CN108983424A

CN108983424A - A kind of nearly eye display device

Info

Publication number: CN108983424A
Application number: CN201810846362.0A
Authority: CN
Inventors: 曹勇; 谢振霖
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2018-07-27
Filing date: 2018-07-27
Publication date: 2018-12-11

Abstract

The embodiment of the present application discloses a kind of nearly eye display device, rapidly adapts to the interpupillary distance of user, promotes user experience.Described device includes: eye tracking device and one or two optical system；The eye tracking device is used to track the pupil of user, and determines the position of the pupil；Each optical system includes: light projector, light fusion device, reflective optical system and electric actuator；The light projector is for emitting the image corresponding light beam to be presented to the pupil；The light beam that the reflective optical system is used to emit the light projector reflects；The smooth fusion device is for converging to the light beam that the reflective optical system reflects in the pupil；The electric actuator is used to determine the first adjustment value of the reflective optical system according to the position of the pupil, and the reflective optical system is adjusted to position indicated by the first adjustment value from current location.

Description

A kind of nearly eye display device

Technical field

This application involves optical treatment technical field more particularly to a kind of nearly eye display devices.

Background technique

Based on virtual display (virtual reality, VR), augmented reality (augmented reality, AR), mixing The display equipment of the nearly eye display technology such as real (mixed reality, MR) is widely used in recent years, and wears this The level of comfort of a little display equipment is many users problem of concern.In general, the interpupillary distance between adult's binocular Between 51 millimeters to 77 millimeters, variable quantity has 26 millimeters, and in order to allow user to have better visual experience, wearing display equipment is needed Adapt to the user of different interpupillary distances.

In traditional scheme, can on the display device increase a mechanical structure, user manually adjust the mechanical structure with Adapt to the interpupillary distance of oneself.

User's many times can be expended above by the mode manually adjusted, and one user of every replacement requires again It manually adjusts, operates very cumbersome.

Summary of the invention

The embodiment of the present application provides a kind of nearly eye display device, for rapidly adapting to user's interpupillary distance, promotes user experience.

In view of this, the application first aspect provides a kind of nearly eye display device, which includes: eye tracking device And one or two optical system.

Wherein, eye tracking device is used to track the pupil of user, and determines the position of pupil.

Each optical system includes: light projector, light fusion device, reflective optical system and electric actuator.

Light projector is for emitting the corresponding light beam of the image to be presented to pupil.

The light beam that reflective optical system is used to emit light projector reflects.

Light fusion device is for converging to the light beam that reflective optical system reflects in pupil.

Electric actuator is used to determine the first adjustment value of reflective optical system according to the position of pupil, and by reflective optical system from current Position is adjusted to position indicated by the first adjustment value.

In this implementation in user's wearing after near-eye display device, near-eye display device will be automatically according to the pupil of user The position of reflective optical system is adjusted in hole site, by the position alignment of the exit pupil position of optical system and pupil, to make The interpupillary distance that closely eye display device is adapted to different user is obtained, this process user is without manually performing any operation, both quickly Again convenient, the user experience is improved.

In one possible implementation, electric actuator is used to search from the first mapping table corresponding with the position of pupil Reflective optical system the first adjustment value.

This implementation provides a kind of mode of the first adjustment value of determining reflective optical system, improves can be achieved for scheme Property.

In one possible implementation, eye tracking device is also used to determine interpupillary distance according to the position of pupil.

Electric actuator from the second mapping table for searching the first adjustment value of reflective optical system corresponding with interpupillary distance.

This implementation provides the mode of another the first adjustment value for determining reflective optical system, improves the flexible of scheme Property.

In one possible implementation, electric actuator is also used to determine the second of light fusion device according to the position of pupil Adjusted value, and light fusion device is adjusted to position indicated by second adjustment value from current location.

It should be noted that electric actuator can search smooth fusion device corresponding with pupil position from the first mapping table Second adjustment value, or search from the second mapping table the second adjustment value of corresponding with interpupillary distance smooth fusion device, Huo Zhetong Cross the second adjustment value that other modes determine light fusion device.

In this implementation, electric actuator can also carry out light fusion device in addition to that reflective optical system can be adjusted It adjusts, improves the flexibility of scheme.

In one possible implementation, light projector includes: laser and optical scanner.

Laser is used to generate the light beam of multiple and different wavelength.

Optical scanner is used to carry out two-dimensional scanning to the light beam of multiple and different wavelength according to default timing and preset path, with Obtain the corresponding light beam of image.

Electric actuator is also used to determine the third adjusted value of optical scanner according to the position of pupil, and by optical scanner from working as Front position is adjusted to position indicated by third adjusted value.

It should be noted that electric actuator can search optical scanner's corresponding with pupil position from the first mapping table Third adjusted value, or search from the second mapping table the third adjusted value of corresponding with interpupillary distance optical scanner, Huo Zhetong Cross the third adjusted value that other modes determine optical scanner.

In this implementation, electric actuator can also carry out optical scanner in addition to that reflective optical system can be adjusted It adjusts, improves the flexibility of scheme.

In one possible implementation, eye tracking device is also used to determine interpupillary distance according to the position of pupil. When interpupillary distance is greater than target range, electric actuator is used to control optical scanner towards close to the movement of the direction of laser.When When interpupillary distance is less than target range, it is mobile away from the direction of laser that electric brake is used to control optical scanner, wherein Target range is the exit pupil position of left eye display optical system and the distance between the exit pupil position of right eye display optical system.

This implementation provides a kind of concrete mode that optical scanner is adjusted in electric actuator, improves scheme Realizability.

In one possible implementation, two optical systems include that left eye display optical system and right eye show light System, eye tracking device are also used to determine interpupillary distance according to the position of pupil.

When interpupillary distance is greater than target range, the electric actuator in left eye display optical system is shown for controlling left eye Reflective optical system in optical system rotates counterclockwise to position indicated by the first adjustment value from current location on the first plane, Target range be left eye display optical system exit pupil position and right eye display optical system the distance between exit pupil position,

When interpupillary distance is greater than target range, the electric actuator in right eye display optical system is shown for controlling right eye Reflective optical system in optical system is rotated clockwise to position indicated by the first adjustment value from current location on the first plane.

It should be noted that interpupillary line refers to that the line between two pupils, orbitomeatal line are socket of the eye lower edges into porus acusticus externus The line of the heart, the interpupillary line of the user and the plane where orbitomeatal line are parallel to first plane, such as the user Plane where interpupillary line and orbitomeatal line can be human body horizontal plane etc..

This implementation provides a kind of mode that reflective optical system is adjusted in electric actuator, and improve scheme can be real Existing property.

When the pupil of user rotates counterclockwise on the first plane, the electric actuator in left eye display optical system is used for Reflective optical system in control left eye display optical system rotates counterclockwise to the first adjustment value from current location on the first plane Indicated position.

When the pupil of user rotates counterclockwise on the first plane, the electric actuator in right eye display optical system is used for Reflective optical system in control right eye display optical system rotates counterclockwise to the first adjustment value from current location on the first plane Indicated position.

Alternatively,

When the pupil of user rotates counterclockwise in the second plane, the electric actuator in left eye display optical system is used for The reflective optical system controlled in left eye display optical system in the second plane rotates counterclockwise to the first adjustment value from current location Indicated position.

When the pupil of user rotates counterclockwise in the second plane, the electric actuator in right eye display optical system is used for The reflective optical system controlled in right eye display optical system in the second plane is rotated clockwise to the first adjustment value from current location Indicated position.

It should be noted that interpupillary line refers to that the line between two pupils, orbitomeatal line are socket of the eye lower edges into porus acusticus externus The line of the heart, the interpupillary line of the user and the plane where orbitomeatal line are parallel to first plane, such as the user Plane where interpupillary line and orbitomeatal line can be human body horizontal plane etc..Second plane vertically and orbitomeatal line, such as can be people Body coronal-plane etc..

This implementation provides the mode that reflective optical system is adjusted in another electric actuator, improves the spirit of scheme Activity.

The application second aspect provides a kind of nearly eye display device, which includes: eye tracking device and one Or two optical systems.Eye tracking device is used to track the pupil of user, and determines the position of pupil.

Light projector is for emitting the corresponding light beam of the image to be presented to user.

Electric actuator is used to determine the first adjustment value of light fusion device according to the position of pupil, and by light fusion device from current Position is adjusted to position indicated by the first adjustment value.

In this implementation in user's wearing after near-eye display device, near-eye display device will be automatically according to the pupil of user The position of light fusion device is adjusted in hole site, by the position alignment of the exit pupil position of optical system and pupil, to make The interpupillary distance that closely eye display device is adapted to different user is obtained, this process user is without manually performing any operation, both quickly Again convenient, the user experience is improved.

In one possible implementation, electric actuator is used to search from the first mapping table corresponding with the position of pupil Light fusion device the first adjustment value.

This implementation provides a kind of mode of the first adjustment value of determining light fusion device, improves can be achieved for scheme Property.

Electric actuator from the second mapping table for searching the first adjustment value of fusion device corresponding with interpupillary distance.

This implementation provides the mode of another the first adjustment value for determining light fusion device, improves the flexible of scheme Property.

Laser is used to generate the light beam of multiple and different wavelength.

Electric actuator is also used to determine the second adjustment value of optical scanner according to the position of pupil, and by optical scanner from working as Front position is adjusted to position indicated by second adjustment value.

It should be noted that electric actuator can search optical scanner's corresponding with pupil position from the first mapping table Second adjustment value, or search from the second mapping table the second adjustment value of corresponding with interpupillary distance optical scanner, Huo Zhetong Cross the second adjustment value that other modes determine optical scanner.

In this implementation, electric actuator can also carry out optical scanner in addition to that light fusion device can be adjusted It adjusts, improves the flexibility of scheme.

In one possible implementation, eye tracking device is also used to determine interpupillary distance according to the position of pupil. When interpupillary distance is greater than target range, the direction that electric actuator is used to control optical scanner towards close laser is mobile, when When interpupillary distance is less than target range, it is mobile away from the direction of laser that electric brake is used to control optical scanner, wherein Target range is the exit pupil position of left eye display optical system and the distance between the exit pupil position of right eye display optical system.

In one possible implementation, two optical systems include that left eye display optical system and right eye show light System.

Eye tracking device is also used to determine interpupillary distance according to the position of pupil.

When interpupillary distance is greater than target range, the electric actuator in left eye display optical system is on the first plane Light fusion device in control left eye display optical system is rotated clockwise to position indicated by the first adjustment value from current location, Target range is the exit pupil position of left eye display optical system and the distance between the exit pupil position of right eye display optical system.

When interpupillary distance is greater than target range, the electric actuator in right eye display optical system is on the first plane Light fusion device in control right eye display optical system rotates counterclockwise to the position that the first adjustment value indicates from current location.

This implementation provides a kind of mode that light fusion device is adjusted in electric actuator, and improve scheme can be real Existing property.

When the pupil of user rotates counterclockwise on the first plane, the electric actuator in left eye display optical system is used for The light fusion device controlled in left eye display optical system on the first plane is rotated clockwise to the first adjustment value from current location Indicated position.

When the pupil of user rotates counterclockwise on the first plane, the electric actuator in right eye display optical system is used for The light fusion device controlled in right eye display optical system on the first plane is rotated clockwise to the first adjustment value from current location Indicated position.

Alternatively,

When the pupil of user rotates counterclockwise in the second plane, the electric actuator in left eye display optical system is used for The light fusion device controlled in left eye display optical system in the second plane is rotated clockwise to the first adjustment value from current location Indicated position.

When the pupil of user rotates counterclockwise in the second plane, the electric actuator in right eye display optical system is used for The light fusion device controlled in right eye display optical system in the second plane rotates counterclockwise to the first adjustment value from current location Indicated position.

It should be noted that interpupillary line refers to that the line between two pupils, orbitomeatal line are socket of the eye lower edges into porus acusticus externus The line of the heart, the interpupillary line of the user and the plane where orbitomeatal line are parallel to first plane, between the pupil of the user Plane where line and orbitomeatal line can be human body horizontal plane etc..Second plane vertically and orbitomeatal line, such as can be human body hat Shape face etc..

This implementation provides the mode that light fusion device is adjusted in another electric actuator, improves the spirit of scheme Activity.

As can be seen from the above technical solutions, the embodiment of the present application has the advantage that

The embodiment of the present application provides a kind of nearly eye display device, the device include: eye tracking device and one or Two optical systems.Wherein, each optical system includes: light projector, light fusion device, reflective optical system and electric actuator.Human eye Tracing equipment is used to track the pupil of user, and determines the position of pupil, and electric actuator is used to determine light according to the position of pupil The first adjustment value of reflector, and reflective optical system is adjusted to position indicated by the first adjustment value from current location.Namely It says, in the application in user's wearing after near-eye display device, near-eye display device will be automatically according to the pupil position pair of user The position of reflective optical system is adjusted, by the position alignment of the exit pupil position of optical system and pupil, so that nearly eye is aobvious Showing device is adapted to the interpupillary distance of different user, this process user not only quickly but also conveniently, mentions without manually performing any operation User experience is risen.

Detailed description of the invention

Technical solution in ord to more clearly illustrate embodiments of the present application, below will be to required use in embodiment description Attached drawing be briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application.

Fig. 1 is one embodiment schematic diagram of nearly eye display device in the embodiment of the present application；

Fig. 2 is another embodiment schematic diagram of nearly eye display device in the embodiment of the present application；

Fig. 3 is the schematic diagram of a scenario that reflective optical system is adjusted in electric actuator in the embodiment of the present application；

Fig. 4 is another embodiment schematic diagram of nearly eye display device in the embodiment of the present application；

Fig. 5 is the schematic diagram of a scenario that light fusion device is adjusted in electric actuator in the embodiment of the present application；

Fig. 6 is a structural schematic diagram of reflective optical system in the embodiment of the present application.

Specific embodiment

Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.

In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application The embodiment of the present application is described in attached drawing.

" first " or " second " for referring in the application etc. is to be used to distinguish similar objects, without specific for describing Sequence or precedence.In addition, the " comprising " or " having " that are referred in present specification and its any deformation, it is intended that cover Cover it is non-exclusive include, for example, the process, method, system, product or equipment for containing a series of steps or units are not necessarily limited to Step or unit those of is clearly listed, but may include be not clearly listed or for these process, methods, product Or other step or units that equipment is intrinsic.

It should be noted that the nearly eye display device in the embodiment of the present invention refers to the display based on nearly eye display technology Equipment, such as VR aobvious, AR glasses.Nearly eye display device in the embodiment of the present application includes eye tracking device and a light System shows for realizing the nearly eye of monocular.Nearly eye display device also may include eye tracking device and two optical systems System, the two optical systems are respectively left eye display optical system and right eye display optical system, are shown for binocular near-eye. Following example will be illustrated so that nearly eye display device includes two optical systems as an example.

Referring to Fig. 1, one embodiment of nearly eye display device 100 includes: eye tracking device in the embodiment of the present application 101, left eye display optical system 102 and right eye display optical system 103.

Wherein, eye tracking device 101 is for determining the pupil of tracking user, and determines the position of pupil.

Left eye display optical system 102 includes: the first light projector 1021, the first smooth fusion device 1023, the reflection of the first light Device 1022 and the first electric actuator 1024.

First light projector 1021 is for emitting the corresponding light beam of the image to be presented to pupil of left eye.

The light beam that first reflective optical system 1022 is used to emit the first light projector 1021 reflects.

First smooth fusion device 1023 is used to converge to the light beam that the first reflective optical system 1022 reflects the pupil of left eye of user In.

First electric actuator 1024 is used to determine the first adjustment value of the first reflective optical system according to the position of pupil of left eye, and First reflective optical system 1022 is adjusted to position indicated by the first adjustment value of the first reflective optical system from current location.

Right eye display optical system 103 includes: the second light projector 1031, the second smooth fusion device 1033, the reflection of the second light Device 1032 and the second electric actuator 1034.

Second light projector 1031 is for emitting the corresponding light beam of the image to be presented to pupil of right eye.

The light beam that second reflective optical system 1032 is used to emit the second light projector 1031 reflects.

Second smooth fusion device 1033 is used to converge to the light beam that the second reflective optical system 1032 reflects the pupil of right eye of user In.

Second electric actuator 1034 is used to determine the first adjustment value of the second reflective optical system according to the position of pupil of right eye, and By the second reflective optical system 1032 position indicated by the whole the first adjustment value to the second reflective optical system in current location.It should be understood that The first adjustment value refers to the adjusted value of reflective optical system in the present embodiment, is not a specific value, left eye display optical system (i.e. the second light is anti-with reflective optical system in right eye display optical system for the first adjustment value of middle reflective optical system (i.e. the first reflective optical system) Emitter) the first adjustment value can be identical or not identical.

In a kind of possible design, electric actuator is also used to pair in addition to being adjusted for the position to reflective optical system The position of light fusion device is adjusted, i.e. the first electric actuator 1024 is also used to the smooth fusion device in position first according to pupil of left eye 1023 second adjustment value, and the first smooth fusion device 1023 is adjusted to position indicated by second adjustment value from current location. Second electric actuator 1034 is also used to determine the second adjustment value of the second smooth fusion device 1033 according to the position of pupil of right eye, and will Second smooth fusion device 1033 is adjusted to position indicated by second adjustment value from current location.

It should be understood that second adjustment value refers to the adjusted value of light fusion device in the present embodiment, and it is not a specific value, it is left The second adjustment value of light fusion device (the i.e. first smooth fusion device) is melted with light in right eye display optical system in eye display optical system The second adjustment value of clutch (the i.e. second smooth fusion device) can be identical or not identical.

In a kind of possible design, light projector can be made of laser and optical scanner, i.e. the first light projector 1021 include: first laser device 10211 and the first optical scanner 10212.Second light projector 1031 includes: second laser 10311 and second optical scanner 10312.

Wherein, first laser device 10211 is used to generate the light beam of multiple and different wavelength.

First optical scanner 10212 is used to carry out the light beam that first laser device generates according to default timing and preset path Two-dimensional scanning is to obtain the corresponding light beam of the image to be presented to pupil of left eye.

Second laser 10311 is used to generate the light beam of multiple and different wavelength.

Second optical scanner 10312 is used to carry out the light beam that second laser generates according to default timing and preset path Two-dimensional scanning is to obtain the corresponding light beam of the image to be presented to pupil of right eye.First electric actuator 1024 is also used to according to pupil Position determine the third adjusted value of the first optical scanner 10212, and the first optical scanner is adjusted to third from current location Position indicated by adjusted value.

Second electric actuator 1034 is also used to determine the third adjustment of the second optical scanner 10312 according to the position of pupil Value, and the second optical scanner is adjusted to position indicated by third adjusted value from current location.

It should be understood that third adjusted value refers to the adjusted value of optical scanner in the present embodiment, and it is not a specific value, it is left Light in the third adjusted value and right eye display optical system of optical scanner's device (i.e. the first optical scanner) in eye display optical system The third adjusted value of scanner (i.e. the second optical scanner) can be identical or not identical.It is left in a kind of possible design Eye display optical system 102 further include: the first semi-transparent semi-reflecting lens 1025, the part light for reflecting the first reflective optical system 1022 Beam is transparent in the first smooth fusion device 1023, and another part light that the first reflective optical system 1022 reflects is reflected into user's left eye In pupil.Right eye display optical system 103 further include: the second semi-transparent semi-reflecting lens 1035, for the second reflective optical system 1032 is anti- The segment beam penetrated is transparent in the second smooth fusion device 1033, and another part light that the second reflective optical system 1032 is reflected reflects Into user's pupil of right eye.

In the present embodiment, either left eye display optical system or right eye display optical system, light are sent out from light projector Out, it being reflected by reflective optical system, light a part of reflective optical system reflection is transparent to light fusion device by semi-transparent semi-reflecting lens, using Light fusion device converges to user's pupil, and another part is directly reflected into user's pupil, so that user's pupil can be presented Correspondence image, then the brain of user merges the image for being presented on pupil of left eye and pupil of right eye, to generate free Between the 3D visual effect felt, realize that nearly eye is shown, as shown in Figure 2.

Eye tracking device 101 during user uses nearly eye display device 100, in nearly eye display device 100 Can be with automatic tracing user's pupil, behind the position for determining pupil of left eye and pupil of right eye, the first electric actuator 1024 and the second electricity Actuator 1034 can change the emergent pupil of left eye display optical system and right eye display optical system by following several modes Position, so that the position alignment of the exit pupil position of left eye display optical system and pupil of left eye, right eye display optical system goes out The position alignment of pupil position and pupil of right eye.

(1), the position of reflective optical system is adjusted.

1, the first electric actuator 1024 searches the first light reflection corresponding with the position of pupil of left eye from the first mapping table The first adjustment value of device 1022, and the first reflective optical system 1022 is adjusted to position indicated by the first adjustment value from current location It sets.Second electric actuator 1034 searches the second reflective optical system 1032 corresponding with the position of pupil of right eye from the first mapping table The first adjustment value, and the second reflective optical system 1032 is adjusted to position indicated by the first adjustment value from current location.

Specifically, reflective optical system can be adjusted to the first adjustment value institute from current location in the following way by electric actuator The position of instruction.

When the pupil of user rotates counterclockwise on the first plane, the first electric actuator 1024 is controlling the reflection of the first light Device 1022 rotates counterclockwise on the first plane from current location indicated by the first adjustment value of the first reflective optical system 1022 Position, the second electric actuator 1034 are rotated counterclockwise to from current location on the first plane in the second reflective optical system 1032 of control Position indicated by the first adjustment value of second reflective optical system 1032.

When the pupil of user rotates clockwise on the first plane, the first electric actuator 1024 is controlling the reflection of the first light Device 1022 is rotated clockwise to indicated by the first adjustment value of the first reflective optical system 1022 on the first plane from current location Position, the second electric actuator 1034 are rotated clockwise to from current location on the first plane in the second reflective optical system 1032 of control Position indicated by the first adjustment value of second reflective optical system 1032.

When the pupil of user rotates counterclockwise in the second plane, the first electric actuator 1024 controls the first reflective optical system 1022 rotate counterclockwise to position indicated by the first adjustment value of the first reflective optical system 1022 from current location in the second plane It sets, the second electric actuator 1034 controls the second reflective optical system 1032 and is rotated clockwise to second from current location in the second plane Position indicated by the first adjustment value of reflective optical system 1032.

When the pupil of user rotates clockwise in the second plane, the first electric actuator 1024 controls the first reflective optical system 1022 are rotated clockwise to position indicated by the first adjustment value of the first reflective optical system 1022 from current location in the second plane It sets, the second electric actuator 1034 controls the second reflective optical system 1032 and rotates counterclockwise to second from current location in the second plane Position indicated by the first adjustment value of reflective optical system 1032.

2, eye tracking device determines interpupillary distance according to the position of pupil, and the first electric actuator 1024 is from the second mapping table The middle the first adjustment value for searching corresponding with the interpupillary distance the first reflective optical system 1022, and by the first reflective optical system 1022 from working as Front position is adjusted to position indicated by the first adjustment value.Second electric actuator 1034 is searched and the pupil from the second mapping table The first adjustment value apart from corresponding second reflective optical system 1032, and the second reflective optical system 1032 is adjusted to from current location Position indicated by one adjusted value.

Specifically, electric actuator can adjust reflective optical system in the following way.

If the interpupillary distance is greater than target range, the first electric actuator 1024 drives the first reflective optical system 1022 first Position indicated by the first adjustment value is rotated counterclockwise to from current location in plane.Second electric actuator 1034 drives the second light Reflector 1032 is rotated clockwise to position indicated by the first adjustment value from current location on the first plane.

If the interpupillary distance is less than target range, the first electric actuator 1024 drives the first reflective optical system 1022 first Position indicated by the first adjustment value is rotated clockwise to from current location in plane.Second electric actuator 1034 drives the second light Reflector 1032 rotates counterclockwise to position indicated by the first adjustment value from current location on the first plane.

Citing is illustrated below, and the second mapping table is as shown in table 1 below, wherein the angle of the reflective optical system of table 1 refers to The angle deflected using initial position by origin.When eye display device 100 close in user's wearing, eye tracking device 101 is counted The interpupillary distance of user is calculated, the first electric actuator 1024 inquires second mapping table and determines corresponding first light of the interpupillary distance Then first reflective optical system 1022 is turned to the corresponding position of the angle, the second electric actuator by the angle of reflector 1022 1034 inquire the angle that the mapping table determines corresponding second reflector 1032 of the interpupillary distance, then by the second reflector 1032 The corresponding position of the angle is turned to, for example, interpupillary distance is 53 millimeters, the first electric actuator 1024 is true according to the second mapping table The angle of fixed first reflector 1022 is 20 °, and the second electric actuator 1034 determines the angle of the second emitter 1032 according to mapping table Degree is -20 °, and the current angle of the first reflector 1022 is 0 °, and the current angle of the second reflector 1032 is 0 °, i.e., the first reflection Device 1022 and the second reflector 1032 are located at initial position, and the first electric actuator 1024 rotates clockwise the first reflector 1022, The first reflector 1022 is set to deflect 20 °, the second electric actuator 1034 rotates counterclockwise the second reflector 1032, makes the first reflector 1022 20 ° of deflections.

Table 1

(2), the position of reflective optical system and light fusion device is adjusted.

3, the first electric actuator 1024 searches the first light reflection corresponding with the position of pupil of left eye from the first mapping table The second adjustment value of the first adjustment value of device 1022 and the first smooth fusion device 1023, by the first reflective optical system 1022 from present bit It sets and is adjusted to position indicated by the first adjustment value, and the first smooth fusion device 1023 is adjusted to second adjustment value from current location Indicated position.It is anti-that second electric actuator 1034 searches the second light corresponding with the position of pupil of right eye from the first mapping table The second adjustment value of the first adjustment value of emitter 1032 and the second smooth fusion device 1033, by the second reflective optical system 1032 from current Position is adjusted to position indicated by the first adjustment value, and the second smooth fusion device 1033 is adjusted to second adjustment from current location The indicated position of value.

Specifically, electric actuator can adjust in the following way reflective optical system and light fusion device:

When the pupil of user rotates counterclockwise on the first plane, the first electric actuator 1024 is controlling the reflection of the first light Device 1022 rotates counterclockwise on the first plane from current location indicated by the first adjustment value of the first reflective optical system 1022 Position, and control the first smooth fusion device 1023 and be rotated clockwise to position indicated by second adjustment value on the first plane.The Two electric actuators 1034 rotate counterclockwise to the second light from current location on the first plane in the second reflective optical system 1032 of control Position indicated by the first adjustment value of reflector 1032, and control the second smooth fusion device 1033 and turn clockwise on the first plane Move position indicated by second adjustment value.

When the pupil of user rotates clockwise on the first plane, the first electric actuator 1024 is controlling the reflection of the first light Device 1022 is rotated clockwise to indicated by the first adjustment value of the first reflective optical system 1022 on the first plane from current location Position, and control the first smooth fusion device 1023 and rotate counterclockwise to position indicated by second adjustment value on the first plane.The Two electric actuators 1034 are rotated clockwise to the second light from current location on the first plane in the second reflective optical system 1032 of control Position indicated by the first adjustment value of reflector 1032, and control the second smooth fusion device 1033 and turn counterclockwise on the first plane Move position indicated by second adjustment value.

When the pupil of user rotates counterclockwise in the second plane, the first electric actuator 1024 controls the first reflective optical system 1022 rotate counterclockwise to position indicated by the first adjustment value of the first reflective optical system 1022 from current location in the second plane It sets, and controls the first smooth fusion device 1023 and be rotated clockwise to position indicated by second adjustment value in the second plane.Second Electric actuator 1034 controls the second reflective optical system 1032 and is rotated clockwise to the reflection of the second light from current location in the second plane Position indicated by the first adjustment value of device 1032, and control the second smooth fusion device 1033 and rotated counterclockwise in the second plane Position indicated by second adjustment value.

When the pupil of user rotates clockwise in the second plane, the first electric actuator 1024 controls the first reflective optical system 1022 are rotated clockwise to position indicated by the first adjustment value of the first reflective optical system 1022 from current location in the second plane It sets, and controls the first smooth fusion device 1023 and rotate counterclockwise to position indicated by second adjustment value in the second plane.Second Electric actuator 1034 controls the second reflective optical system 1032 and rotates counterclockwise to the reflection of the second light from current location in the second plane Position indicated by the first adjustment value of device 1032, and control the second smooth fusion device 1033 and be rotated clockwise in the second plane Position indicated by second adjustment value.

4, eye tracking device determines interpupillary distance according to the position of pupil, and the first electric actuator 1024 is from the second mapping table The of the middle the first adjustment value for searching corresponding with the interpupillary distance the first reflective optical system 1022 and the first smooth fusion device 1023 First reflective optical system 1022 is adjusted to position indicated by the first adjustment value from current location by two adjusted values, and by the first light Fusion device 1023 is adjusted to position indicated by second adjustment value from current location.Second electric actuator 1034 is from the second mapping table The of the middle the first adjustment value for searching corresponding with the interpupillary distance the second reflective optical system 1032 and the second smooth fusion device 1033 Second reflective optical system 1032 is adjusted to position indicated by the first adjustment value from current location by two adjusted values, and by the second light Fusion device 1033 is adjusted to position indicated by second adjustment value from current location.

If the interpupillary distance is greater than target range, the first electric actuator 1024 drives the first reflective optical system 1022 first Position indicated by the first adjustment value is rotated counterclockwise to from current location in plane, and the first smooth fusion device 1023 is driven to exist Position indicated by second adjustment value is rotated clockwise to from current location in first plane.Second electric actuator 1034 driving the Two reflective optical systems 1032 are rotated clockwise to position indicated by the first adjustment value on the first plane, and the second light is driven to melt Clutch 1033 rotates counterclockwise to position indicated by second adjustment value on the first plane.

If the interpupillary distance is less than target range, the first electric actuator 1024 drives the first reflective optical system 1022 first It is rotated clockwise to position indicated by the first adjustment value in plane, and drives the first smooth fusion device 1023 on the first plane Rotate counterclockwise to position indicated by second adjustment value.Second electric actuator 1034 drives the second reflective optical system 1032 first Position indicated by the first adjustment value is rotated counterclockwise in plane, and drives the second smooth fusion device 1033 on the first plane It is rotated clockwise to position indicated by second adjustment value.

(3), the position of reflective optical system and optical scanner is adjusted.

5, the first electric actuator 1024 searches the first light reflection corresponding with the position of pupil of left eye from the first mapping table The third adjusted value of the first adjustment value of device 1022 and the first optical scanner 10212, by the first reflective optical system 1022 from current Position is adjusted to position indicated by the first adjustment value, and the first optical scanner 10212 is adjusted to third tune from current location Position indicated by whole value.Second electric actuator 1034 searches corresponding with the position of pupil of right eye second from the first mapping table The third adjusted value of the first adjustment value of reflective optical system 1032 and the second optical scanner 10312, by the second reflective optical system 1032 It is adjusted to position indicated by the first adjustment value from current location, and the second optical scanner 10312 is adjusted to from current location Position indicated by third adjusted value.

6, eye tracking device determines interpupillary distance according to the position of pupil, and the first electric actuator 1024 is from the second mapping table The of the middle the first adjustment value for searching corresponding with the interpupillary distance the first reflective optical system 1022 and the first optical scanner 10212 First reflective optical system 1022 is adjusted to position indicated by the first adjustment value from current location by three adjusted values, and by the first light Scanner 10212 is adjusted to position indicated by third adjusted value from current location.Second electric actuator 1034 is mapped from second The first adjustment value and the second optical scanner 10312 of corresponding with the interpupillary distance the second reflective optical system 1032 are searched in table Second reflective optical system 1032 is adjusted to position indicated by the first adjustment value from current location by third adjusted value, and by second Optical scanner 10312 is adjusted to position indicated by third adjusted value from current location.

Specifically, when interpupillary distance is greater than target range, the first electric actuator 1024 controls the first reflective optical system 1022 And second electric actuator 1034 control the second reflective optical system 1032 rotation mode and preceding method 2 described in mode class Seemingly, details are not described herein again, in conjunction with the rotation of the first reflective optical system 1022 and the second reflective optical system 1032, the first electric actuator 1024 The first optical scanner 10212 can be also controlled to be moved to indicated by third adjusted value towards the direction close to first laser device 10211 Position, the second electric actuator 1034 can also control the second optical scanner 10312 towards close to second laser 10311 direction It is moved to position indicated by third adjusted value.

When interpupillary distance is less than target range, the first electric actuator 1024 controls the first reflective optical system 1022 and second The mode that electric actuator 1034 controls the rotation of the second reflective optical system 1032 is similar with mode described in preceding method 2, herein not It repeats again, in conjunction with the rotation of the first reflective optical system 1022 and the second reflective optical system 1032, the first electric actuator 1024 can also be controlled First optical scanner 10212 is moved to position indicated by third adjusted value away from the direction of first laser device 10211, the Two electric actuators 1034 can also control the second optical scanner 10312 and be moved to away from the direction of second laser 10311 Position indicated by three adjusted values.

(4), the position of reflective optical system, light fusion device and optical scanner is adjusted.

7, the first electric actuator 1024 searches the first light reflection corresponding with the position of pupil of left eye from the first mapping table The first adjustment value of device 1022, the second adjustment value of the first smooth fusion device 1023 and the third tune of the first optical scanner 10212 First reflective optical system 1022 is adjusted to position indicated by the first adjustment value from current location, by the first smooth fusion device by whole value 1023 are adjusted to position indicated by two adjusted values from current location, and the first optical scanner 10212 is adjusted from current location To position indicated by third adjusted value.Second electric actuator 1034 is searched and the position pair of pupil of right eye from the first mapping table The first adjustment value for the second reflective optical system 1032 answered, the second adjustment value of the second smooth fusion device 1033 and the second optical scanner Second reflective optical system 1032 is adjusted to position indicated by the first adjustment value from current location by 10312 third adjusted value, will Second smooth fusion device 1033 is adjusted to position indicated by two adjusted values from current location, and by the second optical scanner 10312 from Current location is adjusted to position indicated by third adjusted value.

8, eye tracking device determines interpupillary distance according to the position of pupil, and the first electric actuator 1024 is from the second mapping table The middle the first adjustment value for searching the first reflective optical system 1022 corresponding with the interpupillary distance, the second of the first smooth fusion device 1023 are adjusted The third adjusted value of whole value and the first optical scanner 10212, are adjusted to first from current location for the first reflective optical system 1022 First smooth fusion device 1023 is adjusted to position indicated by two adjusted values from current location by position indicated by adjusted value, and First optical scanner 10212 is adjusted to position indicated by third adjusted value from current location.Second electric actuator 1034 from The first adjustment value of the second reflective optical system 1032 corresponding with interpupillary distance, the second smooth fusion device 1033 are searched in second mapping table Second adjustment value and the second optical scanner 10312 third adjusted value, by the second reflective optical system 1032 from current location tune It is whole to arrive position indicated by the first adjustment value, the second smooth fusion device 1033 is adjusted to indicated by two adjusted values from current location Position, and the second optical scanner 10312 is adjusted to position indicated by third adjusted value from current location.

Specifically, when interpupillary distance is greater than target range, the first electric actuator 1024 controls the first reflective optical system 1022 And the first smooth fusion device 1023, the second electric actuator 1034 control the second reflective optical system 1032 and the second smooth fusion device 1033 The mode of rotation is similar with mode described in preceding method 4, and details are not described herein again, in conjunction with the first reflective optical system 1022, first The rotation of light fusion device 1023, the second reflective optical system 1032 and the second smooth fusion device 1033, the first electric actuator 1024 can also It controls the first optical scanner 10212 and is moved to position indicated by third adjusted value towards the direction close to first laser device 10211 It sets, the second electric actuator 1034 can also control the second optical scanner 10312 towards close to the movement of the direction of second laser 10311 To position indicated by third adjusted value.

When interpupillary distance is greater than target range, the first electric actuator 1024 controls the first reflective optical system 1022 and first Light fusion device 1023, the side that the second electric actuator 1034 control the second reflective optical system 1032 and the second smooth fusion device 1033 rotate Formula is similar with mode described in preceding method 4, and details are not described herein again, in conjunction with the first reflective optical system 1022, the first smooth fusion device 1023, the rotation of the second reflective optical system 1032 and the second smooth fusion device 1033, the first electric actuator 1024 can also control first Optical scanner 10212 is moved to position indicated by third adjusted value, the second electricity away from the direction of first laser device 10211 Actuator 1034 can also control the second optical scanner 10312 and be moved to third tune away from the direction of second laser 10311 Position indicated by whole value.

It should be noted that the first mapping table in above-mentioned each implementation can be tester for eyeball phantom Pupil is moved to different positions, is calculated by nearly eye display device according to the pupil of different location, can also be with It is that tester empirically sets and be input to nearly eye display device, can also be nearly eye display device from other equipment It obtains, specific the application is not construed as limiting.It should also be understood that nearly eye display device can be configured with first mapping table, it is used for First electric actuator 1024 and the second electric actuator 1034 inquire adjusted value, and nearly eye display device can also configure that there are two the One mapping table, one is inquired adjusted value for the first electric actuator 1024, another inquires adjusted value for the second electric actuator.

The second mapping table in above-mentioned each implementation can be tester by nearly eye display device to different pupils Away from eyeball phantom carry out measuring and calculation and obtain, be also possible to tester and empirically set and be input to nearly eye display dress It sets, can also be what nearly eye display device was obtained from other equipment, specific the application is not construed as limiting.It should also be understood that nearly eye Display device can be configured with second mapping table, inquire for the first electric actuator 1024 and the second electric actuator 1034 Adjusted value, nearly eye display device can also be configured there are two the second mapping table, and one is adjusted for the inquiry of the first electric actuator 1024 Whole value, another inquires adjusted value for the second electric actuator.

It should also be noted that, the interpupillary line of user and the plane where orbitomeatal line in the present embodiment and subsequent embodiment It is parallel to the first plane, the second plane is perpendicular to the straight line where the orbitomeatal line of user, specifically, works as body erect, face Forwards, when two fronts at eye level, the first plane can be understood as the plane with human body cross section in parallel, and the second plane can be with It is interpreted as the plane in parallel with human coronary face.

It should also be noted that, target interpupillary distance refers to left eye display optical system in the present embodiment and subsequent embodiment Current exit pupil position and current the distance between the exit pupil position of right eye display optical system.

It should be understood that electric actuator is in addition to that can search pupil position pair from the first mapping table in above-mentioned each implementation The first adjustment value for the reflective optical system answered can also calculate the first of reflective optical system corresponding with pupil position by following formula Adjusted value:

Atan2 θ=c (1).

Wherein, c is the displacement of initial pupil position to current pupil position, and a is distance of the reflective optical system to optical scanner, The angle that θ is deflected by reflective optical system relative to initial position.

Specifically, eye tracking device 101 can determine the pupil position of user, and eye tracking device calculates the pupil Position and initial pupil position distance c, electric actuator determine current reflective optical system and optical scanner distance a, then foundation Above-mentioned formula (1) calculates θ, and reflective optical system is turned to the position relative to initial position deflection θ.

Electric actuator can also be calculated by above-mentioned formula (1) for the first of corresponding first reflective optical system of pupil position Adjusted value and the third adjusted value of the first optical scanner, specifically, eye tracking device calculates pupil position and initial bit After the distance c set, the mobile optical scanner of electric actuator also, rotation reflective optical system, so that optical scanner and light reflect after mobile Reflective optical system meets above-mentioned formula (1) relative to the angle, θ that initial position deflects after the distance a of device, and deflection.

As shown in figure 3, Fig. 3 is that the pupil of user's left eye and the top view of nearly eye display device, system preset left eye The initial position of pupil is in E₁, the position of the first optical scanner 10212 is in Q₁, the initial position of the first reflective optical system 1022 exists P₂₁, Q₁With P₂₁Distance a be equal to 6mm, the outgoing optical position of left eye display optical system 102 is in O at this time₁, melt by the first light After clutch 1023 converges, I is converged in₁Place is located at E₁Pupil of left eye obtain retinal projection, it is seen that the first image.User puts on After nearly eye display device, eye tracking device 101 detects user's pupil of left eye position in E₂, the calculating of eye tracking device 101 E out₁To E₂Displacement c be -2.1mm, be calculated θ=- 20 ° according to above-mentioned formula (1), the first electric actuator 1024 is counterclockwise The first reflective optical system 1022 is rotated, so that the first reflective optical system 1022, which deflects 20 °, arrives position P₂₂, at this point, left eye shows optical system The outgoing optical position of system 102 is in O₂, after the first smooth 1023 optically focused of fusion device, converge in I₂Place is located at E₂Pupil of left eye obtain Obtain retinal projection, it is seen that the first image.

It should be understood that nearly eye display device is also possible to advance with eyeball phantom and configure first through the above way and map Table records the position of reflective optical system corresponding to different pupil positions, as shown in Figure 3 above, pupil of left eye position E₁It is right The position for the first reflective optical system 1022 answered is P₂₁, pupil of left eye position E₂The position of corresponding first reflective optical system 1022 is P₂₂, then when detecting that user's pupil of left eye is located at E₁When, the first electric actuator 1024 deflects the first reflective optical system 1022 in place Set P₂₁, when detecting that user's pupil of left eye is located at E₂When, the first electric actuator 1024 deflects the first reflective optical system 1022 in place Set P₂₂。

Secondly, the electric actuator in the embodiment of the present application can determine the adjusted value of adjusting means in several ways, it can To change the exit pupil position of optical system in several ways, so that exit pupil position is aligned with pupil position, scheme is improved Flexibility.

Referring to Fig. 4, another embodiment of nearly eye display device 200 includes: in the embodiment of the present application

Eye tracking device 201, left eye display optical system 202 and right eye display optical system 203.

Wherein, eye tracking device 201 is for determining the pupil of tracking user, and determines the position of pupil.

Left eye display optical system 202 includes: the first light projector 2021, the first smooth fusion device 2023, the reflection of the first light Device 2022 and the first electric actuator 2024.

First light projector 2021 is for emitting the corresponding light beam of the image to be presented to pupil of left eye.

The light beam that first reflective optical system 2022 is used to emit the first light projector 2021 reflects.

First smooth fusion device 2023 is used to converge to the light beam that the first reflective optical system 2022 reflects the pupil of left eye of user In.

First electric actuator 2024 is used to determine the first adjustment value of the first smooth fusion device according to the position of pupil of left eye, and First smooth fusion device 2022 is adjusted to position indicated by the first adjustment value of the first smooth fusion device from current location.

Right eye display optical system 203 includes: the second light projector 2031, the second smooth fusion device 2033, the reflection of the second light Device 2032 and the second electric actuator 2034.

Second light projector 2031 is for emitting the corresponding light beam of the image to be presented to pupil of right eye.

The light beam that second reflective optical system 2032 is used to emit the second light projector 2031 reflects.

Second smooth fusion device 2033 is used to converge to the light beam that the second reflective optical system 2032 reflects the pupil of right eye of user In.

Second electric actuator 2034 is used to determine the first adjustment value of the second smooth fusion device according to the position of pupil of right eye, and By the second smooth fusion device 2032 position indicated by the whole the first adjustment value to the second smooth fusion device in current location.

It should be understood that the first adjustment value refers to the adjusted value of light fusion device in the present embodiment, and it is not a specific value, it is left The first adjustment value of light fusion device (the i.e. first smooth fusion device) is melted with light in right eye display optical system in eye display optical system The first adjustment value of clutch (the i.e. second smooth fusion device) can be identical or not identical.

In a kind of possible design, left eye display optical system 202 further include: the first semi-transparent semi-reflecting lens 2025 are used for The segment beam that first reflective optical system 2022 reflects is transparent in the first smooth fusion device 2023, and by the first reflective optical system 2022 Another part light of reflection is reflected into user's pupil of left eye.Right eye display optical system 203 further include: the second semi-transparent semi-reflecting lens 2035, the segment beam for reflecting the second reflective optical system 2032 is transparent in the second smooth fusion device 2033, and by the second light Another part light that reflector 2032 reflects is reflected into user's pupil of right eye.

In a kind of possible design, light projector can be made of laser and optical scanner, i.e. the first light projector 2021 include: first laser device 20211 and the first optical scanner 20212.Second light projector 2031 includes: second laser 20311 and second optical scanner 20312.

Wherein, first laser device 20211 is used to generate the light beam of multiple and different wavelength.

First optical scanner 20212 is used to carry out the light beam that first laser device generates according to default timing and preset path Two-dimensional scanning is to obtain the corresponding light beam of the image to be presented to pupil of left eye.

Second laser 20311 is used to generate the light beam of multiple and different wavelength.

Second optical scanner 20312 is used to carry out the light beam that second laser generates according to default timing and preset path Two-dimensional scanning is to obtain the corresponding light beam of the image to be presented to pupil of right eye.

First electric actuator 2024 is also used to determine the second adjustment of the first optical scanner 20212 according to the position of pupil Value, and the first optical scanner is adjusted to position indicated by second adjustment value from current location.

Second electric actuator 2034 is also used to determine the second adjustment of the second optical scanner 20312 according to the position of pupil Value, and the second optical scanner is adjusted to position indicated by third adjusted value from current location.

It should be understood that second adjustment value refers to the adjusted value of optical scanner in the present embodiment, and it is not a specific value, it is left The second adjustment value of optical scanner's device (i.e. the first optical scanner) and light in right eye display optical system in eye display optical system The second adjustment value of scanner (i.e. the second optical scanner) can be identical or not identical.

Eye tracking device 201 during user uses nearly eye display device 200, in nearly eye display device 200 Can be with automatic tracing user's pupil, behind the position for determining pupil of left eye and pupil of right eye, the first electric actuator 2024 and the second electricity Actuator 2034 can change the emergent pupil of left eye display optical system and right eye display optical system by following several modes Position, so that the position alignment of the exit pupil position of left eye display optical system and pupil of left eye, right eye display optical system goes out The position alignment of pupil position and pupil of right eye:

(1), the position of light fusion device is adjusted.

1, the first electric actuator 2024 searches the first light fusion corresponding with the position of pupil of left eye from the first mapping table The first adjustment value of device 2023, and the first smooth fusion device 2023 is adjusted to position indicated by the first adjustment value from current location It sets.Second electric actuator 2034 searches the second smooth fusion device 2033 corresponding with the position of pupil of right eye from the first mapping table The first adjustment value, and the second smooth fusion device 2033 is adjusted to position indicated by the first adjustment value from current location.

Specifically, light fusion device can be adjusted to the first adjustment value institute from current location in the following way by electric actuator The position of instruction:

When the pupil for determining user rotates counterclockwise on the first plane, the first electric actuator 2024 drives the fusion of the first light Device 2023 is rotated clockwise to position indicated by the first adjustment value, the second electric actuator 2034 driving second on the first plane Light fusion device 2033 is rotated clockwise to position indicated by the first adjustment value in the first plane.

When the pupil for determining user rotates clockwise on the first plane, the first electric actuator 2024 drives the fusion of the first light Device 2023 rotates counterclockwise to position indicated by the first adjustment value, the second electric actuator 2034 driving second on the first plane Light fusion device 2033 rotates counterclockwise to position indicated by the first adjustment value in the first plane.

When the pupil for determining user rotates counterclockwise in the second plane, the first electric actuator 2024 drives the first light to melt Clutch 2023 is rotated clockwise to position indicated by the first adjustment value in the second plane, the second electric actuator 2034 driving the Two smooth fusion devices 2033 rotate counterclockwise to position indicated by the first adjustment value in the second plane.

When the pupil for determining user rotates clockwise in the second plane, the first electric actuator 2024 drives the first light to melt Clutch 2023 rotates counterclockwise to position indicated by the first adjustment value in the second plane, the second electric actuator 2034 driving the Two smooth fusion devices 2033 are rotated clockwise to position indicated by the first adjustment value in the second plane.

2, eye tracking device determines interpupillary distance according to the position of pupil, and the first electric actuator 2024 is from the second mapping table The middle the first adjustment value for searching corresponding with the interpupillary distance the first smooth fusion device 2023, and by the first smooth fusion device 2023 from working as Front position is adjusted to position indicated by the first adjustment value.Second electric actuator 2034 is searched and the pupil from the second mapping table The first adjustment value apart from corresponding second smooth fusion device 2033, and the second smooth fusion device 2033 is adjusted to from current location Position indicated by one adjusted value.

If the interpupillary distance is greater than target range, the first electric actuator 2024 driving the first smooth fusion device 2023 is first Position indicated by the first adjustment value is rotated clockwise in plane, the second electric actuator 2034 drives the second smooth fusion device 2033 Position indicated by the first adjustment value is rotated counterclockwise on the first plane.

If the interpupillary distance is less than target range, the first electric actuator 2024 driving the first smooth fusion device 2023 is first Position indicated by the first adjustment value is rotated counterclockwise in plane, the second electric actuator 2034 drives the second smooth fusion device 2033 It is rotated clockwise to position indicated by the first adjustment value on the first plane.

(2), the position of light fusion device and optical scanner is adjusted.

3, the first electric actuator 2024 searches the first light fusion corresponding with the position of pupil of left eye from the first mapping table The first adjustment value of device 2023 and the second adjustment value of the first optical scanner 20212, by the first smooth fusion device 2023 from current Position is adjusted to position indicated by the first adjustment value, and the first optical scanner 20212 is adjusted to the second tune from current location Position indicated by whole value.Second electric actuator 2034 searches corresponding with the position of pupil of right eye second from the first mapping table The first adjustment value of light fusion device 2033 and the second adjustment value of the second optical scanner 20312, by the second smooth fusion device 2033 It is adjusted to position indicated by the first adjustment value from current location, and the second optical scanner 20312 is adjusted to from current location Position indicated by second adjustment value.

4, eye tracking device determines interpupillary distance according to the position of pupil, and the first electric actuator 2024 is from the second mapping table The of the middle the first adjustment value for searching corresponding with the interpupillary distance the first smooth fusion device 2023 and the first optical scanner 20212 First smooth fusion device 2023 is adjusted to position indicated by the first adjustment value from current location by two adjusted values, and by the first light Scanner 20212 is adjusted to position indicated by second adjustment value from current location.Second electric actuator 2034 is mapped from second The first adjustment value and the second optical scanner 20312 of corresponding with the interpupillary distance the second smooth fusion device 2033 are searched in table Second smooth fusion device 2033 is adjusted to position indicated by the first adjustment value from current location by second adjustment value, and by second Optical scanner 20312 is adjusted to position indicated by second adjustment value from current location.

Specifically, when interpupillary distance is greater than target range, the first electric actuator 2024 controls the first smooth fusion device 2023 And the second mode class described in the mode that rotates of the second smooth fusion device 2033 of control of electric actuator 2034 and preceding method 2 Seemingly, details are not described herein again, in conjunction with the rotation of the first smooth fusion device 2023 and the second smooth fusion device 2033, the first electric actuator 2024 The first optical scanner 20212 can be also controlled to be moved to indicated by second adjustment value towards the direction close to first laser device 20211 Position, the second electric actuator 2034 can also control the second optical scanner 20312 towards close to second laser 20311 direction It is moved to position indicated by second adjustment value.

When interpupillary distance is less than target range, the first electric actuator 2024 controls the first smooth fusion device 2023 and second The mode that the smooth fusion device 2033 of the control of electric actuator 2,034 second rotates is similar with mode described in preceding method 2, herein not It repeats again, in conjunction with the rotation of the first smooth fusion device 2023 and the second reflective optical system 2033, the first electric actuator 2024 can also be controlled First optical scanner 20212 is moved to position indicated by second adjustment value away from the direction of first laser device 20211, the Two electric actuators 2034 can also control the second optical scanner 20312 and be moved to away from the direction of second laser 20311 Position indicated by two adjusted values.

It should be understood that electric actuator is in addition to that can search pupil position pair from the first mapping table in above-mentioned each implementation The first adjustment value for the light fusion device answered can also calculate the first of smooth fusion device corresponding with pupil position by following formula Adjusted value:

δ=- tan^-1(c/(d+b))/2 (2)。

Wherein, c is the displacement that current pupil position is arrived in initial pupil position, d for light fusion device and semi-transparent semi-reflecting lens away from From b is distance of the semi-transparent semi-reflecting lens to pupil position, and δ is the angle that light fusion device is deflected relative to initial position.

Specifically, eye tracking device 201 can determine the pupil position of user, and eye tracking device calculates the pupil Position and initial pupil position distance c, electric actuator determine light fusion device and semi-transparent semi-reflecting lens distance d and semi-transparent semi-reflecting Then mirror calculates δ according to above-mentioned formula (2), light fusion device is turned to relative to initial bit to the distance b of the pupil position Set the position of deflection δ.

As shown in figure 5, Fig. 5 is that the pupil of user's left eye and the top view of nearly eye display device, system preset left eye The initial position of pupil is in E₃, the initial position of the first smooth fusion device 2023 is in M₁, the half-reflecting half mirror of left eye display optical system Position in N₁, M₁To N₁Distance d be 20mm, N₁To E₃Distance b be 5mm.After user puts on nearly eye display device, human eye is chased after Track equipment 201 detects user's pupil of left eye position in E₄, calculate E₃To E₄Displacement c be -3.5mm, according to above-mentioned formula (2) δ=4 ° are calculated, i.e. the first electric actuator 2024 rotates clockwise the first smooth fusion device 2023, so that the first light merges Device 2023 deflects 4 ° and arrives position M₂。

It should be understood that nearly eye display device is also possible to advance with eyeball phantom and has configured mapping table through the above way, The position of light fusion device corresponding to different pupil positions is recorded, as shown in Figure 4 above, pupil of left eye position E₃It is corresponding The position of first smooth fusion device 2023 is M₁, pupil of left eye position E₄The position of corresponding first smooth fusion device 2023 is M₂, then when Detect that user's pupil of left eye is located at E₃When, the first smooth fusion device 2023 is deflected into position M by the first electric actuator 2024₁, work as inspection It measures user's pupil of left eye and is located at E₂When, the first smooth fusion device 2023 is deflected into position M by the first electric actuator 2024₂。

The embodiment of the present application provides a kind of nearly eye display device, the device include: eye tracking device and one or Two optical systems.Wherein, each optical system includes: light projector, light fusion device, reflective optical system and electric actuator.Human eye Tracing equipment is used to track the pupil of user, and determines the position of pupil, and electric actuator is used to determine light according to the position of pupil The first adjustment value of fusion device, and light fusion device is adjusted to position indicated by the first adjustment value from current location.Namely It says, in the application in user's wearing after near-eye display device, near-eye display device will be automatically according to the pupil position pair of user The position of reflective optical system is adjusted, by the position alignment of the exit pupil position of optical system and pupil, so that nearly eye is aobvious Showing device is adapted to the interpupillary distance of different user, this process user not only quickly but also conveniently, mentions without manually performing any operation User experience is risen.

It should be noted that it includes at least three semiconductor lasers that above-mentioned Fig. 1 or Fig. 4, which correspond to the laser in optical system, Chip, these semiconductor laser chips are formed using integral packaging, using the optical devices such as free space, optical waveguide, optical fiber reality The transmitting of existing multi-path laser light beam.

Or the laser in optical system includes multi-resonant chamber integral type encapsulation pump laser, which can produce Raw multiple wavelength lasers, can specifically be converted to the laser of required different wave length by nonlinear crystal.

It should be understood that above-mentioned Fig. 1, which corresponds to the laser in optical system, can also be that other can carry out conjunction beam, whole to light beam The other kinds of packaged light source of shape and modulation, specific the application are not construed as limiting.

Above-mentioned Fig. 1 or Fig. 4, which corresponds to the optical scanner in optical system, can be two-dimentional MEMS (micro- Electro-mechanical system, MEMS) scanning galvanometer, the driving method of the MEMS scanning galvanometer can be electromagnetism, quiet The modes such as electricity, piezoelectricity, electric heating drive.The optical scanner is also possible to two dimension reflection scanning means, which reflects scanning means It can be driven by modes such as Lamb waves.The optical scanner can also be other equipment with high frequency two-dimensional scanning function, tool Body the application is not construed as limiting.

Above-mentioned Fig. 1 or Fig. 4 corresponds to light fusion device in optical system, also known as photo-coupler, has and distinguishes specific wavelength The function being selectively converging or diverging with, the function can be by making wavelength selection plated film on free surface lens surface come real It is existing, it can also be realized by processing wiener structure in transparent membrane or carrying out holographic interference exposure.Wherein, specific wavelength can It can also include the light for being other colors to include the corresponding wavelength of feux rouges, the corresponding wavelength of green light and the corresponding wavelength of blue light Corresponding wavelength, this is not limited here.

It may include: sensor and processor that above-mentioned Fig. 1 or Fig. 4, which corresponds to the eye tracking device in nearly eye display device, The sensor is used to obtain the ocular image of user, and the processor to ocular image for being analyzed to obtain user Pupil information, such as pupil position, interpupillary distance, direction of gaze etc..

Wherein, the sensor in eye tracking device may include near-infrared (near infrared, NIR) light source and photograph Camera, the NIR light source can by being realized to individual laser or light emitting diode (light emitting diode, LED), Also it can integrate in the light source of light projector.

Or sensor includes NIR and the optical detector for the NIR, (photo detector, PD), the NIR light source It can integrate in the light source of light projector, optionally, the opposite position of the optical scanner and light fusion device of the PD and optical system It is fixed for setting.Optionally, which can acquire the light intensity value of specified NIR wavelength with high frequency.

Or sensor includes NIR and the optical scanner for the NIR, which has high frequency two-dimensional scanning function Can, it can be driven by modes such as electromagnetism, electrostatic, piezoelectricity, electric heating, which is integrated in the light source of light projector.

Sensor can also be that other can acquire the imaging device of human eye area image, and specific the application is not construed as limiting.

Above-mentioned Fig. 1 or Fig. 4, which corresponds to the reflective optical system in optical system, can be micro electronmechanical (micro electro Mechanical system, MEMS) reflecting mirror, i.e. reflective optical system includes: MEMS mirror face, first rotating shaft structure and second Pivot structure, as shown in Figure 6.Specifically, which can be driven by modes such as electromagnetism, electrostatic, voltage, electric heating, Accordingly, electric actuator can drive MEMS mirror face around by any one above-mentioned aforementioned mode depending on pupil position One pivot structure and/or the rotation of the second pivot structure.By taking the MEMS mirror of electromagnetic drive type as an example, when not applying driving current When, mirror surface is maintained at initial position.When applying driving current, MEMS mirror face can be under electromagnetism power drive around first Shaft and the second shaft deflect into new position.After deflecting into desired location, driving current is controlled by driving circuit, can be made Mirror surface opposite optical path at inflection point is static, to play the role of being directed at user's pupil progress retinal projection.

It is used closely it should be noted that the eye tracking device in above-mentioned Fig. 1 or Fig. 4 corresponding embodiment can be in user It is continued working during eye display device, i.e. the pupil of real-time tracing user, obtains the pupil information of user.Human eye tracking is set It is standby to be also possible to the work when user begins to use nearly eye display device, i.e., pupil information when user begins to use only is obtained, Electric actuator is completed after adjusting according to the pupil information, that is, is stopped working, that is, stops the tracking to the pupil of the user.Specifically Ground, eye tracking device can be determined as follows user and begin to use nearly eye display device: when detecting that user passes through When manually booting the operation of nearly eye display device or detecting the sensor signal for starting nearly eye real device, determine that user opens Begin use nearly eye display device, wherein the operation for manually booting nearly eye display device can be press, sliding button, touch by Button stirs button, issues special sound instruction or certain gestures etc., and the sensor signal for starting nearly eye real device can be weight Force sensor signals, gyroscope signal, light detectors signal, sound-detection gear signal, distance-sensor signal etc..

It should be noted that above-mentioned Fig. 1 or Fig. 4 illustrate only an eye tracking device, optics is shown with left eye respectively Electric actuator in system is connected with the electric actuator in right eye display optical system, but in practical applications, nearly eye is shown Device can also be there are two eye tracking device, and one connects with the electric actuator in left eye display optical system, another with Electric actuator connection in right eye display optical system, specific the application are not construed as limiting.

It should also be noted that, above-mentioned Fig. 1 or Fig. 4 correspond to the light projector in optical system in addition to can by laser with And optical scanner's composition, it can also be light emitting diode (light emitting diode, LED) light projector or liquid crystal Display (liquid crystal display, LCD) light projector, or by light source and the attached silicon (liquid of liquid crystal Crystal on silicon, LCOS) light projector, or by laser and optical digital computing (digital light Processing, DLP) light projector forms or other can generate the device of the corresponding light beam of image, and specific the application is not It limits.

In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.

The computer program product includes one or more computer instructions.Load and execute on computers the meter When calculation machine program instruction, entirely or partly generate according to process or function described in the embodiment of the present invention.The computer can To be general purpose computer, special purpose computer, computer network or other programmable devices.The computer instruction can be deposited Storage in a computer-readable storage medium, or from a computer readable storage medium to another computer readable storage medium Transmission, for example, the computer instruction can pass through wired (example from a web-site, computer, server or data center Such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave) mode to another website Website, computer, server or data center are transmitted.The computer readable storage medium can be computer and can deposit Any usable medium of storage either includes that the data storages such as one or more usable mediums integrated server, data center are set It is standby.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or partly lead Body medium (such as solid state hard disk Solid State Disk (SSD)) etc..

In several embodiments provided herein, it should be understood that disclosed device, it can be by another way It realizes.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the unit, only a kind of Logical function partition, there may be another division manner in actual implementation, such as multiple units or components can combine or can To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual Coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, It can be electrical property, mechanical or other forms.

The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.

It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.

If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words It embodies, which is stored in a storage medium, including some instructions are used so that a computer Equipment (can be personal computer, server or the network equipment etc.) execute each embodiment of the application described in whole or Part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (full name in English: Read-Only Memory, english abbreviation: ROM), random access memory (full name in English: Random Access Memory, english abbreviation: RAM), the various media that can store program code such as magnetic or disk.

The above, above embodiments are only to illustrate the technical solution of the application, rather than its limitations.Although referring to before Embodiment is stated the application is described in detail, those skilled in the art should understand that: it still can be to preceding Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features.And these It modifies or replaces, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution.

Claims

1. a kind of nearly eye display device characterized by comprising eye tracking device and one or two optical system；

The eye tracking device is used to track the pupil of user, and determines the position of the pupil；

Each optical system includes: light projector, light fusion device, reflective optical system and electric actuator；

The light projector is for emitting the image corresponding light beam to be presented to the pupil；

The light beam that the reflective optical system is used to emit the light projector reflects；

The smooth fusion device is for converging to the light beam that the reflective optical system reflects in the pupil；

The electric actuator is used to determine the first adjustment value of the reflective optical system according to the position of the pupil, and by the light Reflector is adjusted to position indicated by the first adjustment value from current location.

2. the apparatus according to claim 1, which is characterized in that

The electric actuator from the first mapping table for searching the of corresponding with the position of the pupil reflective optical system One adjusted value.

3. the apparatus according to claim 1, which is characterized in that

The eye tracking device is also used to determine interpupillary distance according to the position of the pupil；

The electric actuator from the second mapping table for searching the first of the reflective optical system corresponding with the interpupillary distance Adjusted value.

4. the apparatus according to claim 1, which is characterized in that the electric actuator is also used to the position according to the pupil It determines the second adjustment value of the smooth fusion device, and the smooth fusion device is adjusted to the second adjustment value institute from current location The position of instruction.

5. device according to any one of claims 1 to 3, which is characterized in that the light projector include: laser and Optical scanner；

The laser is used to generate the light beam of multiple and different wavelength；

The optical scanner is used to carry out two dimension to the light beam of the multiple different wave length according to default timing and preset path to sweep It retouches, to obtain the corresponding light beam of described image；

The electric actuator is also used to determine the third adjusted value of the optical scanner according to the position of the pupil, and will be described Optical scanner is adjusted to position indicated by the third adjusted value from current location.

6. device according to claim 5, which is characterized in that the eye tracking device is also used to according to the pupil Position determines interpupillary distance；When the interpupillary distance is greater than target range, the electric actuator is for controlling the optical scanning Device is mobile towards the direction close to the laser, the target range be the left eye display optical system exit pupil position with The distance between the exit pupil position of the right eye display optical system.

7. device according to any one of claims 1 to 6, which is characterized in that described two optical systems include that left eye is aobvious Show optical system and right eye display optical system；

When the interpupillary distance is greater than target range, the electric actuator in the left eye display optical system is described for controlling It is signified that reflective optical system in left eye display optical system rotates counterclockwise to the first adjustment value from current location on the first plane The position shown, exit pupil position and the right eye display optical system of the target range for the left eye display optical system The distance between exit pupil position, the interpupillary line of the user and the plane where orbitomeatal line are parallel to first plane；

When the interpupillary distance is greater than target range, the electric actuator in the right eye display optical system is described for controlling It is signified that reflective optical system in right eye display optical system is rotated clockwise to the first adjustment value from current location on the first plane The position shown.

8. device according to any one of claims 1 to 6, which is characterized in that described two optical systems include that left eye is aobvious Show optical system and right eye display optical system；

Electric actuator when the pupil of the user rotates counterclockwise on the first plane, in the left eye display optical system Is rotated counterclockwise to from current location on the first plane for controlling the reflective optical system in the left eye display optical system Position indicated by one adjusted value, the interpupillary line of the user and the plane where orbitomeatal line are parallel to first plane；

Electric actuator when the pupil of the user rotates counterclockwise on the first plane, in the right eye display optical system Is rotated counterclockwise to from current location on the first plane for controlling the reflective optical system in the right eye display optical system Position indicated by one adjusted value；

Alternatively,

Electric actuator when the pupil of the user rotates counterclockwise in the second plane, in the left eye display optical system Is rotated counterclockwise to from current location for controlling the reflective optical system in the left eye display optical system in the second plane Position indicated by one adjusted value, second plane is perpendicular to the straight line where the orbitomeatal line of the user；

Electric actuator when the pupil of the user rotates counterclockwise in the second plane, in the right eye display optical system Is rotated clockwise to from current location for controlling the reflective optical system in the right eye display optical system in the second plane Position indicated by one adjusted value.

9. a kind of nearly eye display device characterized by comprising eye tracking device and one or two optical system；Institute Eye tracking device is stated for tracking the pupil of user, and determines the position of the pupil；

The light projector is for emitting the image corresponding light beam to be presented to the user；

The electric actuator is used to determine the first adjustment value of the smooth fusion device according to the position of the pupil, and by the light Fusion device is adjusted to position indicated by the first adjustment value from current location.

10. device according to claim 9, which is characterized in that

The electric actuator from the first mapping table for searching the of corresponding with the position of the pupil smooth fusion device One adjusted value.

11. device according to claim 9, which is characterized in that

The electric actuator is adjusted for searching the first of the fusion device corresponding with the interpupillary distance from the second mapping table Whole value.

12. device according to claim 9, which is characterized in that the light projector includes: laser and optical scanning Device；

The electric actuator is also used to determine the second adjustment value of the optical scanner according to the position of the pupil, and will be described Optical scanner is adjusted to position indicated by the second adjustment value from current location.

13. device according to claim 12, which is characterized in that the eye tracking device is also used to according to the pupil Position determine interpupillary distance；When the interpupillary distance is greater than target range, the electric actuator is swept for controlling the light Device is retouched towards close to the movement of the direction of the laser, the target range is the exit pupil position of the left eye display optical system With the distance between the exit pupil position of the right eye display optical system.

14. according to the described in any item devices of claim 9 to 13, which is characterized in that described two optical systems include left eye Display optical system and right eye display optical system；

When the interpupillary distance is greater than target range, the electric actuator in the left eye display optical system is used for flat first The light fusion device controlled in the left eye display optical system on face is rotated clockwise to the first adjustment value meaning from current location The position shown, exit pupil position and the right eye display optical system of the target range for the left eye display optical system The distance between exit pupil position, the interpupillary line of the user and the plane where orbitomeatal line are parallel to first plane；

When the interpupillary distance is greater than target range, the electric actuator in the right eye display optical system is used for flat first The light fusion device controlled in the right eye display optical system on face rotates counterclockwise to described in the first adjustment value from current location The position of instruction.

15. according to the described in any item devices of claim 9 to 13, which is characterized in that described two optical systems include left eye Display optical system and right eye display optical system；

Electric actuator when the pupil of the user rotates counterclockwise on the first plane, in the left eye display optical system Is rotated clockwise to from current location for controlling the light fusion device in the left eye display optical system on the first plane Position indicated by one adjusted value, the interpupillary line of the user and the plane where orbitomeatal line are parallel to first plane；

Electric actuator when the pupil of the user rotates counterclockwise on the first plane, in the right eye display optical system Is rotated clockwise to from current location for controlling the light fusion device in the right eye display optical system on the first plane Position indicated by one adjusted value；

Alternatively,

Electric actuator when the pupil of the user rotates counterclockwise in the second plane, in the left eye display optical system Is rotated clockwise to from current location for controlling the light fusion device in the left eye display optical system in the second plane Position indicated by one adjusted value, second plane is perpendicular to the straight line where the orbitomeatal line of the user；

Electric actuator when the pupil of the user rotates counterclockwise in the second plane, in the right eye display optical system Is rotated counterclockwise to from current location for controlling the light fusion device in the right eye display optical system in the second plane Position indicated by one adjusted value.