CN109407317A - Waveguide, near-eye display system and its control method - Google Patents

Waveguide, near-eye display system and its control method Download PDF

Info

Publication number
CN109407317A
CN109407317A CN201811382092.9A CN201811382092A CN109407317A CN 109407317 A CN109407317 A CN 109407317A CN 201811382092 A CN201811382092 A CN 201811382092A CN 109407317 A CN109407317 A CN 109407317A
Authority
CN
China
Prior art keywords
coupling
waveguide
eye
component
adjusting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201811382092.9A
Other languages
Chinese (zh)
Inventor
姚长呈
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Idealsee Technology Co Ltd
Original Assignee
Chengdu Idealsee Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Idealsee Technology Co Ltd filed Critical Chengdu Idealsee Technology Co Ltd
Priority to CN201811382092.9A priority Critical patent/CN109407317A/en
Publication of CN109407317A publication Critical patent/CN109407317A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

The embodiment of the present application discloses waveguide, near-eye display system and its control method.The direction of eye movement tracking mould group real-time monitoring user's eye, to determine the visual field of user corresponding focal zone on the image, and it generates adjustment signal and is sent to waveguide, the mode that the mode for being coupled into light beam of component or the decoupling light beam of decoupling component are coupled into waveguide is adjustable, light beam through overregulating is showing the image that can be only shown in the human eye visual field when imaging, to also can be reduced interference of the shown content to user while saving system consumption.

Description

Waveguide, near-to-eye display system and control method thereof
Technical Field
The application relates to the technical field of scanning display, in particular to a waveguide, a near-to-eye display system and a control method thereof.
Background
Nowadays, with the rapid development of Display technologies such as Augmented Reality (AR), Virtual Reality (VR), etc., near-eye Display devices such as Head-Mounted Display (HMD) are also hot spots in the Display industry.
The existing near-eye display device can display an image with a larger field of view in a scanning manner, but in some scenes, the image with the larger field of view may cause some problems, for example: if a user wears the AR equipment to walk, the image with a too large view field can block too much sight of the user, so that potential safety hazards can be brought; another example is: in the process of analyzing objects through the AR device, the image with a large field of view can display rich object information, but actually, human eyes cannot see information outside the focusing range of the field of view, so that part of information displayed by the AR device may not be fully utilized by a user, and meanwhile, redundant burden is caused to the system.
Disclosure of Invention
An object of the present application is to provide a waveguide, a near-eye display system, and a control method thereof for solving the problem of image display in near-eye display.
Embodiments of the present application provide a waveguide, which includes: a coupling-in member, an expanding member, and a coupling-out member provided on the waveguide, the light beam input to the waveguide being transmitted to the expanding member through the coupling-in member, the light beam expanded by the expanding member being transmitted to the coupling-out member and being output by the coupling-out member, wherein,
the coupling-in mode of the coupling-in part or the coupling-out mode of the coupling-out part is adjustable.
Further, the coupling-in part or the coupling-out part comprises a grating with adjustable optical parameters;
wherein the optical parameters include: at least one of a reflectivity, a refractive index, an in-coupling angle, an in-coupling position, an out-coupling angle, and an out-coupling position.
Further, the coupling-in part or the coupling-out part is formed by splicing at least two gratings with adjustable optical parameters.
Further, the coupling-in part or the coupling-out part is formed by a grating with adjustable optical parameters.
Further, the light inlet of the coupling-in component is arranged on the surface of the waveguide; the extension component is arranged on an emergent light path of the coupling-in component and extends along the direction of the emergent light path, and the emergent light direction of the extension component is perpendicular to the extension direction of the extension component; the light incident side of the coupling-out component is parallel and opposite to the extending direction of the extension component, and the coupling-out component extends in the light emergent direction of the extension component.
The present invention also provides a near-eye display system, comprising an image source module, an eye tracking module and the waveguide, wherein,
the image source module generates a light beam containing image information and scans and outputs the light beam to the waveguide;
the waveguide expands the light beams input by the image source module in a first direction and a second direction and then outputs the light beams, and the light beams input to the waveguide or output from the waveguide are adjusted according to the adjusting signals sent by the eye movement tracking module;
the eye tracking module monitors the rotation angle of the eyes of the user in real time so as to determine the corresponding area of the visual field of the user on the image, generate an adjusting signal and send the adjusting signal to the waveguide, and the light beam is adjusted.
The embodiment of the present application further provides a control method for the near-to-eye display system, where the method includes:
the eye movement tracking module monitors the orientation of human eyes and determines a focusing area of the human eyes according to the orientation;
and generating an adjusting signal based on the determined focusing area, sending the adjusting signal to the waveguide, and adjusting the coupling-in mode of a coupling-in component or the coupling-out mode of a coupling-out component in the waveguide so as to control the image formed by the light beam output by the waveguide in the human eye to be positioned in the focusing area.
Further, when the coupling-in part or the coupling-out part is formed by splicing at least two gratings with adjustable optical parameters, adjusting the coupling-in mode of the coupling-in part or the coupling-out mode of the coupling-out part in the waveguide comprises:
adjusting the coupling-in angle or position of the grating with adjustable optical parameters in the coupling-in part corresponding to the focusing region, or
And adjusting the coupling-out angle or the coupling-out position of part or all of the gratings with adjustable optical parameters in the coupling-out part corresponding to the focusing area.
Further, when the coupling-in part or the coupling-out part is formed of a grating with adjustable optical parameters, adjusting the coupling-in mode of the coupling-in part or the coupling-out mode of the coupling-out part in the waveguide includes:
adjusting the coupling-in angle or coupling-in position of the grating with adjustable optical parameters constituting the coupling-in part, corresponding to the focal region, or
And adjusting the coupling-out angle or the coupling-out position corresponding to the focusing area in the grating with the adjustable optical parameters forming the coupling-out part.
The embodiment of the application further provides a near-to-eye display device, the near-to-eye display device is used as an augmented reality display device and at least comprises one set of near-to-eye display system, light beams emitted by the coupling-out part of the waveguide in the near-to-eye display system can enter human eyes, and external environment light penetrates through the waveguide to enter the human eyes.
The embodiment of the present application further provides another near-eye display device, where the near-eye display device is used as a virtual reality display device, and the near-eye display device includes two sets of the near-eye display systems described above, where a light beam emitted from an outcoupling member of a waveguide in a first set of the near-eye display systems enters a left eye, and a light beam emitted from an outcoupling member of a waveguide in a second set of the near-eye display systems enters a right eye.
By adopting the technical scheme in the embodiment of the application, the following technical effects can be realized:
the light beam emitted by the near-eye display system acts on human eyes or a display medium (such as a lens), so that a user can watch a corresponding image, and near-eye display is realized. Meanwhile, under the monitoring of the eye movement tracking module, the near-eye display system can adjust the light beam coupling mode of the coupling component in the waveguide in real time according to the rotation direction of the eyes of the user, and the coupling mode is changed, so that the light beams transmitted in the waveguide are output from the waveguide according to a specific angle and/or a specific position, and the image of the light beams output by the waveguide in the human eye is positioned in a focus area; or, the mode of the light beam coupled out by the coupling-out component in the waveguide is adjusted in real time, and the change of the coupling-out mode can also enable the light beam to be output from the waveguide according to a specific angle and/or a specific position, so that the image formed by the light beam output by the waveguide in the human eye is positioned in the focus area; the method can reduce the interference of the displayed content to the user while saving the system consumption.
In addition, in an actual display scene, if the relative position of the image content to be displayed is fixed and the range exceeds the visual field of human eyes, the near-to-eye display system can only display the image in the visual field of the human eyes according to the rotation of the human eyes; if the image content to be displayed does not exceed the visual field of human eyes and the relative position is not fixed, the display position of the image content can be adjusted by the near-eye display system according to the rotation of the human eyes, and the image content is displayed in the visual field of the human eyes.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
fig. 1 is a schematic diagram of a laser scanning display principle provided by an embodiment of the present application;
FIG. 2 is a simplified diagram of a human eye viewing field acting on an image according to an embodiment of the present disclosure;
fig. 3a is a schematic structural diagram of a near-eye display system according to an embodiment of the present disclosure;
fig. 3b is a schematic diagram illustrating a connection relationship between the image source module 20 and the waveguide 30 in the near-eye display system according to the embodiment of the present application;
FIG. 4 is a schematic structural diagram of a waveguide provided in an embodiment of the present application;
fig. 5a is a schematic structural diagram of a coupling-in component according to an embodiment of the present disclosure;
FIG. 5b is a schematic structural diagram of another coupling-in component provided in the embodiments of the present application;
fig. 6a is a schematic structural diagram of a coupling-out component according to an embodiment of the present disclosure;
FIG. 6b is a schematic structural diagram of another coupling-out member provided in the embodiments of the present application;
fig. 7 is a flowchart of a control method based on a near-eye display system according to an embodiment of the present application;
FIG. 8 is a schematic diagram of adjusting a coupling-out angle according to a control method provided by an embodiment of the present application;
FIG. 9 is a schematic diagram of adjusting the decoupling position in a control method according to an embodiment of the present disclosure;
FIG. 10 is a schematic view of a human eye's field of view when actually viewed;
fig. 11a is a schematic diagram of a near-eye display device according to an embodiment of the present application;
fig. 11b is a schematic diagram of another near-eye display device provided in an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.
For ease of understanding, the basic principle of laser scanning imaging in existing near-eye display devices is first explained. As shown in fig. 1, which is a schematic diagram, fig. 1 includes: a laser light source 101, a scanner 102 and a human eye retina 103.
When the imaging is displayed, the laser emitted by the laser source acts on a certain pixel point position after being output by the scanner, so that the scanning of the pixel point position is realized, and the laser beam moves to the next pixel point position to scan under the control of the scanner. In other words, the laser beam outputted by the scanner will be lighted up at each pixel position with corresponding color, gray scale or brightness according to a certain sequence. In a frame of time, the laser beam traverses each pixel position at a high enough speed, and due to the characteristic of "visual residual" existing in the observation of things by human eyes, the human eyes cannot detect the movement of the laser beam at each pixel position, but see a complete image (in fig. 1, the user can see the image whose content is displayed as "Hi"). Of course, the content shown in fig. 1 is only for simple illustration of the basic principle of laser scanning imaging in the near-eye display, so as to facilitate understanding of the technical solutions in the embodiments of the present application, and should not be taken as a limitation of the present application.
However, in the near-eye display scene, the field of view of the human eye is limited. Specifically, referring to fig. 2, it is assumed that the image in the near-eye display is as shown in fig. 2, and actually, the human eye cannot cover the entire image in the visual field in such a short distance. Taking the areas a1 and a2 as examples, assuming that human eyes focus on the area a1, the field of vision of human eyes can cover the area, which means that the human eyes can view the image content in the area a1, but at this time, due to the field of vision limitation of human eyes, the image content in other areas is difficult to see or even cannot be seen; if it is desired to view the image content in region a2, the focus position of the human eye needs to be shifted from region a1 to a 2. Of course, the above description is only for the purpose of illustrating the way the image is viewed by human eyes in a near-eye display scene so as to facilitate the understanding of the subsequent aspects of the present application, and should not be construed as limiting the present application.
Based on the foregoing, embodiments of the present application provide a near-eye display system, as shown in fig. 3 a. The near-eye display system includes: image source module 20, waveguide 30, and eye-tracking module 40. Wherein,
image source module 20 generates a laser beam containing image information for scanning output to waveguide 30 and adjusts the output laser beam according to the adjustment signal sent by eye tracking module 40. For convenience of description, the laser beam may be simply referred to as a beam in the embodiments of the present application, and the laser beam and the beam represent the same concept in the embodiments of the present application unless otherwise specified.
The waveguide 30 expands the laser beam input from the image source module 20 in the first direction and the second direction, the expanded beam is output from the waveguide 30, and the waveguide 30 adjusts the beam input to the waveguide 30 or the beam output from the waveguide 30 according to the adjustment signal sent by the eye tracking module 40. As shown in fig. 3a, the first direction and the second direction respectively represent the propagation directions of the light beam in the waveguide 30, and when the user actually uses the display device corresponding to the near-eye display system, the first direction can be regarded as a vertical direction in the visual field plane of the human eye, and the second direction can be regarded as a horizontal direction in the visual field plane of the human eye, so the first direction and the second direction can be also referred to as: a vertical direction and a horizontal direction. It is to be understood that the terms "first" and "second" are used herein for distinguishing and should not be construed as limiting in sequence.
The eye tracking module 40 monitors the orientation of the user's eyes in real time to determine the corresponding region of the user's field of view on the image, thereby generating a corresponding adjustment signal that is sent to the waveguide 30 to adjust the light beam. It should be noted that the eye tracking module 40 can be implemented by using conventional components and algorithms, and therefore, the detailed description thereof is omitted here.
The light beam emitted by the near-eye display system acts on human eyes or a display medium (such as a lens), so that a user can watch a corresponding image, and near-eye display is realized. Meanwhile, under the monitoring of the eye movement tracking module 40, the emergent light beam can be adjusted by the near-eye display system according to the rotation direction of the eyes of the user, and the adjusted light beam can only display the image in the visual field of the eyes when the image is displayed, so that the interference of the displayed content on the user can be reduced while the system consumption is saved.
In some embodiments, image source module 20 and waveguide 30 may be a unitary structure, with image source module 20 being secured in a designated position on waveguide 30.
In other embodiments of the present application, image source module 20 and waveguide 30 are detachable. Specifically, referring to fig. 3b, a positioning portion 2001 is disposed on a side of the image source module 20 facing the waveguide 30, and the positioning portion 2001 is engaged with a positioning engaging portion 3001 on the waveguide 30, so that the image source module 20 is fixedly mounted on a designated position of the waveguide 30. The positioning portion 2001 may be a snap, a locking member, and the like, and correspondingly, the positioning engagement portion 3001 on the waveguide 30 may be a snap groove, a locking groove, and the like. Of course, the specific structures of the positioning portion 2001 and the positioning matching portion 3001 shown in fig. 3b can be interchanged, and the connection manner after the interchange is also the scope covered by the embodiments of the present application.
The eye tracking module 40 is typically a separate module, and in some embodiments, it may be integrated with the waveguide 30, and of course, will be specifically configured according to the needs of the application, and should not be construed as limiting the present application.
In the embodiment of the present application, the image source module 20 may include a laser, a scanner, and other elements to scan and output the laser beam of the corresponding image. The type of laser may be specifically an atomic laser, an ion laser, a semiconductor laser, or the like. Meanwhile, in order to ensure the display effect, any one or a combination of red (R), green (G), and blue (B) monochromatic lasers are generally used, or a white laser (it should be understood that the white laser can be separated into the foregoing RGB monochromatic lasers by corresponding optical devices), and of course, the laser of the corresponding color and the corresponding type can be specifically selected according to the needs of the practical application. The scanner may be a fiber optic scanner, a Micro-Electro-Mechanical System (MEMS) scanner, or the like, and may implement two-dimensional scanning. The image source module 20 may further include optical elements such as a collimating lens and a beam combiner, which may be configured according to the actual application requirement, and will not be described herein in detail.
Referring to fig. 4, a schematic diagram of a waveguide 30 in the embodiment of the present application is shown. The waveguide 30 includes a coupling-in member 301, an expanding member 302, and a coupling-out member 303 provided on the waveguide 30.
The light beam input to the waveguide 30 is transmitted to the expanding member 302 through the coupling-in member 301, and the light beam expanded by the expanding member 302 is transmitted to the coupling-out member 303 and output by the coupling-out member 303; the coupling-in manner of the coupling-in member 301 or the coupling-out manner of the coupling-out member 303 is adjustable. Here, the coupling-in mode can be understood as a mode in which the coupling-in member 301 couples an external light beam into the waveguide 30, and similarly, the coupling-out mode can be understood as a mode in which the coupling-out member 303 couples a light beam propagating in the waveguide out of the waveguide 30.
Specifically, in fig. 4, the coupling-in component 301 is located on the surface of the waveguide 30 and on the optical path of the light beam output by the external light source (which may be the image source module 20 in the aforementioned near-eye display system), so that the light beam output by the external light source is coupled into the waveguide 30 through the coupling-in component 301, and under the action of the coupling-in component 301, the light beam entering the waveguide 30 is further transmitted to the expanding component 302.
The expanding member 302 and the outcoupling member 303 expand the light beam entering the waveguide 30 in the first direction and the second direction, respectively. The extension member 302 is provided on the light path from the coupling member 301, and the extension member 302 extends in the direction of the light path, and the light outgoing direction of the extension member 302 is perpendicular to the extending direction of the extension member 302. The light incident side of the coupling-out member 303 is parallel to and opposite to the extending direction of the extending member 302, the coupling-out member 303 extends in the light emitting direction of the extending member 302, and the coupling-out member 303 emits light toward the human eye side.
The positions of the coupling-in part 301, the expanding part 302 and the coupling-out part 303 shown in fig. 4 are only an example, and the positions of the parts may be adjusted according to the needs of the practical application, such as: the coupling-in member 301 may also be located on the side of the waveguide 30, and of course, the coupling-in member will be specifically configured according to the requirements of the practical application, and is not particularly limited herein.
In the embodiment of the present application, the waveguide 30 may be a spatial light modulator, and the expansion component 302 may specifically be an arrayed reflective waveguide, a grating, a reflective mirror group, or the like. The coupling-in component 301 or the coupling-out component 303 may employ a grating (e.g., an electrically controlled liquid crystal grating) with adjustable optical parameters, wherein the optical parameters may include, but are not limited to: reflectivity, refractive index, transmittance, coupling-in angle, coupling-in position, coupling-out angle, coupling-out position, etc., so that the coupling-in manner of the coupling-in part 301 or the coupling-out manner of the coupling-out part 303 can be adjusted.
It should be understood that fig. 4 only shows one possible waveguide configuration, and in practical applications, the light-entering region adjustable coupling-in component 301 or the light-exiting region adjustable coupling-out component 303 may also be applied to waveguides with other structures, so as to realize light beams exiting in a near-eye display scene.
As for the incoupling component 301, in an embodiment of the present application, the incoupling component 301 is composed of at least two tunable gratings. Referring to fig. 5a, a case that the coupling-in component 301 includes two tunable gratings 3011 and 3012 is shown, the tunable gratings 3011 and 3012 may be electrically controlled liquid crystal gratings, and the tunable gratings 3011 and 3012 are finely spliced together in a symmetrical shape and size manner (the shape shown in fig. 5a is a rectangle) to form the coupling-in component 301, and the tunable gratings 3011 and 3012 are respectively controllable, thereby implementing adjustment control on the light-entering region of the coupling-in component 301. Of course, fig. 5a is only a simple example, in practical application, the number of tunable gratings may be multiple, the shapes of each tunable grating may be the same or different, and the size of each tunable grating may be the same or different, and the configuration will be specifically set according to the requirement of practical application, and redundant description is omitted here.
With the scheme shown in fig. 5a, it is possible to control the optical parameters of the coupling-in component 301, such as the coupling-in angle and the coupling-in position, according to the adjustment signal of the eye tracking module 40, and under the condition that the optical parameters of the coupling-in component 301 are controlled and adjusted, the light beam transmitted to the coupling-out component 303 will correspond to the eye focusing area, so the light beam emitted from the coupling-out component 303 will act on the eye focusing area.
In another embodiment of the present application, the coupling-in component 301 is formed by a locally tunable grating, and referring to fig. 5b, a single locally tunable grating 3013 is used as the coupling-in component 301, and optical parameters corresponding to any region on the locally tunable grating 3013 can be adjusted, so as to achieve the same effect as the scheme described in the foregoing fig. 5 a.
As for the coupling-out component 303, referring to fig. 6a, as a possible implementation manner of the present application, the coupling-out component 303 is composed of at least two tunable gratings 3031, 3032, and the tunable gratings 3031, 3032 also adopt a precise splicing manner to form the coupling-out component 303, where as to the specific number, shape, size, and the like of the tunable gratings 3031, 3032, reference may be made to the tunable gratings 3011, 3012 in the coupling-in component 301, and therefore, redundant description is not repeated herein.
In addition, referring to fig. 6b, as another possible implementation manner of the present application, a single local tunable grating 3033 may be used as the coupling-out component 303, and of course, reference may be specifically made to the above-mentioned scheme of tunable gratings on the coupling-in component 301, and redundant description is omitted here.
It should be noted here that the light beam exiting from the coupling-out part 303 is expanded in the first direction and the second direction, and then, generally, the size of the coupling-out part 303 is generally larger than that of the coupling-in part, that is, the size of the tunable grating on the coupling-out part 303 is also generally larger than that of the tunable grating on the coupling-in part 301.
On the basis of the above, an embodiment of the present application further provides a control method based on the near-eye display system, as shown in fig. 7, the method specifically includes the following steps:
step S701: the eye tracking module 40 monitors the orientation of the human eye and determines the area of focus of the human eye based on the orientation.
In combination with the foregoing, it is readily understood that in a near-eye display scene, the field of vision of the human eye is the visible region in which the human eye is effective in the focus region of the image, and the human eye may be obscured or even invisible for images beyond this region. Based on this, the eye tracking module 40 generates a corresponding adjustment signal to adjust the generated light beam. It should be noted that the process of monitoring the human eye focusing area and generating the adjustment signal by the eye tracking module 40 can be implemented by using an existing monitoring algorithm or model, and will not be described in detail herein.
Step S703: an adjusting signal is generated based on the determined focusing area and sent to the waveguide 30, and the coupling-in mode of the coupling-in part 301 or the coupling-out mode of the coupling-out part 303 in the waveguide 30 is adjusted to control the light beam output by the waveguide 30 to be positioned in the focusing area in the human eye.
In the embodiment of the present application, the waveguide 30 can adjust the light beam under the effect of the adjustment signal, so that the near-eye display system only displays the image in the focal region of the field of view of the human eye.
Based on the above method, different adjustment control modes can be specifically adopted in practical application, which is described in detail below. The following adjustment control method will be described by taking the coupling-out member 303 as an example, and the principle of adjusting the coupling-in member 301 is similar to this, so the detailed description is not repeated.
The first method is as follows:
in this manner, eye tracking module 40 sends adjustment signals to waveguide 30 and image source module 20 scans out a complete image. The waveguide 30 receives the adjusting signal sent by the eye tracking module 40, so as to adjust the coupling-out angle of the coupling-out component 303 in the waveguide 30, that is, the waveguide 30 controls the coupling-out component 303 to change the exit angle of the exiting light beam according to the adjusting signal, so that the image formed by the exiting light beam in the human eye is located in the focusing area.
Assuming that the eye tracking module 40 determines the focusing area of the user's eye to be the area a1 so as to generate the adjusting signal to act on the coupling-out member 303 of the waveguide 30, the exit angle of the light beam output by the coupling-out member 303 is changed under the action of the adjusting signal, as shown in fig. 8, and the image formed by the human eye is located in the area a1 after acting on the human eye.
The second method comprises the following steps:
in this manner, eye tracking module 40 sends adjustment signals to waveguide 30 and image source module 20 scans out a complete image. The waveguide 30 receives the adjusting signal sent by the eye tracking module 40, so as to adjust the coupling-out position of the coupling-out part 303 in the waveguide 30, that is, the waveguide 30 controls the coupling-out part 303 to change the emitting position of the emitted light beam according to the adjusting signal, so that the image of the emitted light beam formed by the human eye is located in the focusing area.
Assuming that the eye tracking module 40 determines the focusing area of the user's eye to be the area a1 so as to generate the adjusting signal to act on the coupling-out component 303 of the waveguide 30, as shown in fig. 9, the emitting position of the light beam output by the coupling-out component 303 is changed under the action of the adjusting signal, only the area a1 emits light, and the other areas do not emit light, so that the image formed by the light beam acting on the human eye is located in the area a 1.
It will be appreciated that the above control can be applied whether the outcoupling means 303 is formed by splicing a plurality of tunable gratings, but is instead formed by a complete grating. Meanwhile, the specific control mode can realize the adjustment of the imaging area. In practical applications, any one of the above manners may be adopted, or the above manners may be adopted in combination, and the specific manner may be determined according to the needs of practical applications, and is not specifically limited herein.
In addition, in an actual display scene, a user can adjust the size of the displayed area to adapt to different requirements.
It should be noted that, in the embodiment of the present application, the foregoing content of "dividing" the image is only a simple case adopted for convenience of describing the technical solution of the present application, and it should be understood that, in practical application, the solution in the embodiment of the present application is applicable to more complicated human eye rotation scenes. Specifically, the change in the field of view caused by the rotation of the human eye is not an area strictly divided by a broken line as shown in the foregoing, but as shown in fig. 10, the field of view of the human eye is generally cone-shaped, acting on the image plane to form a circular area, and the rotation of the human eye is arbitrary, and the corresponding field of view may correspond to an arbitrary area on the image. Of course, no limitation to the present application is intended thereby.
In actual image display, image content in a region other than the field of vision of human eyes may not be completely displayed, and display in a low-brightness state, a low-contrast state, a low-resolution state, or the like may be performed. Of course, the setting will be specifically performed according to the needs of practical applications, and therefore, the detailed description is not repeated herein.
In some practical scenes, an object with a large longitudinal or transverse size may appear, and if only a local image is displayed, it may cause an obstacle to a user to identify the object, at this time, a pre-image processing technology may be used to identify characteristics of a displayed virtual object, and adjust the image size of a display area (in the embodiment of the present application, adjustment of the image size may be achieved by adjusting a scan driving voltage, which is not described herein in detail), and the dynamic eye focusing area is displayed to optimize the display effect, and of course, the image light source needs to be correspondingly processed and implemented by matching with a modulation algorithm.
In practical applications, the near-eye display system provided by the embodiment of the present application can be applied to a near-eye display device such as an AR device or a VR device.
Specifically, the near-eye display device in the embodiment of the present application includes at least one set of the near-eye display system described in the foregoing and can be controlled by using at least one control manner of the foregoing.
Referring to fig. 11a, the near-eye display device is mainly used as an augmented reality AR display device, in this case, the near-eye display device may only include one set of near-eye display system S1, light beams emitted from an output component of a waveguide in the near-eye display system S1 may enter human eyes, and meanwhile, external ambient light may also enter human eyes through the waveguide, so that a user views a corresponding augmented reality image. Of course, one possible form of a near-eye display device is shown in fig. 11a, i.e., using integrally formed lenses (i.e., the left and right lenses are not separately separable). Of course, in practical applications, the AR display device may also adopt a separate lens structure (refer to fig. 11b), and in this case, the AR display device may still include a near-eye display system S1, which emits a light beam to act on the left eye or the right eye. The determination can be specifically performed according to the needs of practical application, and redundant description is omitted here.
Referring to fig. 11b, the near-eye display apparatus is mainly used as a virtual reality VR display apparatus, in this case, the near-eye display apparatus includes two sets of near-eye display systems, wherein the light beam emitted from the coupling-out part of the waveguide in the first set of near-eye display system S3 enters the left eye, and the light beam emitted from the coupling-out part of the waveguide in the second set of near-eye display system S5 enters the right eye. Of course, one possible form of a near-eye display device is shown in FIG. 11b, i.e., using two separate lenses. Of course, in practical applications, the VR display device may also adopt an integrated lens structure (refer to fig. 11a), which may be determined according to the needs of practical applications, and redundant description is omitted here.
The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. Especially, as for the device, apparatus and medium type embodiments, since they are basically similar to the method embodiments, the description is simple, and the related points may refer to part of the description of the method embodiments, which is not repeated here.
Thus, particular embodiments of the present subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may be advantageous.
The expressions "first", "second", "said first" or "said second" used in various embodiments of the present disclosure may modify various components regardless of order and/or importance, but these expressions do not limit the respective components. The above description is only configured for the purpose of distinguishing elements from other elements. For example, the first user equipment and the second user equipment represent different user equipment, although both are user equipment. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure.
When an element (e.g., a first element) is referred to as being "operably or communicatively coupled" or "connected" (operably or communicatively) to "another element (e.g., a second element) or" connected "to another element (e.g., a second element), it is understood that the element is directly connected to the other element or the element is indirectly connected to the other element via yet another element (e.g., a third element). In contrast, it is understood that when an element (e.g., a first element) is referred to as being "directly connected" or "directly coupled" to another element (a second element), no element (e.g., a third element) is interposed therebetween.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention herein disclosed is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the invention. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.

Claims (9)

1. A waveguide, comprising: a coupling-in member, an expanding member, and a coupling-out member provided on the waveguide, the light beam input to the waveguide being transmitted to the expanding member through the coupling-in member, the light beam expanded by the expanding member being transmitted to the coupling-out member and being output by the coupling-out member, wherein,
the coupling-in mode of the coupling-in part or the coupling-out mode of the coupling-out part is adjustable.
2. The waveguide of claim 1, wherein the coupling-in part or the coupling-out part comprises a grating with adjustable optical parameters;
wherein the optical parameters include: at least one of a reflectivity, a refractive index, an in-coupling angle, an in-coupling position, an out-coupling angle, and an out-coupling position.
3. A waveguide according to claim 2, wherein said coupling-in part or said coupling-out part is formed by at least two gratings whose optical parameters are adjustable.
4. A waveguide according to claim 2, wherein said coupling-in part or said coupling-out part is constituted by a grating with adjustable said optical parameter.
5. A waveguide according to any one of claims 1 to 4 wherein the light entry port of the incoupling component is provided at the waveguide surface; the extension component is arranged on an emergent light path of the coupling-in component and extends along the direction of the emergent light path, and the emergent light direction of the extension component is perpendicular to the extension direction of the extension component; the light incident side of the coupling-out component is parallel and opposite to the extending direction of the extension component, and the coupling-out component extends in the light emergent direction of the extension component.
6. A near-eye display system, comprising: image source module, eye-tracking module and waveguide according to any of the preceding claims 1 to 5.
7. A control method for the near-eye display system of claim 6, wherein the method comprises:
the eye movement tracking module monitors the orientation of human eyes and determines a focusing area of the human eyes according to the orientation;
and generating an adjusting signal based on the determined focusing area, sending the adjusting signal to the waveguide, and adjusting the coupling-in mode of a coupling-in component or the coupling-out mode of a coupling-out component in the waveguide so as to control the image formed by the light beam output by the waveguide in the human eye to be positioned in the focusing area.
8. The control method according to claim 7, wherein adjusting the coupling-in mode of the coupling-in section or the coupling-out mode of the coupling-out section in the waveguide when the coupling-in section or the coupling-out section is formed by splicing at least two gratings whose optical parameters are adjustable comprises:
adjusting the coupling-in angle or position of the grating with adjustable optical parameters in the coupling-in part corresponding to the focusing region, or
And adjusting the coupling-out angle or the coupling-out position of part or all of the gratings with adjustable optical parameters in the coupling-out part corresponding to the focusing area.
9. The control method according to claim 7, wherein when the coupling-in section or the coupling-out section is formed of a grating whose optical parameter is adjustable, adjusting the coupling-in manner of the coupling-in section or the coupling-out manner of the coupling-out section in the waveguide comprises:
adjusting the coupling-in angle or coupling-in position of the grating with adjustable optical parameters constituting the coupling-in part, corresponding to the focal region, or
And adjusting the coupling-out angle or the coupling-out position corresponding to the focusing area in the grating with the adjustable optical parameters forming the coupling-out part.
CN201811382092.9A 2018-11-20 2018-11-20 Waveguide, near-eye display system and its control method Withdrawn CN109407317A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811382092.9A CN109407317A (en) 2018-11-20 2018-11-20 Waveguide, near-eye display system and its control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811382092.9A CN109407317A (en) 2018-11-20 2018-11-20 Waveguide, near-eye display system and its control method

Publications (1)

Publication Number Publication Date
CN109407317A true CN109407317A (en) 2019-03-01

Family

ID=65474151

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811382092.9A Withdrawn CN109407317A (en) 2018-11-20 2018-11-20 Waveguide, near-eye display system and its control method

Country Status (1)

Country Link
CN (1) CN109407317A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109839746A (en) * 2019-03-05 2019-06-04 京东方科技集团股份有限公司 A kind of near-eye display device and preparation method thereof
CN110146989A (en) * 2019-05-21 2019-08-20 京东方科技集团股份有限公司 Optical waveguide components and its display methods, display device and its display methods
CN113341577A (en) * 2021-08-06 2021-09-03 深圳珑璟光电科技有限公司 Binocular near-to-eye display equipment
WO2022143204A1 (en) * 2020-12-29 2022-07-07 华为技术有限公司 Augmented reality optical system and augmented reality glasses
DE102021207978B3 (en) 2021-07-23 2023-01-05 Continental Automotive Technologies GmbH Head-up display for a vehicle and method for driving independently switchable areas of a head-up display

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060126182A1 (en) * 2004-12-13 2006-06-15 Nokia Corporation General diffractive optics method for expanding an exit pupil
US20100321781A1 (en) * 2006-12-28 2010-12-23 Nokia Corporation Device for expanding an exit pupil in two dimensions
US20130314789A1 (en) * 2010-03-04 2013-11-28 Nokia Corporation Optical Apparatus and Method for Expanding an Exit Pupil
CN104040410A (en) * 2011-08-29 2014-09-10 伊奎蒂公司 Controllable waveguide for near-eye display applications
US20170322426A1 (en) * 2016-05-07 2017-11-09 Jani Kari Tapio Tervo Degrees of freedom for diffraction elements in wave expander

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060126182A1 (en) * 2004-12-13 2006-06-15 Nokia Corporation General diffractive optics method for expanding an exit pupil
US20100321781A1 (en) * 2006-12-28 2010-12-23 Nokia Corporation Device for expanding an exit pupil in two dimensions
US20130314789A1 (en) * 2010-03-04 2013-11-28 Nokia Corporation Optical Apparatus and Method for Expanding an Exit Pupil
CN104040410A (en) * 2011-08-29 2014-09-10 伊奎蒂公司 Controllable waveguide for near-eye display applications
US20170322426A1 (en) * 2016-05-07 2017-11-09 Jani Kari Tapio Tervo Degrees of freedom for diffraction elements in wave expander

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109839746A (en) * 2019-03-05 2019-06-04 京东方科技集团股份有限公司 A kind of near-eye display device and preparation method thereof
CN110146989A (en) * 2019-05-21 2019-08-20 京东方科技集团股份有限公司 Optical waveguide components and its display methods, display device and its display methods
WO2022143204A1 (en) * 2020-12-29 2022-07-07 华为技术有限公司 Augmented reality optical system and augmented reality glasses
DE102021207978B3 (en) 2021-07-23 2023-01-05 Continental Automotive Technologies GmbH Head-up display for a vehicle and method for driving independently switchable areas of a head-up display
CN113341577A (en) * 2021-08-06 2021-09-03 深圳珑璟光电科技有限公司 Binocular near-to-eye display equipment

Similar Documents

Publication Publication Date Title
US10048500B2 (en) Directionally illuminated waveguide arrangement
EP3516443B1 (en) Display engines for use with optical waveguides
CN109407317A (en) Waveguide, near-eye display system and its control method
US9335548B1 (en) Head-wearable display with collimated light source and beam steering mechanism
US8582206B2 (en) Laser-scanning virtual image display
KR102141992B1 (en) Ultra-high resolution scanning fiber display
US8246170B2 (en) Display apparatus
CN113687509B (en) Display device
CN109856796A (en) Image source mould group, waveguide, near-eye display system and its control method
EP4042675B1 (en) Laser-illuminated displays with enhanced uniformity
CN110058410B (en) Waveguide assembly and near-to-eye display device
US11782276B2 (en) Systems and methods to reduce bounce spacing and double-bounce in waveguides
CN109239835A (en) Waveguide, imaging expanded mode group, light source module group, near-eye display system and equipment
CN109348210A (en) Image source mould group, near-eye display system, control method and near-eye display device
US11555962B1 (en) Waveguide illuminator with optical interference mitigation
US20220269079A1 (en) Systems, devices, and methods for inputting light from a scanning projector into a waveguide
CN110959131A (en) Wearable display optics using laser beam scanner
US10690919B1 (en) Superluminous LED array for waveguide display
US11863912B2 (en) Lighting unit and display with wavelength-selective illumination
US20240027748A1 (en) Scanning projector performing consecutive non-linear scan with multi-ridge light sources
US20230236424A1 (en) Lightguide outcoupler and methods for outcoupling light of a lightguide
US20240230988A9 (en) Waveguide coupler for coupling laser beam into photonic integrated circuit
US20230066767A1 (en) Systems and methods to minimize double-bounce in waveguides
US20230341688A1 (en) High-reliability stacked waveguide with reduced sensitivity to pupil walk
EP4414769A1 (en) Folded beam two-dimensional (2d) beam scanner

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20190301

WW01 Invention patent application withdrawn after publication