WO2020048536A1

WO2020048536A1 - Display module and imaging method

Info

Publication number: WO2020048536A1
Application number: PCT/CN2019/104773
Authority: WO
Inventors: 孙洁; 李瑞华
Original assignee: 华为技术有限公司
Priority date: 2018-09-07
Filing date: 2019-09-06
Publication date: 2020-03-12
Also published as: CN110888233A; CN110888233B

Abstract

The present application provides a display module and an imaging method. The display module comprises: a red optical waveguide lens, a green optical waveguide lens, a blue optical waveguide lens, a white optical waveguide lens, and at least one projection optical machine; the at least one projection optical machine inputs a first optical signal into the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens by means of a first optical path, and light emitted after diffraction by the optical waveguide lenses commonly presents a first image on a first focal plane; the at least one projection optical machine further inputs a second optical signal into the white optical waveguide lens by means of a second optical path, emergent light emitted after diffraction by the optical waveguide lens presents a second image on a second focal plane, and the second focal plane and the first focal plane are located on different planes. According to the display module and the imaging method provided in the present application, a display function of two focal planes can be obtained by means of less optical waveguide lenses, and the structure of the display module having the display function of multiple focal planes is simplified to a certain degree.

Description

Display module and imaging method

This application claims priority from a Chinese patent application filed with the Chinese Patent Office on September 07, 2018, with application number 2018110454009, and with the application name "Display Module and Imaging Method", the entire contents of which are incorporated herein by reference.

Technical field

The present application relates to the field of display technology, and in particular, to a display module and an imaging method.

Background technique

Augmented Reality (AR) is a method capable of projecting virtual content represented by an image or video onto an AR display device (such as AR glasses), and enabling a user to simultaneously see the projected virtual content and reality through the AR display device. Technology of real content in the world. Virtual reality (VR) is a technology capable of projecting virtual content represented by an image or a video onto a VR display device (for example, VR glasses), so that a user can immerse themselves in a completely virtual world through the VR display device.

In the prior art, the display module in the display device of the AR / VR is responsible for displaying the image of the virtual content of the AR / VR, and the diffractive optical waveguide in the module can be mass-produced by the nano-imprint technology due to its thin and light profile Is one of the main display components in current display modules. The diffractive light waveguide is composed of a set of waveguide lenses for diffracting red light, blue light and green light, respectively, and is used with a projection light machine. The projector in the display module is used to send an image representing virtual content in the form of an optical signal. When the optical signal enters the diffractive optical waveguide, three waveguide lenses for diffracting red, blue, and green light transmit the optical signal. The red light, blue light, and green light of corresponding colors in the medium are respectively diffracted and emitted, so as to jointly present the image corresponding to the light signal to the user. At the same time, because the light emitted by each group of waveguide lenses in the diffractive optical waveguide has only one focus, that is, each group of waveguide lenses can only present the image on the focal plane to the user, it is necessary to pass the two diffractive optical waveguides to the left and right eyes of the user The way of presenting different angle images of the same virtual content makes the user perceive the distance of the virtual content. Therefore, in order to prevent the user's left and right eyes from constantly adjusting the balance between the images of different angles, the visual convergence adjustment conflicts affect the visual effect, the display module usually adopts the superposition of diffractive optical waveguides to achieve the display function of multiple focal planes, so that Each group of waveguide lenses can present users with images of different focal planes to reduce users' visual convergence adjustment conflicts.

However, in the prior art, each additional focal plane of the display module requires an additional diffractive optical waveguide in addition to the original diffractive optical waveguide of the three waveguide lenses, and each group of diffractive optical waveguides includes a separate The three waveguide lenses used to diffract red light, blue light and green light will greatly increase the weight, volume and cost of the display module, resulting in a more complex structure of the display module. Therefore, how to simplify the structure of a display module having multiple focal plane display functions is a technical problem to be solved urgently at present.

Summary of the Invention

The present application provides a display module and an imaging method to simplify the structure of a display module with multiple focal plane display functions to a certain extent.

A first aspect of the present application provides a display module. The display module is applied to an augmented reality display device or a virtual reality display device. The display module includes:

A red light waveguide lens, a green light waveguide lens, a blue light waveguide lens, a white light waveguide lens, and at least one projector light projector;

The red optical waveguide lens, the green optical waveguide lens, the blue optical waveguide lens, and the white optical waveguide lens are arranged in parallel, and the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide are arranged in parallel. The focal point of the lens and the white light waveguide lens is on the same straight line;

The at least one projector is configured to make a first optical signal representing a first image incident on the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens through a first optical path, and to transmit A second optical signal of a second image is incident on the white optical waveguide lens through a second optical path;

The red optical waveguide lens is configured to receive and diffract red light in the first optical signal and emit the light, and the blue optical waveguide lens is configured to receive and diffract blue light in the first optical signal and emit, The green optical waveguide lens is configured to receive and diffract the green light in the first optical signal and emit the green light. The red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens collectively emit light in the first The focal plane presents the first image;

The white light waveguide lens is used for receiving and diffracting white light in the second optical signal and exiting. The light emitted from the white light waveguide lens presents the second image in a second focal plane. The two focal planes are on different planes from the first focal plane.

The display module provided in this embodiment is capable of injecting a first optical signal into a red optical waveguide lens, a green optical waveguide lens, and a blue optical waveguide lens through at least one projector through a first optical path, so that the red optical waveguide lens and green light The waveguide lens and the blue optical waveguide lens diffract the first optical signal and emit the first optical signal to present a first image in the first focal plane. The second optical signal is incident on the white optical waveguide lens through the second optical path, and the white optical waveguide lens diffracts the first optical signal. The two optical signals are emitted afterwards to present a second image in a second focal plane, and the first focal plane and the second focal plane are in different planes. Therefore, the function of displaying different images on two different focal planes through one display module can be obtained through four optical waveguide lenses, compared with the method of superposing multiple red optical waveguide lenses, green optical waveguide lenses, and blue optical waveguide lenses. , Reducing the use of optical waveguide lenses, thereby reducing the weight, volume and cost of the display module, to some extent, simplifying the structure of a display module with multiple focal plane display functions. In addition, when the display module provided in this embodiment is applied to an AR / VR display device having multiple focal plane display functions, the structure of the AR / VR display device having multiple focal plane display functions can also be simplified to a certain extent. .

In an embodiment of the first aspect of the present application, the first optical path includes a red optical path, a green optical path, and a blue optical path; and the at least one projector is specifically configured to inject the red light into the red optical path through the red optical path. The red light waveguide lens, the green light is incident on the green light waveguide lens through the green light path, and the blue light is incident on the blue light waveguide lens through the blue light path.

In the display module in this embodiment, red light, green light, and blue light can be separately incident into the red light waveguide lens, the green light waveguide lens, and the blue light waveguide lens corresponding to these lights through different light paths, so that each There is only a single color of light diffracted in an optical waveguide lens. And for each optical waveguide lens, there is only a single color of light emitted from it, so the first image composed by the emitted light of the three optical waveguide lenses in the first focal plane can be more uniform. There is no cross-talk between optical waveguides of different colors during the diffraction process of the optical waveguide lens, thereby improving the visual effect of the human eye on the first image.

In an embodiment of the first aspect of the present application, the at least one projection light machine includes: a first projection light machine, configured to make a first light signal representing a first image incident on the red light through the first light path A waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens; and a second optical signal representing a second image is incident on the white optical waveguide lens through the second optical path.

In an embodiment of the first aspect of the present application, the first projector includes a red light source, a green light source, a blue light source, and a white light source that are independently provided;

The red light source is used to generate the red light, the green light source is used to generate the green light, and the blue light source is used to generate the blue light; the first light signal representing the first image It includes the red light, green light, and blue light; the white light source is used to generate the white light, and the second light signal representing the second image is the white light.

Or, in an embodiment of the first aspect of the present application, the at least one projector includes a first projector and a second projector, and the first projector is configured to convert a first projector An optical signal is incident on the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens through the first optical path; and the second projector is configured to transmit a second light representing a second image. A signal is incident on the white optical waveguide lens through the second optical path.

In an embodiment of the first aspect of the present application, the first projector includes a red light source, a green light source, and a blue light source that are independently provided, wherein the red light source is used to generate the red light, and the green light The light source is used to generate the green light, the blue light source is used to generate the blue light, and the first light signal representing the first image includes the red light, green light, and blue light; the second projection The optical machine includes a white light source for generating the white light, and the second light signal representing the second image is the white light.

In this embodiment, at least one of the projectors in the above embodiment is improved on the basis of the existing one, and the light sources in the first projector are set to three independently set red light sources, green light sources, and blue light sources. Alternatively, an independent white light source may be further set in the first projector, so that the light of the corresponding color emitted by each light source irradiates the micro display to generate independent red light, green light, blue light, and white light. Thereby, the first projection light machine independently emits red light, green light, blue light, and white light of different wavelengths from the pupil and separately enters the red light waveguide lens, the green light waveguide lens, the blue light waveguide lens, and the white light corresponding to the lights. Optical waveguide lens. Furthermore, the first image composed of the light emitted by the red light waveguide lens, the green light waveguide lens, and the blue light waveguide lens can be made more uniform in the diffraction, and there is no different color light waveguide between the diffraction processes of each light waveguide lens. Crosstalk to improve the visual effect of the human eye on the first image.

In an embodiment of the first aspect of the present application, the exit pupil gratings of the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens are all arc-shaped, and the red optical waveguide lens, the green The focal points of the optical waveguide lens and the blue optical waveguide lens are located in the first focal plane.

In an embodiment of the first aspect of the present application, an exit pupil grating of the white optical waveguide lens is arc-shaped, and a focal point of the white optical waveguide lens is located in the second focal plane.

The red optical waveguide lens, the green optical waveguide lens, the blue optical waveguide lens, and the white optical waveguide lens provided in this embodiment all use a light field type optical waveguide lens having optical power, and the grating is decoupled by the optical waveguide lens itself. It is a diffractive lens, and the light emitted from the optical waveguide lens has a focal point through the bending of the coupled grating. Therefore, the AR / VR display device does not need to be provided with an additional convex lens for making the emitted light have a focus in addition to the display module. Therefore, when the display module provided in this embodiment is applied to an AR / VR with multiple focal plane display functions When the VR display device is used, the structure of the AR / VR display device is further simplified.

In an embodiment of the first aspect of the present application, the AR / VR display module further includes: N white optical waveguide lenses, where N is an integer greater than or equal to 1.

The at least one projector is further configured to inject N optical signals into the N white optical waveguide lenses through N optical paths, respectively, wherein the N optical signals carry different images;

The N white optical waveguide lenses are respectively used to diffract the light signals incident on the projection light machine and emit the light signals, so as to present images corresponding to the incident light signals in different N focal planes.

The display module provided in this embodiment further includes N white optical waveguide lenses on the basis of the above embodiment, so that the display module can display more different focal planes based on the foregoing that can be provided in two focal planes. Image. And for each additional focal plane, only a white optical waveguide lens is added to the original basis, thereby reducing the increase and use of optical waveguide lenses, thereby reducing the weight, volume and cost of the display module, and simplifying the provision of multiple Structure of a display module with a focal plane display function.

A second aspect of the present application provides an imaging method, including:

Acquiring a first light signal used to represent a first image and a second light signal used to represent a second image;

Red light in the first optical signal is diffracted through a first optical path and then emitted, green light in the first optical signal is diffracted in the first optical path and is emitted and diffracted the first light through the first optical path. The blue light in the signal exits to present the first image in a first focal plane;

The white light in the second optical signal is diffracted through a second optical path and then emitted, so as to present the second image at a second focal plane, and the second focal plane and the first focal plane are on different planes.

In an embodiment of the second aspect of the present application, the first optical path includes: a red optical path, a green optical path, and a blue optical path; the first optical path diffracts red light in the first optical signal, exits, and passes through The first optical path diffracts green light in the first optical signal and emits it, and diffracts blue light in the first optical signal through the first optical path, and then emits, including:

The red light in the first light signal is diffracted through the red light path and emitted, the green light in the first light signal is diffracted in the green light path, and the first light is diffracted in the blue light path. The blue light in the signal is emitted.

In an embodiment of the second aspect of the present application, the acquiring the first light signal used to represent the first image and the second light signal used to represent the second image includes: generating the application by a first projector light machine. A first light signal representing the first image and the second light signal representing the second image.

In an embodiment of the second aspect of the present application, the generating the first light signal for representing a first image and the second light signal for representing a second image by using a first projector includes: The red light is generated by a red light source independently provided by the first projector, the green light is generated by a green light source independently provided by the first projector, and the blue light is independently provided by the first projector. The color light source generates the blue light; the first light signal representing the first image includes the red light, green light, and blue light; and the white light source is generated by a white light source provided by the first projector.

In an embodiment of the second aspect of the present application, the acquiring the first light signal used to represent the first image and the second light signal used to represent the second image includes: generating the application by a first projector light machine. The first light signal representing the first image is generated by the second projector and the second light signal representing the second image is generated by the second projector.

In an embodiment of the second aspect of the present application, the first light signal for representing the first image is generated by a first projector, and the second light is used for representing the second image by a second projector. The second light signal includes: generating the red light by a red light source independently provided by the first projection light machine; generating the green light by a green light source independently provided by the first projector light; A blue light source independently provided by a projection light generator generates the blue light, and the first light signal representing the first image includes the red light, green light, and blue light; and A white light source generates the white light.

In an embodiment of the second aspect of the present application, N optical signals are acquired, wherein the N optical signals carry different images, and N is an integer greater than or equal to 1;

The N optical signals are diffracted through N optical paths and then emitted, so as to present N images corresponding to the N optical signals at different N focal planes.

In an embodiment of the second aspect of the present application, the first light path diffracts red light in the first light signal and emits the light, and the first light path diffracts green light in the first light signal and emits the light. Diffracting the blue light in the first optical signal through the first optical path and then emitting the blue light, including:

The red light in the first optical signal is diffracted by the red optical waveguide lens and is emitted from the exit pupil grating. The green light in the first optical signal is diffracted by the green optical waveguide lens and is emitted from the exit pupil grating and passed through the blue optical waveguide. The lens diffracts the blue light in the first light signal and exits from the exit pupil grating to present the first image to a human eye at a first focal plane;

The exit pupil gratings of the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens are all arc-shaped, and the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide are all curved. The focal points of the lenses are all located in the first focal plane.

In an embodiment of the second aspect of the present application, the diffracting the white light in the second optical signal through the second optical path and then emitting the white light includes:

Diffracting white light in the second optical signal through a white light waveguide lens and exiting from the exit pupil grating;

The exit pupil grating of the white optical waveguide lens is arc-shaped, and the focus of the white optical waveguide lens is located in the second focal plane.

A third aspect of the present application provides an augmented reality device, including:

Sensors for acquiring images of realistic scenes;

The display module according to any one of the embodiments of the first aspect, wherein the display module is configured to image on at least two focal planes, and is presented to a user in an overlay with the real scene image.

A fourth aspect of the present application provides a virtual reality device, including:

The display module according to any one of the first aspect embodiments, wherein the display module is configured to image on at least two focal planes and present it to a user;

And a processor, configured to control the projection light machine in the display module to generate a first light signal representing a first image and a second light signal representing a second image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic structural diagram of an embodiment of a display module of the present application;

2 is a schematic structural diagram of an embodiment of a display module of the present application;

3 is a schematic structural diagram of an embodiment of a display module of the present application;

4 is a schematic structural diagram of an embodiment of a display module of the present application;

5A is a schematic structural diagram of an embodiment of a projection light machine in a display module of the present application;

5B is a schematic structural diagram of an embodiment of a projection light machine in a display module of the present application;

5C-5F are schematic structural diagrams of light paths in a projection light machine in a display module of the present application;

FIG. 6 is a schematic diagram of an optical path of a projection optical machine of the present application;

FIG. 7 is a schematic diagram of a light output structure of a projection light machine of the present application; FIG.

8 is a schematic structural diagram of an embodiment of a display module of the present application;

9 is a schematic structural diagram of an embodiment of a display module of the present application;

FIG. 10 is a schematic structural diagram of a non-light field type optical waveguide lens;

11 is a schematic structural diagram of a light field type optical waveguide lens in a display module of the present application;

12 is a schematic diagram of a light emitting structure of a white light waveguide lens in a display module of the present application;

FIG. 13 is a schematic structural diagram of an AR / VR display device according to an embodiment of the present application; FIG.

14 is a schematic structural diagram of an embodiment of an AR / VR display device of the present application;

15 is a schematic structural diagram of an application embodiment of an AR / VR display device of this application;

16 is a schematic structural diagram of an application embodiment of an AR / VR display device of this application;

17 is a schematic structural diagram of an application embodiment of an AR / VR display device of this application;

18 is a schematic flowchart of an embodiment of an imaging method according to the present application;

19 is a schematic structural diagram of an embodiment of an augmented reality device of the present application;

FIG. 20 is a schematic structural diagram of an embodiment of a virtual reality device of the present application.

detailed description

FIG. 1 is a schematic structural diagram of an embodiment of a display module of the present application. As shown in FIG. 1, the display module in this embodiment can be used to display images in an AR display device or a VR display device. Specifically, the display module in this embodiment includes a red light waveguide lens 11 and a green light waveguide lens 12. , A blue light waveguide lens 13, a white light waveguide lens 21, and at least one projector 3.

Among them, the red light waveguide lens 11 is used to diffract the red light incident on the grating 111 and emit it from the coupling grating 112, and the green light waveguide lens 12 is used to diffract the green light incident on the grating 121. It is emitted from its coupling grating 122. The blue light waveguide lens 13 is used to diffract the blue light incident on the grating 131 and is emitted from its coupling grating 132. The white light waveguide lens 21 is used to couple it to the grating 211 for incidence. The white light is diffracted and exits from its decoupling grating 212. The red optical waveguide lens 11, the green optical waveguide lens 12, the blue optical waveguide lens 13 and the white optical waveguide lens 14 are arranged in parallel, and the red optical waveguide lens 11, the green optical waveguide lens 12, the blue optical waveguide lens 13 and the white optical waveguide lens 14 are arranged in parallel. The focal points of are all on the same line perpendicular to the lens. The focus here refers to the virtual focus of the image formed by the waveguide lens. For example, the specific positional relationship of the above-mentioned four optical waveguide lenses can be shown in FIG. 1, the human eye 5 is located directly below the figure, and the direction of the line of sight of the human eye 5 is viewed from directly below to directly above the figure. Conversely, red The light emitted from the optical waveguide lens 11, the green optical waveguide lens 12, the blue optical waveguide lens 13, and the white optical waveguide lens 14 presents an image to the human eye from a top-to-bottom direction. In addition, the virtual focus of the image formed by the red optical waveguide lens 11, the green optical waveguide lens 12, the blue optical waveguide lens 13 and the white optical waveguide lens 14 may be on the same straight line passing through the human eye 5 and perpendicular to the four optical waveguide lenses. That is, the red optical waveguide lens 11, the green optical waveguide lens 12, the blue optical waveguide lens 13, and the white optical waveguide lens 14 are all disposed perpendicular to the direction of sight of the human eye, and the four optical waveguide lenses are disposed in parallel.

The at least one camera 3 is specifically configured to make the first optical signal representing the first image incident on the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 through the first optical path 31. The first light signal may be a first image represented by independent or mixed red, green, and blue light, or the first light signal is a first image represented by white light. The first light signal may be generated by at least one projector 3, for example, the at least one projector 3 obtains a first image from a processor of the AR / VR display device, and generates a first image representing the first image according to the first image. After the optical signal, the first optical signal is incident on the red optical waveguide lens 11, the green optical waveguide lens 12 and the blue optical waveguide lens 13 through the first optical path 31. Specifically, as shown in FIG. 1, the starting end of the first optical path 31 is at least one projector 3, and the first optical path passes through the coupling grating 111 of the red optical waveguide lens 11 and the coupling grating 121 of the green optical waveguide lens 12 in order. And the blue optical waveguide lens 13 are coupled to the grating 131, and the first signal passes through the first optical path 31 through the coupling grating of the three optical waveguide lenses, the red optical waveguide lens 11 is used to receive and diffract the first optical signal The red light is emitted through its coupled out grating 112, the blue light waveguide lens 12 is used to receive and diffract the blue light in the first optical signal and is emitted through its coupled out grating 122, and the green light waveguide lens 13 is used to receive and diffract the light. The green light in the first light signal is emitted through the coupling-out grating 132. Finally, the diffracted red outgoing light 411 from the red optical waveguide lens 11, the diffracted green outgoing light 412 from the green optical waveguide lens 12, and the diffracted blue outgoing light from the blue waveguide through the lens 13. 413. Together, they constitute white light, and the white light can present a first image 611 to the human eye at the uppermost first focal plane 61 as shown in the figure. That is, the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 are used as a combined optical waveguide lens group 1. The optical waveguide lens group 1 needs to be used in combination to realize the first focal plane 61 to the human eye. An image 611. It should be noted that, as shown in FIG. 1, the single arrow representation of the red outgoing light 411, the green outgoing light 412, and the blue outgoing light 413 is merely an example. The actual outgoing light should include multiple channels and the direction of the actual outgoing light. Both can be represented by arrows starting from the focal point in the first focal plane 61 and diverging in the range shown by the two dotted lines connecting the first focal plane 61 in the figure. In addition, the focal plane here is the virtual focal plane of the image presented by the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13, that is, the human eye 5 located in the lower part of the figure passes the red optical waveguide lens 11, green When the first image 611 seen by the light emitted from the optical waveguide lens 12 and the blue optical waveguide lens 13 is visible to the human eye 5, the first image 611 is located in the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens. 13 is inside 61 above the first focal plane. In addition, as shown in FIG. 1, only one possible arrangement manner of the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 is shown, that is, the red optical waveguide lens 11, the green The order of the optical waveguide lens 12 and the blue optical waveguide lens 13 can be adjusted according to actual use conditions. In this embodiment, the arrangement order of the three optical waveguide lenses is not specifically limited.

At the same time, the at least one projector 3 is further configured to inject the second optical signal representing the second image into the white optical waveguide lens 21 through the second optical path 32. The second optical signal may be independent or mixed red light. A second image represented by, green, and blue light, or a second light signal is a second image represented by white light, and the second light signal may be generated by at least one projector 3, for example, at least one projector 3 from AR The processor of the / VR display device obtains the second image, generates a second optical signal for representing the second image based on the second image, and then enters the second optical signal into the white optical waveguide lens 21 through the second optical path 32. Specifically, as shown in FIG. 1, the starting end of the second optical path 32 is at least one projector 3. The second optical path 32 passes through the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 in order. The white optical waveguide lens 21 is coupled to the grating 211. The white optical waveguide lens 21 receives and diffracts white light and then emits through the coupled grating 212. Finally, the white light 412 emitted by the white optical waveguide lens can be as shown in the second figure. The focal plane 62 presents a second image 612 to the human eye 5. Similarly, the second focal plane 62 here is a virtual focal plane formed by the white light waveguide lens 21, that is, the second image 612 that the human eye 5 located under the white light waveguide lens can perceive through the light emitted by the white light waveguide lens 21. It is located in the second focal plane above the white optical waveguide lens. The second image 612 displayed on the second focal plane 62 and the first image 611 displayed on the first focal plane 61 are different images, and are represented by different first and second optical signals. When the display module needs to display a distant image, the light signal of the image can be generated by at least one projector 3 and incident on the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 through the first optical path. The image is presented on the first focal plane 61 after being diffracted by the three optical waveguide lenses. When the display module needs to display a closer image, the light signal of the image can be generated by at least one projector 3 and then incident on the white optical waveguide lens 21 through the second optical path and diffracted by the white optical waveguide lens 21. This image is presented on the second focal plane 62. Moreover, in this embodiment, the position of the white optical waveguide lens 21 is only an example of the blue optical waveguide lens 13. As shown in FIG. 1, the four optical waveguide lenses can be arbitrarily selected under the condition that they are parallel and the focus is on the same straight line The order is set.

In summary, as shown in FIG. 1, at least one of the projectors 3 in the display module provided in this embodiment can be directed to the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide through the independently set first optical path 31. The lens 13 outputs a first optical signal, and outputs a second optical signal to the white optical waveguide lens 21 through a second light 32 channel provided independently. The first optical signal is emitted after being diffracted by the red optical waveguide lens 11, the green optical waveguide lens 12 and the blue optical waveguide lens 13, and the second optical signal is emitted after being diffracted by the white optical waveguide lens 21. Thus, the human eye 5 can view the first image located on the first focal plane according to the output light of the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13, and view the light emitted from the white light waveguide lens 21. To the second image located on the second focal plane, and the focal lengths of the first focal plane and the second focal plane are different. Therefore, the white optical waveguide lens 21 can realize a function of displaying an image at a specific focal plane only through a single optical waveguide lens, so that the display module in this embodiment can pass three optical waveguides for diffracting monochromatic light. Lens, red light waveguide lens 11, green light waveguide lens 12, and blue light waveguide lens 13 plus a light waveguide lens for diffracting white light, the white light waveguide lens 21 can obtain the function of displaying two focal planes. Compared with the conventional method of superimposing a plurality of red optical waveguide lenses 11, green optical waveguide lenses 12, and blue optical waveguide lenses 13 on the display module to increase the focal plane, the use of optical waveguide lenses is reduced, thereby reducing the display to a certain extent. The weight, volume, and cost of the module. When the display module of this embodiment is applied to an AR / VR display device with multiple focal plane display functions, the AR with multiple focal plane display functions can also be simplified to a certain extent. / VR display device structure.

FIG. 2 is a schematic structural diagram of an embodiment of a display module of the present application. FIG. 2 is a diagram illustrating a possible implementation manner of the first optical path 31 in a display module based on the embodiment shown in FIG. 1.

Specifically, since the white light used to represent the first picture may be composed of red light, green light, and blue light, in the embodiment shown in FIG. 1, at least one projector 3 may be on the first light path 31. The white light used to represent the first image is transmitted. The coupling grating 111 of the red light waveguide lens 11 can couple the red light of the white light into the red light waveguide lens 11 while the green light and blue light of the white light are not. The coupling grating 111 enters but passes directly through the red optical waveguide lens 11. The coupling grating 121 of the green light waveguide lens 12 couples the green light in the white light into the green light waveguide lens 12, and the blue light in the white light continues to reach the coupling grating 121 of the green light waveguide lens 12 to reach The blue light waveguide lens 13 is coupled to the grating 131 and enters the blue light waveguide lens 13. Although this embodiment can also realize that the first optical signal is coupled into the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 through the first optical path 31. However, because the coupling gratings of the red light waveguide lens 11, green light waveguide lens 12, and blue light waveguide lens 13 used to diffract different colors of light are set according to the principle of wavelength selection, the red light waveguide lens 11, green light is caused. The coupling gratings of the waveguide lens 12 and the blue light waveguide lens 13 can only couple the light of the corresponding color, and the wavelengths of the three lights of red light, green light, and blue light partially overlap, so when the red light waveguide When the coupling grating 111 of the lens 11 couples red light into the red light waveguide lens 11, some green light and blue light are also coupled. Similarly, the coupling grating 121 of the green light waveguide lens 12 also couples part of the red light and blue light when the green light is coupled, and the coupling grating 131 of the blue light waveguide lens 13 also couples the blue light when coupled to the blue light. Part of the red light and the green light are coupled into it, which makes the uniformity of the emitted light of the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 poor, which will affect the human eye's vision of the first image in severe cases. effect.

Therefore, in this embodiment, as shown in FIG. 2, in the embodiment shown in FIG. 1, the first optical path 31 of the first optical signal transmitted by at least one of the projectors 3 is more finely divided into a red optical path 311 and a green Light path 312 and blue light path 313. The first optical signal sent by the at least one projector 3 through the first optical path 31 includes independent red light, green light, and blue light. At least one projector 3 is used to directly and independently pass the red light through the red light path 311 through the coupling of the red light waveguide lens 11 into the grating 111 to enter the red light waveguide lens 11, and for passing the green light directly through the green light path 312 and The green light waveguide lens 12 is independently incident into the green light waveguide lens 12 through the coupling grating 121 and the blue light path 313 is used to directly and independently pass the blue light waveguide lens 13 into the blue grating 131 to enter the blue light. In the waveguide lens 13. Thus, red light, green light, and blue light are separately incident into the optical waveguide lenses corresponding to these lights through different optical paths, so that the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 are actually used. The diffracted light has only a single color, so that the light emitted from the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 also has only a single color. Therefore, the first image composed of the emitted light of the red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide lens 13 can be made more uniform. The red light waveguide lens 11, the green light waveguide lens 12, and the blue light waveguide The diffraction process of the lens 13 does not include crosstalk between the optical waveguides of different colors, thereby improving the visual effect of the human eye on the first image.

Optionally, since the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 are arranged in parallel, the green optical path 312 shown in the figure needs to pass through the red optical waveguide lens 11, and the blue optical path 313 needs Passes through the red optical waveguide lens 11 and the green optical waveguide lens 12. Therefore, for the first optical path 31 in the form shown in FIG. 2, the coupling gratings of the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 need to be set at different positions accordingly, as shown in FIG. 2. The green light path 312 shown in the figure does not pass through the red light waveguide lens 11 and is coupled to the grating 111, but passes through the red light waveguide lens 11 and directly enters the green light waveguide lens 12 into the grating 121; as shown in the figure The blue light path 313 does not pass through the coupling grating 111 of the red optical waveguide lens 11 and the coupling grating 121 of the green optical waveguide lens 12, but directly enters the blue optical waveguide lens through the red optical waveguide lens 11 and the green optical waveguide lens 12. 13 is coupled into the grating 131. Similarly, FIG. 2 shows only one possible arrangement manner of the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13, and the embodiments of the present application do not make an arrangement order of the optical waveguide lenses. Specific limitations.

FIG. 3 is a schematic structural diagram of an embodiment of a display module of the present application. It is shown in the embodiment shown in FIG. 3 that at least one projector includes a projector, that is, at least one projector in the above embodiment. This is an embodiment of the first projector 301. The projector 301 is configured to make a first optical signal representing a first image incident on the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 through the first optical path 31. Specifically, the projector can adopt the manner shown in the embodiment shown in FIG. 2 to separately and independently pass red light through the red light path 311 through the coupling of the red optical waveguide lens 11 into the grating 111 and enter the red optical waveguide lens 11 respectively. And is used to directly and independently pass the green light through the green light path 312 through the coupling of the green light waveguide lens 12 into the grating 121 to enter the green light waveguide lens 12 and to directly and independently pass the blue light through the blue light path 313 through the blue light The coupling lens 131 of the waveguide lens 13 is incident into the blue light waveguide lens 13. At the same time, the projector 301 can also be used to make the second optical signal representing the second image incident on the white optical waveguide lens 21 through the second optical path 32. As a result, the first projector 301 can inject red light, green light, blue light, and white light into the optical waveguide lens corresponding to these lights through different light paths.

FIG. 4 is a schematic structural diagram of an embodiment of a display module of the present application. It is shown in the embodiment shown in FIG. 4 that at least one projector 3 includes two projectors, which are a first projector 301 and The second projection light machine 302, and the first light signal and the second light signal are incident on the light guide lens group 1 and the white light through the first light path and the second light path respectively through the first light path and the second light path. The mode of the waveguide lens 21.

Specifically, the embodiment shown in FIG. 4 can be based on the embodiment shown in FIG. 1 or FIG. 2. At least one projector 3 includes a first projector 301 and a second projector 302. A projector 301 is used to inject the first optical signal into the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 through the first optical path 31, and the second projector 302 is configured to pass the second optical path 32 injects the second optical signal into the white optical waveguide lens 21. The specific incident light signals of the first projector 301 and the second projector 302 may use any one of the foregoing embodiments, and details are not described herein again. In this implementation, it is mainly emphasized that two independent projectors are used to project different light signals through different light paths, and a single projector only needs to be responsible for generating a single image display, so as to reduce the demand for the display performance of the projector.

Furthermore, in this embodiment, when the FoV of the image formed by the optical waveguide lens group 1 and the FoV of the image formed by the white optical waveguide lens 21 are different, the first projection optical machine 301 and the second projection optical machine 302 The optical signals of different FoV images can also be sent to corresponding lenses, that is, the FoV of the optical signals sent by the first projector 301 and the second projector 302 in this embodiment can be different. For example: assuming that the FoV of the optical waveguide lens group 1 in FIG. 4 is 60 degrees, the first projector 301 injects the first optical signal with a FoV of 60 degrees into the optical waveguide lens group 1 and is on the first focal plane A first image with a FoV of 60 degrees is presented; if the FoV of the white optical waveguide lens 21 is 25 degrees, the second projection light projector enters the second optical signal with a FoV of 25 degrees into the white optical waveguide lens 21, and A second image with a FoV of 25 degrees is presented on the focal plane. When the pixels of the first image and the second image are the same, since the focal lengths of the optical waveguide lens group 1 and the white optical waveguide lens 21 are different, the two optical machines are separated to be able to project different FoV optical signals to the lenses of different focal lengths. The first image can be presented with a larger FoV in a first focal plane with a larger focal length to present a distant view, and the second image can be presented with a smaller FoV in a second focal plane with a smaller focal length to present a closer view. Therefore, the resolution of the second image in the small FoV focal plane can be improved, and the visual effect of the human eye on the first image and the second image in different focal planes can be improved. And because the human eye is more sensitive to the visual experience of the central field of view, displaying a close view through a smaller FoV image can enhance the depth information and resolution of the central field of view of the human eye, thereby further improving the visual effect of the human eye.

FIG. 5A is a schematic structural diagram of an embodiment of a projection light machine in a display module of the present application. FIG. 5A illustrates a structure of a first projector 301 for implementing red light, green light, and blue light to be emitted through different light paths in the embodiment shown in FIG. 4.

As shown in FIG. 5A, the first projector 301 adopts a light path structure of Bird and Bath folding, which includes a Polarization Beam Splitter (PBS) 801, a reflecting mirror 802, and a projection eyepiece 803. The light from the left light source in the figure is reflected by the PBS801 to the reflector 802, and the reflector 802 reflects the incident light to the image displayed on the microdisplay to obtain a light signal representing the image, and the light signal passes through again After the PBS is reflected to the projection eyepiece 803, the projection eyepiece 803 outputs an optical signal, and the microdisplay can adopt, for example, a liquid crystal-on-silicon (LCoS) structure. The light source in the existing projector is usually a white light emitting diode (LED) light source. The light signal used to identify the image after the light from the white light source illuminates the microdisplay is also in the form of white light, so it cannot be used. It is directly used in the embodiment shown in FIG. 4. The projector in this embodiment is improved on the existing basis. As shown in FIG. 5A, the first projector includes three independently-set red light sources, green light sources, and blue light sources. The light of the corresponding color emitted by each light source passes through the PBS801, the reflecting mirror 802, the micro-display, the PBS801, and the projection eyepiece 803 in order and outputs the first projector light 301. After the path is irradiated with the micro display, independent red light, green light, and blue light are generated, so that the projection light machine independently exits the red light, green light, and blue light of different wavelengths from the pupil. When the first light signal represents the first image by red light, green light, and blue light, it can be applied to an optical waveguide lens that is independently projected into a system that diffracts light of a corresponding color in the system shown in FIG. 4.

Further, FIG. 5B is a schematic structural diagram of an embodiment of a projector in a display module of the present application. The structure shown in FIG. 5B is based on the structure shown in FIG. 5A and further includes a white light source provided independently. That is, when the first projector 301 in FIG. 5A is applied to the embodiment shown in FIG. 3, the first projector 301 also needs to include an independent white light source based on the structure in FIG. 5A. Wherein, the white light emitted by the white light source is irradiated with the micro display through the same path as described above to generate the same independent white light as the second light signal in the embodiment of FIG. 3, and the red light, green light and blue light of the first light signal. The pupils are independently exited from the first projectors 301.

Specifically, FIG. 5C to FIG. 5F are schematic structural diagrams of an optical path in a projection light machine in a display module of the present application. 5C independently shows the light path of the light emitted by the separate red light source in FIG. 5A in the first projector 301, and the red light emitted by the red light source passes through the PBS801, the mirror 802, the microdisplay, the PBS801, and 5D and 5E independently show the light paths of the green light source and the blue light source in the first projection lighter 301, the red light source, and the green light source in FIG. 5A independently. The light path of the blue light source in the first projector 301 is the same, and the red light, green light, and blue light output by the red light source, the green light source, and the blue light source together form the image used to represent the image on the microdisplay. Light signal. FIG. 5F independently shows the light path of the light emitted by the separate white light source in FIG. 5A in the first projector 301. The white light emitted by the white light source also passes through the PBS801, the mirror 802, the microdisplay, the PBS801, and the projection in this order. The eyepiece 803 outputs the first projector light 301, and the white light of the first projector light 301 output by the white light source is a light signal for representing the image on the micro-display. FIG. 6 is a schematic diagram of the light path of the projection optical machine of the present application; FIG. 7 is a schematic diagram of the light output structure of the projection optical machine of the present application. Figure 6 shows the light path of the light in the projector, which is the same as that of the white light in the prior art. The difference is that in this embodiment, there are three different colors of light, and each color of light is independent. The light path can be finally seen in the schematic diagram of the light output structure in FIG. 7. The first projector 301 applied to the embodiment shown in FIG. 3 adjusts the relative positions of the red light source, the green light source, the blue light source, and the white light source to make the projection The light machine independently emits red, green, blue, and white light of different colors from different positions.

In addition, in order to achieve a separate exit pupil of the projector with more power images, more LED light sources can also be set, and the color can be white, red, blue, or green to achieve more exit light paths of the projector. For example, an independent red light source, a blue light source, a green light source, and two white light sources are provided in the first projector light source 301. Among them, the first projector light source 301 independently emits the red light source, the blue light source, and the green light source through the first light path. The obtained red light, green light and blue light; the projection light machine independently emits white light obtained by a white light source through a second light path, and independently emits white light obtained by another white light source through a third light path. The principle of such a simple quantity superposition is the same as that in this embodiment and will not be described again. Therefore, the two types of first projectors provided in the foregoing embodiments can be applied to the embodiments shown in FIG. 4 and FIG. 3, respectively, so that the red, green, and blue lights emitted by the first projector can pass through The first image composed by the diffracted outgoing light of the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 is more uniform, and there is no different color optical waveguide for the diffraction process of each optical waveguide lens. Crosstalk between them to improve the visual effect of the human eye on the first image.

FIG. 8 is a schematic structural diagram of an embodiment of a display module of the present application. As shown in FIG. 8, the display module of this embodiment can provide a solution for achieving more focal length display based on the embodiment shown in FIG. 1 or FIG. 2.

Specifically, as shown in FIG. 8, in this embodiment, in addition to the embodiment in FIG. 1 or FIG. 2, N white optical waveguide lenses are also included, where N is an integer greater than or equal to 1, that is, the display module includes The white optical waveguide lens 21 in FIG. 1 or FIG. 2 further includes other white optical waveguide lenses. For example, in FIG. 8, a white optical waveguide lens 22 is added as an example. The specific composition and implementation principle of the white optical waveguide lens 22 can be implemented as in any of the foregoing embodiments, and the white optical waveguide lens 22 and other lenses are also arranged in parallel, and the focus of the white optical waveguide lens 22 is also the same as that of the other four lenses. The focal points of each optical waveguide lens are on the same straight line. In this embodiment, the display module can increase the focal plane by adding more white light waveguide lenses.

For example, the embodiment shown in FIG. 8 includes: in addition to the white optical waveguide lens 21 in the foregoing embodiment, a white optical waveguide lens 22 is further added. The white optical waveguide lens 22 is the same as that described in the foregoing embodiment. The principle of the white optical waveguide lens 22 is the same, it also receives white light from its coupled grating 221 and diffracts it out of its coupled grating 222. Among them, at least one of the projectors 3 injects a third optical signal representing the third image into the white optical waveguide lens 22 through the third optical path 33, and the third optical signal is white light. The light emitted by the white light waveguide lens 22 presents a third image 613 to the human eye on the third focal plane 63. The focal lengths of the first focal plane 61, the second focal plane 62, and the third focal plane 63 are all different.

In addition, assuming that the FoV of the optical waveguide lens group 1 in FIG. 8 is 60 degrees, at least one projector 3 injects the first optical signal with a FoV of 60 degrees into the optical waveguide lens group 1 and is at the first focal plane 61 The first image 611 with a FoV of 60 degrees is displayed on the top to present a distant view; the FoV of the white optical waveguide lens 21 and the white optical waveguide lens 22 are both 25 degrees. The optical signals are incident into the white optical waveguide lens 21 and the white optical waveguide lens 22, respectively, to present a second image 612 and a third image 613 with a FoV of 25 degrees on the second focal plane 62 and the third focal plane 63, respectively, for presentation Close shot.

It should be noted that, as shown in FIG. 8, only an example when N is 1. If more focal planes need to be added to the display module, new white light can be added on the basis of this embodiment. Waveguide lenses 23, 24 ..., the projection light machine sends different light signals to each white light waveguide lens through different independent optical paths, and each added white light waveguide lens can be presented to the human eye in different focal planes Images with different focal lengths, thereby realizing the display function of the display module in more focal planes, especially for each additional focal plane, only a new white optical waveguide lens is needed, and the superimposed optical waveguide lens group 1 increases the focal plane. Compared with the method, the use of optical waveguide lenses is greatly reduced, and the structure of a display module having multiple focal plane display functions can be further simplified.

FIG. 9 is a schematic structural diagram of an embodiment of a display module of the present application. The display module in the embodiment shown in FIG. 9 is the embodiment shown in FIG. 8. At least one projection light machine in the embodiment shown in FIG. 4 includes a first projection light machine 301 and a second projection light machine. 302 way to achieve. Specifically, as shown in FIG. 9, the first projector light 301 is configured to inject the first optical signal into the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide lens 13 through the first optical path, and the second projection The optical machine 302 is configured to inject the second optical signal into the white optical waveguide lens 21 through the second optical path, and to inject the third optical signal into the white optical waveguide lens 22 through the third optical path. The specific incident light signals of the first projector and the second projector may use any one of the foregoing embodiments, and details are not described herein again. In this implementation, the first light signal is red light, green light, and blue light, and the second light signal and the third light signal are white light. Therefore, two independent projection light machines need to be respectively projected through different light paths. For different representations of light, the first projector only needs to be responsible for the first light signals of red, green, and blue light, and the second projector is responsible for all the white light, in order to reduce the demand for the projector's display performance. Optionally, the second projector can use a single white light source to generate N light signals of N white light waveguide lenses, or respectively set N white light sources, and each white light source is responsible for generating 1 of a white light waveguide lens. Light signals. Similarly, the example shown in FIG. 9 only shows an example when N is 2. If new white optical waveguide lenses 23, 24, ... are added, the N optical signals of all N white optical waveguide lenses are determined by The second projector light beam is incident on the corresponding N white light waveguide lenses through different N light paths, and the specific implementation manner is the same as the foregoing embodiment, and details are not described again.

FIG. 10 is a schematic structural diagram of a non-light field type optical waveguide lens. The structure of the non-light-field optical waveguide lens generally used in the existing optical waveguide lens used in the display module is shown in FIG. 10. The optical waveguide lens 70 specifically includes a coupling grating 701, a pupil expanding grating 703, and a coupling grating 703. The lower part of FIG. 10 is the human eye 5 and the upper part of the human eye 5 is an optical waveguide lens. The schematic diagram shown in FIG. 3 can be understood as an optical waveguide lens provided in front of the human eye 5. At least one projector 3 projects light into the optical waveguide lens 70 through the coupling grating 701 from the same direction as the line of sight of the human eye 5. After passing through the pupil expanding grating 702 and the coupling out grating 703 in order, the light is diffracted through the coupling out grating. The light comes out to the human eye 5. The pupil expanding grating 702 is used to split the light while propagating, so as to expand the field of view of the light. That is, one channel of light shown in the figure is sent to the pupil expanding grating 702, and three (or more) channels are not shown. Out) the same light is sent into the coupling-out grating 703. The coupling-out grating 703 projects light into the human eye as outgoing light, and presents an image corresponding to the light to the human eye 5. Since the coupled-out grating 703 is a linear grating, the outgoing light of the light after passing through the coupled-out grating 703 is parallel light, and the focal point of the parallel light is at infinity. That is, the optical waveguide lens 70 using the linear grating coupled to the grating 703 does not have a focal point, and is a non-optical field optical waveguide lens. Since the human eye 5's perception of parallel light is a flat image, the red optical waveguide lens 11, the green optical waveguide lens 12, the blue optical waveguide lens 13, and the white optical waveguide lens 21 shown in Figs. The structure shown in FIG. 10 also requires a convex lens to bring the infinity focal point of the optical waveguide lens closer to a comfortable viewing distance for the human eye, which will cause the structure of the display module to be more complicated.

Therefore, an embodiment of the present application provides a light field type optical waveguide lens having optical power, so that the red optical waveguide lens 11, the green optical waveguide lens 12, and the blue optical waveguide are shown in FIGS. 1 and 2. Both the lens 13 and the white optical waveguide lens 21 can use the optical waveguide lens provided in this embodiment to achieve a focal point without having to additionally provide a convex lens in the display module. Specifically, FIG. 11 is a schematic structural diagram of a light field type optical waveguide lens in a display module of the present application. The viewing angle, coupling grating 701, and pupil expanding grating 702 are the same as those shown in FIG. 10, except that the coupling is different. The exit grating 703 is a curved arc. Specifically, in the embodiment shown in FIG. 11, the linear grating shown in FIG. 10 needs to be bent. The bending direction may be upward or downward toward the direction shown in the figure, and bent downward in FIG. 11. For example. The coupling grating 703 is bent from a linear grating to a curved grating. The output light of the coupled coupling grating 703 after the bending is non-parallel light and has a focal point, and the greater the degree of bending of the coupled grating 703 is, the larger the output light is. The closer the focal point is to the optical waveguide lens 70. Therefore, if the red optical waveguide lens 11, the green optical waveguide lens 12, the blue optical waveguide lens 13, and the white optical waveguide lens 21 shown in FIG. 1 and FIG. 2 adopt such a structure as shown in FIG. It is arc-shaped, so that the image formed by coupling out the light emitted by the grating from the optical waveguide lens has a virtual focus. Optionally, the coupling-out grating 703 in this embodiment may adopt a surface relief type grating, so that according to the characteristics of the surface relief angle (FoV) of the surface relief grating, the light emitted by the optical waveguide lens presents The image has a larger FoV, thereby further improving the human eye's perception of the image.

Specifically, for the linear grating used in the optical waveguide lens shown in FIG. 10 as the coupling-out grating, the wave vector of the linear grating is a constant

According to the grating equation

It can be seen that for parallel incident light

Outgoing light passing through a linear grating

It is also parallel light. The decoupling grating in the optical waveguide lens shown in FIG. 11 is a curved grating, for example, a diffractive lens based on a surface relief grating, and the wave vector of the curved grating is along the coordinates (x, y ) Change, according to the grating equation

It can be seen that even for parallel incident light

Emitted light passing through a curved grating

The virtual focal point is propagated and formed according to the grating equation, and the greater the degree of bending of the grating away from the linear type, the shorter the virtual focal length is from the waveguide lens.

For example, in the optical simulation software Zemax or Fred, the light guide lens with a curved surface undulating grating can be simulated and described through a binary grating surface shape. Among them, the binary grating surface shape is polynomial by phase formula

Calculate continuous phase changes on the grating surface. Among them, Φ is the phase of the binary grating surface, M is the polynomial coefficient for calculating the phase, each A _i ρ ²ⁱ is the ith mononomial, A in each polynomial is the grating coefficient, and ρ is the coordinate of a specific direction and range. The larger the subscript of the grating coefficient, the higher the number of polynomial series. The addition of N mononomials can obtain the phase formula to represent the fluctuation of the surface of the grating. Specifically, the focal length of the light guide lens that simulates different bending degrees can be adjusted by adjusting the grating coefficient of each term in the above polynomial. For example: when the virtual focal length is infinite, only the grating coefficients A1-A15 corresponding to the light emitted perpendicular to the direction of the waveguide lens have only A2 other than 0, so the emitted light is parallel light, and the focal length of the waveguide lens is infinite; If the grating coefficients of light emitted in different directions are adjusted, for example, A4, A6, A11, A13, and A15 can be adjusted at intervals, the surface of the grating can be undulated to achieve the effect of grating bending. The focal lengths of the waveguide lenses are 100mm and 2000mm. It should be noted that the above-mentioned values of the grating coefficients are merely examples, and different focal lengths obtained by adjusting different parameters are all within the scope of this embodiment. For the use of the simulation software and the setting of other related parameters that are not shown, reference may be made to the software and the setting method in the prior art, which is not limited in this embodiment.

FIG. 12 is a schematic diagram of a light emitting structure of a white light waveguide lens in a display module of the present application, and further illustrates a possible light emitting structure of the white light waveguide lens in the above embodiments.

Specifically, the exit pupil gratings of the optical waveguide lenses used to diffract white light in the prior art all use holographic gratings, resulting in a narrow FoV of the optical waveguide lenses and having a certain wavelength selectivity. In the embodiments of the present application, the exit pupil grating of the white optical waveguide lens uses a surface relief grating, so that the white optical waveguide lens has improved FoV and does not have wavelength selectivity. As shown in FIG. 8, when the white light waveguide lens is implemented by glass having a refractive index of 2.0, the red light (wavelength 633 nm), green light (wavelength 532 nm), and blue light (455 nm) incident on the white light waveguide lens are white light. The transverse FoV of the diffracted outgoing light in the waveguide lens is about 60 degrees, and the outgoing light of each monochromatic light does not completely overlap in the transverse direction. And the white light waveguide lens combines the overlapping parts of the outgoing light after the red, green, and blue light is diffracted, and the horizontal FoV is only 25 degrees.

Therefore, when the white optical waveguide lens using the surface relief grating in this embodiment is applied to the embodiment shown in FIGS. 1 and 2, the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens can display When the image of a large FoV distant view in the focal plane is able to display an image of a close view of a small FoV in the second focal plane, that is, the focal length of the first focal plane is greater than the focal length of the second focal plane of the white optical waveguide lens. For example, when the display module needs to display the content that a person walks from a distance to a near place, when the person is far away, the image of the person at a distance generated by the projector is composed of a red light waveguide lens and a green light waveguide lens. The blue light waveguide lens is presented to the human eye. When the person walks near, the image generated by the projector near the person is presented to the human eye by the white light waveguide lens. The distance here is a relative concept, which can be based on the actual situation. Need to set different focal planes. Because the human eye is more sensitive to the visual experience of the central field of view, displaying a close view through a smaller FoV image can enhance the depth information and resolution of the central field of view of the human eye, thereby further improving the visual effect of the human eye. Furthermore, the display module of the display mode of this embodiment displays a large FoV image through a red light waveguide lens, a green light waveguide lens, and a blue light waveguide lens including three lenses, and a white light waveguide lens with a single lens separately displays a small FoV image. The combination of the two methods not only enables the display module to maximize the FoV, but also takes into account the large FoV display, high resolution of the display content, and a simpler and lighter display module structure.

FIG. 13 is a schematic structural diagram of an embodiment of an AR / VR display device of the present application. The AR / VR display device shown in FIG. 13 includes a display module in any of the embodiments shown in FIGS. 1 to 12. Specifically, as shown in FIG. 13, the AR / VR display device includes the foregoing two display modules, which are respectively configured to display AR / VR content to the left and right eyes of the user. The AR / VR content may be the first image, the second image, and the third image described in the above embodiments. In addition, the AR / VR display device also includes: a sensor, a processor, a memory, and a power source. The processor can connect to the communication network through the network communication module, and obtain the image to be displayed from the server located on the user side or the network side through the communication network, and send the acquired image to the projection light machine in the display module for display. . Alternatively, when the image to be displayed is stored in the memory of the AR / VR display device, the processor may also directly send the image in the memory to the projector in the display module for display. FIG. 14 is a schematic structural diagram of an embodiment of an AR / VR display device of the present application. FIG. 14 shows a system circuit configuration diagram of the AR / VR display device shown in FIG. 13. The processing unit is the processor in the above embodiment. The memory can be used to store the images to be displayed, the network communication module is used to connect to the communication network, and the power supply is used to supply power to the modules in the entire AR / VR display device. The micro-display circuit system is used to display an image to be displayed on the micro-display of the projection light machine, and the display illumination driver is used to drive the light emitted by the lighting unit of the projection light machine to pass through the micro-display to obtain a light signal for representing the image. The sensor unit is used to process the dynamic information and position information of the user acquired by the AR / VR display device to adjust the displayed image content according to the posture of the user. This embodiment shows only an implementation manner of an AR / VR display device, and the important point is that it includes a display module. For other modules in the AR / VR display device that are not shown or not fully shown, reference may be made to common knowledge in the field of AR / VR application technology, which is not limited in this application.

FIG. 15 is a schematic structural diagram of an application embodiment of an AR / VR display device of this application. The application scenario shown in Figure 15 is the AR / VR display device shown in Figure 13 applied to an AR / VR scenario that interacts with virtual objects at close distances, allowing the image to be displayed close to the human hand, and can be applied to people and virtual A scene where objects interact closely. Specifically, the AR / VR display device can determine the position of the user's hand through a gesture recognition and positioning system, and retrieve the virtual object to be displayed from the storage system, and the processor of the display device uses the image algorithm to obtain the actual image The pre-virtual objects are combined to obtain that the virtual object in the image to be displayed is located in the user's hand, and the image to be displayed is sent to the display system for display. The display system here is the display module in the above embodiment. FIG. 16 is a schematic structural diagram of an application embodiment of an AR / VR display device of this application. The application scenario shown in FIG. 16 is an AR / VR application where the AR / VR display device shown in FIG. 13 is applied to a virtual game scenario. Specifically, the AR / VR display device retrieves a virtual object to be displayed from the storage system, and also determines a user's operation on the virtual object through a gesture recognition and positioning system, and combines the obtained actual image with a virtual object through an image algorithm. , To obtain that the virtual object in the image to be displayed is moved according to the user's operation, and the image to be displayed is sent to the display system for display. The display system here is the display module in the above embodiment. In addition, the image resources to be displayed on the network can also be obtained through the wireless network and stored in the storage system for recall. FIG. 17 is a schematic structural diagram of an application embodiment of an AR / VR display device of this application. The application scenario shown in FIG. 17 is an AR / VR scenario where the AR / VR display device shown in FIG. 13 is applied to a 3D video conference. The device is used to collect images and audio to be displayed through a microphone and a camera, and send the images and audio to the storage system of the AR / VR display device through a wireless network, so that the AR / VR display device processes the image to be displayed after the image algorithm is processed. And send it to the display system for display. The display system here is the display module in the above embodiment. At the same time, the AR / VR display device also broadcasts the received audio and images simultaneously. It should be noted that the objects processed in the embodiments shown in FIGS. 15 to 17 may be a single image or video content, and the video content may be understood as a continuous image, and for each single image in the continuous image , The manner and principle of a single image processed by the display module in each of the foregoing embodiments of the present application can be adopted.

FIG. 18 is a schematic flowchart of an embodiment of an imaging method according to the present application. The imaging method shown in FIG. 18 can be used for the display module shown in FIG. 1 to present an image on a first focal plane or a second focal plane. The imaging method in this embodiment includes:

S101: Acquire a first light signal used to represent a first image and a second light signal used to represent a second image.

S102: The red light in the first light signal is diffracted through the first optical path and emitted, the green light in the first light signal is diffracted in the first optical path, and the blue light in the first light signal is diffracted in the first optical path. To present a first image in a first focal plane.

S103: The white light in the second optical signal is diffracted through the second optical path and then emitted to present a second image in a second focal plane, and the second focal plane is on a different plane from the first focal plane.

The sequence of S102 and S103 is not specifically limited. In this embodiment, S103 may be executed first and then S102, or S102 and S103 may be executed simultaneously.

The imaging method shown in FIG. 18 can be executed in the display module shown in FIG. 1, and the specific implementation manner and principle thereof are the same as those described in the embodiment of FIG. 1, and will not be described again.

Optionally, in the foregoing embodiment, the first optical path includes a red optical path, a green optical path, and a blue optical path. Then, S102 in the above embodiment specifically includes: diffracting red light in the first light signal through the red light path and then emitting, diffracting green light in the first light signal through the green light path, and then emitting and diffracting the first light signal through the blue light path After the blue light.

Optionally, S101 in the foregoing embodiment specifically includes: generating, by a first projector light machine, a first light signal for representing a first image and a second light signal for representing a second image.

Optionally, in the above embodiment, S101 specifically includes: generating red light by using a red light source independently provided by the first projector, generating green light by using a green light source independently provided by the first projector, and using the first projector The independently set blue light source generates blue light; the first light signal representing the first image includes red light, green light, and blue light; and white light is generated by the white light source provided by the first projector.

Optionally, S101 in the above embodiment specifically includes: generating a first light signal for representing the first image by the first projector, and generating a second light signal for representing the second image by the second projector; Light signal.

Optionally, S101 in the above embodiment specifically includes: generating red light by using a red light source independently provided by the first projector, generating green light by using a green light source independently provided by the first projector, and using the first projector The independently set blue light source generates blue light, indicating that the first light signal of the first image includes red light, green light, and blue light; and the white light source provided by the second projector generates white light.

Optionally, in the foregoing embodiment, the method further includes: acquiring N optical signals, where the N optical signals carry different images, and N is an integer greater than or equal to 1; and diffracting the N optical signals through N optical paths and then emitting the optical signals. To present N images corresponding to the N light signals at different N focal planes.

Optionally, in the above embodiment, S102 specifically includes: diffracting the red light in the first optical signal through the red optical waveguide lens and exiting from the exit pupil grating; and diffracting the green light in the first optical signal through the green optical waveguide lens. After exiting from the exit pupil grating and diffracting the blue light in the first optical signal through the blue light waveguide lens, the light exits from the exit pupil grating to present a first image in the first focal plane. The exit pupil gratings of the red, green, and blue optical waveguide lenses are all curved, and the focal points of the red, green, and blue optical waveguide lenses are all located in the first focal plane.

Optionally, in the above embodiment, S103 specifically includes: diffracting the white light in the second optical signal through the white optical waveguide lens and exiting from the exit pupil grating. The exit pupil grating of the white light waveguide lens is curved, and the focus of the white light waveguide lens is located in the second focal plane.

The imaging methods shown in the foregoing embodiments can be executed in the display module shown in the foregoing embodiments, and the specific implementation and principles thereof are the same as those described in the foregoing embodiments, and will not be described again.

This application further provides a device, including: a processor and a memory; the memory for storing a program; the processor for calling a program stored in the memory to execute an imaging method as in any of the foregoing embodiments .

The present application also provides a computer-readable storage medium. The computer-readable storage medium stores program code, and when the program code is executed, the imaging method according to any one of the foregoing embodiments is performed.

The present application also provides a computer program product. When the program code included in the computer program product is executed by a processor, the imaging method as in any of the foregoing embodiments is implemented.

FIG. 19 is a schematic structural diagram of an embodiment of an augmented reality device of the present application. As shown in FIG. 19, the augmented reality device 19 provided in this embodiment includes a sensor 1901 and a display module 1902. In some possible implementations, a positioning device 1903 and a processor 1904 may also be included. The display module 1902 may be the display module described in any one of the foregoing embodiments of the present application. The sensor 1901 is used to obtain the real scene map where the augmented reality device 19 is located; the positioning device is used to determine the spatial position of the augmented reality device 19; the processor 1904 is used to perform image processing according to the real scene map and the spatial position of the augmented reality device 19; The resulting image is imaged on at least two focal planes through the display module 1902 and is presented to the user in a superimposed manner with a realistic scene graph.

FIG. 20 is a schematic structural diagram of an embodiment of a virtual reality device of the present application. As shown in FIG. 20, the virtual reality device 20 provided in this embodiment includes a display module 2001 and a processor 2003. In some possible implementations, the positioning device 2002 may also be included. The display module 2001 may be the display module described in any one of the foregoing embodiments of the present application. The positioning device is used to determine the spatial position of the virtual reality device 20, the processor 2003 is used to perform image processing according to the spatial position of the virtual reality device 20, and control the projection light machine in the display module to generate a first light signal representing the first image And a second light signal representing the second image. The processed image is imaged on at least two focal planes through the display module 2001 and presented to the user.

Finally, it should be noted that the above embodiments are only used to describe the technical solution of the present application, rather than limiting it. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: The technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features are equivalently replaced; and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the technical solutions of the embodiments of the present application. range.

Claims

A display module, characterized in that the display module is applied to an augmented reality display device or a virtual reality display device and includes:

A red light waveguide lens, a green light waveguide lens, a blue light waveguide lens, a white light waveguide lens, and at least one projector light projector;

The red optical waveguide lens, the green optical waveguide lens, the blue optical waveguide lens, and the white optical waveguide lens are arranged in parallel, and the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide are arranged in parallel. The focal point of the lens and the white light waveguide lens is on the same straight line;

The at least one projector is configured to make a first optical signal representing a first image incident on the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens through a first optical path, and to transmit A second optical signal of a second image is incident on the white optical waveguide lens through a second optical path;

The red optical waveguide lens is configured to receive and diffract red light in the first optical signal and emit the light, and the blue optical waveguide lens is configured to receive and diffract blue light in the first optical signal and emit, The green optical waveguide lens is configured to receive and diffract the green light in the first optical signal and emit the green light. The red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens collectively emit light in the first The focal plane presents the first image;

The white light waveguide lens is used for receiving and diffracting white light in the second optical signal and exiting. The light emitted from the white light waveguide lens presents the second image in a second focal plane. The two focal planes are on different planes from the first focal plane.
The display module according to claim 1, wherein:

The first optical path includes a red optical path, a green optical path, and a blue optical path;

The at least one projection light machine is specifically configured to: inject the red light into the red light waveguide lens through the red light path, inject the green light into the green light waveguide lens through the green light path, and pass The blue light path enters the blue light into the blue light waveguide lens.
The display module according to claim 1 or 2, wherein:

The at least one projector light includes: a first projector light, which is configured to make a first optical signal representing a first image incident on the red optical waveguide lens, the green optical waveguide lens, and the optical fiber through the first optical path. The blue optical waveguide lens; and a second optical signal representing a second image is incident on the white optical waveguide lens through the second optical path.
The display module according to claim 3, wherein

The first projection light machine includes: a red light source, a green light source, a blue light source, and a white light source that are independently provided;

The red light source is used to generate the red light, the green light source is used to generate the green light, and the blue light source is used to generate the blue light; the first light signal representing the first image Including the red light, green light, and blue light;

The white light source is configured to generate the white light, and the second light signal representing the second image is the white light.
The display module according to claim 1 or 2, wherein:

The at least one projector includes a first projector and a second projector, and the first projector is configured to make a first optical signal representing a first image incident on the first optical path to the first optical signal. A red light waveguide lens, the green light waveguide lens, and the blue light waveguide lens; the second projection light machine is configured to make a second optical signal representing a second image incident on the white light through the second optical path Waveguide lenses.
The display module according to claim 5, wherein:

The first projector includes a red light source, a green light source, and a blue light source that are independently provided, wherein the red light source is used to generate the red light, the green light source is used to generate the green light, and A blue light source is used to generate the blue light, and the first light signal representing the first image includes the red light, green light, and blue light;

The second projector includes a white light source for generating the white light, and the second light signal representing the second image is the white light.
The display module according to any one of claims 1-6, further comprising: N white light waveguide lenses, N being an integer greater than or equal to 1;

The at least one projector is further configured to inject N optical signals into the N white optical waveguide lenses through N optical paths, respectively, wherein the N optical signals carry different images;

The N white optical waveguide lenses are respectively used to diffract the light signals incident on the projection light machine and emit the light signals, so as to present images corresponding to the incident light signals in different N focal planes.
The display module according to any one of claims 1-7, wherein

The exit pupil gratings of the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens are all arc-shaped, and the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens have The focal points are all located in the first focal plane.
The display module according to any one of claims 1-8, wherein:

The exit pupil grating of the white optical waveguide lens is arc-shaped, and the focal point of the white optical waveguide lens is located in the second focal plane.
An imaging method, comprising:

Acquiring a first light signal used to represent a first image and a second light signal used to represent a second image;

Red light in the first optical signal is diffracted through a first optical path and then emitted, green light in the first optical signal is diffracted in the first optical path and is emitted and diffracted the first light through the first optical path. The blue light in the signal exits to present the first image in a first focal plane;

The white light in the second optical signal is diffracted through a second optical path and then emitted, so as to present the second image at a second focal plane, and the second focal plane and the first focal plane are on different planes.
The imaging method according to claim 10, wherein the first optical path comprises: a red optical path, a green optical path, and a blue optical path; and the red light in the first optical signal is diffracted through the first optical path and emitted. 2. diffracting the green light in the first optical signal through the first optical path and then diffracting the blue light in the first optical signal through the first optical path, and exiting, including:

The red light in the first light signal is diffracted through the red light path and emitted, the green light in the first light signal is diffracted in the green light path, and the first light is diffracted in the blue light path. The blue light in the signal is emitted.
The imaging method according to claim 10 or 11, wherein the acquiring the first optical signal for representing the first image and the second optical signal for representing the second image comprises:

A first light signal for representing a first image and a second light signal for representing a second image are generated by a first projector light machine.
The imaging method according to claim 12, wherein the first light signal for representing a first image and the second light signal for representing a second image are generated by a first projector light machine. ,include:

The red light is generated by a red light source independently provided by the first projector, the green light is generated by a green light source independently provided by the first projector, and the blue light is independently provided by the first projector. A color light source generates the blue light; the first light signal representing the first image includes the red light, green light, and blue light; and the white light is generated by a white light source provided by the first projector.
The imaging method according to claim 10 or 11, wherein the acquiring the first optical signal for representing the first image and the second optical signal for representing the second image comprises:

A first light signal for representing a first image is generated by a first projector light, and a second light signal for representing a second image is generated by a second projector light.
The imaging method according to claim 14, wherein the first light signal used to represent the first image is generated by a first projection light machine, and the first light signal used to represent the first image is generated by a second projection light machine. The second light signal of the second image includes:

The red light is generated by a red light source independently provided by the first projector, the green light is generated by a green light source independently provided by the first projector, and the blue light is independently provided by the first projector. A color light source generates the blue light, and the first light signal representing the first image includes the red light, green light, and blue light; and the white light is generated by a white light source provided by the second projector.
The imaging method according to any one of claims 10-15, further comprising:

Obtaining N optical signals, wherein the N optical signals carry different images, and N is an integer greater than or equal to 1;

The N optical signals are diffracted through N optical paths and then emitted, so as to present N images corresponding to the N optical signals at different N focal planes.
The imaging method according to any one of claims 10 to 16, wherein the red light in the first light signal is diffracted through a first optical path, and the first light signal is diffracted, and the first light signal is diffracted through the first optical path. The green light in the optical signal is emitted after being diffracted through the first optical path, and the blue light in the first optical signal is emitted after being emitted, including:

The red light in the first optical signal is diffracted by the red optical waveguide lens and then exits from the exit pupil grating. The green light in the first optical signal is diffracted by the green optical waveguide lens and exits the exit pupil grating and passes through the blue optical waveguide The lens diffracts the blue light in the first light signal and exits from the exit pupil grating to present the first image in a first focal plane;

The exit pupil gratings of the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide lens are all arc-shaped, and the red optical waveguide lens, the green optical waveguide lens, and the blue optical waveguide are all curved. The focal points of the lenses are all located in the first focal plane.
The imaging method according to any one of claims 10 to 17, wherein the diffracting the white light in the second light signal through the second optical path and emitting the white light includes:

Diffracting white light in the second optical signal through a white light waveguide lens and exiting from the exit pupil grating;

The exit pupil grating of the white optical waveguide lens is arc-shaped, and the focus of the white optical waveguide lens is located in the second focal plane.
An augmented reality device, comprising:

Sensors for acquiring images of realistic scenes;

And, the display module according to any one of claims 1 to 9, wherein the display module is used for imaging on at least two focal planes, and is presented to the user in superposition with the real scene image.
A virtual reality device, comprising:

The display module according to any one of claims 1 to 9, wherein the display module is configured to image on at least two focal planes and present it to a user;

And, the processor is configured to control the projection light machine in the display module to generate a first light signal representing a first image and a second light signal representing a second image.