WO2018001320A1

WO2018001320A1 - Near-eye display system, virtual-reality device, and augmented-reality device

Info

Publication number: WO2018001320A1
Application number: PCT/CN2017/090834
Authority: WO
Inventors: 黄琴华; 周旭东; 喻秀英
Original assignee: 成都理想境界科技有限公司
Priority date: 2016-07-01
Filing date: 2017-06-29
Publication date: 2018-01-04
Also published as: CN107561700A

Abstract

Provided are a near-eye display system, virtual-reality device, and augmented-reality device. The near-eye display system comprises an image source (1701), a vertical expansion waveguide (1702), and a horizontal expansion waveguide (1703); the light beams of an image emitted by the image source (1701) pass through the vertical expansion waveguide (1702) and expand in the vertical direction, then pass through the horizontal expansion waveguide (1703) and expand in the horizontal direction, and finally, enter the human eye. The light beams of the image emitted by the image source (1701) pass through the vertical expansion waveguide (1702) and the horizontal expansion waveguide (1703), and are then expanded in the vertical direction and the horizontal direction, that is, the exit-pupil diameter of the near-eye display system is expanded by means of the vertical expansion waveguide (1702) and the horizontal expansion waveguide (1703), such that the light beams outputted by the near-eye display system enter the pupil of the eye at a greater range; thus the strict limitations on the position of the eye during observation are reduced or avoided, expanding the demographic for which the virtual-reality device or augmented-reality device is suitable.

Description

Near-eye display system, virtual reality device and augmented reality device

The present application claims priority to Chinese Patent Application No. CN201610517357.6, filed on Jul. 1, the entire disclosure of which is incorporated herein by reference.

Technical field

The present invention relates to the field of virtual reality and augmented reality, and in particular to a near-eye display system, a virtual reality device, and an augmented reality device.

Background technique

Virtual Reality (English: Virtual Reality; VR) is a computer simulation system that can create and experience virtual worlds. It uses a computer to generate a simulation environment, through interactive 3D dynamic vision and system simulation of physical behavior. Users are immersed in the environment, giving users a sensory experience that transcends real life. In terms of vision, virtual reality technology uses a computer device to generate an image of a virtual scene, and transmits the light of the image to the human eye through the optical device, so that the user can fully feel the virtual scene visually.

Augmented Reality (AUG) is a technology that uses virtual objects or information to enhance the reality of real scenes. Augmented reality technology is usually based on the real physical environment image obtained by the image acquisition device such as a camera. The computer system recognizes and analyzes the query, and displays the virtual image generated by the virtual content such as text content, image content or image model associated with the virtual reality image. In the environmental image, the user can obtain the extended information such as the annotation, description and the like of the real object in the real physical environment, or experience the stereoscopic and highlighted enhanced visual effect of the real object in the real physical environment.

Existing virtual reality devices or augmented reality devices generally converge the light of a virtual image into a user's pupil through an optical lens, which imposes stricter restrictions on the position of the human eye. When the user's pupil position changes, such as the user's eyeball rotation, or two users with different pupil distances use the same augmented reality device, the user needs to adjust the distance of the augmented reality device, or automatically by the augmented reality device. Perform the interpupillary adjustment. However, the accuracy of the two is not high at present, which may cause the virtual image light to not enter the human eye, so that the augmented reality device cannot send the virtual image to the user, or the transmitted virtual image is not effective, and then the user cannot be Good increase Strong reality experience.

Therefore, there is a technical problem in the prior art that the virtual reality device or the augmented reality device has strict restrictions on the position of the human eye, and the user cannot be given a good virtual reality experience or an augmented reality experience.

Summary of the invention

An object of the present invention is to provide a near-eye display system, a virtual reality device, and an augmented reality device, so as to solve the problem that the virtual reality device or the augmented reality device has strict restrictions on the position of the human eye observed in the prior art. Give users a technical problem with a good virtual reality experience or an augmented reality experience. The solution of the embodiment of the present invention increases the field of view provided by the virtual reality technology or the augmented reality technology, so that the virtual reality technology or the augmented reality technology can visually satisfy the viewing requirements of the human eye, thereby being able to provide an immersive experience to the user.

In order to achieve the above object, a first aspect of the present invention provides a near-eye display system, including an image source, a vertical extension waveguide, and a horizontal expansion waveguide; the image light emitted by the image source is extended by the vertical After the waveguide, the beam is expanded in the vertical direction, and after the horizontally extending waveguide, the beam is expanded in the horizontal direction and finally enters the human eye.

Optionally, an incident end of the vertical extension waveguide is disposed on an outgoing optical path of the image source, and the horizontal extended waveguide is disposed on an outgoing optical path of the vertical extended waveguide.

Optionally, the image source is an LCOS display, an LED display or a QD display.

Optionally, the image source is an LCOS display, and the image source further includes an illumination source, the light emitted by the illumination source is incident on the LCOS display screen, so that the LCOS display screen emits the image Light.

Optionally, the near-eye display system further includes a collimating mirror group disposed between an exit end of the image source and an incident end of the vertical extended waveguide, wherein the collimating mirror group is used Performing collimation processing on the image light.

Optionally, the collimating mirror set is a 1/4P autofocus lens.

A second aspect of the present invention provides a virtual reality device, comprising: two sets of near-eye display systems provided by the first aspect, wherein the light emitted by the first set of near-eye display system enters a left eye of the person, and the second The set of near-eye display system emits light into the person's right eye.

Optionally, the virtual reality device further includes a light blocking structure, and the light blocking structure is disposed on the first set of near eyes A side of the horizontal expansion waveguide of the display system and the second set of near-eye display systems that is remote from the human eye.

Optionally, the virtual reality device further includes a zoom lens disposed on a side of the first set of near-eye display system and the horizontal extended waveguide of the second set of near-eye display system near the human eye.

A third aspect of the embodiments of the present invention provides an augmented reality device, comprising: two sets of near-eye display systems as provided by the first aspect, wherein the light emitted by the first set of near-eye display system enters a left eye of the person, and the second The light emitted by the near-eye display system enters the right eye of the person, and the ambient light enters the left eye of the person through the horizontal expansion waveguide of the first set of near-eye display system, and expands horizontally through the second set of near-eye display system The waveguide enters the right eye of the person.

Optionally, the augmented reality device further includes four zoom lenses respectively disposed on a side of the horizontal extended waveguide of the first set of near-eye display system close to the human eye and away from the human eye. a side, and a side of the horizontally extending waveguide of the second set of near-eye display systems that is close to the human eye and a side that is away from the human eye.

One or more technical solutions in the embodiments of the present invention have at least the following technical effects or advantages:

Since the image light emitted by the image source is expanded in both the vertical direction and the horizontal direction after passing through the vertically-expanded waveguide and the horizontally-expanded waveguide, that is, the exit pupil diameter of the near-eye display system is expanded by the vertical spread waveguide and the horizontal spread waveguide. The light output from the near-eye display system can enter the pupil of the eye in a larger range, so the exit pupil provided by the present scheme is significantly increased compared with the exit pupil of a single optical lens, thereby reducing or avoiding observation to the human eye. The strict limitation of the location, thereby expanding the applicable population of the virtual reality device or the augmented reality device, and eliminating the need for the user to adjust the distance of the virtual reality device or the augmented reality device, thereby avoiding the user being unable to obtain good results due to inaccurate adjustment results. A flaw in the virtual reality experience or augmented reality experience.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only some embodiments of the present invention, and those skilled in the art can obtain other drawings according to the drawings without any inventive labor:

Figure 1 is a schematic diagram of laser scanning retinal imaging;

2 is a schematic structural diagram of a near-eye display system according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a near-eye display system applied to a virtual reality device according to an embodiment of the present invention; FIG.

FIG. 4 is a schematic structural diagram of a near-eye display system applied to an augmented reality device according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in the following with reference to the accompanying drawings. It is apparent that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Before introducing the technical solutions in the embodiments of the present invention, the technical principle of laser scanning imaging will be introduced. Please refer to FIG. 1. FIG. 1 is a schematic diagram of laser scanning retinal imaging. As shown in Fig. 1, 101 is a laser generator, 102 is a two-dimensional scanning device, and 103 is a retina of the human eye.

For convenience of description, the resolution of the imaged image is 5*5 as an example. When the current direction of the two-dimensional scanning device is aligned with the white pixel, the laser generator emits a white laser and is deflected by the two-dimensional scanning device and reflected to the pixel, thereby realizing the scanning of the pixel. In the next position of the two-dimensional scanning device, if the direction of the two-dimensional scanning device is aligned with the black pixel point, the laser generator emits a corresponding black laser light, and is deflected and reflected to the pixel point by the two-dimensional scanning device, or A laser is emitted to achieve scanning of the pixel. By analogy, the entire image can be scanned. In this way, through the persistence of the human eye, a complete image can be presented on the retina of the human eye. As shown in Figure 1, in the end, a Chinese character "king" can be formed in the human eye. In practical applications, different colors of laser light are emitted by the laser generator. For example, lasers of different colors can be emitted by coupling a plurality of monochromatic lasers, and the image to be displayed can be completely scanned, thereby forming a rich image in the human eye. The colorful images are not repeated here.

It should be noted that the black laser refers to the corresponding encoded value in the preset color coding mode. For example, in RGB color mode, the black RGB value is (0,0,0).

Please refer to FIG. 2. FIG. 2 is a schematic structural diagram of a near-eye display system according to an embodiment. As shown in FIG. 2, the near-eye display system includes an image source 1701, a vertical extension waveguide 1702, and a horizontal extension waveguide 1703.

The image light emitted by the image source 1701 is expanded in the vertical direction after passing through the vertical expansion waveguide 1702, and then expanded in the horizontal direction after passing through the horizontally extending waveguide 1703, and finally enters the human eye.

The horizontally extending waveguide can be formed by providing a plurality of imaging mirrors in the horizontal optical waveguide, for example, by plating a reversible film layer on a plurality of horizontal optical waveguides and bonding them together, wherein one can be reversed The transmembrane layer forms an imaging mirror. When light enters the horizontal optical waveguide and is transmitted to the reverse permeable layer, a part of the light will be reflected on the reverse permeable layer to be transmitted to the human eye, and another part of the light will be transmitted through the reverse permeable The film layer to the next anti-permeable layer. By analogy, it is possible to achieve an effect of expanding the exit pupil diameter of the near-eye display system.

Of course, in order to ensure the uniformity of the light intensity, the reflection efficiency of each of the anti-permeable membrane layers can be set according to actual conditions. For example, taking a horizontally extending waveguide including five imaging mirrors as an example, according to the transmission direction of the light in the horizontally extending waveguide, the reflectance of the first mirror can be set to 20%, and the reflectance of the second mirror can be set to 25 %, the reflectance of the third mirror is set to 33%, the reflectance of the fourth mirror is set to 50%, and the reflectance of the fifth mirror is set to 100%. Thus, the intensity of light emitted by each mirror is 20% of the total light intensity, and will not be described here.

It can be seen that the image light emitted by the image source 1701 is expanded in both the vertical direction and the horizontal direction after passing through the vertical extension waveguide 1702 and the horizontal expansion waveguide 1703, that is, by the vertical extension waveguide 1702 and the horizontal extension waveguide 1703. The near-eye display system's exit pupil diameter allows the light output by the near-eye display system to enter the pupil of the eye over a greater range. Therefore, compared with the exit of a single optical lens, the solution provided by the present scheme is significantly increased, thereby reducing or avoiding strict restrictions on the position of the human eye, thereby expanding the applicable population of the virtual reality device or the augmented reality device. Moreover, the user does not need to perform the distance adjustment on the virtual reality device or the augmented reality device, and thus avoids the defect that the user cannot obtain a good virtual reality experience or an augmented reality experience due to inaccurate adjustment results.

In the following sections, the above technical solutions will be specifically described.

Referring to FIG. 2, as shown in FIG. 2, the incident end of the vertical extension waveguide 1702 is disposed on the outgoing optical path of the image source 1701, and the horizontal extension waveguide 1703 is disposed on the outgoing optical path of the vertical extension waveguide 1702.

In the specific implementation process, the image source 1701 may specifically be a liquid crystal LCOS (English: Liquid Crystal on Silicon; Chinese: liquid crystal with silicon or silicon-based liquid crystal) display, LED (English: Light Emitting Diode; Chinese: light-emitting diode) display Or QLED (English: Quantum Dot Light-Emitting Diode; Chinese: Quantum Dot Light Emitting Diode) display.

In practical applications, since the LCOS display is a reflective display, it does not emit light by itself, so when the image source 1701 is an LCOS display, the image source 1701 also includes an illumination source. Light from the illumination source is incident on the LCOS, causing the LCOS to emit image light.

The illumination source can be selected according to the actual type of the LCOS, for example, it can be a white light source, etc., and is not limited herein.

With continued reference to FIG. 2, as shown in FIG. 2, the near-eye display system further includes a collimating mirror set 1704. The collimating lens group 1704 is disposed between the exit end of the image source 1701 and the incident end of the vertical extension waveguide 1702. A collimating mirror is used to collimate the image light.

In a specific implementation process, the collimating lens group may be a lens lens formed by a convex lens or a plurality of suitable lenses. It can also be a 1/4P self-focusing lens, which is not limited here.

As can be seen from the above, the image light emitted by the image source 1701 is expanded in both the vertical and horizontal directions after passing through the vertically extending waveguide 1702 and the horizontally extending waveguide 1703, that is, through the vertically expanding waveguide 1702 and the horizontally extending waveguide. The 1703 expands the exit pupil diameter of the near-eye display system so that the light output by the near-eye display system can enter the pupil of the eye over a larger range. Therefore, compared with the exit of a single optical lens, the solution provided by the present scheme is significantly increased, thereby reducing or avoiding strict restrictions on the position of the human eye, thereby expanding the applicable population of the virtual reality device or the augmented reality device. Moreover, the user does not need to perform the distance adjustment on the virtual reality device or the augmented reality device, and thus avoids the defect that the user cannot obtain a good virtual reality experience or an augmented reality experience due to inaccurate adjustment results.

In practical applications, the near-eye display system provided by this embodiment can be applied to a virtual reality device or an augmented reality device. In the following sections, a specific implementation process of applying the near-eye display system to a virtual reality device or an augmented reality device will be described.

First, a specific implementation process of applying the near-eye display system provided by the embodiment to a virtual reality device is introduced.

Please refer to FIG. 3. FIG. 3 is a schematic structural diagram of a near-eye display system applied to a virtual reality device according to an embodiment of the present invention. As shown in FIG. 3, the virtual reality device includes two sets of near-eye display systems as described in the foregoing section, wherein light emitted by the first set of near-eye display system 181 enters the left eye of the person, and light emitted by the second set of near-eye display system 182 enters. The right eye of the person. In this way, the content of the virtual reality can be provided to the user, for example, it can be a scene display, a video, a game content, etc., and will not be described here.

Of course, the two frames of images displayed by the first set of near-eye display system 181 and the second set of near-eye display system 182 at the same time may be images having a certain parallax. In this way, the content of the virtual reality provided to the user has a 3D effect, which can improve the user experience.

In the specific implementation process, in order to ensure the user experience of the virtual reality device, it is necessary to avoid interference from external ambient light. In this embodiment, the virtual reality device further includes a light blocking structure 183 disposed on a side of the horizontal expansion waveguide of the first set of near-eye display system 181 and the second set of near-eye display system 182 away from the human eye.

In practical applications, the light blocking structure may be a total reflection film layer coated on the side of the horizontally extending waveguide that is away from the human eye. The total reflection film layer may be, for example, a metal film composed of aluminum, silver, gold or copper, or an electrolyte film layer composed of silicon monoxide, magnesium fluoride, silicon dioxide or aluminum oxide, or The combination of the two is not limited here. Of course, the light blocking structure can also be a light blocking sheet and the like, and will not be described again here.

In practical applications, the near-eye display system in the virtual reality device can also be disposed in an opaque outer casing, which can also achieve the effect of avoiding interference from external ambient light, and will not be described herein.

In a specific implementation process, the virtual reality device further includes a zoom lens 184. As shown in FIG. 3, the zoom lens 184 is disposed on the horizontal extended waveguide of the first set of the near-eye display system 181 and the second set of the near-eye display system 182 near the human eye. One side. The zoom lens can be, for example, an electrically controlled liquid crystal Fresnel lens. The divergence capability of the electrically controlled liquid crystal Fresnel lens can be varied by varying the voltage applied to the electrically controlled liquid crystal Fresnel lens. In this way, the adjustment of the light emitted by the horizontally spread wave can be achieved, thereby changing the depth of field of the image provided to the user.

In practical applications, as shown in FIG. 3, only one zoom lens may be disposed in one virtual reality device. In another embodiment, a zoom lens may be provided for the left eye and the right eye, respectively, and is not limited herein.

Of course, in a specific implementation process, the zoom lens may be, for example, a liquid-filled zoom lens or a fluid-focusing lens based on dielectric electrowetting, etc., and will not be described herein. In practical applications, the depth of field of the image provided to the user can also be adjusted by software, and will not be described here.

In the process of actually using the virtual reality device provided by the embodiment, since the first set of the near-eye display system 181 and the second set of the near-eye display system 182 provide larger diameters of the exit pupils, the observation of the human eye is reduced or avoided. The strict limitation of the location further expands the applicable population of the virtual reality device, and does not require the user to adjust the distance of the virtual reality device, thereby avoiding the defect that the user cannot obtain a good virtual reality experience due to inaccurate adjustment results.

Then, after the specific implementation process of the near-eye display system provided by the embodiment is applied to the virtual reality device, the following part will introduce the specific application of the near-eye display system provided by the embodiment to the augmented reality device. Implementation process.

Please refer to FIG. 4. FIG. 4 is a schematic structural diagram of a near-eye display system applied to an augmented reality device according to an embodiment of the present invention. As shown in FIG. 4, the augmented reality device includes two sets of near-eye display systems as described in the foregoing section, wherein light emitted by the first set of near-eye display system 191 enters the left eye of the person, and light emitted by the second set of near-eye display system 192 enters. The human right eye, and ambient light passes through the horizontal expansion waveguide of the first set of near-eye display system 191 into the left eye of the person, and enters the right eye of the person through the horizontal expansion waveguide of the second set of near-eye display system 192. In this way, the image provided by the near-eye display system and the image formed by the ambient light are superimposed, so that the user can be provided with augmented reality content, such as navigation information, annotation information of things in the external environment, and the like. No longer elaborate.

In a specific implementation process, as shown in FIG. 4, the augmented reality device further includes four

zoom lenses

1931, 1932, 1933, and 1934, wherein the

zoom lenses

1931 and 1932 are respectively disposed on the horizontal extended waveguide of the first set of the near-eye display system 191. The

zoom lens

1933 and 1934 are respectively disposed on a side of the horizontal expansion waveguide of the second set of the near-eye display system 192 near the human eye and a side away from the human eye, on the side close to the human eye and the side away from the human eye.

The specific function and composition of the zoom lens have been described in detail in the previous sections, and will not be described here. It is.

In the process of actually using the augmented reality device provided by the embodiment, since the first set of the near-eye display system 191 and the second set of the near-eye display system 192 provide a larger diameter of the exit pupil, the observation to the human eye is reduced or avoided. The strict limitation of the location further expands the applicable population of the virtual reality device, and does not require the user to adjust the distance adjustment of the augmented reality device, thereby avoiding the defect that the user cannot obtain a good augmented reality experience due to inaccurate adjustment results.

All of the features disclosed in this specification, or steps in all methods or processes disclosed, may be combined in any manner other than mutually exclusive features and/or steps.

Any feature disclosed in the specification, including any additional claims, abstract and drawings, may be replaced by other equivalents or alternative features, unless otherwise stated. That is, unless specifically stated, each feature is only one example of a series of equivalent or similar features.

The invention is not limited to the specific embodiments described above. The invention extends to any new feature or any new combination disclosed in this specification, as well as any novel method or process steps or any new combination disclosed.

Claims

A near-eye display system, comprising: an image source, a vertically extending waveguide, and a horizontally extending waveguide;

The image light emitted by the image source is expanded in the vertical direction after passing through the vertical expansion waveguide, and then expanded in the horizontal direction after the horizontal expansion waveguide, and finally enters the human eye.
The near-eye display system according to claim 1, wherein an incident end of the vertical extension waveguide is disposed on an outgoing optical path of the image source, and the horizontal extension waveguide is disposed on an outgoing optical path of the vertical extension waveguide. .
The near-eye display system of claim 1 wherein said image source is an LCOS display, an LED display or a QD display.
The near-eye display system of claim 1 wherein said image source is an LCOS display, and wherein said image source further comprises an illumination source, said illumination source emitting light incident on said LCOS display , causing the LCOS display to emit the image light.
The near-eye display system according to claim 1, wherein the near-eye display system further comprises a collimating mirror set disposed at an exit end of the image source and an incident of the vertical extended waveguide Between the ends, the collimating mirror group is used for collimating the image light.
A near-eye display system according to claim 5, wherein said collimating mirror group is a 1/4P self-focusing lens.
A virtual reality device, comprising: two sets of near-eye display systems according to any one of claims 1-6, wherein the light emitted by the first set of near-eye display system enters the left eye of the person, and the second set The near-eye display system emits light into the person's right eye.
The virtual reality device according to claim 7, wherein the virtual reality device further comprises a light blocking structure, wherein the light blocking structure is disposed on the first set of near-eye display system and the second set of near-eye display system The horizontally spreads the side of the waveguide away from the human eye.
The virtual reality device according to claim 7, wherein said virtual reality device further comprises a zoom lens, said zoom lens being disposed at a level of said first set of near-eye display system and said second set of near-eye display system Extend the side of the waveguide close to the human eye.
An augmented reality device, comprising: two sets of near-eye display systems according to any one of claims 1-6, wherein the first set of near-eye display system emits light into a person's left eye, and the second set The light emitted by the near-eye display system enters the right eye of the person, and the ambient light passes through the horizontal expansion of the first set of near-eye display system The waveguide enters the left eye of the person and enters the right eye of the person through the horizontal expansion waveguide of the second set of near-eye display system.
The augmented reality device of claim 10, wherein the augmented reality device further comprises four zoom lenses, the four zoom lenses being respectively disposed adjacent to the horizontal extended waveguide of the first set of near-eye display systems One side of the human eye and one side away from the human eye, and the side of the horizontally extending waveguide of the second set of near-eye display systems that are close to the human eye and the side that is away from the human eye.