CN112198667B - Virtual retina projection system - Google Patents
Virtual retina projection system Download PDFInfo
- Publication number
- CN112198667B CN112198667B CN202011369361.5A CN202011369361A CN112198667B CN 112198667 B CN112198667 B CN 112198667B CN 202011369361 A CN202011369361 A CN 202011369361A CN 112198667 B CN112198667 B CN 112198667B
- Authority
- CN
- China
- Prior art keywords
- sub
- image
- projection system
- virtual
- reflection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
The present invention provides a virtual retinal projection system comprising: the projection module is suitable for generating a thin light beam of an image to be displayed; the discrete light splitting device is suitable for receiving the thin light beams and splitting the thin light beams to generate light beams in different discrete directions; the reflecting device is suitable for receiving the light beams in different discrete directions and reflecting the light beams to obtain reflected light beams, the reflected light beams form all viewpoints, each viewpoint can form a virtual image of the image to be displayed, the virtual image can meet the requirement of the human eye for viewing the complete image, and the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye. The virtual retina projection system provided by the embodiment of the invention can increase the exit pupil of the virtual retina projection system.
Description
Technical Field
The invention relates to the field of virtual reality, in particular to a virtual retina projection system.
Background
At present, the virtual reality technology or the augmented reality technology is developed rapidly, however, after the relevant equipment is used for a long time, the vision is damaged, the convergence function of eyes is damaged, and the normal focusing cannot be achieved.
The 3D display enables a user to feel a stereoscopic sensation by providing parallax images having a slight difference to the left and right eyes of the user, respectively. Because the images presented by the existing virtual reality technology or augmented reality technology are converged on a virtual plane, human eyes can capture the images only if being in a state for a long time, which violates the natural characteristics of the human eyes, and the technology is called as a 'pseudo 3D' display technology, and can cause headache and dizziness of users and even damage to eyesight after being used for a long time.
Therefore, it is necessary to implement virtual reality using "real 3D" display technology, however, the existing "real 3D" reality technology is hindered in application due to the following disadvantages, such as: the virtual retina projection technology has a small exit pupil range, and is difficult to meet the requirements of capturing images in the moving range of eyeballs.
Therefore, how to increase the exit pupil size of the virtual retinal projection system becomes a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The problem addressed by the present invention is to provide a virtual retinal projection system that can increase the exit pupil size of the virtual retinal projection system.
To solve the above problems, the present invention provides a virtual retina projection system, comprising:
the projection module is suitable for generating a thin light beam of an image to be displayed;
the discrete light splitting device is suitable for receiving the beamlets and splitting the beamlets to generate light beams in different discrete directions;
and the reflecting device is suitable for receiving the light beams in different discrete directions and reflecting the light beams to obtain reflected light beams, the reflected light beams form all viewpoints, each viewpoint can form a virtual image which meets the requirement of the human eye for viewing the complete image to be displayed, and the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye.
Optionally, the method further comprises:
the waveguide device is suitable for receiving the thin light beams of the projection module and folding the light path of the transmission light path of the thin light beams;
the discrete beam splitter device is adapted to receive the beamlets and split the beamlets to generate beams in different discrete directions, and includes:
and the light splitting device is suitable for receiving the beamlets folded by the light path, splitting the light and generating light beams in different discrete directions.
Optionally, the discrete light splitting device overlies a surface of the waveguide device or is embedded in the waveguide device.
Optionally, the reflective device overlies a surface of the waveguide device or is embedded in the waveguide device.
Optionally, the discrete beam splitting device is manufactured by a process of manufacturing an optical diffraction device.
Optionally, the processing technology of the optical diffraction device includes a micro-nano processing technology and an interference lithography technology.
Optionally, the reflective device comprises a volume holographic device, a partially transmissive partially reflective device or a fully reflective device.
Optionally, the partially transmissive partially reflective device comprises a curved device that is partially transmissive and partially reflective or a planar device that is partially transmissive and partially reflective.
Optionally, the projection module comprises a laser projection module based on a MEMS galvanometer or a small aperture projection module based on an array pixel panel.
Optionally, the reflection device includes at least two sub-reflection regions, each sub-reflection region is adapted to receive the light beams in different discrete directions corresponding to at least some of the image pixels of the image to be displayed, and perform reflection to obtain sub-reflection light beams corresponding to different image pixels with different angles reflected by different sub-reflection regions and sub-reflection light beams corresponding to the same image pixel with an angle difference within a predetermined angle difference range reflected by different sub-reflection regions, the sub-reflection light beams of different sub-reflection regions respectively form respective continuous sub-viewing zones, different continuous sub-viewing zones are completely overlapped or partially overlapped to form an overlapped viewing zone, each continuous sub-viewing zone includes a sub-viewpoint within each pupil size range, the sub-viewpoints can form at least some virtual images of the image to be displayed, and the viewpoints are located within the overlapped viewing zone, and the virtual image of each sub-viewpoint in the overlapped visual area is spliced to form a virtual image of the image to be displayed which meets the complete requirement of the visual observation of human eyes.
Optionally, each of the sub-reflection regions is arranged in an array.
Optionally, the angle difference of each of said sub-reflected beams of the same image pixel is in the range of 0-5 °.
Optionally, the size of the region of the viewpoint is related to the area of the sub-reflection region and the focal length of the sub-reflection region.
Compared with the prior art, the technical scheme of the invention has the following advantages:
the embodiment of the invention provides a virtual retina projection system, which comprises: the projection module is suitable for generating a thin light beam of an image to be displayed; the discrete light splitting device is suitable for receiving the thin light beams and splitting the thin light beams to generate light beams in different discrete directions; the reflecting device is suitable for receiving the light beams in different discrete directions and reflecting the light beams to obtain reflected light beams, the reflected light beams form all viewpoints, each viewpoint can form a virtual image of the image to be displayed, the virtual image can meet the requirement of the human eye for viewing the complete image, and the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye. The virtual retina projection system provided by the embodiment of the invention firstly utilizes a projection module capable of generating beamlets to generate beamlets of an image to be displayed, the beamlets can irradiate a discrete light splitting device, then the beamlets are split by the discrete light splitting device to obtain beams in different discrete directions, so that the split beams are still the beamlets, the obtained beams in different discrete directions are irradiated to a reflecting device, the reflecting device reflects the beams in different discrete directions still being the beamlets to obtain reflected beams forming various viewpoints, each viewpoint can form a virtual image of the image to be displayed which meets the complete requirement of human eye visual observation, when a human eye is in the region of the viewpoint, the corresponding image can be seen, the distance between each adjacent viewpoint is smaller than the diameter of the pupil of the human eye, when the human eye moves, it is also ensured that the corresponding image is seen. Thus, the virtual retina projection system provided by the embodiment of the invention generates the beamlets by using the projection module capable of generating the beamlets, and always keeps the beamlets transmitting in the subsequent light transmission process, so that the system diaphragm aperture of the whole near-eye imaging system can be reduced, the system depth of field is increased, a user can see clear and complete images on a plurality of planes in a larger depth range, and the convergence-adjustment contradiction can be solved; meanwhile, the beamlets are split by using a discrete beam splitter, the beamlets are kept and split at the same time, then the beamlets are reflected by using a reflector to form viewpoints of the beamlets, each viewpoint can form a virtual image which meets the requirement that the human eye can watch the complete image to be displayed, the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye, the requirement that the motion range of the human eye is large is met, the human eye can watch the complete image in the motion range, and therefore 3D near-eye display with large exit pupil and no convergence adjustment contradiction can be realized, the visual range of a virtual retina projection system is enlarged, and the exit pupil is enlarged.
In an alternative scheme, the virtual retina projection system provided by the embodiment of the invention further comprises a waveguide device, wherein the beamlets generated by the projection module are firstly coupled into the waveguide device, folding of a system propagation light path is realized through the waveguide device, and the discrete beam splitter receives and splits the light beams subjected to light path folding by the waveguide device to obtain the light beams in different discrete directions. In the virtual retina system provided by the embodiment of the invention, the waveguide device is used for folding the thin light ray transmission light path, so that the integration level of the virtual retina projection system can be improved, the compactness of the system is improved, and the required installation space is reduced.
In an alternative aspect, the virtual retina projection system provided in this embodiment of the present invention includes at least two sub-reflection regions, each of the sub-reflection regions is adapted to receive the light beams in different discrete directions corresponding to at least a portion of image pixels of an image to be displayed, and perform reflection to obtain sub-reflection light beams corresponding to different image pixels with different angles reflected by different sub-reflection regions and sub-reflection light beams corresponding to the same image pixel with an angle difference within a predetermined angle difference range reflected by different sub-reflection regions, the sub-reflection light beams of different sub-reflection regions respectively form respective continuous sub-viewing regions, different continuous sub-viewing regions are completely or partially overlapped to form an overlapped viewing region, each continuous sub-viewing region includes a sub-viewpoint in each pupil size range, and the sub-viewpoints can form at least a portion of a virtual image of the image to be displayed, the viewpoint is positioned in the overlapped visual area and comprises a plurality of sub viewpoints positioned in the size range of the pupil, and partial virtual images of the sub viewpoints positioned in the overlapped visual area are spliced to form a virtual image of the image to be displayed, which meets the requirement of the human eye for viewing the integrity. Therefore, light beams in different discrete directions corresponding to image pixels of an image to be displayed irradiate different sub-reflection regions, the light modulation of the sub-reflection regions is independent, and mutual interference does not exist, so that the controllability of a reflection device can be improved, and the light entering a pupil forms a continuous and crosstalk-free image.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic diagram of a virtual retinal projection system provided in accordance with one embodiment of the present invention;
FIG. 2 is a schematic view of an arrangement of viewpoints formed by a virtual retinal projection system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a virtual retinal projection system provided in accordance with another embodiment of the present invention;
FIGS. 4-8 are schematic diagrams of portions of virtual retinal projection systems provided by embodiments of the present invention;
FIG. 9 is a schematic view of a virtual retinal projection system provided in accordance with yet another embodiment of the present invention;
FIG. 10 is a schematic view of a virtual retinal projection system provided in accordance with yet another embodiment of the present invention;
FIGS. 11a and 11b are schematic views of a virtual retinal projection system provided in accordance with yet another embodiment of the present invention;
fig. 12 is a schematic diagram of the optical path propagation of a virtual retinal projection system provided in accordance with one embodiment of the present invention.
Detailed Description
As can be seen from the background, the exit pupil size of the virtual retinal projection system cannot be increased by the prior art virtual retinal projection system.
In order to solve the problem, the present invention provides a virtual retina projection system, comprising:
the projection module is suitable for generating a thin light beam of an image to be displayed;
the discrete light splitting device is suitable for receiving the beamlets and splitting the beamlets to generate light beams in different discrete directions;
the reflecting device is suitable for receiving the light beams in different discrete directions and reflecting the light beams to obtain reflected light beams, the reflected light beams form all viewpoints, each viewpoint can form a virtual image of the image to be displayed, the virtual image can meet the requirement of the human eye for viewing the complete image, and the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye.
It can be seen that, in the virtual retina projection system provided in the embodiment of the present invention, first, a projection module capable of generating a beamlet is used to generate a beamlet of an image to be displayed, the beamlet can irradiate a discrete beam splitter, then the beamlet is split by the discrete beam splitter to obtain beams in different discrete directions, so that the split beam is still a beamlet, the obtained beam in different discrete directions irradiates a reflector, the reflector reflects the beam in different discrete directions, the obtained reflected beam forms viewpoints, each viewpoint can form a virtual image satisfying the complete requirement for human eye to view the image to be displayed, when a human eye is in the region of the viewpoint, the corresponding image can be seen, and the distance between each adjacent viewpoint is smaller than the diameter of a pupil of the human eye, it is also ensured that the corresponding image is seen.
Thus, the virtual retina projection system provided by the embodiment of the invention generates the beamlets by using the projection module capable of generating the beamlets, and always keeps the beamlets transmitting in the subsequent light transmission process, so that the system diaphragm aperture of the whole near-eye imaging system can be reduced, the system depth of field is increased, a user can see clear and complete images on a plurality of planes in a larger depth range, and the convergence-adjustment contradiction can be solved; meanwhile, the beamlets are split by using a discrete beam splitter, the beamlets are kept and split at the same time, then the beamlets are reflected by using a reflector to form viewpoints of the beamlets, each viewpoint can form a virtual image which meets the requirement that the human eye can watch the complete image to be displayed, the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye, the requirement that the motion range of the human eye is large is met, the human eye can watch the complete image in the motion range, and therefore 3D near-eye display with large exit pupil and no convergence adjustment contradiction can be realized, the visual range of a virtual retina projection system is enlarged, and the exit pupil is enlarged.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic diagram of a virtual retina projection system according to an embodiment of the invention.
As shown in the drawings, the virtual retina projection system provided by the embodiment of the invention comprises: a projection module 1, a discrete beam splitter 2 and a reflector 3, wherein,
the projection module 1 is suitable for generating a thin light beam of an image to be displayed;
the discrete light splitting device 2 is suitable for receiving the beamlets and splitting the beamlets to generate light beams in different discrete directions;
the reflecting device 3 is suitable for receiving the light beams in different discrete directions and reflecting the light beams to obtain reflected light beams, the reflected light beams form all viewpoints, each viewpoint can form a virtual image which meets the requirement of the human eye for viewing the complete image to be displayed, and the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye.
It should be noted that the viewpoints described herein are not strict, and all of the viewpoints described herein belong to a virtual image that can form the image to be displayed that meets the requirement of the human eye for viewing integrity, where the virtual image that meets the requirement of the human eye for viewing integrity includes both the image to be displayed that is intact and the image that meets the requirement of the human eye for viewing integrity despite vignetting at the edge of the image.
In the working process, the virtual retina projection system provided by the embodiment of the invention firstly generates the thin beams of the image to be displayed by using the projection module 1 capable of generating the thin beams, the thin beams can be irradiated to the discrete beam splitter 2, then the thin beams are split by the discrete beam splitter 2 to obtain the beams in different discrete directions, so that the beams in different discrete directions are still thin beams, the obtained beams in different discrete directions are irradiated to the reflector 3, the obtained beams in different discrete directions which are still the thin beams are reflected, the obtained reflected beams form various viewpoints (such as a viewpoint j, a viewpoint k and a viewpoint l shown in fig. 1), each viewpoint can form the virtual image of the image to be displayed which meets the complete requirement of human visual observation, and the distance between the adjacent viewpoints is smaller than the diameter of the pupil, so that when the pupil 5 of the human eye 4 is in the region of the viewpoint, even if the human eye moves, the pupil 5 can receive the reflected light beam forming at least one viewpoint and project it onto the retina 6, and the human eye 3 can see the corresponding image.
The regions of the viewpoints described herein, i.e., the regions formed by the respective viewpoints, are as follows: if the view j, the view k and the view l are formed, the region of the view is the region formed by the view j, the view k and the view l.
It should be noted that the thin beam described herein refers to different light rays emitted from the same object point (or virtual image point), which reach the pupil position of the human eye, and the formed beam cross section is less than 2mm, and the light ray bundle formed by the light ray sets with the light ray angle difference less than 5 °.
The discrete light-splitting device 2 splits the beamlets, and the generated light beams in different discrete directions only have discrete directions and are not continuously distributed, so that the beamlets are not damaged, and meanwhile, the diffusion angles of the light beams in different discrete directions can also be designed in a differentiation mode.
Specifically, the discrete light-splitting device 2 belongs to a Diffractive Optical Element (DOE) or a HOE (histogram optical element), and thus can be manufactured by a processing process of the diffractive optical element.
Specifically, the processing technology of the optical diffraction device can comprise a micro-nano processing technology and an interference lithography technology. The micro-nano processing technology is to form a micro structure which is high or low, or straight or inclined on a glass or resin substrate. The interference lithography process is a process of changing the optical characteristics of a recording medium by interfering two or more coherent light beams to form interference fringes on the recording medium. The material medium is silver salt material, light refraction polymer, dichromate gelatin, etc.
Each viewpoint formed after being reflected by the reflecting device can form a display image meeting the complete requirement of human vision, which means that each viewpoint can form a complete image of the image to be displayed, namely all images of the image to be displayed; partial images of the image to be displayed can also be formed, but for human vision, the image already meets the complete requirements, i.e. the image meets the complete requirements for human vision to view despite vignetting at the edges of the image.
It is easy to understand that, in the virtual retina projection system, the arrangement positions among the projection module 1, the discrete light splitting device 2 and the reflection device 3 are not limited as long as the optical path propagation of the thin light of the image to be displayed can be realized.
In one embodiment, to facilitate the arrangement of the optical devices, as shown in fig. 1, the projection module 1 and the discrete beam splitter 2 may be both disposed on the same side of the reflective device 3, so long as the reflective device 3 has a reflective function, and certainly, may also have a transmissive function. Thus, the reflective device may be a volume holographic device, a partially transmissive partially reflective device, or a fully reflective device.
The total reflection device can totally reflect the light, so that the scattered light generated by the discrete light splitting device 2 is totally reflected by the reflection device 3, and the brightness of the obtained image is higher; the cost of the partial transmission partial reflection device is low, so that the cost of the virtual retina projection system can be reduced; the volume holographic device has better optical refraction performance, can reduce the requirements on other devices in a virtual retina projection system, and reduces the number of the devices.
Of course, in another embodiment, the projection module 1 and the discrete beam splitter 2 may also be disposed on two sides of the reflective device 3, so that the reflective device 3 needs to have both reflective and transmissive functions. Thus, the reflective device may be a volume holographic device or a partially transmissive partially reflective device. For the features of each device, please refer to the foregoing description, and further description is omitted here.
Of course, the partially transmissive and partially reflective device may be a curved device that is partially transmissive and partially reflective, or may be a planar device that is partially transmissive and partially reflective. The curved surface device partially transmitting and partially reflecting can also be a plane device partially transmitting and partially reflecting, and can meet different design requirements respectively, wherein the curved surface device partially transmitting and partially reflecting can be provided with certain diopter to carry out aberration correction.
As for the projection module 1, it is sufficient if it can generate a thin beam of an image to be displayed, and in one embodiment, the virtual retinal projection system can be a laser projection module based on a MEMS galvanometer, or a small aperture projection module based on an array pixel panel. The laser projection module based on the MEMS galvanometer or the small-aperture projection module based on the array pixel panel can not only generate beamlets of images to be displayed, but also the equipment is mature, and the generated images to be displayed are clear.
Please refer to fig. 2 for a view point arrangement formed by the virtual retina projection system according to an embodiment of the present invention.
As shown in the drawing, only one-directional viewpoint distribution is considered herein for convenience of description.
Let the diameter of the pupil of the human eye be
Horizontal field of view of
If a certain viewpointn is at a distance of from the reflecting device 3
If the pupil center of the human eye is located on the central symmetry axis of the viewpoint n in the depth of field direction for the viewpoint, the distance between the pupil center and the viewpoint n is
Within the range of (3), the light rays corresponding to all pixels of the image can be incident on the pupil of the human eye, so that the human eye can view the image within the range of (3). In the horizontal direction, if there are p uniformly distributed viewpoints in the horizontal direction and the distance between the viewpoints is m, the size of the viewing zone (the region where the viewpoint can be seen by human eyes, that is, the region of the viewpoint) in the horizontal direction
Is composed of
The exit pupil distance in the depth of field direction is
To
。
Therefore, as long as the human eye is within the region of the viewpoint and within the exit pupil, a display image satisfying the requirement of the visual viewing integrity of the human eye can be seen.
Of course, in a plane perpendicular to the horizontal direction and the depth direction, a plurality of viewpoints are also formed, thereby constituting a region of viewpoints in the vertical direction.
Whether the human eye is in the region of the viewpoint in the horizontal direction or in the region of the viewpoint in the vertical direction, pertains to the region of the human eye in the viewpoint described herein.
Therefore, the spatial arrangement shape of the viewpoints can be designed according to needs, for example, the spatial arrangement shape can be a rectangular shape, a honeycomb shape, and the like, and the viewpoints can be uniformly distributed or non-uniformly distributed.
The spatial arrangement shape of the resulting viewpoints can be determined by the arrangement shape of the object light used when the reflection device 3 is fabricated.
Thus, the virtual retina projection system provided by the embodiment of the invention generates the beamlets by using the projection module capable of generating the beamlets, and always keeps the beamlets transmitting in the subsequent light transmission process, so that the system diaphragm aperture of the whole near-eye imaging system can be reduced, the depth of field is increased, a user can see clear and complete images on a plurality of planes in a larger depth range, and the convergence-adjustment contradiction can be solved; meanwhile, the beamlets are split by using a discrete beam splitter, the beamlets are kept and split at the same time, then the beamlets are reflected by using a reflector to form viewpoints of the beamlets, each viewpoint can form a virtual image which meets the requirement that the human eye can watch the complete image to be displayed, the distance between every two adjacent viewpoints is smaller than the diameter of the pupil of the human eye, the requirement that the motion range of the human eye is large is met, the human eye can watch the complete image in the motion range, and therefore 3D near-eye display with large exit pupil and no convergence adjustment contradiction can be realized, the visual range of a virtual retina projection system is enlarged, and the exit pupil is enlarged.
Referring to fig. 3-8, fig. 3 is a schematic view of a virtual retina projection system according to another embodiment of the present invention; fig. 4-8 are schematic diagrams illustrating a partial structure of a virtual retinal projection system provided in accordance with various embodiments of the present invention.
In another specific embodiment, as shown in fig. 3, the virtual retina projection system provided in the embodiment of the present invention further includes a waveguide device 7, adapted to receive the beamlets of the projection module 1, and fold the optical path of the beamlets;
the discrete beam splitter device 2 is adapted to receive the beamlets and split the beamlets to generate beams in different discrete directions, and includes:
and the light splitting device is suitable for receiving the beamlets folded by the light path, splitting the light and generating light beams in different discrete directions.
When the projection module 1 generates a thin beam of an image to be displayed, the thin beam irradiates to the waveguide device 7, is folded through the optical path of the waveguide device 7 and irradiates to the discrete light-splitting device 2, the discrete light-splitting device 2 performs light splitting to generate light beams in different discrete directions, the obtained light beams in different discrete directions irradiate to the reflecting device 3, reflecting the light beams still in different discrete directions of the beamlets to obtain reflected light beams forming viewpoints (such as viewpoint j, viewpoint k, and viewpoint l shown in fig. 1), wherein each viewpoint can form a virtual image of the image to be displayed which meets the requirement of human vision for viewing integrity, and the distance between adjacent viewpoints is less than the diameter of the pupil, when the pupil 5 of the human eye 4 is in the region of the viewpoint, the pupil 5 can receive the reflected light beam in the region of the viewpoint and project the reflected light beam onto the retina 6, and the human eye 3 can see the corresponding image.
Of course, in order to facilitate the arrangement of the components of the virtual retinal projection system, reduce the occupied space, and fully utilize the folding function of the optical path of the waveguide device 7, the discrete optical splitter 2 can be embedded in the waveguide device 7.
As shown in fig. 4 and 5, the discrete optical splitter 2 may be embedded in the waveguide device 7 horizontally, and as shown in fig. 6 to 8, the discrete optical splitter 2 may be embedded in the waveguide device 7 obliquely as long as the optical path propagation requirement can be satisfied.
Specifically, the discrete optical splitter 2 may be embedded in the waveguide 9 by a gluing process or a thin film insert molding process, and may also cover the surface of the waveguide.
Similarly, the reflecting device 3 may be coated on the surface of the waveguide device 7 or embedded in the waveguide device, enabling reflection of light beams of different scattering directions.
As shown in fig. 3, 5, 7 and 8, the reflective device 3 may be embedded in the waveguide device 7, and as shown in fig. 4 and 6, the reflective device 3 may cover the surface of the waveguide device 7. When the reflecting device 3 is embedded into the waveguide device 7, the projection module 1 and the discrete light-splitting device 2 are respectively positioned at two sides of the reflecting device 3, so that the reflecting device 3 needs to have both a reflection function and a transmission function, and a volume holographic device or a partial transmission partial reflecting device can be selected; when the reflection device 3 covers the surface of the waveguide device 7 and the beamlets of the image to be displayed generated by the projection module 1 can directly irradiate the discrete beam splitter 2, the reflection device 3 may be a total reflection device having only a reflection function, or may be a reflection function, a transmission function volume hologram device, or a partial transmission partial reflection device.
Of course, in one embodiment, the reflecting device 3 may also be embedded in the waveguide device 9 by a gluing process or a thin film insert molding process.
Therefore, in the virtual retina system provided by the embodiment of the invention, the waveguide device is arranged, and the waveguide device is utilized to realize the folding of the propagation light path of the thin light, so that the integration level of the virtual retina projection system can be improved, the compactness of the system is improved, and the required installation space is reduced.
To improve the controllability of light, an embodiment of the invention further provides a virtual retina projection system, please refer to fig. 9-11 b, fig. 9 is a schematic diagram of a virtual retina projection system according to another embodiment of the invention, fig. 10 is a schematic diagram of a virtual retina projection system according to another embodiment of the invention, fig. 11a and 11b are schematic diagrams of a virtual retina projection system according to another embodiment of the invention, wherein fig. 11a and 11b together represent the optical path propagation of a light beam.
As shown in the drawings, embodiments of the present invention also provide a virtual retina projection system, including: the projection module 1, the discrete light splitting device 2 and the reflection device 3, the reflection device 3 includes at least two sub-reflection regions 31, each sub-reflection region 31 is adapted to receive and reflect the light beams in different discrete directions corresponding to at least a part of image pixels of an image to be displayed, so as to obtain sub-reflection light beams corresponding to different image pixels with different angles reflected by different sub-reflection regions 31 and sub-reflection light beams corresponding to the same image pixel with the angle difference within a predetermined angle difference range reflected by different sub-reflection regions 31, the sub-reflection light beams of different sub-reflection regions 31 respectively form respective continuous sub-viewing zones, different continuous sub-viewing zones are completely overlapped or partially overlapped to form an overlapped viewing zone 8 (shown as a completely overlapped overlapping viewing zone), each continuous sub-viewing zone includes a sub-viewpoint within each pupil size range, and the sub-viewpoints can form at least a part of virtual image of the image to be displayed, the viewpoint is positioned in the overlapping visual area and comprises a plurality of sub viewpoints positioned in the pupil size range, and partial virtual images of the sub viewpoints positioned in the overlapping visual area are spliced to form a virtual image of an image to be displayed, which meets the requirement of the human eye for viewing the whole image.
Referring to fig. 12, fig. 12 is a schematic diagram illustrating propagation of a light beam path of a virtual retinal projection system according to an embodiment of the present invention.
In order to ensure that the human eye can still obtain a virtual image of the image to be displayed which meets the visual integrity requirement of the human eye when the pupil moves, the different sub-reflective regions 31, besides receiving the sub-reflected light beams of the image to be displayed which correspond to different image pixels, also need to receive the sub-reflected light beams of the same image pixel (such as a shown in the figure) corresponding to a part of the image to be displayed by the adjacent different sub-reflective regions 31, so that after being reflected by the reflective device 3, the sub-reflected light beams corresponding to different image pixels with different angles reflected by the different sub-reflective regions 31 and the sub-reflected light beams corresponding to the same image pixel with the angle difference within the predetermined angle difference range (such as a1, a2 and a3 shown in the figure) can be obtained.
Said light beams corresponding to different discrete directions of at least part of the image pixels of the image to be displayed as described herein refer to light beams generated by the projection module 1, but which correspond to image pixels of the image to be displayed.
When the projection module 1 generates a beamlet of an image to be displayed, the beamlet irradiates the discrete beam splitter 2, the discrete beam splitter 2 splits the beamlet to generate beams in different discrete directions, the beams in different discrete directions irradiate the reflector 3, each sub-reflective region 31 of the reflector 3 receives the beams in different discrete directions corresponding to at least a part of image pixels of the image to be displayed, the beams in different discrete directions are reflected to obtain sub-reflective beams corresponding to different image pixels with different angles reflected by the different sub-reflective regions 31, and the sub-reflective beams corresponding to the same image pixel with the angle difference within a predetermined angle difference range reflected by the different sub-reflective regions 31, the sub-reflective beams of the different sub-reflective regions 31 form each continuous sub-viewing zone, and each continuous sub-viewing zone can have a plurality of sub-viewing points with pupil size, each sub-viewpoint may form part of a virtual image of the image to be displayed.
It is easily understood that the sub-viewpoints correspond to respective regions obtained by sliding a pupil-sized sliding window within the continuous sub-viewing region, and thus, there are a plurality of sub-viewpoints within the continuous sub-viewing region, but the sub-viewpoints may be partially overlapped or not overlapped.
It should be noted that the continuous sub-viewing zone described herein refers to a zone formed by converging and diverging the light beams reflected from the same sub-reflection zone 31, and the overlapping viewing zone refers to a zone formed by overlapping sub-reflection zones formed by converging and diverging the light beams reflected from the respective sub-reflection zones 31.
When the pupil is located in the overlapped visual area, the pupil is also located in different continuous sub-visual areas formed by different sub-reflection areas 31, so that the reflected light beams of different sub-reflection areas 31 can be received, and when a plurality of sub-viewpoints with the pupil size range are contained in one position in the overlapped visual area, and partial virtual images of the sub-viewpoints are spliced to form a virtual image of the image to be displayed, which meets the complete requirement of the visual observation of human eyes, the position is the viewpoint.
It is easily understood that the pupil size range is not only one region, but arbitrarily slid to each range formed by each position including the sub-viewpoint, with the pupil size range as a sliding window. Therefore, when the pupil 5 of the human eye moves continuously, the eye may move to a viewpoint located at the middle position of the sub-viewpoints or to the borderless viewpoint.
Each sub-reflection region 31 receives light beams with different scattering directions of at least partial image pixels of the image to be displayed, which means that each sub-reflection region 31 can receive light beams with different scattering directions corresponding to all image pixels of the image to be displayed, or can receive only light beams with different scattering directions corresponding to partial image pixels of the image to be displayed, so that the obtained sub-viewpoints can be all images of the image to be displayed or partial images.
Therefore, light beams in different discrete directions corresponding to image pixels of an image to be displayed irradiate different sub-reflection regions, the light modulation of the sub-reflection regions is independent, and mutual interference does not exist, so that the controllability of a reflection device can be improved, and the light entering a pupil forms a continuous and crosstalk-free image.
In one embodiment, the sub-reflective regions 31 are arranged in an array to facilitate the acquisition of the sub-reflective regions 31 and to improve the formation of the sub-viewpoints.
Further, if the angle difference range of each sub-reflected light beam of the same image pixel is large, each partial image of the obtained display image is separated, so that in order to ensure the continuity of the obtained virtual image of the image to be displayed, which meets the requirement of the complete vision of human eyes, the angle difference range of each sub-reflected light beam of the same image pixel can be 0-5 °.
On the other hand, referring to fig. 9 and 10 together, it can be seen that the areas of the viewpoints formed in fig. 9 and 10 are different, and the size of the area of a specific viewpoint can be adjusted as needed, and it is found through a lot of research that the size of the area of the viewpoint is related to the size of the sub-reflection area 31 and the focal length of the sub-reflection area 31, and the size of the area of the viewpoint is positively related to the size of the sub-reflection area 31 and negatively related to the focal length of the sub-reflection area 31, so that the size of the area of the viewpoint can be adjusted by adjusting at least one of the size of the sub-reflection area 31 and the focal length of the sub-reflection area 31.
As shown in the figure, when the area of the viewpoint needs to be increased, on one hand, the size of each sub-reflection area 31 may be increased, and also the focal length of each sub-reflection area 31 may be decreased, or the focal length of the sub-reflection area 31 may be decreased while increasing the size of each sub-reflection area 31.
The change in the size of the sub-reflecting area 31 and the change in the focal length can be realized by replacing the reflecting device 3.
Thus, in use, the reflecting device 3 can be determined and selected as needed so that the range of viewpoints formed by the sub-reflecting areas 31 of the reflecting device 3 satisfies the needs.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (12)
1. A virtual retinal projection system, comprising:
the projection module is suitable for generating a thin light beam of an image to be displayed;
the discrete light splitting device is suitable for receiving the beamlets and splitting the beamlets to generate light beams in different discrete directions;
a reflection device, including at least two sub-reflection regions, each sub-reflection region being adapted to receive the light beams in different discrete directions corresponding to at least some image pixels of an image to be displayed, and perform reflection to obtain sub-reflection light beams corresponding to different image pixels with different angles reflected by different sub-reflection regions and sub-reflection light beams corresponding to the same image pixel with an angle difference within a predetermined angle difference range reflected by different sub-reflection regions, the sub-reflection light beams of different sub-reflection regions respectively forming respective continuous sub-viewing zones, different continuous sub-viewing zones being entirely overlapped or partially overlapped to form an overlapped viewing zone, a viewpoint being located in the overlapped viewing zone, each continuous sub-viewing zone including a sub-viewpoint within each pupil size range, the sub-viewpoints being capable of forming at least some virtual images of the image to be displayed, the viewpoint comprises a plurality of sub viewpoints positioned in the pupil size range, and partial virtual images of the sub viewpoints positioned in the overlapped visual area are spliced to form a virtual image of the image to be displayed, which meets the complete requirement of human visual observation.
2. The virtual retinal projection system of claim 1, further comprising:
the waveguide device is suitable for receiving the beamlets of the projection module and folding the optical paths of the beamlets;
the discrete beam splitter device is adapted to receive the beamlets and split the beamlets to generate beams in different discrete directions, and includes:
and the light splitting device is suitable for receiving the beamlets folded by the light path, splitting the light and generating light beams in different discrete directions.
3. The virtual retinal projection system of claim 2 wherein the discrete light-splitting device overlies a surface of the waveguide device or is embedded in the waveguide device.
4. The virtual retinal projection system of claim 2 wherein the reflective device overlies a surface of the waveguide or is embedded in the waveguide.
5. The virtual retinal projection system of claim 1 wherein the discrete beam-splitting device is fabricated by a process of machining an optical diffraction device.
6. The virtual retinal projection system of claim 5 wherein the optical diffraction device fabrication process comprises a micro-nano fabrication process and an interference lithography process.
7. The virtual retinal projection system of claim 1 wherein the reflective device comprises a volume holographic device, a partially transmissive partially reflective device, or a fully reflective device.
8. The virtual retinal projection system of claim 7 wherein the partially transmissive partially reflective device comprises a curved device that is partially transmissive and partially reflective or a planar device that is partially transmissive and partially reflective.
9. The virtual retinal projection system of claim 1 wherein the projection module comprises a MEMS galvanometer based laser projection module or an array pixel panel based small aperture projection module.
10. The virtual retinal projection system of claim 1 wherein each of the subreflector regions is arranged in an array.
11. The virtual retinal projection system of claim 1 wherein the angle of each of the sub-reflected beams corresponding to a same image pixel differs by an amount in the range of 0 ° -5 °.
12. The virtual retinal projection system of claim 1 wherein the size of the area of the viewpoint is positively correlated with the size of the sub-reflective area and negatively correlated with the focal length of the sub-reflective area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011369361.5A CN112198667B (en) | 2020-11-30 | 2020-11-30 | Virtual retina projection system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011369361.5A CN112198667B (en) | 2020-11-30 | 2020-11-30 | Virtual retina projection system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112198667A CN112198667A (en) | 2021-01-08 |
| CN112198667B true CN112198667B (en) | 2021-06-08 |
Family
ID=74033713
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011369361.5A Active CN112198667B (en) | 2020-11-30 | 2020-11-30 | Virtual retina projection system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112198667B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112859337A (en) * | 2021-01-14 | 2021-05-28 | 上海交通大学 | Super multi-viewpoint display system |
| CN114879359A (en) * | 2021-02-05 | 2022-08-09 | 华为技术有限公司 | Near-to-eye display device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2976898C (en) * | 2015-02-17 | 2023-11-21 | Thalmic Labs Inc. | Systems, devices, and methods for eyebox expansion in wearable heads-up displays |
| JP2019113794A (en) * | 2017-12-26 | 2019-07-11 | ソニーセミコンダクタソリューションズ株式会社 | Image display unit and display unit |
| JP7078985B2 (en) * | 2018-06-12 | 2022-06-01 | 株式会社Ｑｄレーザ | Image projection device |
| DE102018218987A1 (en) * | 2018-11-07 | 2020-05-07 | Robert Bosch Gmbh | Spectacle lens for data glasses, data glasses and method for operating a spectacle lens or data glasses |
| DE102018221438A1 (en) * | 2018-12-11 | 2020-06-18 | Robert Bosch Gmbh | Projection device, microscanner and data glasses |
| CN111158144A (en) * | 2019-12-27 | 2020-05-15 | 瑞声科技（南京）有限公司 | Micromirror laser scanning near-to-eye display system |
-
2020
- 2020-11-30 CN CN202011369361.5A patent/CN112198667B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112198667A (en) | 2021-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11237393B2 (en) | Eyepieces for augmented reality display system | |
| JP7212806B2 (en) | Eyepieces for Virtual Reality, Augmented Reality, and Mixed Reality Systems | |
| KR102601052B1 (en) | Display system with variable power reflector | |
| KR102663100B1 (en) | Antireflection coatings for metasurfaces | |
| EP3640744B1 (en) | Holographic projector for waveguide display | |
| US20240177429A1 (en) | Systems and methods for mixed reality | |
| TWI756691B (en) | Optical system, head-mounted device, and display system | |
| JP2021073511A (en) | Virtual and augmented reality systems and methods having improved diffractive grating structures | |
| TW201835636A (en) | Augmented reality imaging system | |
| CN109073819A (en) | System and method for augmented reality | |
| CN112602004B (en) | Projector-combiner display with beam replication | |
| CN112198667B (en) | Virtual retina projection system | |
| KR20170039526A (en) | Refractive optical screen and floating hologram system using the refractive optical screen | |
| KR20210007818A (en) | Near eye display device, agreegated reality glasses and method of its operation | |
| KR20210048946A (en) | Display apparatus having wide viewing window | |
| CN112925098A (en) | Near-to-eye display module based on light-emitting limited pixel block-aperture pair | |
| TW202235958A (en) | Waveguide display with multiple monochromatic projectors | |
| TW202235939A (en) | Staircase in-coupling for waveguide display | |
| CN115877560B (en) | Laser scanning imaging module, device and AR display equipment | |
| KR102133880B1 (en) | Three dimensional image display apparatus without vergence-accommodation conflict | |
| RU2817180C1 (en) | Device for forming multi-aspect three-dimensional (3d) image of projection type |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |