CN217467358U - Eye movement tracking system based on superlens, near-to-eye display optical system and equipment - Google Patents
Eye movement tracking system based on superlens, near-to-eye display optical system and equipment Download PDFInfo
- Publication number
- CN217467358U CN217467358U CN202221556852.5U CN202221556852U CN217467358U CN 217467358 U CN217467358 U CN 217467358U CN 202221556852 U CN202221556852 U CN 202221556852U CN 217467358 U CN217467358 U CN 217467358U
- Authority
- CN
- China
- Prior art keywords
- superlens
- eye
- display
- optical system
- tracking system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The utility model provides an eye movement tracking system, near-to-eye display optical system and equipment based on super lens, use super lens in eye movement tracking system's structured light generater, because super lens itself has light, thin, simple, cheap and the high advantage of productivity, make the eye movement tracking system volume of using super lens smaller, weight is lighter, be applicable to various wearing formula display devices more, thereby improved the wearing comfort level of wearing the head-mounted display device user who has this eye movement tracking system; moreover, the near-eye display optical system comprising the eye movement tracking system can reconstruct the depth information of the eye fixation point position more pertinently, relieve VAC and improve the visual comfort level.
Description
Technical Field
The utility model relates to a super lens application technology field particularly, relates to an eye movement tracking system, nearly eye display optical system and equipment based on super lens.
Background
Currently, eye tracking cameras are an integral part of consumer electronics level Virtual Reality (VR)/Augmented Reality (AR) devices. In the AR/VR device, the eye movement tracking camera used can determine the vergence and the pupil size of the eyes of the user by adopting a structured light technology, so as to determine the current focus of the user, and project a virtual image onto the determined focus, thereby effectively increasing the eye movement range and improving the visual comfort of the eyes. In addition, the eye-tracking camera is combined with a multi-focal-plane VR/AR near-eye display system, so that the number and distribution of depth planes or depths of field can be dynamically changed according to focal point changes, and visual convergence accommodation conflict (VAC) can be effectively relieved.
However, the eye-tracking cameras mostly adopt multi-piece refractive lenses, which are bulky and heavy, and this may reduce the wearing comfort of a user wearing a head-mounted display device having such eye-tracking cameras.
SUMMERY OF THE UTILITY MODEL
In order to solve the above problem, an object of the embodiments of the present invention is to provide an eye tracking system, a near-eye display optical system and an apparatus based on a superlens.
In a first aspect, an embodiment of the present invention provides an eye tracking system based on a superlens, for determining a gazing point position of an eye of a user, the eye tracking system based on the superlens, including: the device comprises a structured light generator, a receiving module and a processor;
the structured light generator comprising: a light source and a superlens;
the processor is respectively connected with the light source and the receiving module;
infrared light emitted by the light source is projected to the surface of the user eyes through the super lens to form an infrared light point cloud;
when receiving the infrared light signal reflected by the eyes of the user, the receiving module performs photoelectric conversion on the received infrared light signal and sends an electric signal obtained after the photoelectric conversion to the processor, and the processor determines the fixation point position of the eyes of the user through the electric signal.
In a second aspect, the embodiments of the present invention further provide a near-eye display optical system, including: a display, a superlens array, projection optics and a superlens-based eye tracking system according to the first aspect;
the superlens array is disposed between the display and the projection optics; the superlens array comprises a plurality of adjustable superlenses arranged side by side;
the projection lens projects and magnifies an image sent by the display on one side of the display far away from the projection lens into a virtual image which can be observed by the eyes of the user;
the superlens-based eye-tracking system is capable of determining a gaze point location of the user's eye;
the adjustable super lens is used for adjusting the distance between the display and the virtual image part; the virtual image part is a virtual image obtained by amplifying the image part displayed at the gazing point position in the display by the projection lens.
In a third aspect, the embodiment of the present invention further provides a head-mounted display device, including: a support member and the near-eye display optical system according to the second aspect fixed to the support member.
In the embodiments of the present invention, in the solutions provided in the first to third aspects, the super lens is used in the structured light generator of the eye tracking system, and compared with the mode that most of the eye tracking cameras in the related art adopt multi-piece refractive lenses, because the super lens itself has the advantages of light weight, thinness, simplicity, low cost and high productivity, the eye tracking system using the super lens has smaller volume and lighter weight, and is more suitable for various wearable display devices, thereby improving the wearing comfort level of the user wearing the head-mounted display device having the eye tracking system; moreover, the near-eye display optical system comprising the eye movement tracking system can more pointedly reconstruct the depth information of the intersection point position of the visual axis of the eyes and the display, relieve VAC and improve the visual comfort; moreover, the near-eye display optical system utilizes the adjustable super lens to reconstruct the depth information of the intersection point position of the visual axis of the eyes and the display, so that the whole structure of the near-eye display optical system is lighter, thinner and more compact; further improving the wearing comfort of the user.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic structural diagram illustrating an eye tracking system based on a superlens according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating determination of a gaze direction in a superlens-based eye tracking system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a near-eye display optical system according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a near-eye display optical system according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram illustrating a first superlens in a near-eye display optical system according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram illustrating a near-eye display optical system according to an embodiment of the present invention, in which a distance between a display and a virtual image portion is adjusted by using a first superlens;
fig. 7 is a schematic structural diagram illustrating a second superlens in a near-eye display optical system according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram illustrating a near-eye display optical system according to an embodiment of the present invention, in which a distance between a display and a virtual image portion is adjusted by using a second superlens;
fig. 9 is a schematic structural diagram illustrating a third superlens in a near-eye display optical system according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram illustrating a near-eye display optical system according to an embodiment of the present invention, in which a third superlens is used to adjust a distance between a display and a virtual image portion;
fig. 11 shows a schematic structural diagram of a head-mounted display device according to an embodiment of the present invention.
Detailed Description
In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and to simplify the description, but do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore should not be construed as limiting the present invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically limited otherwise.
In the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "fixed" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood according to specific situations by those skilled in the art.
Currently, eye tracking cameras are an integral part of consumer electronic grade VR/AR devices. In the AR/VR equipment, the eye movement tracking camera used can determine the vergence and the pupil size of the eyes of the user by adopting a structured light technology, so as to determine the current focus of the user, and project the virtual image onto the determined focus, thereby effectively increasing the eye movement range and improving the visual comfort of the eyes. In addition, the eye tracking camera is combined with a VR/AR near-eye display system with multiple focal planes, the number and distribution of depth planes or depths of field can be dynamically changed according to focus changes, and VAC is effectively relieved.
However, the eye-tracking cameras mostly adopt multi-piece refractive lenses, which are bulky and heavy, and this may reduce the wearing comfort of a user wearing a head-mounted display device having such eye-tracking cameras.
Based on this, the embodiments of the present application provide an eye tracking system, a near-eye display optical system and a device based on an extra lens, where the extra lens is used in a structured light generator of the eye tracking system, and the extra lens itself has advantages of being light, thin, simple, cheap, and high in productivity, so that the eye tracking system using the extra lens has a smaller volume and a lighter weight, and is more suitable for various wearable display devices, thereby improving the wearing comfort of a user wearing a head-mounted display device having the eye tracking system.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.
Examples
Referring to fig. 1, a schematic structural diagram of a superlens-based eye tracking system, the present embodiment provides a superlens-based eye tracking system for determining a gaze point position of an eye of a user, the superlens-based eye tracking system including: a structured light generator, a receiving module and a processor 100.
The structured light generator comprising: a light source 102 and a superlens 104.
The processor is respectively connected with the light source and the receiving module.
The infrared light emitted by the light source is projected to the surface of the user eyes through the super lens to form an infrared light point cloud.
When receiving the infrared light signal reflected by the eyes of the user, the receiving module performs photoelectric conversion on the received infrared light signal and sends an electric signal obtained after the photoelectric conversion to the processor, and the processor determines the fixation point position of the eyes of the user through the electric signal.
The light source adopts a random dot matrix laser light source. The random lattice laser light source is an infrared vertical cavity surface emitting laser array. When laser emitted by the infrared vertical cavity surface emitting laser array passes through the super lens, the laser is amplified in a certain proportion and is projected onto the surface of eyes of a person according to infrared rays emitted by the infrared vertical cavity surface emitting laser array in a self-arrangement array mode to form infrared point cloud.
In order to sufficiently receive the infrared light signal reflected by the user's eye, in the eye tracking system based on superlens provided in this embodiment, the receiving module includes: an image sensor 106 and a converging superlens (not shown).
The converging super lens can converge the infrared light signal reflected by the user eyes on the image sensor.
In one embodiment, the image sensor may employ, but is not limited to: a charge coupled device or a complementary metal oxide semiconductor device.
In one embodiment, the converging superlens may be disposed between the image sensor and the user's eye. The distance between the converging super lens and the image sensor is preferably not more than the focal length of the converging sensor.
Optionally, the image sensor is located at a focal plane of the converging superlens.
In order to reduce the image sensor from receiving the ambient light other than the infrared light signal reflected by the user's eyes, in the eye-tracking system based on a superlens according to this embodiment, the receiving module further includes: a filter element (not shown).
The filter element covers the converging super lens.
The optical filter element can transmit an infrared light signal with a preset wavelength and can reflect light signals with other wavelengths except the infrared light signal with the preset wavelength.
In one embodiment, the filter element is overlaid on a surface of the converging superlens on a side capable of receiving infrared light signals reflected by the user's eye.
Optionally, the filter element is a narrow-band filter.
By covering the light filtering element on the converging super lens, the receiving of the image sensor to the ambient light except the infrared light signal reflected by the eyes of the user is reduced, and the influence of the ambient light on the eye movement tracking system based on the super lens is reduced.
A processor is communicatively coupled to the structured light generator and the image sensor, and eye pupil location information may be estimated based on a comparison of the detected eye shape as an electrical signal to a human eye model pre-cached in the processor. In addition, yaw, pitch and roll rotations of the eye and translation vectors of the eye may also be determined.
Specifically, referring to the schematic view of determining gaze direction shown in fig. 2, the processor may indirectly estimate the direction of the foveal axis (visual axis) by estimating the direction of the pupillary axis (optical axis) of the eye and using the offset between the pupillary axis and the foveal axis (visual axis), and the estimated visual axis direction may be used to determine the gaze direction and gaze point location of the user's eye.
In this embodiment, the specific process of determining the position of the visual axis and the gaze point of the eye of the user by the processor in the superlens-based eye tracking system is not within the scope of the discussion of this embodiment, and the improvement of the superlens-based eye tracking system is an improvement of the optics in the eye tracking system and does not involve any improvement in the process of determining the position of the visual axis and the gaze point.
The specific process of determining the position of the visual axis and the gaze of the user's eye by the processor in the superlens based eye tracking system is known in the art and will not be described in detail here.
After the above-mentioned eye tracking system based on superlens is introduced, referring to the first structural schematic diagram of the near-eye display optical system shown in fig. 3 and the second structural schematic diagram of the near-eye display optical system shown in fig. 4, the present embodiment further provides a near-eye display optical system, including: a display 300, a superlens array 302, projection optics 304, and a superlens-based eye tracking system 306 as described above.
The superlens array is disposed between the display and the projection optics; the superlens array includes a plurality of tunable superlenses arranged side-by-side.
The projection lens enlarges the image sent by the display into a virtual image which can be observed by the eyes of the user at the side of the display far away from the projection lens.
The superlens-based eye tracking system is capable of determining a gaze point location of the user's eye.
The adjustable super lens is used for adjusting the distance between the display and the virtual image part; the virtual image part is a virtual image obtained by amplifying the image part displayed at the gazing point position in the display by the projection lens.
In one embodiment, the superlens array is disposed on a side of the display capable of displaying an image; the projection lens is arranged on one side of the super lens array far away from the display.
The superlens-based eye tracking system is used for determining the visual axis of the user's eyes firstly and then determining the intersection point position of the display and the visual axis as the fixation point position of the user's eyes.
The image displayed at the gaze point location on the display is the image portion.
In the near-eye display optical system, one superlens-based eye-tracking system may be used, and two superlens-based eye-tracking systems may be used in order to improve the accuracy of determining the visual axis (where the visual axis is completely symmetrical in VR and the visual axes of the left and right eyes are symmetrical about the center line).
In the near-eye display optical system provided by the embodiment, the display is used for displaying an image, and the image displayed by the display is a real image, namely a real image.
Alternatively, to be applicable to near-eye display optical systems, the display includes, but is not limited to: a light emitting diode display, an organic light emitting diode display, a silicon-based liquid crystal display, a digital micromirror device, or a mems-based laser beam scanning display; the whole structure of the displays is small, the displays belong to micro displays, and the displays are more suitable for the near-eye display optical system.
The projection lens is a lens capable of performing an enlarging function, and for example, the projection lens is capable of enlarging an image displayed on a display to obtain a virtual image, i.e., a virtual image, displayed on a side of the display away from the projection lens (i.e., a side of the display on which the image cannot be displayed).
As shown in fig. 3, the projection lens may be a conventional lens, such as a convex lens; alternatively, as shown in fig. 4, the projection optics may employ a superlens.
In the near-to-eye display optical system provided by the embodiment, the super lens is used as the projection lens, the super lens array and the display can be packaged at a wafer level, the alignment problem among optical axes does not need to be considered, and the production cost and the difficulty are greatly reduced.
In the near-eye display optical system proposed in the present embodiment, the plurality of adjustable superlenses 21 respectively correspond to each image area in the graphics displayed by the display, and the virtual image enlarged by the projection lens can be partially modulated, so that the distance between part of the virtual image (i.e., the virtual image portion described above) in the virtual image and the display is changed.
Alternatively, each tunable superlens of the plurality of tunable superlenses may be a separately controllable superlens. Under the condition that every adjustable super lens all is the super lens that can regulate and control alone, through regulating and control alone every adjustable super lens, can change the distance between the virtual image part in the virtual image that every adjustable super lens corresponds and the display respectively.
In order to adjust the distance between the display and the virtual image portion by using the adjustable superlens, referring to a schematic structural diagram of the first superlens shown in fig. 5, in the near-eye display optical system provided in this embodiment, the adjustable superlens includes: a first superlens 211 and a micro-displacement module 212.
The miniature displacement module is attached to the first superlens.
The micro displacement module is capable of changing a distance between the display and a virtual image portion.
The micro displacement module can penetrate through the working waveband light of the first super lens.
When the adjustable superlens comprises at least two first superlenses, the focal length of each of the at least two first superlenses is the same.
Wherein, the micro displacement module can adopt but is not limited to: piezoelectric ceramics, magnetostrictive displacement devices, or electrostrictive displacement devices.
The light of the operating band may be a band in which light emitted from the display is located. Such as: the visible light band.
Referring to the schematic structural diagram of the near-to-eye display optical system shown in fig. 6, which utilizes the first superlens to adjust the distance between the display and the virtual image portion, the distance between the first superlens and the display attached by the miniature displacement module can be changed by the miniature displacement module attached by the adjustable superlens, which is correspondingly arranged with the visual axis of the user's eyes and the image portion displayed at the intersection position of the display, so that the distance between the virtual image portion amplified by the adjustable superlens attached by the miniature displacement module and the display is changed, and the purpose of reconstructing the depth information of the eye gaze point position on the display screen is achieved.
As shown in fig. 6, each adjustable superlens in the superlens array adopts a structure in which the miniature displacement module is attached to the first superlens 211, so that each miniature displacement module can independently control the distance between the first superlens 211 attached to the miniature displacement module and the display, thereby locally changing the distance between the virtual image part needing depth information reconstruction and the display in the virtual image and improving the convergence accommodation regulation conflict.
Optionally, the first superlens 211 includes: a first nanostructure and a filling material filled around the first nanostructure; the filling material is transparent or semitransparent material in the working waveband, and the absolute value of the difference between the refractive index of the filling material and the refractive index of the first nanostructure is more than or equal to 0.5, so that the filling material is prevented from influencing the light modulation effect.
In the working wave band of the adjustable super lens in the near-eye display optical system, such as the visible light wave band, each first super lens is transparent, namely has high transmittance to the light ray in the working wave band. The first superlens comprises a first nano structure and a filling material filled around the first nano structure, wherein the filling material filled around the first nano structure is also a material which is transparent or semitransparent in an operating waveband, namely the filling material has high transmittance or transmittance between 40% and 60% to light (such as visible light) in the operating waveband, so that the first nano structure in a nanometer scale can be protected.
Referring to the schematic structural diagram of the second superlens shown in fig. 7, in the near-eye display optical system provided in this embodiment, the tunable superlens includes: a second superlens 213.
The second superlens includes: the phase change material layer 2133 includes a substrate 2131, a plurality of second nanostructures 2132, a first electrode layer 2134, and a second electrode layer 2135.
The substrate is provided with a plurality of second nanostructures on one side, and the first electrode layer is filled around the plurality of second nanostructures, wherein the height of the first electrode layer is lower than that of the second nanostructures.
The phase change material layer covers the surface of one side, far away from the substrate, of the first electrode layer and is filled around the second nanostructure, wherein the sum of the heights of the first electrode layer and the phase change material layer is greater than or equal to the height of the second nanostructure;
the second electrode layer covers one side surface, far away from the substrate, of the phase change material layer;
the first electrode layer and the second electrode layer can respectively load voltage on different phase change material layers of the second super lens, the focal length of the different second super lenses is changed, and therefore the distance between the corresponding virtual image part of the different second super lenses and the display is adjusted.
The virtual image part corresponding to the second superlens is a virtual image obtained by amplifying an image part corresponding to the second superlens in an image displayed by the display by the projection lens.
The substrate of the second superlens can be selected from but not limited to: quartz glass, crown glass, flint glass.
The second nanostructures may be highly uniform nanostructures, and these second nanostructures may be all-dielectric structural units, with high transmittance in the visible light band, and alternative materials include, but are not limited to: titanium oxide, silicon nitride, fused silica, aluminum oxide, gallium nitride, gallium phosphide, amorphous silicon, crystalline silicon, and hydrogenated amorphous silicon.
The second superlens has a plurality of second nanostructures around it (e.g., gaps between two nanostructures) filled with a first electrode layer having a height that is lower than the height of each second nanostructure.
In one embodiment, the height of the first electrode layer may be one-half of the height of the second nanostructure.
Referring to fig. 8, the second electrode layer and the first electrode layer are respectively located at two sides of the phase change material layer, and are configured to apply a voltage to the phase change material layer, where after the phase change material layer receives the voltage applied by the first electrode layer and the second electrode layer, a phase change state of the phase change material layer changes, so that a focal length of the second superlens changes, and a distance between the virtual image portion and the display may be changed.
The first electrode layer may be a positive electrode layer, and the second electrode layer may be a negative electrode layer; alternatively, the first electrode layer may be a negative electrode layer, and the second electrode layer may be a positive electrode layer, which is not limited in this embodiment.
As shown in fig. 8, when voltages are applied to the phase change material layers of different second superlenses separately, that is, the focal length of the second superlens 213 is changed, so that the distance between the local image of the virtual image (that is, the virtual image portion) and the display can be changed, and the purpose of reconstructing the depth information of the eye gaze point position on the display screen is achieved, so as to improve the convergence accommodation conflict.
In one embodiment, the phase change material used in the phase change material layer is germanium antimony tellurium.
The phase change material selected for the phase change material layer may be germanium antimony tellurium (GST, GeSbTe), such as Ge 2 Sb 2 Te 5 . GST has and realizes that phase transition energy requires characteristics such as low, phase transition is reversible, and GST can realize the alternate reversible phase transition of crystalline state phase and amorphous state under the voltage of difference, thereby the embodiment of the utility model provides a thereby can utilize the different realization of GST crystalline state and amorphous state refracting index to the regulation of second super lens focus.
In one embodiment, the first electrode layer and the second electrode layer are Indium Tin Oxide (ITO).
The ito is an N-type oxide semiconductor, is transparent to visible light bands, has good conductivity as a nano ito metal oxide, and is suitable for being used as an electrode layer to be filled or disposed on two sides of a phase change material layer of a second superlens in a near-eye display optical system provided in this embodiment, and a voltage is applied to the phase change material layer.
Referring to the schematic structural diagram of the third superlens shown in fig. 9, in the near-eye display optical system provided in this embodiment, the tunable superlens includes: a plurality of third superlenses 214.
Each of the plurality of third superlenses includes: an electrode layer 2141, an electrically actuated layer 2142, and third nanostructures 2143; the electrode layers are arranged on two sides of the electric actuating layer; the third nanostructure is disposed on a side of the electrode layer away from the electroactuation layer.
And the electric actuating layer in each third super lens displaces along the height axis direction of the third nano structure under the action of an electric field provided by the electrode layer, so that the phase of each third super lens is changed.
When the phase of each third super lens is changed, the focal length of each third super lens is changed, so that the distance between the virtual image part corresponding to each third super lens and the display is changed.
The virtual image part corresponding to the third superlens is a virtual image obtained by amplifying an image part corresponding to the third superlens in an image displayed by the display by the projection lens.
As can be seen from the above description, the third superlens adopts a height-adjustable substrate (e.g., an electric actuation layer) to realize height adjustment of the third nanostructure, so as to actively change the phase of the third superlens, and in the case that the phase of the third superlens is changed, the focal length of the third superlens can be changed.
Referring to the schematic structural view of the near-eye display optical system shown in fig. 10, which adjusts the distance between the display and the virtual image portion by using the second superlens, the phases of different third superlenses are changed, for example, the focal lengths of some of the third superlenses are changed, so that the distance between the local image (i.e., the virtual image portion) in the virtual image and the display can be changed, the purpose of reconstructing the depth information of the eye gaze point position on the display screen is achieved, and the convergence accommodation conflict is improved.
Further, referring to a schematic structural diagram of a head-mounted display device shown in fig. 11, the embodiment proposes a head-mounted display device, including: a support member 1100 and the above-described near-eye display optical system 1102 fixed to the support member.
In one embodiment, the support member employs a support housing.
The support housing may be made of a flexible material for ease of wearing by the user.
To sum up, the present embodiment provides an eye tracking system, a near-eye display optical system and a device based on a super lens, where the super lens is used in a structured light generator of the eye tracking system, and compared with a mode in which a multi-piece refractive lens is mostly used in an eye tracking camera in the related art, the super lens has advantages of light weight, thinness, simplicity, cheapness and high productivity, so that the eye tracking system using the super lens has a smaller volume and lighter weight, and is more suitable for various wearable display devices, thereby improving the wearing comfort of a user wearing a head-mounted display device having the eye tracking system; moreover, the near-eye display optical system comprising the eye movement tracking system can more pointedly reconstruct the depth information of the intersection point position of the visual axis of the eyes and the display, relieve VAC and improve the visual comfort; moreover, the near-eye display optical system utilizes the adjustable superlens to reconstruct the depth information of the intersection point position of the visual axis of the eyes and the display, so that the whole structure of the near-eye display optical system is lighter, thinner and more compact; further improving the wearing comfort of the user.
The above description is only for the specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present invention, and all should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (19)
1. A superlens-based eye tracking system for determining a gaze point position of a user's eye, the superlens-based eye tracking system comprising: the device comprises a structured light generator, a receiving module and a processor;
the structured light generator comprising: a light source and a superlens;
the processor is respectively connected with the light source and the receiving module;
infrared light emitted by the light source is projected to the surface of the user eyes through the super lens to form an infrared light point cloud;
when receiving the infrared light signal reflected by the eyes of the user, the receiving module performs photoelectric conversion on the received infrared light signal and sends an electric signal obtained after the photoelectric conversion to the processor, and the processor determines the fixation point position of the eyes of the user through the electric signal.
2. The superlens-based eye tracking system of claim 1, wherein the light source is a random-lattice laser light source.
3. The superlens-based eye-tracking system according to claim 2, wherein the random-lattice laser light source is an infrared vertical-cavity surface-emitting laser array.
4. The superlens-based eye-tracking system according to claim 1, wherein the receiving module comprises: an image sensor and a converging superlens;
the converging super lens can converge the infrared light signal reflected by the user eyes on the image sensor.
5. The superlens-based eye tracking system of claim 4, wherein the receive module further comprises: a filter element;
the filter element covers the converging super lens;
the optical filter element can transmit an infrared light signal with a preset wavelength and can reflect light signals with other wavelengths except the infrared light signal with the preset wavelength.
6. The superlens-based eye-tracking system according to claim 5, wherein the filter element is a narrow-band filter.
7. The superlens-based eye-tracking system according to claim 4, wherein the image sensor is a charge-coupled device or a CMOS device.
8. A near-eye display optical system, comprising: a display, a superlens array, a projection optic and a superlens based eye tracking system according to any of claims 1 to 7;
the superlens array is disposed between the display and the projection optics; the superlens array comprises a plurality of adjustable superlenses arranged side by side;
the projection lens projects and magnifies an image emitted by the display on one side of the display far away from the projection lens into a virtual image which can be observed by eyes of the user;
the superlens-based eye tracking system is capable of determining a gaze point location of the user's eye;
the adjustable super lens is used for adjusting the distance between the display and the virtual image part; the virtual image part is a virtual image obtained by amplifying the image part displayed at the gazing point position in the display by the projection lens.
9. The near-eye display optical system of claim 8, wherein the superlens array is disposed on a side of the display capable of displaying an image; the projection lens is arranged on one side of the super lens array far away from the display.
10. The near-eye display optical system of claim 8, wherein the tunable superlens comprises: a first superlens and a micro displacement module;
the micro displacement module is attached to the first super lens;
the micro displacement module is capable of changing a distance between the display and a virtual image portion;
the micro displacement module can penetrate through the working waveband light of the first super lens;
when the adjustable superlens comprises at least two first superlenses, the focal length of each of the at least two first superlenses is the same.
11. The near-eye display optical system of claim 10, wherein the first superlens comprises: a substrate, a plurality of first nanostructures, and a filler material;
the first nanostructures are arranged on the substrate, and the filling material is filled around the first nanostructures.
12. The near-eye display optical system of claim 11, wherein an absolute value of a difference between the refractive index of the filler material and the refractive index of the first nanostructure is 0.5 or greater.
13. The near-to-eye display optical system of claim 10, wherein the micro displacement module is a piezoelectric ceramic, a magnetostrictive displacement device, or an electrostrictive displacement device.
14. The near-eye display optical system of claim 8, wherein the tunable superlens comprises: a second superlens;
the second superlens includes: the phase change material layer comprises a substrate, a plurality of second nanostructures, a phase change material layer, a first electrode layer and a second electrode layer;
one side of the substrate is provided with a plurality of second nanostructures, and the first electrode layer is filled around the second nanostructures, wherein the height of the first electrode layer is lower than that of the second nanostructures;
the phase change material layer covers the surface of one side, far away from the substrate, of the first electrode layer and is filled around the second nanostructure, wherein the sum of the heights of the first electrode layer and the phase change material layer is greater than or equal to the height of the second nanostructure;
the second electrode layer covers one side surface, far away from the substrate, of the phase change material layer;
the first electrode layer and the second electrode layer can respectively load voltage on different phase change material layers of the second super lens, the focal length of the different second super lenses is changed, and therefore the distance between the corresponding virtual image part of the different second super lenses and the display is adjusted.
15. The near-eye display optical system of claim 8, wherein the tunable superlens comprises: a plurality of third superlenses;
each of the plurality of third superlenses includes: an electrode layer, an electrically actuated layer, and a third nanostructure; the electrode layers are arranged on two sides of the electric actuating layer; the third nanostructure is arranged on one side of the electrode layer far away from the electric actuating layer;
the electric actuating layer in each third super lens displaces along the height axis direction of the third nanostructure under the action of an electric field provided by the electrode layer, so that the phase of each third super lens is changed;
when the phase of each third super lens is changed, the focal length of each third super lens is changed, so that the distance between the virtual image part corresponding to each third super lens and the display is changed.
16. The near-eye display optical system of claim 8, wherein the projection optics is a convex lens or a superlens.
17. The near-eye display optical system of claim 8, wherein the display comprises: a light emitting diode display, an organic light emitting diode display, a silicon based liquid crystal display, a digital micromirror device, or a mems based laser beam scanning display.
18. A head-mounted display device, comprising: a support member and the near-eye display optical system according to any one of claims 8 to 17 fixed to the support member.
19. The head-mounted display device of claim 18, wherein the support member employs a support housing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202221556852.5U CN217467358U (en) | 2022-06-21 | 2022-06-21 | Eye movement tracking system based on superlens, near-to-eye display optical system and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202221556852.5U CN217467358U (en) | 2022-06-21 | 2022-06-21 | Eye movement tracking system based on superlens, near-to-eye display optical system and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN217467358U true CN217467358U (en) | 2022-09-20 |
Family
ID=83238801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202221556852.5U Active CN217467358U (en) | 2022-06-21 | 2022-06-21 | Eye movement tracking system based on superlens, near-to-eye display optical system and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN217467358U (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11927769B2 (en) | 2022-03-31 | 2024-03-12 | Metalenz, Inc. | Polarization sorting metasurface microlens array device |
| US11978752B2 (en) | 2019-07-26 | 2024-05-07 | Metalenz, Inc. | Aperture-metasurface and hybrid refractive-metasurface imaging systems |
| US11988844B2 (en) | 2017-08-31 | 2024-05-21 | Metalenz, Inc. | Transmissive metasurface lens integration |
-
2022
- 2022-06-21 CN CN202221556852.5U patent/CN217467358U/en active Active
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11988844B2 (en) | 2017-08-31 | 2024-05-21 | Metalenz, Inc. | Transmissive metasurface lens integration |
| US11978752B2 (en) | 2019-07-26 | 2024-05-07 | Metalenz, Inc. | Aperture-metasurface and hybrid refractive-metasurface imaging systems |
| US11927769B2 (en) | 2022-03-31 | 2024-03-12 | Metalenz, Inc. | Polarization sorting metasurface microlens array device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN217467358U (en) | Eye movement tracking system based on superlens, near-to-eye display optical system and equipment | |
| CN217467352U (en) | Near-to-eye display optical system | |
| US20180084232A1 (en) | Optical See-Through Head Worn Display | |
| US9019614B2 (en) | Display device with image depth simulation | |
| CN217467355U (en) | Holographic near-to-eye display system and head-mounted display equipment | |
| KR20190130147A (en) | Depth-based povided rendering for display systems | |
| US10429648B2 (en) | Augmented reality head worn device | |
| CN108700750B (en) | Display device | |
| JP2019500649A (en) | System and method for augmented reality near-eyewear display | |
| US20130286053A1 (en) | Direct view augmented reality eyeglass-type display | |
| EP1240539B1 (en) | A display device | |
| CN217639768U (en) | Image combiner and near-to-eye display device | |
| CN217639777U (en) | Virtual reality display device | |
| CN217467364U (en) | Projection system based on focusing super lens and equipment with same | |
| CN217639772U (en) | Image combiner and near-to-eye display system | |
| CN217639776U (en) | Light source module and retina projection system | |
| CN217467353U (en) | Near-to-eye display optical system and head-mounted display equipment | |
| CN217467363U (en) | Near-to-eye display optical system and head-mounted display equipment | |
| CN110955063A (en) | Intraocular display device based on retinal scanning | |
| CN117452615A (en) | Reflective fresnel folding optical display | |
| US11782279B2 (en) | High efficiency pancake lens | |
| US20220342219A1 (en) | Apparatus, system, and method for disposing photonic integrated circuits on surfaces | |
| CN218446223U (en) | Near-to-eye display system based on projection super lens and head-mounted display equipment | |
| US20220350147A1 (en) | Conformable electrodes with low conspicuity | |
| US20240053598A1 (en) | Pancake lens with controlled curvature |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |