CN114019678A - Eyeball-tracking optical device, optical system, display device, and display system - Google Patents
Eyeball-tracking optical device, optical system, display device, and display system Download PDFInfo
- Publication number
- CN114019678A CN114019678A CN202111234893.2A CN202111234893A CN114019678A CN 114019678 A CN114019678 A CN 114019678A CN 202111234893 A CN202111234893 A CN 202111234893A CN 114019678 A CN114019678 A CN 114019678A
- Authority
- CN
- China
- Prior art keywords
- optical
- detection light
- eye
- optical surface
- eye tracking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0176—Head mounted characterised by mechanical features
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
The invention provides an eyeball tracking optical device, an optical system, a display device and a display system, wherein the eyeball tracking optical device is applied to a large-view-field head-mounted display device. Moreover, the detection light source does not need to be accurately aligned with eyes, and only the reflected light of the first optical surface facing the detection light can be irradiated on the eyes of the eyes, so that the installation precision requirement of the detection light source is reduced, the utilization rate of the detection light is improved, namely, the detection light acquisition module can acquire the reflected light of the detection light irradiating on the eyes more easily, and the eyeball tracking efficiency of the eyes is improved.
Description
Technical Field
The invention relates to the technical field of optics, in particular to an eyeball tracking optical device, an optical system, a display device and a display system.
Background
The eyeball tracking technology is a scientific application technology, and generally tracking is performed according to the eyeball, the eyeball reflection characteristic and the characteristic change of the periphery of the eyeball, or the change of the iris and the pupil. One or more cameras are adopted to capture an eye image of the user, and then the eyeball characteristic and the glistening characteristic in the eye image are used for estimating where the eyeball of the user is looking. The existing eyeball tracking technology is to emit light through an infrared Light Emitting Diode (LED), irradiate the light to the cornea of human eyes, shoot images of the human eyes through a camera, and extract reflected light of infrared light in the cornea of the human eyes to judge the gazing direction of the human eyes.
In the conventional portable virtual reality/augmented reality (VR/AR) at present, an infrared LED used as an eyeball tracking detection light source is arranged on the side surfaces of two sides of an eyepiece, and if an infrared LED lamp is adopted to directly polish the eyeball, the infrared LED lamp can only be suitable for the condition of the small-size eyepiece with a small visual field. When the virtual reality/augmented reality is large-view-field equipment, the size of an eyepiece of the equipment is large, infrared light emitted by the infrared LED lamps arranged on two sides is blocked by the forehead or other facial structures of a person, and the infrared light cannot irradiate the cornea of the eye of the person.
Disclosure of Invention
In view of this, the present invention provides an eyeball-tracking optical device, an optical system, a display device and a display system, which solve the problem that the current eyeball-tracking device cannot be applied to a large-field virtual reality/augmented reality device with a large eyepiece size.
In order to solve the above technical problem, the present invention provides an optical device for eye tracking, which is applied to a head-mounted display device, wherein the head-mounted display device comprises an eyepiece group, and the eyepiece group comprises a first optical surface facing to eyes; wherein the eye tracking optical device comprises: the detection light source is used for emitting detection light, and the light emitting direction of the detection light source points to the first optical surface; and a detection light collection module configured to acquire reflected light of the eye to the detection light; an acute included angle between a principal ray of a light path between the detection light source and the first optical surface and an optical axis of the eyepiece group is any value between 30 degrees and 70 degrees.
Optionally, the wavelength band of the detection light source is an infrared wavelength band.
Optionally, the eye tracking optical device further comprises: a reflecting mirror disposed in a reflecting direction of the eye to the probe light; wherein the detection light collection module is arranged in the reflection direction of the reflector.
Optionally, the eyepiece group further comprises a second optical surface opposite the first optical surface; the mirror is disposed in a direction in which the second optical surface faces.
Optionally, the mirror is a partially reflective and partially transmissive mirror, and the reflection band of the mirror includes an infrared band.
Optionally, the first optical surface has a partially transmissive partially reflective film on a surface thereof, and a reflection wavelength band of the partially transmissive partially reflective film includes an infrared wavelength band.
Optionally, the probe light source comprises: an optical machine for generating the detection light; and a light path adjusting component, which is configured to shape and turn the detection light to irradiate on the first optical surface; the included angle between the chief ray of the light path between the optical machine and the light path adjusting component and the acute angle between the chief ray of the light path between the light path adjusting component and the first optical surface is any value out of the range of-30 degrees to 30 degrees.
Optionally, a vertical distance between the optical machine and an optical axis of the eyepiece group is any one of 30mm to 60 mm.
Optionally, the optical path adjusting assembly includes: the focusing lens group and the light path deflecting mirror are both arranged on a light path between the optical machine and the first optical surface; the focusing lens group is configured to focus the detection light generated by the optical machine, and the optical path deflecting mirror is configured to change an irradiation direction of the detection light to irradiate toward the first optical surface.
Optionally, the ball tracking optical device further comprises: the detection light machine shell, the detection light source install in the detection light machine shell, the detection light machine shell with the eyepiece group is connected.
In another embodiment, the present invention provides an optical system comprising: two of the aforementioned eye tracking optical devices; and a left eye viewing assembly on which one of said eye tracking optics is mounted; and a right eye viewing assembly on which one of said eye tracking optics is mounted; wherein the left eye viewing assembly and the right eye viewing assembly are distributed in bilateral symmetry.
In another embodiment, the present invention provides a display device applied to a virtual reality device or an augmented reality device, the display device including: the optical system described above.
Optionally, the display device further comprises: a head-worn assembly for wearing on a person's head.
Optionally, the display device further comprises: a housing within which the optical system is housed.
In another embodiment, the present invention provides a display system, which is a virtual reality and/or augmented reality display system, and the display system includes a signal input module and the head-mounted display device, where the head-mounted display device receives and processes a signal of the signal input module.
Optionally, the signal input module includes an operation controller electrically connected to the head-mounted display device.
Optionally, the display system is a virtual and/or augmented reality display all-in-one machine, and the processing module is further configured to control the operating controller and the working state of the detection light source.
The invention has the beneficial effects that: when the invention is used, the invention is applied to the head-mounted display equipment with a large view field, so that the area of the first optical surface is larger, the detection light source irradiates the detection light on the large-area first optical surface, and the area of the eyepiece group is enough to acquire the detection light. When the detection light irradiates on the first optical surface, the first optical surface can partially reflect the detection light, the reflected detection light irradiates on eyes, the reflected light of the detection light after irradiating on the eyes irradiates into the detection light collection module, and the detection light collection module can perform subsequent eyeball tracking analysis after acquiring the reflected light. The detection light firstly irradiates on the ocular group and then is reflected to eyes, the first optical surface of the ocular group plays a role in collecting the detection light, the detection light enters the eyes through the reflection of the first optical surface, so that the detection light source can be arranged at a position far away from the eyes, and the first optical surface of the ocular group carries out relay reflection on the detection light so as to reflect the detection light on the eyes. Meanwhile, the detection light source does not need to be accurately aligned with eyes, and only the reflected light of the first optical surface facing the detection light can be irradiated on the eyes of the eyes, so that the requirement on the installation precision of the detection light source is lowered, the utilization rate of the detection light can be improved, the detection light acquisition module can acquire the reflected light of the detection light irradiating on the eyes more easily, and the eyeball tracking efficiency of the eyes is improved.
Drawings
Fig. 1 is a schematic structural diagram of an eyeball tracking optical device according to an embodiment of the invention.
Fig. 2 is a schematic structural diagram of another eye tracking optical device according to an embodiment of the present invention.
Fig. 3 is a schematic structural diagram of another eye tracking optical device according to an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of another eye tracking optical device according to an embodiment of the present invention.
Fig. 5 is a schematic structural diagram of a display system according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Fig. 1 is a schematic structural diagram of an eyeball tracking optical device according to an embodiment of the invention. As shown in fig. 1, the present application provides an optical device for eye tracking, which is applied to a head-mounted display device, the head-mounted display device includes an eyepiece set 1, the eyepiece set 1 includes a first optical surface 101 and a second optical surface 102 disposed oppositely, the first optical surface 101 faces to an eye 4, the second optical surface 102 faces to the outside, when the head-mounted display device is used, an image can be projected onto the first optical surface 101, or a display screen is disposed in a direction facing the second optical surface 102 to display the image, so that a user wearing the head-mounted display device can view the image.
Specifically, the head-mounted display device applied in the present application is a large field-of-view type head-mounted display device, and the area of the eyepiece group 1 of the large field-of-view type head-mounted display device is large. Based on this, the eyeball tracking optical device comprises a detection light source 2 and a detection light collection module 3, wherein the detection light source 2 is used for emitting detection light, the detection light source 2 is installed at the side of the eyepiece group 1 facing the ear, the light emitting direction of the detection light source 2 points to the first optical surface 101, and the detection light collection module 3 is configured to obtain the reflected light of the eye 4 to the detection light. The main ray of the light path between the detection light source 2 and the first optical surface 101 and the optical axis of the eyepiece group 1 form an acute included angle of 30 ° to 70 °.
When the embodiment is used, the limitation on the included angle between the chief ray between the detection light source 2 and the first optical surface 101 and the optical axis of the eyepiece group 1 corresponds to a large-field-of-view head-mounted display device, the specific field of view is generally greater than 100 °, and the area of the eyepiece group 1 of such a large-field-of-view head-mounted display device is large. If the detection light source 2 is installed at the side of the eyepiece group 1, the distance between the detection light source 2 and the eye 4 is relatively long, and the detection light cannot irradiate on the eye 4. The detection light source 2 irradiates detection light onto the first optical surface 101 having a large area, and since the field of view of the head-mounted display device of the present embodiment is large, the area of the eyepiece group 1 is sufficient to acquire the detection light. When the probe light irradiates on the first optical surface 101, the first optical surface 101 partially reflects the probe light, the reflected probe light irradiates on the eye 4, and the reflected light of the probe light after irradiating on the eye 4 irradiates into the probe light collection module 3. When the detection light collection module 3 is located in the direction faced by the first optical surface 101 of the eyepiece group 1, the reflected light of the detection light by the eyes 4 directly enters the detection light collection module 3; when the detection light collection module 3 is located in the direction facing the second optical surface 102 of the eyepiece set 1, the reflected light of the detection light from the eye 4 may penetrate through the eyepiece set 1 and then enter the detection light collection module 3. After the reflected light is acquired by the detection light acquisition module 3, subsequent eyeball tracking analysis can be performed, and specifically, pupil image information in the reflected light can be extracted to identify the gaze direction of the eyeball.
The detection light of this embodiment firstly shines on eyepiece group 1 and reflects to eyes 4 in, and first optical surface 101 of eyepiece group 1 plays the effect of collecting the detection light, and the detection light gets into eyes 4 through the reflection of first optical surface 101 for detection light source 2 can install in the position department far away from eyes 4, carries out relay reflection to the detection light by first optical surface 101 of eyepiece group 1 with the detection light reflection on eyes 4. Meanwhile, the detection light source 2 does not need to be accurately aligned with the eyes 4, and only the first optical surface 101 can irradiate the reflected light of the detection light on the eyes, so that the requirement on the installation accuracy of the detection light source 2 is lowered, the utilization rate of the detection light can be improved, the detection light acquisition module 3 can acquire the reflected light of the detection light on the eyes 4 more easily, and the eyeball tracking efficiency of the eyes 4 is improved.
Further, in the embodiment, the angle of view of the head-mounted display device is large, so the area of the eyepiece group 1 is large, and more detection light can be reflected. If the position of the detection light source 2 is adjusted to a proper position, the first optical surface 101 can acquire all the detection light, and no detection light leaks from the edge of the eyepiece group 1.
Specifically, the wave band of the detection light source 2 is an infrared wave band, and the invisible detection light of the infrared wave band does not affect the normal display content of the eyepiece group 1.
Fig. 2 is a schematic structural diagram of another eye tracking optical device according to an embodiment of the present invention. Preferably, as shown in fig. 2, the eye-tracking optical device further includes a reflecting mirror 5, and the reflecting mirror 5 is disposed in a reflecting direction of the detection light by the eye 4. The detection light collection module 3 is disposed in the reflection direction of the mirror 5. The optical path direction of the reflected light of the probe light after passing through the eye 4 can be changed by the reflecting mirror 5, and the degree of freedom in placement of each component in the eye tracking optical device can be improved.
As shown in fig. 2, the reflecting mirror 5 is disposed in a direction in which the second optical surface 102 faces. Because the structure of the detection light collection module 3 is generally complex and occupies a large space, the placement position of the detection light collection module 3 can be more free through the reflector 5. In some approaches, the probe light collection module 3 may be disposed in the region between the second optical surface 102 and the mirror 5. Specifically, for example, the installation position of the detection light collection module 3 may be determined according to the specific structure of the entire eye tracking optical device, and then the angle of the reflecting mirror 5 may be adjusted so that the reflected light of the detection light from the eye 4 is irradiated on the light sensing window of the detection light collection module 3.
Specifically, the package structure of the eyepiece group 1 has more installation space, the detection light collection module 3 can be installed on the package structure of the eyepiece group 1, the detection direction of the detection light collection module 3 faces the direction facing the second optical surface 102, and the reflector 5 is installed on a certain structure in the direction facing the second optical surface 102. Wherein, because the simple structure of speculum 5 and occupation space are little, consequently speculum 5 is not high to the requirement of installation space and mounted position, then adjust the angle of speculum 5 and make eyes 4 can incide detection light collection module 3 to the reverberation of detection light.
When the reflector 5 is not a partially reflective and partially transmissive mirror and the head-mounted display device is an augmented reality display device, the installation position of the reflector 5 needs to be designed so that the reflector 5 does not obstruct the visual field range of the eye 4 after penetrating through the eyepiece group 1, for example, the reflector 5 can be installed above or below the horizontal direction of the eyepiece group 1, and the orientation of the detection light source 2 is adjusted accordingly, so that the detection light can irradiate on the reflector 5 after passing through the first optical surface 101 and the reflection of the eye 4. Based on this, speculum 5 can adopt partial reflection partial transmission mirror to speculum 5's reflection wave band includes the infrared band, can make speculum 5 can not influence eyes 4 like this and see external environment through eyepiece group 1, speculum 5 alright with set up in eyes 4 see through the field of vision scope behind eyepiece group 1, can reduce the requirement to the mounted position of each part like this, improved the degree of freedom of putting of each part.
In addition, the surface of the first optical surface 101 may be coated or plated with a partial transmission partial reflection film, and the reflection waveband of the partial transmission partial reflection film includes an infrared waveband, so that the reflectivity of the detection light can be improved on the premise of not affecting the normal image display of the eyepiece group 1, more detection light can be irradiated on the eyes 4, and the utilization rate of the detection light is improved.
Optionally, the detection light source 2 includes an optical machine 201 and a light path adjusting component 202, where the optical machine 201 is configured to generate detection light, and the light path adjusting component 202 is configured to shape and turn the detection light to irradiate on the first optical surface 101; the main ray of the light path between the optical machine 201 and the light path adjusting component 202, and the main ray of the light path between the light path adjusting component 202 and the first optical surface 101 have an acute included angle between the two main rays which is any value out of a range of-30 ° to 30 °, including-30 ° and 30 ° main values.
The definition of the included angle between the two chief rays further defines that the invention is applied to the head-mounted display device with a large field of view, the specific field of view is generally larger than 100 degrees, and the area of the eyepiece group 1 of the head-mounted display device with the large field of view is larger. If the detection light source 2 is installed at the side of the eyepiece group 1, the distance between the detection light source 2 and the eye 4 is relatively long, and the detection light cannot irradiate on the eye 4. The optical path adjusting component 202 can shape the detection light generated by the optical machine 201 into a desired beam shape, for example, the detection light can be focused, the focal point is on the first optical surface 101 or near the surface of the first optical surface 101, and the focused detection light is reflected by the first optical surface 101 to the eye 4, so that the utilization rate of the detection light can be improved, and more detection light can be irradiated on the eye 4.
Optionally, the distance between the optical engine 201 in the detection light source 2 and the optical axis of the eyepiece group 1 is any one of values from 30mm to 60mm, including 30mm and 60mm, under the condition of the distance, the distance between the optical engine 201 of the head-mounted display device and the eyepiece group 1 is relatively long, the optical engine 201 and the eyepiece group 1 under the condition of the distance are not suitable for a small-field head-mounted display device, and the condition of the distance further corresponds to a large-field head-mounted display device. Specifically, the distance between the optical engine 201 and the optical axis of the eyepiece group 1 adopts the geometric center of the optical engine 201 as the distance starting point.
Specifically, the optical path adjusting assembly 202 includes a focusing lens group 210 and an optical path deflecting mirror 211, and both the focusing lens group 210 and the optical path deflecting mirror 211 are disposed on the optical path between the optical engine 201 and the first optical surface 101. The focusing lens group 210 is configured to focus the detection light generated by the optical engine 201, and the optical path deflecting mirror 211 is configured to change the irradiation direction of the detection light to irradiate toward the first optical surface.
As shown in fig. 1 and 2, the optical machine 201 may be an infrared semiconductor light emitting diode, the light entering side of the focusing lens group 210 is disposed in the light exiting direction of the optical machine 201, the focusing lens group 210 may be a lens group with positive power to focus the probe light, the optical path deflecting mirror 211 may be a mirror or a reflecting prism, the optical path deflecting mirror 211 is disposed on the light exiting side of the focusing lens group 210, the optical path deflecting mirror 211 reflects the probe light onto the first optical surface 101, and the probe light is focused on the first optical surface 101 or near the surface of the first optical surface 101.
Fig. 3 is a schematic structural diagram of another eye tracking optical device according to an embodiment of the present invention. As shown in fig. 3, the optical path deflecting mirror 211 may be a reflecting prism and is disposed in the light emitting direction of the optical machine 201, that is, the optical path deflecting mirror 211 firstly redirects the detection light, and the focusing lens group 210 is disposed in the reflecting direction of the optical path deflecting mirror 211.
Fig. 4 is a schematic structural diagram of another eye tracking optical device according to an embodiment of the present invention. As shown in fig. 4, the number of the focusing lens groups 210 may be two, the light entering side of the first focusing lens group 210 is disposed in the light exiting direction of the optical machine 201, the light path deflecting mirror 211 is disposed on the light exiting side of the first focusing lens group 210, the light entering side of the second focusing lens group 210 is disposed in the reflecting direction of the light path deflecting mirror 211, the shaping of the detection light is realized by the two focusing lens groups 210, and the light path deflecting mirror 211 is disposed between the two focusing lens groups 210 to redirect the detection light. The straight lines with arrows in fig. 1 to 4 indicate the general course of the light path.
Optionally, the ball tracking optical apparatus further includes a detection light housing 10, the detection light source 2 is installed in the detection light housing 10, and the detection light housing 10 is connected to the eyepiece group 1. By encapsulating and fixing the detection light source 2 by the detection light housing 10, the displacement of each component in the detection light source 2 can be avoided. The detection light housing 10 may be connected to the side of the eyepiece group 1, or indirectly connected to the eyepiece group 1 through some intermediary members, so as to ensure that the relative positions of the detection light source 2 and the eyepiece group 1 are unchanged, and thus the detection light can be stably irradiated on the first optical surface 101.
The head-mounted display device in this embodiment may further include an eyeglass frame including temples between which the optical system is fixed. The embodiment can hang the glasses legs on the ears of the user, and the eyepiece group can be installed on the lens installation position of the glasses frame, so that the head-mounted display equipment can be conveniently worn on the head of the user, and virtual reality display or augmented reality display is provided for the user. When the head-mounted display equipment is a transmission-type virtual reality/augmented reality product, the eyepiece group arranged at the installation position of the lens is a semi-transparent and semi-reflective lens, so that the human eyes can view a real scene outside the eyepiece group.
Optionally, the head-mounted display device includes an optical system disposed therein and a buckle, the buckle being used to fix the optical system in front of the human eye. In use, the clasp may hold the optical system in front of the human eye for viewing by the human eye.
Example two
The present invention provides an optical system including: according to the eyeball tracking optical device, the left eye watching assembly and the right eye watching assembly, the eyeball tracking optical device is installed on the left eye watching assembly, the eyeball tracking optical device is installed on the right eye watching assembly, and the left eye watching assembly and the right eye watching assembly are distributed in a bilateral symmetry mode. In use, the left and right eyes of a user view images from two sets of eyeglasses, respectively.
EXAMPLE III
The invention further provides a display device applied to virtual reality equipment or augmented reality equipment, and in some embodiments, the display device comprises the optical system and a fixed structure, wherein the optical system is connected with the fixed structure.
When the binocular vision-based system is used, an image can be projected to the first optical surface of the eyepiece group, or an image source is placed on the outer side, far away from eyes, of the eyepiece group, so that the image on the first optical surface of the eyepiece group can be observed, or the image of an image source outside the eyepiece group can be observed. Specifically, the display device may be a virtual reality/augmented reality product such as a transmissive/non-transmissive display, or may be a head-mounted virtual reality/augmented reality product. The fixed structure provides support for the optical system, and avoids displacement of each part of the optical system in the use process, so that the durability of the optical system is ensured. When the display device is a transmission type virtual reality/augmented reality product, the eyepiece group is a semi-transparent and semi-reflective lens, so that human eyes can watch a real scene outside the eyepiece group.
The display device further comprises a head wearing assembly, the head wearing assembly is connected with the fixing structure, and the head wearing assembly is used for being worn on the head of a person.
When the display device is used, the display device can be worn on the head of a user through the head wearing assembly, the head of the user provides support for the display device, and virtual reality or augmented reality images can be conveniently watched.
Optionally, the display device further includes a housing and a camera, the optical system is accommodated in the housing, and the housing can effectively protect the optical system from being damaged. The lens of the camera faces the human eye and the camera may be used to perform an eye tracking function.
Example four
Fig. 5 is a schematic structural diagram of a display system according to the present invention. The present invention further provides a display system, which is a virtual reality and/or augmented reality display system, as shown in fig. 5, the display system includes a signal input module 13 and the head-mounted display device, and the head-mounted display device receives the signal of the signal input module 13 and transmits the signal to the head-mounted display device for processing. The signal input module 13 includes an operation controller electrically connected to the head-mounted display device, and the operation controller may be a handle controller. Optionally, the display system is a virtual and/or augmented reality display all-in-one machine, and the processing module 40 is further configured to control the operation controller and the working state of the detection light source, for example, to control whether the detection light source is turned on.
In some embodiments, as shown in fig. 5, the display system further includes a memory 15, the processing module 40 is electrically connected to the signal input module 13, and the memory 15 is used for storing executable instructions of the processing module 40.
In use, the processing module 40 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the display system to perform desired functions.
Memory 15 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory can include, for example, Random Access Memory (RAM), cache memory (or the like). The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium and executed by the processing module 40 to control the operation controller.
The signal input modules 13 may be interconnected with the processing module 40 via a bus system and/or other form of connection mechanism (not shown), and the signal input modules 13 may include, for example, a keyboard, mouse, joystick, touch screen, and the like.
Of course, for simplicity, only some of the components of the display system that are relevant to the present invention are shown in fig. 5, omitting components such as buses, input/output interfaces, and the like. In addition, the display system may include any other suitable components depending on the particular application.
The basic principles of the present invention have been described above with reference to specific embodiments, but it should be noted that the advantages, effects, etc. mentioned in the present invention are only examples and are not limiting, and the advantages, effects, etc. must not be considered to be possessed by various embodiments of the present invention. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the invention is not limited to the specific details described above.
The block diagrams of devices, apparatuses, systems involved in the present invention are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
It is further noted that in the apparatus and device of the present invention, the components may be disassembled and/or reassembled. These decompositions and/or recombinations are to be regarded as equivalents of the present invention.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and the like that are within the spirit and principle of the present invention are included in the present invention.
Claims (17)
1. An optical device for eye tracking, applied to a head-mounted display apparatus, the head-mounted display apparatus comprising an eyepiece group including a first optical surface facing an eye;
wherein the eye tracking optical device comprises:
the detection light source is used for emitting detection light, and the light emitting direction of the detection light source points to the first optical surface; and
a detection light collection module configured to acquire reflected light of the eye to the detection light;
an acute included angle between a principal ray of a light path between the detection light source and the first optical surface and an optical axis of the eyepiece group is any value between 30 degrees and 70 degrees.
2. The eye tracking optical device according to claim 1,
the wave band of the detection light source is an infrared wave band.
3. The eye tracking optical apparatus according to claim 2, further comprising:
a reflecting mirror disposed in a reflecting direction of the eye to the probe light;
wherein the detection light collection module is arranged in the reflection direction of the reflector.
4. The eye tracking optical device of claim 3, wherein said eyepiece further comprises a second optical surface opposite said first optical surface;
the mirror is disposed in a direction in which the second optical surface faces.
5. The eye tracking optical device according to claim 3,
the reflecting mirror is a partial reflecting and partial transmitting mirror, and the reflecting wave band of the reflecting mirror comprises an infrared wave band.
6. The eye tracking optical device according to claim 1,
the surface of the first optical surface is provided with a partially transmitting and partially reflecting film, and the reflection waveband of the partially transmitting and partially reflecting film comprises an infrared waveband.
7. The eye-tracking optical device according to claim 1, wherein the probe light source comprises:
an optical machine for generating the detection light; and
an optical path adjusting component configured to shape and redirect the probe light to irradiate on the first optical surface;
the included angle between the chief ray of the light path between the optical machine and the light path adjusting component and the acute angle between the chief ray of the light path between the light path adjusting component and the first optical surface is any value out of the range of-30 degrees to 30 degrees.
8. The eye tracking optical device according to claim 7,
the vertical distance between the optical machine and the optical axis of the ocular lens group is any value from 30mm to 60 mm.
9. The eye tracking optical device of claim 7, wherein the optical path adjustment assembly comprises: the focusing lens group and the light path deflecting mirror are both arranged on a light path between the optical machine and the first optical surface; the focusing lens group is configured to focus the detection light generated by the optical machine, and the optical path deflecting mirror is configured to change an irradiation direction of the detection light to irradiate toward the first optical surface.
10. The eye tracking optical apparatus according to claim 1, further comprising:
the detection light machine shell, the detection light source install in the detection light machine shell, the detection light machine shell with the eyepiece group is connected.
11. An optical system, comprising:
two eye tracking optical devices according to any one of claims 1 to 10; and
a left eye viewing assembly on which one of said eye tracking optics is mounted; and
a right eye viewing assembly on which one of said eye tracking optics is mounted;
wherein the left eye viewing assembly and the right eye viewing assembly are distributed in bilateral symmetry.
12. A display device applied to virtual reality equipment or augmented reality equipment is characterized by comprising:
the optical system of claim 11.
13. The display device according to claim 12, further comprising:
a head-worn assembly for wearing on a person's head.
14. The display device according to claim 13, further comprising:
a housing within which the optical system is housed.
15. A display system, the display system being a virtual reality and/or augmented reality display system, wherein the display system comprises a signal input module and a head mounted display device according to any one of claims 1 to 10, the head mounted display device receiving and processing signals of the signal input module.
16. The display system of claim 15,
the signal input module comprises an operation controller electrically connected with the head-mounted display equipment.
17. The display system of claim 16, wherein the display system is a virtual and/or augmented reality display all-in-one machine, and the processing module is further configured to control the operation controller and the operating state of the probe light source.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111234893.2A CN114019678A (en) | 2021-10-22 | 2021-10-22 | Eyeball-tracking optical device, optical system, display device, and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111234893.2A CN114019678A (en) | 2021-10-22 | 2021-10-22 | Eyeball-tracking optical device, optical system, display device, and display system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114019678A true CN114019678A (en) | 2022-02-08 |
Family
ID=80057223
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111234893.2A Pending CN114019678A (en) | 2021-10-22 | 2021-10-22 | Eyeball-tracking optical device, optical system, display device, and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114019678A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114660806A (en) * | 2022-04-19 | 2022-06-24 | 塔普翊海（上海）智能科技有限公司 | Eye tracking optical device, head-mounted display equipment and eye tracking method |
| WO2023198003A1 (en) * | 2022-04-13 | 2023-10-19 | 北京七鑫易维信息技术有限公司 | Eyeball tracking apparatus and head-mounted display device |
-
2021
- 2021-10-22 CN CN202111234893.2A patent/CN114019678A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023198003A1 (en) * | 2022-04-13 | 2023-10-19 | 北京七鑫易维信息技术有限公司 | Eyeball tracking apparatus and head-mounted display device |
| CN114660806A (en) * | 2022-04-19 | 2022-06-24 | 塔普翊海（上海）智能科技有限公司 | Eye tracking optical device, head-mounted display equipment and eye tracking method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9999348B2 (en) | Compact eye imaging and eye tracking apparatus | |
| EP3499341B1 (en) | Eye tracking module for video eyeglasses | |
| JP2022176291A5 (en) | ||
| US20190258062A1 (en) | Eye tracking system and method, eyeglass lens, and wearable heads-up display | |
| US11513349B2 (en) | Optical see-through (OST) near-eye display (NED) system integrating ophthalmic correction | |
| US10474229B1 (en) | Folded viewing optics with high eye tracking contrast ratio | |
| TW201831953A (en) | Eye tracker based on retinal imaging via light-guide optical element | |
| CN114019678A (en) | Eyeball-tracking optical device, optical system, display device, and display system | |
| CN109725416B (en) | Eyeball tracking optical system, head-mounted equipment and imaging method | |
| US10452911B2 (en) | Gaze-tracking system using curved photo-sensitive chip | |
| CN219066130U (en) | Head-mounted display device | |
| US20220229300A1 (en) | Optical see through (ost) near eye display (ned) system integrating ophthalmic correction | |
| CN113454504A (en) | Holographic pattern generation for Head Mounted Display (HMD) eye tracking using diffractive optical elements | |
| WO2023066384A1 (en) | Eyeball tracking optical apparatus, optical system, display apparatus and display system | |
| CN110780433A (en) | Off-axis reflective optical system and electronic equipment | |
| KR20220046494A (en) | Eye tracking method and eye tracking sensor | |
| WO2023187780A1 (en) | Eye tracking device | |
| US20230118315A1 (en) | Optical see through (ost) near eye display (ned) system integrating ophthalmic correction | |
| CN113933999B (en) | Eyeball tracking optical device, optical system, display device and display system | |
| CN114563871B (en) | Eye movement tracking device and electronic equipment | |
| JP2017116768A (en) | Biological information acquisition device | |
| WO2023246815A1 (en) | Eyeball tracking optical system and head-mounted device | |
| US20240045211A1 (en) | Increased Optical Performance of Head-Mounted Displays inside Laser Safety Eyewear | |
| US20240004189A1 (en) | Optical systems and methods for eye tracking based on eye imaging via collimating element and light-guide optical element | |
| CN114252998B (en) | Near-to-eye display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |