CN114690403A - Head-mounted eye movement tracking system - Google Patents
Head-mounted eye movement tracking system Download PDFInfo
- Publication number
- CN114690403A CN114690403A CN202011580625.1A CN202011580625A CN114690403A CN 114690403 A CN114690403 A CN 114690403A CN 202011580625 A CN202011580625 A CN 202011580625A CN 114690403 A CN114690403 A CN 114690403A
- Authority
- CN
- China
- Prior art keywords
- head
- tracking system
- light
- light emitting
- sensing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004424 eye movement Effects 0.000 title abstract description 4
- 210000001508 eye Anatomy 0.000 claims abstract description 142
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 24
- 230000008878 coupling Effects 0.000 claims abstract description 24
- 238000010168 coupling process Methods 0.000 claims abstract description 24
- 238000005859 coupling reaction Methods 0.000 claims abstract description 24
- 230000000712 assembly Effects 0.000 claims abstract description 13
- 238000000429 assembly Methods 0.000 claims abstract description 13
- 230000003287 optical effect Effects 0.000 description 24
- 238000012545 processing Methods 0.000 description 14
- 239000000758 substrate Substances 0.000 description 9
- 230000033001 locomotion Effects 0.000 description 6
- 238000013461 design Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000005070 sampling Methods 0.000 description 4
- 210000000695 crystalline len Anatomy 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- -1 but not limited to Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 229920000139 polyethylene terephthalate Polymers 0.000 description 2
- 239000005020 polyethylene terephthalate Substances 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 239000004642 Polyimide Substances 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 210000004087 cornea Anatomy 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 210000000554 iris Anatomy 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920001721 polyimide Polymers 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
Abstract
The invention discloses a head-mounted eye movement tracking system which comprises a light combiner, an eye movement tracker and a signal processor. The light combiner includes a light coupling element. The eye tracker is at least partially arranged on the light combiner and is suitable for sensing an eyeball of the wearer. The eye tracker includes a plurality of light emitting elements and a plurality of sensing elements. The plurality of light emitting assemblies are adapted to emit a tracking light beam. The plurality of sensing elements are adapted to receive a tracking light beam reflected by an eye of the wearer. The signal processor is in signal connection with the eye tracker.
Description
Technical Field
The present invention relates to a tracking system, and more particularly, to a head-mounted eye tracking system.
Background
In order to provide higher quality video and audio effects, technologies such as Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) have become one of the important research and development points of the new generation of display technologies, and the head-mounted eye tracking system is one of the means for realizing these technologies.
Generally, a head-mounted eye tracking system tracks the movement of an eyeball through an eye tracker mounted therein, and adjusts a displayed image according to a visual line direction to improve a real-world effect. Taking a conventional eye tracker as an example, the eye tracker tracks and determines the position of an eyeball through a camera for moving images. However, such tracking is often limited by the frame rate of the camera. Also, the complexity, bulkiness and/or weight of the camera often affect the comfort of the wearer during use.
Disclosure of Invention
The present invention is directed to a head-mounted eye tracking system adapted to sense an eye of a wearer.
According to an embodiment of the present invention, a head-mounted eye tracking system includes a light combiner, an eye tracker, and a signal processor. The light combiner includes a light coupling element. The eye tracker is at least partially arranged on the light combiner and is suitable for sensing an eyeball of the wearer. The eye tracker includes a plurality of light emitting elements and a plurality of sensing elements. The plurality of light emitting assemblies are adapted to emit a tracking light beam. The plurality of sensing elements are adapted to receive a tracking light beam reflected by an eye of the wearer. The signal processor is in signal connection with the eye tracker.
In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.
Drawings
Fig. 1A is a schematic perspective view of a portion of a head-mounted eye tracking system according to a first embodiment of the present invention;
FIG. 1B is a schematic top view of a portion of a head-mounted eye tracking system according to a first embodiment of the present invention;
FIG. 1C is a schematic partial front view of a head-mounted eye tracking system according to a first embodiment of the invention;
fig. 1D is a schematic diagram illustrating an arrangement of light emitting elements and sensing elements of a head-mounted eye tracking system according to an embodiment of the invention;
FIG. 1E is a schematic diagram illustrating an arrangement of light emitting elements and sensing elements of another head-mounted eye tracking system according to an embodiment of the invention;
FIG. 1F is a schematic diagram illustrating an arrangement of light emitting elements and sensing elements of another head-mounted eye tracking system according to an embodiment of the invention;
fig. 2 is a schematic partial front view of a head mounted eye tracking system according to a second embodiment of the present invention;
FIG. 3 is a schematic partial front view of a head-mounted eye tracking system according to a third embodiment of the present invention;
FIG. 4 is a schematic partial front view of a head-mounted eye tracking system according to a fourth embodiment of the present invention;
FIG. 5 is a schematic partial front view of a head-mounted eye tracking system according to a fifth embodiment of the invention;
fig. 6A is a schematic top view of a portion of a head mounted eye tracking system according to a sixth embodiment of the present invention;
fig. 6B is a schematic front view of a portion of a head mounted eye tracking system in accordance with a sixth embodiment of the present invention;
FIG. 7 is a schematic partial front view of a head-mounted eye tracking system according to a seventh embodiment of the invention;
FIG. 8 is a schematic diagram of a partial front view of a head-mounted eye tracking system in accordance with an eighth embodiment of the present invention;
fig. 9A is a schematic top view of a portion of a head mounted eye tracking system in accordance with a ninth embodiment of the invention;
fig. 9B is a partial perspective view of a head-mounted eye tracking system according to a ninth embodiment of the present invention;
fig. 9C is a schematic front view of a portion of a head-mounted eye tracking system in accordance with a ninth embodiment of the invention;
fig. 10 is a schematic partial front view of a head-mounted eye tracking system according to a tenth embodiment of the invention;
fig. 11 is a schematic partial front view of a head-mounted eye tracking system according to an eleventh embodiment of the invention;
fig. 12 is a schematic partial front view of a head-mounted eye tracking system according to a twelfth embodiment of the invention.
Description of reference numerals:
100. 200, 300, 400, 500, 600, 700, 800, 900, 1000, 1100, 1200: a head-mounted eye tracking system;
110. 610: a light combiner;
114. 614: a light coupling member;
120. 220, 320, 420, 520, 620, 920, 1020, 1120, 1220: an eye tracker;
124. 224, 324, 424, 524, 924: a light emitting element;
124R, 924R: tracking the light beam;
125. 225, 325, 425, 525, 625, 925, 1025, 1125, 1225: a sensing component;
125R: reflecting the light beam;
130. 930: a display;
131. 931: a display component;
130R, 930R: a display beam;
140: a light guide;
650. 750: a signal processor;
651: an assembly layer;
652: a signal line;
753: a processing component;
161: a light-transmissive substrate;
162: a frame;
90: a wearer;
91: an eyeball;
ER: an ambient light beam;
p5: spacing;
l2, L9: a distance;
d1: a first alignment direction;
d2: a second alignment direction;
SU1, SU2, SU 3: a sensing unit;
r1, R2, R3: and (3) a range.
Detailed Description
In the drawings, the size of portions of elements or layers may be exaggerated or reduced for clarity. In addition, portions of components or layers may be omitted from the drawings or labeled for clarity. Also, the numerical values set forth in the specification may include the numerical values and deviation values within the deviation range acceptable to one of ordinary skill in the art.
In the embodiments described later or the corresponding drawings, the same or similar components are denoted by the same or similar reference numerals and have the same or similar functions, and the description is omitted. In addition, for clarity, not all of the light emitting elements, sensing elements, and/or the like may be labeled or illustrated individually in the figures.
Fig. 1A is a schematic perspective view of a part of a head-mounted eye tracking system according to a first embodiment of the invention. Fig. 1B is a schematic top view of a portion of a head-mounted eye tracking system according to a first embodiment of the invention. Fig. 1C is a schematic partial front view of a head-mounted eye tracking system according to a first embodiment of the invention. In addition, for clarity, not all of the light emitting elements 124, the sensing elements 125, and/or the display elements 131 are labeled or shown in fig. 1A to 1C.
Referring to fig. 1A to 1C, the head-mounted eye tracking system 100 includes an optical combiner (optical combiner)110 and an eye tracker (eye tracker) 120. The light combiner 110 includes an optical coupling 114. The number and arrangement of the optical couplers 114 can be adjusted according to the actual application requirements, and the invention is not limited thereto. The eye tracker 120 is disposed on the light combiner 110. Eye tracker 120 is adapted to sense an eyeball 91 of wearer 90. In the present embodiment, wearer 90 is not limited to a human being.
In the present embodiment, the optical coupler 114 may include a coupler mirror (coupler mirror), but the present invention is not limited thereto. In one embodiment, an optical coupling similar to optical coupling 114 may include a grating coupler. In one embodiment, the optical coupling element similar to the optical coupling element 114 may include a Volume Holographic Grating (VHG), a surface relief grating (surface relief grating), or a liquid crystal film coupling element.
In this embodiment, the head-mounted eye tracking system 100 may further include a translucent substrate 161. The light combiner 110 may be disposed on one side of the light-transmissive substrate 161. In one embodiment, the transparent substrate 161 may comprise glass, polymer (such as, but not limited to, polyimide, polyethylene terephthalate, PET, or other suitable transparent material. in one embodiment, the transparent substrate 161 may be mounted on the frame 162, but the invention is not limited thereto.
In this embodiment, the head-mounted eye tracking system 100 may further include a display 130. Display 130 is adapted to emit display beam 130R. The display light beam 130R can be irradiated to the eyeball 91 of the wearer 90 via the optical coupling element 114 of the optical combiner 110.
In one embodiment, display 130 may include one or more display components 131. The display element 131 of the display 130 is, for example, a light emitting diode, a micro light emitting diode, an organic light emitting diode or a laser diode capable of emitting the corresponding display beam 130R, which can be selected by those skilled in the art according to actual requirements. Display light beam 130R includes, for example, red, green, blue or other suitable light visible to wearer 90. The display light beam 130R emitted from the display 130 may be conducted to the light combiner 110 via a suitable light guide 140. The external light beam ER and the display light beam 130R can be irradiated to the eyeball 91 of the wearer 90 through the optical coupler 114 of the optical combiner 110. That is, the eyeball 91 of the wearer 90 can receive the external light beam ER and the display light beam 130R through the optical coupling element 114. In addition, the ambient light beam ER may include ambient light or light emitted by other displays not shown.
In one embodiment, the display element 131 of the display 130 may include a light emitting diode, but the invention is not limited thereto. For example, the display member 131 may include micro light emitting diodes (micro LEDs; μ LEDs) having sizes substantially of (5 micrometers; μm) to 100 μm) x (5 μm to 100 μm).
In fig. 1B, only one light guide 140 is illustrated by way of example, but the present invention is not limited thereto. In one embodiment, the light guide 140 may include a reflector, a refractor, and/or other suitable light guides. For example, the light guide 140 may include a mirror (mirror), a prism (prism), a lens (lens), an optical fiber (optical fiber), and/or a light pipe (light pipe).
In the present embodiment, the eye tracker 120 may include a plurality of light emitting elements 124 and a plurality of sensing elements 125.
In an embodiment, the light emitting elements 124 and/or the sensing elements 125 may be disposed on the transparent substrate 161 and located on the other side opposite to the light combiner 110, but the invention is not limited thereto.
The light emitting assembly 124 of the eye tracker 120 is adapted to directly or indirectly emit a tracking light beam 124R to the eyeball 91 of the wearer 90. Tracking light beam 124R includes, for example, infrared light or other suitable light that is not visible to wearer 90 and/or is less harmful to eye 91 tissue. The amount of light (luminescence) of the tracking beam 124R can be adjusted according to design requirements and is required to meet biosafety regulations, which are not limited in the present invention.
The sensing element 125 of the eye tracker 120 may include, for example, a reverse-biased light-emitting diode (LED), a Photodiode (PD), or a photosensitive element under a planar optical layer with a diffraction pattern (e.g., but not limited to, a speckle mask). The tracking light beam 124R may illuminate the eyeball 91 of the wearer 90 and then generate corresponding reflections in corresponding regions or directions according to corresponding eyeball tissues (e.g., iris, pupil, crystalline lens, cornea, etc.). For example, the eye tissue may have different directions and/or intensities of light reflection at different locations under the irradiation of the tracking light beam 124R with substantially the same light wavelength. In this way, the tracking light beam (referred to as the reflected light beam 125R) reflected by the eyeball 91 of the wearer 90 can be received by the sensing element 125, so as to track the movement of the eyeball 91. That is, the eye tracker 120 can track the movement of the eyeball 91 without imaging, as compared to having a tracker for focusing the optical components for imaging.
In one embodiment, the sensing component 125 can track the movement of the eyeball 91 through high frequency sampling. For example, the sampling frequency of the sensing element 125 may be higher than the frame rate (frame rate) of a general motion image. In one embodiment, the sampling frequency of the sensing element 125 may be greater than or equal to 250 hertz (Hz), which may be determined by the circuit design of the sensor, but the invention is not limited thereto.
In the embodiment, the distance P5 between two adjacent sensing elements 125 is between 1 millimeter (mm) and 30 mm. In one embodiment, the pitch P5 between two adjacent sensing elements 125 may be between 3mm and 15 mm.
In the present embodiment, the light emitting element 124 may be a micro light emitting diode (micro LED; μ LED) having a size of substantially (5 μm to 100 μm) × (5 μm to 100 μm). As such, some or all of the light emitting elements 124 may be disposed at least partially overlapping (i.e., including partially overlapping or completely overlapping) with the optical coupling member 114. That is, part or all of the light emitting elements 124 may at least partially overlap the visible area of the eyeball 91 of the wearer 90.
In the present embodiment, the sensing element 125 may be a micro-transmicro-LED or a Photodiode (PD) having a size of substantially (5 μm-100 μm) × (5 μm-100 μm). In this way, part or all of the sensing elements 125 may be partially or completely disposed to overlap the optical coupler 114. That is, part or all of the sensing element 125 may at least partially overlap the visible area of the eyeball 91 of the wearer 90.
In one embodiment, the micro light emitting diodes can emit light or perform light detection at different timings through different operation bias voltages.
In the embodiment, the light emitting elements 124 or the sensing elements 125 surround the light coupling element 114, but the invention is not limited thereto.
In the present embodiment, in the first arrangement direction D1, a part of the light emitting elements 124 and a part of the sensing elements 125 are arranged in a staggered manner, but the invention is not limited thereto.
Taking fig. 1D as an example, in an embodiment, within a closed range R1 in the front view state, the light emitting devices 124 and the sensing devices 125 adjacent to each other may be integrated into a sensing unit SU 1. In the aforementioned sensing unit SU1, the light emitting elements 124 and the sensing elements 125 can be arranged alternately.
Taking fig. 1E as an example, in an embodiment, within a closed range R2 in the front view state, the light emitting device 124 and the plurality of sensing devices 125 may be integrated into one sensing unit SU 2. In the aforementioned sensing unit SU2, the light emitting elements 124 and the sensing elements 125 can be staggered as shown in fig. 1E.
Taking fig. 1F as an example, in an embodiment, within a closed range R3 in a front view state, a plurality of light emitting elements 124 and a plurality of sensing elements 125 can be integrated into one sensing unit SU 3. In the aforementioned sensing unit SU3, one of the light emitting elements 124 and one of the sensing elements 125 may be staggered as shown in fig. 1E.
In one embodiment, the number of sensing elements 125 in a sensing unit may be greater than or equal to the number of light emitting elements 124.
In the present embodiment, a portion of the plurality of light emitting elements 124 and a portion of the plurality of sensing elements 125 are arranged in a staggered manner in the second arrangement direction D2 perpendicular to the first arrangement direction D1, but the invention is not limited thereto.
In the present embodiment, the number of the light emitting elements 124 and the number of the sensing elements 125 may be staggered and adjusted according to the actual use requirement, and may be regular staggered design or irregular staggered design, as shown in fig. 1C to 5, but the invention is not limited thereto. In this embodiment, the number of sensing elements 125 may be greater than or equal to the number of light emitting elements 124.
Fig. 2 is a schematic partial front view of a head-mounted eye tracking system according to a second embodiment of the present invention.
In the present embodiment, the head-mounted eye tracking system 200 includes a light combiner 110 and an eye tracker 220. Eye tracker 220 may include a plurality of light emitting elements 224 and a plurality of sensing elements 225. The light emitting assembly 224 may be the same or similar to the light emitting assembly 124 of the previous embodiments. The sensing component 225 may be the same or similar to the sensing component 125 of the previous embodiment.
In this embodiment, the light emitting elements 224 may surround the light coupling element 114, and the sensing elements 225 may be arranged in a cross shape.
Fig. 3 is a schematic partial front view of a head-mounted eye tracking system according to a third embodiment of the present invention.
In the embodiment, the head-mounted eye tracking system 300 includes a light combiner 110 and an eye tracker 320. The eye tracker 320 may include a plurality of light emitting elements 324 and a plurality of sensing elements 325. The light emitting assembly 324 may be the same or similar to the light emitting assembly 124 of the previous embodiment. The sensing component 325 may be the same or similar to the sensing component 125 of the previous embodiments.
In the present embodiment, a portion of the light emitting elements 324 and a portion of the sensing elements 325 may be arranged in a staggered manner in the first arrangement direction D1, a portion of the light emitting elements 324 and a portion of the sensing elements 325 may be arranged in a staggered manner in the second arrangement direction D2, and the light emitting elements 324 and the sensing elements 325 may be arranged in an array manner in a staggered manner.
Fig. 4 is a schematic partial front view of a head-mounted eye tracking system according to a fourth embodiment of the present invention.
In the embodiment, the head-mounted eye tracking system 400 includes a light combiner 110 and an eye tracker 420. Eye tracker 420 may include a plurality of light emitting elements 424 and a plurality of sensing elements 425. The light emitting assembly 424 may be the same or similar to the light emitting assembly 124 of the previous embodiments. The sensing component 425 may be the same or similar to the sensing component 125 of the previous embodiment.
In the present embodiment, the plurality of light emitting elements 424 may surround the sensing elements 425 and the optical coupling element 114, and the plurality of sensing elements 425 may be arranged in an array (array).
Fig. 5 is a schematic partial front view of a head-mounted eye tracking system according to a fifth embodiment of the invention.
In the present embodiment, the head-mounted eye tracking system 500 includes a light combiner 110 and an eye tracker 520. Eye tracker 520 may include a plurality of light emitting elements 524 and a plurality of sensing elements 525. The light emitting elements 524 may be the same or similar to the light emitting elements 124 of the previous embodiments. The sensing component 525 may be the same or similar to the sensing component 125 of the previous embodiment.
In the present embodiment, the light emitting elements 524 and/or the sensing elements 525 may be disposed on the frame 162.
In this embodiment, a plurality of light emitting elements 524 or a plurality of sensing elements 525 may surround the light coupling 114.
Fig. 6A is a schematic top view of a portion of a head-mounted eye tracking system according to a sixth embodiment of the invention. Fig. 6B is a schematic partial front view of a head-mounted eye tracking system according to a sixth embodiment of the present invention.
In the present embodiment, the head-mounted eye tracking system 600 includes a light combiner 610 and an eye tracker 620. The eye tracker 620 may include a plurality of light emitting elements (not directly shown, which may be the same as or similar to the light emitting elements 124 of the previous embodiments) and a plurality of sensing elements 625. The light combiner 610 includes a light coupling 614. The light coupling 614 can include a grating coupling.
In this embodiment, the head-mounted eye tracking system 600 may further include a signal processor 650. The signal processor 650 may be signally connected to the eye tracker 620. For example, optical signals or corresponding electronic signals received by the sensing element 625 of the eye tracker 620 may be transmitted to the signal processor 650. For example, the signal processor 650 may transmit an electrical signal to a light emitting element (not shown directly, and may be the same as or similar to the light emitting element 124 of the previous embodiments) to drive the light emitting element to emit light.
In the embodiment, the signal processor 650 may be connected to the eye tracker 620 via a signal line 652 in the component layer 651 by wired signal transmission (wired signal transmission), but the invention is not limited thereto.
In fig. 6A and 6B, the signal connection between the signal processor 650 and a part of the sensing component 625 is only exemplarily shown, but the invention is not limited thereto.
In one embodiment, the signal processor 650 may include a processing chip, but the present invention is not limited thereto. For example, the signal processor 650 may include a computer or other processing system (e.g., a cloud processing system).
In the present embodiment, the device layer 651 may include a corresponding conductive film layer, an insulating film layer and/or a semiconductor film layer. The conductive film, the insulating film and/or the semiconductor film may form corresponding active devices, passive devices and/or lines (e.g., the signal line 652).
In the present embodiment, the signal line 652 may be formed of at least a part of the conductive pattern in the component layer 651, but the present invention is not limited thereto. In other words, the signal line 652 may include a portion of the conductive pattern in the assembly layer 651 (e.g., a conductive film layer included in the assembly layer 651). The conductive pattern may be on the light-transmitting substrate 161. In this embodiment, the conductive pattern and the sensing component 625 may be located on the same side of the transparent substrate 161.
In the present embodiment, the layers, elements and/or wires (layout) in the device layer 651 can be formed or disposed by conventional methods in the art, which are not described herein.
Fig. 7 is a schematic partial front view of a head-mounted eye tracking system according to a seventh embodiment of the invention. The head-mounted eye tracking system 700 of the present embodiment is similar to the head-mounted eye tracking system 600 of the sixth embodiment, and similar components are denoted by the same reference numerals and have similar functions, and the description thereof is omitted. Additionally, for clarity, not all of the sensing components 625, signal lines 652, and/or processing components 753 are labeled or illustrated individually in FIG. 7.
In the present embodiment, the head-mounted eye tracking system 700 includes a light combiner (not directly shown, and may be the same as or similar to the light combiner 110 or the light combiner 610 of the previous embodiments), an eye tracker 620, and a signal processor 750.
In the present embodiment, the signal processor 750 may be similar to the signal processor 650 of the previous embodiments. The signal processor 750 may also include processing components 753. The processing component 753 can be signally (or; electrically) connected to a corresponding sensing component 625 and/or light-emitting component (not directly shown, and can be the same as or similar to the light-emitting component 124 of the previous embodiments). The processing component 753 can include, for example, an IC or a μ IC, although the invention is not limited thereto.
In this embodiment, the processing component 753 may be disposed on the transparent substrate 161, and the processing component 753 of the signal processor 750 may be disposed between the light combiner 610 and the sensing component 625 (shown in fig. 6A).
In the embodiment, the processing component 753 of the signal processor 750 may at least partially overlap the sensing component 625 of the eye tracker 620, but the invention is not limited thereto.
Fig. 8 is a schematic partial front view of a head-mounted eye tracking system according to an eighth embodiment of the present invention. The head-mounted eye tracking system 800 of the present embodiment is similar to the head-mounted eye tracking system 700 of the seventh embodiment, and similar components are denoted by the same reference numerals and have similar functions, and the description thereof is omitted. Additionally, for clarity, not all of the sensing components 625, signal lines 652, and/or processing components 753 are labeled or illustrated individually in FIG. 8.
In this embodiment, the processing element of the signal processor 750 may not overlap the sensing element 625 of the eye tracker 620. That is, the processing element of the signal processor 750 may be remote from the sensing element 625 of the eye tracker 620.
Fig. 9A is a schematic top view of a portion of a head-mounted eye tracking system according to a ninth embodiment of the invention. Fig. 9B is a schematic perspective view of a portion of a head-mounted eye tracking system according to a ninth embodiment of the invention. Fig. 9C is a schematic front view of a portion of a head mounted eye tracking system according to a ninth embodiment of the present invention. The head-mounted eye tracking system 900 of the present embodiment is similar to the head-mounted eye tracking system 100 of the first embodiment, and similar components are denoted by the same reference numerals and have similar functions, and the description thereof is omitted. In addition, for clarity, not all of the light emitting devices 924 and/or the sensing devices 925 are labeled or shown in fig. 9A-9C.
Referring to fig. 9A to 9C, in the present embodiment, the head-mounted eye tracking system 900 includes a light combiner 110, an eye tracker 920, and a display 930. The eye tracker 920 may include a plurality of light emitting components 924 and a plurality of sensing components 925. The light emitting assembly 924 can be the same or similar to the light emitting assembly 124 of the previous embodiments. The sensing component 925 can be the same or similar to the sensing component 125 of the previous embodiments. Display 930 may be similar to display 130 of the previous embodiments.
In this embodiment, the light emitting device 924 and the sensing device 925 of the eye tracker 920 may be disposed at different positions. That is, the light emitting component 924 and the sensing component 925 of the eye tracker 920 may be remote from each other. For example, the sensing element 925 of the eye tracker 920 may be disposed on the light combiner 110, and the light emitting element 924 of the eye tracker 920 may be disposed on the display 930. The tracking light beam 924R emitted from the light emitting assembly 924 of the eye tracker 920 may be directed to the light combiner 110 via a suitable light guide 140. The external light beam ER, the display light beam 930R and the tracking light beam 924R can be irradiated to the eyeball 91 of the wearer 90 through the optical coupler 114 of the optical combiner 110.
In the embodiment, the display component 931 of the display 930 and the light emitting component 924 of the eye tracker 920 may be arranged in an array (array), but the invention is not limited thereto.
In the embodiment, the light emitting element 924 of the eye tracker 920 may not be disposed on the light combiner 110, but the invention is not limited thereto.
In the present embodiment, the sensing element 925 of the eye tracker 920 surrounds the optical coupling 114, but the invention is not limited thereto.
Fig. 10 is a schematic partial front view of a head-mounted eye tracking system according to a tenth embodiment of the invention. The head-mounted eye tracking system 1000 of the present embodiment is similar to the head-mounted eye tracking system 900 of the ninth embodiment, and similar components are denoted by the same reference numerals and have similar functions, and the description thereof is omitted. In addition, for clarity, not all of the sensing elements 1025 are labeled or shown individually in FIG. 10.
In the present embodiment, the head-mounted eye tracking system 1000 includes a light combiner 110, an eye tracker 1020, and a display (not directly shown, which may be the same as or similar to the display 930 of the previous embodiment). The eye tracker 1020 may include a plurality of light emitting elements (not shown directly, which may be the same as or similar to the light emitting elements 924 of the previous embodiments) and a plurality of sensing elements 1025. The sensing component 1025 may be the same as or similar to the sensing component 125 of the previous embodiment.
In this embodiment, the plurality of sensing elements 1025 may be arranged in a cross shape.
Fig. 11 is a schematic partial front view of a head-mounted eye tracking system according to an eleventh embodiment of the invention. The head-mounted eye tracking system 1100 of the present embodiment is similar to the head-mounted eye tracking system 900 of the ninth embodiment, and similar components are denoted by the same reference numerals and have similar functions, and the description thereof is omitted. In addition, for clarity, not all of the sensing components 1125 are labeled or illustrated individually in fig. 11.
In the present embodiment, the head-mounted eye-tracking system 1100 includes the light combiner 110, the eye tracker 1120, and a display (not shown directly, which may be the same as or similar to the display 930 of the previous embodiment). The eye tracker 1120 may include a plurality of light emitting assemblies (not directly shown, and may be the same as or similar to the light emitting assemblies 924 of the previous embodiments) and a plurality of sensing assemblies 1125. The sensing component 1125 may be the same or similar to the sensing component 125 of the previous embodiment.
In this embodiment, the sensing elements 1125 may be arranged in an array (array).
Fig. 12 is a schematic partial front view of a head-mounted eye tracking system according to a twelfth embodiment of the invention. The head-mounted eye tracking system 1200 of the present embodiment is similar to the head-mounted eye tracking system 900 of the ninth embodiment, and similar components are denoted by the same reference numerals and have similar functions, and the description thereof is omitted. In addition, for clarity, not all of the sensing elements 1225 are labeled or illustrated individually in FIG. 12.
In the present embodiment, the head-mounted eye tracking system 1200 includes the light combiner 110, the eye tracker 1220, and a display (not directly shown, which may be the same as or similar to the display 930 of the previous embodiment). The eye tracker 1220 may include a plurality of light emitting assemblies (not directly shown, and may be the same as or similar to the light emitting assemblies 924 of the previous embodiments) and a plurality of sensing assemblies 1225. The sensing assembly 1225 may be the same or similar to the sensing assembly 125 of the previous embodiment.
In this embodiment, a plurality of sensing assemblies 1225 may be disposed on the frame 162.
In this embodiment, a plurality of sensing elements 1225 can surround the optical coupling 114.
In summary, the head-mounted eye tracking system of the present invention is suitable for sensing the eyeball of the wearer.
In summary, in the head-mounted eye tracking system of the present invention, the eye tracker can track the movement of the eyeball without imaging. Therefore, the sampling frequency of the sensing device can be correspondingly increased, the power consumption of the head-mounted eye tracking system during operation can be reduced, and the integration with other devices can be increased.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (11)
1. A head-mounted eye tracking system, comprising:
a light combiner comprising a light coupling element;
an eye tracker disposed at least partially on the light combiner and adapted to sense an eyeball of a wearer, the eye tracker comprising:
a plurality of light emitting assemblies adapted to emit a tracking light beam; and
a plurality of sensing elements adapted to receive the tracking light beam reflected via the eyeball of the wearer; and
and the signal processor is in signal connection with the eye tracker.
2. The head-mounted eye tracking system of claim 1, further comprising:
a display adapted to emit a display light beam, wherein the display light beam is irradiated to the eyeball of the wearer via the light combiner.
3. The head-mounted eye tracking system of claim 2, wherein the plurality of sensing elements are disposed on the light combiner and the plurality of light emitting elements are disposed on the display.
4. The head-mounted eye tracking system of claim 1, wherein the plurality of light emitting elements or the plurality of sensing elements are disposed on the light combiner.
5. The head-mounted eye tracking system of claim 1, wherein a spacing between adjacent two of the plurality of sensing assemblies is between 1mm and 30 mm.
6. The head-mounted eye tracking system of claim 1, wherein the plurality of light emitting elements or the plurality of sensing elements at least partially overlap the light coupling.
7. The head-mounted eye tracking system of claim 1, wherein the plurality of light emitting assemblies or the plurality of sensing assemblies encircle the light coupling.
8. The head-mounted eye tracking system of claim 1, wherein the plurality of light emitting elements or the plurality of sensing elements are arranged in an array.
9. The system of claim 1, wherein a portion of the plurality of light emitting elements and a portion of the plurality of sensing elements are staggered with respect to each other in the first arrangement direction.
10. The head-mounted eye tracking system of claim 9, wherein a portion of the plurality of light emitting elements and a portion of the plurality of sensing elements are staggered with respect to each other in a second alignment direction perpendicular to the first alignment direction.
11. The head-mounted eye tracking system of claim 1, wherein at least one of the plurality of light emitting elements and at least one of the plurality of sensing elements are integrated into one sensing unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011580625.1A CN114690403A (en) | 2020-12-28 | 2020-12-28 | Head-mounted eye movement tracking system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011580625.1A CN114690403A (en) | 2020-12-28 | 2020-12-28 | Head-mounted eye movement tracking system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114690403A true CN114690403A (en) | 2022-07-01 |
Family
ID=82130353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011580625.1A Pending CN114690403A (en) | 2020-12-28 | 2020-12-28 | Head-mounted eye movement tracking system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114690403A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108572447A (en) * | 2017-03-13 | 2018-09-25 | 宏达国际电子股份有限公司 | Head-mounted display apparatus, object follow-up mechanism and its object method for tracing |
| CN108604116A (en) * | 2015-09-24 | 2018-09-28 | 托比股份公司 | It can carry out the wearable device of eye tracks |
| WO2018215272A1 (en) * | 2017-05-23 | 2018-11-29 | Koninklijke Philips N.V. | Safety improvement for uv applications by monitoring changes in uv outcoupling |
| US10698483B1 (en) * | 2019-04-22 | 2020-06-30 | Facebook Technologies, Llc | Eye-tracking systems, head-mounted displays including the same, and related methods |
| US20200271936A1 (en) * | 2019-02-22 | 2020-08-27 | Facebook Technologies, Llc | Near-eye display system having optical combiner |
| CN111781722A (en) * | 2020-07-01 | 2020-10-16 | 业成科技（成都）有限公司 | Eyeball tracking structure, electronic device and intelligent glasses |
| CN112014975A (en) * | 2020-10-12 | 2020-12-01 | 业成科技（成都）有限公司 | Head-mounted display |
-
2020
- 2020-12-28 CN CN202011580625.1A patent/CN114690403A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108604116A (en) * | 2015-09-24 | 2018-09-28 | 托比股份公司 | It can carry out the wearable device of eye tracks |
| CN108572447A (en) * | 2017-03-13 | 2018-09-25 | 宏达国际电子股份有限公司 | Head-mounted display apparatus, object follow-up mechanism and its object method for tracing |
| WO2018215272A1 (en) * | 2017-05-23 | 2018-11-29 | Koninklijke Philips N.V. | Safety improvement for uv applications by monitoring changes in uv outcoupling |
| US20200271936A1 (en) * | 2019-02-22 | 2020-08-27 | Facebook Technologies, Llc | Near-eye display system having optical combiner |
| US10698483B1 (en) * | 2019-04-22 | 2020-06-30 | Facebook Technologies, Llc | Eye-tracking systems, head-mounted displays including the same, and related methods |
| CN111781722A (en) * | 2020-07-01 | 2020-10-16 | 业成科技（成都）有限公司 | Eyeball tracking structure, electronic device and intelligent glasses |
| CN112014975A (en) * | 2020-10-12 | 2020-12-01 | 业成科技（成都）有限公司 | Head-mounted display |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9807381B2 (en) | Imaging structure emitter calibration | |
| US11056032B2 (en) | Scanning display systems with photonic integrated circuits | |
| US9368546B2 (en) | Imaging structure with embedded light sources | |
| US9779643B2 (en) | Imaging structure emitter configurations | |
| US9726887B2 (en) | Imaging structure color conversion | |
| US10886702B2 (en) | Vertical-cavity surface-emitting laser for near-field illumination of an eye | |
| US10942349B2 (en) | Illumination assembly with in-field micro devices | |
| KR20190106856A (en) | Electronic device | |
| JP2014082185A (en) | Backlight unit for display device and driving method thereof | |
| US9798147B1 (en) | Near-eye display with phase map | |
| KR102346623B1 (en) | Head-Up display | |
| TWI816830B (en) | Light emission apparatus | |
| CN114690403A (en) | Head-mounted eye movement tracking system | |
| TWI768623B (en) | Head-mounted eye tracking system | |
| EP3614193A1 (en) | Illumination assembly with in-field micro devices | |
| CN111783660B (en) | Eye movement tracking device and electronic device using same | |
| CN113589527B (en) | Augmented reality glasses based on micro LED display | |
| US20240027755A1 (en) | Head-mounted eye tracking system | |
| US11727891B2 (en) | Integrated electronic and photonic backplane architecture for display panels | |
| CN111919518A (en) | Edge-emitting LED with enhanced illumination | |
| CN113692784A (en) | Spacer for surface-mountable electronic components | |
| US20240192488A1 (en) | Electronic Device With Protected Light Sources | |
| CN220232107U (en) | Eye movement tracking system and glasses | |
| US20240192496A1 (en) | Virtual image display device and head-mounted display apparatus | |
| CN113589940A (en) | Human eye tracking system and virtual reality display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |