WO2022243185A1 - Eye tracking - Google Patents

Eye tracking Download PDF

Info

Publication number
WO2022243185A1
WO2022243185A1 PCT/EP2022/063018 EP2022063018W WO2022243185A1 WO 2022243185 A1 WO2022243185 A1 WO 2022243185A1 EP 2022063018 W EP2022063018 W EP 2022063018W WO 2022243185 A1 WO2022243185 A1 WO 2022243185A1
Authority
WO
WIPO (PCT)
Prior art keywords
laser
eye
cornea
tracking device
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2022/063018
Other languages
French (fr)
Inventor
Ioannis Papadopoulos
Daniel NAJER
Volker ZAGOLLA
Ferran Suarez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ams International AG
Original Assignee
Ams International AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ams International AG filed Critical Ams International AG
Priority to CN202280051291.XA priority Critical patent/CN117813540A/en
Priority to DE112022002732.0T priority patent/DE112022002732T5/en
Priority to US18/562,509 priority patent/US12455447B2/en
Priority to JP2023571964A priority patent/JP2024522341A/en
Priority to KR1020237043420A priority patent/KR20240009468A/en
Publication of WO2022243185A1 publication Critical patent/WO2022243185A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/50Systems of measurement based on relative movement of target
    • G01S17/58Velocity or trajectory determination systems; Sense-of-movement determination systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481Constructional features, e.g. arrangements of optical elements
    • G01S7/4811Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/09Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
    • G02B27/0938Using specific optical elements
    • G02B27/095Refractive optical elements
    • G02B27/0955Lenses
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/09Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
    • G02B27/0938Using specific optical elements
    • G02B27/0977Reflective elements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Definitions

  • the present disclosure relates to eye tracking devices, in particular devices for integrating in a frame for mounting to a user’s head, for example in AR smart glasses.
  • Eye tracking is an important user side sensing modality that can enable a diverse set of applications in e.g. Augmented Reality (AR) applications.
  • AR Augmented Reality
  • Eye tracking sensing modalities rely on imaging of the eye and cornea using an imaging sensor and the identification of the gaze vector based on data processing of the acquired image. Such approaches tend to be of high power consumption, low accuracy, and/or slow data collection. Equally important is that the placement of the imaging sensor is chosen in a way to maximize the quality of the acquired data, leading to placements that are obstructing the field of view in the bearing device.
  • An ideal eye tracking solution should have low power consumption, be accurate, fast, and have a small form factor with a simple integration in the bearing device. Current systems cannot provide all of these features together.
  • a device that uses laser light to measure the distance of specific points on the cornea and uses this information to infer the rotational position of the eye.
  • an eye tracking device for integrating in a frame for mounting to a user’s head (e.g. smart glasses, AR headset, VR headset, helmet or similar) comprising a laser output unit for fixing to the frame and configured to provide a laser beam for illuminating a cornea of the user’s eye when in use.
  • the device further comprises a receiver unit (which may be the same as the laser output unit when using SMI) for fixing to the frame and configured to receive a reflection of the laser beam and to provide, a tracking signal usable for determining a distance or velocity of the cornea, and a processing unit for determining a rotation of the user’s eye from the tracking signal.
  • the eye-tracking device does not require imaging of the eye.
  • the eye-tracking device provides at least two spatially separated laser beams for illuminating different points on the cornea of the user’s eye, wherein the receiver unit is configured to receive reflections from both laser beams and, for each of the received reflections, provide a tracking signal usable for determining the distance or velocity of the respective points of the cornea.
  • the receiver unit is configured to receive reflections from both laser beams and, for each of the received reflections, provide a tracking signal usable for determining the distance or velocity of the respective points of the cornea.
  • the receiver unit is configured to receive reflections from both laser beams and, for each of the received reflections, provide a tracking signal usable for determining the distance or velocity of the respective points of the cornea.
  • the receiver unit is configured to receive reflections from both laser beams and, for each of the received reflections, provide a tracking signal usable for determining the distance or velocity of the respective points of the cornea.
  • the receiver unit is configured to receive reflections from both laser beams and, for each of the received reflections, provide a
  • the beams can be distributed symmetrically on the cornea of the user’s eye.
  • three laser beams may illuminate three points on the cornea of forming an equilateral triangle.
  • other distributions of the laser beam illumination on the cornea may be appropriate.
  • a non-symmetrical distribution may be used for some applications.
  • a laser source is used by itself or together with an optical element to produce an illumination field over the eye and in particular the cornea.
  • a specific position on the cornea surface will produce a reflection of this illumination field that can be detected.
  • the cornea is a spherical surface offset from the rotation point of the eye, any rotation of the eye will lead to a displacement of the cornea. This links the cornea target point displacement measured with the laser signal to the rotation of the eye.
  • the proposed method infers the eye rotation from the relative distance change of a specific point on the cornea, any eye rotation within a given cone around the starting position leads to the same distance change and therefore an uncertainty between measurement and rotation.
  • at least three laser beams with different positions may be used.
  • the laser output unit typically comprises a laser source (one for each laser beam), such as laser diodes, e.g. edge emitting lasers, distributed feedback (DFB) lasers, distributed bragg reflector (DBR) lasers, or vertical cavity surface emitting lasers (VCSELs).
  • the laser output unit may comprise an optic waveguide connected to a laser source.
  • the waveguide would typically be a single wave mode fibre optic waveguide.
  • the laser output unit may comprise multiple waveguides connected to respective laser sources for providing multiple (typically three) laser beams.
  • the actual laser sources may be located off the integrating device (i.e. off the frame) but connected to the device via the waveguides.
  • the laser source should be very monochromatic (narrowband) and have high coherence for accurate distance/displacement measurements.
  • VCSELs have the advantage of being relatively cheap and have low power consumption.
  • the laser sources may be configured to operate at a wavelength in the infrared or near infrared spectra.
  • the laser sources may be configured to emit light having a wavelength in the range of 850 nm to 1500 nm, e.g. at 940 nm. Longer wavelengths are typically better in terms of eye safety, and can therefore be used with a relatively higher output power, which may provide a better signal.
  • the laser output unit is also the receiver unit and the tracking signal(s) are provided by measuring the phase difference between the emitted and the received laser beam.
  • SMI self-mixing interferometry
  • SMI allows for accurate distance/displacement measurements without requiring additional photodiodes for receiving the reflected light.
  • a portion of the illumination light is reflected off the cornea surface and makes its way back to each respective laser source.
  • the reflected light coupled back into the laser cavity interferes with the original laser light leading to a modulation of the laser emission characteristics. Measuring the changes in the laser emission characteristics (e.g.
  • each tracking signal can provide information about the relative position change of the remote target (specific points on the cornea surface).
  • SMI may use optical detection, wherein each tracking signal is determined from an optical output of the respective laser source.
  • a photodiode may be placed close to the laser source and measure the output intensity of the laser source.
  • the photodiode may be integrated in the laser epitaxy or may be located behind the laser source and arranged to monitor the power output on the laser mirror opposite to the eye emission.
  • each tracking signal may be determined from a current or voltage input to the respective laser source.
  • the SMI affects the laser output it also affects the power supply to the laser source, which can be measured to determine the distance/displacement.
  • the spatially separated laser beams may be separated by an angular distance in the range of 3.5° to 20° on the cornea of the user’s eye when in use.
  • the laser beams may be separate by a minimum angular distance of about 17°.
  • Other values of the angular distance of laser sources are also possible and may depend on the number of laser beams used.
  • the spatially separated laser beams may contain a number of laser beams in the range of 3 to 12. Whilst three laser beams (from three laser sources) can provide accurate eye tracking, more beams may be used to improve eye tracking or to provide redundancy in the system (e.g. should one laser source fail). However, a greater number of sources may increase the complexity and power consumption of the device.
  • the device may further comprises one or more optical elements fixed to the frame and configured to modulate the laser beams illuminating the cornea.
  • the one or more optical elements may be collimating lenses for providing plane wave illumination of the cornea.
  • the one or more optical elements may be focusing lenses for focusing the laser beams on the cornea.
  • the optical elements may be reflective lenses.
  • the laser output unit can then be fixed to the stem of the frame running a long a side of the user’s head.
  • the one or more optical elements may be transmission lenses.
  • the laser output unit may for example be placed in front of the user’s eye.
  • the laser can be used with the optical element(s) to create any range of illumination fields onto the cornea surface, from a plane wave illumination to a single focus spot on the cornea surface. For example, this can be achieved by changing the distance between the lens and the laser source.
  • the spherical surface of the cornea will reflect some part of the light back, which interacting with the same or a different optical element will be redirected towards the receiving unit (back to the laser when using SMI).
  • the depth changes of the remote target can be inferred and linked to the rotation of the eye.
  • the optical element(s) may comprise any of volume-phase holographic (VPH), liquid crystal polarization grating (LCPG), and hot mirror etc.
  • a method of eye tracking which may be implemented with the eye-tracking device according to the first aspect.
  • the method comprises mounting a frame to a user’s head (e.g. putting the glasses on, illuminating a cornea of the user’s eye with a laser beam provided by a laser output unit fixed to the frame, and receiving a reflection of the laser beam with a receiver unit fixed to the frame and providing a tracking signal (e.g. an SMI signal) usable for determining a distance to the cornea or a velocity of the cornea.
  • the method further comprises determining with a processing unit a rotation of the user’s eye from the tracking signals.
  • the method of eye-tracking does not require imaging of the eye.
  • At least three spatially separated laser beams are used to provide at least three tracking signals, which can be used together to determine the rotation of the user’s eye.
  • the disclosure provides an eye-tracking solution that uses a small number of illumination and detection elements leading to a low complexity solution.
  • the sensing module can be flexibly placed on different positions of the device (e.g. on the stem) allowing for unobtrusive eye-tracking. Reduced data collection (due to signal read-out from a limited numbers of photodiodes) can lead to increased data rates.
  • Figure 1 depicts smart glasses comprising an eye-tracking device according to an embodiment of the disclosure
  • Figure 2 depicts a part of an eye tracking device according to an embodiment
  • Figure 3 depicts a part of an eye tracking device according to an embodiment when in use
  • Figure 4 depicts a laser beam reflected from the cornea of the eye
  • Figure 5a depicts a part of an eye tracking device comprising a collimating transmission lens
  • Figure 5b depicts a part of an eye tracking device comprising a weakly focusing transmission lens
  • Figure 5c depicts a part of an eye tracking device comprising a strongly focusing transmission lens
  • Figure 6a depicts a part of an eye tracking device comprising a collimating reflective lens
  • Figure 6b depicts a part of an eye tracking device comprising a weakly focusing reflective lens
  • Figure 6c depicts a part of an eye tracking device comprising a strongly focusing reflective lens
  • Figure 7 depicts a graph plotting the position of a reflected laser beam on a VCSEL laser source against the position on a reflective lens
  • Figure 8 depicts a part of an eye-tracking device comprising a holographic optical element (HOE) mirror;
  • HOE holographic optical element
  • Figure 9 depicts the optical path difference (OPD) due to a 20° rotation of the eye
  • Figure 10 depicts the contour lines of OPD for one laser source
  • Figure 11 depicts a graph plotting the accuracy of measurements of rotation against the direction of rotation for one laser source
  • Figure 12 depicts the contour lines of OPD for two laser sources
  • Figure 13 depicts a graph plotting the accuracy of measurements of rotation against the direction of rotation for two laser sources
  • Figure 14 depicts the contour lines of OPD for three laser sources
  • Figure 15 depicts a graph plotting the accuracy of measurements of rotation against the direction of rotation for three laser sources
  • Figure 16 depicts graph of the minimum accuracy for rotation in any direction using a three laser source configuration with 17° angular distance between laser beams and for any rotation position of the eye from -30° to 30° about the x and y axes;
  • Figure 17 depicts the contour lines of OPD for three laser sources separated by an angular distance of 3.5°.
  • Figure 18 depicts graph of the minimum accuracy for rotation in any direction using a three laser source configuration with 3.5° angular distance between laser beams and for any rotation position of the eye from -30° to 30° about the x and y axes.
  • Figure 1 shows an eye tracking device 1 integrated in a pair of glasses (e.g. AR smart glasses) comprising a frame 2 having a stem 3.
  • the device 1 comprises a laser output unit 4 comprising three laser sources being VCSEL lasers, and an optical element 5 for modulating laser beams 6 from the laser output unit 4.
  • the optical element 5 is a reflecting and collimating lens (e.g. a Bragg reflector), which provides a plane wave illumination field on the cornea 7 of the eye 8 of the user/wearer of the glasses. A part of the laser beam 6 is reflected back from the cornea 7 and into the laser output unit 4.
  • the laser output unit 4 is also a receiver unit for receiving the reflected light.
  • the reflected light interferes with the laser field in the laser source through so called self mixing interference, which changes the output of the laser.
  • self mixing interference By monitoring the output intensity of the laser or the input voltage or input current to the laser source, the distance to the cornea 7 and/or the velocity of the cornea 7 can be determined.
  • the device 1 comprises a processing unit 9 for determining the distance to the cornea 7 based on self mixing interferometry (SMI).
  • SI self mixing interferometry
  • at least three angularly separated laser beams 6 are used.
  • the device 1 also comprises a second optical element 10 being a mirror for redirecting the laser beams 6 from the laser output unit 4. Further optical elements can provide greater flexibility in the placement of the laser output unit 4.
  • the laser output unit 4 may be placed in the frame in front of the eye 8 and transmit the laser beams 6 directly onto the cornea 7, without requiring a reflective element. Also, it is not necessary to have the laser sources in the laser output unit 4. Instead the laser sources may be placed off the device and be connected to waveguides for transmitting the laser beams 6.
  • the embodiment provides an eye-tracking device 1 with a small number of illumination and detection devices to measure the relative depth change of specific points on the cornea 7 and use this information to infer the gaze direction of the eye 8.
  • the SMI signal used to detect the depth change of each point can be measured, with an integrated photodiode in the laser source, or via direct measurement of the gate voltage.
  • the use of laser illumination and detection enables the combination of the sensing module with highly transparent and efficient reflective optical components placed in the eyepiece. It is exactly this that allows the flexible placement of the sensing module within the stem 3 of head wearable devices.
  • the combination of SMI detection (capable of measuring very small depth changes of the point of interest) together with the placement of the various illumination and detection sources in a particular geometry enables very high accuracy over the full eye rotation space.
  • the solution comprising of a minimum of three sources (each one being potentially a lower power consuming VCSEL) leads to an overall low power consumption.
  • Figure 2 shows a schematic diagram of a diverging laser beam 6 reflected from a holographic elliptical mirror 11 to provide a plane wave illumination field 12 on a target 13 (e.g. the cornea of a user’s eye).
  • the holographic elliptical mirror 11 may be used as an optical element in the eye-tracking device 1 of Figure 1 to provide plane wave illumination.
  • the same reference numerals have been used to refer to equivalent or similar features in different figures for clarity, and are not intended to limit the illustrated embodiments.
  • Figure 3 shows a laser beam 6 with an optical element 5 being a reflective lens for illuminating the cornea 7 of an eye 8.
  • the optical element may be a holographic elliptical mirror (HOE) as illustrated in Figure 2 to provide a plane wave.
  • Figure 4 shows a reflected laser beam 14.
  • the laser beam 14 is reflected from the cornea 7. Due to the curvature of the cornea, the reflected laser beam 14 is diverging.
  • the reflected laser beam 14 may be a reflection of the laser beam 6 illustrated in Figure 3.
  • Figures 5a to 5c show a part of an eye-tracking device according to embodiments having a laser output unit 4 and an optical element 5 being a transmission lens (as opposed to a reflective lens).
  • the optical element provides a illumination field on the cornea 7 of the eye 8.
  • Figure 5a shows an embodiment with a collimating lens, which provides plane wave illumination 15.
  • Figure 5b shows an embodiment with a weakly focusing lens, with a focus behind the surface of the cornea 7, providing a weakly focused illumination 16.
  • Figure 5c shows an embodiment with a strongly focusing lens, with a focus substantially on the surface of the cornea 7, to provide strongly focused illumination 17.
  • Figures 6a to 6c show a part of an eye-tracking device according to embodiments having a laser output unit 4 and an optical element 5 being a reflective lens.
  • the laser output unit 4 provides a laser beam 6 which is modulated by the optical element to provide an illumination field on the cornea 7 of the eye 8.
  • Figure 6a shows an embodiment with a collimating lens, which provides plane wave illumination 15.
  • Figure 6b shows an embodiment with a weakly focusing lens, with a focus behind the surface of the cornea 7, providing a weakly focused illumination 16.
  • Figure 6c shows an embodiment with a strongly focusing lens, with a focus substantially on the surface of the cornea 7, to provide strongly focused illumination 17.
  • Figure 7 shows a graph plotting the position of reflected laser light on the VCSEL laser source against the position of reflected laser light on the optical element being a holographic optical mirror (HOE).
  • Two lines 18 and 19 are plotted for positions along the x-axis 18 and the y-axis 19 respectively.
  • Figure 8 illustrates the diverging laser beam 20 reflected from the cornea 7 of the eye 8 and incident on the VCSEL laser source 21 via the HOE 22. Because of the curvature of the cornea 7, the reflected light is diverging and ends up illuminating a relatively large area on the VCSEL plane (see Figure 7).
  • the power ratio is given by the diffracting aperture divided by the full illumination aperture, wherein the full illumination aperture is defined by the eye rotation range and interpupillary distance (I PD) range that is covered.
  • the power ratio is given by:
  • simulations can be used to determine a frequency for which the SMI signal will be above the noise floor.
  • the frequency of the signal is the inverse of the measurement time (the time “looking” at the signal) for determining the distance/velocity.
  • the noise is proportional to the bandwidth or to the square root of the bandwidth. Hence, the faster the measurement, the bigger the bandwidth and also the noise.
  • the power ratio may be increased by a factor of 4 to 8.
  • using focusing optics can increase complexity and potentially affect the fitting requirements (e.g. inter-pupillary distance, eye relief, nose height, ear position etc.).
  • Figure 9 illustrates how rotation of the eye 8 changes the optical path when using plane wave illumination, which thereby gives rise to a measurable signal.
  • the change in distance of the optical path (the optical path difference, OPD) of the reflected laser beams 6a and 6b between the cornea 7 and the receiver unit depends on the angle of rotation a and can therefore be measured to determine the eye rotation.
  • Figure 10 shows how the OPD changes with the angle of rotation.
  • contour lines 23 OPD are shown, for which the OPD is constant.
  • a star indicates an arbitrary position 24 in rotation space of the eye, and arrows indicate possible directions of rotation of the eye.
  • the central point 25 indicates the position of the laser illumination on the cornea. The most accurate measurements (corresponding to the largest OPD) are possible for rotation in a direction perpendicular to the contour lines 23. Conversely, rotation following the tangent of the contour lines 23 does not change the OPD and therefore has the worst accuracy.
  • the accuracy as a function of the angle of rotation from any given position is illustrated in Figure 11.
  • the accuracy can be defined as the smallest determinable change in angle, so that a large number indicates a poor accuracy (low resolution) and a small number indicates a good accuracy (high resolution).
  • the accuracy as a function of the angle of rotation can be expressed by the following equation:
  • Figures 12 and 13 show the OPD contour lines 23 and corresponding accuracy plot for two laser sources providing two spatially separated laser beams for illuminating the cornea. As can be seen from the graph in Figure 13, by using two sources as shown, the accuracy of at least one source will always be less than 0.25 degrees (indicated by the dashed line).
  • Figures 14 and 15 shows the OPD contour lines 23 and corresponding accuracy for a configuration comprising three laser sources. Each laser beam is separated by an angle of 17°, which provides an accuracy of less than approximately 0.05 degrees in all directions from any position on the cornea.
  • Figure 16 plots the minimum accuracy for rotation in any direction using the three laser source configuration with 17° angle between laser beams for any rotation position of the eye from -30° to 30° about the x and y axes. As can be seen from the plot, only relatively small regions have a minimum accuracy worse than 0.05 degrees for movement/rotation in any direction.
  • Figure 17 shows the OPD contour lines 23 for a device providing three laser beams separated by an angular distance of 3.5°.
  • Figure 18 shows a corresponding plot of the minimum accuracy for rotation in any direction from any rotational position of the eye within -30° to 30° about the x and y axes.
  • the accuracy is not as good as for the 17° configuration of three sources.
  • the minimum accuracy is approximately 0.25 degrees (compared to 0.05 degrees for the 17° configuration). Hence, reducing the angle between the laser sources worsens the accuracy.
  • Processing unit 22 Holographic optical element (HOE)

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Eye Examination Apparatus (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An eye tracking device (1) for integrating in a frame (2) for mounting to a user's head comprises a laser output unit (4) for fixing to the frame and configured to provide a laser beam (6) for illuminating a cornea (7) of the user's eye (8) when in use and a receiver unit (4) for fixing to the frame (2) and configured to receive a reflection of the laser beam (6) and to provide a tracking signal usable for determining a distance or velocity of the cornea (7). The device further comprises a processing unit (9) for determining a rotation of the user's eye (8) from the tracking signal.

Description

EYE TRACKING
FIELD OF DISCLOSURE
The present disclosure relates to eye tracking devices, in particular devices for integrating in a frame for mounting to a user’s head, for example in AR smart glasses.
BACKGROUND
Eye tracking is an important user side sensing modality that can enable a diverse set of applications in e.g. Augmented Reality (AR) applications.
State of the art eye tracking sensing modalities rely on imaging of the eye and cornea using an imaging sensor and the identification of the gaze vector based on data processing of the acquired image. Such approaches tend to be of high power consumption, low accuracy, and/or slow data collection. Equally important is that the placement of the imaging sensor is chosen in a way to maximize the quality of the acquired data, leading to placements that are obstructing the field of view in the bearing device.
An ideal eye tracking solution should have low power consumption, be accurate, fast, and have a small form factor with a simple integration in the bearing device. Current systems cannot provide all of these features together.
SUMMARY
To solve at least some of these problems there is provided a device that uses laser light to measure the distance of specific points on the cornea and uses this information to infer the rotational position of the eye.
According to a first aspect of the present disclosure there is provided an eye tracking device for integrating in a frame for mounting to a user’s head (e.g. smart glasses, AR headset, VR headset, helmet or similar) comprising a laser output unit for fixing to the frame and configured to provide a laser beam for illuminating a cornea of the user’s eye when in use. The device further comprises a receiver unit (which may be the same as the laser output unit when using SMI) for fixing to the frame and configured to receive a reflection of the laser beam and to provide, a tracking signal usable for determining a distance or velocity of the cornea, and a processing unit for determining a rotation of the user’s eye from the tracking signal. Hence, the eye-tracking device does not require imaging of the eye.
Preferably the eye-tracking device provides at least two spatially separated laser beams for illuminating different points on the cornea of the user’s eye, wherein the receiver unit is configured to receive reflections from both laser beams and, for each of the received reflections, provide a tracking signal usable for determining the distance or velocity of the respective points of the cornea. Using two or more laser beams can improve the accuracy of the eye-tracking. More preferably, at least three spatially separated laser beams are provided by the laser output unit. Again, the device is configured so that each laser beam illuminates a different point on the cornea of the user’s eye. The receiving unit is configured to receive the reflections from the at least three laser beams and to provide corresponding tracking signals. The tracking signals can then be used to determine the rotation of the user’s eye (e.g. from the change in distance or from the velocity of the different points of the cornea). By using at least three laser beams (from three laser sources) the accuracy can be further improved.
When having multiple laser beams, the beams can be distributed symmetrically on the cornea of the user’s eye. For example, three laser beams may illuminate three points on the cornea of forming an equilateral triangle. For applications where tracking the rotation of the eye in some directions is more important than in other directions (for example where accurate horizontal tracking is more important than vertical tracking) other distributions of the laser beam illumination on the cornea may be appropriate. For example, a non-symmetrical distribution may be used for some applications.
A laser source is used by itself or together with an optical element to produce an illumination field over the eye and in particular the cornea. Depending on the actual geometry, a specific position on the cornea surface will produce a reflection of this illumination field that can be detected. As the cornea is a spherical surface offset from the rotation point of the eye, any rotation of the eye will lead to a displacement of the cornea. This links the cornea target point displacement measured with the laser signal to the rotation of the eye. Because the proposed method infers the eye rotation from the relative distance change of a specific point on the cornea, any eye rotation within a given cone around the starting position leads to the same distance change and therefore an uncertainty between measurement and rotation. To overcome this, further and preferably at least three laser beams with different positions may be used.
The laser output unit typically comprises a laser source (one for each laser beam), such as laser diodes, e.g. edge emitting lasers, distributed feedback (DFB) lasers, distributed bragg reflector (DBR) lasers, or vertical cavity surface emitting lasers (VCSELs). Alternatively, the laser output unit may comprise an optic waveguide connected to a laser source. The waveguide would typically be a single wave mode fibre optic waveguide. The laser output unit may comprise multiple waveguides connected to respective laser sources for providing multiple (typically three) laser beams. Hence, the actual laser sources may be located off the integrating device (i.e. off the frame) but connected to the device via the waveguides. The laser source should be very monochromatic (narrowband) and have high coherence for accurate distance/displacement measurements. VCSELs have the advantage of being relatively cheap and have low power consumption. The laser sources may be configured to operate at a wavelength in the infrared or near infrared spectra. For example, the laser sources may be configured to emit light having a wavelength in the range of 850 nm to 1500 nm, e.g. at 940 nm. Longer wavelengths are typically better in terms of eye safety, and can therefore be used with a relatively higher output power, which may provide a better signal.
Advantageously, the laser output unit is also the receiver unit and the tracking signal(s) are provided by measuring the phase difference between the emitted and the received laser beam. In particular, self-mixing interferometry, SMI, where self-mixing interference occurs in the laser sources may be used to provide an SMI signal as the tracking signal. SMI allows for accurate distance/displacement measurements without requiring additional photodiodes for receiving the reflected light. Using SMI, a portion of the illumination light is reflected off the cornea surface and makes its way back to each respective laser source. The reflected light coupled back into the laser cavity interferes with the original laser light leading to a modulation of the laser emission characteristics. Measuring the changes in the laser emission characteristics (e.g. laser power output, junction voltage etc.) can provide information about the relative position change of the remote target (specific points on the cornea surface). SMI may use optical detection, wherein each tracking signal is determined from an optical output of the respective laser source. For example, a photodiode may be placed close to the laser source and measure the output intensity of the laser source. The photodiode may be integrated in the laser epitaxy or may be located behind the laser source and arranged to monitor the power output on the laser mirror opposite to the eye emission. Alternatively, each tracking signal may be determined from a current or voltage input to the respective laser source. As the SMI affects the laser output it also affects the power supply to the laser source, which can be measured to determine the distance/displacement.
The spatially separated laser beams may be separated by an angular distance in the range of 3.5° to 20° on the cornea of the user’s eye when in use. For example, in a configuration using three laser sources, the laser beams may be separate by a minimum angular distance of about 17°. Other values of the angular distance of laser sources are also possible and may depend on the number of laser beams used. The spatially separated laser beams may contain a number of laser beams in the range of 3 to 12. Whilst three laser beams (from three laser sources) can provide accurate eye tracking, more beams may be used to improve eye tracking or to provide redundancy in the system (e.g. should one laser source fail). However, a greater number of sources may increase the complexity and power consumption of the device.
The device may further comprises one or more optical elements fixed to the frame and configured to modulate the laser beams illuminating the cornea. For example, the one or more optical elements may be collimating lenses for providing plane wave illumination of the cornea. Alternatively, the one or more optical elements may be focusing lenses for focusing the laser beams on the cornea. The optical elements may be reflective lenses. The laser output unit can then be fixed to the stem of the frame running a long a side of the user’s head. Alternatively, the one or more optical elements may be transmission lenses. The laser output unit may for example be placed in front of the user’s eye.
The laser can be used with the optical element(s) to create any range of illumination fields onto the cornea surface, from a plane wave illumination to a single focus spot on the cornea surface. For example, this can be achieved by changing the distance between the lens and the laser source. The spherical surface of the cornea will reflect some part of the light back, which interacting with the same or a different optical element will be redirected towards the receiving unit (back to the laser when using SMI). Based on the tracking signal, the depth changes of the remote target can be inferred and linked to the rotation of the eye. The optical element(s) may comprise any of volume-phase holographic (VPH), liquid crystal polarization grating (LCPG), and hot mirror etc.
According to a second aspect of the invention there is provided a method of eye tracking, which may be implemented with the eye-tracking device according to the first aspect. The method comprises mounting a frame to a user’s head (e.g. putting the glasses on, illuminating a cornea of the user’s eye with a laser beam provided by a laser output unit fixed to the frame, and receiving a reflection of the laser beam with a receiver unit fixed to the frame and providing a tracking signal (e.g. an SMI signal) usable for determining a distance to the cornea or a velocity of the cornea. The method further comprises determining with a processing unit a rotation of the user’s eye from the tracking signals. Hence, the method of eye-tracking does not require imaging of the eye.
Preferably at least three spatially separated laser beams are used to provide at least three tracking signals, which can be used together to determine the rotation of the user’s eye.
The disclosure provides an eye-tracking solution that uses a small number of illumination and detection elements leading to a low complexity solution. By using optical elements on the frame, the sensing module can be flexibly placed on different positions of the device (e.g. on the stem) allowing for unobtrusive eye-tracking. Reduced data collection (due to signal read-out from a limited numbers of photodiodes) can lead to increased data rates.
BRIEF DESCRIPTION OF THE PREFERRED EMBODIMENTS
Specific embodiments of the disclosure are described below with reference to the accompanying drawings, wherein
Figure 1 depicts smart glasses comprising an eye-tracking device according to an embodiment of the disclosure; Figure 2 depicts a part of an eye tracking device according to an embodiment;
Figure 3 depicts a part of an eye tracking device according to an embodiment when in use;
Figure 4 depicts a laser beam reflected from the cornea of the eye; Figure 5a depicts a part of an eye tracking device comprising a collimating transmission lens;
Figure 5b depicts a part of an eye tracking device comprising a weakly focusing transmission lens;
Figure 5c depicts a part of an eye tracking device comprising a strongly focusing transmission lens;
Figure 6a depicts a part of an eye tracking device comprising a collimating reflective lens;
Figure 6b depicts a part of an eye tracking device comprising a weakly focusing reflective lens; Figure 6c depicts a part of an eye tracking device comprising a strongly focusing reflective lens;
Figure 7 depicts a graph plotting the position of a reflected laser beam on a VCSEL laser source against the position on a reflective lens;
Figure 8 depicts a part of an eye-tracking device comprising a holographic optical element (HOE) mirror;
Figure 9 depicts the optical path difference (OPD) due to a 20° rotation of the eye;
Figure 10 depicts the contour lines of OPD for one laser source;
Figure 11 depicts a graph plotting the accuracy of measurements of rotation against the direction of rotation for one laser source; Figure 12 depicts the contour lines of OPD for two laser sources;
Figure 13 depicts a graph plotting the accuracy of measurements of rotation against the direction of rotation for two laser sources;
Figure 14 depicts the contour lines of OPD for three laser sources;
Figure 15 depicts a graph plotting the accuracy of measurements of rotation against the direction of rotation for three laser sources; Figure 16 depicts graph of the minimum accuracy for rotation in any direction using a three laser source configuration with 17° angular distance between laser beams and for any rotation position of the eye from -30° to 30° about the x and y axes;
Figure 17 depicts the contour lines of OPD for three laser sources separated by an angular distance of 3.5°; and
Figure 18 depicts graph of the minimum accuracy for rotation in any direction using a three laser source configuration with 3.5° angular distance between laser beams and for any rotation position of the eye from -30° to 30° about the x and y axes.
DETAILED DESCRIPTION
Figure 1 shows an eye tracking device 1 integrated in a pair of glasses (e.g. AR smart glasses) comprising a frame 2 having a stem 3. The device 1 comprises a laser output unit 4 comprising three laser sources being VCSEL lasers, and an optical element 5 for modulating laser beams 6 from the laser output unit 4. The optical element 5 is a reflecting and collimating lens (e.g. a Bragg reflector), which provides a plane wave illumination field on the cornea 7 of the eye 8 of the user/wearer of the glasses. A part of the laser beam 6 is reflected back from the cornea 7 and into the laser output unit 4. Hence, the laser output unit 4 is also a receiver unit for receiving the reflected light. The reflected light interferes with the laser field in the laser source through so called self mixing interference, which changes the output of the laser. By monitoring the output intensity of the laser or the input voltage or input current to the laser source, the distance to the cornea 7 and/or the velocity of the cornea 7 can be determined. The device 1 comprises a processing unit 9 for determining the distance to the cornea 7 based on self mixing interferometry (SMI). As the user’s eye 8 moves the distance to the reflection point on the cornea 7 shifts, which causes the distance between the laser source and the cornea 7 to change. Hence, the eye movement can be detected. To accurately determine the rotation of the eye in all directions, at least three angularly separated laser beams 6 are used. More beams may be used for more precise eye tracking and/or to provide redundancy in the system. However, an advantage of using only three laser beams 6 is the possible low power consumption and small form factor. The device 1 also comprises a second optical element 10 being a mirror for redirecting the laser beams 6 from the laser output unit 4. Further optical elements can provide greater flexibility in the placement of the laser output unit 4.
In other embodiments, the laser output unit 4 may be placed in the frame in front of the eye 8 and transmit the laser beams 6 directly onto the cornea 7, without requiring a reflective element. Also, it is not necessary to have the laser sources in the laser output unit 4. Instead the laser sources may be placed off the device and be connected to waveguides for transmitting the laser beams 6.
The embodiment provides an eye-tracking device 1 with a small number of illumination and detection devices to measure the relative depth change of specific points on the cornea 7 and use this information to infer the gaze direction of the eye 8. The SMI signal used to detect the depth change of each point can be measured, with an integrated photodiode in the laser source, or via direct measurement of the gate voltage. The use of laser illumination and detection enables the combination of the sensing module with highly transparent and efficient reflective optical components placed in the eyepiece. It is exactly this that allows the flexible placement of the sensing module within the stem 3 of head wearable devices. The combination of SMI detection (capable of measuring very small depth changes of the point of interest) together with the placement of the various illumination and detection sources in a particular geometry enables very high accuracy over the full eye rotation space. Finally, the solution comprising of a minimum of three sources (each one being potentially a lower power consuming VCSEL) leads to an overall low power consumption.
Figure 2 shows a schematic diagram of a diverging laser beam 6 reflected from a holographic elliptical mirror 11 to provide a plane wave illumination field 12 on a target 13 (e.g. the cornea of a user’s eye). The holographic elliptical mirror 11 may be used as an optical element in the eye-tracking device 1 of Figure 1 to provide plane wave illumination. The same reference numerals have been used to refer to equivalent or similar features in different figures for clarity, and are not intended to limit the illustrated embodiments.
Figure 3 shows a laser beam 6 with an optical element 5 being a reflective lens for illuminating the cornea 7 of an eye 8. The optical element may be a holographic elliptical mirror (HOE) as illustrated in Figure 2 to provide a plane wave. Figure 4 shows a reflected laser beam 14. The laser beam 14 is reflected from the cornea 7. Due to the curvature of the cornea, the reflected laser beam 14 is diverging. The reflected laser beam 14 may be a reflection of the laser beam 6 illustrated in Figure 3.
Figures 5a to 5c show a part of an eye-tracking device according to embodiments having a laser output unit 4 and an optical element 5 being a transmission lens (as opposed to a reflective lens). The optical element provides a illumination field on the cornea 7 of the eye 8. Figure 5a shows an embodiment with a collimating lens, which provides plane wave illumination 15. Figure 5b shows an embodiment with a weakly focusing lens, with a focus behind the surface of the cornea 7, providing a weakly focused illumination 16. Figure 5c shows an embodiment with a strongly focusing lens, with a focus substantially on the surface of the cornea 7, to provide strongly focused illumination 17.
Figures 6a to 6c show a part of an eye-tracking device according to embodiments having a laser output unit 4 and an optical element 5 being a reflective lens. The laser output unit 4 provides a laser beam 6 which is modulated by the optical element to provide an illumination field on the cornea 7 of the eye 8. Figure 6a shows an embodiment with a collimating lens, which provides plane wave illumination 15. Figure 6b shows an embodiment with a weakly focusing lens, with a focus behind the surface of the cornea 7, providing a weakly focused illumination 16. Figure 6c shows an embodiment with a strongly focusing lens, with a focus substantially on the surface of the cornea 7, to provide strongly focused illumination 17.
Figure 7 shows a graph plotting the position of reflected laser light on the VCSEL laser source against the position of reflected laser light on the optical element being a holographic optical mirror (HOE). Two lines 18 and 19 are plotted for positions along the x-axis 18 and the y-axis 19 respectively.
Figure 8 illustrates the diverging laser beam 20 reflected from the cornea 7 of the eye 8 and incident on the VCSEL laser source 21 via the HOE 22. Because of the curvature of the cornea 7, the reflected light is diverging and ends up illuminating a relatively large area on the VCSEL plane (see Figure 7). In order to estimate the power ratio, the size of the HOE aperture that will be captured into the VCSEL aperture must be identified. The power ratio is given by the diffracting aperture divided by the full illumination aperture, wherein the full illumination aperture is defined by the eye rotation range and interpupillary distance (I PD) range that is covered. The power ratio is given by:
Power ratio = Fresnel coefficient * Diffracting aperture / Full illumination aperture
Using this equation, simulations can be used to determine a frequency for which the SMI signal will be above the noise floor. The frequency of the signal is the inverse of the measurement time (the time “looking” at the signal) for determining the distance/velocity. The noise is proportional to the bandwidth or to the square root of the bandwidth. Hence, the faster the measurement, the bigger the bandwidth and also the noise.
By changing the optical geometry to a focus spot behind the cornea can increase the power ratio. For example, the power ratio may be increased by a factor of 4 to 8. However, using focusing optics can increase complexity and potentially affect the fitting requirements (e.g. inter-pupillary distance, eye relief, nose height, ear position etc.).
Figure 9 illustrates how rotation of the eye 8 changes the optical path when using plane wave illumination, which thereby gives rise to a measurable signal. A laser beam 6a having an illumination angle b is incident on and reflected from a point on the cornea 7 of the eye 8 when the eye 8 is in a first position (eye rotation a = 0°). Based on the input angle b, there is one point on the cornea 7 that, due to the local curvature, will reflect light at the same angle as the incident angle and back to the receiving unit (not shown). This point remains the same relative to the centre of the cornea 7 when the eye 8 rotates. The eye 8 is rotated into a second position (a = 20°), in which the laser beam 6b is incident on and reflected from a point on the cornea 7 and back to the receiving unit. The change in distance of the optical path (the optical path difference, OPD) of the reflected laser beams 6a and 6b between the cornea 7 and the receiver unit depends on the angle of rotation a and can therefore be measured to determine the eye rotation.
Figure 10 shows how the OPD changes with the angle of rotation. In particular, contour lines 23 OPD are shown, for which the OPD is constant. A star indicates an arbitrary position 24 in rotation space of the eye, and arrows indicate possible directions of rotation of the eye. The central point 25 indicates the position of the laser illumination on the cornea. The most accurate measurements (corresponding to the largest OPD) are possible for rotation in a direction perpendicular to the contour lines 23. Conversely, rotation following the tangent of the contour lines 23 does not change the OPD and therefore has the worst accuracy.
The accuracy as a function of the angle of rotation from any given position is illustrated in Figure 11. The accuracy can be defined as the smallest determinable change in angle, so that a large number indicates a poor accuracy (low resolution) and a small number indicates a good accuracy (high resolution). As can be seen from Figure 11 , rotation in a tangential direction along the OPD line 23 (i.e. Q = 0° or Q = 180°) has the worst accuracy, whilst rotation in a perpendicular direction (i.e. Q = 90° or Q = 270°) has the best accuracy. The accuracy as a function of the angle of rotation can be expressed by the following equation:
Figure imgf000012_0001
To solve this problem, further laser beams can be provided. Figures 12 and 13 show the OPD contour lines 23 and corresponding accuracy plot for two laser sources providing two spatially separated laser beams for illuminating the cornea. As can be seen from the graph in Figure 13, by using two sources as shown, the accuracy of at least one source will always be less than 0.25 degrees (indicated by the dashed line).
Figures 14 and 15 shows the OPD contour lines 23 and corresponding accuracy for a configuration comprising three laser sources. Each laser beam is separated by an angle of 17°, which provides an accuracy of less than approximately 0.05 degrees in all directions from any position on the cornea.
Figure 16 plots the minimum accuracy for rotation in any direction using the three laser source configuration with 17° angle between laser beams for any rotation position of the eye from -30° to 30° about the x and y axes. As can be seen from the plot, only relatively small regions have a minimum accuracy worse than 0.05 degrees for movement/rotation in any direction.
Figure 17 shows the OPD contour lines 23 for a device providing three laser beams separated by an angular distance of 3.5°. Figure 18 shows a corresponding plot of the minimum accuracy for rotation in any direction from any rotational position of the eye within -30° to 30° about the x and y axes. As can be seen from the plot, the accuracy is not as good as for the 17° configuration of three sources. The minimum accuracy is approximately 0.25 degrees (compared to 0.05 degrees for the 17° configuration). Hence, reducing the angle between the laser sources worsens the accuracy.
Although specific embodiment have been described above, the claims are not limited to those embodiments. Each feature disclosed may be incorporated in any of the described embodiments, alone or in an appropriate combination with other features disclosed herein.
Reference Numerals
1 Eye tracking device 14 Reflected laser beam
2 Frame 15 Plane wave illumination
3 Stem 16 Weakly focused illumination
4 Laser output unit 17 Strongly focused illumination
5 Optical element 18 Position along the x-axis
6 Laser beam 19 Position along the y-axis
7 Cornea 20 Diverging laser beam
8 Eye 21 VCSEL laser source
9 Processing unit 22 Holographic optical element (HOE)
10 Second optical element 23 Contour line
11 Holographic elliptical element 24 Eye position
12 Plane wave illumination field 25 Central point
13 Target

Claims

CLAIMS:
1. An eye tracking device (1) for integrating in a frame (2) for mounting to a user’s head, the device comprising; a laser output unit (4) for fixing to the frame (2) and configured to provide a laser beam (6) for illuminating a cornea (7) of the user’s eye (8) when in use; a receiver unit (4) for fixing to the frame (2) and configured to receive reflections of the laser beam and to provide a tracking signal usable for determining a distance or velocity of the cornea (7); and a processing unit (9) for determining a rotation of the user’s eye (8) from the tracking signal.
2. An eye-tracking device (1) according to claim 1, wherein the laser output unit (4) is configured to provide at least three spatially separated laser beams (6), and wherein the receiver unit (4) is configured to receive reflections of the at least three spatially separated laser beams (6).
3. An eye tracking device (1) according to claim 2, wherein the at least three separated laser beams (6) are separated by an angular distance in the range of 3.5° to 20° on the cornea (7) of the user’s eye (8) when in use.
4. An eye tracking device (1) according to claim 1 , 2 or 3, wherein the laser output unit (4) comprises a laser source for emitting the laser beam.
5. An eye tracking device (1) according to claim 1 , 2 or 3, wherein the laser output unit (4) comprises an optic waveguide connected to a laser source for emitting the laser beam.
6. An eye tracking device (1) according to claim 4 or 5, wherein the laser output unit (4) is also the receiver unit (4) and the tracking signal is provided by self-mixing interference in the laser source.
7. An eye tracking device (1 ) according to claim 4, 5 or 6, wherein the tracking signal is determined from an optical output of the laser source.
8. An eye tracking device (1 ) according to claim 4, 5 or 6, wherein the tracking signal is determined from a current or voltage input to the laser source.
9. An eye tracking device (1) according to any one of claims 4 to 8, wherein the laser source is a vertical cavity surface emitting laser, VCSEL.
10. An eye tracking device (1) according to any one of the preceding claims, further comprising one or more optical elements (5, 10, 11, 22) for fixing to the frame (2) and configured to modulate the laser beams (6) for illuminating the cornea (7).
11. An eye tracking device (1) according to claim 10, wherein the one or more optical elements (5, 10, 11, 22) are collimating lenses for providing plane wave illumination (12, 15) of the cornea (7).
12. An eye tracking device (1) according to claim 10, wherein the one or more optical elements (5, 10, 11, 22) are focusing lenses for focusing the laser beams on the cornea (7).
13. An eye tracking device (1) according to claim 10, 11 or 12, wherein the one or more optical elements (5, 10, 11, 22) are reflective lenses.
14. An eye tracking device (1) according to claim 13, wherein the laser output unit is configured to be fixed to a stem of the frame running a long a side of the user’s head when in use.
15. A virtual reality, VR, or augmented reality, AR, headset comprising a frame (2) for mounting to a user’s head and an eye tracking device (1) according to any one of claims 1 to 14 integrated in the frame (2).
16. A method of eye tracking comprising: mounting a frame to a user’s head; illuminating a cornea of the user’s eye with a laser beam provided by a laser output unit fixed to the frame; receiving a reflection of the laser beam with a receiver unit fixed to the frame and providing a tracking signal usable for determining a distance or velocity of the cornea; and determining with a processing unit a rotation of the user’s eye from the tracking signal.
PCT/EP2022/063018 2021-05-20 2022-05-13 Eye tracking Ceased WO2022243185A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN202280051291.XA CN117813540A (en) 2021-05-20 2022-05-13 eye tracking
DE112022002732.0T DE112022002732T5 (en) 2021-05-20 2022-05-13 EYE TRACKING
US18/562,509 US12455447B2 (en) 2021-05-20 2022-05-13 Eye tracking
JP2023571964A JP2024522341A (en) 2021-05-20 2022-05-13 Eye Tracking
KR1020237043420A KR20240009468A (en) 2021-05-20 2022-05-13 eye tracking

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB2107231.9A GB202107231D0 (en) 2021-05-20 2021-05-20 Eye tracking
GB2107231.9 2021-05-20

Publications (1)

Publication Number Publication Date
WO2022243185A1 true WO2022243185A1 (en) 2022-11-24

Family

ID=76637719

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2022/063018 Ceased WO2022243185A1 (en) 2021-05-20 2022-05-13 Eye tracking

Country Status (7)

Country Link
US (1) US12455447B2 (en)
JP (1) JP2024522341A (en)
KR (1) KR20240009468A (en)
CN (1) CN117813540A (en)
DE (1) DE112022002732T5 (en)
GB (1) GB202107231D0 (en)
WO (1) WO2022243185A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025067950A1 (en) * 2023-09-29 2025-04-03 Ams-Osram Ag Eye tracking sensor and ar/vr glasses and method for eye tracking

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4198607A1 (en) * 2021-12-20 2023-06-21 ams International AG Eye sensing
DE102024130285A1 (en) * 2024-10-18 2026-04-23 Robert Bosch Gesellschaft mit beschränkter Haftung Eye tracking device and method and AR headset or VR headset

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060269190A1 (en) * 2005-05-31 2006-11-30 Hyun-Soo Kim Parabolic waveguide-type collimating lens and tunable external cavity laser diode provided with the same
KR20210049868A (en) * 2018-08-29 2021-05-06 로베르트 보쉬 게엠베하 Method for detecting the eye's gaze direction

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6424407B1 (en) * 1998-03-09 2002-07-23 Otm Technologies Ltd. Optical translation measurement
US9860522B2 (en) * 2012-08-04 2018-01-02 Paul Lapstun Head-mounted light field display
US10514541B2 (en) * 2012-12-27 2019-12-24 Microsoft Technology Licensing, Llc Display update time reduction for a near-eye display
EP3140779A4 (en) 2014-05-09 2017-11-29 Google LLC Systems and methods for using eye signals with secure mobile communications
US9696801B2 (en) * 2014-06-26 2017-07-04 Thomas Alan Donaldson Eye-controlled user interface to control an electronic device
EP3329250B1 (en) 2015-07-30 2018-12-26 Koninklijke Philips N.V. Laser sensor for particle size detection
US10013055B2 (en) * 2015-11-06 2018-07-03 Oculus Vr, Llc Eye tracking using optical flow
US10373592B2 (en) * 2016-08-01 2019-08-06 Facebook Technologies, Llc Adaptive parameters in image regions based on eye tracking information
WO2018094307A1 (en) * 2016-11-18 2018-05-24 Robert Bosch Start-Up Platform North America, Llc, Sensing system and method
US10108014B2 (en) * 2017-01-10 2018-10-23 Microsoft Technology Licensing, Llc Waveguide display with multiple focal depths
US10824229B2 (en) * 2017-01-20 2020-11-03 AdHawk Microsystems System and method for resonant eye-tracking
US10303248B2 (en) * 2017-04-28 2019-05-28 Microsoft Technology Licensing, Llc Eye tracking using scanned beam and multiple detectors
EP3765943B1 (en) * 2018-03-16 2025-11-05 Magic Leap, Inc. Depth based foveated rendering for display systems
DE102018113848A1 (en) * 2018-06-11 2019-12-12 Sick Ag Optoelectronic sensor and method for acquiring three-dimensional image data
JP7418149B2 (en) 2018-11-29 2024-01-19 株式会社リコー Optical devices, retinal projection display devices, head-mounted display devices, and input devices
US11156759B2 (en) * 2019-01-29 2021-10-26 Osram Opto Semiconductors Gmbh μ-LED, μ-LED device, display and method for the same
US11435820B1 (en) * 2019-05-16 2022-09-06 Facebook Technologies, Llc Gaze detection pipeline in an artificial reality system
US11509835B2 (en) * 2019-07-08 2022-11-22 Varjo Technologies Oy Imaging system and method for producing images using means for adjusting optical focus
US11474358B2 (en) * 2020-03-20 2022-10-18 Magic Leap, Inc. Systems and methods for retinal imaging and tracking
DE102020206822A1 (en) * 2020-06-02 2021-12-02 Robert Bosch Gesellschaft mit beschränkter Haftung Procedure for operating data glasses
DE102020206821A1 (en) * 2020-06-02 2021-12-02 Robert Bosch Gesellschaft mit beschränkter Haftung Method for determining a line of sight of an eye
US11749964B2 (en) * 2020-06-24 2023-09-05 Meta Platforms Technologies, Llc Monolithic light source with integrated optics based on nonlinear frequency conversion
WO2022031572A1 (en) * 2020-08-03 2022-02-10 Arizona Board Of Regents On Behalf Of The University Of Arizona Perceptual-driven foveated displays
JP7600693B2 (en) * 2021-01-13 2024-12-17 株式会社リコー Optical device, line of sight detection device, retinal projection display device, head-mounted display device, eye examination device, method for detecting inclination of three-dimensional object, and method for detecting line of sight
US11860358B2 (en) * 2021-08-13 2024-01-02 Meta Platforms Technologies, Llc Angular light sensor and eye-tracking
TW202312731A (en) * 2021-08-13 2023-03-16 美商元平台技術有限公司 Angular light sensor and eye-tracking

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060269190A1 (en) * 2005-05-31 2006-11-30 Hyun-Soo Kim Parabolic waveguide-type collimating lens and tunable external cavity laser diode provided with the same
KR20210049868A (en) * 2018-08-29 2021-05-06 로베르트 보쉬 게엠베하 Method for detecting the eye's gaze direction

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
THOMAS TAIMRE ET AL: "Laser feedback interferometry: a tutorial on the self-mixing effect for coherent sensing", ADVANCES IN OPTICS AND PHOTONICS, vol. 7, no. 3, 20 August 2015 (2015-08-20), pages 570, XP055595620, DOI: 10.1364/AOP.7.000570 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025067950A1 (en) * 2023-09-29 2025-04-03 Ams-Osram Ag Eye tracking sensor and ar/vr glasses and method for eye tracking

Also Published As

Publication number Publication date
JP2024522341A (en) 2024-06-18
GB202107231D0 (en) 2021-07-07
CN117813540A (en) 2024-04-02
DE112022002732T5 (en) 2024-03-07
US20240255753A1 (en) 2024-08-01
KR20240009468A (en) 2024-01-22
US12455447B2 (en) 2025-10-28

Similar Documents

Publication Publication Date Title
US12455447B2 (en) Eye tracking
US12474773B2 (en) Eye movement determination
CN115202037B (en) Optical device, retinal projection display device, head mounted display device
US20180242841A1 (en) Eye-tracker illumination
RU2700373C1 (en) Eye tracking system
EP4356179B1 (en) Optical system for eye tracking
KR102895053B1 (en) Eye accommodation distance measuring device and method for head mounted display, head mounted display
US12484775B2 (en) Eye sensing
US20220000362A1 (en) Eye-tracking using laser doppler interferometry
WO2022169667A1 (en) Scanning self-mixing interferometry system and sensor
US12443039B2 (en) Eye information detection device and image display apparatus
CN121666550A (en) Eye-tracking system
JP7428028B2 (en) Rotation angle detection device for three-dimensional objects, retinal projection display device, head-mounted display device, optometry device, and input device
US11796829B1 (en) In-field illuminator for eye depth sensing
US11269191B2 (en) Data acquisition apparatus
CN116406449A (en) Systems and methods for eye tracking in head-mounted devices using low-coherence interferometry
WO2024245754A1 (en) Processing device, eye tracking system and processing method
WO2024208689A1 (en) Eye tracking device and method of tracking an eye rotation
WO2026027218A1 (en) Eye tracking system
CN120226984A (en) Eye detection device and electronic equipment
WO2023078689A1 (en) Retinal imaging

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22728894

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18562509

Country of ref document: US

Ref document number: 2023571964

Country of ref document: JP

ENP Entry into the national phase

Ref document number: 20237043420

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 1020237043420

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 112022002732

Country of ref document: DE

WWE Wipo information: entry into national phase

Ref document number: 202280051291.X

Country of ref document: CN

122 Ep: pct application non-entry in european phase

Ref document number: 22728894

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 18562509

Country of ref document: US

WWR Wipo information: refused in national office

Ref document number: 1020237043420

Country of ref document: KR