JP7008702B2 - スペックルパターンを使用した眼追跡のための方法およびシステム - Google Patents

スペックルパターンを使用した眼追跡のための方法およびシステム Download PDF

Info

Publication number
JP7008702B2
JP7008702B2 JP2019524195A JP2019524195A JP7008702B2 JP 7008702 B2 JP7008702 B2 JP 7008702B2 JP 2019524195 A JP2019524195 A JP 2019524195A JP 2019524195 A JP2019524195 A JP 2019524195A JP 7008702 B2 JP7008702 B2 JP 7008702B2
Authority
JP
Japan
Prior art keywords
eye
sight
light beam
speckle
line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019524195A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020516326A (ja
JP2020516326A5 (https=
Inventor
アシフ シネイ，
バラク フリードマン，
エヴィヤター ブルーザー，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2020516326A publication Critical patent/JP2020516326A/ja
Publication of JP2020516326A5 publication Critical patent/JP2020516326A5/ja
Priority to JP2022002426A priority Critical patent/JP7186906B2/ja
Application granted granted Critical
Publication of JP7008702B2 publication Critical patent/JP7008702B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/47—Scattering, i.e. diffuse reflection
    • G01N21/4788—Diffraction
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/262—Analysis of motion using transform domain methods, e.g. Fourier domain methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/32—Determination of transform parameters for the alignment of images, i.e. image registration using correlation-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/47—Scattering, i.e. diffuse reflection
    • G01N21/4788—Diffraction
    • G01N2021/479—Speckle
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30041—Eye; Retina; Ophthalmic

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Eye Examination Apparatus (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Position Input By Displaying (AREA)
JP2019524195A 2016-11-10 2017-11-07 スペックルパターンを使用した眼追跡のための方法およびシステム Active JP7008702B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022002426A JP7186906B2 (ja) 2016-11-10 2022-01-11 スペックルパターンを使用した眼追跡のための方法およびシステム

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662420292P 2016-11-10 2016-11-10
US62/420,292 2016-11-10
PCT/US2017/060303 WO2018089329A1 (en) 2016-11-10 2017-11-07 Method and system for eye tracking using speckle patterns

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022002426A Division JP7186906B2 (ja) 2016-11-10 2022-01-11 スペックルパターンを使用した眼追跡のための方法およびシステム

Publications (3)

Publication Number Publication Date
JP2020516326A JP2020516326A (ja) 2020-06-11
JP2020516326A5 JP2020516326A5 (https=) 2020-12-03
JP7008702B2 true JP7008702B2 (ja) 2022-02-10

Family

ID=62064441

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2019524195A Active JP7008702B2 (ja) 2016-11-10 2017-11-07 スペックルパターンを使用した眼追跡のための方法およびシステム
JP2022002426A Active JP7186906B2 (ja) 2016-11-10 2022-01-11 スペックルパターンを使用した眼追跡のための方法およびシステム

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2022002426A Active JP7186906B2 (ja) 2016-11-10 2022-01-11 スペックルパターンを使用した眼追跡のための方法およびシステム

Country Status (9)

Country Link
US (2) US10948981B2 (https=)
EP (1) EP3537950B1 (https=)
JP (2) JP7008702B2 (https=)
KR (1) KR102555925B1 (https=)
CN (1) CN109922710B (https=)
AU (1) AU2017356886A1 (https=)
CA (1) CA3042263A1 (https=)
IL (1) IL266390B (https=)
WO (1) WO2018089329A1 (https=)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018089329A1 (en) 2016-11-10 2018-05-17 Magic Leap, Inc. Method and system for eye tracking using speckle patterns
IL300511A (en) 2017-03-22 2023-04-01 Magic Leap Inc Depth-based rendering for display systems
IL301447B2 (en) * 2017-04-24 2024-05-01 Magic Leap Inc Optical flow tracking of backscattered laser speckle samples
EP4648015A3 (en) 2018-03-16 2026-01-14 Magic Leap, Inc. Depth based foveated rendering for display systems
US10884492B2 (en) * 2018-07-20 2021-01-05 Avegant Corp. Relative position based eye-tracking system
CN110022321A (zh) * 2019-04-09 2019-07-16 李丰 一种基于虚拟现实的vr建筑检测方法及vr设备
CN110471532B (zh) * 2019-08-19 2023-04-18 业成科技（成都）有限公司 整合眼球追踪与手势操控之车载装置
KR102710604B1 (ko) * 2020-05-08 2024-09-26 한국전자통신연구원 시선 추적 장치 및 방법
DE102020206822A1 (de) * 2020-06-02 2021-12-02 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren zum Betreiben einer Datenbrille
CN116917846A (zh) 2021-06-29 2023-10-20 三星电子株式会社 用于校正注视方向识别期间的误差的电子装置及操作方法
DE102022202208A1 (de) 2022-03-04 2023-09-07 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren zu einer Pupillendetektion und/oder Pupillenverfolgung, optisches System und Datenbrille
CN115760750B (zh) * 2022-11-15 2023-11-21 北京的卢铭视科技有限公司 Doe质量检测方法、系统、电子设备和存储介质
WO2025175292A1 (en) * 2024-02-15 2025-08-21 Meta Platforms Technologies, Llc Apparatus, system, and method for eye tracking based on speckle patterns formed by coherent light
US20260000342A1 (en) * 2024-06-26 2026-01-01 Cognuro, LLC Vestibular and oculomotor assessment utilizing videonystagmography data and posturography data

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150289762A1 (en) 2012-05-11 2015-10-15 Milan Momcilo Popovich Apparatus for eye tracking
US20160209657A1 (en) 2013-05-20 2016-07-21 Digilens, Inc. Holographic waveguide eye tracker

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9713658D0 (en) * 1997-06-28 1997-09-03 Travis Adrian R L View-sequential holographic display
JP3851050B2 (ja) * 2000-02-15 2006-11-29 ナイルス株式会社 眼の状態検出装置
WO2007085682A1 (en) * 2006-01-26 2007-08-02 Nokia Corporation Eye tracker device
IL184868A0 (en) * 2007-07-26 2008-03-20 Univ Bar Ilan Motion detection system and method
WO2010014977A1 (en) * 2008-08-01 2010-02-04 The Trustees Of Columbia University In The City Of New York Systems and methods for matching and imaging tissue characteristics
US7736000B2 (en) * 2008-08-27 2010-06-15 Locarna Systems, Inc. Method and apparatus for tracking eye movement
WO2011117776A1 (en) * 2010-03-22 2011-09-29 Koninklijke Philips Electronics N.V. System and method for tracking the point of gaze of an observer
EP2696259B1 (en) * 2012-08-09 2021-10-13 Tobii AB Fast wake-up in a gaze tracking system
US10262462B2 (en) * 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
JP2015011579A (ja) 2013-06-28 2015-01-19 株式会社東芝 視線検出装置、及び視線検出方法
CN107272199B (zh) * 2013-11-27 2023-04-07 奇跃公司 虚拟和增强现实系统与方法
CN106028911A (zh) * 2014-03-04 2016-10-12 南加利福尼亚大学 具有延长的持续时间的光学相干断层扫描(oct)系统
WO2016046514A1 (en) * 2014-09-26 2016-03-31 LOKOVIC, Kimberly, Sun Holographic waveguide opticaltracker
US9911046B1 (en) * 2014-11-13 2018-03-06 The United States Of America, As Represented By The Secretary Of The Navy Method and apparatus for computer vision analysis of spin rate of marked projectiles
DK179537B1 (en) * 2015-02-04 2019-02-08 Itu Business Development A/S Tin traces and eye tracking methods
WO2017079689A1 (en) * 2015-11-06 2017-05-11 Oculus Vr, Llc Eye tracking using optical flow
WO2018089329A1 (en) 2016-11-10 2018-05-17 Magic Leap, Inc. Method and system for eye tracking using speckle patterns

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150289762A1 (en) 2012-05-11 2015-10-15 Milan Momcilo Popovich Apparatus for eye tracking
US20160209657A1 (en) 2013-05-20 2016-07-21 Digilens, Inc. Holographic waveguide eye tracker

Also Published As

Publication number Publication date
US20180129282A1 (en) 2018-05-10
EP3537950A4 (en) 2019-10-30
EP3537950A1 (en) 2019-09-18
KR102555925B1 (ko) 2023-07-13
CA3042263A1 (en) 2018-05-17
JP7186906B2 (ja) 2022-12-09
IL266390A (en) 2019-06-30
AU2017356886A1 (en) 2019-05-02
US20210232221A1 (en) 2021-07-29
EP3537950B1 (en) 2025-09-03
JP2020516326A (ja) 2020-06-11
CN109922710B (zh) 2022-05-13
US11237631B2 (en) 2022-02-01
JP2022058561A (ja) 2022-04-12
KR20190079667A (ko) 2019-07-05
US10948981B2 (en) 2021-03-16
CN109922710A (zh) 2019-06-21
WO2018089329A1 (en) 2018-05-17
IL266390B (en) 2022-04-01

Similar Documents

Publication Publication Date Title
JP7186906B2 (ja) スペックルパターンを使用した眼追跡のための方法およびシステム
Chen et al. 3D gaze estimation with a single camera without IR illumination
CN109558012B (zh) 一种眼球追踪方法及装置
US6659611B2 (en) System and method for eye gaze tracking using corneal image mapping
US9070017B2 (en) Methods and apparatus for estimating point-of-gaze in three dimensions
CN113260299B (zh) 用于眼睛追踪的系统和方法
EP3542308B1 (en) Method and device for eye metric acquisition
JP2025098000A (ja) アイトラッキングデバイスおよび方法
CN107145086B (zh) 一种免定标的视线追踪装置及方法
JP2020516326A5 (https=)
EP4320499B1 (en) Gaze-tracking system and method employing selective glints
JP7246044B2 (ja) 視標視認判定システム及び視野検査装置
JP6957048B2 (ja) 眼部画像処理装置
NZ793781A (en) Method and system for eye tracking using speckle patterns
Uramune et al. Fixation-based Self-calibration for Eye Tracking in VR Headsets
US20260105628A1 (en) Eye-tracking system and methods of using an eye-tracking
Kowalik Do-it-yourself eye tracker: impact of the viewing angle on the eye tracking accuracy

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201020

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201020

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210806

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211104

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20211210

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220111

R150 Certificate of patent or registration of utility model

Ref document number: 7008702

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250