JP6577454B2 - 軸上視線追跡システム及び方法 - Google Patents

軸上視線追跡システム及び方法 Download PDF

Info

Publication number
JP6577454B2
JP6577454B2 JP2016503499A JP2016503499A JP6577454B2 JP 6577454 B2 JP6577454 B2 JP 6577454B2 JP 2016503499 A JP2016503499 A JP 2016503499A JP 2016503499 A JP2016503499 A JP 2016503499A JP 6577454 B2 JP6577454 B2 JP 6577454B2
Authority
JP
Japan
Prior art keywords
eye
pupil
illumination
image
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016503499A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016512765A5 (enExample
JP2016512765A (ja
Inventor
ジェイ．サリバン ニコラス
ジェイ．サリバン ニコラス
Original Assignee
ミラメトリックス インコーポレイテッド
ミラメトリックス インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ミラメトリックス インコーポレイテッド, ミラメトリックス インコーポレイテッド filed Critical ミラメトリックス インコーポレイテッド
Publication of JP2016512765A publication Critical patent/JP2016512765A/ja
Publication of JP2016512765A5 publication Critical patent/JP2016512765A5/ja
Application granted granted Critical
Publication of JP6577454B2 publication Critical patent/JP6577454B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Multimedia (AREA)
  • Eye Examination Apparatus (AREA)
  • Studio Devices (AREA)
JP2016503499A 2013-03-18 2014-03-17 軸上視線追跡システム及び方法 Active JP6577454B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201361802881P 2013-03-18 2013-03-18
US61/802,881 2013-03-18
PCT/CA2014/050282 WO2014146199A1 (en) 2013-03-18 2014-03-17 System and method for on-axis eye gaze tracking

Publications (3)

Publication Number Publication Date
JP2016512765A JP2016512765A (ja) 2016-05-09
JP2016512765A5 JP2016512765A5 (enExample) 2017-06-08
JP6577454B2 true JP6577454B2 (ja) 2019-09-18

Family

ID=51579241

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016503499A Active JP6577454B2 (ja) 2013-03-18 2014-03-17 軸上視線追跡システム及び方法

Country Status (6)

Country Link
US (1) US9733703B2 (enExample)
EP (1) EP2975997B1 (enExample)
JP (1) JP6577454B2 (enExample)
CN (1) CN105431078B (enExample)
CA (1) CA2882413C (enExample)
WO (1) WO2014146199A1 (enExample)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6504788B2 (ja) * 2014-11-12 2019-04-24 国立大学法人静岡大学 瞳孔検出用光源装置の制御方法
US10016130B2 (en) 2015-09-04 2018-07-10 University Of Massachusetts Eye tracker system and methods for detecting eye parameters
US10061383B1 (en) 2015-09-16 2018-08-28 Mirametrix Inc. Multi-feature gaze tracking system and method
JP7053469B2 (ja) * 2015-12-31 2022-04-12 ミラメトリックス インコーポレイテッド 視線追跡のためのシステムおよび装置
US10162651B1 (en) * 2016-02-18 2018-12-25 Board Of Trustees Of The University Of Alabama, For And On Behalf Of The University Of Alabama In Huntsville Systems and methods for providing gaze-based notifications
US10715824B2 (en) * 2016-03-17 2020-07-14 Facebook Technologies, Llc System and method for data compressing optical sensor data prior to transferring to a host system
WO2017205789A1 (en) 2016-05-27 2017-11-30 Pelz Jeff B System and method for eye tracking
US20180005057A1 (en) * 2016-07-01 2018-01-04 Hyundai Motor Company Apparatus and method for capturing face image of decreased reflection on spectacles in vehicle
JP6751324B2 (ja) * 2016-09-14 2020-09-02 株式会社デンソーアイティーラボラトリ 虹彩検出装置、虹彩検出方法、およびプログラム
CN109716268B (zh) * 2016-09-22 2022-05-17 苹果公司 眼部和头部跟踪
EP3859495B1 (en) * 2016-12-06 2023-05-10 Vuelosophy Inc. Systems and methods for tracking motion and gesture of heads and eyes
JP7019700B2 (ja) 2016-12-21 2022-02-15 アキュセラ インコーポレイテッド 網膜の厚さを測定するための光干渉断層撮影（ｏｃｔ）システム
US10296786B2 (en) * 2017-02-15 2019-05-21 International Business Machines Corporation Detecting hand-eye coordination in real time by combining camera eye tracking and wearable sensing
WO2018222897A1 (en) 2017-06-01 2018-12-06 University Of Washington Smartphone-based digital pupillometer
CN107357429B (zh) * 2017-07-10 2020-04-07 京东方科技集团股份有限公司 用于确定视线的方法、设备和计算机可读存储介质
JP7116978B2 (ja) * 2017-07-12 2022-08-12 国立大学法人静岡大学 画像特徴追跡方法、視線追跡方法及び注視点追跡方法
ES2909057T3 (es) * 2017-09-08 2022-05-05 Tobii Ab Seguimiento ocular que utiliza la posición del centro del globo ocular
ES3039315T3 (en) * 2017-09-11 2025-10-21 Tobii Ab Reliability of gaze tracking data for left and right eye
WO2019116078A1 (en) * 2017-12-13 2019-06-20 Medical Diagnostech (Pty) Ltd System and method for obtaining a pupil response profile
CN118576146A (zh) 2018-06-20 2024-09-03 奥克塞拉有限公司 基于家庭的眼科应用的微型移动低成本光学相干断层扫描系统
US11003244B2 (en) * 2018-08-27 2021-05-11 University Of Rochester System and method for real-time high-resolution eye-tracking
US20210319585A1 (en) * 2018-08-31 2021-10-14 Eyeware Tech Sa Method and system for gaze estimation
CN109725715B (zh) * 2018-11-16 2024-04-05 深圳惠智光电子科技有限公司 一种眼睛训练引导方法、电子设备及存储介质
IL264530B2 (en) 2019-01-29 2024-07-01 Eyeway Vision Ltd Eye tracking device and a method thereof
CN110051319A (zh) * 2019-04-23 2019-07-26 七鑫易维(深圳)科技有限公司 眼球追踪传感器的调节方法、装置、设备及存储介质
US11263634B2 (en) * 2019-08-16 2022-03-01 Advanced New Technologies Co., Ltd. Payment method and device
IL271287B2 (en) 2019-12-09 2025-06-01 Eyeway Vision Ltd Eye tracking systems and methods
US11921917B2 (en) 2020-04-07 2024-03-05 Eyetech Digital Systems, Inc. Compact eye-tracking camera systems and methods
US10996753B1 (en) * 2020-04-07 2021-05-04 Eyetech Digital Systems, Inc. Multi-mode eye-tracking with independently operable illuminators
JP7635264B2 (ja) * 2020-06-05 2025-02-25 マジック リープ， インコーポレイテッド 画像のニューラルネットワーク分析に基づいて向上された眼追跡技法
US10959613B1 (en) 2020-08-04 2021-03-30 Acucela Inc. Scan pattern and signal processing for optical coherence tomography
US11974807B2 (en) 2020-08-14 2024-05-07 Acucela Inc. System and method for optical coherence tomography a-scan decurving
WO2022084803A1 (en) 2020-10-23 2022-04-28 Eyeware Tech Sa Automated calibration method of a system comprising an external eye tracking device and a computing device
EP4027220A1 (en) 2021-01-08 2022-07-13 Eyeware Tech SA Method for calibrating an eye-tracking device
EP4113251A1 (en) 2021-06-30 2023-01-04 Eyeware Tech SA Calibration method of a system comprising an eye tracking device and a computing device comprising one or multiple screens
EP4113982A1 (en) 2021-06-30 2023-01-04 Eyeware Tech SA Method for sensing and communicating visual focus of attention in a video conference
EP4113983A1 (en) 2021-06-30 2023-01-04 Eyeware Tech SA Method for gaze tracking calibration with a video conference system
US11861916B2 (en) * 2021-10-05 2024-01-02 Yazaki Corporation Driver alertness monitoring system
US12002290B2 (en) 2022-02-25 2024-06-04 Eyetech Digital Systems, Inc. Systems and methods for hybrid edge/cloud processing of eye-tracking image data
JP2025521063A (ja) * 2022-06-02 2025-07-08 アルコン インコーポレイティド ハードウェアフィルタリング及びソフトウェアソーティングを有するアイトラッカー
DE102024200568A1 (de) * 2024-01-23 2025-07-24 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren zum Betreiben einer Vorrichtung zur Nachverfolgung einer Blickrichtung einer Person, Vorrichtung zur Nachverfolgung einer Blickrichtung einer Person und Datenbrille

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3804496A (en) 1972-12-11 1974-04-16 Stanford Research Inst Two dimensional eye tracker and method for tracking an eye
US4950069A (en) 1988-11-04 1990-08-21 University Of Virginia Eye movement detector with improved calibration and speed
US5231674A (en) * 1989-06-09 1993-07-27 Lc Technologies, Inc. Eye tracking method and apparatus
US6134339A (en) * 1998-09-17 2000-10-17 Eastman Kodak Company Method and apparatus for determining the position of eyes and for correcting eye-defects in a captured frame
GB9823977D0 (en) * 1998-11-02 1998-12-30 Scient Generics Ltd Eye tracking method and apparatus
US8292433B2 (en) 2003-03-21 2012-10-23 Queen's University At Kingston Method and apparatus for communication between humans and devices
US7762665B2 (en) 2003-03-21 2010-07-27 Queen's University At Kingston Method and apparatus for communication between humans and devices
CA2545202C (en) 2003-11-14 2014-01-14 Queen's University At Kingston Method and apparatus for calibration-free eye tracking
US7362885B2 (en) * 2004-04-20 2008-04-22 Delphi Technologies, Inc. Object tracking and eye state identification method
JP2006023949A (ja) * 2004-07-07 2006-01-26 Canon Inc 画像処理装置及び画像処理方法
US7922670B2 (en) 2005-02-24 2011-04-12 Warren Jones System and method for quantifying and mapping visual salience
WO2007092512A2 (en) * 2006-02-07 2007-08-16 Attention Technologies, Inc. Driver drowsiness and distraction monitor
JP5355399B2 (ja) 2006-07-28 2013-11-27 コーニンクレッカ フィリップス エヌ ヴェ 注視された商品の情報表示のための注視インタラクション
US8077914B1 (en) * 2006-08-07 2011-12-13 Arkady Kaplan Optical tracking apparatus using six degrees of freedom
JP5028073B2 (ja) * 2006-11-29 2012-09-19 株式会社ニデック 角膜手術装置
JP4780088B2 (ja) * 2007-11-09 2011-09-28 アイシン精機株式会社 顔画像撮像装置、顔画像撮像方法、及びそのプログラム
US8348429B2 (en) * 2008-03-27 2013-01-08 Doheny Eye Institute Optical coherence tomography device, method, and system
JP4888838B2 (ja) * 2008-05-12 2012-02-29 トヨタ自動車株式会社 運転者撮像装置および運転者撮像方法
ATE527934T1 (de) 2009-04-01 2011-10-15 Tobii Technology Ab Adaptive kamera und illuminator-eyetracker
EP2309307B1 (en) 2009-10-08 2020-12-09 Tobii Technology AB Eye tracking using a GPU
US9507418B2 (en) 2010-01-21 2016-11-29 Tobii Ab Eye tracker based contextual action

Also Published As

Publication number Publication date
CN105431078A (zh) 2016-03-23
CA2882413C (en) 2016-10-25
CN105431078B (zh) 2018-11-02
EP2975997A4 (en) 2016-12-14
US20150160726A1 (en) 2015-06-11
CA2882413A1 (en) 2014-09-25
EP2975997A1 (en) 2016-01-27
US9733703B2 (en) 2017-08-15
EP2975997B1 (en) 2023-07-12
JP2016512765A (ja) 2016-05-09
WO2014146199A1 (en) 2014-09-25

Similar Documents

Publication Publication Date Title
JP6577454B2 (ja) 軸上視線追跡システム及び方法
US11715231B2 (en) Head pose estimation from local eye region
JP6930223B2 (ja) 瞳孔検出用コンピュータプログラム、瞳孔検出装置及び瞳孔検出方法
Chen et al. Efficient and robust pupil size and blink estimation from near-field video sequences for human–machine interaction
CN112153363B (zh) 用于3d角膜位置估计的方法和系统
JP2022538669A (ja) 眼追跡待ち時間向上
TW202044828A (zh) 眼動追蹤裝置及其方法
JP6870474B2 (ja) 視線検出用コンピュータプログラム、視線検出装置及び視線検出方法
WO2021204211A1 (zh) 人脸和虹膜图像采集方法、装置、可读存储介质及设备
CN109658904B (zh) 一种屏幕亮度调节方法及装置
KR20120006819A (ko) 시선 추적 방법 및 이를 적용하는 장치
CN119847330B (zh) 一种ar设备的智能控制方法以及系统
US11163994B2 (en) Method and device for determining iris recognition image, terminal apparatus, and storage medium
JP2020191089A (ja) 顔生体の検出方法及び検出装置、電子機器、並びにコンピュータ読み取り可能な媒体
CN114092985A (zh) 一种终端控制方法、装置、终端及存储介质
US11156831B2 (en) Eye-tracking system and method for pupil detection, associated systems and computer programs
Khan et al. A new 3D eyeball tracking system to enhance the usability of page scrolling
CN112528713A (zh) 一种注视点估计方法、系统、处理器及设备
Kim et al. Eye detection for gaze tracker with near infrared illuminator
US20210350554A1 (en) Eye-tracking system
CN109522868A (zh) 一种检测眨眼的方法和装置
Kim et al. Computer interface using eye tracking for handicapped people
Wankhede et al. Real Time Eye Recognition

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160622

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170317

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170317

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170418

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180223

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180403

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180703

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20181204

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20190301

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190426

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20190723

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190822

R150 Certificate of patent or registration of utility model

Ref document number: 6577454

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250