CN107106007B - 具有校准改进、准确度补偿和注视局部化平滑的注视跟踪系统 - Google Patents

具有校准改进、准确度补偿和注视局部化平滑的注视跟踪系统 Download PDF

Info

Publication number
CN107106007B
CN107106007B CN201580068833.4A CN201580068833A CN107106007B CN 107106007 B CN107106007 B CN 107106007B CN 201580068833 A CN201580068833 A CN 201580068833A CN 107106007 B CN107106007 B CN 107106007B
Authority
CN
China
Prior art keywords
gaze
calibration
noise
correction
zone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580068833.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN107106007A (zh
Inventor
K·卢
钱悦晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN107106007A publication Critical patent/CN107106007A/zh
Application granted granted Critical
Publication of CN107106007B publication Critical patent/CN107106007B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)
  • Position Input By Displaying (AREA)
  • Position Fixing By Use Of Radio Waves (AREA)
  • User Interface Of Digital Computer (AREA)
CN201580068833.4A 2014-12-16 2015-12-07 具有校准改进、准确度补偿和注视局部化平滑的注视跟踪系统 Expired - Fee Related CN107106007B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462092349P 2014-12-16 2014-12-16
US62/092,349 2014-12-16
PCT/IB2015/059390 WO2016097919A1 (en) 2014-12-16 2015-12-07 Gaze tracking system with calibration improvement, accuracy compensation, and gaze localization smoothing

Publications (2)

Publication Number Publication Date
CN107106007A CN107106007A (zh) 2017-08-29
CN107106007B true CN107106007B (zh) 2020-10-02

Family

ID=55022632

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580068833.4A Expired - Fee Related CN107106007B (zh) 2014-12-16 2015-12-07 具有校准改进、准确度补偿和注视局部化平滑的注视跟踪系统

Country Status (5)

Country Link
US (1) US10496160B2 (enExample)
EP (1) EP3234737B1 (enExample)
JP (1) JP6495457B2 (enExample)
CN (1) CN107106007B (enExample)
WO (1) WO2016097919A1 (enExample)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016072965A1 (en) * 2014-11-03 2016-05-12 Bayerische Motoren Werke Aktiengesellschaft Method and system for calibrating an eye tracking system
US11023038B2 (en) * 2015-03-05 2021-06-01 Sony Corporation Line of sight detection adjustment unit and control method
RU2596062C1 (ru) * 2015-03-20 2016-08-27 Автономная Некоммерческая Образовательная Организация Высшего Профессионального Образования "Сколковский Институт Науки И Технологий" Способ коррекции изображения глаз с использованием машинного обучения и способ машинного обучения
US10466780B1 (en) * 2015-10-26 2019-11-05 Pillantas Systems and methods for eye tracking calibration, eye vergence gestures for interface control, and visual aids therefor
ES2912310T3 (es) 2016-01-05 2022-05-25 Reald Spark Llc Corrección de la mirada en imágenes multivista
EP4009147B1 (en) * 2016-09-20 2024-12-25 Tobii AB Gaze and saccade based graphical manipulation
JP2019017988A (ja) * 2017-07-18 2019-02-07 富士通株式会社 視線位置検出プログラム、視線位置検出装置及び視線位置検出方法
EP3665553B1 (en) 2017-08-08 2023-12-13 RealD Spark, LLC Adjusting a digital representation of a head region
CN108038884B (zh) * 2017-11-01 2020-12-11 北京七鑫易维信息技术有限公司 校准方法、装置、存储介质和处理器
US11346833B2 (en) * 2018-01-17 2022-05-31 Schlumberger Technology Corporation Reservoir fluid characterization system
WO2019154511A1 (en) 2018-02-09 2019-08-15 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters using a neural network
EP3750028B1 (en) 2018-02-09 2022-10-19 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
EP3749172B2 (en) 2018-02-09 2025-01-01 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
US11017575B2 (en) 2018-02-26 2021-05-25 Reald Spark, Llc Method and system for generating data to provide an animated visual representation
CN108259887B (zh) * 2018-04-13 2020-01-31 宁夏大学 注视点校准方法及装置、注视点标定方法及装置
CN108969930B (zh) * 2018-06-25 2023-09-15 中国人民解放军火箭军工程大学 用于旋翼无人机灭火弹系统的瞄准装置及瞄准方法
EP3605287A1 (en) * 2018-07-31 2020-02-05 Nokia Technologies Oy An apparatus, method and computer program for adjusting output signals
TWI704501B (zh) * 2018-08-09 2020-09-11 宏碁股份有限公司 可由頭部操控的電子裝置與其操作方法
EP3912013A1 (en) 2019-01-16 2021-11-24 Pupil Labs GmbH Methods for generating calibration data for head-wearable devices and eye tracking system
US11676422B2 (en) 2019-06-05 2023-06-13 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
US12353617B2 (en) 2019-06-18 2025-07-08 Pupil Labs Gmbh Systems and methods for determining one or more parameters of a user's eye
US11347308B2 (en) * 2019-07-26 2022-05-31 Samsung Electronics Co., Ltd. Method and apparatus with gaze tracking
CN113253829B (zh) * 2020-02-10 2022-05-06 Oppo广东移动通信有限公司 眼球跟踪校准方法及相关产品
US12140771B2 (en) 2020-02-19 2024-11-12 Pupil Labs Gmbh Eye tracking module and head-wearable device
CN113395438B (zh) * 2020-03-12 2023-01-31 Oppo广东移动通信有限公司 眼球追踪技术的图像校正方法及相关装置
CN111399658B (zh) * 2020-04-24 2022-03-15 Oppo广东移动通信有限公司 眼球注视点的校准方法、装置、电子设备及存储介质
JP7572237B2 (ja) * 2020-12-28 2024-10-23 株式会社Subaru 視線キャリブレーションシステム
SE545129C2 (en) 2021-03-31 2023-04-11 Tobii Ab Method and system for eye-tracker calibration
US11998335B2 (en) 2021-04-19 2024-06-04 Microsoft Technology Licensing, Llc Systems and methods of capturing eye-gaze data
US11619993B2 (en) 2021-04-19 2023-04-04 Microsoft Technology Licensing, Llc Systems and methods for gaze-tracking
US12393269B2 (en) * 2022-03-28 2025-08-19 Apple Inc. Calibrating a gaze tracker
EP4508510A1 (en) * 2022-06-28 2025-02-19 Apple Inc. Gaze behavior detection
US12141350B2 (en) * 2022-07-08 2024-11-12 Tencent America LLC Vergence based gaze matching for mixed-mode immersive telepresence application

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5913079A (en) * 1995-07-31 1999-06-15 Canon Kabushiki Kaisha Optical apparatus having a line of sight detection device
US6152563A (en) * 1998-02-20 2000-11-28 Hutchinson; Thomas E. Eye gaze direction tracker
US6421064B1 (en) * 1997-04-30 2002-07-16 Jerome H. Lemelson System and methods for controlling automatic scrolling of information on a display screen
CN103501688A (zh) * 2011-03-18 2014-01-08 感官运动仪器创新传感器有限公司 注视点映射的方法和装置
CN103514462A (zh) * 2012-06-27 2014-01-15 株式会社读卖广告社 注视线测定方法、注视线测定装置、眼球回旋点测定方法及着眼点测定装置
WO2014051010A1 (ja) * 2012-09-28 2014-04-03 株式会社Ｊｖｃケンウッド 診断支援装置および診断支援方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090268045A1 (en) 2007-08-02 2009-10-29 Sudipto Sur Apparatus and methods for configuration and optimization of image sensors for gaze tracking applications
ES2880475T3 (es) 2009-04-01 2021-11-24 Tobii Ab Sistema de representación visual con iluminadores para el seguimiento de la mirada
WO2011117776A1 (en) 2010-03-22 2011-09-29 Koninklijke Philips Electronics N.V. System and method for tracking the point of gaze of an observer
US20120106793A1 (en) * 2010-10-29 2012-05-03 Gershenson Joseph A Method and system for improving the quality and utility of eye tracking data
WO2012083415A1 (en) 2010-11-15 2012-06-28 Tandemlaunch Technologies Inc. System and method for interacting with and analyzing media on a display using eye gaze tracking
JP5971061B2 (ja) * 2012-07-24 2016-08-17 株式会社Ｊｖｃケンウッド 注視点検出装置、注視点検出方法、診断支援装置、診断支援装置の作動方法およびプログラム
JP6014931B2 (ja) * 2012-09-06 2016-10-26 公立大学法人広島市立大学 視線計測方法
KR101438948B1 (ko) 2012-12-12 2014-09-11 현대자동차주식회사 시선 추적 제어 장치 및 방법
CN105027144A (zh) * 2013-02-27 2015-11-04 汤姆逊许可公司 用于无校准注视估计的方法和设备
GB2511868B (en) 2013-03-15 2020-07-15 Tobii Ab Eye/gaze tracker and method of tracking the position of an eye and/or a gaze point of a subject
JP6123694B2 (ja) * 2014-02-10 2017-05-10 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US9489739B2 (en) * 2014-08-13 2016-11-08 Empire Technology Development Llc Scene analysis for improved eye tracking

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5913079A (en) * 1995-07-31 1999-06-15 Canon Kabushiki Kaisha Optical apparatus having a line of sight detection device
US6421064B1 (en) * 1997-04-30 2002-07-16 Jerome H. Lemelson System and methods for controlling automatic scrolling of information on a display screen
US6152563A (en) * 1998-02-20 2000-11-28 Hutchinson; Thomas E. Eye gaze direction tracker
CN103501688A (zh) * 2011-03-18 2014-01-08 感官运动仪器创新传感器有限公司 注视点映射的方法和装置
CN103514462A (zh) * 2012-06-27 2014-01-15 株式会社读卖广告社 注视线测定方法、注视线测定装置、眼球回旋点测定方法及着眼点测定装置
WO2014051010A1 (ja) * 2012-09-28 2014-04-03 株式会社Ｊｖｃケンウッド 診断支援装置および診断支援方法

Also Published As

Publication number Publication date
JP6495457B2 (ja) 2019-04-03
WO2016097919A1 (en) 2016-06-23
EP3234737A1 (en) 2017-10-25
US20170364149A1 (en) 2017-12-21
JP2017537730A (ja) 2017-12-21
US10496160B2 (en) 2019-12-03
EP3234737B1 (en) 2019-04-10
CN107106007A (zh) 2017-08-29

Similar Documents

Publication Publication Date Title
CN107106007B (zh) 具有校准改进、准确度补偿和注视局部化平滑的注视跟踪系统
CN110502099B (zh) 可靠地检测注视与刺激之间的关联的方法
US10650533B2 (en) Apparatus and method for estimating eye gaze location
US7657062B2 (en) Self-calibration for an eye tracker
JP5189057B2 (ja) 視線追跡方法及び視線追跡システム
JP7659148B2 (ja) アイトラッキングデバイスおよび方法
CN111124104B (zh) 使用瞳孔中心位置的映射进行注视跟踪
JP6684728B2 (ja) 画素配分最適化を用いた方法およびディスプレイ装置
US12141343B2 (en) Personalized calibration-independent regional fixation prediction for simultaneous users of a digital display
EP3948402A2 (en) Pupil tracking system and method, and digital display device and digital image rendering system and method using same
JP2019527377A (ja) 視線追跡に基づき自動合焦する画像捕捉システム、デバイス及び方法
WO2019153370A1 (en) 3d gazing point detection by binocular homography mapping
US20150309567A1 (en) Device and method for tracking gaze
WO2013175701A1 (ja) 映像解析装置、映像解析方法、および注視点表示システム
JP2014188322A (ja) 視線検出装置、視線検出方法及びプログラム
US20140085189A1 (en) Line-of-sight detection apparatus, line-of-sight detection method, and program therefor
TWI705354B (zh) 眼球追蹤裝置及其光源控制方法
CN108592865A (zh) 基于ar设备的几何量测量方法及其装置、ar设备
CN106537217A (zh) 宽视野深度成像
Lander et al. hEYEbrid: A hybrid approach for mobile calibration-free gaze estimation
Weigle et al. Analysis of eye-tracking experiments performed on a Tobii T60
JP7423005B2 (ja) 瞳孔径変化を用いた視線計測用キャリブレーション方法及び装置、並びに視線計測装置及びカメラ装置
WO2022079587A1 (ja) 視点検出装置、キャリブレーション方法及びプログラム
EP4160362B1 (en) Gaze defect compensation
Blignaut The effect of real-time headbox adjustments on data quality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201002

CF01 Termination of patent right due to non-payment of annual fee