CN105027144A - 用于无校准注视估计的方法和设备 - Google Patents

用于无校准注视估计的方法和设备 Download PDF

Info

Publication number
CN105027144A
CN105027144A CN201480010593.8A CN201480010593A CN105027144A CN 105027144 A CN105027144 A CN 105027144A CN 201480010593 A CN201480010593 A CN 201480010593A CN 105027144 A CN105027144 A CN 105027144A
Authority
CN
China
Prior art keywords
gaze
eye
attentively
pixel
watching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201480010593.8A
Other languages
English (en)
Chinese (zh)
Inventor
阮非邦
朱利安·弗勒罗
克里斯特尔·沙马雷
菲利普·古约泰尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CN105027144A publication Critical patent/CN105027144A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20024—Filtering details
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20061—Hough transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Image Analysis (AREA)
  • Eye Examination Apparatus (AREA)
  • Position Input By Displaying (AREA)
CN201480010593.8A 2013-02-27 2014-02-20 用于无校准注视估计的方法和设备 Pending CN105027144A (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP13305219.1 2013-02-27
EP13305219 2013-02-27
EP13306351 2013-09-30
EP13306351.1 2013-09-30
PCT/EP2014/053349 WO2014131690A1 (en) 2013-02-27 2014-02-20 Method and device for calibration-free gaze estimation

Publications (1)

Publication Number Publication Date
CN105027144A true CN105027144A (zh) 2015-11-04

Family

ID=50179590

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480010593.8A Pending CN105027144A (zh) 2013-02-27 2014-02-20 用于无校准注视估计的方法和设备

Country Status (6)

Country Link
US (1) US9965860B2 (enExample)
EP (1) EP2962251A1 (enExample)
JP (1) JP2016515242A (enExample)
KR (1) KR20150122666A (enExample)
CN (1) CN105027144A (enExample)
WO (1) WO2014131690A1 (enExample)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107422844A (zh) * 2017-03-27 2017-12-01 联想(北京)有限公司 一种信息处理方法及电子设备
CN108885784A (zh) * 2016-04-22 2018-11-23 英特尔公司 使用基于神经网络的机器学习的实时目光接触校正
CN110992250A (zh) * 2019-11-29 2020-04-10 京东方科技集团股份有限公司 一种实现高分辨率显示的方法及装置
CN113408511A (zh) * 2021-08-23 2021-09-17 南开大学 一种确定注视目标的方法、系统、设备及存储介质
CN114630099A (zh) * 2020-12-14 2022-06-14 京东方科技集团股份有限公司 显示方法、装置、系统及计算机可读存储介质

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10169661B2 (en) * 2014-03-28 2019-01-01 International Business Machines Corporation Filtering methods for visual object detection
EP3140716B1 (en) * 2014-05-08 2020-04-01 Sony Corporation Portable electronic equipment and method of controlling a portable electronic equipment
JP6495457B2 (ja) * 2014-12-16 2019-04-03 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 較正の改善、正確性の補償、及び注視定位平滑化を有する注視追跡システム
JP2016191845A (ja) * 2015-03-31 2016-11-10 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
CN104834852B (zh) * 2015-05-04 2018-07-13 惠州Tcl移动通信有限公司 一种移动终端基于高质量眼纹图像进行解锁的方法及系统
CN106293046B (zh) * 2015-06-30 2020-03-17 北京智谷睿拓技术服务有限公司 信息处理方法、信息处理装置及用户设备
CN106293045B (zh) * 2015-06-30 2019-09-10 北京智谷睿拓技术服务有限公司 显示控制方法、显示控制装置及用户设备
CN104951084B (zh) * 2015-07-30 2017-12-29 京东方科技集团股份有限公司 视线追踪方法及装置
EP3337385A4 (en) * 2015-08-21 2019-04-03 Magic Leap, Inc. EYELIDE FORMALIZATION USING EYE POST MEASUREMENT
EP3761232B1 (en) 2015-10-16 2025-12-03 Magic Leap, Inc. Eye pose identification using eye features
CN106709404B (zh) * 2015-11-16 2022-01-04 佳能株式会社 图像处理装置及图像处理方法
US11579686B2 (en) * 2016-03-07 2023-02-14 Apple Inc. Method and device for carrying out eye gaze mapping
KR102564479B1 (ko) * 2016-11-22 2023-08-07 삼성전자주식회사 사용자의 눈을 위한 3d 렌더링 방법 및 장치
CN106598258B (zh) * 2016-12-28 2019-04-16 北京七鑫易维信息技术有限公司 注视点映射函数确定方法及装置、注视点确定方法及装置
US10121337B2 (en) * 2016-12-30 2018-11-06 Axis Ab Gaze controlled bit rate
JP7009882B2 (ja) * 2017-09-26 2022-01-26 富士通株式会社 表示プログラム、表示方法、及び表示装置
US10957069B2 (en) * 2017-09-29 2021-03-23 Tobii Ab Head pose estimation from local eye region
CN108053444B (zh) * 2018-01-02 2021-03-12 京东方科技集团股份有限公司 瞳孔定位方法及装置、设备和存储介质
JP6821611B2 (ja) * 2018-01-22 2021-01-27 日本電信電話株式会社 推定装置、その方法、及びプログラム
EP3749172B2 (en) 2018-02-09 2025-01-01 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
EP3750028B1 (en) 2018-02-09 2022-10-19 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
WO2019154511A1 (en) 2018-02-09 2019-08-15 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters using a neural network
JP7118697B2 (ja) 2018-03-30 2022-08-16 株式会社Preferred Networks 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル
US11684305B2 (en) 2018-06-02 2023-06-27 Seyedhesam Sadeghian-Motahar Electrode array configuration on a flexible substrate for electro-oculogram recording
CN108932532A (zh) * 2018-07-11 2018-12-04 杭州电子科技大学 一种针对视频显著性图预测所需的眼动数据数目建议方法
EP3912013A1 (en) 2019-01-16 2021-11-24 Pupil Labs GmbH Methods for generating calibration data for head-wearable devices and eye tracking system
US20200250736A1 (en) * 2019-02-05 2020-08-06 Adroit Worldwide Media, Inc. Systems, method and apparatus for frictionless shopping
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
US11676422B2 (en) 2019-06-05 2023-06-13 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
US12353617B2 (en) 2019-06-18 2025-07-08 Pupil Labs Gmbh Systems and methods for determining one or more parameters of a user's eye
CN112183160B (zh) * 2019-07-04 2024-08-13 北京七鑫易维科技有限公司 视线估计方法及装置
US11169604B2 (en) 2019-11-15 2021-11-09 Tobii Ab Determination of gaze calibration parameters
US12140771B2 (en) 2020-02-19 2024-11-12 Pupil Labs Gmbh Eye tracking module and head-wearable device
US11847248B2 (en) 2020-12-16 2023-12-19 Cigna Intellectual Property, Inc. Automated viewpoint detection and screen obfuscation of secure content
US12340554B1 (en) * 2021-04-16 2025-06-24 Apple Inc. Triggering presentation of an object based on saliency
US12217424B2 (en) 2021-05-03 2025-02-04 NeuraLight Ltd. Determining digital markers indicative of a neurological condition using eye movement parameters
US12118825B2 (en) 2021-05-03 2024-10-15 NeuraLight Ltd. Obtaining high-resolution oculometric parameters
US12271519B2 (en) * 2021-06-08 2025-04-08 Huawei Technologies Co., Ltd. Systems, methods, and media for eye tracking using statistically derived linear functions
JP7633885B2 (ja) * 2021-06-08 2025-02-20 矢崎総業株式会社 視線推定システム
US12371072B2 (en) * 2021-09-28 2025-07-29 Honda Motor Co., Ltd. Operator take-over prediction
WO2023133072A2 (en) * 2022-01-07 2023-07-13 Jumio Corporation Biometric authentication using head-mounted devices
US12217421B2 (en) 2023-01-05 2025-02-04 NeuraLight Ltd. Point of gaze tracking with integrated calibration process
WO2024147106A1 (en) 2023-01-05 2024-07-11 NeuraLight Ltd. Estimating a delay from a monitor output to a sensor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6246779B1 (en) * 1997-12-12 2001-06-12 Kabushiki Kaisha Toshiba Gaze position detection apparatus and method
US20100208078A1 (en) * 2009-02-17 2010-08-19 Cisco Technology, Inc. Horizontal gaze estimation for video conferencing
CN102520796A (zh) * 2011-12-08 2012-06-27 华南理工大学 一种基于逐步回归分析映射模型的视线跟踪方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3069654A (en) 1960-03-25 1962-12-18 Paul V C Hough Method and means for recognizing complex patterns
KR20120118383A (ko) * 2011-04-18 2012-10-26 삼성전자주식회사 이미지 보정 장치 및 이를 이용하는 이미지 처리 장치와 그 방법들
CA2853709C (en) * 2011-10-27 2020-09-01 Tandemlaunch Technologies Inc. System and method for calibrating eye gaze data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6246779B1 (en) * 1997-12-12 2001-06-12 Kabushiki Kaisha Toshiba Gaze position detection apparatus and method
US20100208078A1 (en) * 2009-02-17 2010-08-19 Cisco Technology, Inc. Horizontal gaze estimation for video conferencing
CN102520796A (zh) * 2011-12-08 2012-06-27 华南理工大学 一种基于逐步回归分析映射模型的视线跟踪方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
KOUJI MIYAZATO等: ""Real-time estimation of human visual attention with dynamic bayesian network and MCMC-based particle filter"", 《PROCEEDINGS OF THE 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO》 *
刘俊，马燕，陈坤: ""一种改进的基于区域生长的彩色图像分割方法"", 《计算机应用与软件》 *
徐勇: ""基于DSP的疲劳驾驶监测方法研究"", 《中国优秀硕士学位论文全文数据库（电子期刊）》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108885784A (zh) * 2016-04-22 2018-11-23 英特尔公司 使用基于神经网络的机器学习的实时目光接触校正
CN108885784B (zh) * 2016-04-22 2024-01-05 英特尔公司 使用基于神经网络的机器学习的实时目光接触校正
CN107422844A (zh) * 2017-03-27 2017-12-01 联想(北京)有限公司 一种信息处理方法及电子设备
CN107422844B (zh) * 2017-03-27 2020-07-24 联想(北京)有限公司 一种信息处理方法及电子设备
CN110992250A (zh) * 2019-11-29 2020-04-10 京东方科技集团股份有限公司 一种实现高分辨率显示的方法及装置
CN114630099A (zh) * 2020-12-14 2022-06-14 京东方科技集团股份有限公司 显示方法、装置、系统及计算机可读存储介质
CN114630099B (zh) * 2020-12-14 2024-04-05 京东方科技集团股份有限公司 显示方法、装置、系统及计算机可读存储介质
CN113408511A (zh) * 2021-08-23 2021-09-17 南开大学 一种确定注视目标的方法、系统、设备及存储介质
CN113408511B (zh) * 2021-08-23 2021-11-12 南开大学 一种确定注视目标的方法、系统、设备及存储介质

Also Published As

Publication number Publication date
EP2962251A1 (en) 2016-01-06
KR20150122666A (ko) 2015-11-02
WO2014131690A1 (en) 2014-09-04
US9965860B2 (en) 2018-05-08
US20160005176A1 (en) 2016-01-07
JP2016515242A (ja) 2016-05-26

Similar Documents

Publication Publication Date Title
CN105027144A (zh) 用于无校准注视估计的方法和设备
US10109056B2 (en) Method for calibration free gaze tracking using low cost camera
Tonsen et al. A high-level description and performance evaluation of pupil invisible
Sugano et al. Appearance-based gaze estimation using visual saliency
Lin et al. Real-time eye-gaze estimation using a low-resolution webcam
US20170238860A1 (en) Mental state mood analysis using heart rate collection based on video imagery
US10254831B2 (en) System and method for detecting a gaze of a viewer
US9013591B2 (en) Method and system of determing user engagement and sentiment with learned models and user-facing camera images
Han et al. Spatial and temporal visual attention prediction in videos using eye movement data
CN113168700A (zh) 电子装置及其控制方法
JP2014191474A (ja) 集中度判定プログラム、集中度判定装置、および集中度判定方法
Khaleel et al. Best low-cost methods for real-time detection of the eye and gaze tracking
Yang et al. vGaze: Implicit saliency-aware calibration for continuous gaze tracking on mobile devices
Xiaowei et al. Object tracking with an evolutionary particle filter based on self-adaptive multi-features fusion
Guo et al. Appearance-based gaze estimation under slight head motion
Zhang et al. Eye gaze estimation and its applications
US12230053B2 (en) Automatic face and human subject enhancement algorithm for digital images
US9501710B2 (en) Systems, methods, and media for identifying object characteristics based on fixation points
EP2685351A1 (en) Method for calibration free gaze tracking using low cost camera
US20250225627A1 (en) Image aspect ratio enhancement using generative ai
Sj et al. Real-time eye tracking using representation learning and regression
Asghari et al. Can eye tracking with pervasive webcams replace dedicated eye trackers? An experimental comparison of eye-tracking performance
Yang et al. Spatialgaze: towards spatial gaze tracking for extended reality
Thamizharasan et al. Face attribute analysis from structured light: an end-to-end approach
Elahi et al. Webcam-based accurate eye-central localization

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20151104

WD01 Invention patent application deemed withdrawn after publication