JP2016515242A - 校正不要な注視点推定の方法と装置 - Google Patents

校正不要な注視点推定の方法と装置 Download PDF

Info

Publication number
JP2016515242A
JP2016515242A JP2015559469A JP2015559469A JP2016515242A JP 2016515242 A JP2016515242 A JP 2016515242A JP 2015559469 A JP2015559469 A JP 2015559469A JP 2015559469 A JP2015559469 A JP 2015559469A JP 2016515242 A JP2016515242 A JP 2016515242A
Authority
JP
Japan
Prior art keywords
eye
gazing point
viewer
gaze
point position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
JP2015559469A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016515242A5 (enExample
Inventor
バン グエン，ファイ
バン グエン，ファイ
フルーレオ，ジュリアン
シャマレ，クリステル
ギヨテル，フィリップ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of JP2016515242A publication Critical patent/JP2016515242A/ja
Publication of JP2016515242A5 publication Critical patent/JP2016515242A5/ja
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20024—Filtering details
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20061—Hough transform
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Image Analysis (AREA)
  • Eye Examination Apparatus (AREA)
  • Position Input By Displaying (AREA)
JP2015559469A 2013-02-27 2014-02-20 校正不要な注視点推定の方法と装置 Withdrawn JP2016515242A (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP13305219.1 2013-02-27
EP13305219 2013-02-27
EP13306351 2013-09-30
EP13306351.1 2013-09-30
PCT/EP2014/053349 WO2014131690A1 (en) 2013-02-27 2014-02-20 Method and device for calibration-free gaze estimation

Publications (2)

Publication Number Publication Date
JP2016515242A true JP2016515242A (ja) 2016-05-26
JP2016515242A5 JP2016515242A5 (enExample) 2017-03-09

Family

ID=50179590

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015559469A Withdrawn JP2016515242A (ja) 2013-02-27 2014-02-20 校正不要な注視点推定の方法と装置

Country Status (6)

Country Link
US (1) US9965860B2 (enExample)
EP (1) EP2962251A1 (enExample)
JP (1) JP2016515242A (enExample)
KR (1) KR20150122666A (enExample)
CN (1) CN105027144A (enExample)
WO (1) WO2014131690A1 (enExample)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI662834B (zh) * 2016-12-30 2019-06-11 瑞典商安訊士有限公司 凝視控制位元率
JP2019126425A (ja) * 2018-01-22 2019-08-01 日本電信電話株式会社 推定装置、その方法、及びプログラム
US11341680B2 (en) 2018-03-30 2022-05-24 Preferred Networks, Inc. Gaze point estimation processing apparatus, gaze point estimation model generation apparatus, gaze point estimation processing system, and gaze point estimation processing method

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10169661B2 (en) * 2014-03-28 2019-01-01 International Business Machines Corporation Filtering methods for visual object detection
EP3140716B1 (en) * 2014-05-08 2020-04-01 Sony Corporation Portable electronic equipment and method of controlling a portable electronic equipment
JP6495457B2 (ja) * 2014-12-16 2019-04-03 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 較正の改善、正確性の補償、及び注視定位平滑化を有する注視追跡システム
JP2016191845A (ja) * 2015-03-31 2016-11-10 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
CN104834852B (zh) * 2015-05-04 2018-07-13 惠州Tcl移动通信有限公司 一种移动终端基于高质量眼纹图像进行解锁的方法及系统
CN106293046B (zh) * 2015-06-30 2020-03-17 北京智谷睿拓技术服务有限公司 信息处理方法、信息处理装置及用户设备
CN106293045B (zh) * 2015-06-30 2019-09-10 北京智谷睿拓技术服务有限公司 显示控制方法、显示控制装置及用户设备
CN104951084B (zh) * 2015-07-30 2017-12-29 京东方科技集团股份有限公司 视线追踪方法及装置
EP3337385A4 (en) * 2015-08-21 2019-04-03 Magic Leap, Inc. EYELIDE FORMALIZATION USING EYE POST MEASUREMENT
EP3761232B1 (en) 2015-10-16 2025-12-03 Magic Leap, Inc. Eye pose identification using eye features
CN106709404B (zh) * 2015-11-16 2022-01-04 佳能株式会社 图像处理装置及图像处理方法
US11579686B2 (en) * 2016-03-07 2023-02-14 Apple Inc. Method and device for carrying out eye gaze mapping
US10423830B2 (en) * 2016-04-22 2019-09-24 Intel Corporation Eye contact correction in real time using neural network based machine learning
KR102564479B1 (ko) * 2016-11-22 2023-08-07 삼성전자주식회사 사용자의 눈을 위한 3d 렌더링 방법 및 장치
CN106598258B (zh) * 2016-12-28 2019-04-16 北京七鑫易维信息技术有限公司 注视点映射函数确定方法及装置、注视点确定方法及装置
CN107422844B (zh) * 2017-03-27 2020-07-24 联想(北京)有限公司 一种信息处理方法及电子设备
JP7009882B2 (ja) * 2017-09-26 2022-01-26 富士通株式会社 表示プログラム、表示方法、及び表示装置
US10957069B2 (en) * 2017-09-29 2021-03-23 Tobii Ab Head pose estimation from local eye region
CN108053444B (zh) * 2018-01-02 2021-03-12 京东方科技集团股份有限公司 瞳孔定位方法及装置、设备和存储介质
EP3749172B2 (en) 2018-02-09 2025-01-01 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
EP3750028B1 (en) 2018-02-09 2022-10-19 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
WO2019154511A1 (en) 2018-02-09 2019-08-15 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters using a neural network
US11684305B2 (en) 2018-06-02 2023-06-27 Seyedhesam Sadeghian-Motahar Electrode array configuration on a flexible substrate for electro-oculogram recording
CN108932532A (zh) * 2018-07-11 2018-12-04 杭州电子科技大学 一种针对视频显著性图预测所需的眼动数据数目建议方法
EP3912013A1 (en) 2019-01-16 2021-11-24 Pupil Labs GmbH Methods for generating calibration data for head-wearable devices and eye tracking system
US20200250736A1 (en) * 2019-02-05 2020-08-06 Adroit Worldwide Media, Inc. Systems, method and apparatus for frictionless shopping
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
US11676422B2 (en) 2019-06-05 2023-06-13 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
US12353617B2 (en) 2019-06-18 2025-07-08 Pupil Labs Gmbh Systems and methods for determining one or more parameters of a user's eye
CN112183160B (zh) * 2019-07-04 2024-08-13 北京七鑫易维科技有限公司 视线估计方法及装置
US11169604B2 (en) 2019-11-15 2021-11-09 Tobii Ab Determination of gaze calibration parameters
CN110992250B (zh) * 2019-11-29 2024-06-14 京东方科技集团股份有限公司 一种实现高分辨率显示的方法及装置
US12140771B2 (en) 2020-02-19 2024-11-12 Pupil Labs Gmbh Eye tracking module and head-wearable device
CN114630099B (zh) * 2020-12-14 2024-04-05 京东方科技集团股份有限公司 显示方法、装置、系统及计算机可读存储介质
US11847248B2 (en) 2020-12-16 2023-12-19 Cigna Intellectual Property, Inc. Automated viewpoint detection and screen obfuscation of secure content
US12340554B1 (en) * 2021-04-16 2025-06-24 Apple Inc. Triggering presentation of an object based on saliency
US12217424B2 (en) 2021-05-03 2025-02-04 NeuraLight Ltd. Determining digital markers indicative of a neurological condition using eye movement parameters
US12118825B2 (en) 2021-05-03 2024-10-15 NeuraLight Ltd. Obtaining high-resolution oculometric parameters
US12271519B2 (en) * 2021-06-08 2025-04-08 Huawei Technologies Co., Ltd. Systems, methods, and media for eye tracking using statistically derived linear functions
JP7633885B2 (ja) * 2021-06-08 2025-02-20 矢崎総業株式会社 視線推定システム
CN113408511B (zh) * 2021-08-23 2021-11-12 南开大学 一种确定注视目标的方法、系统、设备及存储介质
US12371072B2 (en) * 2021-09-28 2025-07-29 Honda Motor Co., Ltd. Operator take-over prediction
WO2023133072A2 (en) * 2022-01-07 2023-07-13 Jumio Corporation Biometric authentication using head-mounted devices
US12217421B2 (en) 2023-01-05 2025-02-04 NeuraLight Ltd. Point of gaze tracking with integrated calibration process
WO2024147106A1 (en) 2023-01-05 2024-07-11 NeuraLight Ltd. Estimating a delay from a monitor output to a sensor

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3069654A (en) 1960-03-25 1962-12-18 Paul V C Hough Method and means for recognizing complex patterns
JP3361980B2 (ja) * 1997-12-12 2003-01-07 株式会社東芝 視線検出装置及びその方法
US20100208078A1 (en) * 2009-02-17 2010-08-19 Cisco Technology, Inc. Horizontal gaze estimation for video conferencing
KR20120118383A (ko) * 2011-04-18 2012-10-26 삼성전자주식회사 이미지 보정 장치 및 이를 이용하는 이미지 처리 장치와 그 방법들
CA2853709C (en) * 2011-10-27 2020-09-01 Tandemlaunch Technologies Inc. System and method for calibrating eye gaze data
CN102520796B (zh) * 2011-12-08 2014-10-08 华南理工大学 一种基于逐步回归分析映射模型的视线跟踪方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI662834B (zh) * 2016-12-30 2019-06-11 瑞典商安訊士有限公司 凝視控制位元率
JP2019126425A (ja) * 2018-01-22 2019-08-01 日本電信電話株式会社 推定装置、その方法、及びプログラム
US11341680B2 (en) 2018-03-30 2022-05-24 Preferred Networks, Inc. Gaze point estimation processing apparatus, gaze point estimation model generation apparatus, gaze point estimation processing system, and gaze point estimation processing method
US11748904B2 (en) 2018-03-30 2023-09-05 Preferred Networks, Inc. Gaze point estimation processing apparatus, gaze point estimation model generation apparatus, gaze point estimation processing system, and gaze point estimation processing method

Also Published As

Publication number Publication date
EP2962251A1 (en) 2016-01-06
KR20150122666A (ko) 2015-11-02
WO2014131690A1 (en) 2014-09-04
US9965860B2 (en) 2018-05-08
US20160005176A1 (en) 2016-01-07
CN105027144A (zh) 2015-11-04

Similar Documents

Publication Publication Date Title
JP2016515242A (ja) 校正不要な注視点推定の方法と装置
US10109056B2 (en) Method for calibration free gaze tracking using low cost camera
Tonsen et al. A high-level description and performance evaluation of pupil invisible
CN110460837B (zh) 具有中央凹显示器和注视预测的电子设备
Hosp et al. RemoteEye: An open-source high-speed remote eye tracker: Implementation insights of a pupil-and glint-detection algorithm for high-speed remote eye tracking
CN109086726B (zh) 一种基于ar智能眼镜的局部图像识别方法及系统
US8878749B1 (en) Systems and methods for position estimation
AU2015264699B2 (en) Eye gaze tracking based upon adaptive homography mapping
US10254831B2 (en) System and method for detecting a gaze of a viewer
EP3757878B1 (en) Head pose estimation
Sun et al. Real-time gaze estimation with online calibration
CN113168700A (zh) 电子装置及其控制方法
Cao et al. Gaze tracking on any surface with your phone
Satriawan et al. Predicting future eye gaze using inertial sensors
Yang et al. vGaze: Implicit saliency-aware calibration for continuous gaze tracking on mobile devices
Khaleel et al. Best low-cost methods for real-time detection of the eye and gaze tracking
Chhimpa et al. Revolutionizing Gaze-based Human-Computer Interaction using Iris Tracking: A Webcam-Based Low-Cost Approach with Calibration, Regression and Real-Time Re-calibration
Zhang et al. Eye gaze estimation and its applications
CN116430992A (zh) 针对视线追踪的隐式校准方法和装置
Palmero et al. Automatic mutual gaze detection in face-to-face dyadic interaction videos
US9501710B2 (en) Systems, methods, and media for identifying object characteristics based on fixation points
EP2685351A1 (en) Method for calibration free gaze tracking using low cost camera
Sj et al. Real-time eye tracking using representation learning and regression
NL2004878C2 (en) System and method for detecting a person's direction of interest, such as a person's gaze direction.
Elahi et al. Webcam-based accurate eye-central localization

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20151028

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170202

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170202

A761 Written withdrawal of application

Free format text: JAPANESE INTERMEDIATE CODE: A761

Effective date: 20170323