CN106133752B - 眼睛注视跟踪 - Google Patents

眼睛注视跟踪 Download PDF

Info

Publication number
CN106133752B
CN106133752B CN201580016687.0A CN201580016687A CN106133752B CN 106133752 B CN106133752 B CN 106133752B CN 201580016687 A CN201580016687 A CN 201580016687A CN 106133752 B CN106133752 B CN 106133752B
Authority
CN
China
Prior art keywords
eye
stable
eyeball
image
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580016687.0A
Other languages
English (en)
Chinese (zh)
Other versions
CN106133752A (zh
Inventor
左使·K·萨里帕勒
R·R·德拉赫沙尼
维卡斯·格特木库拉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jumio Inc
Original Assignee
EyeVerify Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by EyeVerify Inc filed Critical EyeVerify Inc
Publication of CN106133752A publication Critical patent/CN106133752A/zh
Application granted granted Critical
Publication of CN106133752B publication Critical patent/CN106133752B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30041—Eye; Retina; Ophthalmic
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)
  • Eye Examination Apparatus (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
CN201580016687.0A 2014-02-25 2015-02-25 眼睛注视跟踪 Expired - Fee Related CN106133752B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201461944438P 2014-02-25 2014-02-25
US61/944,438 2014-02-25
PCT/US2015/017604 WO2015130849A1 (en) 2014-02-25 2015-02-25 Eye gaze tracking

Publications (2)

Publication Number Publication Date
CN106133752A CN106133752A (zh) 2016-11-16
CN106133752B true CN106133752B (zh) 2019-08-30

Family

ID=52669667

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580016687.0A Expired - Fee Related CN106133752B (zh) 2014-02-25 2015-02-25 眼睛注视跟踪

Country Status (8)

Country Link
US (1) US9939893B2 (enExample)
EP (1) EP3111421A1 (enExample)
JP (1) JP6329635B2 (enExample)
KR (1) KR101950562B1 (enExample)
CN (1) CN106133752B (enExample)
BR (1) BR112016019529B1 (enExample)
MY (1) MY180872A (enExample)
WO (1) WO2015130849A1 (enExample)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9529428B1 (en) * 2014-03-28 2016-12-27 Amazon Technologies, Inc. Using head movement to adjust focus on content of a display
EP3112922A1 (en) * 2015-06-30 2017-01-04 Thomson Licensing A gaze tracking device and a head mounted device embedding said gaze tracking device
US9857871B2 (en) 2015-09-04 2018-01-02 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
PH12018500541B1 (en) * 2015-09-11 2024-04-12 Jumio Corp Method and system for determining a quality metric in biometric authentication
US10445606B2 (en) * 2015-10-08 2019-10-15 Microsoft Technology Licensing, Llc Iris recognition
CN105577886A (zh) * 2015-12-16 2016-05-11 努比亚技术有限公司 移动终端解锁装置及方法
JP2017151556A (ja) * 2016-02-22 2017-08-31 富士通株式会社 電子機器、認証方法および認証プログラム
KR102370445B1 (ko) 2016-03-04 2022-03-03 매직 립, 인코포레이티드 Ar/vr 디스플레이 시스템들에서의 전류 드레인 감소
CN109154723B (zh) 2016-03-25 2021-08-17 奇跃公司 虚拟和增强现实系统和方法
US10372205B2 (en) * 2016-03-31 2019-08-06 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10169846B2 (en) 2016-03-31 2019-01-01 Sony Interactive Entertainment Inc. Selective peripheral vision filtering in a foveated rendering system
US10401952B2 (en) 2016-03-31 2019-09-03 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10192528B2 (en) 2016-03-31 2019-01-29 Sony Interactive Entertainment Inc. Real-time user adaptive foveated rendering
US10733275B1 (en) * 2016-04-01 2020-08-04 Massachusetts Mutual Life Insurance Company Access control through head imaging and biometric authentication
US10956544B1 (en) 2016-04-01 2021-03-23 Massachusetts Mutual Life Insurance Company Access control through head imaging and biometric authentication
WO2017205789A1 (en) 2016-05-27 2017-11-30 Pelz Jeff B System and method for eye tracking
JP6799063B2 (ja) * 2016-07-20 2020-12-09 富士フイルム株式会社 注目位置認識装置、撮像装置、表示装置、注目位置認識方法及びプログラム
KR102786437B1 (ko) 2016-10-05 2025-03-25 매직 립, 인코포레이티드 혼합 현실 교정을 위한 안구주위 테스트
CN106990839B (zh) * 2017-03-21 2020-06-05 张文庆 一种眼球识别多媒体播放器及其实现方法
CN107862673B (zh) * 2017-10-31 2021-08-24 北京小米移动软件有限公司 图像处理方法及装置
WO2019240157A1 (ja) * 2018-06-12 2019-12-19 国立大学法人筑波大学 眼球運動測定装置、眼球運動測定方法及び眼球運動測定プログラム
WO2020018938A1 (en) 2018-07-19 2020-01-23 Magic Leap, Inc. Content interaction driven by eye metrics
US11567336B2 (en) 2018-07-24 2023-01-31 Magic Leap, Inc. Display systems and methods for determining registration between display and eyes of user
TWI685772B (zh) * 2018-11-23 2020-02-21 國立臺灣大學 取得眼球追蹤位置的影像運算方法和其系統
JP2021039654A (ja) * 2019-09-05 2021-03-11 フリュー株式会社 画像処理装置、画像処理方法、およびプログラム
KR102879935B1 (ko) * 2019-10-16 2025-11-03 삼성디스플레이 주식회사 동공 검출 장치
CN110969084B (zh) * 2019-10-29 2021-03-05 深圳云天励飞技术有限公司 一种关注区域检测方法、装置、可读存储介质及终端设备
CN112883767B (zh) * 2019-11-29 2024-03-12 Oppo广东移动通信有限公司 眼跳图像的处理方法及相关产品
KR102396519B1 (ko) 2020-08-18 2022-05-11 고려대학교 산학협력단 Mri 환경에서 실시간 시야 변화 추적 기반 360° 파노라마 비디오 제공 방법, 이를 수행하기 위한 기록 매체 및 장치
CN116507267A (zh) * 2020-09-22 2023-07-28 苹果公司 用于视网膜眼睛跟踪的多个注视相关照明源
WO2023133072A2 (en) 2022-01-07 2023-07-13 Jumio Corporation Biometric authentication using head-mounted devices
IL300551A (en) * 2023-02-09 2024-09-01 Immersix Ltd Retina image reference database
CN115984952B (zh) * 2023-03-20 2023-11-24 杭州叶蓁科技有限公司 基于球结膜血管图像识别的眼动跟踪系统及其方法
CN119131873A (zh) * 2024-08-21 2024-12-13 天津牧瞳星科技有限公司 一种基于人工智能的眼部行为分析方法和系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1774207A (zh) * 2003-04-11 2006-05-17 博士伦公司 用于获取数据以及对准和跟踪眼睛的系统和方法
JP2008099716A (ja) * 2006-10-17 2008-05-01 Tokyo Institute Of Technology 眼球運動計測装置
CN101523895A (zh) * 2006-10-02 2009-09-02 索尼爱立信移动通讯有限公司 通过注视方向选择对焦区域
CN101861118A (zh) * 2007-11-16 2010-10-13 视瑞尔技术公司 用于发现和跟踪双眼的方法和装置
CN201767950U (zh) * 2009-10-22 2011-03-23 哈尔滨理工大学 球结膜微循环生物信息采集用眼球固定器
CN102245085A (zh) * 2008-10-14 2011-11-16 俄亥俄大学 利用眼跟踪的认知和语言评估

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2002361210A1 (en) * 2001-12-21 2003-07-09 Sensomotoric Instruments Gmbh Method and apparatus for eye registration
US20040196399A1 (en) * 2003-04-01 2004-10-07 Stavely Donald J. Device incorporating retina tracking
US9433345B2 (en) * 2012-02-24 2016-09-06 University Of Tsukuba Cycloduction measurement device, cycloduction measurement method, and cycloduction measurement program
US8369595B1 (en) 2012-08-10 2013-02-05 EyeVerify LLC Texture features for biometric authentication

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1774207A (zh) * 2003-04-11 2006-05-17 博士伦公司 用于获取数据以及对准和跟踪眼睛的系统和方法
CN101692979A (zh) * 2003-04-11 2010-04-14 博士伦公司 用于获取数据以及对准和跟踪眼睛的系统和方法
CN101523895A (zh) * 2006-10-02 2009-09-02 索尼爱立信移动通讯有限公司 通过注视方向选择对焦区域
JP2008099716A (ja) * 2006-10-17 2008-05-01 Tokyo Institute Of Technology 眼球運動計測装置
CN101861118A (zh) * 2007-11-16 2010-10-13 视瑞尔技术公司 用于发现和跟踪双眼的方法和装置
CN102245085A (zh) * 2008-10-14 2011-11-16 俄亥俄大学 利用眼跟踪的认知和语言评估
CN201767950U (zh) * 2009-10-22 2011-03-23 哈尔滨理工大学 球结膜微循环生物信息采集用眼球固定器

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
Adaptive Object Tracking for Improved Gaze Estimation Based on Fusion of Starburst Algorithm and Natural Features Tracking;Peter Bazanov;《9TH CONFERENCE OF OPEN INNOVATIONS COMMUNITY FRUCT》;20111231;全文 *
An Algorithm to Detect a Center of Pupil for Extraction of Point of Gaze;S. I. Kim et al.;《《Proceedings of the 26th Annual International Conference of the IEEE EMBS》》;20040905;第II节、图4 *
Aydın Kaya1 et al..Designing A Pattern Stabilization Method Using Scleral Blood Vessels For Laser Eye Surgery.《IEEE》.2010, *
Gaze estimation for near-eye display based on fusion of starburst algorithm and fern natural features;Peter Bazanov et al.;《Fruct Org》;20111231;第2.2节、图2 *
Subpixel Eye Gaze Tracking;Jie Zhu et al.;《IEEE》;20021231;第2.3节 *
一种可克服头动影响的视线跟踪系统;秦华标 等;《电子学报》;20131231;第41卷(第12期);摘要、第5.2节 *

Also Published As

Publication number Publication date
US20150241967A1 (en) 2015-08-27
BR112016019529A8 (pt) 2022-12-13
CN106133752A (zh) 2016-11-16
JP6329635B2 (ja) 2018-05-23
MY180872A (en) 2020-12-10
EP3111421A1 (en) 2017-01-04
WO2015130849A1 (en) 2015-09-03
BR112016019529A2 (enExample) 2017-08-15
US9939893B2 (en) 2018-04-10
KR101950562B1 (ko) 2019-02-20
KR20160124870A (ko) 2016-10-28
JP2017515182A (ja) 2017-06-08
BR112016019529B1 (pt) 2023-03-07

Similar Documents

Publication Publication Date Title
CN106133752B (zh) 眼睛注视跟踪
US10726260B2 (en) Feature extraction and matching for biometric authentication
KR102290392B1 (ko) 얼굴 등록 방법 및 장치, 얼굴 인식 방법 및 장치
Zhang et al. Fast and robust occluded face detection in ATM surveillance
Jillela et al. Iris segmentation for challenging periocular images
Gu et al. Feature local binary patterns with application to eye detection
Choi et al. Accurate eye pupil localization using heterogeneous CNN models
Bhoi et al. Template matching based eye detection in facial image
Roy et al. Improvement of iris recognition performance using region-based active contours, genetic algorithms and SVMs
HK1228074A1 (en) Eye gaze tracking
HK1228074B (zh) 眼睛注视跟踪
Mehrübeoglu et al. Real-time iris tracking with a smart camera
Ahmad et al. Precise eye center localization in a practical environment
Jung et al. A robust eye detection method in facial region
Ukpai et al. Pupil segmentation using active contour with shape prior
Pathak et al. Match score level fusion of iris and sclera descriptor for iris recognition
Shah et al. Iris segmentation and recognition for human identification
Wang et al. Hybrid iris center localization method using cascaded regression, weighted averaging, and weighted snakuscule

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1228074

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230113

Address after: California, USA

Patentee after: JUMIO Inc.

Address before: Missouri, USA

Patentee before: EYEVERIFY

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190830