CN107209551B - 用于注视跟踪的系统和方法 - Google Patents

用于注视跟踪的系统和方法 Download PDF

Info

Publication number
CN107209551B
CN107209551B CN201580054828.8A CN201580054828A CN107209551B CN 107209551 B CN107209551 B CN 107209551B CN 201580054828 A CN201580054828 A CN 201580054828A CN 107209551 B CN107209551 B CN 107209551B
Authority
CN
China
Prior art keywords
eye
image
illumination
reflection
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201580054828.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN107209551A (zh
Inventor
郭慧敏
I·埃登
V·萨克拉尔
D·Z·尼斯特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of CN107209551A publication Critical patent/CN107209551A/zh
Application granted granted Critical
Publication of CN107209551B publication Critical patent/CN107209551B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005—Input arrangements through a video camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141—Control of illumination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Eye Examination Apparatus (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
  • Eyeglasses (AREA)
  • Position Input By Displaying (AREA)
CN201580054828.8A 2014-10-08 2015-10-06 用于注视跟踪的系统和方法 Active CN107209551B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/509,976 US9946339B2 (en) 2014-10-08 2014-10-08 Gaze tracking through eyewear
US14/509,976 2014-10-08
PCT/US2015/054102 WO2016057435A1 (en) 2014-10-08 2015-10-06 Gaze tracking through eyewear

Publications (2)

Publication Number Publication Date
CN107209551A CN107209551A (zh) 2017-09-26
CN107209551B true CN107209551B (zh) 2020-08-25

Family

ID=54360538

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580054828.8A Active CN107209551B (zh) 2014-10-08 2015-10-06 用于注视跟踪的系统和方法

Country Status (11)

Country Link
US (1) US9946339B2 (https=)
EP (1) EP3204891B1 (https=)
JP (1) JP6560748B2 (https=)
KR (1) KR102455734B1 (https=)
CN (1) CN107209551B (https=)
AU (1) AU2015328317B2 (https=)
BR (1) BR112017005648A2 (https=)
CA (1) CA2964099C (https=)
MX (1) MX390316B (https=)
RU (1) RU2705432C2 (https=)
WO (1) WO2016057435A1 (https=)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107111863B (zh) * 2014-12-10 2020-11-17 瑞典爱立信有限公司 角膜成像的设备和方法
US20160300108A1 (en) * 2015-04-08 2016-10-13 Motorola Mobility Llc Iris acquisition using visible light imaging
EP3308188A4 (en) * 2015-06-09 2019-01-23 Nokia Technologies Oy MAKING THE IMPLEMENTATION OF AN ACTIVE SCAN
US9785234B2 (en) * 2015-12-26 2017-10-10 Intel Corporation Analysis of ambient light for gaze tracking
JP7532249B2 (ja) 2017-08-23 2024-08-13 ニューラブル インコーポレイテッド 高速視標追跡機能を有する脳－コンピュータインタフェース
KR102410834B1 (ko) * 2017-10-27 2022-06-20 삼성전자주식회사 반사 영역을 제거하는 방법, 사용자의 눈을 추적하는 방법 및 그 장치
WO2019094953A1 (en) 2017-11-13 2019-05-16 Neurable Inc. Brain-computer interface with adaptations for high-speed, accurate, and intuitive user interactions
WO2019144019A1 (en) 2018-01-18 2019-07-25 Neurable Inc. Brain-computer interface with adaptations for high-speed, accurate, and intuitive user interactions
US10725292B2 (en) * 2018-02-01 2020-07-28 Varjo Technologies Oy Gaze-tracking system and aperture device
US10288879B1 (en) 2018-05-31 2019-05-14 Tobii Ab Method and system for glint/reflection identification
US10324529B1 (en) 2018-05-31 2019-06-18 Tobii Ab Method and system for glint/reflection identification
CN112165894B (zh) * 2018-05-31 2024-07-19 托比股份公司 用于闪光/反射识别的方法和系统
EP3627194B1 (en) * 2018-09-20 2025-09-17 Essilor International An optical device with reduced reflection in deep red, near infrared and visible ranges
US10664050B2 (en) * 2018-09-21 2020-05-26 Neurable Inc. Human-computer interface using high-speed and accurate tracking of user interactions
KR102608471B1 (ko) 2018-11-06 2023-12-01 삼성전자주식회사 눈 추적 방법 및 장치
KR102349087B1 (ko) * 2019-10-10 2022-01-12 한국과학기술연구원 뇌-컴퓨터 인터페이스에 기반하여 로봇을 제어하는 방법 및 그에 따른 식사 보조 로봇의 제어 장치
CN113132643B (zh) * 2019-12-30 2023-02-07 Oppo广东移动通信有限公司 图像处理方法及相关产品
US11205069B1 (en) * 2020-02-20 2021-12-21 Facebook Technologies, Llc Hybrid cornea and pupil tracking
US12368965B2 (en) * 2020-07-16 2025-07-22 Nec Corporation Imaging system, imaging method, and computer program
CN116507949A (zh) 2020-09-22 2023-07-28 苹果公司 使用多区透镜的闪光分析
GB2618078A (en) * 2022-04-25 2023-11-01 Continental Automotive Tech Gmbh An image processing method for removal of glare spots and system for the same
US12469168B2 (en) * 2022-08-05 2025-11-11 Smart Eye Ab Low light gaze detection in a vehicle environment
KR20240169433A (ko) 2023-05-24 2024-12-03 (주)브이피소프트 아이웨어 착용시 시선 추적 방법

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103492979A (zh) * 2011-01-19 2014-01-01 马特奇克实验室 用于确定凝视方向的方法和设备

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5471542A (en) * 1993-09-27 1995-11-28 Ragland; Richard R. Point-of-gaze tracker
JP3465336B2 (ja) * 1994-02-04 2003-11-10 三菱電機株式会社 顔画像撮影装置
AUPP048097A0 (en) 1997-11-21 1997-12-18 Xenotech Research Pty Ltd Eye tracking apparatus
US6152563A (en) * 1998-02-20 2000-11-28 Hutchinson; Thomas E. Eye gaze direction tracker
US6134339A (en) * 1998-09-17 2000-10-17 Eastman Kodak Company Method and apparatus for determining the position of eyes and for correcting eye-defects in a captured frame
SE0004741D0 (sv) 2000-12-21 2000-12-21 Smart Eye Ab Image capturing device with reflex reduction
US7809160B2 (en) 2003-11-14 2010-10-05 Queen's University At Kingston Method and apparatus for calibration-free eye tracking using multiple glints or surface reflections
MXPA06011168A (es) * 2004-04-01 2007-04-16 William C Torch Biosensores, comunicadores, y controladores que verifican el movimiento del ojo y metodos para utilizarlos.
US7773111B2 (en) 2005-03-16 2010-08-10 Lc Technologies, Inc. System and method for perceived image processing in a gaze tracking system
US8457352B2 (en) 2007-05-23 2013-06-04 The University Of British Columbia Methods and apparatus for estimating point-of-gaze in three dimensions
PL2242419T3 (pl) * 2008-02-14 2016-05-31 Nokia Technologies Oy Urządzenie i sposób określania kierunku spojrzenia
US10178290B2 (en) 2010-02-17 2019-01-08 Sri International Method and apparatus for automatically acquiring facial, ocular, and iris images from moving subjects at long-range
US8888287B2 (en) * 2010-12-13 2014-11-18 Microsoft Corporation Human-computer interface system having a 3D gaze tracker
US8408706B2 (en) * 2010-12-13 2013-04-02 Microsoft Corporation 3D gaze tracker
RU2455676C2 (ru) * 2011-07-04 2012-07-10 Общество с ограниченной ответственностью "ТРИДИВИ" Способ управления устройством с помощью жестов и 3d-сенсор для его осуществления
WO2013036621A1 (en) * 2011-09-09 2013-03-14 Thales Avionics, Inc. Controlling vehicle entertainment systems responsive to sensed passenger gestures
US8971570B1 (en) * 2011-11-04 2015-03-03 Google Inc. Dual LED usage for glint detection
KR20130121303A (ko) * 2012-04-27 2013-11-06 한국전자통신연구원 원거리 시선 추적 시스템 및 방법
JP6011173B2 (ja) * 2012-09-06 2016-10-19 株式会社Ｊｖｃケンウッド 瞳孔検出装置および瞳孔検出方法
WO2014181775A1 (ja) * 2013-05-08 2014-11-13 国立大学法人静岡大学 瞳孔検出用光源装置、瞳孔検出装置及び瞳孔検出方法
KR20140147748A (ko) * 2013-06-19 2014-12-30 한국전자통신연구원 시력 보조 기구 착용시에도 안정적인 시선 추적 방법
US9468373B2 (en) * 2013-09-24 2016-10-18 Sony Interactive Entertainment Inc. Gaze tracking variations using dynamic lighting position
WO2015070182A2 (en) * 2013-11-09 2015-05-14 Firima Inc. Optical eye tracking
WO2015081325A1 (en) * 2013-11-27 2015-06-04 Shenzhen Huiding Technology Co., Ltd. Eye tracking and user reaction detection
US9454699B2 (en) * 2014-04-29 2016-09-27 Microsoft Technology Licensing, Llc Handling glare in eye tracking

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103492979A (zh) * 2011-01-19 2014-01-01 马特奇克实验室 用于确定凝视方向的方法和设备

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Gaze Tracking System for User Wearing Glasses;SU GWON ET AL;《SENSORS》;20140127;第14卷(第2期);图3 *
Improved Video-Based Eye-Gaze Detection Method;Yoshinobu Ebisawa;《Instrumentation & measurement Technology Conference IEEE》;19980831;第47卷(第4期);正文第II至V节 *
Yoshinobu Ebisawa.Improved Video-Based Eye-Gaze Detection Method.《Instrumentation & measurement Technology Conference IEEE》.1998,第47卷(第4期), *

Also Published As

Publication number Publication date
EP3204891B1 (en) 2021-08-18
US20160103484A1 (en) 2016-04-14
US9946339B2 (en) 2018-04-17
JP2017537366A (ja) 2017-12-14
BR112017005648A2 (pt) 2017-12-12
RU2017111831A (ru) 2018-10-09
EP3204891A1 (en) 2017-08-16
RU2705432C2 (ru) 2019-11-07
KR102455734B1 (ko) 2022-10-17
MX390316B (es) 2025-03-20
MX2017004450A (es) 2017-11-16
AU2015328317B2 (en) 2020-07-02
JP6560748B2 (ja) 2019-08-14
CN107209551A (zh) 2017-09-26
CA2964099C (en) 2023-01-24
AU2015328317A1 (en) 2017-04-13
WO2016057435A1 (en) 2016-04-14
CA2964099A1 (en) 2016-04-14
RU2017111831A3 (https=) 2019-04-25
KR20170070110A (ko) 2017-06-21

Similar Documents

Publication Publication Date Title
CN107209551B (zh) 用于注视跟踪的系统和方法
CN102566756B (zh) 用于扩展现实显示的基于理解力和意图的内容
US9128522B2 (en) Wink gesture input for a head-mountable device
KR102231910B1 (ko) 초점 이동에 반응하는 입체적 디스플레이
CN110266916B (zh) 用于在眼睛追踪中处理眩光的方法和系统
KR102366110B1 (ko) 번쩍임의 광원에의 매핑
JP2017513093A (ja) 注視の検出を介した遠隔デバイスの制御
JP2017534957A (ja) 眼の不快感を軽減させるディスプレイ
US9201512B1 (en) Proximity sensing for input detection
CN116529786A (zh) 多相机生物识别成像系统
CN116583885A (zh) 生物识别认证系统中的姿态优化
CN116529787A (zh) 多波长生物识别成像系统
CN116569221A (zh) 用于成像系统的灵活照明
CN114258279A (zh) 使用经调制的同轴照明的瞳孔评估
CN118103800A (zh) 使用人工现实头戴式视图器中的面向内的传感器检测眼睛的物理特性
CN116472564A (zh) 基于所获取图像的质量自动选择生物识别
US20260104313A1 (en) Prescription lens enrollment and switching for optical sensing systems
US9746915B1 (en) Methods and systems for calibrating a device
CN118140126A (zh) 使用反射识别透镜特性
CN116529700A (zh) 光学系统中的杂散光减轻
HK1234172B (zh) 在眼睛追踪中处理眩光
HK1171103B (en) Comprehension and intent-based content for augmented reality display
HK1234172A1 (en) Handling glare in eye tracking

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant