KR102334139B1 - 적응적 호모그래피 매핑에 기초한 눈 시선 추적 - Google Patents

적응적 호모그래피 매핑에 기초한 눈 시선 추적 Download PDF

Info

Publication number
KR102334139B1
KR102334139B1 KR1020167026540A KR20167026540A KR102334139B1 KR 102334139 B1 KR102334139 B1 KR 102334139B1 KR 1020167026540 A KR1020167026540 A KR 1020167026540A KR 20167026540 A KR20167026540 A KR 20167026540A KR 102334139 B1 KR102334139 B1 KR 102334139B1
Authority
KR
South Korea
Prior art keywords
gaze
data
head
adaptive homography
adaptive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020167026540A
Other languages
English (en)
Korean (ko)
Other versions
KR20160138062A (ko
Inventor
젱유 쟝
퀸 카이
지쳉 리우
지아빈 후앙
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20160138062A publication Critical patent/KR20160138062A/ko
Application granted granted Critical
Publication of KR102334139B1 publication Critical patent/KR102334139B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G06K9/00604—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Multimedia (AREA)
  • Eye Examination Apparatus (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
KR1020167026540A 2014-03-26 2015-03-12 적응적 호모그래피 매핑에 기초한 눈 시선 추적 Expired - Fee Related KR102334139B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/226,467 2014-03-26
US14/226,467 US9684827B2 (en) 2014-03-26 2014-03-26 Eye gaze tracking based upon adaptive homography mapping
PCT/US2015/020178 WO2015179008A1 (en) 2014-03-26 2015-03-12 Eye gaze tracking based upon adaptive homography mapping

Publications (2)

Publication Number Publication Date
KR20160138062A KR20160138062A (ko) 2016-12-02
KR102334139B1 true KR102334139B1 (ko) 2021-12-03

Family

ID=54066176

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020167026540A Expired - Fee Related KR102334139B1 (ko) 2014-03-26 2015-03-12 적응적 호모그래피 매핑에 기초한 눈 시선 추적

Country Status (11)

Country Link
US (1) US9684827B2 (enExample)
EP (1) EP3123283B1 (enExample)
JP (1) JP6502370B2 (enExample)
KR (1) KR102334139B1 (enExample)
CN (1) CN106133648B (enExample)
AU (1) AU2015264699B2 (enExample)
CA (1) CA2940241C (enExample)
ES (1) ES2680825T3 (enExample)
MX (1) MX380962B (enExample)
RU (1) RU2685020C2 (enExample)
WO (1) WO2015179008A1 (enExample)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8885882B1 (en) * 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
US9465444B1 (en) * 2014-06-30 2016-10-11 Amazon Technologies, Inc. Object recognition for gesture tracking
JP6547268B2 (ja) * 2014-10-02 2019-07-24 富士通株式会社 視線位置検出装置、視線位置検出方法及び視線位置検出プログラム
RU2596062C1 (ru) * 2015-03-20 2016-08-27 Автономная Некоммерческая Образовательная Организация Высшего Профессионального Образования "Сколковский Институт Науки И Технологий" Способ коррекции изображения глаз с использованием машинного обучения и способ машинного обучения
US9990921B2 (en) * 2015-12-09 2018-06-05 Lenovo (Singapore) Pte. Ltd. User focus activated voice recognition
US10664949B2 (en) * 2016-04-22 2020-05-26 Intel Corporation Eye contact correction in real time using machine learning
US10423830B2 (en) * 2016-04-22 2019-09-24 Intel Corporation Eye contact correction in real time using neural network based machine learning
US10178948B2 (en) * 2016-05-11 2019-01-15 Miraco Light Inc. Self operatable ophthalmic device
JP2017211430A (ja) * 2016-05-23 2017-11-30 ソニー株式会社 情報処理装置および情報処理方法
DE102016210288A1 (de) 2016-06-10 2017-12-14 Volkswagen Aktiengesellschaft Bedienvorrichtung mit Eyetrackereinheit und Verfahren zum Kalibrieren einer Eyetrackereinheit einer Bedienvorrichtung
US11042984B2 (en) * 2016-11-10 2021-06-22 Movea Systems and methods for providing image depth information
KR20180061956A (ko) * 2016-11-30 2018-06-08 삼성전자주식회사 눈 위치 예측 방법 및 장치
US10152822B2 (en) 2017-04-01 2018-12-11 Intel Corporation Motion biased foveated renderer
US10319064B2 (en) 2017-04-10 2019-06-11 Intel Corporation Graphics anti-aliasing resolve with stencil mask
US11647903B2 (en) * 2017-06-01 2023-05-16 University Of Washington Smartphone-based digital pupillometer
US10810773B2 (en) * 2017-06-14 2020-10-20 Dell Products, L.P. Headset display control based upon a user's pupil state
CN107357429B (zh) * 2017-07-10 2020-04-07 京东方科技集团股份有限公司 用于确定视线的方法、设备和计算机可读存储介质
WO2019054598A1 (ko) * 2017-09-13 2019-03-21 주식회사 비주얼캠프 시선 추적 방법 및 이를 수행하기 위한 사용자 단말
US11181977B2 (en) 2017-11-17 2021-11-23 Dolby Laboratories Licensing Corporation Slippage compensation in eye tracking
US20190253700A1 (en) * 2018-02-15 2019-08-15 Tobii Ab Systems and methods for calibrating image sensors in wearable apparatuses
EP3540574B1 (en) * 2018-03-15 2021-08-11 HTC Corporation Eye tracking method, electronic device, and non-transitory computer readable storage medium
KR102094953B1 (ko) * 2018-03-28 2020-03-30 주식회사 비주얼캠프 시선 추적 방법 및 이를 수행하기 위한 단말
JP7118697B2 (ja) 2018-03-30 2022-08-16 株式会社Preferred Networks 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル
WO2019246613A1 (en) * 2018-06-22 2019-12-26 Magic Leap, Inc. Method and system for performing eye tracking using an off-axis camera
SE1851597A1 (en) * 2018-12-17 2020-06-02 Tobii Ab Gaze tracking via tracing of light paths
US11113842B2 (en) 2018-12-24 2021-09-07 Samsung Electronics Co., Ltd. Method and apparatus with gaze estimation
US11221671B2 (en) 2019-01-31 2022-01-11 Toyota Research Institute, Inc. Opengaze: gaze-tracking in the wild
CN112183160B (zh) * 2019-07-04 2024-08-13 北京七鑫易维科技有限公司 视线估计方法及装置
CN110647800B (zh) * 2019-08-06 2022-06-03 广东工业大学 一种基于深度学习的眼神交流检测方法
WO2021034961A1 (en) 2019-08-19 2021-02-25 Magic Leap, Inc. Eye tracking and gaze estimation using off-axis camera
JP7521220B2 (ja) * 2020-03-27 2024-07-24 日本電気株式会社 画像処理装置、視線推定装置、視線推定システム、画像処理方法およびプログラム
GB2596541B (en) * 2020-06-30 2023-09-13 Sony Interactive Entertainment Inc Video processing
CN113057860B (zh) * 2021-03-17 2023-06-27 上海海洋大学 一种基于物联网的眼部肌肉锻炼装置及使用方法
SE545952C2 (en) * 2022-03-31 2024-03-26 Tobii Ab Dynamic Camera Rotation Calibration
US11816260B2 (en) 2022-04-06 2023-11-14 Inseye Inc. System and method for continuous calibration of eye tracking systems used in VR/AR HMD units
US12465845B2 (en) * 2022-10-28 2025-11-11 Dell Products L.P. Information handling system head position detection for commanding an application function
CN116723308A (zh) * 2023-06-05 2023-09-08 人民百业科技有限公司 一种基于裸眼3d的瞳孔动态追踪方法与系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040174496A1 (en) 2003-03-06 2004-09-09 Qiang Ji Calibration-free gaze tracking under natural head movement
US20040227693A1 (en) 2003-05-14 2004-11-18 Darwin Rambo Integral eye-path alignment on telephony and computer video devices using two or more image sensing devices
US20110182472A1 (en) 2008-07-08 2011-07-28 Dan Witzner Hansen Eye gaze tracking

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6578962B1 (en) * 2001-04-27 2003-06-17 International Business Machines Corporation Calibration-free eye gaze tracking
US7515173B2 (en) * 2002-05-23 2009-04-07 Microsoft Corporation Head pose tracking system
US8159519B2 (en) * 2007-05-31 2012-04-17 Eastman Kodak Company Personal controls for personal video communications
US7742623B1 (en) * 2008-08-04 2010-06-22 Videomining Corporation Method and system for estimating gaze target, gaze sequence, and gaze map from video
CN102063624A (zh) * 2010-11-13 2011-05-18 天津大学 基于单应性约束的立体图像匹配方法
RU2455676C2 (ru) * 2011-07-04 2012-07-10 Общество с ограниченной ответственностью "ТРИДИВИ" Способ управления устройством с помощью жестов и 3d-сенсор для его осуществления
CN102567989A (zh) * 2011-11-30 2012-07-11 重庆大学 基于双目立体视觉的空间定位方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040174496A1 (en) 2003-03-06 2004-09-09 Qiang Ji Calibration-free gaze tracking under natural head movement
US20040227693A1 (en) 2003-05-14 2004-11-18 Darwin Rambo Integral eye-path alignment on telephony and computer video devices using two or more image sensing devices
US20110182472A1 (en) 2008-07-08 2011-07-28 Dan Witzner Hansen Eye gaze tracking

Also Published As

Publication number Publication date
JP2017523487A (ja) 2017-08-17
ES2680825T3 (es) 2018-09-11
CN106133648A (zh) 2016-11-16
CA2940241A1 (en) 2015-11-26
EP3123283B1 (en) 2018-04-25
EP3123283A1 (en) 2017-02-01
AU2015264699B2 (en) 2019-11-14
AU2015264699A1 (en) 2016-09-08
CA2940241C (en) 2023-01-17
MX380962B (es) 2025-03-12
MX2016012193A (es) 2017-01-05
JP6502370B2 (ja) 2019-04-17
US9684827B2 (en) 2017-06-20
RU2685020C2 (ru) 2019-04-16
US20150278599A1 (en) 2015-10-01
CN106133648B (zh) 2019-05-31
RU2016137779A3 (enExample) 2018-10-02
RU2016137779A (ru) 2018-03-23
WO2015179008A1 (en) 2015-11-26
KR20160138062A (ko) 2016-12-02

Similar Documents

Publication Publication Date Title
KR102334139B1 (ko) 적응적 호모그래피 매핑에 기초한 눈 시선 추적
EP3123279B1 (en) Eye gaze tracking using binocular fixation constraints
US8878749B1 (en) Systems and methods for position estimation
US9430040B2 (en) Eye gaze detection with multiple light sources and sensors
US20230169686A1 (en) Joint Environmental Reconstruction and Camera Calibration
KR101320683B1 (ko) 증강현실 기반의 디스플레이 보정 방법 및 모듈, 이를 이용한 객체정보 디스플레이 방법 및 시스템
Perra et al. Adaptive eye-camera calibration for head-worn devices
CN113378777B (zh) 基于单目摄像机的视线检测的方法和装置
CN117372545A (zh) 位姿信息确定方法及系统
KR20230066752A (ko) 영상 정보 수집 방법 및 장치

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

A201 Request for examination
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20241130

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

H13 Ip right lapsed

Free format text: ST27 STATUS EVENT CODE: N-4-6-H10-H13-OTH-PC1903 (AS PROVIDED BY THE NATIONAL OFFICE); TERMINATION CATEGORY : DEFAULT_OF_REGISTRATION_FEE

Effective date: 20241130

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20241130