KR20170003442A - 시선 추적 디바이스 및 상기 시선 추적 디바이스를 내장한 헤드 장착형 디바이스 - Google Patents

시선 추적 디바이스 및 상기 시선 추적 디바이스를 내장한 헤드 장착형 디바이스 Download PDF

Info

Publication number
KR20170003442A
KR20170003442A KR1020160081139A KR20160081139A KR20170003442A KR 20170003442 A KR20170003442 A KR 20170003442A KR 1020160081139 A KR1020160081139 A KR 1020160081139A KR 20160081139 A KR20160081139 A KR 20160081139A KR 20170003442 A KR20170003442 A KR 20170003442A
Authority
KR
South Korea
Prior art keywords
eye
light
tracking device
head
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
KR1020160081139A
Other languages
English (en)
Korean (ko)
Inventor
르노 도레
프랑크 갈빵
브누와 방담므
Original Assignee
톰슨 라이센싱
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 톰슨 라이센싱 filed Critical 톰슨 라이센싱
Publication of KR20170003442A publication Critical patent/KR20170003442A/ko
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/30—Polarising elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • H04N5/217—
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/957—Light-field or plenoptic cameras or camera modules

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Medical Informatics (AREA)
  • Eye Examination Apparatus (AREA)
  • Position Input By Displaying (AREA)
KR1020160081139A 2015-06-30 2016-06-28 시선 추적 디바이스 및 상기 시선 추적 디바이스를 내장한 헤드 장착형 디바이스 Withdrawn KR20170003442A (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP15306047.0A EP3112922A1 (en) 2015-06-30 2015-06-30 A gaze tracking device and a head mounted device embedding said gaze tracking device
EP15306047.0 2015-06-30

Publications (1)

Publication Number Publication Date
KR20170003442A true KR20170003442A (ko) 2017-01-09

Family

ID=53524700

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160081139A Withdrawn KR20170003442A (ko) 2015-06-30 2016-06-28 시선 추적 디바이스 및 상기 시선 추적 디바이스를 내장한 헤드 장착형 디바이스

Country Status (5)

Country Link
US (1) US20170004363A1 (enExample)
EP (1) EP3112922A1 (enExample)
JP (1) JP6850557B6 (enExample)
KR (1) KR20170003442A (enExample)
CN (1) CN106324831A (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20250377721A1 (en) * 2024-06-07 2025-12-11 Apple Inc. Camera field of view capturing eye reflection and eye views for gaze tracking
US12710816B2 (en) * 2025-05-23 2026-08-18 Apple Inc. Camera field of view capturing eye reflection and eye views for gaze tracking

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10120442B2 (en) * 2016-12-21 2018-11-06 Oculus Vr, Llc Eye tracking using a light field camera on a head-mounted display
US10108261B1 (en) * 2017-07-05 2018-10-23 Oculus Vr, Llc Eye tracking based on light polarization
CN107661085A (zh) * 2017-08-04 2018-02-06 上海志听医疗科技有限公司 一种实时收集眼动和头部位置及稳定性数据的方法
CN107661086A (zh) * 2017-08-04 2018-02-06 上海志听医疗科技有限公司 一种使用移动视觉记录设备收集眼睛运动数据的系统
CN107595291A (zh) * 2017-08-04 2018-01-19 上海志听医疗科技有限公司 一种安装到移动视觉记录设备的计算机可读介质
CN107515466B (zh) 2017-08-14 2019-11-26 华为技术有限公司 一种眼球追踪系统和眼球追踪方法
US20190129174A1 (en) * 2017-10-31 2019-05-02 Google Llc Multi-perspective eye-tracking for vr/ar systems
US10311584B1 (en) 2017-11-09 2019-06-04 Facebook Technologies, Llc Estimation of absolute depth from polarization measurements
US10725292B2 (en) * 2018-02-01 2020-07-28 Varjo Technologies Oy Gaze-tracking system and aperture device
WO2019154511A1 (en) 2018-02-09 2019-08-15 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters using a neural network
WO2019154509A1 (en) 2018-02-09 2019-08-15 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
EP3749172B2 (en) 2018-02-09 2025-01-01 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
CN121878981A (zh) * 2018-06-13 2026-04-17 托比股份公司 眼睛跟踪装置和制造眼睛跟踪装置的方法
EP3627194B1 (en) * 2018-09-20 2025-09-17 Essilor International An optical device with reduced reflection in deep red, near infrared and visible ranges
US11537202B2 (en) 2019-01-16 2022-12-27 Pupil Labs Gmbh Methods for generating calibration data for head-wearable devices and eye tracking system
EP3979896B1 (en) 2019-06-05 2024-11-13 Pupil Labs GmbH Devices, systems and methods for predicting gaze-related parameters
EP3987380B1 (en) 2019-06-18 2024-10-16 Pupil Labs GmbH Systems and methods for determining one or more parameters of a user's eye
CN112578556B (zh) * 2019-09-27 2023-02-21 托比股份公司 用于减少来自光学装置的不合需的反射的眼睛跟踪系统
US11073906B1 (en) * 2020-01-27 2021-07-27 Valve Corporation Eye tracking system for head-mounted display devices
US12140771B2 (en) 2020-02-19 2024-11-12 Pupil Labs Gmbh Eye tracking module and head-wearable device
CN113138664A (zh) * 2021-03-30 2021-07-20 青岛小鸟看看科技有限公司 基于光场感知的眼球追踪系统、方法

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2731896B1 (fr) * 1995-03-24 1997-08-29 Commissariat Energie Atomique Dispositif de mesure de la position du point de fixation d'un oeil sur une cible, procede d'eclairage de l'oeil et application a l'affichage d'images dont les images changent en fonction des mouvements de l'oeil
US6871951B2 (en) * 2000-06-23 2005-03-29 E-Vision, Llc Electro-optic lens with integrated components
US8228417B1 (en) * 2009-07-15 2012-07-24 Adobe Systems Incorporated Focused plenoptic camera employing different apertures or filtering at different microlenses
US20110170061A1 (en) * 2010-01-08 2011-07-14 Gordon Gary B Gaze Point Tracking Using Polarized Light
US8941559B2 (en) * 2010-09-21 2015-01-27 Microsoft Corporation Opacity filter for display device
JP5570386B2 (ja) * 2010-10-18 2014-08-13 パナソニック株式会社 注意状態判別システム、方法、コンピュータプログラムおよび注意状態判別装置
EP2731490B1 (en) * 2011-07-14 2015-01-21 Koninklijke Philips N.V. System and method for remote measurement of optical focus
JP6094106B2 (ja) * 2011-09-26 2017-03-15 大日本印刷株式会社 視線分析装置、視線計測システム、方法、プログラム、記録媒体
US8929589B2 (en) * 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8878749B1 (en) * 2012-01-06 2014-11-04 Google Inc. Systems and methods for position estimation
US9116337B1 (en) * 2012-03-21 2015-08-25 Google Inc. Increasing effective eyebox size of an HMD
WO2013167864A1 (en) 2012-05-11 2013-11-14 Milan Momcilo Popovich Apparatus for eye tracking
US8754829B2 (en) * 2012-08-04 2014-06-17 Paul Lapstun Scanning light field camera and display
JP5949319B2 (ja) * 2012-08-21 2016-07-06 富士通株式会社 視線検出装置及び視線検出方法
CA2882747A1 (en) * 2012-08-24 2014-02-27 Ic Inside Ltd Visual aid projector
EP2720464B1 (en) * 2012-10-11 2018-01-10 Sony Mobile Communications Inc. Generating image information
US9110503B2 (en) * 2012-11-30 2015-08-18 WorldViz LLC Precision position tracking device
US9665171B1 (en) * 2013-03-04 2017-05-30 Tobii Ab Gaze and saccade based graphical manipulation
US9060710B2 (en) * 2013-03-14 2015-06-23 Amo Wavefront Sciences, Llc. System and method for ocular tomography using plenoptic imaging
CN104113680B (zh) * 2013-04-19 2019-06-28 北京三星通信技术研究有限公司 视线跟踪系统及方法
WO2014186620A1 (en) * 2013-05-15 2014-11-20 The Johns Hopkins University Eye tracking and gaze fixation detection systems, components and methods using polarized light
EP3041400A1 (en) * 2013-09-03 2016-07-13 Tobii AB Portable eye tracking device
JP2015061595A (ja) * 2013-09-19 2015-04-02 ジーエヌ オトメトリックス エー／エスＧＮ Ｏｔｏｍｅｔｒｉｃｓ Ａ／Ｓ 目の動きを観察するためのヘッドギア
JP6144429B2 (ja) * 2013-12-09 2017-06-07 ゼンソモトリック インストゥルメンツ ゲゼルシャフト ヒューア イノベイティブ ゼンソリック エムベーハーＳＥＮＳＯＭＯＴＯＲＩＣ ＩＮＳＴＲＵＭＥＮＴＳ Ｇｅｓｅｌｌｓｃｈａｆｔ ｆｕｒ ｉｎｎｏｖａｔｉｖｅ Ｓｅｎｓｏｒｉｋ ｍｂＨ 目追跡のロバスト性を改善するアクティブ照明制御を行う目追跡装置動作方法及び目追跡装置
EP2886041A1 (en) * 2013-12-17 2015-06-24 ESSILOR INTERNATIONAL (Compagnie Générale d'Optique) Method for calibrating a head-mounted eye tracking device
EP3111421A1 (en) * 2014-02-25 2017-01-04 EyeVerify Inc. Eye gaze tracking
EP4173550A1 (en) * 2015-03-16 2023-05-03 Magic Leap, Inc. Diagnosing and treating health ailments

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20250377721A1 (en) * 2024-06-07 2025-12-11 Apple Inc. Camera field of view capturing eye reflection and eye views for gaze tracking
US12710816B2 (en) * 2025-05-23 2026-08-18 Apple Inc. Camera field of view capturing eye reflection and eye views for gaze tracking

Also Published As

Publication number Publication date
EP3112922A1 (en) 2017-01-04
JP6850557B6 (ja) 2021-05-26
JP6850557B2 (ja) 2021-03-31
JP2017012746A (ja) 2017-01-19
US20170004363A1 (en) 2017-01-05
CN106324831A (zh) 2017-01-11

Similar Documents

Publication Publication Date Title
JP6850557B6 (ja) 視線追跡デバイスおよび前記視線追跡デバイスを埋め込む頭部装着型デバイス
US10878236B2 (en) Eye tracking using time multiplexing
US10845606B1 (en) Eye tracking for a head mounted display including a pancake lens block
US10429927B1 (en) Eye tracking for a head mounted display including a pancake lens block
US10429657B1 (en) Eye tracking for a head mounted display including a pancake lens block
US11847257B2 (en) Position tracking system for head-mounted display systems
EP2889733A1 (en) Information input device
CN105531716A (zh) 显示设备中的近眼光学定位
US10338675B2 (en) Selective color sensing for motion tracking
US20180039327A1 (en) Information processing apparatus, information processing method, and program
CN105682539A (zh) 便携式眼睛追踪设备
KR20160075571A (ko) 재구성 가능한 프로젝트된 증강/가상 현실 기기를 위한 시스템 및 방법
US11933976B2 (en) Position tracking systems and methods for head-mounted display systems
US11327329B2 (en) Information processing apparatus and surface roughness acquisition method
US20210096368A1 (en) Head-mounted display apparatus and method employing dynamic eye calibration
US11747626B1 (en) Display system with extended display area
US12044846B2 (en) Position tracking systems and methods for head-mounted display systems
JP2020081557A (ja) 眼の角膜中心の位置を特定する装置、方法、及びプログラム

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20160628

PG1501 Laying open of application
N231 Notification of change of applicant
PN2301 Change of applicant

Patent event date: 20191023

Comment text: Notification of Change of Applicant

Patent event code: PN23011R01D

A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20210628

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20160628

Comment text: Patent Application

PC1202 Submission of document of withdrawal before decision of registration

Comment text: [Withdrawal of Procedure relating to Patent, etc.] Withdrawal (Abandonment)

Patent event code: PC12021R01D

Patent event date: 20221024

WITB Written withdrawal of application