JP6850557B2 - 視線追跡デバイスおよび前記視線追跡デバイスを埋め込む頭部装着型デバイス - Google Patents
視線追跡デバイスおよび前記視線追跡デバイスを埋め込む頭部装着型デバイス Download PDFInfo
- Publication number
- JP6850557B2 JP6850557B2 JP2016124627A JP2016124627A JP6850557B2 JP 6850557 B2 JP6850557 B2 JP 6850557B2 JP 2016124627 A JP2016124627 A JP 2016124627A JP 2016124627 A JP2016124627 A JP 2016124627A JP 6850557 B2 JP6850557 B2 JP 6850557B2
- Authority
- JP
- Japan
- Prior art keywords
- light
- line
- head
- sight tracking
- tracking device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0176—Head mounted characterised by mechanical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/30—Polarising elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/957—Light-field or plenoptic cameras or camera modules
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Signal Processing (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Heart & Thoracic Surgery (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Eye Examination Apparatus (AREA)
- Position Input By Displaying (AREA)
Description
− 前記視線追跡デバイスの使用者の目の表面上に赤外光を投影するように構成された複数の光源と、
− 上記使用者の上記目の上記表面から反射された上記赤外光を捕捉するライトフィールドカメラと、
を備える。
− 前記視線追跡デバイスの使用者の目の表面上に赤外光を投影するように構成された複数の光源と、
− 上記使用者の上記目の上記表面から反射された上記赤外光を捕捉するライトフィールドカメラと、
を備える。
上述の実施形態の一部又は全部は、以下の付記のように記載され得るが、以下には限定されない。
(付記1)
視線追跡デバイスであって、
視線追跡デバイスの使用者の目の表面上に赤外光を投影するように構成された複数の光源と、
使用者の目の表面から反射された赤外光を捕捉するライトフィールドカメラと、
を備える、視線追跡デバイス。
(付記2)
光源は、使用者の目の視野の周辺部に配置される、付記1に記載の視線追跡デバイス。
(付記3)
ライトフィールドカメラは、使用者の目の視野の周辺部に配置される、付記1または2に記載の視線追跡デバイス。
(付記4)
光源は、偏光された赤外光を放出する、付記1乃至3のいずれか一項に記載の視線追跡デバイス。
(付記5)
少なくともライトフィールドカメラのマイクロレンズアレイのマイクロレンズに、偏光フィルターが装備される、付記1乃至3のいずれか一項に記載の視線追跡デバイス。
(付記6)
少なくとも1つの視線追跡デバイスを備える頭部装着型デバイスであって、
視線追跡デバイスの使用者の目の表面上に赤外光を投影するように構成された複数の光源と、
使用者の目の表面から反射された赤外光を捕捉するライトフィールドカメラと、
を備える、頭部装着型デバイス。
(付記7)
光源は、頭部装着型デバイスのフレームの縁上に配置される、付記6に記載の頭部装着型デバイス。
(付記8)
ライトフィールドカメラは、頭部装着型デバイスのフレームの縁上に配置される、付記6または7に記載の頭部装着型デバイス。
(付記9)
ライトフィールドカメラは、頭部装着型デバイスのフレームの側部上に埋め込まれる、付記8に記載の頭部装着型デバイス。
Claims (8)
- 視線追跡デバイスであって、
前記視線追跡デバイスの使用者の目の表面上に赤外光を投影するように構成された複数の光源と、
前記使用者の前記目の前記表面から反射された前記赤外光を捕捉するための複数のマイクロレンズを有するマイクロレンズアレイを含むライトフィールドカメラであって、前記マイクロレンズアレイの少なくとも一つのマイクロレンズに偏光フィルターが装備される、ライトフィールドカメラと、
を備える、前記視線追跡デバイス。 - 前記光源は、前記使用者の前記目の視野の周辺部に配置される、請求項1に記載の視線追跡デバイス。
- 前記ライトフィールドカメラは、前記使用者の前記目の視野の周辺部に配置される、請求項1または2に記載の視線追跡デバイス。
- 前記光源は、偏光された赤外光を放出する、請求項1乃至3のいずれか一項に記載の視線追跡デバイス。
- 少なくとも1つの視線追跡デバイスを備える頭部装着型デバイスであって、
前記視線追跡デバイスの使用者の目の表面上に赤外光を投影するように構成された複数の光源と、
前記使用者の前記目の前記表面から反射された前記赤外光を捕捉するための複数のマイクロレンズを有するマイクロレンズアレイを含むライトフィールドカメラであって、前記マイクロレンズアレイの少なくとも一つのマイクロレンズに偏光フィルターが装備される、ライトフィールドカメラと、
を備える、前記頭部装着型デバイス。 - 前記光源は、前記頭部装着型デバイスのフレームの縁上に配置される、請求項5に記載の頭部装着型デバイス。
- 前記ライトフィールドカメラは、前記頭部装着型デバイスの前記フレームの前記縁上に配置される、請求項5または6に記載の頭部装着型デバイス。
- 前記ライトフィールドカメラは、前記頭部装着型デバイスの前記フレームの側部上に埋め込まれる、請求項7に記載の頭部装着型デバイス。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP15306047.0 | 2015-06-30 | ||
EP15306047.0A EP3112922A1 (en) | 2015-06-30 | 2015-06-30 | A gaze tracking device and a head mounted device embedding said gaze tracking device |
Publications (4)
Publication Number | Publication Date |
---|---|
JP2017012746A JP2017012746A (ja) | 2017-01-19 |
JP2017012746A5 JP2017012746A5 (ja) | 2019-07-25 |
JP6850557B2 true JP6850557B2 (ja) | 2021-03-31 |
JP6850557B6 JP6850557B6 (ja) | 2021-05-26 |
Family
ID=53524700
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2016124627A Active JP6850557B6 (ja) | 2015-06-30 | 2016-06-23 | 視線追跡デバイスおよび前記視線追跡デバイスを埋め込む頭部装着型デバイス |
Country Status (5)
Country | Link |
---|---|
US (1) | US20170004363A1 (ja) |
EP (1) | EP3112922A1 (ja) |
JP (1) | JP6850557B6 (ja) |
KR (1) | KR20170003442A (ja) |
CN (1) | CN106324831A (ja) |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10120442B2 (en) * | 2016-12-21 | 2018-11-06 | Oculus Vr, Llc | Eye tracking using a light field camera on a head-mounted display |
US10108261B1 (en) * | 2017-07-05 | 2018-10-23 | Oculus Vr, Llc | Eye tracking based on light polarization |
CN107595291A (zh) * | 2017-08-04 | 2018-01-19 | 上海志听医疗科技有限公司 | 一种安装到移动视觉记录设备的计算机可读介质 |
CN107661085A (zh) * | 2017-08-04 | 2018-02-06 | 上海志听医疗科技有限公司 | 一种实时收集眼动和头部位置及稳定性数据的方法 |
CN107661086A (zh) * | 2017-08-04 | 2018-02-06 | 上海志听医疗科技有限公司 | 一种使用移动视觉记录设备收集眼睛运动数据的系统 |
CN107515466B (zh) * | 2017-08-14 | 2019-11-26 | 华为技术有限公司 | 一种眼球追踪系统和眼球追踪方法 |
US20190129174A1 (en) * | 2017-10-31 | 2019-05-02 | Google Llc | Multi-perspective eye-tracking for vr/ar systems |
US10311584B1 (en) | 2017-11-09 | 2019-06-04 | Facebook Technologies, Llc | Estimation of absolute depth from polarization measurements |
US10725292B2 (en) * | 2018-02-01 | 2020-07-28 | Varjo Technologies Oy | Gaze-tracking system and aperture device |
EP3749172B1 (en) | 2018-02-09 | 2022-03-30 | Pupil Labs GmbH | Devices, systems and methods for predicting gaze-related parameters |
EP3750028B1 (en) | 2018-02-09 | 2022-10-19 | Pupil Labs GmbH | Devices, systems and methods for predicting gaze-related parameters |
WO2019154511A1 (en) | 2018-02-09 | 2019-08-15 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters using a neural network |
EP3582077A1 (en) | 2018-06-13 | 2019-12-18 | Tobii AB | Eye tracking device and method for manufacturing an eye tracking device |
EP3627194A1 (en) * | 2018-09-20 | 2020-03-25 | Essilor International | An optical device with reduced reflection in deep red, near infrared and visible ranges |
EP3912013A1 (en) | 2019-01-16 | 2021-11-24 | Pupil Labs GmbH | Methods for generating calibration data for head-wearable devices and eye tracking system |
US11676422B2 (en) | 2019-06-05 | 2023-06-13 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters |
CN112578556B (zh) * | 2019-09-27 | 2023-02-21 | 托比股份公司 | 用于减少来自光学装置的不合需的反射的眼睛跟踪系统 |
CN113138664A (zh) * | 2021-03-30 | 2021-07-20 | 青岛小鸟看看科技有限公司 | 基于光场感知的眼球追踪系统、方法 |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2731896B1 (fr) * | 1995-03-24 | 1997-08-29 | Commissariat Energie Atomique | Dispositif de mesure de la position du point de fixation d'un oeil sur une cible, procede d'eclairage de l'oeil et application a l'affichage d'images dont les images changent en fonction des mouvements de l'oeil |
US6871951B2 (en) * | 2000-06-23 | 2005-03-29 | E-Vision, Llc | Electro-optic lens with integrated components |
US8228417B1 (en) * | 2009-07-15 | 2012-07-24 | Adobe Systems Incorporated | Focused plenoptic camera employing different apertures or filtering at different microlenses |
US20110170061A1 (en) * | 2010-01-08 | 2011-07-14 | Gordon Gary B | Gaze Point Tracking Using Polarized Light |
US8941559B2 (en) * | 2010-09-21 | 2015-01-27 | Microsoft Corporation | Opacity filter for display device |
JP5570386B2 (ja) * | 2010-10-18 | 2014-08-13 | パナソニック株式会社 | 注意状態判別システム、方法、コンピュータプログラムおよび注意状態判別装置 |
RU2612500C2 (ru) * | 2011-07-14 | 2017-03-09 | Конинклейке Филипс Н.В. | Система и способ для удаленного измерения оптического фокуса |
JP6094106B2 (ja) * | 2011-09-26 | 2017-03-15 | 大日本印刷株式会社 | 視線分析装置、視線計測システム、方法、プログラム、記録媒体 |
US8929589B2 (en) * | 2011-11-07 | 2015-01-06 | Eyefluence, Inc. | Systems and methods for high-resolution gaze tracking |
US8913789B1 (en) * | 2012-01-06 | 2014-12-16 | Google Inc. | Input methods and systems for eye positioning using plural glints |
US9116337B1 (en) * | 2012-03-21 | 2015-08-25 | Google Inc. | Increasing effective eyebox size of an HMD |
WO2013167864A1 (en) | 2012-05-11 | 2013-11-14 | Milan Momcilo Popovich | Apparatus for eye tracking |
JP5949319B2 (ja) * | 2012-08-21 | 2016-07-06 | 富士通株式会社 | 視線検出装置及び視線検出方法 |
RU2015108858A (ru) * | 2012-08-24 | 2016-10-20 | Ай Си ИНСАЙД ЛТД | Проектор для коррекции зрения |
EP2720464B1 (en) * | 2012-10-11 | 2018-01-10 | Sony Mobile Communications Inc. | Generating image information |
US9110503B2 (en) * | 2012-11-30 | 2015-08-18 | WorldViz LLC | Precision position tracking device |
US9665171B1 (en) * | 2013-03-04 | 2017-05-30 | Tobii Ab | Gaze and saccade based graphical manipulation |
US9060710B2 (en) * | 2013-03-14 | 2015-06-23 | Amo Wavefront Sciences, Llc. | System and method for ocular tomography using plenoptic imaging |
CN104113680B (zh) * | 2013-04-19 | 2019-06-28 | 北京三星通信技术研究有限公司 | 视线跟踪系统及方法 |
WO2014186620A1 (en) * | 2013-05-15 | 2014-11-20 | The Johns Hopkins University | Eye tracking and gaze fixation detection systems, components and methods using polarized light |
KR101926942B1 (ko) * | 2013-09-03 | 2019-03-07 | 토비 에이비 | 휴대용 눈 추적 디바이스 |
JP2015061595A (ja) * | 2013-09-19 | 2015-04-02 | ジーエヌ オトメトリックス エー/エスGN Otometrics A/S | 目の動きを観察するためのヘッドギア |
CN105828700B (zh) * | 2013-12-09 | 2018-07-06 | Smi创新传感技术有限公司 | 操作眼睛跟踪装置的方法和提供主动照明控制用于改进的眼睛跟踪稳定性的眼睛跟踪装置 |
EP2886041A1 (en) * | 2013-12-17 | 2015-06-24 | ESSILOR INTERNATIONAL (Compagnie Générale d'Optique) | Method for calibrating a head-mounted eye tracking device |
JP6329635B2 (ja) * | 2014-02-25 | 2018-05-23 | アイベリファイ インコーポレイテッド | 視線追跡 |
NZ773822A (en) * | 2015-03-16 | 2022-07-29 | Magic Leap Inc | Methods and systems for diagnosing and treating health ailments |
-
2015
- 2015-06-30 EP EP15306047.0A patent/EP3112922A1/en active Pending
-
2016
- 2016-06-23 JP JP2016124627A patent/JP6850557B6/ja active Active
- 2016-06-27 CN CN201610478798.XA patent/CN106324831A/zh active Pending
- 2016-06-28 KR KR1020160081139A patent/KR20170003442A/ko not_active Application Discontinuation
- 2016-06-30 US US15/197,927 patent/US20170004363A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
JP2017012746A (ja) | 2017-01-19 |
CN106324831A (zh) | 2017-01-11 |
EP3112922A1 (en) | 2017-01-04 |
JP6850557B6 (ja) | 2021-05-26 |
KR20170003442A (ko) | 2017-01-09 |
US20170004363A1 (en) | 2017-01-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6850557B2 (ja) | 視線追跡デバイスおよび前記視線追跡デバイスを埋め込む頭部装着型デバイス | |
US10878236B2 (en) | Eye tracking using time multiplexing | |
JP7057454B2 (ja) | 改良されたカメラ較正システム、標的、およびプロセス | |
US10845606B1 (en) | Eye tracking for a head mounted display including a pancake lens block | |
US10349038B2 (en) | Dynamic control over structured illumination intensity | |
EP3371973B1 (en) | Eye tracking using a diffraction pattern of coherent light on the surface of the eye | |
US10429927B1 (en) | Eye tracking for a head mounted display including a pancake lens block | |
US9560345B2 (en) | Camera calibration | |
US10168531B1 (en) | Lightfield waveguide integrated eye tracking | |
US9285893B2 (en) | Object detection and tracking with variable-field illumination devices | |
EP3353632A1 (en) | Eye-tracking enabled wearable devices | |
CN108027881A (zh) | 使用多种捕捉技术的用户认证 | |
KR20150067608A (ko) | 시력 보조 기구 착용 여부 및 사용자 움직임에 무관한 시선 정보 획득 방법 | |
JP2019533918A (ja) | 深度マッピング用のアレイ検出器 | |
US10789777B1 (en) | Generating content for presentation by a head mounted display based on data captured by a light field camera positioned on the head mounted display | |
US11847257B2 (en) | Position tracking system for head-mounted display systems | |
US11747626B1 (en) | Display system with extended display area | |
WO2023055732A1 (en) | Position tracking systems and methods for head-mounted display systems | |
WO2024058934A1 (en) | Position tracking systems and methods for head-mounted display systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
RD03 | Notification of appointment of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7423 Effective date: 20161202 |
|
RD04 | Notification of resignation of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7424 Effective date: 20161202 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20190618 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190618 |
|
A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20191111 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200709 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20201007 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20210209 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20210308 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6850557 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |