CN114127610A - 用于估计眼睛姿势的系统和技术 - Google Patents

用于估计眼睛姿势的系统和技术 Download PDF

Info

Publication number
CN114127610A
CN114127610A CN202080052077.7A CN202080052077A CN114127610A CN 114127610 A CN114127610 A CN 114127610A CN 202080052077 A CN202080052077 A CN 202080052077A CN 114127610 A CN114127610 A CN 114127610A
Authority
CN
China
Prior art keywords
eye
user
image
hot spot
locations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080052077.7A
Other languages
English (en)
Chinese (zh)
Inventor
D·法默
D·科恩
B·V·斯图尔特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CN114127610A publication Critical patent/CN114127610A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/77—Determining position or orientation of objects or cameras using statistical methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10152—Varying illumination
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30041—Eye; Retina; Ophthalmic
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Probability & Statistics with Applications (AREA)
  • User Interface Of Digital Computer (AREA)
  • Eye Examination Apparatus (AREA)
  • Image Analysis (AREA)
CN202080052077.7A 2019-05-20 2020-05-19 用于估计眼睛姿势的系统和技术 Pending CN114127610A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962850539P 2019-05-20 2019-05-20
US62/850,539 2019-05-20
PCT/US2020/033620 WO2020236827A1 (en) 2019-05-20 2020-05-19 Systems and techniques for estimating eye pose

Publications (1)

Publication Number Publication Date
CN114127610A true CN114127610A (zh) 2022-03-01

Family

ID=73457064

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080052077.7A Pending CN114127610A (zh) 2019-05-20 2020-05-19 用于估计眼睛姿势的系统和技术

Country Status (5)

Country Link
US (5) US11315288B2 (https=)
EP (1) EP3973347B1 (https=)
JP (2) JP7423659B2 (https=)
CN (1) CN114127610A (https=)
WO (1) WO2020236827A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115171217A (zh) * 2022-07-27 2022-10-11 北京拙河科技有限公司 一种动态背景下的动作识别方法及系统

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11944481B1 (en) * 2018-02-23 2024-04-02 Robert Edwin Douglas Method and apparatus for predicting an image analysis tool based on user behavior
EP3973347B1 (en) 2019-05-20 2025-03-26 Magic Leap, Inc. Systems and techniques for estimating eye pose
US11315326B2 (en) * 2019-10-15 2022-04-26 At&T Intellectual Property I, L.P. Extended reality anchor caching based on viewport prediction
US11205069B1 (en) * 2020-02-20 2021-12-21 Facebook Technologies, Llc Hybrid cornea and pupil tracking
GB2594966B (en) * 2020-05-13 2024-07-31 Sony Interactive Entertainment Inc Gaze tracking apparatus and systems
WO2021247435A1 (en) * 2020-06-05 2021-12-09 Magic Leap, Inc. Enhanced eye tracking techniques based on neural network analysis of images
KR102817675B1 (ko) 2020-07-15 2025-06-09 매직 립, 인코포레이티드 비구면 각막 모델을 사용한 눈 추적
CN116507267A (zh) * 2020-09-22 2023-07-28 苹果公司 用于视网膜眼睛跟踪的多个注视相关照明源
US20220198831A1 (en) * 2020-12-17 2022-06-23 Delphinium Clinic Ltd. System for determining one or more characteristics of a user based on an image of their eye using an ar/vr headset
CN113177434A (zh) * 2021-03-30 2021-07-27 青岛小鸟看看科技有限公司 基于单眼球追踪的虚拟现实系统注视渲染方法、系统
ES2988871T3 (es) * 2021-06-30 2024-11-22 Tobii Ab Sistema de seguimiento ocular
EP4113252A1 (en) 2021-07-02 2023-01-04 IniVation AG Eye tracking device, eye tracking method, and computer-readable medium
GB2614326B (en) * 2021-12-31 2024-10-02 Sony Interactive Entertainment Europe Ltd Apparatus and method for virtual reality
US12535678B2 (en) 2022-03-30 2026-01-27 Jerusalem College Of Technology Eye tracking device
JP2024034143A (ja) * 2022-08-31 2024-03-13 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および情報処理方法

Family Cites Families (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
RU2016102317A (ru) 2010-05-29 2018-11-21 Вэньюй ЦЗЯН Системы, способы и аппарат для создания и использования очков с адаптивной линзой на основе определения расстояния наблюдения и отслеживания взгляда в условиях низкого энергопотребления
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
NZ706893A (en) 2010-12-24 2017-02-24 Magic Leap Inc An ergonomic head mounted display device and optical system
CA3035118C (en) 2011-05-06 2022-01-04 Magic Leap, Inc. Massive simultaneous remote digital presence world
US9213163B2 (en) 2011-08-30 2015-12-15 Microsoft Technology Licensing, Llc Aligning inter-pupillary distance in a near-eye display system
US9354445B1 (en) * 2011-09-16 2016-05-31 Google Inc. Information processing on a head-mountable device
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
RU2017115669A (ru) 2011-10-28 2019-01-28 Мэджик Лип, Инк. Система и способ для дополненной и виртуальной реальности
BR112014024941A2 (pt) 2012-04-05 2017-09-19 Magic Leap Inc dispositivo de imagem de campo de visão amplo com capacidade de focalização ativa
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
JP2015534108A (ja) 2012-09-11 2015-11-26 マジック リープ， インコーポレイテッド 人間工学的な頭部搭載型ディスプレイデバイスおよび光学システム
JP5732446B2 (ja) * 2012-11-06 2015-06-10 株式会社ソニー・コンピュータエンタテインメント ヘッドマウントディスプレイ、および動き検出方法
CN103870796B (zh) * 2012-12-13 2017-05-24 汉王科技股份有限公司 一种人眼视线估计的方法与装置
CN105229719B (zh) 2013-03-15 2018-04-27 奇跃公司 显示系统和方法
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
EP3058418B1 (en) 2013-10-16 2023-10-04 Magic Leap, Inc. Virtual or augmented reality headsets having adjustable interpupillary distance
KR102651578B1 (ko) 2013-11-27 2024-03-25 매직 립, 인코포레이티드 가상 및 증강 현실 시스템들 및 방법들
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP3140779A4 (en) 2014-05-09 2017-11-29 Google LLC Systems and methods for using eye signals with secure mobile communications
JP2016106668A (ja) 2014-12-02 2016-06-20 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
CN111493809B (zh) * 2014-12-17 2023-06-27 索尼公司 信息处理装置和方法、眼镜式终端以及存储介质
NZ773822A (en) 2015-03-16 2022-07-29 Magic Leap Inc Methods and systems for diagnosing and treating health ailments
CN108141575B (zh) 2015-05-19 2020-10-30 奇跃公司 半全局快门成像器
KR102726941B1 (ko) 2015-08-21 2024-11-05 매직 립, 인코포레이티드 눈꺼풀 형상 추정
CN108135469B (zh) 2015-08-21 2021-03-09 奇跃公司 使用眼睛姿态测量的眼睑形状估计
WO2017053821A1 (en) 2015-09-25 2017-03-30 Magic Leap, Inc. Methods and systems for detecting and combining structural features in 3d reconstruction
CN113220116A (zh) 2015-10-20 2021-08-06 奇跃公司 改变可穿戴设备用户输入模式的系统和方法及可穿戴系统
JP6631951B2 (ja) 2015-12-18 2020-01-15 国立大学法人静岡大学 視線検出装置及び視線検出方法
JP2017211891A (ja) 2016-05-27 2017-11-30 ソニー株式会社 情報処理装置、情報処理方法および記録媒体
US10296792B2 (en) 2016-07-14 2019-05-21 Magic Leap, Inc. Iris boundary estimation using cornea curvature
KR102402467B1 (ko) 2016-10-05 2022-05-25 매직 립, 인코포레이티드 혼합 현실 교정을 위한 안구주위 테스트
US10659701B2 (en) 2016-11-10 2020-05-19 Magic Leap, Inc. Method and system for multiple f-number lens
EP3559862B1 (en) 2016-12-23 2022-06-15 Magic Leap, Inc. Techniques for determining settings for a content capture device
JP6948688B2 (ja) 2017-02-06 2021-10-13 国立大学法人神戸大学 視線計測装置、視線計測方法および視線計測プログラム
WO2018156366A1 (en) * 2017-02-27 2018-08-30 Tobii Ab Determining eye openness with an eye tracking device
IL269008B2 (en) 2017-03-21 2023-10-01 Magic Leap Inc Depth sensing techniques for virtual, augmented and mixed reality systems
EP3603058B1 (en) 2017-03-22 2024-07-03 Magic Leap, Inc. Depth based foveated rendering for display systems
EP4120127B1 (en) 2017-03-24 2025-02-12 Magic Leap, Inc. Accumulation and confidence assignment of iris codes
US10489648B2 (en) 2017-08-04 2019-11-26 Facebook Technologies, Llc Eye tracking using time multiplexing
ES2909057T3 (es) * 2017-09-08 2022-05-05 Tobii Ab Seguimiento ocular que utiliza la posición del centro del globo ocular
US9940518B1 (en) * 2017-09-11 2018-04-10 Tobii Ab Reliability of gaze tracking data for left and right eye
AU2018386190A1 (en) 2017-12-13 2020-06-04 Magic Leap, Inc. Global shutter pixel circuit and method for computer vision applications
WO2019143864A1 (en) 2018-01-17 2019-07-25 Magic Leap, Inc. Display systems and methods for determining registration between a display and a user's eyes
JP7390297B2 (ja) 2018-01-17 2023-12-01 マジック リープ， インコーポレイテッド 眼の回転中心決定、深度平面選択、およびディスプレイシステム内のレンダリングカメラ位置付け
US11067805B2 (en) 2018-04-19 2021-07-20 Magic Leap, Inc. Systems and methods for operating a display system based on user perceptibility
EP3914997A4 (en) 2019-01-25 2022-10-12 Magic Leap, Inc. Eye-tracking using images having different exposure times
EP3973347B1 (en) 2019-05-20 2025-03-26 Magic Leap, Inc. Systems and techniques for estimating eye pose

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115171217A (zh) * 2022-07-27 2022-10-11 北京拙河科技有限公司 一种动态背景下的动作识别方法及系统
CN115171217B (zh) * 2022-07-27 2023-03-03 北京拙河科技有限公司 一种动态背景下的动作识别方法及系统

Also Published As

Publication number Publication date
JP7423659B2 (ja) 2024-01-29
US12050727B2 (en) 2024-07-30
EP3973347B1 (en) 2025-03-26
US20250371736A1 (en) 2025-12-04
US20220237823A1 (en) 2022-07-28
US11675432B2 (en) 2023-06-13
US12474775B2 (en) 2025-11-18
EP3973347A1 (en) 2022-03-30
US20240329737A1 (en) 2024-10-03
WO2020236827A1 (en) 2020-11-26
EP3973347A4 (en) 2023-05-31
JP2023181496A (ja) 2023-12-21
JP7570487B2 (ja) 2024-10-21
US11315288B2 (en) 2022-04-26
US20230305627A1 (en) 2023-09-28
US20200372678A1 (en) 2020-11-26
JP2022533205A (ja) 2022-07-21

Similar Documents

Publication Publication Date Title
JP7679503B2 (ja) 異なる露光時間を有する画像を使用した眼追跡
US12474775B2 (en) Systems and techniques for estimating eye pose
JP7443332B2 (ja) ユーザカテゴリ化による多深度平面ディスプレイシステムのための深度平面選択
US12566499B2 (en) Eye center of rotation determination with one or more eye tracking cameras
CN111771179B (zh) 用于确定显示器与用户的眼睛之间的配准的显示系统和方法
CN111869200B (zh) 显示系统中的眼睛旋转中心确定、深度平面选择和渲染相机定位
CN115053270A (zh) 用于基于用户身份来操作头戴式显示系统的系统和方法
CN112689869A (zh) 用于确定显示器与用户的眼睛之间的配准的显示系统和方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination