CA3090817A1 - Display system with low-latency pupil tracker - Google Patents

Display system with low-latency pupil tracker Download PDF

Info

Publication number
CA3090817A1
CA3090817A1 CA3090817A CA3090817A CA3090817A1 CA 3090817 A1 CA3090817 A1 CA 3090817A1 CA 3090817 A CA3090817 A CA 3090817A CA 3090817 A CA3090817 A CA 3090817A CA 3090817 A1 CA3090817 A1 CA 3090817A1
Authority
CA
Canada
Prior art keywords
light
eye
image
light source
display system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3090817A
Other languages
English (en)
French (fr)
Inventor
Michael Anthony Klug
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CA3090817A1 publication Critical patent/CA3090817A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0118—Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
    • G02B2027/012—Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility comprising devices for attenuating parasitic image effects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Diffracting Gratings Or Hologram Optical Elements (AREA)
  • Lenses (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Eyeglasses (AREA)
CA3090817A 2018-03-05 2019-03-01 Display system with low-latency pupil tracker Pending CA3090817A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862638607P 2018-03-05 2018-03-05
US62/638,607 2018-03-05
PCT/US2019/020376 WO2019173158A1 (en) 2018-03-05 2019-03-01 Display system with low-latency pupil tracker

Publications (1)

Publication Number Publication Date
CA3090817A1 true CA3090817A1 (en) 2019-09-12

Family

ID=67846748

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3090817A Pending CA3090817A1 (en) 2018-03-05 2019-03-01 Display system with low-latency pupil tracker

Country Status (7)

Country Link
US (4) US11467398B2 (https=)
EP (1) EP3762765B1 (https=)
JP (3) JP7303818B2 (https=)
CN (1) CN111819487A (https=)
AU (1) AU2019229957A1 (https=)
CA (1) CA3090817A1 (https=)
WO (1) WO2019173158A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7303818B2 (ja) 2018-03-05 2023-07-05 マジック リープ， インコーポレイテッド 低遅延瞳孔トラッカーを伴うディスプレイシステム
US11885968B2 (en) 2019-09-13 2024-01-30 Arizona Board Of Regents On Behalf Of The University Of Arizona Pupil matched occlusion-capable optical see-through head-mounted display
JP7432339B2 (ja) * 2019-10-29 2024-02-16 株式会社日立エルジーデータストレージ ヘッドマウントディスプレイ
GB2613086B (en) * 2021-02-05 2023-08-23 Envisics Ltd Image projection
JP2024522302A (ja) * 2021-06-07 2024-06-13 パナモーフ，インコーポレイテッド ニアアイディスプレイシステム
US12204096B2 (en) 2021-06-07 2025-01-21 Panamorph, Inc. Near-eye display system
KR102898611B1 (ko) * 2021-08-24 2025-12-12 삼성디스플레이 주식회사 표시 장치 및 이의 구동 방법
SE546809C2 (en) * 2022-06-22 2025-02-25 Tobii Ab An eye tracking system
CN117310971B (zh) * 2022-06-22 2026-01-02 舜宇光学（浙江）研究院有限公司 眼动追踪显示装置及其方法和近眼显示设备

Family Cites Families (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
JPH07311361A (ja) 1994-05-16 1995-11-28 Olympus Optical Co Ltd 眼球投影型映像表示装置
JPH08286113A (ja) * 1995-04-17 1996-11-01 Olympus Optical Co Ltd 対物レンズ
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
WO2002065443A1 (en) * 2001-02-15 2002-08-22 Tveye Inc. Method and apparatus for low bandwidth transmission of data utilizing of the human eye anatomy
JP2002318365A (ja) 2001-04-20 2002-10-31 Sanyo Electric Co Ltd 網膜投影型ディスプレイ
JP3623482B2 (ja) 2002-02-05 2005-02-23 オリンパス株式会社 映像表示装置
JP3785539B2 (ja) 2002-11-01 2006-06-14 独立行政法人科学技術振興機構 広視域網膜投影型表示システム
US7639208B1 (en) 2004-05-21 2009-12-29 University Of Central Florida Research Foundation, Inc. Compact optical see-through head-mounted display with occlusion support
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US10261321B2 (en) * 2005-11-08 2019-04-16 Lumus Ltd. Polarizing optical system
US20100149073A1 (en) * 2008-11-02 2010-06-17 David Chaum Near to Eye Display System and Appliance
US20100033830A1 (en) * 2008-08-11 2010-02-11 Man Fat Yung Wearable image display device
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
AU2011348122A1 (en) 2010-12-24 2013-07-11 Magic Leap Inc. An ergonomic head mounted display device and optical system
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
JP6316186B2 (ja) 2011-05-06 2018-04-25 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 広範囲同時遠隔ディジタル提示世界
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
US9215293B2 (en) 2011-10-28 2015-12-15 Magic Leap, Inc. System and method for augmented and virtual reality
WO2013152205A1 (en) * 2012-04-05 2013-10-10 Augmented Vision Inc. Wide-field of view (fov) imaging devices with active foveation capability
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US9250445B2 (en) * 2012-08-08 2016-02-02 Carol Ann Tosaya Multiple-pixel-beam retinal displays
KR20150054967A (ko) 2012-09-11 2015-05-20 매직 립, 인코포레이티드 인체공학적 헤드 마운티드 디스플레이 디바이스 및 광학 시스템
US9417452B2 (en) 2013-03-15 2016-08-16 Magic Leap, Inc. Display system and method
CN106170729A (zh) * 2013-03-25 2016-11-30 英特尔公司 用于具有多个出射光瞳的头戴显示器的方法和设备
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US20140375542A1 (en) * 2013-06-25 2014-12-25 Steve Robbins Adjusting a near-eye display device
JP6479785B2 (ja) 2013-10-16 2019-03-06 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 調節可能な瞳孔間距離を有する仮想または拡張現実ヘッドセット
CN107272199B (zh) 2013-11-27 2023-04-07 奇跃公司 虚拟和增强现实系统与方法
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP3140780B1 (en) 2014-05-09 2020-11-04 Google LLC Systems and methods for discerning eye signals and continuous biometric identification
CN112987307B (zh) 2014-05-30 2022-06-28 奇跃公司 用于在虚拟和增强现实中产生焦平面的方法和系统
US9494799B2 (en) 2014-09-24 2016-11-15 Microsoft Technology Licensing, Llc Waveguide eye tracking employing switchable diffraction gratings
US10031338B2 (en) * 2015-02-17 2018-07-24 Thalmic Labs Inc. Systems, devices, and methods for eyebox expansion in wearable heads-up displays
WO2016179246A1 (en) * 2015-05-04 2016-11-10 Magic Leap, Inc. Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
US20170054890A1 (en) * 2015-08-19 2017-02-23 Sound Devices, LLC Identification of flicker and banding in video
US10108144B2 (en) * 2016-09-16 2018-10-23 Microsoft Technology Licensing, Llc Holographic wide field of view display
US11022939B2 (en) * 2017-01-03 2021-06-01 Microsoft Technology Licensing, Llc Reduced bandwidth holographic near-eye display
US10025384B1 (en) * 2017-01-06 2018-07-17 Oculus Vr, Llc Eye tracking architecture for common structured light and time-of-flight framework
US20190098267A1 (en) * 2017-09-27 2019-03-28 Microsoft Technology Licensing, Llc Hololens light engine with linear array imagers and mems
JP7303818B2 (ja) 2018-03-05 2023-07-05 マジック リープ， インコーポレイテッド 低遅延瞳孔トラッカーを伴うディスプレイシステム
WO2020069026A1 (en) * 2018-09-26 2020-04-02 Magic Leap, Inc. Diffractive optical elements with optical power
EP3860861B1 (en) * 2018-10-05 2023-06-07 Sicpa Holding Sa Optical security elements, marked object, method of authenticating an object and use of optical security elements for authenticating or securing against counterfeiting
US11762197B2 (en) * 2019-08-13 2023-09-19 Apple Inc. Display systems with geometrical phase lenses
US12019240B2 (en) * 2021-08-06 2024-06-25 Hong Kong Applied Science and Technology Research Institute Company Limited Imaging apparatus integrated with display for head-mounted display

Also Published As

Publication number Publication date
EP3762765A4 (en) 2021-12-08
US20210048668A1 (en) 2021-02-18
US12504625B2 (en) 2025-12-23
JP2021516358A (ja) 2021-07-01
JP2024149549A (ja) 2024-10-18
JP2023126268A (ja) 2023-09-07
EP3762765B1 (en) 2025-12-17
JP7625757B2 (ja) 2025-02-03
JP7544920B2 (ja) 2024-09-03
US20230030381A1 (en) 2023-02-02
US11860359B2 (en) 2024-01-02
EP3762765A1 (en) 2021-01-13
AU2019229957A1 (en) 2020-08-13
US20250053003A1 (en) 2025-02-13
US12158577B2 (en) 2024-12-03
CN111819487A (zh) 2020-10-23
WO2019173158A1 (en) 2019-09-12
US11467398B2 (en) 2022-10-11
JP7303818B2 (ja) 2023-07-05
US20240069334A1 (en) 2024-02-29

Similar Documents

Publication Publication Date Title
US12504625B2 (en) Display system with low-latency pupil tracker
US12183310B2 (en) Depth based foveated rendering for display systems
US11480861B2 (en) Low-profile beam splitter
KR102708487B1 (ko) 향상된 포즈 결정을 위한 시스템들 및 방법들
US12393271B2 (en) Enhanced eye tracking for augmented or virtual reality display systems
CN110637249A (zh) 使用衍射光学元件的眼睛成像装置
JP2023529606A (ja) 画像のニューラルネットワーク分析に基づいて向上された眼追跡技法
EP4439152B1 (en) Display system having 1-dimensional pixel array with scanning mirror

Legal Events

Date Code Title Description
U13 Renewal or maintenance fee not paid

Free format text: ST27 STATUS EVENT CODE: N-1-6-U10-U13-U300 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: DEEMED ABANDONED - FAILURE TO RESPOND TO MAINTENANCE FEE NOTICE

Effective date: 20240903

N11 Application terminated

Free format text: ST27 STATUS EVENT CODE: T-6-6-N10-N11-N106 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: APPLICATION NOT REINSTATED BY DEADLINE

Effective date: 20250903

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-1-1-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20250904

U13 Renewal or maintenance fee not paid

Free format text: ST27 STATUS EVENT CODE: N-6-6-U10-U13-U300 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: DEEMED ABANDONED - FAILURE TO RESPOND TO MAINTENANCE FEE NOTICE

Effective date: 20251104

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: N-6-6-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20251229