JP2020514831A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2020514831A5 JP2020514831A5 JP2019551616A JP2019551616A JP2020514831A5 JP 2020514831 A5 JP2020514831 A5 JP 2020514831A5 JP 2019551616 A JP2019551616 A JP 2019551616A JP 2019551616 A JP2019551616 A JP 2019551616A JP 2020514831 A5 JP2020514831 A5 JP 2020514831A5
- Authority
- JP
- Japan
- Prior art keywords
- eye
- image frame
- item
- eyepiece
- scanning projector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003287 optical effect Effects 0.000 claims description 61
- 238000000034 method Methods 0.000 claims description 57
- 238000012512 characterization method Methods 0.000 claims description 7
- 239000000835 fiber Substances 0.000 claims description 7
- 230000008878 coupling Effects 0.000 claims description 5
- 238000010168 coupling process Methods 0.000 claims description 5
- 238000005859 coupling reaction Methods 0.000 claims description 5
- 239000011521 glass Substances 0.000 claims description 3
- 210000001747 pupil Anatomy 0.000 claims description 2
- 230000000149 penetrating effect Effects 0.000 claims 2
- 230000002123 temporal effect Effects 0.000 description 4
- 238000007796 conventional method Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2023074415A JP7581413B2 (ja) | 2017-03-21 | 2023-04-28 | 光走査プロジェクタと連動した眼移動の追跡のための方法およびシステム |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201762474497P | 2017-03-21 | 2017-03-21 | |
| US62/474,497 | 2017-03-21 | ||
| PCT/US2018/023512 WO2018175548A1 (en) | 2017-03-21 | 2018-03-21 | Method and system for tracking eye movement in conjunction with a light scanning projector |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2023074415A Division JP7581413B2 (ja) | 2017-03-21 | 2023-04-28 | 光走査プロジェクタと連動した眼移動の追跡のための方法およびシステム |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2020514831A JP2020514831A (ja) | 2020-05-21 |
| JP2020514831A5 true JP2020514831A5 (enExample) | 2021-04-30 |
| JP7273720B2 JP7273720B2 (ja) | 2023-05-15 |
Family
ID=63583782
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2019551616A Active JP7273720B2 (ja) | 2017-03-21 | 2018-03-21 | 光走査プロジェクタと連動した眼移動の追跡のための方法およびシステム |
| JP2023074415A Active JP7581413B2 (ja) | 2017-03-21 | 2023-04-28 | 光走査プロジェクタと連動した眼移動の追跡のための方法およびシステム |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2023074415A Active JP7581413B2 (ja) | 2017-03-21 | 2023-04-28 | 光走査プロジェクタと連動した眼移動の追跡のための方法およびシステム |
Country Status (9)
| Country | Link |
|---|---|
| US (4) | US10715794B2 (enExample) |
| EP (2) | EP4235258B1 (enExample) |
| JP (2) | JP7273720B2 (enExample) |
| KR (2) | KR102594058B1 (enExample) |
| CN (2) | CN114755824A (enExample) |
| AU (1) | AU2018239359A1 (enExample) |
| CA (1) | CA3056657A1 (enExample) |
| IL (2) | IL301719B2 (enExample) |
| WO (1) | WO2018175548A1 (enExample) |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018175548A1 (en) * | 2017-03-21 | 2018-09-27 | Magic Leap, Inc. | Method and system for tracking eye movement in conjunction with a light scanning projector |
| KR102661322B1 (ko) * | 2017-03-21 | 2024-04-25 | 매직 립, 인코포레이티드 | 섬유 스캐닝 프로젝터를 위한 방법 및 시스템 |
| US10698204B1 (en) * | 2017-10-16 | 2020-06-30 | Facebook Technologies, Llc | Immersed hot mirrors for illumination in eye tracking |
| JP2020071429A (ja) * | 2018-11-01 | 2020-05-07 | セイコーエプソン株式会社 | 表示装置 |
| US10886702B2 (en) * | 2018-11-09 | 2021-01-05 | Facebook Technologies, Llc | Vertical-cavity surface-emitting laser for near-field illumination of an eye |
| US12124034B2 (en) * | 2018-12-19 | 2024-10-22 | Apple Inc. | Modular system for head-mounted device |
| US11435584B2 (en) * | 2019-03-13 | 2022-09-06 | Hong Kong Applied Science And Technology Research Institute Co., Ltd. | Large field of view see through head mounted display having magnified curved intermediate image |
| JP7163230B2 (ja) * | 2019-03-25 | 2022-10-31 | 株式会社日立製作所 | 視線検出装置、視線検出方法、及び表示装置 |
| CN112130321B (zh) * | 2019-06-24 | 2023-06-27 | 成都理想境界科技有限公司 | 一种波导模组及基于波导的近眼显示模组及设备 |
| US11120258B1 (en) * | 2019-07-18 | 2021-09-14 | Facebook Technologies, Llc | Apparatuses, systems, and methods for scanning an eye via a folding mirror |
| JP7379021B2 (ja) * | 2019-08-29 | 2023-11-14 | 株式会社東芝 | 距離計測装置、距離計測方法、及び速度計測装置 |
| US12360360B2 (en) * | 2019-11-06 | 2025-07-15 | Magic Leap, Inc. | System for using characterization light to detect fiber position in a fiber scanning projector |
| US11681362B2 (en) * | 2019-11-26 | 2023-06-20 | Magic Leap, Inc. | Enhanced eye tracking for augmented or virtual reality display systems |
| US12174318B2 (en) | 2019-11-27 | 2024-12-24 | Magic Leap, Inc. | Method and system for detecting fiber position in a fiber scanning projector |
| CN110989166A (zh) | 2019-12-25 | 2020-04-10 | 歌尔股份有限公司 | 一种近眼显示设备的眼球追踪系统及近眼显示设备 |
| WO2021130739A1 (en) * | 2019-12-25 | 2021-07-01 | Lumus Ltd. | Optical systems and methods for eye tracking based on redirecting light from eye using an optical arrangement associated with a light-guide optical element |
| EP4086691B1 (en) * | 2020-02-04 | 2024-11-27 | Sony Group Corporation | Video-tracking-information detection device |
| WO2021189144A1 (en) * | 2020-03-26 | 2021-09-30 | Diamentis Inc. | Systems and methods for processing retinal signal data and identifying conditions |
| DE102020206821A1 (de) * | 2020-06-02 | 2021-12-02 | Robert Bosch Gesellschaft mit beschränkter Haftung | Verfahren zum Ermitteln einer Blickrichtung eines Auges |
| KR102817675B1 (ko) | 2020-07-15 | 2025-06-09 | 매직 립, 인코포레이티드 | 비구면 각막 모델을 사용한 눈 추적 |
| EP3955051A1 (en) * | 2020-08-10 | 2022-02-16 | Carl Zeiss Vision International GmbH | Spectacle lens and a method for producing a spectacle lens |
| WO2022150222A1 (en) * | 2021-01-11 | 2022-07-14 | Magic Leap, Inc. | Actuated pupil steering for head-mounted display systems |
| JP7814373B2 (ja) * | 2021-03-15 | 2026-02-16 | 富士フイルム株式会社 | 視線追跡システムおよび虚像表示装置 |
| US11669159B2 (en) * | 2021-03-22 | 2023-06-06 | Microsoft Technology Licensing, Llc | Eye tracker illumination through a waveguide |
| WO2023215112A1 (en) * | 2022-05-04 | 2023-11-09 | Apple Inc. | Retinal reflection tracking for gaze alignment |
| US11892638B2 (en) | 2022-06-03 | 2024-02-06 | Meta Platforms Technologies, Llc | Scanning near-eye imaging and sensing system |
| US12147047B1 (en) | 2022-07-18 | 2024-11-19 | Meta Platforms, Inc. | Methods, apparatuses and computer program products for providing transmission chirped volume bragg grating based compact waveguide in-couplers for light sources |
Family Cites Families (71)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5309272A (en) | 1992-12-11 | 1994-05-03 | Xerox Corporation | Dual pass binary diffractive optical element scanner |
| US5416876A (en) * | 1994-01-28 | 1995-05-16 | Hughes Training, Inc. | Fiber optic ribbon subminiature display for head/helmet mounted display |
| US5727098A (en) * | 1994-09-07 | 1998-03-10 | Jacobson; Joseph M. | Oscillating fiber optic display and imager |
| US5694230A (en) | 1995-06-07 | 1997-12-02 | Digital Optics Corp. | Diffractive optical elements as combiners |
| JP2000056259A (ja) * | 1998-08-10 | 2000-02-25 | Fuji Xerox Co Ltd | 画像表示装置 |
| JP4372891B2 (ja) * | 1999-06-22 | 2009-11-25 | オリンパス株式会社 | 映像表示装置 |
| US6307995B1 (en) * | 2000-04-05 | 2001-10-23 | James T. Veligdan | Planar optical waveguides for optical panel having gradient refractive index core |
| JP2002098820A (ja) * | 2000-09-21 | 2002-04-05 | Nippon Sheet Glass Co Ltd | 反射型回折格子 |
| JP4772204B2 (ja) * | 2001-04-13 | 2011-09-14 | オリンパス株式会社 | 観察光学系 |
| DE10196499D2 (de) * | 2001-05-22 | 2004-07-01 | Physoptics Opto Electronic Gmb | Verfahren und Vorrichtung zur Anpassung eines optischen Systems an die Blickrichtung des menschlichen Auges |
| EP1437608A4 (en) * | 2001-09-13 | 2006-07-26 | Asahi Glass Co Ltd | DIFFRACTION DEVICE |
| US7197165B2 (en) * | 2002-02-04 | 2007-03-27 | Canon Kabushiki Kaisha | Eye tracking using image data |
| US7110180B2 (en) | 2002-10-09 | 2006-09-19 | Ricoh Company, Ltd. | Diffraction grating, method of fabricating diffraction optical element, optical pickup device, and optical disk drive |
| US7145722B2 (en) | 2003-04-24 | 2006-12-05 | Banpil Photonics, Inc. | Optical filter and method of manufacturing thereof |
| JP4608996B2 (ja) * | 2004-08-19 | 2011-01-12 | ブラザー工業株式会社 | 瞳孔検出装置およびそれを備えた画像表示装置 |
| US7206107B2 (en) | 2004-12-13 | 2007-04-17 | Nokia Corporation | Method and system for beam expansion in a display device |
| EP1932051A1 (en) | 2005-09-14 | 2008-06-18 | Mirage Innovations Ltd. | Diffraction grating with a spatially varying duty-cycle |
| US7817176B2 (en) | 2005-12-26 | 2010-10-19 | Ricoh Company, Ltd. | Light source device, optical scanning device, and image forming apparatus |
| EP1882916A1 (en) * | 2006-07-20 | 2008-01-30 | Interuniversitair Microelektronica Centrum | Compact catadioptric spectrometer |
| US20090268045A1 (en) * | 2007-08-02 | 2009-10-29 | Sudipto Sur | Apparatus and methods for configuration and optimization of image sensors for gaze tracking applications |
| US20100149073A1 (en) * | 2008-11-02 | 2010-06-17 | David Chaum | Near to Eye Display System and Appliance |
| US10274660B2 (en) | 2008-11-17 | 2019-04-30 | Luminit, Llc | Holographic substrate-guided wave-based see-through display |
| US11320571B2 (en) * | 2012-11-16 | 2022-05-03 | Rockwell Collins, Inc. | Transparent waveguide display providing upper and lower fields of view with uniform light extraction |
| US8248178B2 (en) | 2009-12-03 | 2012-08-21 | The Aerospace Corporation | High power waveguide polarizer with broad bandwidth and low loss, and methods of making and using same |
| JP5494153B2 (ja) * | 2010-04-08 | 2014-05-14 | ソニー株式会社 | 頭部装着型ディスプレイにおける画像表示方法 |
| US8467643B2 (en) | 2010-08-13 | 2013-06-18 | Toyota Motor Engineering & Mfg. North America, Inc. | Optical device using double-groove grating |
| US20120057235A1 (en) | 2010-09-03 | 2012-03-08 | Massachusetts Institute Of Technology | Method for Antireflection in Binary and Multi-Level Diffractive Elements |
| US8998414B2 (en) | 2011-09-26 | 2015-04-07 | Microsoft Technology Licensing, Llc | Integrated eye tracking and display system |
| US9297996B2 (en) * | 2012-02-15 | 2016-03-29 | Microsoft Technology Licensing, Llc | Laser illumination scanning |
| US8736963B2 (en) * | 2012-03-21 | 2014-05-27 | Microsoft Corporation | Two-dimensional exit-pupil expansion |
| WO2013167864A1 (en) * | 2012-05-11 | 2013-11-14 | Milan Momcilo Popovich | Apparatus for eye tracking |
| US9671566B2 (en) * | 2012-06-11 | 2017-06-06 | Magic Leap, Inc. | Planar waveguide apparatus with diffraction element(s) and system employing same |
| US9040923B2 (en) * | 2012-09-04 | 2015-05-26 | Innovega, Inc. | Eye tracking system and related methods |
| US9418480B2 (en) * | 2012-10-02 | 2016-08-16 | Augmented Reailty Lab LLC | Systems and methods for 3D pose estimation |
| CN103793045B (zh) * | 2012-10-31 | 2016-12-28 | 原相科技股份有限公司 | 瞳孔追踪装置 |
| JP6057743B2 (ja) * | 2013-01-29 | 2017-01-11 | オリンパス株式会社 | 光走査装置 |
| CA3157218A1 (en) * | 2013-03-11 | 2014-10-09 | Magic Leap, Inc. | System and method for augmented and virtual reality |
| WO2014186620A1 (en) * | 2013-05-15 | 2014-11-20 | The Johns Hopkins University | Eye tracking and gaze fixation detection systems, components and methods using polarized light |
| US10262462B2 (en) * | 2014-04-18 | 2019-04-16 | Magic Leap, Inc. | Systems and methods for augmented and virtual reality |
| US9874749B2 (en) * | 2013-11-27 | 2018-01-23 | Magic Leap, Inc. | Virtual and augmented reality systems and methods |
| WO2015006784A2 (en) * | 2013-07-12 | 2015-01-15 | Magic Leap, Inc. | Planar waveguide apparatus with diffraction element(s) and system employing same |
| BR112016000639B1 (pt) * | 2013-07-19 | 2022-08-09 | Sony Corporation | Aparelho e método de detecção |
| US9420950B2 (en) * | 2013-09-17 | 2016-08-23 | Pixart Imaging Inc. | Retro-reflectivity array for enabling pupil tracking |
| KR102268462B1 (ko) * | 2013-11-27 | 2021-06-22 | 매직 립, 인코포레이티드 | 가상 및 증강 현실 시스템들 및 방법들 |
| EP2887124A1 (en) * | 2013-12-20 | 2015-06-24 | Thomson Licensing | Optical see-through glass type display device and corresponding optical unit |
| US9459451B2 (en) * | 2013-12-26 | 2016-10-04 | Microsoft Technology Licensing, Llc | Eye tracking apparatus, method and system |
| US10191279B2 (en) * | 2014-03-17 | 2019-01-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| JP6270674B2 (ja) * | 2014-02-27 | 2018-01-31 | シチズン時計株式会社 | 投影装置 |
| US10203762B2 (en) * | 2014-03-11 | 2019-02-12 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
| US9389424B1 (en) * | 2014-04-02 | 2016-07-12 | Magic Leap, Inc. | Methods and systems for implementing a high resolution color micro-display |
| WO2015192117A1 (en) * | 2014-06-14 | 2015-12-17 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
| US9874744B2 (en) * | 2014-06-25 | 2018-01-23 | Thalmic Labs Inc. | Systems, devices, and methods for wearable heads-up displays |
| CN104199196B (zh) * | 2014-09-04 | 2017-02-15 | 北京理工大学 | 一种具有眼动追踪功能的波导式集成成像三维显示系统 |
| US9494799B2 (en) * | 2014-09-24 | 2016-11-15 | Microsoft Technology Licensing, Llc | Waveguide eye tracking employing switchable diffraction gratings |
| US20160231567A1 (en) | 2015-02-09 | 2016-08-11 | Pasi Saarikko | Display System |
| US9513480B2 (en) | 2015-02-09 | 2016-12-06 | Microsoft Technology Licensing, Llc | Waveguide |
| EP3062142B1 (en) * | 2015-02-26 | 2018-10-03 | Nokia Technologies OY | Apparatus for a near-eye display |
| WO2016191709A1 (en) * | 2015-05-28 | 2016-12-01 | Thalmic Labs Inc. | Systems, devices, and methods that integrate eye tracking and scanning laser projection in wearable heads-up displays |
| GB201510400D0 (en) | 2015-06-15 | 2015-07-29 | The Technology Partnership Plc | Optical system |
| EP3326023B1 (en) | 2015-07-20 | 2020-02-26 | Magic Leap, Inc. | Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system |
| CN113759555B (zh) * | 2015-10-05 | 2024-09-20 | 迪吉伦斯公司 | 波导显示器 |
| US10983340B2 (en) * | 2016-02-04 | 2021-04-20 | Digilens Inc. | Holographic waveguide optical tracker |
| US10067344B2 (en) * | 2016-07-01 | 2018-09-04 | Intel Corporation | Variable transmissivity virtual image projection system |
| US10267970B2 (en) | 2016-08-22 | 2019-04-23 | Magic Leap, Inc. | Thermal dissipation for wearable device |
| KR102647795B1 (ko) | 2016-10-26 | 2024-03-13 | 매직 립, 인코포레이티드 | 증강 현실 시스템을 위한 아웃커플링 격자 |
| CA3045192A1 (en) * | 2016-11-30 | 2018-06-07 | North Inc. | Systems, devices, and methods for laser eye tracking in wearable heads-up displays |
| GB2557593A (en) * | 2016-12-09 | 2018-06-27 | Sony Interactive Entertainment Inc | Virtual reality |
| WO2018129398A1 (en) * | 2017-01-05 | 2018-07-12 | Digilens, Inc. | Wearable heads up displays |
| EP3572863B1 (en) * | 2017-01-20 | 2024-10-09 | Sony Group Corporation | Optical device and display device |
| US10545347B2 (en) * | 2017-02-23 | 2020-01-28 | Google Llc | Compact eye tracking using folded display optics |
| WO2018175548A1 (en) | 2017-03-21 | 2018-09-27 | Magic Leap, Inc. | Method and system for tracking eye movement in conjunction with a light scanning projector |
-
2018
- 2018-03-21 WO PCT/US2018/023512 patent/WO2018175548A1/en not_active Ceased
- 2018-03-21 KR KR1020197030310A patent/KR102594058B1/ko active Active
- 2018-03-21 CN CN202210423224.8A patent/CN114755824A/zh active Pending
- 2018-03-21 JP JP2019551616A patent/JP7273720B2/ja active Active
- 2018-03-21 AU AU2018239359A patent/AU2018239359A1/en not_active Abandoned
- 2018-03-21 IL IL301719A patent/IL301719B2/en unknown
- 2018-03-21 EP EP23171485.8A patent/EP4235258B1/en active Active
- 2018-03-21 CN CN201880019662.XA patent/CN110446965B/zh active Active
- 2018-03-21 IL IL269101A patent/IL269101B2/en unknown
- 2018-03-21 US US15/927,855 patent/US10715794B2/en active Active
- 2018-03-21 CA CA3056657A patent/CA3056657A1/en active Pending
- 2018-03-21 EP EP18772388.7A patent/EP3602178B1/en active Active
- 2018-03-21 KR KR1020237035884A patent/KR102821244B1/ko active Active
-
2020
- 2020-06-03 US US16/892,184 patent/US11025897B2/en active Active
-
2021
- 2021-05-03 US US17/306,732 patent/US11838496B2/en active Active
-
2023
- 2023-04-28 JP JP2023074415A patent/JP7581413B2/ja active Active
- 2023-10-24 US US18/383,417 patent/US12439021B2/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2020514831A5 (enExample) | ||
| US12439021B2 (en) | Method and system for tracking eye movement in conjunction with a light scanning projector | |
| CN108882845B (zh) | 基于经由光导光学元件的视网膜成像的眼动追踪器 | |
| US9285877B2 (en) | Heads-up display | |
| KR102156405B1 (ko) | 안구-추적기와 헤드-탑재 디스플레이 통합 시스템 | |
| JP6522158B2 (ja) | 積層された光導波路を有するニアアイディスプレイ | |
| JP2020534584A5 (enExample) | ||
| RU2700373C1 (ru) | Система слежения за поворотом глаза | |
| JP7302592B2 (ja) | 情報検出装置、映像投影装置、情報検出方法、及び映像投影方法 |