KR102356906B1 - 눈 추적기능을 갖는 헤드 마운트 디스플레이 - Google Patents

눈 추적기능을 갖는 헤드 마운트 디스플레이 Download PDF

Info

Publication number
KR102356906B1
KR102356906B1 KR1020217005158A KR20217005158A KR102356906B1 KR 102356906 B1 KR102356906 B1 KR 102356906B1 KR 1020217005158 A KR1020217005158 A KR 1020217005158A KR 20217005158 A KR20217005158 A KR 20217005158A KR 102356906 B1 KR102356906 B1 KR 102356906B1
Authority
KR
South Korea
Prior art keywords
light
polarizing beam
beam splitter
eye tracking
head mounted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020217005158A
Other languages
English (en)
Korean (ko)
Other versions
KR20210024202A (ko
Inventor
앤드류 제이 아우더컬크
Original Assignee
쓰리엠 이노베이티브 프로퍼티즈 컴파니
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 쓰리엠 이노베이티브 프로퍼티즈 컴파니 filed Critical 쓰리엠 이노베이티브 프로퍼티즈 컴파니
Publication of KR20210024202A publication Critical patent/KR20210024202A/ko
Application granted granted Critical
Publication of KR102356906B1 publication Critical patent/KR102356906B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/28—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising
    • G02B27/283—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising used for beam splitting or combining
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/30—Polarising elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
KR1020217005158A 2013-09-06 2014-09-02 눈 추적기능을 갖는 헤드 마운트 디스플레이 Expired - Fee Related KR102356906B1 (ko)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201361874822P 2013-09-06 2013-09-06
US61/874,822 2013-09-06
KR1020167008537A KR102259103B1 (ko) 2013-09-06 2014-09-02 눈 추적기능을 갖는 헤드 마운트 디스플레이
PCT/US2014/053646 WO2015034801A2 (en) 2013-09-06 2014-09-02 Head mounted display with eye tracking

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
KR1020167008537A Division KR102259103B1 (ko) 2013-09-06 2014-09-02 눈 추적기능을 갖는 헤드 마운트 디스플레이

Publications (2)

Publication Number Publication Date
KR20210024202A KR20210024202A (ko) 2021-03-04
KR102356906B1 true KR102356906B1 (ko) 2022-02-08

Family

ID=51541349

Family Applications (2)

Application Number Title Priority Date Filing Date
KR1020217005158A Expired - Fee Related KR102356906B1 (ko) 2013-09-06 2014-09-02 눈 추적기능을 갖는 헤드 마운트 디스플레이
KR1020167008537A Expired - Fee Related KR102259103B1 (ko) 2013-09-06 2014-09-02 눈 추적기능을 갖는 헤드 마운트 디스플레이

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR1020167008537A Expired - Fee Related KR102259103B1 (ko) 2013-09-06 2014-09-02 눈 추적기능을 갖는 헤드 마운트 디스플레이

Country Status (5)

Country Link
US (3) US10146055B2 (https=)
JP (3) JP6462696B2 (https=)
KR (2) KR102356906B1 (https=)
CN (1) CN105518514B (https=)
WO (1) WO2015034801A2 (https=)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017003719A2 (en) 2015-06-30 2017-01-05 3M Innovative Properties Company Illuminator
EP3189376A1 (en) 2015-09-03 2017-07-12 3M Innovative Properties Company Beam expander with a curved reflective polarizer
US9726891B2 (en) 2015-09-03 2017-08-08 Microsoft Technology Licensing, Llc Left and right eye optical paths with shared optical element for head-mounted display device
HK1256792A1 (zh) 2015-09-23 2019-10-04 Magic Leap, Inc. 采用离轴成像器的眼睛成像
WO2017127494A1 (en) 2016-01-22 2017-07-27 Corning Incorporated Wide field personal display
KR102448919B1 (ko) * 2016-03-16 2022-10-04 삼성디스플레이 주식회사 표시 장치
US11346829B2 (en) 2016-05-18 2022-05-31 The Board Of Trustees Of The University Of Illinois Methods and devices for detection of trimethylamine (TMA) and trimethylamine oxide (TMAO)
EP3300653B1 (en) * 2016-09-30 2019-07-03 Smart Eye AB Head/eye tracking with light source preheating
CN106526861A (zh) * 2016-12-16 2017-03-22 擎中科技（上海）有限公司 一种ar显示装置
US10545347B2 (en) 2017-02-23 2020-01-28 Google Llc Compact eye tracking using folded display optics
CN110651216B (zh) 2017-03-21 2022-02-25 奇跃公司 低轮廓分束器
KR102767824B1 (ko) 2017-03-21 2025-02-13 매직 립, 인코포레이티드 공간 광 변조기들을 조명하기 위한 방법들, 디바이스들, 및 시스템들
KR102365726B1 (ko) 2017-06-13 2022-02-22 한국전자통신연구원 광학 투시 기반의 합성 이미지 제공 방법 및 이를 위한 장치
CN108701363B (zh) * 2017-07-07 2021-06-29 广东虚拟现实科技有限公司 使用多相机识别和追踪对象的方法、设备和系统
WO2019024090A1 (zh) * 2017-08-04 2019-02-07 深圳市柔宇科技有限公司 光学成像系统和头戴设备
US10976551B2 (en) 2017-08-30 2021-04-13 Corning Incorporated Wide field personal display device
US10311584B1 (en) * 2017-11-09 2019-06-04 Facebook Technologies, Llc Estimation of absolute depth from polarization measurements
CN107678166A (zh) * 2017-11-22 2018-02-09 深圳创维新世界科技有限公司 增强现实显示装置
CN107765435A (zh) * 2017-11-22 2018-03-06 深圳创维新世界科技有限公司 头戴显示装置
KR102717573B1 (ko) 2017-12-11 2024-10-14 매직 립, 인코포레이티드 도파관 조명기
US12372793B2 (en) 2017-12-11 2025-07-29 Magic Leap, Inc. Illumination layout for compact projection system
US11467329B2 (en) 2018-02-19 2022-10-11 3M Innovative Properties Company Optical film device
CN110596889A (zh) * 2018-06-13 2019-12-20 托比股份公司 眼睛跟踪装置和制造眼睛跟踪装置的方法
US10630925B1 (en) 2018-12-03 2020-04-21 Facebook Technologies, Llc Depth determination using polarization of light and camera assembly with augmented pixels
US10855896B1 (en) 2018-12-13 2020-12-01 Facebook Technologies, Llc Depth determination using time-of-flight and camera assembly with augmented pixels
US10791286B2 (en) 2018-12-13 2020-09-29 Facebook Technologies, Llc Differentiated imaging using camera assembly with augmented pixels
US10791282B2 (en) 2018-12-13 2020-09-29 Fenwick & West LLP High dynamic range camera assembly with augmented pixels
US11409240B2 (en) * 2018-12-17 2022-08-09 Meta Platforms Technologies, Llc Holographic pattern generation for head-mounted display (HMD) eye tracking using a diffractive optical element
CN111665622B (zh) * 2019-03-06 2022-07-08 株式会社理光 光学装置、视网膜投影显示装置、头部安装型显示装置
JP7062606B2 (ja) * 2019-03-08 2022-05-06 株式会社東芝 マルチビュー光学系、光学装置、撮像装置、及び、移動体
US10902623B1 (en) 2019-11-19 2021-01-26 Facebook Technologies, Llc Three-dimensional imaging with spatial and temporal coding for depth camera assembly
US11194160B1 (en) 2020-01-21 2021-12-07 Facebook Technologies, Llc High frame rate reconstruction with N-tap camera sensor
CN113109942B (zh) * 2021-03-02 2022-07-26 联想(北京)有限公司 显示装置及头戴式显示设备
CN115933172B (zh) * 2022-11-29 2023-09-12 大连海事大学 一种基于偏振多光谱成像的人眼视线追踪装置及方法
DE102022134420A1 (de) * 2022-12-21 2024-06-27 OQmented GmbH Vorrichtung zur Erzeugung und Darstellung eines Bildes auf einem Beobachtungsfeld unter Verwendung eines refraktiven Wellenleiters

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006001254A1 (ja) 2004-06-29 2006-01-05 Nikon Corporation イメージコンバイナ及び画像表示装置
JP2012159681A (ja) 2011-01-31 2012-08-23 Brother Ind Ltd ヘッドマウントディスプレイ
US20130106674A1 (en) 2011-11-02 2013-05-02 Google Inc. Eye Gaze Detection to Determine Speed of Image Movement
US20130207887A1 (en) * 2012-02-15 2013-08-15 Google Inc. Heads-up display including eye tracking

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3976364A (en) * 1973-12-21 1976-08-24 Harley Burke Lindemann Optical air lens system
US6432854B1 (en) * 1994-02-07 2002-08-13 Nikon Corporation Optical glass for polarizing optical system, production process therefor and polarizing beam splitter
US5625491A (en) * 1995-03-15 1997-04-29 Spectra-Physics Lasers, Inc. Broad band polarizing beam splitter
US5886822A (en) * 1996-10-08 1999-03-23 The Microoptical Corporation Image combining system for eyeglasses and face masks
US6207260B1 (en) * 1998-01-13 2001-03-27 3M Innovative Properties Company Multicomponent optical body
US6157490A (en) * 1998-01-13 2000-12-05 3M Innovative Properties Company Optical film with sharpened bandedge
US5982555A (en) 1998-01-20 1999-11-09 University Of Washington Virtual retinal display with eye tracking
JP2002071946A (ja) * 2000-08-30 2002-03-12 Nippon Sheet Glass Co Ltd 偏光フィルタおよびそれを用いた光学装置
JP4510547B2 (ja) * 2004-08-09 2010-07-28 キヤノン株式会社 偏光分離素子及びそれを有する投影装置
US20090040461A1 (en) 2005-04-03 2009-02-12 Ben Gurion Univ. Of The Negev Resea. & Dev. Auth. Low vision aid device
DE102005062847A1 (de) 2005-12-23 2007-07-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Okularsystem
TW200819899A (en) 2006-07-31 2008-05-01 3M Innovative Properties Co Combination camera/projector system
WO2008129539A2 (en) * 2007-04-22 2008-10-30 Lumus Ltd. A collimating optical device and system
JP2009157634A (ja) 2007-12-26 2009-07-16 Fuji Xerox Co Ltd 照射制御装置、照射制御プログラム、視線分析システム
US8786675B2 (en) * 2008-01-23 2014-07-22 Michael F. Deering Systems using eye mounted displays
JP5214556B2 (ja) * 2008-08-06 2013-06-19 パナソニック株式会社 光学ヘッド装置及び記録／再生装置
US9952664B2 (en) * 2014-01-21 2018-04-24 Osterhout Group, Inc. Eye imaging in head worn computing
US8531394B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglasses transceiver
JP2012226208A (ja) * 2011-04-21 2012-11-15 Canon Inc 偏光分離素子、及びそれを用いた偏光変換素子及び画像投射装置
GB201109208D0 (en) * 2011-06-01 2011-07-13 Barco Nv Apparatus and method for combining laser beams of different polarization
US9551818B2 (en) 2011-10-20 2017-01-24 3M Innovative Properties Company Apodized broadband partial reflectors having differing optical packets
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
KR102028199B1 (ko) * 2012-08-28 2019-10-04 한국전자통신연구원 의료 진단장치 및 그 조작방법
US20150205135A1 (en) * 2014-01-21 2015-07-23 Osterhout Group, Inc. See-through computer display systems
US9958680B2 (en) * 2014-09-30 2018-05-01 Omnivision Technologies, Inc. Near-eye display device and methods with coaxial eye imaging

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006001254A1 (ja) 2004-06-29 2006-01-05 Nikon Corporation イメージコンバイナ及び画像表示装置
JP2012159681A (ja) 2011-01-31 2012-08-23 Brother Ind Ltd ヘッドマウントディスプレイ
US20130106674A1 (en) 2011-11-02 2013-05-02 Google Inc. Eye Gaze Detection to Determine Speed of Image Movement
US20130207887A1 (en) * 2012-02-15 2013-08-15 Google Inc. Heads-up display including eye tracking

Also Published As

Publication number Publication date
US10852556B1 (en) 2020-12-01
US20160202484A1 (en) 2016-07-14
WO2015034801A3 (en) 2015-07-30
JP2021103310A (ja) 2021-07-15
JP2016532161A (ja) 2016-10-13
CN105518514B (zh) 2019-07-05
KR102259103B1 (ko) 2021-06-01
JP6462696B2 (ja) 2019-01-30
KR20160055174A (ko) 2016-05-17
JP7076891B2 (ja) 2022-05-30
US10146055B2 (en) 2018-12-04
CN105518514A (zh) 2016-04-20
WO2015034801A2 (en) 2015-03-12
US10809531B2 (en) 2020-10-20
KR20210024202A (ko) 2021-03-04
US20190094555A1 (en) 2019-03-28
JP2019091049A (ja) 2019-06-13

Similar Documents

Publication Publication Date Title
US10852556B1 (en) Head mounted display with eye tracking
US11675191B2 (en) Head mounted display and low conspicuity pupil illuminator
US11029523B2 (en) Near-eye display with self-emitting microdisplay engine
US9087471B2 (en) Adaptive brightness control of head mounted display
US10345598B2 (en) Low profile image combiner for near-eye displays
US9927613B2 (en) Image display apparatus and head mounted display
US9223139B2 (en) Cascading optics in optical combiners of head mounted displays
CN111399224A (zh) 显示光学系统及头戴显示设备
US10539796B1 (en) Systems and methods to provide privacy protection and brightness enhancement in an interactive environment
CN115145034B (zh) 光学模块以及头部佩戴型显示装置

Legal Events

Date Code Title Description
A107 Divisional application of patent
A201 Request for examination
PA0104 Divisional application for international application

St.27 status event code: A-0-1-A10-A18-div-PA0104

St.27 status event code: A-0-1-A10-A16-div-PA0104

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E601 Decision to refuse application
PE0601 Decision on rejection of patent

St.27 status event code: N-2-6-B10-B15-exm-PE0601

X091 Application refused [patent]
AMND Amendment
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PX0901 Re-examination

St.27 status event code: A-2-3-E10-E12-rex-PX0901

PX0701 Decision of registration after re-examination

St.27 status event code: A-3-4-F10-F13-rex-PX0701

X701 Decision to grant (after re-examination)
GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20250126

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

H13 Ip right lapsed

Free format text: ST27 STATUS EVENT CODE: N-4-6-H10-H13-OTH-PC1903 (AS PROVIDED BY THE NATIONAL OFFICE); TERMINATION CATEGORY : DEFAULT_OF_REGISTRATION_FEE

Effective date: 20250126

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20250126