KR102054695B1 - 가상 현실 시스템을 위한 스파스 프로젝션 - Google Patents

가상 현실 시스템을 위한 스파스 프로젝션 Download PDF

Info

Publication number
KR102054695B1
KR102054695B1 KR1020177026280A KR20177026280A KR102054695B1 KR 102054695 B1 KR102054695 B1 KR 102054695B1 KR 1020177026280 A KR1020177026280 A KR 1020177026280A KR 20177026280 A KR20177026280 A KR 20177026280A KR 102054695 B1 KR102054695 B1 KR 102054695B1
Authority
KR
South Korea
Prior art keywords
delete delete
clusters
headset
cluster
local area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020177026280A
Other languages
English (en)
Korean (ko)
Other versions
KR20170122215A (ko
Inventor
도브 캐츠
팔머 프리맨 럭키
샘 레드몬드 다미코
에반 엠. 리처즈
시저 쉔
제니퍼 리 돌슨
Original Assignee
페이스북 테크놀로지스, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 페이스북 테크놀로지스, 엘엘씨 filed Critical 페이스북 테크놀로지스, 엘엘씨
Publication of KR20170122215A publication Critical patent/KR20170122215A/ko
Application granted granted Critical
Publication of KR102054695B1 publication Critical patent/KR102054695B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G02B2027/0174—Head mounted characterised by optical features holographic
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Holo Graphy (AREA)
  • Image Processing (AREA)
KR1020177026280A 2015-03-04 2016-03-04 가상 현실 시스템을 위한 스파스 프로젝션 Expired - Fee Related KR102054695B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562128433P 2015-03-04 2015-03-04
US62/128,433 2015-03-04
PCT/US2016/020814 WO2016141263A1 (en) 2015-03-04 2016-03-04 Sparse projection for a virtual reality system

Publications (2)

Publication Number Publication Date
KR20170122215A KR20170122215A (ko) 2017-11-03
KR102054695B1 true KR102054695B1 (ko) 2019-12-11

Family

ID=56849076

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020177026280A Expired - Fee Related KR102054695B1 (ko) 2015-03-04 2016-03-04 가상 현실 시스템을 위한 스파스 프로젝션

Country Status (6)

Country Link
US (1) US10073263B2 (https=)
EP (1) EP3114528B1 (https=)
JP (1) JP6581203B2 (https=)
KR (1) KR102054695B1 (https=)
CN (1) CN107533225B (https=)
WO (1) WO2016141263A1 (https=)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10643341B2 (en) 2018-03-22 2020-05-05 Microsoft Technology Licensing, Llc Replicated dot maps for simplified depth computation using machine learning
US10728518B2 (en) 2018-03-22 2020-07-28 Microsoft Technology Licensing, Llc Movement detection in low light environments
US10944957B2 (en) 2018-03-22 2021-03-09 Microsoft Technology Licensing, Llc Active stereo matching for depth applications
US10565720B2 (en) * 2018-03-27 2020-02-18 Microsoft Technology Licensing, Llc External IR illuminator enabling improved head tracking and surface reconstruction for virtual reality
US10994216B2 (en) * 2019-08-15 2021-05-04 Board Media Group LLC Virtual reality motion simulator
CN116829902A (zh) 2020-12-14 2023-09-29 夏日机器人公司 基于感测表面和感测表面运动来感知物体
US11686938B2 (en) * 2020-12-16 2023-06-27 Samsung Electronics Co., Ltd. Augmented reality device for providing 3D augmented reality and operating method of the same
WO2023278868A1 (en) 2021-07-01 2023-01-05 Summer Robotics, Inc. Calibration of sensor position offsets based on rotation and translation vectors for matched trajectories
US12148185B2 (en) 2021-07-15 2024-11-19 Summer Robotics, Inc. Automatic parameter adjustment for scanning event cameras
US11704835B2 (en) 2021-07-29 2023-07-18 Summer Robotics, Inc. Dynamic calibration of 3D acquisition systems
CN115728943B (zh) * 2021-09-02 2025-04-01 成都极米科技股份有限公司 Vr投影系统
WO2023096873A1 (en) 2021-11-28 2023-06-01 Summer Robotics, Inc. Association of concurrent tracks across multiple views
WO2023164064A1 (en) 2022-02-27 2023-08-31 Summer Robotics, Inc. Association of concurrent tracks using graph crossings
WO2023177692A1 (en) 2022-03-14 2023-09-21 Summer Robotics, Inc. Stage studio for immersive 3-d video capture
WO2023196225A1 (en) * 2022-04-05 2023-10-12 Summer Robotics, Inc. Auxiliary device for augmented reality
US12401905B2 (en) 2022-07-14 2025-08-26 Summer Robotics, Inc. Foveated robotic vision system
US11974055B1 (en) 2022-10-17 2024-04-30 Summer Robotics, Inc. Perceiving scene features using event sensors and image sensors
US12276730B2 (en) 2022-11-08 2025-04-15 Summer Robotics, Inc. Virtual fences in air, water, and space
US12416804B1 (en) 2024-05-08 2025-09-16 Summer Robotics, Inc. Kaleidoscopic laser beam projection system
CN120812235B (zh) * 2025-09-09 2025-11-11 南京芯视元电子有限公司 微显示系统及头显设备

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090231270A1 (en) * 2005-06-30 2009-09-17 Panu Vartiainen Control device for information display, corresponding system, method and program product

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4473133B2 (ja) * 2002-11-13 2010-06-02 シーリアル、テクノロジーズ、ゲーエムベーハー 映像ホログラムおよび映像ホログラム再生装置
WO2012033170A1 (ja) * 2010-09-08 2012-03-15 大日本印刷株式会社 投射装置および投射型映像表示装置
JPWO2012049795A1 (ja) * 2010-10-12 2014-02-24 パナソニック株式会社 表示処理装置、表示方法およびプログラム
US20140063061A1 (en) * 2011-08-26 2014-03-06 Reincloud Corporation Determining a position of an item in a virtual augmented space
JP5966510B2 (ja) * 2012-03-29 2016-08-10 ソニー株式会社 情報処理システム
KR101861380B1 (ko) * 2012-07-16 2018-05-28 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 헤드 마운트 디스플레이를 이용한 컨텐츠 출력 방법 및 이를 위한 헤드 마운트 디스플레이
US8711370B1 (en) * 2012-10-04 2014-04-29 Gerard Dirk Smits Scanning optical positioning system with spatially triangulating receivers
JP6061334B2 (ja) 2012-11-26 2017-01-18 Kddi株式会社 光学式シースルー型ｈｍｄを用いたａｒシステム
US20140160162A1 (en) * 2012-12-12 2014-06-12 Dhanushan Balachandreswaran Surface projection device for augmented reality
JP6123342B2 (ja) * 2013-02-20 2017-05-10 ソニー株式会社 表示装置
EP2797313A1 (en) * 2013-04-26 2014-10-29 Elvesjö, John Computer graphics presentation system and method
DE102013210746A1 (de) * 2013-06-10 2014-12-11 Robert Bosch Gmbh System und Verfahren zum Überwachen und/oder Bedienen einer technischen Anlage, insbesondere eines Fahrzeugs
CN103617636B (zh) * 2013-12-02 2016-08-17 西北工业大学 基于运动信息及稀疏投影的视频目标自动检测跟踪方法
KR20150096948A (ko) 2014-02-17 2015-08-26 엘지전자 주식회사 증강 현실 사진 촬영 가이드를 디스플레이 하는 헤드 마운티드 디스플레이 디바이스 및 그 제어 방법
US20150253574A1 (en) * 2014-03-10 2015-09-10 Ion Virtual Technology Corporation Modular and Convertible Virtual Reality Headset System
EP3117263B1 (en) * 2014-03-14 2018-05-09 Sony Interactive Entertainment Inc. Methods and systems tracking head mounted display (hmd) and calibrations for hmd headband adjustments

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090231270A1 (en) * 2005-06-30 2009-09-17 Panu Vartiainen Control device for information display, corresponding system, method and program product

Also Published As

Publication number Publication date
CN107533225B (zh) 2020-07-14
CN107533225A (zh) 2018-01-02
JP6581203B2 (ja) 2019-09-25
EP3114528A4 (en) 2017-11-01
KR20170122215A (ko) 2017-11-03
US20160259168A1 (en) 2016-09-08
JP2018517187A (ja) 2018-06-28
US10073263B2 (en) 2018-09-11
WO2016141263A1 (en) 2016-09-09
EP3114528B1 (en) 2019-11-06
EP3114528A1 (en) 2017-01-11

Similar Documents

Publication Publication Date Title
KR102054695B1 (ko) 가상 현실 시스템을 위한 스파스 프로젝션
US11450015B2 (en) Shifting diffractive optical element for adjustable depth sensing resolution
US10529113B1 (en) Generating graphical representation of facial expressions of a user wearing a head mounted display accounting for previously captured images of the user's facial expressions
CN109565585B (zh) 用于深度信息确定的多发射器照明源
US10636193B1 (en) Generating graphical representation of a user's face and body using a monitoring system included on a head mounted display
US10636192B1 (en) Generating a graphical representation of a face of a user wearing a head mounted display
US10469722B2 (en) Spatially tiled structured light projector
KR102510644B1 (ko) 깊이 감지를 위해 프로그래밍가능한 회절 광학 요소를 갖는 카메라 어셈블리
US10410373B1 (en) Calibration of a phase interferometry depth camera assembly
US20180173303A1 (en) Eye tracking using a light field camera on a head-mounted display
US10795436B2 (en) Determining fixation of a user's eyes from images of portions of the user's face enclosed by a head mounted display
US10789777B1 (en) Generating content for presentation by a head mounted display based on data captured by a light field camera positioned on the head mounted display
US10948283B1 (en) Tileable structured light projection system
US10521926B1 (en) Tileable non-planar structured light patterns for wide field-of-view depth sensing
US10495882B1 (en) Positioning cameras in a head mounted display to capture images of portions of a face of a user
EP3282285A1 (en) Multiple emitter illumination source for depth information determination
US10462451B1 (en) Asymmetric structured light source
US10855973B1 (en) Depth mapping using fringe interferometry
EP3445049B1 (en) Camera assembly with programmable diffractive optical element for depth sensing

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

A201 Request for examination
A302 Request for accelerated examination
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PA0302 Request for accelerated examination

St.27 status event code: A-1-2-D10-D17-exm-PA0302

St.27 status event code: A-1-2-D10-D16-exm-PA0302

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

R17-X000 Change to representative recorded

St.27 status event code: A-3-3-R10-R17-oth-X000

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PN2301 Change of applicant

St.27 status event code: A-5-5-R10-R13-asn-PN2301

St.27 status event code: A-5-5-R10-R11-asn-PN2301

FPAY Annual fee payment

Payment date: 20221114

Year of fee payment: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20241206

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

H13 Ip right lapsed

Free format text: ST27 STATUS EVENT CODE: N-4-6-H10-H13-OTH-PC1903 (AS PROVIDED BY THE NATIONAL OFFICE); TERMINATION CATEGORY : DEFAULT_OF_REGISTRATION_FEE

Effective date: 20241206

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20241206