CN107533225B - 用于虚拟现实系统的稀疏投影 - Google Patents

用于虚拟现实系统的稀疏投影 Download PDF

Info

Publication number
CN107533225B
CN107533225B CN201680022460.1A CN201680022460A CN107533225B CN 107533225 B CN107533225 B CN 107533225B CN 201680022460 A CN201680022460 A CN 201680022460A CN 107533225 B CN107533225 B CN 107533225B
Authority
CN
China
Prior art keywords
clusters
additional
diffractive optical
local area
cluster
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680022460.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN107533225A (zh
Inventor
多夫·卡茨
帕尔默·弗里曼·勒基
山姆·雷德蒙·达米科
伊万·M·理查兹
沈诗哲
珍妮弗·利·道尔森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meta Platforms Technologies LLC
Original Assignee
Oculus VR Inc
Facebook Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oculus VR Inc, Facebook Technologies LLC filed Critical Oculus VR Inc
Publication of CN107533225A publication Critical patent/CN107533225A/zh
Application granted granted Critical
Publication of CN107533225B publication Critical patent/CN107533225B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G02B2027/0174—Head mounted characterised by optical features holographic
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Holo Graphy (AREA)
  • Image Processing (AREA)
CN201680022460.1A 2015-03-04 2016-03-04 用于虚拟现实系统的稀疏投影 Active CN107533225B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562128433P 2015-03-04 2015-03-04
US62/128,433 2015-03-04
PCT/US2016/020814 WO2016141263A1 (en) 2015-03-04 2016-03-04 Sparse projection for a virtual reality system

Publications (2)

Publication Number Publication Date
CN107533225A CN107533225A (zh) 2018-01-02
CN107533225B true CN107533225B (zh) 2020-07-14

Family

ID=56849076

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680022460.1A Active CN107533225B (zh) 2015-03-04 2016-03-04 用于虚拟现实系统的稀疏投影

Country Status (6)

Country Link
US (1) US10073263B2 (https=)
EP (1) EP3114528B1 (https=)
JP (1) JP6581203B2 (https=)
KR (1) KR102054695B1 (https=)
CN (1) CN107533225B (https=)
WO (1) WO2016141263A1 (https=)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10643341B2 (en) 2018-03-22 2020-05-05 Microsoft Technology Licensing, Llc Replicated dot maps for simplified depth computation using machine learning
US10728518B2 (en) 2018-03-22 2020-07-28 Microsoft Technology Licensing, Llc Movement detection in low light environments
US10944957B2 (en) 2018-03-22 2021-03-09 Microsoft Technology Licensing, Llc Active stereo matching for depth applications
US10565720B2 (en) * 2018-03-27 2020-02-18 Microsoft Technology Licensing, Llc External IR illuminator enabling improved head tracking and surface reconstruction for virtual reality
US10994216B2 (en) * 2019-08-15 2021-05-04 Board Media Group LLC Virtual reality motion simulator
CN116829902A (zh) 2020-12-14 2023-09-29 夏日机器人公司 基于感测表面和感测表面运动来感知物体
US11686938B2 (en) * 2020-12-16 2023-06-27 Samsung Electronics Co., Ltd. Augmented reality device for providing 3D augmented reality and operating method of the same
WO2023278868A1 (en) 2021-07-01 2023-01-05 Summer Robotics, Inc. Calibration of sensor position offsets based on rotation and translation vectors for matched trajectories
US12148185B2 (en) 2021-07-15 2024-11-19 Summer Robotics, Inc. Automatic parameter adjustment for scanning event cameras
US11704835B2 (en) 2021-07-29 2023-07-18 Summer Robotics, Inc. Dynamic calibration of 3D acquisition systems
CN115728943B (zh) * 2021-09-02 2025-04-01 成都极米科技股份有限公司 Vr投影系统
WO2023096873A1 (en) 2021-11-28 2023-06-01 Summer Robotics, Inc. Association of concurrent tracks across multiple views
WO2023164064A1 (en) 2022-02-27 2023-08-31 Summer Robotics, Inc. Association of concurrent tracks using graph crossings
WO2023177692A1 (en) 2022-03-14 2023-09-21 Summer Robotics, Inc. Stage studio for immersive 3-d video capture
WO2023196225A1 (en) * 2022-04-05 2023-10-12 Summer Robotics, Inc. Auxiliary device for augmented reality
US12401905B2 (en) 2022-07-14 2025-08-26 Summer Robotics, Inc. Foveated robotic vision system
US11974055B1 (en) 2022-10-17 2024-04-30 Summer Robotics, Inc. Perceiving scene features using event sensors and image sensors
US12276730B2 (en) 2022-11-08 2025-04-15 Summer Robotics, Inc. Virtual fences in air, water, and space
US12416804B1 (en) 2024-05-08 2025-09-16 Summer Robotics, Inc. Kaleidoscopic laser beam projection system
CN120812235B (zh) * 2025-09-09 2025-11-11 南京芯视元电子有限公司 微显示系统及头显设备

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4473133B2 (ja) * 2002-11-13 2010-06-02 シーリアル、テクノロジーズ、ゲーエムベーハー 映像ホログラムおよび映像ホログラム再生装置
US8164640B2 (en) * 2005-06-30 2012-04-24 Nokia Corporation Camera control means to allow operating of a destined location of the information surface of a presentation and information system
WO2012033170A1 (ja) * 2010-09-08 2012-03-15 大日本印刷株式会社 投射装置および投射型映像表示装置
JPWO2012049795A1 (ja) * 2010-10-12 2014-02-24 パナソニック株式会社 表示処理装置、表示方法およびプログラム
US20140063061A1 (en) * 2011-08-26 2014-03-06 Reincloud Corporation Determining a position of an item in a virtual augmented space
JP5966510B2 (ja) * 2012-03-29 2016-08-10 ソニー株式会社 情報処理システム
KR101861380B1 (ko) * 2012-07-16 2018-05-28 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 헤드 마운트 디스플레이를 이용한 컨텐츠 출력 방법 및 이를 위한 헤드 마운트 디스플레이
US8711370B1 (en) * 2012-10-04 2014-04-29 Gerard Dirk Smits Scanning optical positioning system with spatially triangulating receivers
JP6061334B2 (ja) 2012-11-26 2017-01-18 Kddi株式会社 光学式シースルー型ｈｍｄを用いたａｒシステム
US20140160162A1 (en) * 2012-12-12 2014-06-12 Dhanushan Balachandreswaran Surface projection device for augmented reality
JP6123342B2 (ja) * 2013-02-20 2017-05-10 ソニー株式会社 表示装置
EP2797313A1 (en) * 2013-04-26 2014-10-29 Elvesjö, John Computer graphics presentation system and method
DE102013210746A1 (de) * 2013-06-10 2014-12-11 Robert Bosch Gmbh System und Verfahren zum Überwachen und/oder Bedienen einer technischen Anlage, insbesondere eines Fahrzeugs
CN103617636B (zh) * 2013-12-02 2016-08-17 西北工业大学 基于运动信息及稀疏投影的视频目标自动检测跟踪方法
KR20150096948A (ko) 2014-02-17 2015-08-26 엘지전자 주식회사 증강 현실 사진 촬영 가이드를 디스플레이 하는 헤드 마운티드 디스플레이 디바이스 및 그 제어 방법
US20150253574A1 (en) * 2014-03-10 2015-09-10 Ion Virtual Technology Corporation Modular and Convertible Virtual Reality Headset System
EP3117263B1 (en) * 2014-03-14 2018-05-09 Sony Interactive Entertainment Inc. Methods and systems tracking head mounted display (hmd) and calibrations for hmd headband adjustments

Also Published As

Publication number Publication date
CN107533225A (zh) 2018-01-02
JP6581203B2 (ja) 2019-09-25
KR102054695B1 (ko) 2019-12-11
EP3114528A4 (en) 2017-11-01
KR20170122215A (ko) 2017-11-03
US20160259168A1 (en) 2016-09-08
JP2018517187A (ja) 2018-06-28
US10073263B2 (en) 2018-09-11
WO2016141263A1 (en) 2016-09-09
EP3114528B1 (en) 2019-11-06
EP3114528A1 (en) 2017-01-11

Similar Documents

Publication Publication Date Title
CN107533225B (zh) 用于虚拟现实系统的稀疏投影
CN109565585B (zh) 用于深度信息确定的多发射器照明源
JP7307093B2 (ja) 深度検知システム用の動的構造化光
EP3371973B1 (en) Eye tracking using a diffraction pattern of coherent light on the surface of the eye
US10636193B1 (en) Generating graphical representation of a user's face and body using a monitoring system included on a head mounted display
US10469722B2 (en) Spatially tiled structured light projector
US10529113B1 (en) Generating graphical representation of facial expressions of a user wearing a head mounted display accounting for previously captured images of the user's facial expressions
CN109425994B (zh) 深度相机组件、头戴式显示器和用于深度感测的方法
US10410373B1 (en) Calibration of a phase interferometry depth camera assembly
KR102510644B1 (ko) 깊이 감지를 위해 프로그래밍가능한 회절 광학 요소를 갖는 카메라 어셈블리
US10795436B2 (en) Determining fixation of a user's eyes from images of portions of the user's face enclosed by a head mounted display
WO2018194737A1 (en) Event camera
US10948283B1 (en) Tileable structured light projection system
JP2019533918A (ja) 深度マッピング用のアレイ検出器
US10789777B1 (en) Generating content for presentation by a head mounted display based on data captured by a light field camera positioned on the head mounted display
US10521926B1 (en) Tileable non-planar structured light patterns for wide field-of-view depth sensing
EP3393122A1 (en) Event camera
EP3282285B1 (en) Multiple emitter illumination source for depth information determination
US10462451B1 (en) Asymmetric structured light source
US10495882B1 (en) Positioning cameras in a head mounted display to capture images of portions of a face of a user
US10855973B1 (en) Depth mapping using fringe interferometry
US10685453B1 (en) Folded laser emitters for structured light applications

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: California, USA

Applicant after: Facebook Technologies, LLC

Address before: California, USA

Applicant before: OCULUS VR, LLC

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder

Address after: California, USA

Patentee after: Yuan Platform Technology Co.,Ltd.

Address before: California, USA

Patentee before: Facebook Technologies, LLC

CP01 Change in the name or title of a patent holder