JP6581203B2 - 仮想現実システムにおけるスパース投影 - Google Patents

仮想現実システムにおけるスパース投影 Download PDF

Info

Publication number
JP6581203B2
JP6581203B2 JP2017546086A JP2017546086A JP6581203B2 JP 6581203 B2 JP6581203 B2 JP 6581203B2 JP 2017546086 A JP2017546086 A JP 2017546086A JP 2017546086 A JP2017546086 A JP 2017546086A JP 6581203 B2 JP6581203 B2 JP 6581203B2
Authority
JP
Japan
Prior art keywords
cluster
additional
clusters
diffractive optical
local region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017546086A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018517187A (ja
JP2018517187A5 (https=
Inventor
カッツ、ドブ
フリーマン ラッキー、パーマー
フリーマン ラッキー、パーマー
レドモンド ダミーコ、サム
レドモンド ダミーコ、サム
エム． リチャーズ、エバン
エム． リチャーズ、エバン
シェン、シージェ
リー ドルソン、ジェニファー
リー ドルソン、ジェニファー
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meta Platforms Technologies LLC
Original Assignee
Facebook Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facebook Technologies LLC filed Critical Facebook Technologies LLC
Publication of JP2018517187A publication Critical patent/JP2018517187A/ja
Publication of JP2018517187A5 publication Critical patent/JP2018517187A5/ja
Application granted granted Critical
Publication of JP6581203B2 publication Critical patent/JP6581203B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G02B2027/0174—Head mounted characterised by optical features holographic
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Holo Graphy (AREA)
  • Image Processing (AREA)
JP2017546086A 2015-03-04 2016-03-04 仮想現実システムにおけるスパース投影 Active JP6581203B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562128433P 2015-03-04 2015-03-04
US62/128,433 2015-03-04
PCT/US2016/020814 WO2016141263A1 (en) 2015-03-04 2016-03-04 Sparse projection for a virtual reality system

Publications (3)

Publication Number Publication Date
JP2018517187A JP2018517187A (ja) 2018-06-28
JP2018517187A5 JP2018517187A5 (https=) 2019-02-28
JP6581203B2 true JP6581203B2 (ja) 2019-09-25

Family

ID=56849076

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017546086A Active JP6581203B2 (ja) 2015-03-04 2016-03-04 仮想現実システムにおけるスパース投影

Country Status (6)

Country Link
US (1) US10073263B2 (https=)
EP (1) EP3114528B1 (https=)
JP (1) JP6581203B2 (https=)
KR (1) KR102054695B1 (https=)
CN (1) CN107533225B (https=)
WO (1) WO2016141263A1 (https=)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10643341B2 (en) 2018-03-22 2020-05-05 Microsoft Technology Licensing, Llc Replicated dot maps for simplified depth computation using machine learning
US10728518B2 (en) 2018-03-22 2020-07-28 Microsoft Technology Licensing, Llc Movement detection in low light environments
US10944957B2 (en) 2018-03-22 2021-03-09 Microsoft Technology Licensing, Llc Active stereo matching for depth applications
US10565720B2 (en) * 2018-03-27 2020-02-18 Microsoft Technology Licensing, Llc External IR illuminator enabling improved head tracking and surface reconstruction for virtual reality
US10994216B2 (en) * 2019-08-15 2021-05-04 Board Media Group LLC Virtual reality motion simulator
CN116829902A (zh) 2020-12-14 2023-09-29 夏日机器人公司 基于感测表面和感测表面运动来感知物体
US11686938B2 (en) * 2020-12-16 2023-06-27 Samsung Electronics Co., Ltd. Augmented reality device for providing 3D augmented reality and operating method of the same
WO2023278868A1 (en) 2021-07-01 2023-01-05 Summer Robotics, Inc. Calibration of sensor position offsets based on rotation and translation vectors for matched trajectories
US12148185B2 (en) 2021-07-15 2024-11-19 Summer Robotics, Inc. Automatic parameter adjustment for scanning event cameras
US11704835B2 (en) 2021-07-29 2023-07-18 Summer Robotics, Inc. Dynamic calibration of 3D acquisition systems
CN115728943B (zh) * 2021-09-02 2025-04-01 成都极米科技股份有限公司 Vr投影系统
WO2023096873A1 (en) 2021-11-28 2023-06-01 Summer Robotics, Inc. Association of concurrent tracks across multiple views
WO2023164064A1 (en) 2022-02-27 2023-08-31 Summer Robotics, Inc. Association of concurrent tracks using graph crossings
WO2023177692A1 (en) 2022-03-14 2023-09-21 Summer Robotics, Inc. Stage studio for immersive 3-d video capture
WO2023196225A1 (en) * 2022-04-05 2023-10-12 Summer Robotics, Inc. Auxiliary device for augmented reality
US12401905B2 (en) 2022-07-14 2025-08-26 Summer Robotics, Inc. Foveated robotic vision system
US11974055B1 (en) 2022-10-17 2024-04-30 Summer Robotics, Inc. Perceiving scene features using event sensors and image sensors
US12276730B2 (en) 2022-11-08 2025-04-15 Summer Robotics, Inc. Virtual fences in air, water, and space
US12416804B1 (en) 2024-05-08 2025-09-16 Summer Robotics, Inc. Kaleidoscopic laser beam projection system
CN120812235B (zh) * 2025-09-09 2025-11-11 南京芯视元电子有限公司 微显示系统及头显设备

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4473133B2 (ja) * 2002-11-13 2010-06-02 シーリアル、テクノロジーズ、ゲーエムベーハー 映像ホログラムおよび映像ホログラム再生装置
US8164640B2 (en) * 2005-06-30 2012-04-24 Nokia Corporation Camera control means to allow operating of a destined location of the information surface of a presentation and information system
WO2012033170A1 (ja) * 2010-09-08 2012-03-15 大日本印刷株式会社 投射装置および投射型映像表示装置
JPWO2012049795A1 (ja) * 2010-10-12 2014-02-24 パナソニック株式会社 表示処理装置、表示方法およびプログラム
US20140063061A1 (en) * 2011-08-26 2014-03-06 Reincloud Corporation Determining a position of an item in a virtual augmented space
JP5966510B2 (ja) * 2012-03-29 2016-08-10 ソニー株式会社 情報処理システム
KR101861380B1 (ko) * 2012-07-16 2018-05-28 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 헤드 마운트 디스플레이를 이용한 컨텐츠 출력 방법 및 이를 위한 헤드 마운트 디스플레이
US8711370B1 (en) * 2012-10-04 2014-04-29 Gerard Dirk Smits Scanning optical positioning system with spatially triangulating receivers
JP6061334B2 (ja) 2012-11-26 2017-01-18 Kddi株式会社 光学式シースルー型ｈｍｄを用いたａｒシステム
US20140160162A1 (en) * 2012-12-12 2014-06-12 Dhanushan Balachandreswaran Surface projection device for augmented reality
JP6123342B2 (ja) * 2013-02-20 2017-05-10 ソニー株式会社 表示装置
EP2797313A1 (en) * 2013-04-26 2014-10-29 Elvesjö, John Computer graphics presentation system and method
DE102013210746A1 (de) * 2013-06-10 2014-12-11 Robert Bosch Gmbh System und Verfahren zum Überwachen und/oder Bedienen einer technischen Anlage, insbesondere eines Fahrzeugs
CN103617636B (zh) * 2013-12-02 2016-08-17 西北工业大学 基于运动信息及稀疏投影的视频目标自动检测跟踪方法
KR20150096948A (ko) 2014-02-17 2015-08-26 엘지전자 주식회사 증강 현실 사진 촬영 가이드를 디스플레이 하는 헤드 마운티드 디스플레이 디바이스 및 그 제어 방법
US20150253574A1 (en) * 2014-03-10 2015-09-10 Ion Virtual Technology Corporation Modular and Convertible Virtual Reality Headset System
EP3117263B1 (en) * 2014-03-14 2018-05-09 Sony Interactive Entertainment Inc. Methods and systems tracking head mounted display (hmd) and calibrations for hmd headband adjustments

Also Published As

Publication number Publication date
CN107533225B (zh) 2020-07-14
CN107533225A (zh) 2018-01-02
KR102054695B1 (ko) 2019-12-11
EP3114528A4 (en) 2017-11-01
KR20170122215A (ko) 2017-11-03
US20160259168A1 (en) 2016-09-08
JP2018517187A (ja) 2018-06-28
US10073263B2 (en) 2018-09-11
WO2016141263A1 (en) 2016-09-09
EP3114528B1 (en) 2019-11-06
EP3114528A1 (en) 2017-01-11

Similar Documents

Publication Publication Date Title
JP6581203B2 (ja) 仮想現実システムにおけるスパース投影
JP7307093B2 (ja) 深度検知システム用の動的構造化光
US10511829B1 (en) Dynamic control over structured illumination intensity
US11450015B2 (en) Shifting diffractive optical element for adjustable depth sensing resolution
EP3371973B1 (en) Eye tracking using a diffraction pattern of coherent light on the surface of the eye
US10636193B1 (en) Generating graphical representation of a user's face and body using a monitoring system included on a head mounted display
US10529113B1 (en) Generating graphical representation of facial expressions of a user wearing a head mounted display accounting for previously captured images of the user's facial expressions
US10237481B2 (en) Event camera for generation of event-based images
KR102510644B1 (ko) 깊이 감지를 위해 프로그래밍가능한 회절 광학 요소를 갖는 카메라 어셈블리
US10120442B2 (en) Eye tracking using a light field camera on a head-mounted display
US10791283B2 (en) Imaging device based on lens assembly with embedded filter
JP2022504010A (ja) 構造化光源および飛行時間カメラ付き深度測定アセンブリ
US10795436B2 (en) Determining fixation of a user's eyes from images of portions of the user's face enclosed by a head mounted display
US10948283B1 (en) Tileable structured light projection system
JP2019533918A (ja) 深度マッピング用のアレイ検出器
US10789777B1 (en) Generating content for presentation by a head mounted display based on data captured by a light field camera positioned on the head mounted display
US10521926B1 (en) Tileable non-planar structured light patterns for wide field-of-view depth sensing
EP3393122A1 (en) Event camera
US10495882B1 (en) Positioning cameras in a head mounted display to capture images of portions of a face of a user
EP3445049B1 (en) Camera assembly with programmable diffractive optical element for depth sensing

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20180709

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20180709

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190117

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20190117

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20190117

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20190128

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190319

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20190520

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20190619

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190701

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20190730

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190829

R150 Certificate of patent or registration of utility model

Ref document number: 6581203

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250