JP7554070B2 - 明視野を使用する仮想および拡張現実 - Google Patents

明視野を使用する仮想および拡張現実 Download PDF

Info

Publication number
JP7554070B2
JP7554070B2 JP2020131411A JP2020131411A JP7554070B2 JP 7554070 B2 JP7554070 B2 JP 7554070B2 JP 2020131411 A JP2020131411 A JP 2020131411A JP 2020131411 A JP2020131411 A JP 2020131411A JP 7554070 B2 JP7554070 B2 JP 7554070B2
Authority
JP
Japan
Prior art keywords
user device
data
bright field
field data
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020131411A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021039747A5 (OSRAM
JP2021039747A (ja
Inventor
ウェイド ジョナサン
Original Assignee
ショッピファイ インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ショッピファイ インコーポレイテッド filed Critical ショッピファイ インコーポレイテッド
Publication of JP2021039747A publication Critical patent/JP2021039747A/ja
Publication of JP2021039747A5 publication Critical patent/JP2021039747A5/ja
Application granted granted Critical
Publication of JP7554070B2 publication Critical patent/JP7554070B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/08—Volume rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10052—Images from lightfield camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Architecture (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2020131411A 2019-08-30 2020-08-03 明視野を使用する仮想および拡張現実 Active JP7554070B2 (ja)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US16/557,267 US20210065427A1 (en) 2019-08-30 2019-08-30 Virtual and augmented reality using light fields
US16/557,267 2019-08-30
EP20185574 2020-07-13
EP20185574.9A EP3786766A1 (en) 2019-08-30 2020-07-13 Virtual and augmented reality using light fields

Publications (3)

Publication Number Publication Date
JP2021039747A JP2021039747A (ja) 2021-03-11
JP2021039747A5 JP2021039747A5 (OSRAM) 2023-08-04
JP7554070B2 true JP7554070B2 (ja) 2024-09-19

Family

ID=71607826

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020131411A Active JP7554070B2 (ja) 2019-08-30 2020-08-03 明視野を使用する仮想および拡張現実

Country Status (9)

Country Link
US (1) US20210065427A1 (OSRAM)
EP (1) EP3786766A1 (OSRAM)
JP (1) JP7554070B2 (OSRAM)
KR (1) KR20210027198A (OSRAM)
CN (1) CN112445336A (OSRAM)
AU (1) AU2020220123A1 (OSRAM)
CA (1) CA3089789A1 (OSRAM)
SG (1) SG10202007284QA (OSRAM)
TW (1) TWI884164B (OSRAM)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12013538B2 (en) 2017-07-03 2024-06-18 Holovisions LLC Augmented reality (AR) eyewear with a section of a fresnel reflector comprising individually-adjustable transmissive-reflective optical elements
US12436394B2 (en) 2017-07-03 2025-10-07 Holovisions Augmented reality (or mixed reality) eyewear with see-through optical elements having individually-adjustable opacity/reflectivity levels
US12205231B2 (en) 2017-07-03 2025-01-21 Holovisions Holovisions™—adjustable and/or modular augmented reality (AR) eyewear with a movable transflective mirror and different viewing modes
JP6655751B1 (ja) * 2019-07-25 2020-02-26 エヌ・ティ・ティ・コミュニケーションズ株式会社 映像表示制御装置、方法およびプログラム
US11029755B2 (en) 2019-08-30 2021-06-08 Shopify Inc. Using prediction information with light fields
US11430175B2 (en) 2019-08-30 2022-08-30 Shopify Inc. Virtual object areas using light fields
GB2609013B (en) * 2021-07-16 2025-08-20 Sony Interactive Entertainment Inc Video recording and playback systems and methods
CN113706673B (zh) * 2021-07-29 2024-07-23 中国南方电网有限责任公司超高压输电公司 一种应用于虚拟增强现实技术的云渲染框架平台
US11659043B1 (en) 2022-01-27 2023-05-23 Meta Platforms Technologies, Llc Systems and methods for predictively downloading volumetric data
CN114697764B (zh) * 2022-06-01 2022-09-02 深圳比特微电子科技有限公司 一种生成视频摘要的方法、装置和可读存储介质
CN117974947B (zh) * 2024-03-29 2024-07-02 山东齐鲁壹点传媒有限公司 一种vr虚拟博物馆系统及藏品推荐算法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040017473A1 (en) 2002-07-27 2004-01-29 Sony Computer Entertainment Inc. Man-machine interface using a deformable device
JP2015095802A (ja) 2013-11-13 2015-05-18 ソニー株式会社 表示制御装置、表示制御方法、およびプログラム
US20150208060A1 (en) 2014-01-23 2015-07-23 Electronics And Telecommunications Research Institute Apparatus and method for inputting and outputting stereo light field supporting generation of eye's moved point of sight
JP2016522463A (ja) 2013-03-11 2016-07-28 マジック リープ， インコーポレイテッド 拡張現実および仮想現実のためのシステムおよび方法
US20180096494A1 (en) 2016-09-30 2018-04-05 Visbit Inc. View-optimized light field image and video streaming
WO2018163637A1 (ja) 2017-03-09 2018-09-13 ソニー株式会社 情報処理装置、情報処理方法及び記録媒体
US20190094981A1 (en) 2014-06-14 2019-03-28 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017528949A (ja) * 2014-07-15 2017-09-28 オステンド・テクノロジーズ・インコーポレーテッド 全方向視差光照射野圧縮のためのプリプロセッサ
US10448030B2 (en) * 2015-11-16 2019-10-15 Ostendo Technologies, Inc. Content adaptive light field compression
GB2574882B (en) * 2018-06-22 2020-08-12 Sony Interactive Entertainment Inc Method and system for displaying a virtual object
CN110062243B (zh) * 2019-04-23 2020-12-11 清华大学深圳研究生院 一种基于近邻优化的光场视频运动估计方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040017473A1 (en) 2002-07-27 2004-01-29 Sony Computer Entertainment Inc. Man-machine interface using a deformable device
JP2016522463A (ja) 2013-03-11 2016-07-28 マジック リープ， インコーポレイテッド 拡張現実および仮想現実のためのシステムおよび方法
JP2015095802A (ja) 2013-11-13 2015-05-18 ソニー株式会社 表示制御装置、表示制御方法、およびプログラム
US20150208060A1 (en) 2014-01-23 2015-07-23 Electronics And Telecommunications Research Institute Apparatus and method for inputting and outputting stereo light field supporting generation of eye's moved point of sight
US20190094981A1 (en) 2014-06-14 2019-03-28 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US20180096494A1 (en) 2016-09-30 2018-04-05 Visbit Inc. View-optimized light field image and video streaming
WO2018163637A1 (ja) 2017-03-09 2018-09-13 ソニー株式会社 情報処理装置、情報処理方法及び記録媒体

Also Published As

Publication number Publication date
US20210065427A1 (en) 2021-03-04
AU2020220123A1 (en) 2021-03-18
EP3786766A1 (en) 2021-03-03
TW202114408A (zh) 2021-04-01
CN112445336A (zh) 2021-03-05
CA3089789A1 (en) 2021-02-28
KR20210027198A (ko) 2021-03-10
TWI884164B (zh) 2025-05-21
JP2021039747A (ja) 2021-03-11
SG10202007284QA (en) 2021-03-30

Similar Documents

Publication Publication Date Title
JP7554070B2 (ja) 明視野を使用する仮想および拡張現実
US12266010B2 (en) Methods, systems, and articles of manufacture for augmented reality application for display of virtual objects
EP3945486B1 (en) Systems and methods for representing user interactions in multi-user augmented reality
US11430175B2 (en) Virtual object areas using light fields
US12086859B2 (en) Systems and methods for recommending a product based on an image of a scene
US12111963B2 (en) Using prediction information with light fields
CA3131589A1 (en) SYSTEMS AND METHODS FOR DELIVERING AUGMENTED CONTENT
US20250371832A1 (en) Systems and methods for editing content items in augmented reality
US20240029279A1 (en) Systems and methods for generating augmented reality scenes
US12423924B2 (en) Methods for calibrating augmented reality scenes

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230727

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230727

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20231115

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20231127

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240611

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240702

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240827

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240906

R150 Certificate of patent or registration of utility model

Ref document number: 7554070

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150