SG10202007284QA - Virtual and augmented reality using light fields - Google Patents

Virtual and augmented reality using light fields

Info

Publication number
SG10202007284QA
SG10202007284QA SG10202007284QA SG10202007284QA SG10202007284QA SG 10202007284Q A SG10202007284Q A SG 10202007284QA SG 10202007284Q A SG10202007284Q A SG 10202007284QA SG 10202007284Q A SG10202007284Q A SG 10202007284QA SG 10202007284Q A SG10202007284Q A SG 10202007284QA
Authority
SG
Singapore
Prior art keywords
virtual
augmented reality
light fields
fields
light
Prior art date
Application number
SG10202007284QA
Other languages
English (en)
Inventor
WADE Jonathan
Original Assignee
Shopify Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shopify Inc filed Critical Shopify Inc
Publication of SG10202007284QA publication Critical patent/SG10202007284QA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/08—Volume rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10052—Images from lightfield camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Architecture (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
SG10202007284QA 2019-08-30 2020-07-30 Virtual and augmented reality using light fields SG10202007284QA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/557,267 US20210065427A1 (en) 2019-08-30 2019-08-30 Virtual and augmented reality using light fields
EP20185574.9A EP3786766A1 (en) 2019-08-30 2020-07-13 Virtual and augmented reality using light fields

Publications (1)

Publication Number Publication Date
SG10202007284QA true SG10202007284QA (en) 2021-03-30

Family

ID=71607826

Family Applications (1)

Application Number Title Priority Date Filing Date
SG10202007284QA SG10202007284QA (en) 2019-08-30 2020-07-30 Virtual and augmented reality using light fields

Country Status (9)

Country Link
US (1) US20210065427A1 (https=)
EP (1) EP3786766A1 (https=)
JP (1) JP7554070B2 (https=)
KR (1) KR20210027198A (https=)
CN (1) CN112445336A (https=)
AU (1) AU2020220123A1 (https=)
CA (1) CA3089789C (https=)
SG (1) SG10202007284QA (https=)
TW (1) TWI884164B (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12205231B2 (en) 2017-07-03 2025-01-21 Holovisions Holovisions™—adjustable and/or modular augmented reality (AR) eyewear with a movable transflective mirror and different viewing modes
US12013538B2 (en) 2017-07-03 2024-06-18 Holovisions LLC Augmented reality (AR) eyewear with a section of a fresnel reflector comprising individually-adjustable transmissive-reflective optical elements
US12601923B2 (en) 2017-07-03 2026-04-14 Holovisions LLC Augmented reality (AR) eyewear with an environment-only viewing mode and an augmented reality viewing mode
US12436394B2 (en) 2017-07-03 2025-10-07 Holovisions Augmented reality (or mixed reality) eyewear with see-through optical elements having individually-adjustable opacity/reflectivity levels
JP6655751B1 (ja) * 2019-07-25 2020-02-26 エヌ・ティ・ティ・コミュニケーションズ株式会社 映像表示制御装置、方法およびプログラム
US11029755B2 (en) 2019-08-30 2021-06-08 Shopify Inc. Using prediction information with light fields
US11430175B2 (en) 2019-08-30 2022-08-30 Shopify Inc. Virtual object areas using light fields
GB2609013B (en) * 2021-07-16 2025-08-20 Sony Interactive Entertainment Inc Video recording and playback systems and methods
CN113706673B (zh) * 2021-07-29 2024-07-23 中国南方电网有限责任公司超高压输电公司 一种应用于虚拟增强现实技术的云渲染框架平台
US11659043B1 (en) 2022-01-27 2023-05-23 Meta Platforms Technologies, Llc Systems and methods for predictively downloading volumetric data
CN114697764B (zh) * 2022-06-01 2022-09-02 深圳比特微电子科技有限公司 一种生成视频摘要的方法、装置和可读存储介质
CN117974947B (zh) * 2024-03-29 2024-07-02 山东齐鲁壹点传媒有限公司 一种vr虚拟博物馆系统及藏品推荐算法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7102615B2 (en) 2002-07-27 2006-09-05 Sony Computer Entertainment Inc. Man-machine interface using a deformable device
IL308285B2 (en) 2013-03-11 2024-11-01 Magic Leap Inc System and method for augmentation and virtual reality
JP2015095802A (ja) 2013-11-13 2015-05-18 ソニー株式会社 表示制御装置、表示制御方法、およびプログラム
KR20150088355A (ko) * 2014-01-23 2015-08-03 한국전자통신연구원 눈동자 이동 시점 생성을 지원하는 스테레오 라이트필드 입출력 장치 및 방법
US10852838B2 (en) * 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
JP2017528949A (ja) * 2014-07-15 2017-09-28 オステンド・テクノロジーズ・インコーポレーテッド 全方向視差光照射野圧縮のためのプリプロセッサ
US10448030B2 (en) * 2015-11-16 2019-10-15 Ostendo Technologies, Inc. Content adaptive light field compression
WO2018064502A1 (en) * 2016-09-30 2018-04-05 Visbit Inc. View-optimized light field image and video streaming
DE112018001224T5 (de) 2017-03-09 2019-11-28 Sony Corporation Datenprozessor, Datenverarbeitungsverfahren und Aufzeichnungsmedium
GB2574882B (en) * 2018-06-22 2020-08-12 Sony Interactive Entertainment Inc Method and system for displaying a virtual object
CN110062243B (zh) * 2019-04-23 2020-12-11 清华大学深圳研究生院 一种基于近邻优化的光场视频运动估计方法

Also Published As

Publication number Publication date
US20210065427A1 (en) 2021-03-04
CA3089789A1 (en) 2021-02-28
TW202114408A (zh) 2021-04-01
EP3786766A1 (en) 2021-03-03
TWI884164B (zh) 2025-05-21
KR20210027198A (ko) 2021-03-10
CA3089789C (en) 2026-03-10
AU2020220123A1 (en) 2021-03-18
CN112445336A (zh) 2021-03-05
JP2021039747A (ja) 2021-03-11
JP7554070B2 (ja) 2024-09-19

Similar Documents

Publication Publication Date Title
SG10202007284QA (en) Virtual and augmented reality using light fields
EP3629134C0 (en) INTERACTION TECHNIQUES FOR AUGMENTED REALITY
IL274294B (en) Interactive augmented or virtual reality devices
IL275615A (en) Represents augmented reality with active alignment and matching methods
IL290382B1 (en) Continuous time warping and binocular time warping for virtual and augmented reality display systems and methods
IL273645A (en) Augmented reality display
GB201705160D0 (en) Waveguide for an augmented reality or virtual reality display
SG11202101783RA (en) Modular augmented and virtual reality ride attraction
IL261769A (en) Virtual and augmented reality systems and methods
IL261138A (en) Virtual and augmented reality systems and methods
IL264489A (en) Virtual and augmented reality systems at a fixed distance and methods
GB202103276D0 (en) Augmented reality display view generation
SG11202112943QA (en) Virtual, augmented and extended reality system
IL254886A0 (en) Separated pupil optical systems for virtual and augmented reality and methods for displaying images using them
GB201905773D0 (en) Display for augmented reality
GB201817310D0 (en) Device for augmented reality or virtual reality display
GB201808055D0 (en) Optical structure for augmented reality display
GB201815516D0 (en) Device for augmented reality or virtual reality display
EP3580714A4 (en) OPERATING SYSTEMS WITH EXTENDED AND VIRTUAL REALITY
GB201720605D0 (en) Display for augmented reality or virtual reality
GB201903037D0 (en) Display for augmented realityor virtual reality
GB201902028D0 (en) Augmented reality methods and systems
GB201906420D0 (en) Virtual augmented and mixed reality systems with physical feedback
GB2585241B (en) Augmented reality system
GB201813535D0 (en) Optical structure for augmented reality display