JP6356784B2 - 拡張現実用のラジアンス伝達サンプリングのための装置および方法 - Google Patents

拡張現実用のラジアンス伝達サンプリングのための装置および方法 Download PDF

Info

Publication number
JP6356784B2
JP6356784B2 JP2016510671A JP2016510671A JP6356784B2 JP 6356784 B2 JP6356784 B2 JP 6356784B2 JP 2016510671 A JP2016510671 A JP 2016510671A JP 2016510671 A JP2016510671 A JP 2016510671A JP 6356784 B2 JP6356784 B2 JP 6356784B2
Authority
JP
Japan
Prior art keywords
rays
environment
video frame
subset
generating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2016510671A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016520908A (ja
JP2016520908A5 (https=
Inventor
ルーカス・グルーバー
ディーター・シュマルスティエグ
Original Assignee
クアルコム，インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム，インコーポレイテッド filed Critical クアルコム，インコーポレイテッド
Publication of JP2016520908A publication Critical patent/JP2016520908A/ja
Publication of JP2016520908A5 publication Critical patent/JP2016520908A5/ja
Application granted granted Critical
Publication of JP6356784B2 publication Critical patent/JP6356784B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/506—Illumination models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/55—Radiosity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/50—Lighting effects
    • G06T15/80—Shading
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/16—Using real world measurements to influence rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Image Generation (AREA)
JP2016510671A 2013-04-24 2014-02-26 拡張現実用のラジアンス伝達サンプリングのための装置および方法 Expired - Fee Related JP6356784B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201361815692P 2013-04-24 2013-04-24
US61/815,692 2013-04-24
US14/189,838 US10062210B2 (en) 2013-04-24 2014-02-25 Apparatus and method for radiance transfer sampling for augmented reality
US14/189,838 2014-02-25
PCT/US2014/018775 WO2014175958A1 (en) 2013-04-24 2014-02-26 Apparatus and method for radiance transfer sampling for augmented reality

Publications (3)

Publication Number Publication Date
JP2016520908A JP2016520908A (ja) 2016-07-14
JP2016520908A5 JP2016520908A5 (https=) 2017-03-09
JP6356784B2 true JP6356784B2 (ja) 2018-07-11

Family

ID=51788883

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016510671A Expired - Fee Related JP6356784B2 (ja) 2013-04-24 2014-02-26 拡張現実用のラジアンス伝達サンプリングのための装置および方法

Country Status (6)

Country Link
US (1) US10062210B2 (https=)
EP (1) EP2989614B1 (https=)
JP (1) JP6356784B2 (https=)
KR (1) KR101933860B1 (https=)
CN (1) CN105144245B (https=)
WO (1) WO2014175958A1 (https=)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7239345B1 (en) * 2001-10-12 2007-07-03 Worldscape, Inc. Camera arrangements with backlighting detection and methods of using same
US10229526B2 (en) * 2014-03-13 2019-03-12 Imagination Technologies Limited Rendering of soft shadows
CN106133796B (zh) 2014-03-25 2019-07-16 苹果公司 用于在真实环境的视图中表示虚拟对象的方法和系统
US9805510B2 (en) 2014-05-13 2017-10-31 Nant Holdings Ip, Llc Augmented reality content rendering via albedo models, systems and methods
CN114296175A (zh) * 2016-07-15 2022-04-08 光场实验室公司 利用二维、光场和全息中继器的能量传播和横向安德森局域化
WO2018014045A2 (en) * 2016-07-15 2018-01-18 Light Field Lab, Inc. Method of calibration for holographic energy directing systems
EP3273686A1 (en) * 2016-07-21 2018-01-24 Thomson Licensing A method for generating layered depth data of a scene
JP6899915B2 (ja) * 2017-03-03 2021-07-07 インターグラフ コーポレイションＩｎｔｅｒｇｒａｐｈ Ｃｏｒｐｏｒａｔｉｏｎ 標高データグリッドのためのシャドウキャスティング
CN107452031B (zh) * 2017-03-09 2020-06-26 叠境数字科技（上海）有限公司 虚拟光线跟踪方法及光场动态重聚焦显示系统
EP3503037B1 (en) * 2017-12-24 2025-08-13 Dassault Systèmes Visibility function of a three-dimensional scene
CN119148489A (zh) 2018-01-14 2024-12-17 光场实验室公司 全息衍射光学编码系统
CN112105976B (zh) 2018-01-14 2022-12-09 光场实验室公司 能量场三维打印系统
CN112105975A (zh) 2018-01-14 2020-12-18 光场实验室公司 用于能量中继器中使用有序结构进行横向能量局域化的系统和方法
JP7274682B2 (ja) 2018-01-14 2023-05-17 ライト フィールド ラボ、インコーポレイテッド ３ｄ環境からデータをレンダリングするためのシステムおよび方法
CN108305328A (zh) * 2018-02-08 2018-07-20 网易（杭州）网络有限公司 虚拟物体渲染方法、系统、介质和计算设备
WO2020023669A1 (en) 2018-07-25 2020-01-30 Light Field Lab, Inc. Light field display system based amusement park attraction
EP3827415A1 (en) * 2018-07-26 2021-06-02 NVIDIA Corporation Global illumination using shared lighting contributions for interactions in path tracing
US10909373B1 (en) 2018-08-24 2021-02-02 Snap Inc. Augmented reality system using structured light
US10930049B2 (en) 2018-08-27 2021-02-23 Apple Inc. Rendering virtual objects with realistic surface properties that match the environment
US10904479B2 (en) 2019-03-12 2021-01-26 Light Field Lab, Inc. Video communication including holographic content
US11212514B2 (en) 2019-03-25 2021-12-28 Light Field Lab, Inc. Light field display system for cinemas
US11428933B2 (en) 2019-05-13 2022-08-30 Light Field Lab, Inc. Light field display system for performance events
KR20220045166A (ko) 2019-08-09 2022-04-12 라이트 필드 랩 인코포레이티드 라이트필드 디스플레이 시스템 기반 디지털 사이니지 시스템
CA3148816A1 (en) * 2019-08-26 2021-03-04 Light Field Lab, Inc. Light field display system for sporting events
US20250191282A1 (en) * 2023-12-06 2025-06-12 Microsoft Technology Licensing, Llc Adaptive sampling of locations in a scene

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5488700A (en) 1993-07-30 1996-01-30 Xerox Corporation Image rendering system with local, adaptive estimation of incident diffuse energy
US6628298B1 (en) * 1998-07-17 2003-09-30 The Regents Of The University Of California Apparatus and method for rendering synthetic objects into real scenes using measurements of scene illumination
US7164420B2 (en) 2003-07-24 2007-01-16 Autodesk, Inc. Ray tracing hierarchy
US7382369B2 (en) 2003-10-10 2008-06-03 Microsoft Corporation Systems and methods for robust sampling for real-time relighting of objects in natural lighting environments
US20090109240A1 (en) 2007-10-24 2009-04-30 Roman Englert Method and System for Providing and Reconstructing a Photorealistic Three-Dimensional Environment
JP4999711B2 (ja) 2007-11-07 2012-08-15 キヤノン株式会社 画像処理装置、画像処理方法
US9082213B2 (en) 2007-11-07 2015-07-14 Canon Kabushiki Kaisha Image processing apparatus for combining real object and virtual object and processing method therefor
US8259110B1 (en) 2007-11-12 2012-09-04 Adobe Systems Incorporated Method and apparatus for computing direct lighting for global illumination rendering in 3-D computer graphics
WO2012007795A1 (en) 2010-07-16 2012-01-19 Sony Ericsson Mobile Communications Ab Three dimensional face modeling and sharing based on two dimensional images

Also Published As

Publication number Publication date
US10062210B2 (en) 2018-08-28
KR20160002994A (ko) 2016-01-08
CN105144245B (zh) 2018-06-22
EP2989614A1 (en) 2016-03-02
JP2016520908A (ja) 2016-07-14
US20140320530A1 (en) 2014-10-30
WO2014175958A1 (en) 2014-10-30
KR101933860B1 (ko) 2018-12-31
EP2989614B1 (en) 2018-01-17
CN105144245A (zh) 2015-12-09

Similar Documents

Publication Publication Date Title
JP6356784B2 (ja) 拡張現実用のラジアンス伝達サンプリングのための装置および方法
US9578226B2 (en) Photometric registration from arbitrary geometry for augmented reality
TWI764974B (zh) 使用一類神經網路過濾影像資料
CN112184575B (zh) 图像渲染的方法和装置
CN108895981B (zh) 一种三维测量方法、装置、服务器和存储介质
Lensing et al. Instant indirect illumination for dynamic mixed reality scenes
JP5655095B2 (ja) デプスカメラの互換性
CN105684037B (zh) 图形处理单元
US10832375B2 (en) Image decomposition and path-space motion estimation
JP2016522485A (ja) 再構成からの隠消現実感効果および媒介現実感効果
JP2013519089A (ja) デプスカメラの互換性
Dos Santos et al. Real time ray tracing for augmented reality
US12315064B2 (en) Motion vector optimization for multiple refractive and reflective interfaces
US10212406B2 (en) Image generation of a three-dimensional scene using multiple focal lengths
CN115272575B (zh) 图像生成方法及装置、存储介质和电子设备
US8891857B2 (en) Concave surface modeling in image-based visual hull
US11508119B2 (en) Inverse path tracing for material and lighting estimation
Kronander et al. Real-time video based lighting using GPU raytracing
CN109685882B (zh) 在渲染中将光场作为更好的背景
CN119991922A (zh) 特效生成方法和装置、计算机可读存储介质、电子设备
CN119399342A (zh) 基于全局-局部表面协同感知的物体高斯逆渲染方法
CN121725122A (zh) 对象渲染方法、装置、设备、介质及产品

Legal Events

Date Code Title Description
A529 Written submission of copy of amendment under article 34 pct

Free format text: JAPANESE INTERMEDIATE CODE: A529

Effective date: 20151021

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170202

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170202

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180131

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180209

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180521

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180614

R150 Certificate of patent or registration of utility model

Ref document number: 6356784

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees