JP7643674B2 - ハイブリッドレンダリング - Google Patents

ハイブリッドレンダリング Download PDF

Info

Publication number
JP7643674B2
JP7643674B2 JP2021559786A JP2021559786A JP7643674B2 JP 7643674 B2 JP7643674 B2 JP 7643674B2 JP 2021559786 A JP2021559786 A JP 2021559786A JP 2021559786 A JP2021559786 A JP 2021559786A JP 7643674 B2 JP7643674 B2 JP 7643674B2
Authority
JP
Japan
Prior art keywords
rendering
computing device
depth
remote
rendered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021559786A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022528432A5 (enExample
JP2022528432A (ja
Inventor
バーガー フロムホールド，ダグ
マイケル ライオンズ，ジョナサン
マークス タウト，ベンジャミン
アイマン ミハイル，アシュラフ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of JP2022528432A publication Critical patent/JP2022528432A/ja
Publication of JP2022528432A5 publication Critical patent/JP2022528432A5/ja
Application granted granted Critical
Publication of JP7643674B2 publication Critical patent/JP7643674B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/40—Hidden part removal
    • G06T15/405—Hidden part removal using Z-buffer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Architecture (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • User Interface Of Digital Computer (AREA)
JP2021559786A 2019-04-09 2020-03-09 ハイブリッドレンダリング Active JP7643674B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/379,693 US11170579B2 (en) 2019-04-09 2019-04-09 Hybrid rendering
US16/379,693 2019-04-09
PCT/US2020/021616 WO2020209962A1 (en) 2019-04-09 2020-03-09 Hybrid rendering

Publications (3)

Publication Number Publication Date
JP2022528432A JP2022528432A (ja) 2022-06-10
JP2022528432A5 JP2022528432A5 (enExample) 2023-02-06
JP7643674B2 true JP7643674B2 (ja) 2025-03-11

Family

ID=70190110

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021559786A Active JP7643674B2 (ja) 2019-04-09 2020-03-09 ハイブリッドレンダリング

Country Status (14)

Country Link
US (1) US11170579B2 (enExample)
EP (1) EP3953796B1 (enExample)
JP (1) JP7643674B2 (enExample)
KR (1) KR102807379B1 (enExample)
CN (1) CN113661471B (enExample)
AU (1) AU2020271774A1 (enExample)
BR (1) BR112021020031A2 (enExample)
CA (1) CA3132825A1 (enExample)
IL (1) IL287022A (enExample)
MX (1) MX2021012316A (enExample)
PH (1) PH12021552574A1 (enExample)
SG (1) SG11202109431SA (enExample)
WO (1) WO2020209962A1 (enExample)
ZA (1) ZA202106433B (enExample)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11321927B1 (en) * 2019-09-23 2022-05-03 Apple Inc. Temporal segmentation
US11189100B2 (en) * 2019-11-25 2021-11-30 Verizon Patent and Acessing Inc. Systems and methods for optimizing extended reality experiences
US11308698B2 (en) * 2019-12-05 2022-04-19 Facebook Technologies, Llc. Using deep learning to determine gaze
WO2021173850A1 (en) * 2020-02-27 2021-09-02 Magic Leap, Inc. Cross reality system for large scale environment reconstruction
FR3117632A1 (fr) 2020-12-14 2022-06-17 Orange Procédés et dispositifs d’immersion d’un utilisateur dans une scène immersive et de traitement d’objets 3D.
US11651544B2 (en) 2021-04-30 2023-05-16 Varjo Technologies Oy Systems and methods employing multiple graphics processing units for producing images
WO2023280623A1 (en) * 2021-07-09 2023-01-12 Koninklijke Kpn N.V. Augmenting video or external environment with 3d graphics
KR102605698B1 (ko) * 2022-02-11 2023-11-24 주식회사 유룸 이벤트 생성 기능을 갖는 3d 웹사이트 제작 플랫폼 제공 시스템, 방법 및 프로그램
KR102481613B1 (ko) * 2022-02-11 2022-12-27 주식회사 유룸 편집 기능을 갖는 3d 웹사이트 제작 플랫폼 제공 시스템, 방법 및 프로그램
KR102537403B1 (ko) * 2022-02-11 2023-05-26 주식회사 유룸 3d 컨텐츠 배치 기능을 갖는 3d 웹사이트 제작 플랫폼 제공 시스템, 방법 및 프로그램
US12132954B2 (en) * 2022-04-14 2024-10-29 Tencent America LLC Smart client for streaming of scene-based immersive media
US12573145B2 (en) * 2022-06-30 2026-03-10 Advanced Micro Devices, Inc. Pipeline delay reduction for coarse visibility compression
US12118202B2 (en) 2022-09-19 2024-10-15 Microsoft Technology Licensing, Llc Locally generating preliminary inking imagery
US12505628B2 (en) 2022-11-28 2025-12-23 Samsung Electronics Co., Ltd. Electronic device and method for rendering based on tracking information for user's movement
WO2024177293A1 (ko) * 2023-02-21 2024-08-29 삼성전자주식회사 디스플레이를 통해 표시되는 가상 공간 상에 외부 공간에 대응하는 이미지를 표시하기 위한 전자 장치, 방법, 및 컴퓨터 판독 가능 저장 매체
EP4603954A4 (en) 2023-02-21 2026-02-25 Samsung Electronics Co Ltd COMPUTER-READABLE ELECTRONIC DEVICE, METHOD AND STORAGE MEDIA FOR DISPLAYING AN IMAGE CORRESPONDING TO AN EXTERNAL SPACE IN A VIRTUAL SPACE DISPLAY
US12499622B2 (en) 2023-03-23 2025-12-16 Microsoft Technology Licensing, Llc. Late stage reprojection using tessellated mesh
CN117095100B (zh) * 2023-06-05 2024-11-26 北京虹宇科技有限公司 多任务系统中渲染三维内容的方法、装置及设备
CN117173304B (zh) * 2023-06-05 2025-05-06 北京虹宇科技有限公司 三维内容多人协同方法、装置、系统及设备
WO2024263066A1 (en) * 2023-06-19 2024-12-26 Telefonaktiebolaget Lm Ericsson (Publ) A method and device for rendering extended reality objects
WO2025088435A1 (en) * 2023-10-25 2025-05-01 Nokia Technologies Oy Adaptive split rendering
GB2636089A (en) * 2023-11-28 2025-06-11 Sony Interactive Entertainment Europe Ltd Hybrid pre and post processing
KR102847572B1 (ko) * 2025-01-14 2025-08-20 주식회사 로커스 게임 엔진 시스템 기반의 3ｄ 애니메이션 제작 방법 및 장치

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004348702A (ja) 2002-09-06 2004-12-09 Sony Computer Entertainment Inc 画像処理方法、画像処理装置、および画像処理システム
US20100045662A1 (en) 2006-10-02 2010-02-25 Aftercad Software Inc. Method and system for delivering and interactively displaying three-dimensional graphics
US20170115488A1 (en) 2015-10-26 2017-04-27 Microsoft Technology Licensing, Llc Remote rendering for virtual images

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7088374B2 (en) * 2003-03-27 2006-08-08 Microsoft Corporation System and method for managing visual structure, timing, and animation in a graphics processing system
JP2013118468A (ja) * 2011-12-02 2013-06-13 Sony Corp 画像処理装置および画像処理方法
WO2015141369A1 (ja) * 2014-03-20 2015-09-24 シャープ株式会社 照明装置及び表示装置
WO2016077531A1 (en) 2014-11-13 2016-05-19 Intuitive Surgical Operations, Inc. Integrated user environments
US10146414B2 (en) * 2015-06-09 2018-12-04 Pearson Education, Inc. Augmented physical and virtual manipulatives
WO2017164924A1 (en) 2016-03-21 2017-09-28 Siemens Product Lifecycle Management Software Inc. System for gpu based depth reprojection for accelerating depth buffer generation
US10129523B2 (en) * 2016-06-22 2018-11-13 Microsoft Technology Licensing, Llc Depth-aware reprojection
US9928660B1 (en) 2016-09-12 2018-03-27 Intel Corporation Hybrid rendering for a wearable display attached to a tethered computer
US10621773B2 (en) * 2016-12-30 2020-04-14 Google Llc Rendering content in a 3D environment
CN110832442A (zh) * 2017-06-09 2020-02-21 索尼互动娱乐股份有限公司 注视点渲染系统中的优化的阴影和自适应网状蒙皮
US10776992B2 (en) * 2017-07-05 2020-09-15 Qualcomm Incorporated Asynchronous time warp with depth data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004348702A (ja) 2002-09-06 2004-12-09 Sony Computer Entertainment Inc 画像処理方法、画像処理装置、および画像処理システム
US20100045662A1 (en) 2006-10-02 2010-02-25 Aftercad Software Inc. Method and system for delivering and interactively displaying three-dimensional graphics
US20170115488A1 (en) 2015-10-26 2017-04-27 Microsoft Technology Licensing, Llc Remote rendering for virtual images

Also Published As

Publication number Publication date
PH12021552574A1 (en) 2022-04-04
KR102807379B1 (ko) 2025-05-13
SG11202109431SA (en) 2021-09-29
CN113661471B (zh) 2023-11-24
US20200327740A1 (en) 2020-10-15
EP3953796B1 (en) 2024-04-24
EP3953796A1 (en) 2022-02-16
ZA202106433B (en) 2022-11-30
BR112021020031A2 (pt) 2021-12-07
AU2020271774A1 (en) 2021-10-07
WO2020209962A1 (en) 2020-10-15
MX2021012316A (es) 2021-11-12
US11170579B2 (en) 2021-11-09
KR20210151114A (ko) 2021-12-13
IL287022A (en) 2021-12-01
CN113661471A (zh) 2021-11-16
JP2022528432A (ja) 2022-06-10
CA3132825A1 (en) 2020-10-15

Similar Documents

Publication Publication Date Title
JP7643674B2 (ja) ハイブリッドレンダリング
CN111754381B (zh) 图形渲染方法、装置和计算机可读存储介质
TWI485644B (zh) 群眾外包式（ｃｒｏｗｄ－ｓｏｕｒｃｅｄ）視訊顯像系統
JP6309620B2 (ja) 頂点シェーダのフロント・エンドとしてコンピュート・シェーダを使用すること
CN110969685A (zh) 使用渲染图的可定制渲染管线
KR20230153468A (ko) 3d 오브젝트의 스트리밍 방법, 장치, 및 프로그램
Doellner et al. Server-based rendering of large 3D scenes for mobile devices using G-buffer cube maps
CN116958344A (zh) 虚拟形象的动画生成方法、装置、计算机设备及存储介质
KR20110105350A (ko) 가상 세계 씬의 이미지들을 제공하기 위한 방법 및 장치 그리고 이를 처리하기 위한 방법 및 장치
CN114445257A (zh) 流式传输利用无损或有损压缩进行压缩的光场
CN114494328B (zh) 图像显示方法、装置、电子设备及存储介质
JP2016529593A (ja) 立体シーンのインターリーブ方式のタイル型レンダリング
CN114020390A (zh) Bim模型显示方法、装置、计算机设备和存储介质
CN114419226A (zh) 全景渲染方法、装置、计算机设备和存储介质
CN114788287A (zh) 对体积图像数据上的视图进行编码和解码
CN115375822A (zh) 云模型的渲染方法、装置、存储介质及电子装置
CN117173304B (zh) 三维内容多人协同方法、装置、系统及设备
EP3948790A1 (en) Depth-compressed representation for 3d virtual scene
CN110889384A (zh) 场景切换方法及装置、电子设备和存储介质
CN117496023A (zh) 注视点渲染方法、设备、介质和程序
RU2810701C2 (ru) Гибридный рендеринг
CN119698636A (zh) 用于图像处理的方法、装置及存储介质
HK40059347A (en) Hybrid rendering
CN109923540A (zh) 实时记录用于修改动画的手势和/或声音
CN115545845A (zh) 实物商品展示方法及装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230127

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230127

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240227

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240305

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240604

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240910

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241106

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250128

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250217

R150 Certificate of patent or registration of utility model

Ref document number: 7643674

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150