CA3132825A1 - Hybrid rendering - Google Patents

Hybrid rendering Download PDF

Info

Publication number
CA3132825A1
CA3132825A1 CA3132825A CA3132825A CA3132825A1 CA 3132825 A1 CA3132825 A1 CA 3132825A1 CA 3132825 A CA3132825 A CA 3132825A CA 3132825 A CA3132825 A CA 3132825A CA 3132825 A1 CA3132825 A1 CA 3132825A1
Authority
CA
Canada
Prior art keywords
rendering
computing device
remote
local
rendered
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3132825A
Other languages
English (en)
French (fr)
Inventor
Dag Birger Frommhold
Jonathan Michael LYONS
Benjamin Markus Thaut
Ashraf Ayman Michail
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of CA3132825A1 publication Critical patent/CA3132825A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/40—Hidden part removal
    • G06T15/405—Hidden part removal using Z-buffer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • User Interface Of Digital Computer (AREA)
CA3132825A 2019-04-09 2020-03-09 Hybrid rendering Pending CA3132825A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/379,693 US11170579B2 (en) 2019-04-09 2019-04-09 Hybrid rendering
US16/379,693 2019-04-09
PCT/US2020/021616 WO2020209962A1 (en) 2019-04-09 2020-03-09 Hybrid rendering

Publications (1)

Publication Number Publication Date
CA3132825A1 true CA3132825A1 (en) 2020-10-15

Family

ID=70190110

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3132825A Pending CA3132825A1 (en) 2019-04-09 2020-03-09 Hybrid rendering

Country Status (14)

Country Link
US (1) US11170579B2 (cg-RX-API-DMAC7.html)
EP (1) EP3953796B1 (cg-RX-API-DMAC7.html)
JP (1) JP7643674B2 (cg-RX-API-DMAC7.html)
KR (1) KR102807379B1 (cg-RX-API-DMAC7.html)
CN (1) CN113661471B (cg-RX-API-DMAC7.html)
AU (1) AU2020271774A1 (cg-RX-API-DMAC7.html)
BR (1) BR112021020031A2 (cg-RX-API-DMAC7.html)
CA (1) CA3132825A1 (cg-RX-API-DMAC7.html)
IL (1) IL287022A (cg-RX-API-DMAC7.html)
MX (1) MX2021012316A (cg-RX-API-DMAC7.html)
PH (1) PH12021552574A1 (cg-RX-API-DMAC7.html)
SG (1) SG11202109431SA (cg-RX-API-DMAC7.html)
WO (1) WO2020209962A1 (cg-RX-API-DMAC7.html)
ZA (1) ZA202106433B (cg-RX-API-DMAC7.html)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11321927B1 (en) * 2019-09-23 2022-05-03 Apple Inc. Temporal segmentation
US11189100B2 (en) * 2019-11-25 2021-11-30 Verizon Patent and Acessing Inc. Systems and methods for optimizing extended reality experiences
US11308698B2 (en) * 2019-12-05 2022-04-19 Facebook Technologies, Llc. Using deep learning to determine gaze
US11501489B2 (en) * 2020-02-27 2022-11-15 Magic Leap, Inc. Cross reality system for large scale environment reconstruction
FR3117632A1 (fr) 2020-12-14 2022-06-17 Orange Procédés et dispositifs d’immersion d’un utilisateur dans une scène immersive et de traitement d’objets 3D.
US11651544B2 (en) * 2021-04-30 2023-05-16 Varjo Technologies Oy Systems and methods employing multiple graphics processing units for producing images
US12661584B2 (en) 2021-05-26 2026-06-23 Google Llc Hybrid cloud and local rendering
WO2023280623A1 (en) * 2021-07-09 2023-01-12 Koninklijke Kpn N.V. Augmenting video or external environment with 3d graphics
US12616907B2 (en) 2021-12-09 2026-05-05 Universal City Studios Llc Amusement content processing systems and methods
KR102481613B1 (ko) * 2022-02-11 2022-12-27 주식회사 유룸 편집 기능을 갖는 3d 웹사이트 제작 플랫폼 제공 시스템, 방법 및 프로그램
KR102537403B1 (ko) * 2022-02-11 2023-05-26 주식회사 유룸 3d 컨텐츠 배치 기능을 갖는 3d 웹사이트 제작 플랫폼 제공 시스템, 방법 및 프로그램
KR102605698B1 (ko) * 2022-02-11 2023-11-24 주식회사 유룸 이벤트 생성 기능을 갖는 3d 웹사이트 제작 플랫폼 제공 시스템, 방법 및 프로그램
US12132954B2 (en) * 2022-04-14 2024-10-29 Tencent America LLC Smart client for streaming of scene-based immersive media
US12573145B2 (en) * 2022-06-30 2026-03-10 Advanced Micro Devices, Inc. Pipeline delay reduction for coarse visibility compression
US12118202B2 (en) * 2022-09-19 2024-10-15 Microsoft Technology Licensing, Llc Locally generating preliminary inking imagery
WO2024117452A1 (ko) 2022-11-28 2024-06-06 삼성전자주식회사 사용자의 움직임에 대한 트래킹 정보에 기반하여 렌더링을 하기 위한 전자 장치 및 방법
EP4603954A4 (en) 2023-02-21 2026-02-25 Samsung Electronics Co Ltd COMPUTER-READABLE ELECTRONIC DEVICE, METHOD AND STORAGE MEDIA FOR DISPLAYING AN IMAGE CORRESPONDING TO AN EXTERNAL SPACE IN A VIRTUAL SPACE DISPLAY
US12682571B2 (en) * 2023-03-17 2026-07-14 Microsoft Technology Licensing, Llc. Split compute reprojection
US12499622B2 (en) 2023-03-23 2025-12-16 Microsoft Technology Licensing, Llc. Late stage reprojection using tessellated mesh
CN117173304B (zh) * 2023-06-05 2025-05-06 北京虹宇科技有限公司 三维内容多人协同方法、装置、系统及设备
CN119904561A (zh) * 2023-06-05 2025-04-29 北京虹宇科技有限公司 多任务系统中渲染三维内容的方法、装置及设备
WO2024263066A1 (en) * 2023-06-19 2024-12-26 Telefonaktiebolaget Lm Ericsson (Publ) A method and device for rendering extended reality objects
WO2025088435A1 (en) * 2023-10-25 2025-05-01 Nokia Technologies Oy Adaptive split rendering
GB2636089A (en) * 2023-11-28 2025-06-11 Sony Interactive Entertainment Europe Ltd Hybrid pre and post processing
KR102847572B1 (ko) * 2025-01-14 2025-08-20 주식회사 로커스 게임 엔진 시스템 기반의 3d 애니메이션 제작 방법 및 장치

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4467267B2 (ja) 2002-09-06 2010-05-26 株式会社ソニー・コンピュータエンタテインメント 画像処理方法、画像処理装置、および画像処理システム
US7088374B2 (en) * 2003-03-27 2006-08-08 Microsoft Corporation System and method for managing visual structure, timing, and animation in a graphics processing system
WO2008040123A1 (en) * 2006-10-02 2008-04-10 Aftercad Software Inc. Method and system for delivering and interactively displaying three-dimensional graphics
JP2013118468A (ja) * 2011-12-02 2013-06-13 Sony Corp 画像処理装置および画像処理方法
WO2015141369A1 (ja) * 2014-03-20 2015-09-24 シャープ株式会社 照明装置及び表示装置
WO2016077531A1 (en) 2014-11-13 2016-05-19 Intuitive Surgical Operations, Inc. Integrated user environments
US10146414B2 (en) * 2015-06-09 2018-12-04 Pearson Education, Inc. Augmented physical and virtual manipulatives
US10962780B2 (en) 2015-10-26 2021-03-30 Microsoft Technology Licensing, Llc Remote rendering for virtual images
WO2017164924A1 (en) 2016-03-21 2017-09-28 Siemens Product Lifecycle Management Software Inc. System for gpu based depth reprojection for accelerating depth buffer generation
US10129523B2 (en) * 2016-06-22 2018-11-13 Microsoft Technology Licensing, Llc Depth-aware reprojection
US9928660B1 (en) 2016-09-12 2018-03-27 Intel Corporation Hybrid rendering for a wearable display attached to a tethered computer
US10621773B2 (en) * 2016-12-30 2020-04-14 Google Llc Rendering content in a 3D environment
CN110832442A (zh) * 2017-06-09 2020-02-21 索尼互动娱乐股份有限公司 注视点渲染系统中的优化的阴影和自适应网状蒙皮
US10776992B2 (en) * 2017-07-05 2020-09-15 Qualcomm Incorporated Asynchronous time warp with depth data

Also Published As

Publication number Publication date
EP3953796A1 (en) 2022-02-16
KR20210151114A (ko) 2021-12-13
PH12021552574A1 (en) 2022-04-04
CN113661471A (zh) 2021-11-16
AU2020271774A1 (en) 2021-10-07
CN113661471B (zh) 2023-11-24
ZA202106433B (en) 2022-11-30
JP2022528432A (ja) 2022-06-10
IL287022A (en) 2021-12-01
BR112021020031A2 (pt) 2021-12-07
SG11202109431SA (en) 2021-09-29
WO2020209962A1 (en) 2020-10-15
US20200327740A1 (en) 2020-10-15
MX2021012316A (es) 2021-11-12
JP7643674B2 (ja) 2025-03-11
US11170579B2 (en) 2021-11-09
EP3953796B1 (en) 2024-04-24
KR102807379B1 (ko) 2025-05-13

Similar Documents

Publication Publication Date Title
EP3953796B1 (en) Hybrid rendering
CN111754381B (zh) 图形渲染方法、装置和计算机可读存储介质
JP5763276B2 (ja) クラウドソース動画レンダリングシステム
US10776997B2 (en) Rendering an image from computer graphics using two rendering computing devices
CN117616762A (zh) 利用3d图形增强视频或外部环境
US20100060652A1 (en) Graphics rendering system
KR20230153468A (ko) 3d 오브젝트의 스트리밍 방법, 장치, 및 프로그램
Doellner et al. Server-based rendering of large 3D scenes for mobile devices using G-buffer cube maps
JP7447266B2 (ja) ボリュメトリック画像データに関するビューの符号化及び復号
EP3948790B1 (en) Depth-compressed representation for 3d virtual scene
KR20080090671A (ko) 3d 객체 모델에 텍스쳐를 매핑하는 방법 및 장치
KR20250088496A (ko) 장면 디스크립션들에서의 가상 표현 인코딩
CN115375822A (zh) 云模型的渲染方法、装置、存储介质及电子装置
CN117173304B (zh) 三维内容多人协同方法、装置、系统及设备
CN108876925B (zh) 虚拟现实场景处理方法和装置
CN115802076A (zh) 一种三维模型分布式云端渲染方法、系统及电子设备
RU2810701C2 (ru) Гибридный рендеринг
CN117095105A (zh) 一种超大三维模型轻客户端浏览系统及方法
HK40059347A (en) Hybrid rendering
Park et al. StreamSplat: A Hybrid Client-Server Architecture for Neural Graphics using Depth-based Fusion on the Web
US12299805B1 (en) Immersive media content encoding and rendering
CN119991526B (zh) 面向城市级数字孪生的协同渲染方法、设备及存储介质
CN116208725A (zh) 视频处理方法、电子设备和存储介质
JP2022034640A (ja) 仮想環境を描画する方法及びシステム
Jakovljev Holoportation of human models

Legal Events

Date Code Title Description
W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-1-1-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20250902

U13 Renewal or maintenance fee not paid

Free format text: ST27 STATUS EVENT CODE: N-1-6-U10-U13-U300 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: DEEMED ABANDONED - FAILURE TO RESPOND TO MAINTENANCE FEE NOTICE

Effective date: 20251103

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: N-6-6-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20260102

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: N-6-6-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20260420

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: N-6-6-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20260703