RU2764187C2 - Обработка информации 3d-изображения на основании текстурных карт и сеток - Google Patents

Обработка информации 3d-изображения на основании текстурных карт и сеток Download PDF

Info

Publication number
RU2764187C2
RU2764187C2 RU2020102462A RU2020102462A RU2764187C2 RU 2764187 C2 RU2764187 C2 RU 2764187C2 RU 2020102462 A RU2020102462 A RU 2020102462A RU 2020102462 A RU2020102462 A RU 2020102462A RU 2764187 C2 RU2764187 C2 RU 2764187C2
Authority
RU
Russia
Prior art keywords
viewpoint
texture map
image
texture
mesh
Prior art date
Application number
RU2020102462A
Other languages
English (en)
Russian (ru)
Other versions
RU2020102462A (ru
RU2020102462A3 (https=
Inventor
Кристиан ВАРЕКАМП
Барт КРОН
Патрик Люк Элс ВАНДЕВАЛЛЕ
Original Assignee
Конинклейке Филипс Н.В.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Конинклейке Филипс Н.В. filed Critical Конинклейке Филипс Н.В.
Publication of RU2020102462A publication Critical patent/RU2020102462A/ru
Publication of RU2020102462A3 publication Critical patent/RU2020102462A3/ru
Application granted granted Critical
Publication of RU2764187C2 publication Critical patent/RU2764187C2/ru

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Generation (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
RU2020102462A 2017-06-23 2018-06-19 Обработка информации 3d-изображения на основании текстурных карт и сеток RU2764187C2 (ru)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP17177649.5 2017-06-23
EP17177649.5A EP3419286A1 (en) 2017-06-23 2017-06-23 Processing of 3d image information based on texture maps and meshes
PCT/EP2018/066159 WO2018234258A1 (en) 2017-06-23 2018-06-19 Processing of 3d image information based on texture maps and meshes

Publications (3)

Publication Number Publication Date
RU2020102462A RU2020102462A (ru) 2021-07-26
RU2020102462A3 RU2020102462A3 (https=) 2021-08-25
RU2764187C2 true RU2764187C2 (ru) 2022-01-14

Family

ID=59152789

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2020102462A RU2764187C2 (ru) 2017-06-23 2018-06-19 Обработка информации 3d-изображения на основании текстурных карт и сеток

Country Status (9)

Country Link
US (1) US11189079B2 (https=)
EP (2) EP3419286A1 (https=)
JP (1) JP7181233B2 (https=)
KR (1) KR102538939B1 (https=)
CN (1) CN110999285B (https=)
BR (1) BR112019027116A2 (https=)
RU (1) RU2764187C2 (https=)
TW (1) TWI800513B (https=)
WO (1) WO2018234258A1 (https=)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102379670B1 (ko) * 2017-09-01 2022-03-25 매직 립, 인코포레이티드 이전의 관점으로부터의 렌더링된 콘텐츠 및 비-렌더링된 콘텐츠를 사용하는 새로운 프레임의 생성
EP3509308A1 (en) 2018-01-05 2019-07-10 Koninklijke Philips N.V. Apparatus and method for generating an image data bitstream
EP3712843A1 (en) * 2019-03-19 2020-09-23 Koninklijke Philips N.V. Image signal representing a scene
GB2582315B (en) * 2019-03-19 2023-05-17 Sony Interactive Entertainment Inc Method and system for generating an image
US11217011B2 (en) 2019-04-19 2022-01-04 Facebook Technologies, Llc. Providing semantic-augmented artificial-reality experience
CN112153391B (zh) * 2019-06-28 2022-07-29 腾讯美国有限责任公司 视频编码的方法、装置、电子设备及存储介质
US11132827B2 (en) 2019-09-19 2021-09-28 Facebook Technologies, Llc Artificial reality system architecture for concurrent application execution and collaborative 3D scene rendering
CN116458153A (zh) * 2020-06-09 2023-07-18 苹果公司 双凸透镜图像生成
US12249092B2 (en) 2020-09-15 2025-03-11 Meta Platforms Technologies, Llc Visual inertial odometry localization using sparse sensors
US12020363B2 (en) * 2021-03-29 2024-06-25 Tetavi Ltd. Surface texturing from multiple cameras
US12008806B2 (en) 2021-08-19 2024-06-11 Meta Platforms Technologies, Llc Methods and systems to allow three-dimensional map sharing between heterogeneous computing systems, cross-localization, and sharing content in three-dimensional space
US12333730B2 (en) 2021-09-17 2025-06-17 Samsung Electronics Co., Ltd. Method and apparatus for scene segmentation for three-dimensional scene reconstruction
US12277642B2 (en) 2021-10-26 2025-04-15 Meta Platforms Technologies, Llc Localization failure handling on artificial reality systems
US12125250B2 (en) * 2021-11-22 2024-10-22 Tencent America LLC Decoding of patch temporal alignment for mesh compression
US12299918B2 (en) 2022-01-26 2025-05-13 Meta Platforms Technologies, Llc Methods and systems to facilitate passive relocalization using three-dimensional maps
CN114140569B (zh) * 2022-01-27 2022-04-26 山东捷瑞数字科技股份有限公司 一种三维场景序列化压缩方法
US20240095965A1 (en) * 2022-09-20 2024-03-21 Tencent America LLC Duplicate vertices merging in mesh compression
US12299835B1 (en) 2022-10-24 2025-05-13 Meta Platforms Technologies, Llc Shared scene co-location for artificial reality devices
EP4588238A1 (en) * 2022-11-15 2025-07-23 Google LLC Real-time view synthesis
WO2024107872A1 (en) * 2022-11-15 2024-05-23 Google Llc Real-time view synthesis
WO2024105530A1 (en) * 2022-11-15 2024-05-23 Fitix Visualization Ltd. System and method for creating 3d model data
WO2024129727A1 (en) * 2022-12-12 2024-06-20 Google Llc Real-time view synthesis
CN118570359A (zh) * 2023-02-28 2024-08-30 戴尔产品有限公司 用于虚拟现实建模的方法、电子设备和计算机程序产品
US12380650B2 (en) * 2023-11-05 2025-08-05 Htc Corporation Method for reducing computational loading while generating content and host
WO2025152015A1 (zh) * 2024-01-15 2025-07-24 Oppo广东移动通信有限公司 编解码方法、码流、编码器、解码器以及存储介质
CN117974817B (zh) * 2024-04-02 2024-06-21 江苏狄诺尼信息技术有限责任公司 基于图像编码的三维模型纹理数据高效压缩方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2237283C2 (ru) * 2001-11-27 2004-09-27 Самсунг Электроникс Ко., Лтд. Устройство и способ представления трехмерного объекта на основе изображений с глубиной
US20110255592A1 (en) * 2008-10-27 2011-10-20 Lg Electronics Inc. Virtual view image synthesis method and apparatus
RU2467395C1 (ru) * 2011-07-11 2012-11-20 Российская Федерация, От Имени Которой Выступает Министерство Промышленности И Торговли Российской Федерации Способ создания изображений трехмерных объектов для систем реального времени
US20160073117A1 (en) * 2014-09-09 2016-03-10 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6124864A (en) * 1997-04-07 2000-09-26 Synapix, Inc. Adaptive modeling and segmentation of visual image streams
DE60126387D1 (de) * 2000-10-27 2007-03-22 Canon Kk Bilderzeugungsverfahren und Bilderzeugungsgerät
KR100731979B1 (ko) 2005-10-18 2007-06-25 전자부품연구원 다시점 정방향 카메라 구조 기반의 메쉬를 이용한 중간영상 합성 방법 및 장치와 이를 구현하는 기능을실현시키기 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는기록 매체
TWI348120B (en) 2008-01-21 2011-09-01 Ind Tech Res Inst Method of synthesizing an image with multi-view images
CN101626509B (zh) * 2009-08-10 2011-02-02 北京工业大学 三维网格编码、解码方法及编码、解码装置
US9482528B2 (en) * 2009-09-18 2016-11-01 Logos Technologies Llc Systems and methods for persistent surveillance and large volume data streaming
US20130095920A1 (en) * 2011-10-13 2013-04-18 Microsoft Corporation Generating free viewpoint video using stereo imaging
CN102625126B (zh) * 2012-03-22 2014-10-15 北京工业大学 一种基于预测的三维网格编码方法
KR101429349B1 (ko) * 2012-09-18 2014-08-12 연세대학교 산학협력단 중간 시점 영상 합성 장치 및 방법과 이에 관한 기록매체
US20140092439A1 (en) * 2012-09-28 2014-04-03 Scott A. Krig Encoding images using a 3d mesh of polygons and corresponding textures
GB2499694B8 (en) * 2012-11-09 2017-06-07 Sony Computer Entertainment Europe Ltd System and method of image reconstruction
US10163247B2 (en) * 2015-07-14 2018-12-25 Microsoft Technology Licensing, Llc Context-adaptive allocation of render model resources
US9922432B1 (en) * 2016-09-02 2018-03-20 Artomatix Ltd. Systems and methods for providing convolutional neural network based image synthesis using stable and controllable parametric models, a multiscale synthesis framework and novel network architectures
JP6651679B2 (ja) 2016-12-06 2020-02-19 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 光強度画像を生成するための装置及び方法
US10026218B1 (en) * 2017-11-01 2018-07-17 Pencil and Pixel, Inc. Modeling indoor scenes based on digital images
EP3509308A1 (en) * 2018-01-05 2019-07-10 Koninklijke Philips N.V. Apparatus and method for generating an image data bitstream

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2237283C2 (ru) * 2001-11-27 2004-09-27 Самсунг Электроникс Ко., Лтд. Устройство и способ представления трехмерного объекта на основе изображений с глубиной
US20110255592A1 (en) * 2008-10-27 2011-10-20 Lg Electronics Inc. Virtual view image synthesis method and apparatus
RU2467395C1 (ru) * 2011-07-11 2012-11-20 Российская Федерация, От Имени Которой Выступает Министерство Промышленности И Торговли Российской Федерации Способ создания изображений трехмерных объектов для систем реального времени
US20160073117A1 (en) * 2014-09-09 2016-03-10 Qualcomm Incorporated Simultaneous localization and mapping for video coding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
A. Smolic et al. "3D video and free viewpoint video - technologies, applications and MPEG standards", опубл. 2006,[найдено 23.08.2021]; найдено в Интернет по адресу:[http://www.cecs.uci.edu/~papers/icme06/pdfs/0002161.pdf]. *

Also Published As

Publication number Publication date
EP3643059A1 (en) 2020-04-29
RU2020102462A (ru) 2021-07-26
US20210150802A1 (en) 2021-05-20
EP3643059B1 (en) 2022-03-30
CN110999285B (zh) 2023-02-28
KR102538939B1 (ko) 2023-06-01
JP7181233B2 (ja) 2022-11-30
TWI800513B (zh) 2023-05-01
TW201921921A (zh) 2019-06-01
RU2020102462A3 (https=) 2021-08-25
EP3419286A1 (en) 2018-12-26
US11189079B2 (en) 2021-11-30
CN110999285A (zh) 2020-04-10
WO2018234258A1 (en) 2018-12-27
KR20200020879A (ko) 2020-02-26
JP2020524851A (ja) 2020-08-20
BR112019027116A2 (pt) 2020-07-07

Similar Documents

Publication Publication Date Title
RU2764187C2 (ru) Обработка информации 3d-изображения на основании текстурных карт и сеток
US11363249B2 (en) Layered scene decomposition CODEC with transparency
KR102930021B1 (ko) 체적 비디오 인코딩 및 디코딩을 위한 방법, 장치 및 컴퓨터 프로그램
TWI764959B (zh) 用於產生光強度影像之裝置與方法
Bonatto et al. Real-time depth video-based rendering for 6-DoF HMD navigation and light field displays
US20180310025A1 (en) Method and technical equipment for encoding media content
TW201921318A (zh) 用於產生場景之舖磚式三維影像表示之設備及方法
WO2023217867A1 (en) Variable resolution variable frame rate video coding using neural networks
EP3540696B1 (en) A method and an apparatus for volumetric video rendering
CN113519165B (zh) 生成图像信号的装置和方法
US9672653B2 (en) Stereo viewpoint graphics processing subsystem and method of sharing geometry data between stereo images in screen-spaced processing
CN121753060A (zh) 用于运动估计和立体深度的网格拼接
EP4254958A1 (en) Compression of depth maps
TWI917319B (zh) 表示場景之影像信號
EP4588238A1 (en) Real-time view synthesis
WO2024107872A1 (en) Real-time view synthesis
GB2642453A (en) Processing a three-dimensional representation of a scene
WO2025215363A1 (en) Determining a point of a three-dimensional representation of a scene
WO2026047326A1 (en) Generating a three-dimensional representation of a scene
McNamee et al. Efficient Remote Rendering Using Equirectangular Projection.
Colleu A floating polygon soup representation for 3D video