JP7499182B2 - ボリュメトリックビデオフォーマット用の方法、装置及びストリーム - Google Patents

ボリュメトリックビデオフォーマット用の方法、装置及びストリーム Download PDF

Info

Publication number
JP7499182B2
JP7499182B2 JP2020552727A JP2020552727A JP7499182B2 JP 7499182 B2 JP7499182 B2 JP 7499182B2 JP 2020552727 A JP2020552727 A JP 2020552727A JP 2020552727 A JP2020552727 A JP 2020552727A JP 7499182 B2 JP7499182 B2 JP 7499182B2
Authority
JP
Japan
Prior art keywords
tile
tiles
scene
patches
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020552727A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021520101A5 (cg-RX-API-DMAC7.html
JP2021520101A (ja
Inventor
フリュールー,ジュリアン
シャポー,ベルトラン
タピ,ティエリー
チュードル,フランク
Original Assignee
インターデジタル ヴイシー ホールディングス, インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターデジタル ヴイシー ホールディングス, インコーポレイテッド filed Critical インターデジタル ヴイシー ホールディングス, インコーポレイテッド
Publication of JP2021520101A publication Critical patent/JP2021520101A/ja
Publication of JP2021520101A5 publication Critical patent/JP2021520101A5/ja
Application granted granted Critical
Publication of JP7499182B2 publication Critical patent/JP7499182B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Generation (AREA)
JP2020552727A 2018-03-30 2019-03-27 ボリュメトリックビデオフォーマット用の方法、装置及びストリーム Active JP7499182B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP18305372.7A EP3547704A1 (en) 2018-03-30 2018-03-30 Method, apparatus and stream for volumetric video format
EP18305372.7 2018-03-30
PCT/US2019/024245 WO2019191205A1 (en) 2018-03-30 2019-03-27 Method, apparatus and stream for volumetric video format

Publications (3)

Publication Number Publication Date
JP2021520101A JP2021520101A (ja) 2021-08-12
JP2021520101A5 JP2021520101A5 (cg-RX-API-DMAC7.html) 2022-03-31
JP7499182B2 true JP7499182B2 (ja) 2024-06-13

Family

ID=61965880

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020552727A Active JP7499182B2 (ja) 2018-03-30 2019-03-27 ボリュメトリックビデオフォーマット用の方法、装置及びストリーム

Country Status (5)

Country Link
US (2) US11178383B2 (cg-RX-API-DMAC7.html)
EP (2) EP3547704A1 (cg-RX-API-DMAC7.html)
JP (1) JP7499182B2 (cg-RX-API-DMAC7.html)
CN (1) CN112189345B (cg-RX-API-DMAC7.html)
WO (1) WO2019191205A1 (cg-RX-API-DMAC7.html)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112534477B (zh) * 2018-08-08 2025-03-21 松下电器(美国)知识产权公司 三维数据编码方法、三维数据解码方法、三维数据编码装置以及三维数据解码装置
WO2020036389A1 (en) * 2018-08-13 2020-02-20 Lg Electronics Inc. Method for transmitting video, apparatus for transmitting video, method for receiving video, and apparatus for receiving video
WO2020145668A1 (ko) * 2019-01-08 2020-07-16 삼성전자주식회사 3차원 컨텐츠의 처리 및 전송 방법
CN113748681B (zh) 2019-01-09 2024-04-26 腾讯美国有限责任公司 动态点云分区打包方法、装置和电子设备
US12155809B2 (en) * 2019-06-20 2024-11-26 At&T Intellectual Property I, L.P. Processing system for streaming volumetric video to a client device
US11432009B2 (en) * 2019-07-02 2022-08-30 Intel Corporation Techniques for encoding and decoding immersive video
JP7434577B2 (ja) * 2020-01-09 2024-02-20 エルジー エレクトロニクス インコーポレイティド ポイントクラウドデータ送信装置、ポイントクラウドデータ送信方法、ポイントクラウドデータ受信装置及びポイントクラウドデータ受信方法
US12015805B2 (en) * 2020-01-29 2024-06-18 Nokia Technologies Oy Method, an apparatus and a computer program product for video streaming
WO2021187737A1 (ko) * 2020-03-18 2021-09-23 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
EP4131961A4 (en) * 2020-04-13 2023-09-13 LG Electronics, Inc. DEVICE FOR TRANSMITTING POINT CLOUD DATA, METHOD FOR TRANSMITTING POINT CLOUD DATA, DEVICE FOR RECEIVING POINT CLOUD DATA AND METHOD FOR RECEIVING POINT CLOUD DATA
WO2021211665A1 (en) 2020-04-14 2021-10-21 Interdigital Patent Holdings, Inc. Partial access support in isobmff containers for video-based point cloud streams
FR3112662B1 (fr) * 2020-07-17 2024-12-13 Fond B Com Procédé et dispositif électronique de décodage d’un flux de données, et flux de données associé
AU2021330784A1 (en) * 2020-08-26 2023-04-06 Charles Leon CLAPSHAW Volumetric immersion system and method
CN112258568B (zh) * 2020-10-12 2022-07-01 武汉中海庭数据技术有限公司 一种高精度地图要素的提取方法及装置
US12579729B2 (en) * 2021-04-07 2026-03-17 Interdigital Ce Patent Holdings, Sas Volumetric video supporting light effects

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008509630A (ja) 2004-08-13 2008-03-27 インダストリー・アカデミック・コーオペレーション・ファウンデーション・キョンヒ・ユニヴァーシティ パノラマ画像の動き推定及び補償のために仮想画像領域を生成する方法及び装置
US20180035134A1 (en) 2015-04-15 2018-02-01 Lytro, Inc. Encoding and decoding virtual reality video
US20190087978A1 (en) 2017-09-18 2019-03-21 Apple Inc. Point cloud compression using non-cubic projections and masks
JP2022502961A (ja) 2018-10-02 2022-01-11 華為技術有限公司Huawei Technologies Co., Ltd. 3d補助データを用いた動き推定

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2168096A1 (en) 2007-07-12 2010-03-31 Thomson Licensing System and method for three-dimensional object reconstruction from two-dimensional images
WO2010096189A1 (en) * 2009-02-19 2010-08-26 Thomson Licensing 3d video formats
RU2453922C2 (ru) 2010-02-12 2012-06-20 Георгий Русланович Вяхирев Способ представления исходной трехмерной сцены по результатам съемки изображений в двумерной проекции (варианты)
CN108419076B (zh) * 2012-09-29 2022-04-29 华为技术有限公司 视频编码及解码方法、装置及系统
US9674507B2 (en) 2013-04-30 2017-06-06 Qualcomm Incorporated Monocular visual SLAM with general and panorama camera movements
CN105165008B (zh) * 2013-05-10 2017-11-21 皇家飞利浦有限公司 对与多视图再现设备一起使用的视频数据信号进行编码的方法
US8860720B1 (en) * 2014-01-02 2014-10-14 Ubitus Inc. System and method for delivering graphics over network
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
RU2606875C2 (ru) 2015-01-16 2017-01-10 Общество с ограниченной ответственностью "Системы Компьютерного зрения" Способ и система отображения масштабных сцен в режиме реального времени
US20170347084A1 (en) * 2016-05-27 2017-11-30 Intel Corporation Virtual reality panoramic video system using scalable video coding layers
IL264690B (en) 2016-08-11 2022-06-01 Magic Leap Inc Automatic positioning of a virtual object in 3D space
JP2019534500A (ja) * 2016-09-13 2019-11-28 インターデジタル ヴイシー ホールディングス, インコーポレイテッド 没入型ビデオフォーマットのための方法、機器、及びシステム
JP2019054417A (ja) * 2017-09-15 2019-04-04 ソニー株式会社 画像処理装置およびファイル生成装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008509630A (ja) 2004-08-13 2008-03-27 インダストリー・アカデミック・コーオペレーション・ファウンデーション・キョンヒ・ユニヴァーシティ パノラマ画像の動き推定及び補償のために仮想画像領域を生成する方法及び装置
US20180035134A1 (en) 2015-04-15 2018-02-01 Lytro, Inc. Encoding and decoding virtual reality video
US20190087978A1 (en) 2017-09-18 2019-03-21 Apple Inc. Point cloud compression using non-cubic projections and masks
JP2022502961A (ja) 2018-10-02 2022-01-11 華為技術有限公司Huawei Technologies Co., Ltd. 3d補助データを用いた動き推定

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
MAO, Yu et al.,On Constructing z-Dimensional DIBR-Synthesized Images,IEEE Transactions on Multimedia,IEEE,2016年05月26日,Vol.18, No.8,pp.1453-1468,[online],[retrieved on 2023-04-28],Retrieved from the Internet: <URL: https://ieeexplore.ieee.org/document/7479491>
TECH, Gerhard et al.,AHG13: Restriction of Inter-Layer Prediction on Tile Boundaries,JCT3V-D0051 (version 2),ITU,2013年04月22日,pp.1-3,[online],[retrieved on 2023-04-28],Retrieved from the Internet: <URL: http://phenix.it-sudparis.eu/jct2/doc_end_user/documents/4_Incheon/wg11/JCT3V-D0051-v2.zip>,JCT3V-D0051-v2.doc
WANG, Ye-Kui et al.,WD of ISO/IEC 14496-15:2013/AMD 1 Enhanced Carriage of HEVC and Support of MVC with Depth Information,ISO/IEC,2014年01月,Sect.8.5.6.1,[online],[retrieved on 2023-04-28],Retrieved from the Internet: <URL: https://mpeg.chiariglione.org/tags/enhanced-carriage-hevc>,"w14123 - 14496-15_2013_AMD1_WD2.doc"

Also Published As

Publication number Publication date
EP3777222A1 (en) 2021-02-17
US11178383B2 (en) 2021-11-16
US11647177B2 (en) 2023-05-09
US20220094903A1 (en) 2022-03-24
US20210112236A1 (en) 2021-04-15
CN112189345A (zh) 2021-01-05
WO2019191205A1 (en) 2019-10-03
EP3777222B1 (en) 2026-05-06
CN112189345B (zh) 2023-02-21
RU2020135597A (ru) 2022-05-04
JP2021520101A (ja) 2021-08-12
EP3547704A1 (en) 2019-10-02

Similar Documents

Publication Publication Date Title
US11647177B2 (en) Method, apparatus and stream for volumetric video format
KR102600011B1 (ko) 3 자유도 및 볼류메트릭 호환 가능한 비디오 스트림을 인코딩 및 디코딩하기 위한 방법들 및 디바이스들
KR102468178B1 (ko) 몰입형 비디오 포맷을 위한 방법, 장치 및 스트림
KR20200065076A (ko) 볼류메트릭 비디오 포맷을 위한 방법, 장치 및 스트림
EP3562159A1 (en) Method, apparatus and stream for volumetric video format
JP2021502033A (ja) ボリュメトリックビデオを符号化/復号する方法、装置、およびストリーム
CN111164969B (zh) 使用拼接和重新投影相关元数据发送或接收6dof视频的方法和装置
KR20200083616A (ko) 볼류메트릭 비디오를 인코딩/디코딩하기 위한 방법, 장치 및 스트림
JP7614168B2 (ja) ボリュメトリックビデオコンテンツを配信するための方法および装置
CN117121059A (zh) 支持光效果的体积视频
EP3547703A1 (en) Method, apparatus and stream for volumetric video format
KR102839883B1 (ko) 볼류메트릭 비디오 콘텐츠를 전달하기 위한 방법 및 장치들
KR102607709B1 (ko) 3 자유도 및 볼류메트릭 호환 가능한 비디오 스트림을 인코딩 및 디코딩하기 위한 방법들 및 디바이스들
WO2020185529A1 (en) A method and apparatus for encoding and decoding volumetric video
RU2807582C2 (ru) Способ, устройство и поток для формата объемного видео
JP7824219B2 (ja) 3dof構成要素からの6dofコンテンツを符号化、復号化、及びレンダリングするための方法及び装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220323

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220323

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230421

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230508

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20230721

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231107

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240129

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240423

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240507

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240603

R150 Certificate of patent or registration of utility model

Ref document number: 7499182

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150