JP7499182B2 - ボリュメトリックビデオフォーマット用の方法、装置及びストリーム - Google Patents

ボリュメトリックビデオフォーマット用の方法、装置及びストリーム Download PDF

Info

Publication number
JP7499182B2
JP7499182B2 JP2020552727A JP2020552727A JP7499182B2 JP 7499182 B2 JP7499182 B2 JP 7499182B2 JP 2020552727 A JP2020552727 A JP 2020552727A JP 2020552727 A JP2020552727 A JP 2020552727A JP 7499182 B2 JP7499182 B2 JP 7499182B2
Authority
JP
Japan
Prior art keywords
tile
tiles
scene
patches
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020552727A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021520101A (ja
JP2021520101A5 (https=
JPWO2019191205A5 (https=
Inventor
フリュールー，ジュリアン
シャポー，ベルトラン
タピ，ティエリー
チュードル，フランク
Original Assignee
インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターデジタル ヴイシー ホールディングス， インコーポレイテッド filed Critical インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Publication of JP2021520101A publication Critical patent/JP2021520101A/ja
Publication of JP2021520101A5 publication Critical patent/JP2021520101A5/ja
Publication of JPWO2019191205A5 publication Critical patent/JPWO2019191205A5/ja
Application granted granted Critical
Publication of JP7499182B2 publication Critical patent/JP7499182B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Generation (AREA)
JP2020552727A 2018-03-30 2019-03-27 ボリュメトリックビデオフォーマット用の方法、装置及びストリーム Active JP7499182B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP18305372.7A EP3547704A1 (en) 2018-03-30 2018-03-30 Method, apparatus and stream for volumetric video format
EP18305372.7 2018-03-30
PCT/US2019/024245 WO2019191205A1 (en) 2018-03-30 2019-03-27 Method, apparatus and stream for volumetric video format

Publications (4)

Publication Number Publication Date
JP2021520101A JP2021520101A (ja) 2021-08-12
JP2021520101A5 JP2021520101A5 (https=) 2022-03-31
JPWO2019191205A5 JPWO2019191205A5 (https=) 2022-03-31
JP7499182B2 true JP7499182B2 (ja) 2024-06-13

Family

ID=61965880

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020552727A Active JP7499182B2 (ja) 2018-03-30 2019-03-27 ボリュメトリックビデオフォーマット用の方法、装置及びストリーム

Country Status (5)

Country Link
US (2) US11178383B2 (https=)
EP (2) EP3547704A1 (https=)
JP (1) JP7499182B2 (https=)
CN (1) CN112189345B (https=)
WO (1) WO2019191205A1 (https=)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BR112020026735A2 (pt) * 2018-08-08 2021-03-30 Panasonic Intellectual Property Corporation Of America Método de codificação de dados tridimensionais, método de decodificação de dados tridimensionais, dispositivo de codificação de dados tridimensionais, e dispositivo de decodificação de dados tridimensionais
US11558597B2 (en) * 2018-08-13 2023-01-17 Lg Electronics Inc. Method for transmitting video, apparatus for transmitting video, method for receiving video, and apparatus for receiving video
CN111869201B (zh) * 2019-01-08 2023-01-31 三星电子株式会社 处理和发送三维内容的方法
US11109071B2 (en) 2019-01-09 2021-08-31 Tencent America LLC Method and apparatus for dynamic point cloud partition packing
US12155809B2 (en) * 2019-06-20 2024-11-26 At&T Intellectual Property I, L.P. Processing system for streaming volumetric video to a client device
US11432009B2 (en) * 2019-07-02 2022-08-30 Intel Corporation Techniques for encoding and decoding immersive video
CN114930863B (zh) * 2020-01-09 2023-08-08 Lg电子株式会社 点云数据发送装置、点云数据发送方法、点云数据接收装置和点云数据接收方法
WO2021151761A1 (en) * 2020-01-29 2021-08-05 Nokia Technologies Oy A method, an apparatus and a computer program product for video streaming
KR102406846B1 (ko) * 2020-03-18 2022-06-10 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
WO2021210837A1 (ko) * 2020-04-13 2021-10-21 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
KR20230002615A (ko) 2020-04-14 2023-01-05 인터디지탈 패튼 홀딩스, 인크 비디오 기반 포인트 클라우드 스트림들을 위한 isobmff 컨테이너들에서의 부분 액세스 지원
FR3112662B1 (fr) * 2020-07-17 2024-12-13 Fond B Com Procédé et dispositif électronique de décodage d’un flux de données, et flux de données associé
AU2021330784A1 (en) * 2020-08-26 2023-04-06 Charles Leon CLAPSHAW Volumetric immersion system and method
CN112258568B (zh) * 2020-10-12 2022-07-01 武汉中海庭数据技术有限公司 一种高精度地图要素的提取方法及装置
MX2023011296A (es) * 2021-04-07 2023-12-14 Interdigital Ce Patent Holdings Sas Video volumétrico que soporta efectos de luz.

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008509630A (ja) 2004-08-13 2008-03-27 インダストリー・アカデミック・コーオペレーション・ファウンデーション・キョンヒ・ユニヴァーシティ パノラマ画像の動き推定及び補償のために仮想画像領域を生成する方法及び装置
US20180035134A1 (en) 2015-04-15 2018-02-01 Lytro, Inc. Encoding and decoding virtual reality video
US20190087978A1 (en) 2017-09-18 2019-03-21 Apple Inc. Point cloud compression using non-cubic projections and masks
JP2022502961A (ja) 2018-10-02 2022-01-11 華為技術有限公司Huawei Technologies Co., Ltd. ３ｄ補助データを用いた動き推定

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2168096A1 (en) 2007-07-12 2010-03-31 Thomson Licensing System and method for three-dimensional object reconstruction from two-dimensional images
WO2010096189A1 (en) 2009-02-19 2010-08-26 Thomson Licensing 3d video formats
RU2453922C2 (ru) 2010-02-12 2012-06-20 Георгий Русланович Вяхирев Способ представления исходной трехмерной сцены по результатам съемки изображений в двумерной проекции (варианты)
EP2887663B1 (en) 2012-09-29 2017-02-22 Huawei Technologies Co., Ltd. Method, apparatus and system for encoding and decoding video
US9674507B2 (en) 2013-04-30 2017-06-06 Qualcomm Incorporated Monocular visual SLAM with general and panorama camera movements
RU2667605C2 (ru) * 2013-05-10 2018-09-21 Конинклейке Филипс Н.В. Способ кодирования сигнала видеоданных для использования с многовидовым устройством визуализации
US8860720B1 (en) * 2014-01-02 2014-10-14 Ubitus Inc. System and method for delivering graphics over network
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
RU2606875C2 (ru) 2015-01-16 2017-01-10 Общество с ограниченной ответственностью "Системы Компьютерного зрения" Способ и система отображения масштабных сцен в режиме реального времени
US20170347084A1 (en) * 2016-05-27 2017-11-30 Intel Corporation Virtual reality panoramic video system using scalable video coding layers
EP4398566A3 (en) 2016-08-11 2024-10-09 Magic Leap, Inc. Automatic placement of a virtual object in a three-dimensional space
CN109716757A (zh) * 2016-09-13 2019-05-03 交互数字Vc控股公司 用于沉浸式视频格式的方法、装置和流
JP2019054417A (ja) * 2017-09-15 2019-04-04 ソニー株式会社 画像処理装置およびファイル生成装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008509630A (ja) 2004-08-13 2008-03-27 インダストリー・アカデミック・コーオペレーション・ファウンデーション・キョンヒ・ユニヴァーシティ パノラマ画像の動き推定及び補償のために仮想画像領域を生成する方法及び装置
US20180035134A1 (en) 2015-04-15 2018-02-01 Lytro, Inc. Encoding and decoding virtual reality video
US20190087978A1 (en) 2017-09-18 2019-03-21 Apple Inc. Point cloud compression using non-cubic projections and masks
JP2022502961A (ja) 2018-10-02 2022-01-11 華為技術有限公司Huawei Technologies Co., Ltd. ３ｄ補助データを用いた動き推定

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
MAO, Yu et al.，On Constructing z-Dimensional DIBR-Synthesized Images，IEEE Transactions on Multimedia，IEEE，2016年05月26日，Vol.18, No.8，pp.1453-1468，[online]，[retrieved on 2023-04-28]，Retrieved from the Internet: <URL: https://ieeexplore.ieee.org/document/7479491>
TECH, Gerhard et al.，AHG13: Restriction of Inter-Layer Prediction on Tile Boundaries，JCT3V-D0051 (version 2)，ITU，2013年04月22日，pp.1-3，[online]，[retrieved on 2023-04-28]，Retrieved from the Internet: <URL: http://phenix.it-sudparis.eu/jct2/doc_end_user/documents/4_Incheon/wg11/JCT3V-D0051-v2.zip>，JCT3V-D0051-v2.doc
WANG, Ye-Kui et al.，WD of ISO/IEC 14496-15:2013/AMD 1 Enhanced Carriage of HEVC and Support of MVC with Depth Information，ISO/IEC，2014年01月，Sect.8.5.6.1，[online]，[retrieved on 2023-04-28]，Retrieved from the Internet: <URL: https://mpeg.chiariglione.org/tags/enhanced-carriage-hevc>，"w14123 - 14496-15_2013_AMD1_WD2.doc"

Also Published As

Publication number Publication date
JP2021520101A (ja) 2021-08-12
EP3547704A1 (en) 2019-10-02
US20210112236A1 (en) 2021-04-15
WO2019191205A1 (en) 2019-10-03
US20220094903A1 (en) 2022-03-24
CN112189345A (zh) 2021-01-05
US11178383B2 (en) 2021-11-16
EP3777222A1 (en) 2021-02-17
RU2020135597A (ru) 2022-05-04
US11647177B2 (en) 2023-05-09
CN112189345B (zh) 2023-02-21

Similar Documents

Publication Publication Date Title
JP7499182B2 (ja) ボリュメトリックビデオフォーマット用の方法、装置及びストリーム
KR102600011B1 (ko) 3 자유도 및 볼류메트릭 호환 가능한 비디오 스트림을 인코딩 및 디코딩하기 위한 방법들 및 디바이스들
KR102468178B1 (ko) 몰입형 비디오 포맷을 위한 방법, 장치 및 스트림
KR20200065076A (ko) 볼류메트릭 비디오 포맷을 위한 방법, 장치 및 스트림
EP3562159A1 (en) Method, apparatus and stream for volumetric video format
JP2021502033A (ja) ボリュメトリックビデオを符号化／復号する方法、装置、およびストリーム
KR20200083616A (ko) 볼류메트릭 비디오를 인코딩/디코딩하기 위한 방법, 장치 및 스트림
EP3547703A1 (en) Method, apparatus and stream for volumetric video format
KR102839883B1 (ko) 볼류메트릭 비디오 콘텐츠를 전달하기 위한 방법 및 장치들
JP7614168B2 (ja) ボリュメトリックビデオコンテンツを配信するための方法および装置
CN117121059A (zh) 支持光效果的体积视频
KR102607709B1 (ko) 3 자유도 및 볼류메트릭 호환 가능한 비디오 스트림을 인코딩 및 디코딩하기 위한 방법들 및 디바이스들
WO2020185529A1 (en) A method and apparatus for encoding and decoding volumetric video
RU2807582C2 (ru) Способ, устройство и поток для формата объемного видео
JP7824219B2 (ja) ３ｄｏｆ構成要素からの６ｄｏｆコンテンツを符号化、復号化、及びレンダリングするための方法及び装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220323

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220323

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230421

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230508

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20230721

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231107

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240129

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240423

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240507

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240603

R150 Certificate of patent or registration of utility model

Ref document number: 7499182

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150