JP7499182B2 - ボリュメトリックビデオフォーマット用の方法、装置及びストリーム - Google Patents

ボリュメトリックビデオフォーマット用の方法、装置及びストリーム Download PDF

Info

Publication number
JP7499182B2
JP7499182B2 JP2020552727A JP2020552727A JP7499182B2 JP 7499182 B2 JP7499182 B2 JP 7499182B2 JP 2020552727 A JP2020552727 A JP 2020552727A JP 2020552727 A JP2020552727 A JP 2020552727A JP 7499182 B2 JP7499182 B2 JP 7499182B2
Authority
JP
Japan
Prior art keywords
tile
tiles
scene
patches
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020552727A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021520101A5 (enExample
JP2021520101A (ja
Inventor
フリュールー，ジュリアン
シャポー，ベルトラン
タピ，ティエリー
チュードル，フランク
Original Assignee
インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターデジタル ヴイシー ホールディングス， インコーポレイテッド filed Critical インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Publication of JP2021520101A publication Critical patent/JP2021520101A/ja
Publication of JP2021520101A5 publication Critical patent/JP2021520101A5/ja
Application granted granted Critical
Publication of JP7499182B2 publication Critical patent/JP7499182B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Generation (AREA)
JP2020552727A 2018-03-30 2019-03-27 ボリュメトリックビデオフォーマット用の方法、装置及びストリーム Active JP7499182B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP18305372.7A EP3547704A1 (en) 2018-03-30 2018-03-30 Method, apparatus and stream for volumetric video format
EP18305372.7 2018-03-30
PCT/US2019/024245 WO2019191205A1 (en) 2018-03-30 2019-03-27 Method, apparatus and stream for volumetric video format

Publications (3)

Publication Number Publication Date
JP2021520101A JP2021520101A (ja) 2021-08-12
JP2021520101A5 JP2021520101A5 (enExample) 2022-03-31
JP7499182B2 true JP7499182B2 (ja) 2024-06-13

Family

ID=61965880

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020552727A Active JP7499182B2 (ja) 2018-03-30 2019-03-27 ボリュメトリックビデオフォーマット用の方法、装置及びストリーム

Country Status (5)

Country Link
US (2) US11178383B2 (enExample)
EP (2) EP3547704A1 (enExample)
JP (1) JP7499182B2 (enExample)
CN (1) CN112189345B (enExample)
WO (1) WO2019191205A1 (enExample)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120182398A (zh) * 2018-08-08 2025-06-20 松下电器（美国）知识产权公司 三维数据生成方法、编码三维数据处理方法、三维数据生成装置、以及编码三维数据处理装置
US11558597B2 (en) * 2018-08-13 2023-01-17 Lg Electronics Inc. Method for transmitting video, apparatus for transmitting video, method for receiving video, and apparatus for receiving video
WO2020145668A1 (ko) * 2019-01-08 2020-07-16 삼성전자주식회사 3차원 컨텐츠의 처리 및 전송 방법
CN113748681B (zh) 2019-01-09 2024-04-26 腾讯美国有限责任公司 动态点云分区打包方法、装置和电子设备
US12155809B2 (en) * 2019-06-20 2024-11-26 At&T Intellectual Property I, L.P. Processing system for streaming volumetric video to a client device
US11432009B2 (en) * 2019-07-02 2022-08-30 Intel Corporation Techniques for encoding and decoding immersive video
CN114930863B (zh) * 2020-01-09 2023-08-08 Lg电子株式会社 点云数据发送装置、点云数据发送方法、点云数据接收装置和点云数据接收方法
EP4097981A1 (en) * 2020-01-29 2022-12-07 Nokia Technologies Oy A method, an apparatus and a computer program product for video streaming
KR102406846B1 (ko) * 2020-03-18 2022-06-10 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
EP4131961A4 (en) * 2020-04-13 2023-09-13 LG Electronics, Inc. DEVICE FOR TRANSMITTING POINT CLOUD DATA, METHOD FOR TRANSMITTING POINT CLOUD DATA, DEVICE FOR RECEIVING POINT CLOUD DATA AND METHOD FOR RECEIVING POINT CLOUD DATA
IL297255B1 (en) * 2020-04-14 2026-01-01 Interdigital Patent Holdings Inc Partial access support in isobmff containers for video-based point cloud streams
FR3112662B1 (fr) * 2020-07-17 2024-12-13 Fond B Com Procédé et dispositif électronique de décodage d’un flux de données, et flux de données associé
AU2021330784A1 (en) * 2020-08-26 2023-04-06 Charles Leon CLAPSHAW Volumetric immersion system and method
CN112258568B (zh) * 2020-10-12 2022-07-01 武汉中海庭数据技术有限公司 一种高精度地图要素的提取方法及装置
JP7809720B2 (ja) * 2021-04-07 2026-02-02 インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ 光効果をサポートする容積ビデオ

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008509630A (ja) 2004-08-13 2008-03-27 インダストリー・アカデミック・コーオペレーション・ファウンデーション・キョンヒ・ユニヴァーシティ パノラマ画像の動き推定及び補償のために仮想画像領域を生成する方法及び装置
US20180035134A1 (en) 2015-04-15 2018-02-01 Lytro, Inc. Encoding and decoding virtual reality video
US20190087978A1 (en) 2017-09-18 2019-03-21 Apple Inc. Point cloud compression using non-cubic projections and masks
JP2022502961A (ja) 2018-10-02 2022-01-11 華為技術有限公司Huawei Technologies Co., Ltd. ３ｄ補助データを用いた動き推定

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100182406A1 (en) 2007-07-12 2010-07-22 Benitez Ana B System and method for three-dimensional object reconstruction from two-dimensional images
BRPI1013339B1 (pt) 2009-02-19 2021-09-21 Interdigital Madison Patent Holdings Método e aparelho para codificar vídeo, método e aparelho para decodificar vídeo, sinal de vídeo formatado para incluir informações e mídia legível por processador
RU2453922C2 (ru) 2010-02-12 2012-06-20 Георгий Русланович Вяхирев Способ представления исходной трехмерной сцены по результатам съемки изображений в двумерной проекции (варианты)
JP6074509B2 (ja) * 2012-09-29 2017-02-01 華為技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． 映像符号化及び復号化方法、装置及びシステム
US9674507B2 (en) 2013-04-30 2017-06-06 Qualcomm Incorporated Monocular visual SLAM with general and panorama camera movements
BR112015026131A2 (pt) * 2013-05-10 2017-07-25 Koninklijke Philips Nv método de codificação de um sinal de dados de vídeo para uso em um dispositivo de renderização de múltiplas vistas, sinal de dados de vídeo para uso em um dispositivo de renderização de múltiplas vistas, portadora de dados, método de decodificação de um sinal de dados de vídeo, decodificador para decodificar um sinal de dados de vídeo, produto de programa de computador, e, codificador de um sinal de dados de vídeo para uso em um dispositivo de renderização de múltiplas vistas
US8860720B1 (en) * 2014-01-02 2014-10-14 Ubitus Inc. System and method for delivering graphics over network
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
RU2606875C2 (ru) 2015-01-16 2017-01-10 Общество с ограниченной ответственностью "Системы Компьютерного зрения" Способ и система отображения масштабных сцен в режиме реального времени
US20170347084A1 (en) * 2016-05-27 2017-11-30 Intel Corporation Virtual reality panoramic video system using scalable video coding layers
IL303843B2 (en) 2016-08-11 2024-06-01 Magic Leap Inc Automatic placement of a virtual object in a three-dimensional space
KR20190046850A (ko) * 2016-09-13 2019-05-07 인터디지털 브이씨 홀딩스 인코포레이티드 몰입형 비디오 포맷을 위한 방법, 장치 및 스트림
JP2019054417A (ja) * 2017-09-15 2019-04-04 ソニー株式会社 画像処理装置およびファイル生成装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008509630A (ja) 2004-08-13 2008-03-27 インダストリー・アカデミック・コーオペレーション・ファウンデーション・キョンヒ・ユニヴァーシティ パノラマ画像の動き推定及び補償のために仮想画像領域を生成する方法及び装置
US20180035134A1 (en) 2015-04-15 2018-02-01 Lytro, Inc. Encoding and decoding virtual reality video
US20190087978A1 (en) 2017-09-18 2019-03-21 Apple Inc. Point cloud compression using non-cubic projections and masks
JP2022502961A (ja) 2018-10-02 2022-01-11 華為技術有限公司Huawei Technologies Co., Ltd. ３ｄ補助データを用いた動き推定

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
MAO, Yu et al.，On Constructing z-Dimensional DIBR-Synthesized Images，IEEE Transactions on Multimedia，IEEE，2016年05月26日，Vol.18, No.8，pp.1453-1468，[online]，[retrieved on 2023-04-28]，Retrieved from the Internet: <URL: https://ieeexplore.ieee.org/document/7479491>
TECH, Gerhard et al.，AHG13: Restriction of Inter-Layer Prediction on Tile Boundaries，JCT3V-D0051 (version 2)，ITU，2013年04月22日，pp.1-3，[online]，[retrieved on 2023-04-28]，Retrieved from the Internet: <URL: http://phenix.it-sudparis.eu/jct2/doc_end_user/documents/4_Incheon/wg11/JCT3V-D0051-v2.zip>，JCT3V-D0051-v2.doc
WANG, Ye-Kui et al.，WD of ISO/IEC 14496-15:2013/AMD 1 Enhanced Carriage of HEVC and Support of MVC with Depth Information，ISO/IEC，2014年01月，Sect.8.5.6.1，[online]，[retrieved on 2023-04-28]，Retrieved from the Internet: <URL: https://mpeg.chiariglione.org/tags/enhanced-carriage-hevc>，"w14123 - 14496-15_2013_AMD1_WD2.doc"

Also Published As

Publication number Publication date
EP3777222B1 (en) 2026-05-06
RU2020135597A (ru) 2022-05-04
US20210112236A1 (en) 2021-04-15
WO2019191205A1 (en) 2019-10-03
JP2021520101A (ja) 2021-08-12
US20220094903A1 (en) 2022-03-24
CN112189345A (zh) 2021-01-05
US11178383B2 (en) 2021-11-16
EP3777222A1 (en) 2021-02-17
CN112189345B (zh) 2023-02-21
EP3547704A1 (en) 2019-10-02
US11647177B2 (en) 2023-05-09

Similar Documents

Publication Publication Date Title
JP7499182B2 (ja) ボリュメトリックビデオフォーマット用の方法、装置及びストリーム
KR102600011B1 (ko) 3 자유도 및 볼류메트릭 호환 가능한 비디오 스트림을 인코딩 및 디코딩하기 위한 방법들 및 디바이스들
KR102468178B1 (ko) 몰입형 비디오 포맷을 위한 방법, 장치 및 스트림
KR20200065076A (ko) 볼류메트릭 비디오 포맷을 위한 방법, 장치 및 스트림
EP3562159A1 (en) Method, apparatus and stream for volumetric video format
JP2021502033A (ja) ボリュメトリックビデオを符号化／復号する方法、装置、およびストリーム
KR20200083616A (ko) 볼류메트릭 비디오를 인코딩/디코딩하기 위한 방법, 장치 및 스트림
EP3547703A1 (en) Method, apparatus and stream for volumetric video format
KR102839883B1 (ko) 볼류메트릭 비디오 콘텐츠를 전달하기 위한 방법 및 장치들
JP7614168B2 (ja) ボリュメトリックビデオコンテンツを配信するための方法および装置
CN117121059A (zh) 支持光效果的体积视频
KR102607709B1 (ko) 3 자유도 및 볼류메트릭 호환 가능한 비디오 스트림을 인코딩 및 디코딩하기 위한 방법들 및 디바이스들
WO2020185529A1 (en) A method and apparatus for encoding and decoding volumetric video
RU2807582C2 (ru) Способ, устройство и поток для формата объемного видео
JP7824219B2 (ja) ３ｄｏｆ構成要素からの６ｄｏｆコンテンツを符号化、復号化、及びレンダリングするための方法及び装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220323

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220323

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230421

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230508

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20230721

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231107

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240129

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240423

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240507

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240603

R150 Certificate of patent or registration of utility model

Ref document number: 7499182

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150