EP3821602A4 - A method, an apparatus and a computer program product for volumetric video coding - Google Patents

A method, an apparatus and a computer program product for volumetric video coding Download PDF

Info

Publication number
EP3821602A4
EP3821602A4 EP19834742.9A EP19834742A EP3821602A4 EP 3821602 A4 EP3821602 A4 EP 3821602A4 EP 19834742 A EP19834742 A EP 19834742A EP 3821602 A4 EP3821602 A4 EP 3821602A4
Authority
EP
European Patent Office
Prior art keywords
computer program
program product
video coding
volumetric video
volumetric
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19834742.9A
Other languages
German (de)
French (fr)
Other versions
EP3821602A1 (en
Inventor
Sebastian Schwarz
Mika Pesonen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Publication of EP3821602A1 publication Critical patent/EP3821602A1/en
Publication of EP3821602A4 publication Critical patent/EP3821602A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/001—Model-based coding, e.g. wire frame
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
EP19834742.9A 2018-07-10 2019-07-09 A method, an apparatus and a computer program product for volumetric video coding Pending EP3821602A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862696026P 2018-07-10 2018-07-10
PCT/FI2019/050537 WO2020012071A1 (en) 2018-07-10 2019-07-09 A method, an apparatus and a computer program product for volumetric video coding

Publications (2)

Publication Number Publication Date
EP3821602A1 EP3821602A1 (en) 2021-05-19
EP3821602A4 true EP3821602A4 (en) 2022-05-04

Family

ID=69143222

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19834742.9A Pending EP3821602A4 (en) 2018-07-10 2019-07-09 A method, an apparatus and a computer program product for volumetric video coding

Country Status (2)

Country Link
EP (1) EP3821602A4 (en)
WO (1) WO2020012071A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3942821A4 (en) 2019-03-19 2023-01-18 Nokia Technologies Oy An apparatus, a method and a computer program for volumetric video
US20220191544A1 (en) * 2020-12-14 2022-06-16 Nokia Technologies Oy Radiative Transfer Signalling For Immersive Video

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018093851A1 (en) * 2016-11-17 2018-05-24 Intel Corporation Suggested viewport indication for panoramic video
US20180158249A1 (en) * 2016-03-02 2018-06-07 Meta Company System and method for simulating user interaction with virtual objects in an interactive space
WO2018109265A1 (en) * 2016-12-15 2018-06-21 Nokia Technologies Oy A method and technical equipment for encoding media content

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8964008B2 (en) * 2011-06-17 2015-02-24 Microsoft Technology Licensing, Llc Volumetric video presentation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180158249A1 (en) * 2016-03-02 2018-06-07 Meta Company System and method for simulating user interaction with virtual objects in an interactive space
WO2018093851A1 (en) * 2016-11-17 2018-05-24 Intel Corporation Suggested viewport indication for panoramic video
WO2018109265A1 (en) * 2016-12-15 2018-06-21 Nokia Technologies Oy A method and technical equipment for encoding media content

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"First idea on Systems technologies for Point Cloud Coding", no. n17675, 30 April 2018 (2018-04-30), XP030024302, Retrieved from the Internet <URL:http://phenix.int-evry.fr/mpeg/doc_end_user/documents/122_San%20Diego/wg11/w17675.zip w17675.doc> [retrieved on 20180430] *
KHALED MAMMOU ET AL: "Point Cloud Compression: Test Model Category 2 version 0.0", no. m41920, 27 October 2017 (2017-10-27), XP030070262, Retrieved from the Internet <URL:http://phenix.int-evry.fr/mpeg/doc_end_user/documents/120_Macau/wg11/m41920-v1-m41920.zip m41920.docx> [retrieved on 20171027] *
SCHWARZ (NOKIA) S ET AL: "Nokia's response to CfP for Point Cloud Compression (Category 2)", no. m41779, 17 October 2017 (2017-10-17), XP030260370, Retrieved from the Internet <URL:http://phenix.int-evry.fr/mpeg/doc_end_user/documents/120_Macau/wg11/m41779-v2-m41779.zip m41779_PCC_Nokia_CfP_response.pdf> [retrieved on 20171017] *
See also references of WO2020012071A1 *

Also Published As

Publication number Publication date
EP3821602A1 (en) 2021-05-19
WO2020012071A1 (en) 2020-01-16

Similar Documents

Publication Publication Date Title
EP3850579A4 (en) A method, an apparatus and a computer program product for volumetric video
EP3777185A4 (en) An apparatus, a method and a computer program for volumetric video
EP3695597A4 (en) An apparatus, a method and a computer program for volumetric video
EP3776477A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3818716A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3725081A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3695602A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3906677A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3759925A4 (en) An apparatus, a method and a computer program for volumetric video
EP3906699A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3603090A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3987816A4 (en) An apparatus, a method and a computer program for video encoding and decoding
EP3850863A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3566445A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3818717A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3354029A4 (en) A method, an apparatus and a computer program product for coding a 360-degree panoramic video
EP3479575A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3741108A4 (en) An apparatus, a method and a computer program for omnidirectional video
EP3434019A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3539291A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3417612A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3535977A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3925214A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3906675A4 (en) An apparatus, a method and a computer program for video coding and decoding
EP3818502A4 (en) A method, an apparatus and a computer program product for image compression

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210210

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220404

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/84 20110101ALI20220328BHEP

Ipc: H04N 21/234 20110101ALI20220328BHEP

Ipc: H04N 21/44 20110101ALI20220328BHEP

Ipc: H04N 21/434 20110101ALI20220328BHEP

Ipc: H04N 13/268 20180101ALI20220328BHEP

Ipc: H04N 19/597 20140101ALI20220328BHEP

Ipc: G06F 3/01 20060101ALI20220328BHEP

Ipc: G06T 17/00 20060101ALI20220328BHEP

Ipc: H04N 21/472 20110101ALI20220328BHEP

Ipc: H04N 21/4725 20110101ALI20220328BHEP

Ipc: G06T 7/10 20170101ALI20220328BHEP

Ipc: G06F 3/0481 20130101ALI20220328BHEP

Ipc: G06T 19/20 20110101ALI20220328BHEP

Ipc: H04N 19/17 20140101ALI20220328BHEP

Ipc: H04N 19/33 20140101AFI20220328BHEP