CN109314791B - 用于呈现设备的生成流和合成视频的方法、设备和处理器可读介质 - Google Patents

用于呈现设备的生成流和合成视频的方法、设备和处理器可读介质 Download PDF

Info

Publication number
CN109314791B
CN109314791B CN201780024150.8A CN201780024150A CN109314791B CN 109314791 B CN109314791 B CN 109314791B CN 201780024150 A CN201780024150 A CN 201780024150A CN 109314791 B CN109314791 B CN 109314791B
Authority
CN
China
Prior art keywords
video
stream
immersive
syntax element
mapping surface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780024150.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN109314791A (zh
Inventor
R.多尔
J.弗勒雷奥
T.塔皮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital VC Holdings Inc
Original Assignee
InterDigital VC Holdings Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by InterDigital VC Holdings Inc filed Critical InterDigital VC Holdings Inc
Publication of CN109314791A publication Critical patent/CN109314791A/zh
Application granted granted Critical
Publication of CN109314791B publication Critical patent/CN109314791B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/06Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • G06T3/073Transforming surfaces of revolution to planar images, e.g. cylindrical surfaces to planar images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/21805Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2355Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages
    • H04N21/2358Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages for generating different versions, e.g. for different recipient devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25825Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Circuits (AREA)
CN201780024150.8A 2016-03-22 2017-03-14 用于呈现设备的生成流和合成视频的方法、设备和处理器可读介质 Active CN109314791B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP16305321.8A EP3223524A1 (en) 2016-03-22 2016-03-22 Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
EP16305321.8 2016-03-22
PCT/EP2017/055952 WO2017162479A1 (en) 2016-03-22 2017-03-14 Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices

Publications (2)

Publication Number Publication Date
CN109314791A CN109314791A (zh) 2019-02-05
CN109314791B true CN109314791B (zh) 2021-07-20

Family

ID=55646505

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780024150.8A Active CN109314791B (zh) 2016-03-22 2017-03-14 用于呈现设备的生成流和合成视频的方法、设备和处理器可读介质

Country Status (10)

Country Link
US (1) US10958950B2 (https=)
EP (2) EP3223524A1 (https=)
JP (1) JP7177034B2 (https=)
KR (1) KR102308604B1 (https=)
CN (1) CN109314791B (https=)
CA (1) CA3018600C (https=)
MX (1) MX388973B (https=)
RU (1) RU2733218C2 (https=)
TW (1) TWI735552B (https=)
WO (1) WO2017162479A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA3023986A1 (en) 2016-05-13 2017-11-16 Interdigital Vc Holdings, Inc. Method and apparatus for video coding with adaptive clipping
EP3249928A1 (en) * 2016-05-23 2017-11-29 Thomson Licensing Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices
WO2018025660A1 (ja) * 2016-08-05 2018-02-08 ソニー株式会社 画像処理装置および画像処理方法
EP3297282A1 (en) 2016-09-15 2018-03-21 Thomson Licensing Method and apparatus for video coding with adaptive clipping
WO2019117569A1 (en) * 2017-12-14 2019-06-20 Samsung Electronics Co., Ltd. Method and apparatus for managing immersive data
CN110910485B (zh) * 2019-12-16 2023-07-25 山东东艺数字科技有限公司 一种沉浸式cave影像制作方法
FR3117221B1 (fr) * 2020-12-04 2023-01-06 Socialdream dispositif immersif

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102484727A (zh) * 2009-03-19 2012-05-30 Lg电子株式会社 用于处理三维(3d)视频信号的方法和用于执行该处理方法的数字广播接收机
CN102726038A (zh) * 2010-01-27 2012-10-10 联发科技股份有限公司 用于依据视频输入产生适合显示装置的显示能力的视频输出的视频处理装置及相关方法
CN102835047A (zh) * 2010-01-28 2012-12-19 三星电子株式会社 使用关于多视点视频流的链接信息发送数字广播流的方法和设备以及接收数字广播流的方法和设备

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7336299B2 (en) * 2003-07-03 2008-02-26 Physical Optics Corporation Panoramic video system with real-time distortion-free imaging
JP2005333552A (ja) 2004-05-21 2005-12-02 Viewplus Inc パノラマ映像配信システム
WO2008047054A2 (fr) 2006-10-18 2008-04-24 France Telecom Procedes et dispositifs pour optimiser les ressources necessaires a la presentation de contenus multimedias
US7982733B2 (en) 2007-01-05 2011-07-19 Qualcomm Incorporated Rendering 3D video images on a stereo-enabled display
CN101453639B (zh) 2007-11-29 2012-05-30 展讯通信(上海)有限公司 支持roi区域的多路视频流的编码、解码方法和系统
WO2010075726A1 (zh) 2008-12-30 2010-07-08 华为终端有限公司 立体全景视频流生成方法、设备及视频会议方法和设备
MX2011000947A (es) 2009-05-19 2011-03-02 Panasonic Corp Medio de grabacion, dispositivo de reproduccion, dispositivo de codificacion, circuito integrado, y dispositivo de salida de reproduccion.
US8537200B2 (en) * 2009-10-23 2013-09-17 Qualcomm Incorporated Depth map generation techniques for conversion of 2D video data to 3D video data
CN101771878B (zh) * 2010-01-14 2011-05-25 广西大学 面向全景视频编码的自适应选择全局运动估计方法
CN103098462A (zh) 2010-08-06 2013-05-08 松下电器产业株式会社 编码方法、显示装置以及解码方法
US20120092348A1 (en) 2010-10-14 2012-04-19 Immersive Media Company Semi-automatic navigation with an immersive image
JP2012199897A (ja) 2011-03-04 2012-10-18 Sony Corp 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法
US8600194B2 (en) * 2011-05-17 2013-12-03 Apple Inc. Positional sensor-assisted image registration for panoramic photography
EP2530642A1 (en) 2011-05-31 2012-12-05 Thomson Licensing Method of cropping a 3D content
WO2012168365A1 (en) 2011-06-08 2012-12-13 Koninklijke Kpn N.V. Spatially-segmented content delivery
KR101282955B1 (ko) 2011-08-31 2013-07-17 한국과학기술연구원 실시간 고해상도 파노라마 영상 스트리밍 시스템 및 방법
WO2013074060A1 (en) 2011-11-14 2013-05-23 Intel Corporation Video analytic encoding
US9516225B2 (en) 2011-12-02 2016-12-06 Amazon Technologies, Inc. Apparatus and method for panoramic video hosting
WO2014005301A1 (en) 2012-07-04 2014-01-09 Intel Corporation A region of interest based framework for 3d video coding
EP2824883A1 (en) 2013-07-12 2015-01-14 Alcatel Lucent A video client and video server for panoramic video consumption
EP3008896B1 (en) * 2013-07-15 2021-03-31 Sony Corporation Extensions of motion-constrained tile sets sei message for interactivity
CN104680505A (zh) * 2013-11-29 2015-06-03 陆婷 一种鱼眼镜头校正的全景视图算法
US20150373341A1 (en) * 2014-06-23 2015-12-24 Cisco Technology, Inc. Techniques for Interactive Region-Based Scalability
WO2015197818A1 (en) * 2014-06-27 2015-12-30 Koninklijke Kpn N.V. Hevc-tiled video streaming
US9883101B1 (en) 2014-07-23 2018-01-30 Hoyos Integrity Corporation Providing a real-time via a wireless communication channel associated with a panoramic video capture device
CN104539893B (zh) 2014-12-23 2017-12-01 福建星网视易信息系统有限公司 实现虚拟云台监控效果的方法、装置及系统
US9843725B2 (en) * 2015-12-29 2017-12-12 VideoStitch Inc. Omnidirectional camera with multiple processors and/or multiple sensors connected to each processor

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102484727A (zh) * 2009-03-19 2012-05-30 Lg电子株式会社 用于处理三维(3d)视频信号的方法和用于执行该处理方法的数字广播接收机
CN102726038A (zh) * 2010-01-27 2012-10-10 联发科技股份有限公司 用于依据视频输入产生适合显示装置的显示能力的视频输出的视频处理装置及相关方法
CN102835047A (zh) * 2010-01-28 2012-12-19 三星电子株式会社 使用关于多视点视频流的链接信息发送数字广播流的方法和设备以及接收数字广播流的方法和设备

Also Published As

Publication number Publication date
US20190104330A1 (en) 2019-04-04
MX388973B (es) 2025-03-20
RU2018136879A (ru) 2020-04-22
WO2017162479A1 (en) 2017-09-28
US10958950B2 (en) 2021-03-23
RU2733218C2 (ru) 2020-09-30
TW201803358A (zh) 2018-01-16
EP3434021A1 (en) 2019-01-30
CA3018600A1 (en) 2017-09-28
RU2018136879A3 (https=) 2020-04-22
EP3434021B1 (en) 2021-05-05
MX2018011498A (es) 2019-07-04
KR102308604B1 (ko) 2021-10-06
CN109314791A (zh) 2019-02-05
BR112018069211A2 (pt) 2019-01-22
TWI735552B (zh) 2021-08-11
JP7177034B2 (ja) 2022-11-22
KR20190029505A (ko) 2019-03-20
CA3018600C (en) 2022-07-12
EP3223524A1 (en) 2017-09-27
JP2019514313A (ja) 2019-05-30

Similar Documents

Publication Publication Date Title
US11700352B2 (en) Rectilinear viewport extraction from a region of a wide field of view using messaging in video transmission
CN109314791B (zh) 用于呈现设备的生成流和合成视频的方法、设备和处理器可读介质
CN107454468B (zh) 对沉浸式视频进行格式化的方法、装置和流
KR102262727B1 (ko) 360 비디오 처리 방법 및 그 장치
CN116235497A (zh) 一种用于用信号通知基于多平面图像的体积视频的深度的方法和装置
CN113906761A (zh) 利用修补补片对3d场景进行编码和渲染的方法和装置
JP7614168B2 (ja) ボリュメトリックビデオコンテンツを配信するための方法および装置
KR20200088485A (ko) 카메라 렌즈 정보를 포함한 360도 비디오를 송수신하는 방법 및 그 장치
BR112018069211B1 (pt) Método e dispositivo configurado para gerar um fluxo, fluxo portando dados representativos de um vídeo preparados para uma superfície de mapeamento convexa, e método e dispositivo configurado para compor um vídeo a partir de um fluxo portando dados representativos de um vídeo imersivo preparado para uma superfície de mapeamento convexa

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant