RU2711591C1 - Способ, устройство и компьютерная программа для адаптивной потоковой передачи мультимедийного контента виртуальной реальности - Google Patents

Способ, устройство и компьютерная программа для адаптивной потоковой передачи мультимедийного контента виртуальной реальности Download PDF

Info

Publication number
RU2711591C1
RU2711591C1 RU2018142793A RU2018142793A RU2711591C1 RU 2711591 C1 RU2711591 C1 RU 2711591C1 RU 2018142793 A RU2018142793 A RU 2018142793A RU 2018142793 A RU2018142793 A RU 2018142793A RU 2711591 C1 RU2711591 C1 RU 2711591C1
Authority
RU
Russia
Prior art keywords
projection
media
multimedia
multimedia data
omnidirectional
Prior art date
Application number
RU2018142793A
Other languages
English (en)
Russian (ru)
Inventor
Джонатан ТАКЕ
Франк ДЕНУАЛЬ
Наель УЭДРАОГО
Original Assignee
Кэнон Кабусики Кайся
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Кэнон Кабусики Кайся filed Critical Кэнон Кабусики Кайся
Application granted granted Critical
Publication of RU2711591C1 publication Critical patent/RU2711591C1/ru

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/44029—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4353—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving decryption of additional data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6373—Control signals issued by the client directed to the server or network components for rate control, e.g. request to the server to modify its transmission rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Library & Information Science (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Processing Or Creating Images (AREA)
  • Information Transfer Between Computers (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
RU2018142793A 2016-05-23 2017-05-18 Способ, устройство и компьютерная программа для адаптивной потоковой передачи мультимедийного контента виртуальной реальности RU2711591C1 (ru)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
GB1609056.5A GB2550587B (en) 2016-05-23 2016-05-23 Method, device, and computer program for adaptive streaming of virtual reality media content
GB1609056.5 2016-05-23
PCT/EP2017/062050 WO2017202699A1 (en) 2016-05-23 2017-05-18 Method, device, and computer program for adaptive streaming of virtual reality media content

Publications (1)

Publication Number Publication Date
RU2711591C1 true RU2711591C1 (ru) 2020-01-17

Family

ID=56369829

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2018142793A RU2711591C1 (ru) 2016-05-23 2017-05-18 Способ, устройство и компьютерная программа для адаптивной потоковой передачи мультимедийного контента виртуальной реальности

Country Status (8)

Country Link
US (1) US20190141359A1 (enExample)
EP (1) EP3466093B1 (enExample)
JP (2) JP2019519149A (enExample)
KR (1) KR102247399B1 (enExample)
CN (1) CN109155874B (enExample)
GB (3) GB2550587B (enExample)
RU (1) RU2711591C1 (enExample)
WO (1) WO2017202699A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115866008A (zh) * 2022-11-08 2023-03-28 阿里巴巴（中国）有限公司 扩展现实数据渲染方法以及系统

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2558086B (en) * 2014-03-25 2019-02-20 Canon Kk Methods, devices, and computer programs for improving streaming of partitioned timed media data
MY199102A (en) * 2015-08-07 2023-10-13 Mediatek Inc Method and apparatus of bitstream random access and synchronization for multimedia applications
EP3466079B1 (en) * 2016-05-24 2023-07-12 Nokia Technologies Oy Method and an apparatus and a computer program for encoding media content
US10587934B2 (en) 2016-05-24 2020-03-10 Qualcomm Incorporated Virtual reality video signaling in dynamic adaptive streaming over HTTP
KR102358757B1 (ko) * 2016-08-25 2022-02-07 엘지전자 주식회사 전방향 비디오를 전송하는 방법, 전방향 비디오를 수신하는 방법, 전방향 비디오 전송 장치, 전방향 비디오 수신 장치
US11532128B2 (en) * 2017-03-23 2022-12-20 Qualcomm Incorporated Advanced signaling of regions of interest in omnidirectional visual media
US20190104326A1 (en) * 2017-10-03 2019-04-04 Qualcomm Incorporated Content source description for immersive media data
GB201717011D0 (en) * 2017-10-17 2017-11-29 Nokia Technologies Oy An apparatus a method and a computer program for volumetric video
CN111373760A (zh) * 2017-11-30 2020-07-03 索尼公司 发送设备、发送方法、接收设备和接收方法
KR20200107945A (ko) * 2018-01-12 2020-09-16 소니 주식회사 정보 처리 장치 및 방법
MX2020010475A (es) 2018-04-05 2020-12-09 Vid Scale Inc Metadatos de puntos de vista para video omnidireccional.
CN110956583B (zh) * 2018-09-26 2022-05-10 华为技术有限公司 球面图像处理方法、装置及服务器
WO2020063850A1 (zh) * 2018-09-27 2020-04-02 华为技术有限公司 一种处理媒体数据的方法、终端及服务器
CN111263191B (zh) * 2018-11-30 2023-06-27 中兴通讯股份有限公司 视频数据的处理方法、装置、相关设备及存储介质
US11403784B2 (en) * 2019-03-19 2022-08-02 Tencent America LLC Method and apparatus for tree-based point cloud compression (PCC) media stream using moving picture experts group (MPEG)-dynamic adaptive streaming over HTTP (DASH)
GB2585052B (en) * 2019-06-26 2023-07-26 Canon Kk Method and apparatus for encapsulating panorama images in a file
KR20220044938A (ko) * 2019-08-08 2022-04-12 인텔 코포레이션 링크 성능 예측 및 미디어 스트리밍 기술들
EP4082217A1 (en) * 2019-12-24 2022-11-02 Koninklijke KPN N.V. Video processing device and manifest file for video streaming
WO2021136881A1 (en) * 2020-01-03 2021-07-08 Nokia Technologies Oy Method for real time texture adaptation
GB2593945A (en) * 2020-04-06 2021-10-13 Canon Kk Method and apparatus for encapsulating region related annotation in an image file
CN115462088B (zh) * 2020-04-07 2025-12-23 交互数字Ce专利控股有限公司 用于体积视频的不同图集打包
CN113542907B (zh) * 2020-04-16 2022-09-23 上海交通大学 多媒体数据收发方法、系统、处理器和播放器
EP4222966A1 (en) * 2020-09-30 2023-08-09 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Signaling of visual content
US12309434B2 (en) 2020-10-01 2025-05-20 Koninklijke Kpn N.V. Streaming panoramic video of a scene from multiple viewpoints
US11895170B2 (en) * 2021-03-09 2024-02-06 Cisco Technology, Inc. Synchronicity for virtual reality/augmented reality interactive sessions in wireless networks
EP4622273A1 (de) * 2024-03-21 2025-09-24 Softseed Technologies GmbH Verfahren und system zur übertragung von 360°- live videostreams
KR102801355B1 (ko) * 2024-10-07 2025-04-30 박성환 체험형 vr 영상 촬영 및 관리 시스템

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2824885A1 (en) * 2013-07-12 2015-01-14 Alcatel Lucent A manifest file format supporting panoramic video
RU2014107894A (ru) * 2011-08-01 2015-09-10 Квэлкомм Инкорпорейтед Способ и устройство для транспорта фрагментов описания сегментов инициализации динамической адаптивной потоковой передачи по нттр (dash) в качестве фрагментов описания пользовательских услуг
WO2015197818A1 (en) * 2014-06-27 2015-12-30 Koninklijke Kpn N.V. Hevc-tiled video streaming

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1093711C (zh) * 1998-02-06 2002-10-30 财团法人工业技术研究院 全景图象式虚拟现实播放系统和方法
JP2001285832A (ja) * 2000-01-24 2001-10-12 Matsushita Electric Ind Co Ltd データ受信装置，データ受信方法，データ伝送方法，およびデータ記憶媒体
JP2003141562A (ja) * 2001-10-29 2003-05-16 Sony Corp 非平面画像の画像処理装置及び画像処理方法、記憶媒体、並びにコンピュータ・プログラム
US7149367B2 (en) * 2002-06-28 2006-12-12 Microsoft Corp. User interface for a system and method for head size equalization in 360 degree panoramic images
JP5016541B2 (ja) * 2008-04-01 2012-09-05 富士フイルム株式会社 画像処理装置および方法並びにプログラム
CN102056015B (zh) * 2009-11-04 2012-12-05 沈阳迅景科技有限公司 一种全景虚拟现实漫游中的流媒体应用方法
CN102217322B (zh) * 2011-05-27 2013-10-09 华为技术有限公司 媒体发送方法、媒体接收方法和客户端及系统
FR3004881B1 (fr) * 2013-04-19 2015-04-17 Kolor Procede de generation d'un flux video de sortie a partir d'un flux video large champ
US20150130814A1 (en) * 2013-11-11 2015-05-14 Amazon Technologies, Inc. Data collection for multiple view generation
GB2558086B (en) * 2014-03-25 2019-02-20 Canon Kk Methods, devices, and computer programs for improving streaming of partitioned timed media data
CN106664443B (zh) * 2014-06-27 2020-03-24 皇家Kpn公司 根据hevc拼贴视频流确定感兴趣区域
WO2016004039A1 (en) * 2014-07-01 2016-01-07 Huawei Technologies Co., Ltd. Client behavior control in adaptive streaming
CN107431819B (zh) * 2014-12-31 2022-02-01 诺基亚技术有限公司 用于视频解码的方法、装置、计算机可读存储介质及视频解码器

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2014107894A (ru) * 2011-08-01 2015-09-10 Квэлкомм Инкорпорейтед Способ и устройство для транспорта фрагментов описания сегментов инициализации динамической адаптивной потоковой передачи по нттр (dash) в качестве фрагментов описания пользовательских услуг
EP2824885A1 (en) * 2013-07-12 2015-01-14 Alcatel Lucent A manifest file format supporting panoramic video
WO2015197818A1 (en) * 2014-06-27 2015-12-30 Koninklijke Kpn N.V. Hevc-tiled video streaming

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LIM SEONG YONG et al, Tiled panoramic video transmission system based on MPEG-DASH, 2015 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), IEEE, 2015. *
LIM SEONG YONG et al, Tiled panoramic video transmission system based on MPEG-DASH, 2015 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), IEEE, 2015. MARTIN PRINS et al, A hybrid architecture for delivery of panoramic video, PROCEEDINGS OF THE 11TH EUROPEAN CONFERENCE ON INTERACTIVE TV AND VIDEO, EUROITV '13, New York, 2013. *
MARTIN PRINS et al, A hybrid architecture for delivery of panoramic video, PROCEEDINGS OF THE 11TH EUROPEAN CONFERENCE ON INTERACTIVE TV AND VIDEO, EUROITV '13, New York, 2013 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115866008A (zh) * 2022-11-08 2023-03-28 阿里巴巴（中国）有限公司 扩展现实数据渲染方法以及系统

Also Published As

Publication number Publication date
GB2550587B (en) 2020-05-20
GB2578227B (en) 2021-09-15
KR20190008325A (ko) 2019-01-23
GB2578227A (en) 2020-04-22
EP3466093B1 (en) 2021-12-01
CN109155874A (zh) 2019-01-04
JP2022031346A (ja) 2022-02-18
GB202108749D0 (en) 2021-08-04
KR102247399B1 (ko) 2021-05-03
GB201609056D0 (en) 2016-07-06
CN109155874B (zh) 2022-01-11
WO2017202699A1 (en) 2017-11-30
JP2019519149A (ja) 2019-07-04
GB201914981D0 (en) 2019-11-27
JP7223106B2 (ja) 2023-02-15
EP3466093A1 (en) 2019-04-10
GB2550587A (en) 2017-11-29
US20190141359A1 (en) 2019-05-09

Similar Documents

Publication Publication Date Title
JP7223106B2 (ja) 仮想現実メディアコンテンツを適応ストリーミングする方法、デバイス及びコンピュータプログラム
KR102246002B1 (ko) 가상 현실 미디어 콘텐트의 스트리밍을 개선하는 방법, 디바이스, 및 컴퓨터 프로그램
JP6735415B2 (ja) オーディオビジュアルコンテンツの観察点および観察向きの制御された選択のための方法および装置
US12088862B2 (en) Method, device, and computer program for transmitting media content
KR102261559B1 (ko) 정보 처리 방법 및 장치
US11094130B2 (en) Method, an apparatus and a computer program product for video encoding and video decoding
EP3712751B1 (en) Method and apparatus for incorporating location awareness in media content
CN108282449B (zh) 一种应用于虚拟现实技术的流媒体的传输方法和客户端
WO2020043126A1 (zh) 视频数据的处理，传输方法及装置，视频数据的处理系统
US20200145736A1 (en) Media data processing method and apparatus
EP3939327A1 (en) Method and apparatus for grouping entities in media content
JP7041472B2 (ja) マニフェストを作成する方法及びネットワーク機器
CN114930869A (zh) 用于视频编码和视频解码的方法、装置和计算机程序产品
JP2020526969A (ja) メディア情報処理方法および装置
US11677978B2 (en) Omnidirectional video processing method and device, related apparatuses and storage medium
HK40083059B (en) Method, apparatus, device and storage medium for encapsulating and decapsulating media file