CN110945873B - 下一代网络上的360度视频递送 - Google Patents

下一代网络上的360度视频递送 Download PDF

Info

Publication number
CN110945873B
CN110945873B CN201880048278.2A CN201880048278A CN110945873B CN 110945873 B CN110945873 B CN 110945873B CN 201880048278 A CN201880048278 A CN 201880048278A CN 110945873 B CN110945873 B CN 110945873B
Authority
CN
China
Prior art keywords
segment
request
segments
degree video
viewport
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880048278.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN110945873A (zh
Inventor
贺勇
叶艳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital VC Holdings Inc
Original Assignee
Vid Scale Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vid Scale Inc filed Critical Vid Scale Inc
Priority to CN202211267345.4A priority Critical patent/CN115567755A/zh
Publication of CN110945873A publication Critical patent/CN110945873A/zh
Application granted granted Critical
Publication of CN110945873B publication Critical patent/CN110945873B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN201880048278.2A 2017-06-02 2018-06-01 下一代网络上的360度视频递送 Active CN110945873B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211267345.4A CN115567755A (zh) 2017-06-02 2018-06-01 下一代网络上的360度视频递送

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762514405P 2017-06-02 2017-06-02
US62/514,405 2017-06-02
PCT/US2018/035607 WO2018222996A1 (en) 2017-06-02 2018-06-01 360-degree video delivery over next generation network

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202211267345.4A Division CN115567755A (zh) 2017-06-02 2018-06-01 下一代网络上的360度视频递送

Publications (2)

Publication Number Publication Date
CN110945873A CN110945873A (zh) 2020-03-31
CN110945873B true CN110945873B (zh) 2022-11-04

Family

ID=62685218

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201880048278.2A Active CN110945873B (zh) 2017-06-02 2018-06-01 下一代网络上的360度视频递送
CN202211267345.4A Pending CN115567755A (zh) 2017-06-02 2018-06-01 下一代网络上的360度视频递送

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202211267345.4A Pending CN115567755A (zh) 2017-06-02 2018-06-01 下一代网络上的360度视频递送

Country Status (6)

Country Link
US (3) US11025993B2 (enExample)
EP (2) EP3635959B1 (enExample)
JP (4) JP6941694B2 (enExample)
CN (2) CN110945873B (enExample)
MX (1) MX2019014416A (enExample)
WO (1) WO2018222996A1 (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10547704B2 (en) * 2017-04-06 2020-01-28 Sony Interactive Entertainment Inc. Predictive bitrate selection for 360 video streaming
US11218711B2 (en) 2017-09-15 2022-01-04 Cable Television Laboratories, Inc. Information centric networking (ICN) media streaming
WO2019115153A1 (en) * 2017-12-12 2019-06-20 Nokia Solutions And Networks Oy Method, apparatus, system and computer readable medium to transmit data stream
CN110519652B (zh) 2018-05-22 2021-05-18 华为软件技术有限公司 Vr视频播放方法、终端及服务器
FR3091438B1 (fr) * 2018-12-28 2021-12-31 Quortex Module elementaire d’un systeme de distribution d’un contenu audiovisuel
JP7506077B2 (ja) * 2019-01-02 2024-06-25 ノキア テクノロジーズ オサケユイチア 映像の符号化および復号のための装置、方法、およびコンピュータプログラム
US11805303B2 (en) * 2019-01-04 2023-10-31 Nokia Technologies Oy Method and apparatus for storage and signaling of media segment sizes and priority ranks
GB2580667A (en) * 2019-01-22 2020-07-29 Sony Corp A method, device and computer program
JP7296219B2 (ja) * 2019-03-07 2023-06-22 日本放送協会 受信装置、送信装置、及びプログラム
US12155809B2 (en) * 2019-06-20 2024-11-26 At&T Intellectual Property I, L.P. Processing system for streaming volumetric video to a client device
US11582463B2 (en) * 2019-12-30 2023-02-14 Tencent America LLC Method for alignment across layers in coded video stream
US11412310B2 (en) 2020-05-18 2022-08-09 Qualcomm Incorporated Performing and evaluating split rendering over 5G networks
US11503289B2 (en) * 2020-05-27 2022-11-15 Tencent America LLC Bitstream structure for viewport-based streaming with a fallback bitstream
WO2022122123A1 (en) * 2020-12-08 2022-06-16 Nokia Technologies Oy Method and apparatus for use in a data pulling operation
US11895170B2 (en) * 2021-03-09 2024-02-06 Cisco Technology, Inc. Synchronicity for virtual reality/augmented reality interactive sessions in wireless networks
JP7763425B2 (ja) * 2022-02-15 2025-11-04 Ｎｔｔ株式会社 映像配信システム、エッジサーバ及び映像配信方法
CN114979089B (zh) * 2022-04-25 2023-03-24 北京邮电大学 一种实时传输全景视频的系统和方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1324463A (zh) * 1998-10-28 2001-11-28 国际商业机器公司 用于图象数据关键区的优先传输和显示的方法和装置
CN1722908A (zh) * 2004-04-15 2006-01-18 株式会社东芝 信息设备远程操作系统
EP2824883A1 (en) * 2013-07-12 2015-01-14 Alcatel Lucent A video client and video server for panoramic video consumption
CN105791882A (zh) * 2016-03-22 2016-07-20 腾讯科技（深圳）有限公司 视频编码方法及装置
EP3065406A1 (en) * 2015-03-05 2016-09-07 Nokia Technologies Oy Video streaming method
CN106131615A (zh) * 2016-07-25 2016-11-16 北京小米移动软件有限公司 视频播放方法及装置

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004048546A (ja) 2002-07-15 2004-02-12 Sony Corp 情報処理装置および方法、表示装置および方法、並びにプログラム
US20160286128A1 (en) * 2002-10-01 2016-09-29 Dylan TX ZHOU Amphibious vtol super drone camera in a mobile case (phone case) with multiple aerial and aquatic flight modes for capturing panoramic virtual reality views, selfie and interactive video
JP2008516478A (ja) * 2004-10-05 2008-05-15 ヴェクターマックス コーポレーション データストリーム内のデータを認識して処理するシステム及び方法
CN102017617B (zh) 2008-05-07 2014-08-13 数字源泉公司 广播信道上的快速信道切换和高质量流保护
JP4878642B2 (ja) 2009-12-15 2012-02-15 シャープ株式会社 コンテンツ配信システム、コンテンツ配信装置、コンテンツ再生端末およびコンテンツ配信方法
US8751925B1 (en) * 2010-04-05 2014-06-10 Facebook, Inc. Phased generation and delivery of structured documents
US9445136B2 (en) * 2011-09-21 2016-09-13 Qualcomm Incorporated Signaling characteristics of segments for network streaming of media data
CN102547592B (zh) * 2012-01-06 2015-02-18 电信科学技术研究院 一种数据传输方法及装置
EP2665239B1 (en) * 2012-05-14 2016-08-31 Alcatel Lucent An adaptive streaming aware networks node, client and method with priority marking
EP2898719B1 (en) * 2012-09-19 2023-11-01 InterDigital Patent Holdings, Inc. Methods and apparatus for shared access system
US20140232819A1 (en) * 2013-02-19 2014-08-21 Tourwrist, Inc. Systems and methods for generating and sharing panoramic moments
US8953452B2 (en) * 2013-05-16 2015-02-10 Cisco Technology, Inc. Enhancing performance of rapid channel changes and other playback positioning changes in adaptive streaming
RU2625328C1 (ru) * 2013-07-12 2017-07-13 Кэнон Кабусики Кайся Способ адаптивной потоковой передачи данных с управлением сообщениями активной доставки
US9197717B2 (en) * 2013-11-27 2015-11-24 At&T Intellectual Property I, Lp Server-side scheduling for media transmissions according to client device states
US9253231B2 (en) * 2013-12-19 2016-02-02 Verizon Patent And Licensing Inc. Retrieving and caching adaptive bitrate stream segments based on network congestion
JP2016025633A (ja) 2014-07-24 2016-02-08 ソニー株式会社 情報処理装置、管理装置、情報処理方法、およびプログラム
US20160150212A1 (en) * 2014-11-26 2016-05-26 Sony Corporation Live selective adaptive bandwidth
JP2016213810A (ja) * 2015-05-01 2016-12-15 株式会社リコー 画像表示システム、情報処理装置、プログラム、画像表示方法
CN104918077B (zh) * 2015-06-02 2018-01-30 北京邮电大学 一种视频传输方法、装置及系统
WO2016204815A1 (en) * 2015-06-16 2016-12-22 Intel IP Corporation Adaptive video streaming using dynamic radio access network information
US9858706B2 (en) 2015-09-22 2018-01-02 Facebook, Inc. Systems and methods for content streaming
WO2017129051A1 (en) * 2016-01-28 2017-08-03 Mediatek Inc. Method and system for streaming applications using rate pacing and mpd fragmenting
US10334224B2 (en) * 2016-02-19 2019-06-25 Alcacruz Inc. Systems and method for GPU based virtual reality video streaming server
US10666941B1 (en) * 2016-04-06 2020-05-26 Ambarella International Lp Low bitrate encoding of panoramic video to support live streaming over a wireless peer-to-peer connection
US11032588B2 (en) * 2016-05-16 2021-06-08 Google Llc Method and apparatus for spatial enhanced adaptive bitrate live streaming for 360 degree video playback
US11019257B2 (en) * 2016-05-19 2021-05-25 Avago Technologies International Sales Pte. Limited 360 degree video capture and playback
KR102224826B1 (ko) * 2016-05-26 2021-03-09 브이아이디 스케일, 인크. 뷰포트 적응형 360도 비디오 전달의 방법 및 장치
MX2018014748A (es) * 2016-06-08 2019-04-29 Sony Corp Dispositivo de recepcion y metodo de recepcion, dispositivo de reproduccion y metodo de reproduccion, dispositivo de suministro y metodo de suministro y programa.
WO2018049221A1 (en) * 2016-09-09 2018-03-15 Vid Scale, Inc. Methods and apparatus to reduce latency for 360-degree viewport adaptive streaming
EP3539269B1 (en) * 2016-11-10 2020-09-23 Sony Corporation Node type based control of assistance for data streaming
US10542328B2 (en) * 2016-12-30 2020-01-21 Facebook, Inc. Systems and methods for providing content
US11102267B2 (en) * 2017-04-14 2021-08-24 Apple Inc. Server- and network-assisted dynamic adaptive streaming over hypertext transport protocol signaling

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1324463A (zh) * 1998-10-28 2001-11-28 国际商业机器公司 用于图象数据关键区的优先传输和显示的方法和装置
CN1722908A (zh) * 2004-04-15 2006-01-18 株式会社东芝 信息设备远程操作系统
EP2824883A1 (en) * 2013-07-12 2015-01-14 Alcatel Lucent A video client and video server for panoramic video consumption
EP3065406A1 (en) * 2015-03-05 2016-09-07 Nokia Technologies Oy Video streaming method
CN105791882A (zh) * 2016-03-22 2016-07-20 腾讯科技（深圳）有限公司 视频编码方法及装置
CN106131615A (zh) * 2016-07-25 2016-11-16 北京小米移动软件有限公司 视频播放方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications Amendment 2: Sub 1 GHz License Exempt Operation;IEEE-SA Standards Board;《802.11ah-2016 - IEEE Standard for Information technology》;20170505;576 *

Also Published As

Publication number Publication date
CN115567755A (zh) 2023-01-03
US11770594B2 (en) 2023-09-26
JP7723137B2 (ja) 2025-08-13
EP3896979A1 (en) 2021-10-20
JP7473693B2 (ja) 2024-04-23
US20230421863A1 (en) 2023-12-28
JP2023030191A (ja) 2023-03-07
JP2024096148A (ja) 2024-07-12
US12108125B2 (en) 2024-10-01
JP2020522932A (ja) 2020-07-30
US20210321171A1 (en) 2021-10-14
EP3635959A1 (en) 2020-04-15
JP6941694B2 (ja) 2021-09-29
JP7206341B2 (ja) 2023-01-17
US11025993B2 (en) 2021-06-01
WO2018222996A1 (en) 2018-12-06
JP2021185713A (ja) 2021-12-09
EP3635959B1 (en) 2021-08-04
US20200137462A1 (en) 2020-04-30
MX2019014416A (es) 2020-02-05
CN110945873A (zh) 2020-03-31

Similar Documents

Publication Publication Date Title
CN110945873B (zh) 下一代网络上的360度视频递送
JP7333802B2 (ja) ３６０度適応ストリーミングのエクスペリエンスを改善するためのメトリックおよびメッセージ
JP7716436B2 (ja) ジオメトリベースのポイントクラウドの適応ストリーミング
WO2020185842A1 (en) Methods and apparatus for sub-picture adaptive resolution change
JP2025170343A (ja) ビデオベース点群ストリームのｉｓｏｂｍｆｆコンテナにおける部分的なアクセスサポート
JP2024502822A (ja) ビジュアルボリュメトリックビデオベース（ｖ３ｃ）及びジオメトリベース点群（ｇ－ｐｃｃ）メディアのストリーミングのためのｍｍｔシグナリング
US20250168376A1 (en) Dynamic adaptation of volumetric content component sub-bitstreams in streaming services
US20240430478A1 (en) Adaptive streaming of geometry-based point clouds
EP3973713A1 (en) Video-based point cloud streams
EP4035410A1 (en) Video-based point cloud streams
WO2025080952A1 (en) Qos-aware haptic data transmission methods
WO2024081395A1 (en) Viewport and/or region-of-interest dependent delivery of v3c data using rtp
CN116830588A (zh) 用于基于视觉体积视频（v3c）媒体和基于几何的点云（g-pcc）媒体的流式传输的mmt信令

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240815

Address after: Delaware, USA

Patentee after: Interactive Digital VC Holdings

Country or region after: U.S.A.

Address before: Wilmington, Delaware, USA

Patentee before: VID SCALE, Inc.

Country or region before: U.S.A.