JP6382319B2 - オーディオ／ビデオストリーミングのためのレイテンシバッファリングの動的および自動制御 - Google Patents

オーディオ／ビデオストリーミングのためのレイテンシバッファリングの動的および自動制御 Download PDF

Info

Publication number
JP6382319B2
JP6382319B2 JP2016540908A JP2016540908A JP6382319B2 JP 6382319 B2 JP6382319 B2 JP 6382319B2 JP 2016540908 A JP2016540908 A JP 2016540908A JP 2016540908 A JP2016540908 A JP 2016540908A JP 6382319 B2 JP6382319 B2 JP 6382319B2
Authority
JP
Japan
Prior art keywords
source device
latency
buffer size
media stream
transport stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2016540908A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016537914A5 (enExample
JP2016537914A (ja
Inventor
クーン、スティーブン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2016537914A publication Critical patent/JP2016537914A/ja
Publication of JP2016537914A5 publication Critical patent/JP2016537914A5/ja
Application granted granted Critical
Publication of JP6382319B2 publication Critical patent/JP6382319B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23406—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving management of server-side video buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2401—Monitoring of the client buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Synchronisation In Digital Transmission Systems (AREA)
JP2016540908A 2013-09-04 2014-08-25 オーディオ／ビデオストリーミングのためのレイテンシバッファリングの動的および自動制御 Expired - Fee Related JP6382319B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/018,019 US9826015B2 (en) 2013-09-04 2013-09-04 Dynamic and automatic control of latency buffering for audio/video streaming
US14/018,019 2013-09-04
PCT/US2014/052476 WO2015034698A1 (en) 2013-09-04 2014-08-25 Dynamic and automatic control of latency buffering for audio/video streaming

Publications (3)

Publication Number Publication Date
JP2016537914A JP2016537914A (ja) 2016-12-01
JP2016537914A5 JP2016537914A5 (enExample) 2017-09-07
JP6382319B2 true JP6382319B2 (ja) 2018-08-29

Family

ID=51539334

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016540908A Expired - Fee Related JP6382319B2 (ja) 2013-09-04 2014-08-25 オーディオ／ビデオストリーミングのためのレイテンシバッファリングの動的および自動制御

Country Status (5)

Country Link
US (1) US9826015B2 (enExample)
EP (1) EP3042502A1 (enExample)
JP (1) JP6382319B2 (enExample)
CN (1) CN105556977A (enExample)
WO (1) WO2015034698A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023068904A1 (ko) * 2021-10-22 2023-04-27 삼성전자 주식회사 전자 장치 및 전자 장치의 동작 방법

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8788578B2 (en) * 2011-07-11 2014-07-22 Roku, Inc. Method and apparatus for customized provisioning of on-line application channels
WO2014051403A1 (en) * 2012-09-28 2014-04-03 Samsung Electronics Co., Ltd. Method and system for streaming multimedia content in a wireless fidelity display network environment
US9210204B2 (en) * 2013-10-31 2015-12-08 At&T Intellectual Property I, Lp Synchronizing media presentation at multiple devices
US9246970B2 (en) * 2014-02-14 2016-01-26 GM Global Technology Operations LLC System and method for compensating for delay and jitter
US9306987B2 (en) * 2014-04-29 2016-04-05 Cisco Technology, Inc. Content message for video conferencing
US9564108B2 (en) * 2014-10-20 2017-02-07 Amlogic Co., Limited Video frame processing on a mobile operating system
US9589543B2 (en) 2015-03-18 2017-03-07 Intel Corporation Static frame image quality improvement for sink displays
US9532099B2 (en) * 2015-03-24 2016-12-27 Intel Corporation Distributed media stream synchronization control
US20170055235A1 (en) * 2015-08-21 2017-02-23 Qualcomm Incorporated Providing precision timing protocol (ptp) timing and clock synchronization for wireless multimedia devices
US9985887B2 (en) * 2015-08-27 2018-05-29 Cavium Inc. Method and apparatus for providing a low latency transmission system using adaptive buffering estimation
US10296765B2 (en) * 2015-09-30 2019-05-21 International Business Machines Corporation Multi-level security enforcement
CN105872651A (zh) * 2015-12-18 2016-08-17 乐视移动智能信息技术（北京）有限公司 图像处理方法及装置
US11134114B2 (en) * 2016-03-15 2021-09-28 Intel Corporation User input based adaptive streaming
KR102388049B1 (ko) * 2017-02-14 2022-04-19 삼성전자주식회사 무선 통신 시스템에서 통신을 수행하는 장치 및 이를 위한 방법
US10169114B1 (en) 2017-09-06 2019-01-01 International Business Machines Corporation Predicting exhausted storage for a blocking API
EP3462745A1 (en) * 2017-09-27 2019-04-03 Nokia Solutions and Networks Oy Modifying a buffer size
US10974139B2 (en) * 2017-11-09 2021-04-13 Disney Enterprises, Inc. Persistent progress over a connected device network and interactive and continuous storytelling via data input from connected devices
US11595316B2 (en) * 2018-06-01 2023-02-28 Apple Inc. Adaptive and seamless playback buffer adjustment for streaming content
US20200014963A1 (en) * 2018-07-03 2020-01-09 Qualcomm Incorporated Latency improvement via frame latency feedback
CN109151194B (zh) * 2018-08-14 2021-03-02 Oppo广东移动通信有限公司 数据传输方法、装置、电子设备以及存储介质
CN109144463B (zh) * 2018-08-14 2020-08-25 Oppo广东移动通信有限公司 传输控制方法、装置以及电子设备
CN109275129B (zh) * 2018-08-14 2021-10-22 Oppo广东移动通信有限公司 通信处理方法、装置、电子设备及存储介质
CN110856028B (zh) * 2018-08-20 2021-12-14 上海途擎微电子有限公司 一种媒体数据的播放方法、设备及存储介质
CN109218795B (zh) * 2018-11-29 2021-09-24 海信视像科技股份有限公司 一种多设备播放进度同步方法、装置及终端设备
FR3100412B1 (fr) * 2019-09-04 2021-08-06 Sagemcom Broadband Sas Procédé de décodage d’un flux d’entrée audio/vidéo
US11110349B2 (en) * 2019-10-01 2021-09-07 Sony Interactive Entertainment Inc. Dynamic client buffering and usage of received video frames for cloud gaming
CN111135569B (zh) * 2019-12-20 2024-01-19 RealMe重庆移动通信有限公司 云游戏处理方法、装置、存储介质与电子设备
CN116457767A (zh) * 2020-11-09 2023-07-18 索尼集团公司 信息处理设备和通信方法

Family Cites Families (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5543853A (en) 1995-01-19 1996-08-06 At&T Corp. Encoder/decoder buffer control for variable bit-rate channel
US5933603A (en) * 1995-10-27 1999-08-03 Emc Corporation Video file server maintaining sliding windows of a video data set in random access memories of stream server computers for immediate video-on-demand service beginning at any specified location
US6806909B1 (en) * 1997-03-03 2004-10-19 Koninklijke Philips Electronics N.V. Seamless splicing of MPEG-2 multimedia data streams
US6021440A (en) * 1997-05-08 2000-02-01 International Business Machines Corporation Method and apparatus for coalescing and packetizing data
US6360271B1 (en) * 1999-02-02 2002-03-19 3Com Corporation System for dynamic jitter buffer management based on synchronized clocks
US6611624B1 (en) * 1998-03-13 2003-08-26 Cisco Systems, Inc. System and method for frame accurate splicing of compressed bitstreams
US6327275B1 (en) 1998-05-19 2001-12-04 General Instrument Corporation Remultiplexing variable rate bitstreams using a delay buffer and rate estimation
US6279041B1 (en) * 1998-11-13 2001-08-21 International Business Machines Corporation Methods, systems and computer program products for differencing data communications using a message queue
US6658469B1 (en) * 1998-12-18 2003-12-02 Microsoft Corporation Method and system for switching between network transport providers
US6263395B1 (en) * 1999-01-06 2001-07-17 Compaq Computer Corp. System and method for serial interrupt scanning
US6748481B1 (en) * 1999-04-06 2004-06-08 Microsoft Corporation Streaming information appliance with circular buffer for receiving and selectively reading blocks of streaming information
US6820144B2 (en) * 1999-04-06 2004-11-16 Microsoft Corporation Data format for a streaming information appliance
US6378035B1 (en) * 1999-04-06 2002-04-23 Microsoft Corporation Streaming information appliance with buffer read and write synchronization
US6564292B2 (en) * 2000-07-12 2003-05-13 Seagate Technology Llc Optimizing allocation of sectors in disc drives
AU2001295924A1 (en) * 2000-10-13 2002-04-22 Sony Corporation Radio communication system, transmission control apparatus and transmission control method
US7349691B2 (en) * 2001-07-03 2008-03-25 Microsoft Corporation System and apparatus for performing broadcast and localcast communications
EP1286502A1 (en) * 2001-08-22 2003-02-26 Thomson Licensing S.A. Method for managing network comprising a bridge between HAVi clusters
JP2003143152A (ja) * 2001-10-31 2003-05-16 Nippon Telegr & Teleph Corp <Ntt> 通信方法及びシステム、伝送装置、終端装置
JP3629008B2 (ja) * 2002-04-19 2005-03-16 松下電器産業株式会社 データ受信装置及びデータ配信システム
US7190670B2 (en) * 2002-10-04 2007-03-13 Nokia Corporation Method and apparatus for multimedia streaming in a limited bandwidth network with a bottleneck link
WO2004057817A2 (en) * 2002-12-19 2004-07-08 Koninklijke Philips Electronics N.V. Protecting real-time data in wireless networks
EP1579308A2 (en) * 2002-12-20 2005-09-28 Koninklijke Philips Electronics N.V. Power saving method for portable streaming devices
GB0300361D0 (en) * 2003-01-07 2003-02-05 Koninkl Philips Electronics Nv Audio-visual content transmission
US7246227B2 (en) * 2003-02-10 2007-07-17 Symantec Corporation Efficient scanning of stream based data
US7298741B2 (en) * 2003-02-27 2007-11-20 Sharp Laboratories Of America, Inc. Robust MPEG-2 multiplexing system and method using an adjustable time stamp
EP1465186A1 (en) * 2003-04-02 2004-10-06 Deutsche Thomson-Brandt Gmbh Method for buffering data streams read from an optical storage medium
US7680155B2 (en) 2003-08-14 2010-03-16 Zenith Electronics Llc PCR jitter reduction in a VSB and/or EVSB multiplexer system
ES2322271T3 (es) * 2003-12-03 2009-06-18 Koninklijke Philips Electronics N.V. Procedimiento y sistema de ahorro de energia.
US7668243B2 (en) * 2004-05-18 2010-02-23 Texas Instruments Incorporated Audio and video clock synchronization in a wireless network
JP2005333434A (ja) * 2004-05-20 2005-12-02 Matsushita Electric Ind Co Ltd 無線モジュール
US20060104356A1 (en) * 2004-11-15 2006-05-18 Microsoft Corporation Timing for decoder buffer examination
KR101227499B1 (ko) * 2006-04-28 2013-01-29 엘지전자 주식회사 디지털 방송 신호 수신 방법 및 장치
US20080133766A1 (en) * 2006-05-05 2008-06-05 Wenjun Luo Method and apparatus for streaming media to a plurality of adaptive client devices
KR100801002B1 (ko) * 2006-06-05 2008-02-11 삼성전자주식회사 무선 네트워크 상에서 멀티미디어 데이터를 전송/재생하는방법, 및 그 방법을 이용한 무선 기기
US20080069126A1 (en) * 2006-09-14 2008-03-20 Sbc Knowledge Ventures, L.P. Method and system for buffering content
US9135951B2 (en) * 2006-10-10 2015-09-15 Qualcomm Incorporated System and method for dynamic audio buffer management
US8341282B2 (en) 2006-11-21 2012-12-25 Verizon Patent And Licensing Inc. Hybrid buffer management
US8069260B2 (en) * 2007-01-12 2011-11-29 Microsoft Corporation Dynamic buffer settings for media playback
US8027560B2 (en) * 2007-02-05 2011-09-27 Thales Avionics, Inc. System and method for synchronizing playback of audio and video
JP2010021867A (ja) * 2008-07-11 2010-01-28 Sony Ericsson Mobilecommunications Japan Inc ストリーミング再生装置、ストリーミング配信再生システム、ストリーミング再生方法及びストリーミング再生プログラム
US8259794B2 (en) * 2008-08-27 2012-09-04 Alexander Bronstein Method and system for encoding order and frame type selection optimization
JPWO2010140199A1 (ja) 2009-06-01 2012-11-15 パナソニック株式会社 映像データの伝送方法
JP2011004163A (ja) * 2009-06-18 2011-01-06 Renesas Electronics Corp 送信装置
BR112012017687A2 (pt) * 2010-02-12 2016-04-05 Thomson Licensing método para reprodução de conteúdo sincronizado
US9420022B2 (en) * 2010-12-17 2016-08-16 Microsoft Technology Licensing, Llc Media requests to counter latency and minimize network bursts
US8983555B2 (en) 2011-01-07 2015-03-17 Microsoft Technology Licensing, Llc Wireless communication techniques
KR101917174B1 (ko) * 2012-02-24 2018-11-09 삼성전자주식회사 전자 장치 사이의 스트림 전송 방법 및 그 방법을 처리하는 전자 장치
US9167296B2 (en) * 2012-02-28 2015-10-20 Qualcomm Incorporated Customized playback at sink device in wireless display system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023068904A1 (ko) * 2021-10-22 2023-04-27 삼성전자 주식회사 전자 장치 및 전자 장치의 동작 방법

Also Published As

Publication number Publication date
WO2015034698A1 (en) 2015-03-12
US20150067186A1 (en) 2015-03-05
US9826015B2 (en) 2017-11-21
CN105556977A (zh) 2016-05-04
EP3042502A1 (en) 2016-07-13
JP2016537914A (ja) 2016-12-01

Similar Documents

Publication Publication Date Title
JP6382319B2 (ja) オーディオ／ビデオストリーミングのためのレイテンシバッファリングの動的および自動制御
US9648073B2 (en) Streaming control for real-time transport protocol
US10869081B2 (en) Image processing device, image reproduction device, and image reproduction system
US9491505B2 (en) Frame capture and buffering at source device in wireless display system
EP3087716B1 (en) Remote rendering for efficient use of wireless bandwidth for wireless docking
US10110393B2 (en) Protocol switching over multi-network interface
JP2018113696A (ja) マルチスクリーンサービスを用いたワイヤレスディスプレイ
KR20130135281A (ko) 무선 통신 기술
US10158690B2 (en) Method and system for streaming multimedia content in a wireless fidelity display network environment
CN107211186A (zh) 多视图流媒体服务支持方法以及用于支持该方法的装置
EP3281317B1 (en) Multi-layer timing synchronization framework
JP2021013049A (ja) データ送信装置、データ送信システム、及び、データ送信方法
KR102210407B1 (ko) 복수 통신망을 이용한 컨텐츠 전송 방법 및 장치
HK1180126A (en) Wireless communication techniques

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170726

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170726

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180411

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180417

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180529

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180703

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180801

R150 Certificate of patent or registration of utility model

Ref document number: 6382319

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees