WO2012013024A1 - Procédé et client pour un tampon de connexion multimédia en continu - Google Patents

Procédé et client pour un tampon de connexion multimédia en continu Download PDF

Info

Publication number
WO2012013024A1
WO2012013024A1 PCT/CN2011/070056 CN2011070056W WO2012013024A1 WO 2012013024 A1 WO2012013024 A1 WO 2012013024A1 CN 2011070056 W CN2011070056 W CN 2011070056W WO 2012013024 A1 WO2012013024 A1 WO 2012013024A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
data
unit
audio
processing unit
Prior art date
Application number
PCT/CN2011/070056
Other languages
English (en)
Chinese (zh)
Inventor
赵发杰
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012013024A1 publication Critical patent/WO2012013024A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/764—Media network packet handling at the destination 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump

Definitions

  • the present invention relates to the field of mobile streaming media technologies, and more particularly to a method and client for implementing streaming media connection buffering. Background technique
  • streaming media technology allows users to get to know the scenes around the world with an immersive feeling, for the continuity and smoothness of playback, each time the streaming media is started, the streaming client will have A longer data buffer wait time.
  • Figure 1 shows the flow chart of the existing streaming media client data processing. As shown in the figure, after the connection is successful, the streaming client will perform a period of data buffering before starting playback.
  • the object of the present invention is to provide a method and a client for implementing streaming media connection buffering, so as to improve the connection buffering speed of streaming media and enhance the user experience without changing the existing streaming media protocol standard.
  • a client that implements a streaming media connection buffer includes: a connection management unit, a protocol interaction and data receiving unit, a data buffer unit, a data processing unit, and a video adjustment unit;
  • the connection management unit is configured to support a client to establish a connection with a streaming media server, and the protocol interaction and data receiving unit is configured to exchange with a streaming media server by using a protocol and receive data sent by the server;
  • the data buffer unit is configured to buffer audio and video data
  • the data processing unit is configured to decode and process buffered audio and video data
  • the video adjustment unit is configured to adjust a video data processing speed of the control data processing unit to control a video playback speed.
  • the video adjustment unit is configured to:
  • the control data processing unit decodes the display, and in the case of insufficient data buffering, slows down the speed at which the data processing unit decodes the display so as to continuously play the video data.
  • the video adjustment unit is further configured to:
  • the data processing unit After buffering for 2-5 seconds, the data processing unit is controlled to process the video at a rate of 5-10 frames per second; after buffering for 5-10 seconds, the data processing unit is adjusted to play the video at the normal frame rate. ; and based on the video timestamp, the video frames that are out of sync with the audio time are discarded by interval, and the audio and video are played synchronously.
  • protocol interaction and data receiving unit When the protocol interaction and data receiving unit performs the interaction, it is used to:
  • the rtsp protocol interacts with the streaming server and receives data sent by the streaming server.
  • the data buffer unit includes an audio data buffer unit and a video data buffer unit;
  • the data processing unit includes an audio data processing unit and a video data processing unit;
  • the client further includes an output unit including an audio output unit and a video output a unit, the audio output unit is configured to output audio data; and the video output unit is configured to output video data.
  • a method for implementing streaming media connection buffering comprising:
  • the streaming media client establishes a connection with the server through the connection management unit, and starts receiving the streaming audio and video data through the protocol interaction and the data receiving unit; For the received audio data, the output is decoded by the audio processing unit to reduce the buffer waiting time; for the received video data, the video adjustment unit controls the decoding display of the video data to control the video playback speed.
  • the process of receiving the streaming audio and video data includes:
  • the streaming media client establishes a data link connection with the server and interacts with the server through the rtsp control protocol to start receiving data.
  • the process of outputting the audio data includes:
  • the streaming media client receives the audio data sent by the server to the audio data buffer; and decodes and outputs the data in the audio data buffer through the audio processing unit.
  • the process of controlling video playback speed includes:
  • the streaming media client receives the video data sent by the server to the video data buffer; the video adjustment unit controls the decoding display of the video data; in the case of insufficient data buffering, slows down the decoding speed of the video data, so as to continuously play the video Data; After the data buffer is normal, the video data is normally decoded and displayed.
  • the method further includes:
  • the video adjustment unit After buffering for 2-5 seconds, the video adjustment unit starts to control the video data at a rate of 5-10 frames per second; after buffering for 5-10 seconds, the video adjustment unit plays the video at the normal frame rate; The video timestamp shall prevail, and the video frames that are not synchronized with the audio time are discarded by the interval, and the audio and video are resumed and played synchronously.
  • the present invention utilizes the existing streaming media technology standards and hardware devices, and implements the improvement of the buffering speed of the streaming media connection through software technology modification.
  • the video adjusting unit in the present invention, the startup playing stream can be improved.
  • the speed of the media enhance the user experience.
  • FIG. 1 is a schematic diagram of a data processing flow of a streaming media client in the prior art
  • FIG. 2 is a schematic structural diagram of a client that implements streaming media connection buffering according to an embodiment of the present invention
  • FIG. 3 is a schematic flowchart of implementing streaming media connection buffering according to an embodiment of the present invention. detailed description
  • the invention improves the connection buffering speed of the streaming media and enhances the user experience by modifying the software technology of the streaming media client without changing the existing streaming media protocol standard.
  • the method for implementing streaming media connection buffering of the present invention mainly includes the following features:
  • the streaming media client establishes a connection with the server through the connection management unit, and starts receiving the streaming audio and video data through the protocol interaction and data receiving unit;
  • the streaming media client decodes the output through the audio processing unit for the received audio data, reducing the buffer waiting time
  • the streaming media client controls the video data processing unit to decode and display the received video data.
  • the video adjusting unit slows down the decoding and display speed of the video data processing unit.
  • the video adjustment unit of the streaming media client returns to normal, and the video data processing unit is controlled to normally decode and display.
  • FIG. 2 it is a schematic diagram of a client structure for implementing streaming media connection buffering according to an embodiment of the present invention, which includes: a connection management unit, a protocol interaction and data receiving unit, an audio data buffer unit, an audio data processing unit, and an audio output. Unit, video data buffer unit, video adjustment unit, video data processing unit, and video output unit.
  • connection management unit is configured to establish, by the streaming media client, a connection with the streaming media server;
  • protocol interaction and data receiving unit is configured to interact with the streaming media server by using the rtsp protocol, and receive data sent by the server;
  • the audio data buffer unit is configured to buffer protocol interaction and audio data received by the data receiving unit;
  • the audio data processing unit is configured to decode and process audio buffered by the audio data buffer unit Data
  • the audio output unit is configured to output audio data decoded by the audio data processing unit;
  • the video data buffer unit is configured to buffer protocol interaction and video data received by the data receiving unit;
  • the video adjustment unit is configured to adjust a processing speed of the video data processing unit to control a playback speed of the video frame;
  • the video data processing unit is configured to decode and process audio data buffered by the video data buffer unit;
  • the video output unit is configured to output video data decoded by the video data processing unit.
  • FIG. 3 it is a schematic diagram of a streaming media connection buffering process according to an embodiment of the present invention, which includes the following steps:
  • Step 301 The connection management unit, the streaming media client establishes a data link with the server;
  • Step 302 Start receiving data from the streaming media server by using the protocol interaction and the data receiving unit;
  • the protocol interaction and data receiving unit uses the data link established in step 301 to start receiving audio and video data from the server through the rtsp protocol interaction.
  • Step 303 The audio and video data buffer unit starts receiving buffer data.
  • the audio data buffering unit buffers the audio data received in step 302, and the video data buffering unit buffers the video data received in step 302.
  • Step 304 The audio data processing unit decodes the audio data.
  • the audio processing unit processes the audio data buffered in step 303, and after the audio buffer is 2 seconds, the audio data is processed by the audio processing unit;
  • Step 305 The video data processing unit is controlled by the video adjustment unit to perform decoding of the video data.
  • the video adjustment unit controls the video data processing unit from the video buffer in step 303
  • the data is taken for decoding; after 2-5 seconds of buffering, the video adjustment unit starts to control the video data processing unit to process the video at a rate of 5-10 frames per second, after buffering for 5-10 seconds, the video is adjusted.
  • the unit adjusts the video data processing unit to play the video at the normal frame rate, and the video time stamp is taken as the standard, and the audio and video that are not synchronized with the audio time are discarded by the interval, and the audio and video are resumed and played synchronously.
  • Step 306 The audio output unit and the video output unit start to output audio and video
  • the audio output unit outputs the data decoded by the audio processing unit in step 304, and the video output unit outputs step 305 to start the playback of the audio and video data by the video data decoded by the video data processing unit.
  • the invention utilizes the existing streaming media technology standards and hardware devices to improve the buffering speed of the streaming media connection.
  • Streaming media connection buffering speeds are compatible with existing streaming technologies and devices.
  • the increase of the buffering speed of the streaming media connection does not affect the normal streaming media playback function.
  • the video adjusting unit After the data buffering is normal, the video adjusting unit returns to normal, and the audio and video data is normally played and output.
  • the audio and video data when the streaming media is turned on, the audio and video data is rarely buffered, the audio output unit outputs the audio data in time, and the video adjusting unit slows down the processing speed of the video output unit video frame. Due to the delay of the human eye vision, the adjustment of the video adjustment unit does not make the user feel the delay of video playback. Therefore, the speed of the connection buffer after the streaming media is turned on can be significantly improved, and the user experience is enhanced.
  • the audio data buffer unit and the video data buffer unit may be collectively referred to as a data buffer unit; the audio data processing unit and the video data processing unit may be collectively referred to as a data processing unit; the audio output unit and Video output units can be collectively referred to as output units.
  • the present invention is convenient to implement, utilizes the existing streaming media technical standards and hardware devices, and realizes the improvement of the buffering speed of the streaming media connection through software technical transformation.
  • the video adjusting unit in the present invention the startup playing stream can be improved.
  • the speed of the media enhance the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente invention porte sur un procédé et un client pour un tampon de connexion multimédia en continu. Le client multimédia en continu établit la connexion avec un serveur au moyen d'une unité de gestion de connexion, et commence la réception des données audio/vidéo multimédia en continu par une interaction de protocole et une unité de réception de données; pour les données audio reçues, celles-ci sont décodées et émises au moyen d'une unité de traitement audio de façon à réduire le temps de latence de tampon; pour les données vidéo reçues, celles-ci sont décodées et affichées sous la commande d'une unité de régulation vidéo de façon à commander la vitesse de lecture vidéo. La présente invention est mise en œuvre de manière commode, utilise les critères techniques de multimédias en continu et le dispositif matériel existants, permet une amélioration de la vitesse de tampon de connexion multimédia en continu par l'innovation technologique logicielle, et améliore la vitesse du début de la lecture multimédia en continu par l'unité de régulation vidéo de la présente invention pour améliorer l'expérience d'utilisateur.
PCT/CN2011/070056 2010-07-28 2011-01-06 Procédé et client pour un tampon de connexion multimédia en continu WO2012013024A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010239837.3 2010-07-28
CN2010102398373A CN101917412A (zh) 2010-07-28 2010-07-28 一种提高流媒体连接缓冲速度的方法及客户端

Publications (1)

Publication Number Publication Date
WO2012013024A1 true WO2012013024A1 (fr) 2012-02-02

Family

ID=43324798

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/070056 WO2012013024A1 (fr) 2010-07-28 2011-01-06 Procédé et client pour un tampon de connexion multimédia en continu

Country Status (2)

Country Link
CN (1) CN101917412A (fr)
WO (1) WO2012013024A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9325765B2 (en) 2012-12-05 2016-04-26 Industrial Technology Research Institute Multimedia stream buffer and output method and multimedia stream buffer module

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101917412A (zh) * 2010-07-28 2010-12-15 中兴通讯股份有限公司 一种提高流媒体连接缓冲速度的方法及客户端
CN102176317B (zh) * 2011-01-14 2014-10-15 东软集团股份有限公司 用于实现旅客向导系统多屏播放帧级同步的方法及系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1601998A (zh) * 2003-09-27 2005-03-30 Lg电子株式会社 多媒体流服务系统和方法
CN101075949A (zh) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 一种改变流媒体文件播放速度的方法
CN101193269A (zh) * 2006-11-22 2008-06-04 中兴通讯股份有限公司 一种提高客户端vcr操作的响应速度的方法
US20090138614A1 (en) * 2007-11-28 2009-05-28 Motorola, Inc. Method and apparatus for streaming media in a communication network
CN101917412A (zh) * 2010-07-28 2010-12-15 中兴通讯股份有限公司 一种提高流媒体连接缓冲速度的方法及客户端

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101296158A (zh) * 2007-04-26 2008-10-29 深圳市同洲电子股份有限公司 一种流媒体数据传输方法及其数据传输装置
CN101583025B (zh) * 2009-06-11 2011-05-11 中兴通讯股份有限公司 一种流媒体播放方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1601998A (zh) * 2003-09-27 2005-03-30 Lg电子株式会社 多媒体流服务系统和方法
CN101075949A (zh) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 一种改变流媒体文件播放速度的方法
CN101193269A (zh) * 2006-11-22 2008-06-04 中兴通讯股份有限公司 一种提高客户端vcr操作的响应速度的方法
US20090138614A1 (en) * 2007-11-28 2009-05-28 Motorola, Inc. Method and apparatus for streaming media in a communication network
CN101917412A (zh) * 2010-07-28 2010-12-15 中兴通讯股份有限公司 一种提高流媒体连接缓冲速度的方法及客户端

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9325765B2 (en) 2012-12-05 2016-04-26 Industrial Technology Research Institute Multimedia stream buffer and output method and multimedia stream buffer module

Also Published As

Publication number Publication date
CN101917412A (zh) 2010-12-15

Similar Documents

Publication Publication Date Title
US11606597B2 (en) Devices, systems, and processes for facilitating live and recorded content watch parties
US10099129B2 (en) System and method for improving the graphics performance of hosted applications
US11516518B2 (en) Live streaming with live video production and commentary
CN102802075B (zh) 一种在线播放缓冲系统和方法
WO2020125153A1 (fr) Procédé de commande de lecture vidéo en réseau fluide reposant sur une technologie de diffusion multimédia en continu
WO2017096935A1 (fr) Procédé et serveur de commutation de canal rapide, et système iptv
JP2012521268A5 (fr)
US11758245B2 (en) Interactive media events
WO2011153868A1 (fr) Procédé, appareil et système pour la commutation de voies
TWI735476B (zh) 視聽接收裝置及其快速變換頻道之方法
WO2009039741A1 (fr) Procédé et dispositif permettant la commutation de chaînes iptv
WO2010094234A1 (fr) Procédé et appareil de commande de lecture de données audio / vidéo
WO2014054325A1 (fr) Dispositif de commande de codage et procédé de commande de codage
CN111372138A (zh) 一种播放器端的直播低延迟技术方案
US11471763B2 (en) System and method for improving the graphics performance of hosted applications
US20130166769A1 (en) Receiving device, screen frame transmission system and method
WO2009094841A1 (fr) Procédé pour le saut de chaîne rapide et continu dans un décodeur iptv
CN108810656A (zh) 一种实时直播ts流的去抖处理方法及处理系统
US20220394328A1 (en) Consolidated Watch Parties
CN114554277B (zh) 多媒体的处理方法、装置、服务器及计算机可读存储介质
WO2012013024A1 (fr) Procédé et client pour un tampon de connexion multimédia en continu
CN102413335A (zh) 一种手动调节节目音画同步的装置及方法
WO2013082750A1 (fr) Procédé et dispositif de transcodage en temps réel
US20220408140A1 (en) Moving image reproduction apparatus, moving image reproduction system, and moving image reproduction method
JP2023508945A (ja) 無線オーディオのビデオとの同期

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11811726

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11811726

Country of ref document: EP

Kind code of ref document: A1