CN105392023A - Video live broadcasting method and device in network jitter environment - Google Patents

Video live broadcasting method and device in network jitter environment Download PDF

Info

Publication number
CN105392023A
CN105392023A CN201510716762.6A CN201510716762A CN105392023A CN 105392023 A CN105392023 A CN 105392023A CN 201510716762 A CN201510716762 A CN 201510716762A CN 105392023 A CN105392023 A CN 105392023A
Authority
CN
China
Prior art keywords
video
capacity
threshold
playback speed
data packets
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510716762.6A
Other languages
Chinese (zh)
Other versions
CN105392023B (en
Inventor
陈建文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yinghua Hightech Co ltd
Original Assignee
Shenzhen Yunjuhui Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Yunjuhui Digital Technology Co Ltd filed Critical Shenzhen Yunjuhui Digital Technology Co Ltd
Priority to CN201510716762.6A priority Critical patent/CN105392023B/en
Publication of CN105392023A publication Critical patent/CN105392023A/en
Application granted granted Critical
Publication of CN105392023B publication Critical patent/CN105392023B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23406Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving management of server-side video buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64746Control signals issued by the network directed to the server or the client
    • H04N21/64761Control signals issued by the network directed to the server or the client directed to the server
    • H04N21/64769Control signals issued by the network directed to the server or the client directed to the server for rate control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/654Transmission by server directed to the client

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明涉及一种网络抖动环境下的视频直播方法及装置,其中的方法包括如下步骤:步骤S1,接收视频并存储于视频缓冲区;步骤S2,检测缓冲区中滞留数据包的容量;步骤S3,将滞留数据包的容量与预先设置的容量阈值进行比较,根据比较结果,调整视频播放速度。本发明通过在本地播放器端动态调整本地的播放速度来减小网络抖动对视频播放观看体验的负面影响,从而提升用户体验度。

The present invention relates to a video live broadcast method and device in a network jitter environment, wherein the method includes the following steps: step S1, receiving video and storing it in a video buffer; step S2, detecting the capacity of data packets remaining in the buffer; step S3 , compare the capacity of the remaining data packets with the preset capacity threshold, and adjust the video playback speed according to the comparison result. The present invention reduces the negative impact of network jitter on video playback and viewing experience by dynamically adjusting the local playback speed at the local player end, thereby improving user experience.

Description

一种网络抖动环境下的视频直播方法及装置Method and device for live video broadcasting under network jitter environment

技术领域: Technical field:

本发明属于网络视频播放领域,尤其涉及一种网络抖动环境下的视频直播方法及装置。 The invention belongs to the field of network video playback, and in particular relates to a video live broadcast method and device in a network jitter environment.

背景技术: Background technique:

随着互联网走进千家万户,网络视频直播成为人们喜闻乐见的一种在线沟通形式。不论是手机端还是电脑端,互联网的分享思维深入人心,网络直播的主题和内容异常丰富,形成视频直播需求量大面广的局面。 With the Internet entering thousands of households, online video broadcasting has become a form of online communication that people love to see. Regardless of whether it is a mobile phone or a computer, the idea of sharing on the Internet is deeply rooted in the hearts of the people, and the themes and contents of live webcasts are extremely rich, forming a situation where the demand for live video broadcasts is large and wide.

但现有的网络质量并不能总是满足网络视频直播的需求。网络质量不稳定的典型表现之一是网络抖动。网络抖动定义为网络中相邻数据包到达时延差异的最大绝对值。相邻数据包在时延上的差异反映了网络数据传输能力的波动。 However, the existing network quality cannot always meet the needs of online video live broadcast. One of the typical manifestations of unstable network quality is network jitter. Network jitter is defined as the maximum absolute value of the difference in the arrival delays of adjacent packets in the network. The difference in delay between adjacent data packets reflects the fluctuation of network data transmission capacity.

网络抖动是造成视频播放卡顿现象的原因之一。卡顿现象严重影响用户的观看体验。 Network jitter is one of the reasons for video playback stuttering. Caton phenomenon seriously affects the user's viewing experience.

互联网视频直播的过程可以简化为2个步骤:视频源通过互联网传输视频数据包到播放设备端;播放设备端接收视频并播放。在这个过程中,网络质量关系到视频数据包能否及时、无丢失(完整)地被传输到播放设备端。 The process of Internet video live broadcast can be simplified into two steps: the video source transmits video data packets to the playback device through the Internet; the playback device receives the video and plays it. In this process, the quality of the network is related to whether the video data packets can be transmitted to the playback device in a timely manner without loss (completely).

区别于文件上传下载对网络传输实时性的要求不高,视频直播需要较高的实时性,要求视频数据包按照特定的时间节拍准时到达播放设备端。如果数据包能够按时到达播放设备端,播放效果将是流畅的,不会出现卡顿现象。相反,如果数据包到达播放设备端的时间是不可预期的,则卡顿或者等待延时就是不可避免的。 Unlike file upload and download, which do not have high requirements for real-time network transmission, video live broadcast requires high real-time performance, requiring video data packets to reach the playback device on time according to a specific time beat. If the data packets can reach the playback device on time, the playback effect will be smooth and there will be no stuttering. On the contrary, if the time when the data packet arrives at the playback device is unpredictable, it is inevitable to freeze or wait for a delay.

相对于网络传输能力的不确定性,网络视频直播则通常采用固定速度来播放视频。波动的下行网络数据传输能力与本地稳定的数据处理能力难以得到较好的匹配。 Compared with the uncertainty of network transmission capacity, online video live broadcast usually uses a fixed speed to play video. It is difficult to get a good match between the fluctuating downlink network data transmission capacity and the local stable data processing capacity.

现有技术通常引入缓冲区来解决这个不匹配问题。借助缓冲器的数据滞留功能,减小网络传输能力波动对数据处理能力的影响。 Existing techniques usually introduce buffers to solve this mismatch problem. With the help of the data retention function of the buffer, the influence of the fluctuation of the network transmission capacity on the data processing capacity is reduced.

缓冲区可以缓存深度固定的静态缓存,也可以是缓存深度动态变化的动态缓存。 The buffer can be a static cache with a fixed cache depth, or a dynamic cache with a dynamically changing cache depth.

发明专利CN100373890C根据缓存队列中入队数据包和出队数据包的时间信息判断是否动态调整缓冲队列的缓存深度来解决网络抖动问题。 The invention patent CN100373890C judges whether to dynamically adjust the cache depth of the buffer queue according to the time information of the data packets entering the queue and the data packets leaving the queue in the cache queue to solve the problem of network jitter.

引入缓存深度动态变化的缓冲队列能够在一定程度上减小网络抖动对视频传输的影响,但动态缓存需要占用较多的存储资源,动态调整缓存深度会占用较多的计算资源,从时间和空间两个层面都增加了接收端的负担。 Introducing a buffer queue with dynamically changing cache depth can reduce the impact of network jitter on video transmission to a certain extent, but dynamic caching requires more storage resources, and dynamically adjusting the cache depth will occupy more computing resources. Both levels increase the burden on the receiving end.

发明内容: Invention content:

鉴于此,本发明旨在提出一种网络抖动环境下的视频直播方法及装置,通过在本地播放器端动态调整本地的播放速度来减小网络抖动对视频播放观看体验的负面影响,从而提升用户体验度。 In view of this, the present invention aims to propose a video live broadcast method and device in a network jitter environment, by dynamically adjusting the local playback speed on the local player side to reduce the negative impact of network jitter on video playback and viewing experience, thereby improving user experience. experience.

第一方面,本发明提出的视频直播方法包括如下步骤:步骤S1,接收视频并存储于视频缓冲区;步骤S2,检测缓冲区中滞留数据包的容量;步骤S3,将滞留数据包的容量与预先设置的容量阈值进行比较,根据比较结果,调整视频播放速度。 In the first aspect, the live video method proposed by the present invention includes the following steps: step S1, receiving video and storing it in the video buffer; step S2, detecting the capacity of the data packets remaining in the buffer; step S3, combining the capacity of the data packets remaining with The preset capacity threshold is compared, and the video playback speed is adjusted according to the comparison result.

进一步地,该视频直播方法步骤S3中的容量阈值包括第一阈值,若通过步骤S2获取的滞留数据包的容量小于所述第一阈值,则调整播放速度小于预先设定的正常播放速度。 Further, the capacity threshold in step S3 of the video live broadcast method includes a first threshold, and if the capacity of the retained data packets obtained in step S2 is smaller than the first threshold, the adjusted playback speed is lower than the preset normal playback speed.

进一步地,该视频直播方法步骤S3中的容量阈值还包括第二阈值,若通过步骤S2获取的滞留数据包的容量大于所述第二阈值,则调整播放速大于预先设定的正常播放速度。 Further, the capacity threshold in step S3 of the video live broadcast method further includes a second threshold, and if the capacity of the stranded data packets obtained in step S2 is greater than the second threshold, the adjusted playback speed is greater than the preset normal playback speed.

进一步地,该视频直播方法步骤S3中,若通过步骤S2获取的滞留数据包的容量小于第二阈值并且大于第一阈值,则调整播放速等于预先设定的正常播放速度。 Further, in step S3 of the video live broadcast method, if the capacity of the lingering data packets obtained in step S2 is smaller than the second threshold and larger than the first threshold, the adjusted playback speed is equal to the preset normal playback speed.

进一步地,该视频直播方法中预先设定的正常播放速度和视频缓冲区的容量根据播放设备的内存、用户请求的视频播放质量以及本地网络带宽等参数确定。 Further, the pre-set normal playback speed and the capacity of the video buffer in the video live broadcast method are determined according to parameters such as the memory of the playback device, the video playback quality requested by the user, and the local network bandwidth.

进一步地,该视频直播方法中滞留数据包容量根据缓冲区中进入数据、取出数据之差确定。 Further, in the video live broadcast method, the capacity of the retained data packets is determined according to the difference between the incoming data and the outgoing data in the buffer.

本发明的视频直播方法通过实时检测视频缓冲区中滞留的数据包容量,判断当前数据包的下行速度是否满足当前播放速度的需要。若检测到滞留数据包数量适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度匹配,用户能够流畅地观看视频直播;若检测到滞留数据包数量不适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度不匹配,若不主动采取另外的措施,则用户观看视频直播将会出卡顿现象。通过及时调整本地端播放设备的视频播放速度,改变从缓冲区中取出数据的量,从而控制滞留数据包数量保持在适当的数量,保证用户能够全程流畅地观看视频直播。因此,本发明通过在本地播放器端动态调整本地的播放速度来减小网络抖动对视频播放观看体验的负面影响,从而提升用户体验度。 The video live broadcast method of the present invention detects the capacity of the data packets remaining in the video buffer in real time, and judges whether the downlink speed of the current data packets satisfies the requirement of the current playback speed. If it is detected that the number of stranded data packets is appropriate, it indicates that the downlink speed of the network data matches the video playback speed of the local playback device, and the user can watch the live video smoothly; if the detected number of stranded data packets is inappropriate, it indicates that the network data is insufficient. The downlink speed does not match the video playback speed of the local playback device. If you do not actively take other measures, users will experience lag when watching live video. By timely adjusting the video playback speed of the local playback device and changing the amount of data taken out of the buffer, the number of stranded data packets is kept at an appropriate number to ensure that users can watch the live video smoothly throughout the process. Therefore, the present invention reduces the negative impact of network jitter on video playback and viewing experience by dynamically adjusting the local playback speed at the local player end, thereby improving user experience.

第二方面,本发明提出的视频直播装置包括:接收模块、实时容量检测模块及播放速度调整模块。其中,接收模块用于接收视频并将视频存储在视频缓冲区;实时容量检测模块,用于实时检测缓冲区中当前滞留数据包的容量;播放速度调整模块,用于将当前滞留数据包的容量与预先设置的容量阈值进行比较,根据比较结果,调整视频的当前播放速度。 In the second aspect, the live video device provided by the present invention includes: a receiving module, a real-time capacity detection module and a playback speed adjustment module. Wherein, the receiving module is used to receive the video and store the video in the video buffer; the real-time capacity detection module is used to detect the capacity of the currently stranded data packet in the buffer zone in real time; the playback speed adjustment module is used to convert the capacity of the currently stranded data packet Compare with the preset capacity threshold, and adjust the current playback speed of the video according to the comparison result.

进一步地,该视频直播装置涉及到的容量阈值包括第一阈值,该视频直播装置的速度调整模块包括第一播放单元。若通过实时容量检测模块获取的当前滞留数据包的容量小于第一阈值,则控制当前播放速度小于预先设定的正常播放速度。 Further, the capacity threshold involved in the live video device includes a first threshold, and the speed adjustment module of the live video device includes a first playback unit. If the capacity of the currently retained data packets acquired by the real-time capacity detection module is smaller than the first threshold, the current playback speed is controlled to be lower than the preset normal playback speed.

进一步地,该视频直播装置涉及到的第一阈值通过如下方式确定:令第一阈值为B,视频缓冲区的容量为A,则:B=A/2-A*(5%~10%)。 Further, the first threshold involved in the video live broadcast device is determined in the following manner: let the first threshold be B, and the capacity of the video buffer be A, then: B=A/2-A*(5%~10%) .

进一步地,该视频直播装置涉及到的容量阈值包括第二阈值,该视频直播装置的速度调整模块包括第二播放单元。若通过实时容量检测模块获取的当前滞留数据包的容量大于第二阈值,则控制当前播放速度大于预先设定的正常播放速度。 Further, the capacity threshold involved in the live video device includes a second threshold, and the speed adjustment module of the live video device includes a second playback unit. If the capacity of the currently retained data packets acquired by the real-time capacity detection module is greater than the second threshold, the current playback speed is controlled to be greater than the preset normal playback speed.

进一步地,该视频直播装置涉及到的第二阈值通过如下方式确定:令第二阈值为C,视频缓冲区的容量为A,则:C=A/2+A*(5%~10%)。 Further, the second threshold involved in the video live broadcast device is determined in the following manner: let the second threshold be C, and the capacity of the video buffer be A, then: C=A/2+A*(5%~10%) .

进一步地,该视频直播装置的速度调整模块还包括第三播放单元。若通过实时容量检测模块获取的滞留数据包的容量小于第二阈值并且大于第一阈值,则控制当前播放速等于预先设定的正常播放速度。 Further, the speed adjustment module of the video live broadcast device further includes a third playback unit. If the capacity of the retained data packets obtained by the real-time capacity detection module is less than the second threshold and greater than the first threshold, the current playback speed is controlled to be equal to the preset normal playback speed.

进一步地,该视频直播装置的正常播放速度和视频缓冲区的容量根据播放设备的内存、用户请求的视频播放质量以及本地网络带宽等参数确定。 Further, the normal playback speed and the capacity of the video buffer of the live video broadcast device are determined according to parameters such as the memory of the playback device, the video playback quality requested by the user, and the local network bandwidth.

进一步地,该视频直播装置涉及到的滞留数据包容量根据缓冲区中进入数据、取出数据之差确定。 Further, the retained data packet capacity involved in the video live broadcast device is determined according to the difference between incoming data and outgoing data in the buffer.

本发明的视频直播装置的实时容量检测模块通过实时检测视频缓冲区中滞留的数据包容量,判断当前数据包的下行速度是否满足当前播放速度的需要。若检测到滞留数据包数量适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度匹配,则播放速度调整模块保持当前的播放速度,用户能够流畅地观看视频直播;若实时容量检测模块检测到滞留数据包数量不适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度不匹配,若不主动采取另外的措施,则用户观看视频直播将会出卡顿现象。该视频直播装置的播放速度调整模块通过及时调整本地端播放设备的视频播放速度,改变从缓冲区中取出数据的量,从而控制滞留数据包数量保持在适当的数量,保证用户能够全程流畅地观看视频直播。因此,本发明的视频直播装置通过在本地播放器端动态调整本地的播放速度来减小网络抖动对视频播放观看体验的负面影响,从而提升用户体验度。 The real-time capacity detection module of the video live broadcast device of the present invention detects the capacity of the data packets retained in the video buffer in real time, and judges whether the downlink speed of the current data packets meets the requirement of the current playback speed. If it is detected that the number of stranded data packets is appropriate, it indicates that the downlink speed of the network data matches the video playback speed of the local playback device, and the playback speed adjustment module maintains the current playback speed, and the user can watch the live video smoothly; if the real-time capacity detection If the module detects that the number of stranded data packets is inappropriate, it indicates that the downlink speed of the network data does not match the video playback speed of the local playback device. If other measures are not taken actively, the user will freeze when watching live video. The playback speed adjustment module of the video live broadcast device adjusts the video playback speed of the local playback device in time to change the amount of data taken out from the buffer, thereby controlling the number of stranded data packets to remain at an appropriate number, ensuring that users can watch the whole process smoothly Live video. Therefore, the video live broadcast device of the present invention reduces the negative impact of network jitter on video playback and viewing experience by dynamically adjusting the local playback speed at the local player end, thereby improving user experience.

附图说明: Description of drawings:

图1为本发明视频直播方法实施例的流程图; Fig. 1 is the flow chart of the embodiment of video broadcasting method of the present invention;

图2为本发明视频直播方法实施例调整播放速度的流程图。 Fig. 2 is a flow chart of adjusting the playback speed of the embodiment of the live video broadcasting method of the present invention.

具体实施方式: detailed description:

下面通过具体的实施例进一步说明本发明,但是,应当理解为,这些发明仅仅是用于更详细具体地说明之用,而不应理解为用于以任何形式限制本发明。 The present invention will be further described below through specific examples, but it should be understood that these inventions are only used for more detailed description, and should not be construed as limiting the present invention in any form.

图1、图2是展示了本发明视频直播方法实施例的流程图。如图1所示,本发明视频直播方法的实施例包括如下步骤:步骤S1,接收视频并存储于视频缓冲区;步骤S2,实时检测所述缓冲区中当前数据包的容量;步骤S3,将当前数据包的容量与预先设置的容量阈值进行比较,若通过所述步骤S2获取的当前数据包的容量小于所述第一阈值,则调整所述当前播放速度小于预先设定的正常播放速度;若通过所述步骤S2获取的当前数据包的容量大于所述第二阈值,则:调整所述当前播放速大于预先设定的正常播放速度。 Fig. 1 and Fig. 2 are flow charts showing an embodiment of the live video broadcasting method of the present invention. As shown in Figure 1, the embodiment of the video broadcasting method of the present invention comprises the following steps: Step S1, receive video and store in video buffer; Step S2, detect the capacity of current data packet in the buffer in real time; Step S3, put The capacity of the current data packet is compared with the preset capacity threshold, if the capacity of the current data packet acquired by the step S2 is less than the first threshold, then adjust the current playback speed to be less than the preset normal playback speed; If the capacity of the current data packet obtained through the step S2 is greater than the second threshold, then: adjust the current playback speed to be greater than a preset normal playback speed.

令第一阈值为B,所述视频缓冲区的容量为A,则: Let the first threshold be B, and the capacity of the video buffer is A, then:

B=A/2-A*(5%~10%)。令所述第二阈值为C,则: B=A/2-A*(5%~10%). Let the second threshold be C, then:

C=A/2+A*(5%~10%)。 C=A/2+A*(5%~10%).

预先设定的正常播放速度根据如下参数确定:播放设备的内存、用户请求的视频播放质量以及本地网络带宽。 The preset normal playback speed is determined according to the following parameters: memory of the playback device, video playback quality requested by the user, and local network bandwidth.

本发明的视频直播方法通过实时检测视频缓冲区中滞留的数据包容量,判断当前数据包的下行速度是否满足当前播放速度的需要。若检测到滞留数据包数量适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度匹配,用户能够流畅地观看视频直播;若检测到滞留数据包数量不适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度不匹配,若不主动采取另外的措施,则用户观看视频直播将会出卡顿现象。通过及时调整本地端播放设备的视频播放速度,改变从缓冲区中取出数据的量,从而控制滞留数据包数量保持在适当的数量,保证用户能够全程流畅地观看视频直播。因此,本发明通过在本地播放器端动态调整本地的播放速度来减小网络抖动对视频播放观看体验的负面影响,从而提升用户体验度。 The video live broadcast method of the present invention detects the capacity of the data packets remaining in the video buffer in real time, and judges whether the downlink speed of the current data packets satisfies the requirement of the current playback speed. If it is detected that the number of stranded data packets is appropriate, it indicates that the downlink speed of the network data matches the video playback speed of the local playback device, and the user can watch the live video smoothly; if the detected number of stranded data packets is inappropriate, it indicates that the network data is insufficient. The downlink speed does not match the video playback speed of the local playback device. If you do not actively take other measures, users will experience lag when watching live video. By timely adjusting the video playback speed of the local playback device and changing the amount of data taken out of the buffer, the number of stranded data packets is kept at an appropriate number to ensure that users can watch the live video smoothly throughout the process. Therefore, the present invention reduces the negative impact of network jitter on video playback and viewing experience by dynamically adjusting the local playback speed at the local player end, thereby improving user experience.

本发明的视频直播装置实施例包括:接收模块、实时容量检测模块及播放速度调整模块。其中,接收模块用于接收视频并将视频存储在视频缓冲区;实时容量检测模块,用于实时检测缓冲区中当前滞留数据包的容量;播放速度调整模块,用于将当前滞留数据包的容量与预先设置的容量阈值进行比较,根据比较结果,调整视频的当前播放速度。 The embodiment of the live video device of the present invention includes: a receiving module, a real-time capacity detection module and a playback speed adjustment module. Wherein, the receiving module is used to receive the video and store the video in the video buffer; the real-time capacity detection module is used to detect the capacity of the currently stranded data packet in the buffer zone in real time; the playback speed adjustment module is used to convert the capacity of the currently stranded data packet Compare with the preset capacity threshold, and adjust the current playback speed of the video according to the comparison result.

该视频直播装置涉及到的容量阈值包括第一阈值,该视频直播装置的速度调整模块包括第一播放单元。若通过实时容量检测模块获取的当前滞留数据包的容量小于第一阈值,则控制当前播放速度小于预先设定的正常播放速度。其中,第一阈值通过如下方式确定:令第一阈值为B,视频缓冲区的容量为A,则:B=A/2-A*(5%~10%)。 The capacity threshold involved in the live video device includes a first threshold, and the speed adjustment module of the live video device includes a first playback unit. If the capacity of the currently retained data packets acquired by the real-time capacity detection module is smaller than the first threshold, the current playback speed is controlled to be lower than the preset normal playback speed. Wherein, the first threshold is determined in the following manner: let the first threshold be B, and the capacity of the video buffer be A, then: B=A/2-A*(5%˜10%).

该视频直播装置涉及到的容量阈值包括第二阈值,该视频直播装置的速度调整模块包括第二播放单元。若通过实时容量检测模块获取的当前滞留数据包的容量大于第二阈值,则控制当前播放速度大于预先设定的正常播放速度。其中,第二阈值通过如下方式确定:令第二阈值为C,视频缓冲区的容量为A,则:C=A/2+A*(5%~10%)。 The capacity threshold involved in the live video device includes a second threshold, and the speed adjustment module of the live video device includes a second playback unit. If the capacity of the currently retained data packets acquired by the real-time capacity detection module is greater than the second threshold, the current playback speed is controlled to be greater than the preset normal playback speed. Wherein, the second threshold is determined in the following manner: let the second threshold be C, and the capacity of the video buffer be A, then: C=A/2+A*(5%˜10%).

该视频直播装置的速度调整模块还包括第三播放单元。若通过实时容量检测模块获取的滞留数据包的容量小于第二阈值并且大于第一阈值,则控制当前播放速等于预先设定的正常播放速度。 The speed adjustment module of the video live broadcast device also includes a third playback unit. If the capacity of the retained data packets obtained by the real-time capacity detection module is less than the second threshold and greater than the first threshold, the current playback speed is controlled to be equal to the preset normal playback speed.

该视频直播装置的正常播放速度和视频缓冲区的容量根据播放设备的内存、用户请求的视频播放质量以及本地网络带宽等参数确定。 The normal playback speed of the live video device and the capacity of the video buffer are determined according to parameters such as the memory of the playback device, the video playback quality requested by the user, and the local network bandwidth.

该视频直播装置涉及到的滞留数据包容量根据缓冲区中进入数据、取出数据之差确定。 The retained data packet capacity involved in the video live broadcast device is determined according to the difference between incoming data and outgoing data in the buffer.

本发明的视频直播装置的实时容量检测模块通过实时检测视频缓冲区中滞留的数据包容量,判断当前数据包的下行速度是否满足当前播放速度的需要。若检测到滞留数据包数量适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度匹配,则播放速度调整模块保持当前的播放速度,用户能够流畅地观看视频直播;若实时容量检测模块检测到滞留数据包数量不适当,则表明网络数据的下行速度与本地端播放设备的视频播放速度不匹配,若不主动采取另外的措施,则用户观看视频直播将会出卡顿现象。该视频直播装置的播放速度调整模块通过及时调整本地端播放设备的视频播放速度,改变从缓冲区中取出数据的量,从而控制滞留数据包数量保持在适当的数量,保证用户能够全程流畅地观看视频直播。因此,本发明的视频直播装置通过在本地播放器端动态调整本地的播放速度来减小网络抖动对视频播放观看体验的负面影响,从而提升用户体验度。 The real-time capacity detection module of the video live broadcast device of the present invention detects the capacity of the data packets retained in the video buffer in real time, and judges whether the downlink speed of the current data packets meets the requirement of the current playback speed. If it is detected that the number of stranded data packets is appropriate, it indicates that the downlink speed of the network data matches the video playback speed of the local playback device, and the playback speed adjustment module maintains the current playback speed, and the user can watch the live video smoothly; if the real-time capacity detection If the module detects that the number of stranded data packets is inappropriate, it indicates that the downlink speed of the network data does not match the video playback speed of the local playback device. If other measures are not taken actively, the user will freeze when watching live video. The playback speed adjustment module of the video live broadcast device adjusts the video playback speed of the local playback device in time to change the amount of data taken out from the buffer, thereby controlling the number of stranded data packets to remain at an appropriate number, ensuring that users can watch the whole process smoothly Live video. Therefore, the video live broadcast device of the present invention reduces the negative impact of network jitter on video playback and viewing experience by dynamically adjusting the local playback speed at the local player end, thereby improving user experience.

尽管本发明已进行了一定程度的描述,明显地,在不脱离本发明的精神和范围的条件下,可进行各个条件的适当变化。可以理解,本发明不限于所述实施方案,而归于权利要求的范围,其包括所述每个因素的等同替换。 While the invention has been described to a certain extent, it will be obvious that various changes may be made in various conditions without departing from the spirit and scope of the invention. It is to be understood that the invention is not limited to the described embodiments, but rather falls within the scope of the claims, which include equivalents to each of the elements described.

Claims (8)

1.一种网络抖动环境下的视频直播方法,其特征在于,包括如下步骤:1. a live video method under network jitter environment, is characterized in that, comprises the steps: 步骤S1,接收视频并存储于视频缓冲区;Step S1, receiving the video and storing it in the video buffer; 步骤S2,检测所述缓冲区中滞留数据包的容量;Step S2, detecting the capacity of data packets remaining in the buffer; 步骤S3,将滞留数据包的容量与预先设置的容量阈值进行比较,根据比较结果,调整视频播放速度。Step S3, comparing the capacity of the remaining data packets with a preset capacity threshold, and adjusting the video playback speed according to the comparison result. 2.根据权利要求1所述的视频直播方法,其特征在于,2. The video live broadcast method according to claim 1, characterized in that, 所述步骤S3中,所述容量阈值包括第一阈值;In the step S3, the capacity threshold includes a first threshold; 若通过所述步骤S2获取的滞留数据包的容量小于所述第一阈值,则:调整所述播放速度小于预先设定的正常播放速度。If the capacity of the lingering data packets obtained through the step S2 is smaller than the first threshold, then: adjust the playback speed to be lower than a preset normal playback speed. 3.根据权利要求2所述的视频直播方法,其特征在于,3. The video live broadcast method according to claim 2, characterized in that, 所述步骤S3中,所述容量阈值还包括第二阈值;In the step S3, the capacity threshold further includes a second threshold; 若通过所述步骤S2获取的滞留数据包的容量大于所述第二阈值,则:调整所述播放速大于预先设定的正常播放速度。If the capacity of the lingering data packets obtained through the step S2 is greater than the second threshold, then: adjust the playback speed to be greater than a preset normal playback speed. 4.根据权利要求3所述的视频直播方法,其特征在于,4. The video live broadcast method according to claim 3, characterized in that, 所述步骤S3中,若通过所述步骤S2获取的滞留数据包的容量小于所述第二阈值并且大于所述第一阈值,则:In the step S3, if the capacity of the stranded data packets acquired through the step S2 is less than the second threshold and greater than the first threshold, then: 调整所述播放速等于预先设定的正常播放速度。The playback speed is adjusted to be equal to a preset normal playback speed. 5.根据权利要求2至4中任一权利要求所述的视频直播方法,其特征在于,所述预先设定的正常播放速度根据如下参数确定:播放设备的内存、用户请求的视频播放质量以及本地网络带宽。5. The video live broadcast method according to any one of claims 2 to 4, wherein the preset normal playback speed is determined according to the following parameters: the memory of the playback device, the video playback quality requested by the user, and Local network bandwidth. 6.根据权利要求1至4中任一权利要求所述的视频直播方法,其特征在于,所述的视频缓冲区的容量根据如下参数确定:6. according to the video live broadcast method described in any one of claims 1 to 4, it is characterized in that, the capacity of described video buffer is determined according to the following parameters: 播放设备的内存、用户请求的视频播放质量以及本地网络带宽。The memory of the playback device, the quality of video playback requested by the user, and the bandwidth of the local network. 7.根据权利要求1至4中任一权利要求所述的视频直播方法,其特征在于,所述的滞留数据包容量根据缓冲区中进入数据、取出数据之差确定。7. The video live broadcast method according to any one of claims 1 to 4, characterized in that, the capacity of the retained data packets is determined according to the difference between incoming data and outgoing data in the buffer. 8.一种网络抖动环境下的视频直播装置,其特征在于,包括:8. A live video device under a network jitter environment, characterized in that it comprises: 接收模块,用于接收视频并将视频存储在视频缓冲区;The receiving module is used to receive the video and store the video in the video buffer; 实时容量检测模块,用于实时检测所述缓冲区中当前滞留数据包的容量;A real-time capacity detection module, configured to detect in real time the capacity of the currently stranded data packets in the buffer; 播放速度调整模块,用于将当前滞留数据包的容量与预先设置的容量阈值进行比较,根据比较结果,调整视频的当前播放速度。The playback speed adjustment module is used to compare the capacity of the currently retained data packets with a preset capacity threshold, and adjust the current playback speed of the video according to the comparison result.
CN201510716762.6A 2015-10-29 2015-10-29 A kind of video live broadcast method and device under network jitter environment Active CN105392023B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510716762.6A CN105392023B (en) 2015-10-29 2015-10-29 A kind of video live broadcast method and device under network jitter environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510716762.6A CN105392023B (en) 2015-10-29 2015-10-29 A kind of video live broadcast method and device under network jitter environment

Publications (2)

Publication Number Publication Date
CN105392023A true CN105392023A (en) 2016-03-09
CN105392023B CN105392023B (en) 2019-04-26

Family

ID=55423787

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510716762.6A Active CN105392023B (en) 2015-10-29 2015-10-29 A kind of video live broadcast method and device under network jitter environment

Country Status (1)

Country Link
CN (1) CN105392023B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107347065A (en) * 2017-06-29 2017-11-14 上海鋆创信息技术有限公司 A kind of data push method and device, a kind of terminal and storage medium
CN108810656A (en) * 2018-06-12 2018-11-13 深圳国微视安科技有限公司 A kind of the debounce processing method and processing system of real-time live broadcast TS streams
CN108965807A (en) * 2018-07-17 2018-12-07 深圳市共进电子股份有限公司 Control method for playing back, device, terminal and the storage medium of real-time video
CN109168083A (en) * 2018-10-23 2019-01-08 青岛海信电器股份有限公司 A kind of Streaming Media real time playing method and device
CN110536153A (en) * 2018-05-23 2019-12-03 视联动力信息技术股份有限公司 A kind of playback method and server of video data
CN111294634A (en) * 2020-02-27 2020-06-16 腾讯科技(深圳)有限公司 Live broadcast method, device, system, equipment and computer readable storage medium
CN112822502A (en) * 2020-12-28 2021-05-18 阿里巴巴(中国)有限公司 Live broadcast jitter removal intelligent caching and live broadcast method, equipment and storage medium
CN112911377A (en) * 2021-02-01 2021-06-04 华录智达科技股份有限公司 System and algorithm for adapting video playing and cache

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101466034A (en) * 2008-12-25 2009-06-24 华为技术有限公司 Method and device for sending and playing stream medium data and stream medium program request system
CN101583025A (en) * 2009-06-11 2009-11-18 中兴通讯股份有限公司 Streaming media playing method and device
CN101662676A (en) * 2009-09-30 2010-03-03 四川长虹电器股份有限公司 Processing method for streaming media buffer
CN102185835A (en) * 2011-04-14 2011-09-14 广东威创视讯科技股份有限公司 Real-time network signal playing method and device
CN103152651A (en) * 2013-01-31 2013-06-12 广东欧珀移动通信有限公司 Method and system of automatically adjusting play threshold of streaming media buffering area

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101466034A (en) * 2008-12-25 2009-06-24 华为技术有限公司 Method and device for sending and playing stream medium data and stream medium program request system
CN101583025A (en) * 2009-06-11 2009-11-18 中兴通讯股份有限公司 Streaming media playing method and device
CN101662676A (en) * 2009-09-30 2010-03-03 四川长虹电器股份有限公司 Processing method for streaming media buffer
CN102185835A (en) * 2011-04-14 2011-09-14 广东威创视讯科技股份有限公司 Real-time network signal playing method and device
CN103152651A (en) * 2013-01-31 2013-06-12 广东欧珀移动通信有限公司 Method and system of automatically adjusting play threshold of streaming media buffering area

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107347065A (en) * 2017-06-29 2017-11-14 上海鋆创信息技术有限公司 A kind of data push method and device, a kind of terminal and storage medium
CN110536153A (en) * 2018-05-23 2019-12-03 视联动力信息技术股份有限公司 A kind of playback method and server of video data
CN108810656A (en) * 2018-06-12 2018-11-13 深圳国微视安科技有限公司 A kind of the debounce processing method and processing system of real-time live broadcast TS streams
CN108965807A (en) * 2018-07-17 2018-12-07 深圳市共进电子股份有限公司 Control method for playing back, device, terminal and the storage medium of real-time video
CN109168083A (en) * 2018-10-23 2019-01-08 青岛海信电器股份有限公司 A kind of Streaming Media real time playing method and device
CN109168083B (en) * 2018-10-23 2021-05-28 海信视像科技股份有限公司 Streaming media real-time playing method and device
CN111294634A (en) * 2020-02-27 2020-06-16 腾讯科技(深圳)有限公司 Live broadcast method, device, system, equipment and computer readable storage medium
CN111294634B (en) * 2020-02-27 2022-02-18 腾讯科技(深圳)有限公司 Live broadcast method, device, system, equipment and computer readable storage medium
CN112822502A (en) * 2020-12-28 2021-05-18 阿里巴巴(中国)有限公司 Live broadcast jitter removal intelligent caching and live broadcast method, equipment and storage medium
CN112911377A (en) * 2021-02-01 2021-06-04 华录智达科技股份有限公司 System and algorithm for adapting video playing and cache
CN112911377B (en) * 2021-02-01 2022-10-21 华录智达科技股份有限公司 A system and algorithm for adaptation between video playback and buffering

Also Published As

Publication number Publication date
CN105392023B (en) 2019-04-26

Similar Documents

Publication Publication Date Title
CN105392023A (en) Video live broadcasting method and device in network jitter environment
US10200432B2 (en) HTTP streaming client adaptation algorithm based on proportional-integral control
US12284410B2 (en) Facilitating watch parties
US10652165B2 (en) Merging multicast ABR and unicast ABR with progressive download ABR in a customer premises device within the same video delivery pipe
US8973067B2 (en) Methods and apparatus for managing network resources used by multimedia streams in a virtual pipe
CN105376607A (en) Live video method and device in network jittering environment
US8402158B2 (en) Adaptive variable fidelity media distribution system and method
CA2888218C (en) Playback stall avoidance in adaptive media streaming
JP5421346B2 (en) High-speed transmission method and apparatus for unicast stream in high-speed channel change
CN105578211B (en) Live streaming based on unlimited service node accelerates network interim card optimization method and system
CN104935958B (en) A kind of real-time video transmission device
TW201521394A (en) Method for distributing available bandwidth of a network amongst ongoing traffic sessions run by devices of the network, corresponding device
Evensen et al. Using bandwidth aggregation to improve the performance of quality-adaptive streaming
CN108200470A (en) A kind of video code rate method of adjustment and equipment
JP2007312051A (en) Set top box
CN105245946B (en) Method, device and system for controlling flow of variable-code-rate media stream
Kennedy et al. Household bandwidth and the'need for speed': evaluating the impact of active queue management for home internet traffic
KR100556748B1 (en) How to manage dynamic buffers of streaming data
CN106713316B (en) Method for acquiring streaming media service transmission resource requirement based on receiving buffer
Hu et al. Scene aware smooth playout control for portable media players over random VBR channels
Zhang et al. Adaptive streaming media VOD system under the background of new media
Bojarzadeh Adaptive Algorithm for Video Streaming over Wireless Networks

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180123

Address after: 100000 floor 2, unit 3, floor No. 1, Futong East Street, Chaoyang District, Beijing

Applicant after: Beijing Yi Yun cloud Technology Co.,Ltd.

Address before: 518057 Guangdong, Shenzhen, Nanshan District science and technology in the road Software Park, two, 11, two B306

Applicant before: SHENZHEN YUNJUHUI DIGITAL CO.,LTD.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180201

Address after: 100102 floor 2, unit 3, building No. 2, Futong East Street, Chaoyang District, Beijing, 121806

Applicant after: Beijing Yi Yun cloud Technology Co.,Ltd.

Address before: 518057 Guangdong, Shenzhen, Nanshan District science and technology in the road Software Park, two, 11, two B306

Applicant before: SHENZHEN YUNJUHUI DIGITAL CO.,LTD.

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20211118

Address after: Room 1125, 1f, building 9, No. 66, East Tiantan Road, Dongcheng District, Beijing 100010

Patentee after: YINGHUA HIGHTECH Co.,Ltd.

Address before: 100102 121806, 15 / F, unit 2, building 3, yard 1, Futong East Street, Chaoyang District, Beijing

Patentee before: Beijing Yi Yun cloud Technology Co.,Ltd.

CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: Room 2093, South Floor, Building 1, No. 55 Tiantan Road, Dongcheng District, Beijing 100010

Patentee after: YINGHUA HIGHTECH Co.,Ltd.

Country or region after: China

Address before: Room 1125, 1f, building 9, No. 66, East Tiantan Road, Dongcheng District, Beijing 100010

Patentee before: YINGHUA HIGHTECH Co.,Ltd.

Country or region before: China

CP03 Change of name, title or address

Address after: 100000 Room 1204, 12th Floor, No. 67 West Beisihuan Road, Haidian District, Beijing

Patentee after: YINGHUA HIGHTECH Co.,Ltd.

Country or region after: China

Address before: Room 2093, South Floor, Building 1, No. 55 Tiantan Road, Dongcheng District, Beijing 100010

Patentee before: YINGHUA HIGHTECH Co.,Ltd.

Country or region before: China