CN108282689A - 一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法 - Google Patents

一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法 Download PDF

Info

Publication number
CN108282689A
CN108282689A CN201711288910.4A CN201711288910A CN108282689A CN 108282689 A CN108282689 A CN 108282689A CN 201711288910 A CN201711288910 A CN 201711288910A CN 108282689 A CN108282689 A CN 108282689A
Authority
CN
China
Prior art keywords
network
accomplished
playing
delay
network jitter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711288910.4A
Other languages
English (en)
Inventor
周仁东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Electronic Polytron Technologies Inc
Original Assignee
Shanghai Electronic Polytron Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Electronic Polytron Technologies Inc filed Critical Shanghai Electronic Polytron Technologies Inc
Priority to CN201711288910.4A priority Critical patent/CN108282689A/zh
Publication of CN108282689A publication Critical patent/CN108282689A/zh
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4392—Processing of audio elementary streams involving audio buffer management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

本发明涉及一种互联网视频监控实时播放在网络条件不理想的情况下获得最优播放效果的方法，特别是针对非常普遍的网络抖动频繁情况。一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法，其步骤如下：S1：音视频数据到达，时间戳和系统事件输入到网络延时统计模块；S2：播放器查询网络延时统计模块决定当前播放模式为快速播放还是正常播放；以动态调节控制模块控制；S3：快速播放/正常播放。

Description

一种互联网监控在网络抖动下做到最小延时并能流畅播放的 方法
技术领域
本发明涉及一种互联网视频监控实时播放在网络条件不理想的情况下获得最优播放效果的方法，特别是针对非常普遍的网络抖动频繁情况。
背景技术
互联网视频监控播放有如下特点：1，实时性，音视频数据是实时传送的；2，受网络条件影响很大，在网络慢的情况下，音视频数据会延时送达，在网络恢复的情况下又会把过期的音视频数据补送到达。基于以上特点，在网络条件不理想的情况下，特别是在共享网络、移动网络，经常会出现播放卡顿，快进等影响用户体验的现象。有的播放器为了满足流畅播放，缓冲了部分数据，引起较大的延时，导致监控实时性不高，影响用户监控安全的需求。看视频是互联网监控最重要的功能，所以良好的播放体验一定是用户最关心的。针对这个需求，本发明提出一种基于数据统计，视觉效果，听觉效果，自动调节算法实现的最优播放效果方法。
发明内容
本发明的目的是提出一种新的播放器处理方法，具有在音视频数据获取速度不均匀情况下，低延时，流畅播放的特点。
一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法，其步骤如下：
S1：音视频数据到达，时间戳和系统事件输入到网络延时统计模块；
S2：播放器查询网络延时统计模块决定当前播放模式为快速播放还是正常播放；以动态调节控制模块控制；
S3：快速播放/正常播放。
进一步的，所述网络延时统计模块是统计之前网络的最大延时，平均延时，延时发生概率。输入音视频的时间戳和实际到达的系统事件，从而得到延时的数据。
进一步的，所述播放模块是用户无感知快速播放模块：采用视频倍数播放模块；视频用1.2倍数播放，让用户基本无感知。
进一步的，所述播放模块是音频倍数播放模块；音频根据算法将PCM波形样本数据压缩，从而达到声音频率变高，但声音内容无丢失，无啸叫效果，用户能清晰地听到原始声音。
进一步的，所述动态调节控制模块是根据网络延时统计模块决定是否要进入或退出快速播放模式。一旦侦测到有网络抖动，则自然慢放，等到过期音视频数据到达时，如果网络延时变小，也就是网络恢复，判断当前数据缓冲区中是否在满足流畅播放的情况下还有富余，如有，则启动快速播放模式。快速播放模式终止的判断条件非常重要，必须根据之前的网络延时保证流畅播放所需的缓冲数据。
有益效果：本方法采用数据统计，视觉效果，听觉效果，自动调节算法做到了在满足流畅播放的前提下最接近实时，而且在切换播放模式的过程中做到用户基本无感知。
附图说明
图1是一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法的流程图。
具体实施方式
应用实例：
如1所示，一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法，其步骤如下：
S1：音视频数据到达，时间戳和系统事件输入到网络延时统计模块；
S2：播放器查询网络延时统计模块决定当前播放模式为快速播放还是正常播放；以动态调节控制模块控制；
S3：快速播放/正常播放。
所述网络延时统计模块是统计之前网络的最大延时，平均延时，延时发生概率。输入音视频的时间戳和实际到达的系统事件，从而得到延时的数据。
所述播放模块是用户无感知快速播放模块：采用视频倍数播放模块；视频用1.2倍数播放，让用户基本无感知。
所述播放模块是音频倍数播放模块；音频根据算法将PCM波形样本数据压缩，从而达到声音频率变高，但声音内容无丢失，无啸叫效果，用户能清晰地听到原始声音。
所述动态调节控制模块是根据网络延时统计模块决定是否要进入或退出快速播放模式。一旦侦测到有网络抖动，则自然慢放，等到过期音视频数据到达时，如果网络延时变小，也就是网络恢复，判断当前数据缓冲区中是否在满足流畅播放的情况下还有富余，如有，则启动快速播放模式。快速播放模式终止的判断条件非常重要，必须根据之前的网络延时保证流畅播放所需的缓冲数据。
采用本发明的视频监控播放器，在和同行业其他播放器相比，取得了卓越的播放体验。

Claims (1)

1.一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法，其步骤如下：
S1：音视频数据到达，时间戳和系统事件输入到网络延时统计模块；
S2：播放器查询网络延时统计模块决定当前播放模式为快速播放还是正常播放；以动态调节控制模块控制；
S3：快速播放/正常播放。
CN201711288910.4A 2017-12-07 2017-12-07 一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法 Pending CN108282689A (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711288910.4A CN108282689A (zh) 2017-12-07 2017-12-07 一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711288910.4A CN108282689A (zh) 2017-12-07 2017-12-07 一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法

Publications (1)

Publication Number Publication Date
CN108282689A true CN108282689A (zh) 2018-07-13

Family

ID=62801366

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711288910.4A Pending CN108282689A (zh) 2017-12-07 2017-12-07 一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法

Country Status (1)

Country Link
CN (1) CN108282689A (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108966028A (zh) * 2018-08-17 2018-12-07 上海悠络客电子科技股份有限公司 一种基于网络状况动态调节播放速度的防抖动方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7577980B2 (en) * 2006-01-19 2009-08-18 International Business Machines Corporation Bit-rate constrained trick play through stream switching and adaptive streaming
CN101583025A (zh) * 2009-06-11 2009-11-18 中兴通讯股份有限公司 一种流媒体播放方法及装置
CN102271280A (zh) * 2011-07-20 2011-12-07 宝利微电子系统控股公司 一种数字音视频变速播放的方法和装置
CN103475927A (zh) * 2012-06-08 2013-12-25 腾讯科技（深圳）有限公司 在线视频实时变速播放方法及系统
CN103916716A (zh) * 2013-01-08 2014-07-09 北京信威通信技术股份有限公司 一种无线网络下视频实时传输的码率平滑方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7577980B2 (en) * 2006-01-19 2009-08-18 International Business Machines Corporation Bit-rate constrained trick play through stream switching and adaptive streaming
CN101583025A (zh) * 2009-06-11 2009-11-18 中兴通讯股份有限公司 一种流媒体播放方法及装置
CN102271280A (zh) * 2011-07-20 2011-12-07 宝利微电子系统控股公司 一种数字音视频变速播放的方法和装置
CN103475927A (zh) * 2012-06-08 2013-12-25 腾讯科技（深圳）有限公司 在线视频实时变速播放方法及系统
CN103916716A (zh) * 2013-01-08 2014-07-09 北京信威通信技术股份有限公司 一种无线网络下视频实时传输的码率平滑方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108966028A (zh) * 2018-08-17 2018-12-07 上海悠络客电子科技股份有限公司 一种基于网络状况动态调节播放速度的防抖动方法
CN108966028B (zh) * 2018-08-17 2021-04-30 上海悠络客电子科技股份有限公司 一种基于网络状况动态调节播放速度的防抖动方法

Similar Documents

Publication Publication Date Title
US8787595B2 (en) Audio signal adjustment device and audio signal adjustment method having long and short term gain adjustment
RU2507707C2 (ru) Способ и устройство управления воспроизведением видео- и аудиоданных
US20080095385A1 (en) Method of and System for Automatically Adjusting the Loudness of an Audio Signal
US11109095B2 (en) Automatic activation of closed captioning for low volume periods
JP2010537233A (ja) 圧縮デジタルテレビの音声処理
EP1736001A1 (en) Audio level control
CN106210879A (zh) 智能音量控制系统和智能音量控制方法
CN105142002B (zh) 音/视频直播方法、装置及控制方法、装置
US8560331B1 (en) Audio acceleration
US10827264B2 (en) Audio preferences for media content players
WO2017101312A1 (zh) 双画面下的音量自动调节方法、装置及智能设备
CN109257631A (zh) 视频轮播播放方法、装置、计算机设备及存储介质
EP2945339B1 (en) Method and device for regulating streaming media data transmission
CN112825550A (zh) 生成用于要被应用的音频配置文件的命令的解码器装备
US20120260276A1 (en) Information processing apparatus, information processing method, and program
CN108282689A (zh) 一种互联网监控在网络抖动下做到最小延时并能流畅播放的方法
US10656901B2 (en) Automatic audio level adjustment during media item presentation
CN114930865A (zh) 用于设置包括音频的媒体内容的回放速度的计算机实施的方法、设备和计算机程序产品
US20140250482A1 (en) System and method for removing a pause in a delayed remote broadcast interview
KR100556748B1 (ko) 스트리밍 데이터의 동적 버퍼 관리 방법
CN114420149B (zh) 音频延时器的时间补偿方法、音频延时器及计算机存储介质
CN107154263B (zh) 声音处理方法、装置及电子设备
CN112887745A (zh) 数据处理方法、系统、电子设备和计算机可读存储介质
JP2002016858A (ja) デジタル放送受信装置
KR20070022116A (ko) 오디오 신호의 크기를 자동적으로 조정하는 방법 및 시스템

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180713

RJ01 Rejection of invention patent application after publication