CN107743252A - A kind of method for reducing live delay - Google Patents
A kind of method for reducing live delay Download PDFInfo
- Publication number
- CN107743252A CN107743252A CN201711055882.1A CN201711055882A CN107743252A CN 107743252 A CN107743252 A CN 107743252A CN 201711055882 A CN201711055882 A CN 201711055882A CN 107743252 A CN107743252 A CN 107743252A
- Authority
- CN
- China
- Prior art keywords
- delay
- live
- plug
- video
- flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention relates to a kind of method for reducing live delay, comprise the following steps：S1 reduces the delay of video encoder：S2 optimizes transmission network；S3 plug-flows end code check adaptively reduces delay；S4 optimizations play end delay.Advantages of the present invention is embodied in：After carrying out delay optimization to each module of live broadcast system in the present invention, it is minimum that the live delay of the system nearly reaches industry；Under weak net environment, excessive accumulated delay will not be produced using technical solution of the present invention, it is ensured that the synchronism of video and interactive message.
Description
Technical field
The present invention relates to streaming media live broadcast technology field, and in particular to a kind of method for reducing live delay.
Background technology
Traditional audio frequency and video direct seeding technique, including audio-video collection (YUV/PCM forms), coding (H264/AAC forms),
Encapsulate (FLV forms), plug-flow (RTMP protocol packages), distribution (RTMP protocol packages), decoding (H264/AAC forms), broadcasting (YUV/
) etc. PCM module, each module can have certain delay.
Existing audio frequency and video direct seeding technique, have two aspect the shortcomings that, first：Because each module of live broadcast system can
Certain delay is produced, especially live coding layer delay accounts for the overwhelming majority, thus causes live bulk delay higher, influences
Live real-time experience；Second：If other subsidiary real-time signaling messages, can produce video and signaling message not in live
The problem of synchronous, for example, it is live in chat and the operation of document paintbrush be real-time, and video has certain hysteresis quality, Er Qieshi
This delay can be increasing during border plays, and influences very much live viewing experience and interactive function.
The content of the invention
The purpose of the present invention is to be directed to deficiency of the prior art, there is provided a kind of method for reducing live delay.
To achieve the above object, the invention discloses following technical scheme：
A kind of method for reducing live delay, comprises the following steps：
S1 reduces the delay of video encoder：
S101 opens the lowest latency option of encoder；
S102 sets Video Key frame period；
S2 optimizes transmission network：Plug-flow client carries out node before carrying out plug-flow and tested the speed, and selection delay lowest section clicks through
Row plug-flow, viewing client obtain current optimal node in real time by inquiring about service end；
S3 plug-flows end code check adaptively reduces delay：Live plug-flow client adds code check adaptation function, in weak net ring
In the case of border or network jitter, plug-flow code check enters Mobile state adjustment；
S4 optimizations play end delay：Adjusting and optimizing buffer size value, one higher limit of end buffer setting is played, once it is super
This threshold value is crossed, then carries out live TV stream reconnection, reduces the accumulated delay brought in decoding end.
In the further technical scheme of the present invention, in the step S1, encoder is compiled for the x264 based on H264 agreements
Code device.
In the further technical scheme of the present invention, in the step S102, key frame of video is set at intervals of 1s.
In the further technical scheme of the present invention, in the step S2, used between service end node and node
RTMP agreements carry out plug-flow.
A kind of method for reducing live delay disclosed by the invention, has the advantages that：
1. after carrying out delay optimization to each module of live broadcast system in the present invention, the live delay of the system nearly reaches
Industry is minimum.
2. under weak net environment, excessive accumulated delay will not be produced using technical solution of the present invention, it is ensured that video with
The synchronism of interactive message.
Brief description of the drawings
Fig. 1 is delay Optimizing Flow figure.
Embodiment
The technical scheme in the embodiment of the present invention will be clearly and completely described below, it is clear that described implementation
Example only part of the embodiment of the present invention, rather than whole embodiments.It is common based on the embodiment in the present invention, this area
The every other embodiment that technical staff is obtained under the premise of creative work is not made, belong to the model that the present invention protects
Enclose.
Video coding is to be compressed huge video data using certain compress technique, so as to reduce transmission
Bandwidth consumption.Video compression coding aims at the compression factor for ensureing video and the quality recovered, can be with inexpensive real
Now compress.
Conventional method for video coding mainly includes transition coding, entropy code, Motion estimation and compensation, mixing volume
Code.
The main function of Video coding is that video pixel data (RGB, YUV etc.) is collapsed into video code flow, so as to drop
The data volume of low video.If video is without compressed encoding, volume is typically very big, and a film is possible will
G up to a hundred space.Video coding is one of most important technology in video and audio frequency technology applications.The data volume of video code flow account for video and audio
The overwhelming majority of total amount of data.Efficient Video coding can obtain higher video quality under equal code check.
Frequency encoding and decoding technique has two sets of standards, and the standard of International Telecommunication Association (ITU-T) is H.261, H.263, H.263+ etc.；Also
ISO MPEG standards Mpeg1, Mpeg2, Mpeg4 etc..H.264/AVC it is the advantages of H.263+ two big tissues are gathered with Mpeg4
Combine the newest standards released, most valuable part is undoubtedly higher data compression ratio.In equal picture quality condition
Under, data compression ratio H.264 can be higher than MPEG-4 1.5 times than H.263 high 2 times.In this technical scheme, what we used
Coded format is H.264 form.
Video coding generally comprises Software Coding and hardware encoding, and the present invention is using the x264 codings based on H264 agreements
Device, x264 are the H.264/MPEG-4 AVC software encoders of source code of opening for free, and are that current encoder efficiency highest opens
Source code H.264 encoder.
Refer to Fig. 1.The present invention passes through delay, especially prolonging in coding side caused by the modules in reduction system
Late, live bulk delay is reduced.Specifically, a kind of method for reducing live delay disclosed by the invention, including following step
Suddenly：
S1 reduces the delay of video encoder：
S101 opens the lowest latency option of encoder；
In X264 encoders, there is an option zerolatency that control lowest latency is set, it would be desirable to open this
First term, ensure that delay is lowest latency caused by coding side.
S102 sets Video Key frame period；
Video coding is carried out by " group ", and each group be directly not in contact with by also to be made a GOP, GOP and GOP, is compiled
Code relation only produces among GOP, and each GOP groups are since a key frame.Key frame also hands over I frames, is presented as that one is secondary complete
Whole picture, those frames among GOP are all incomplete, it is necessary to by being obtained after key frame, front and rear frame arithmetic.
The interval regulation of I frames influences whether GOP length, and then has influence on the speed for reading GOP, due in live broadcast system
Playing end needs to carry out decoded back these frames, and decode play at first by an I frame, if I frame periods set it is excessive,
The time of the broadcastings to be decoded such as broadcasting end is longer, therefore can also produce the delay for being up to an I frame period duration.This motion will
I frame periods are arranged to minimum 1s, without waiting for that can play out long very much when can so play end decoding, reduce broadcasting
The delay of wait.
S2 optimizes transmission network：Plug-flow client carries out node before carrying out plug-flow and tested the speed, and selection delay lowest section clicks through
Row plug-flow, viewing client obtain current optimal node in real time by inquiring about service end；Can so reduce due to cross-region or
Postpone caused by cross operator or transmission line failure.
S3 plug-flows end code check adaptively reduces delay：Live plug-flow client adds code check adaptation function, in weak net ring
In the case of border or network jitter, plug-flow code check enters Mobile state adjustment, will not produce accumulated delays because of network congestion.
S4 optimizations play end delay：Playing first open delay of the end buffer control for video also has considerable influence, if only
Optimization first opens delay, can be decoded immediately when data reach under 0 caching situation.But if under weak net environment in order to
Influence caused by eliminating network jitter, sets certain caching to be also necessary, it is therefore desirable to prolongs in live stability and first opening
Balance is found in optimization late, adjusting and optimizing buffer size value, plays one higher limit of end buffer setting, once exceed this threshold
Value, then live TV stream reconnection is carried out, reduces the accumulated delay brought in decoding end.
In an embodiment of the present invention, in the step S1, encoder is the x264 encoders based on H264 agreements.
In an embodiment of the present invention, in the step S102, key frame of video is set at intervals of 1s.
In an embodiment of the present invention, in the step S2, assisted between service end node and node using RTMP
View carries out plug-flow.HTTP HLS or HDS agreements are not based between service end node and node using RTMP as far as possible to be passed
It is defeated, it can so reduce overall transmission delay.This situation about being played out mainly for terminal user using HLS.HDS by
In the form played using similar " program request " fragment file, it is necessary to change into the flv bags of http agreements after waiting live data again, because
This can also produce delay.
Compared to the content introduced in background technology, the present invention will not produce excessive accumulated delay under weak net environment, can
To ensure the synchronism of video and interactive message.
Described above is only the preferred embodiment of the present invention, rather than its limitations；It should be pointed out that although with reference to above-mentioned each
The present invention is described in detail embodiment, it will be understood by those within the art that, it still can be to above-mentioned each
Technical scheme described in embodiment is modified, or carries out equivalent substitution to which part or all technical characteristic；And this
A little modifications and replacement, do not make the essence of corresponding technical scheme depart from the scope of various embodiments of the present invention technical scheme.
Claims (4)
- A kind of 1. method for reducing live delay, it is characterised in that comprise the following steps：S1 reduces the delay of video encoder：S101 opens the lowest latency option of encoder；S102 sets Video Key frame period；S2 optimizes transmission network：Plug-flow client carries out node before carrying out plug-flow and tested the speed, and selection delay lowest section point is pushed away Stream, viewing client obtain current optimal node in real time by inquiring about service end；S3 plug-flows end code check adaptively reduces delay：Live plug-flow client adds code check adaptation function, in weak net environment or In the case of network jitter, plug-flow code check enters Mobile state adjustment；S4 optimizations play end delay：Adjusting and optimizing buffer size value, one higher limit of end buffer setting is played, once exceed this Individual threshold value, then live TV stream reconnection is carried out, reduces the accumulated delay brought in decoding end.
- A kind of 2. method for reducing live delay according to claim 1, it is characterised in that in the step S1, coding Device is the x264 encoders based on H264 agreements.
- A kind of 3. method for reducing live delay according to claim 1, it is characterised in that in the step S102, if Key frame of video is put at intervals of 1s.
- 4. a kind of method for reducing live delay according to claim 1, it is characterised in that in the step S2, taking It is engaged in carrying out plug-flow using RTMP agreements between end node and node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711055882.1A CN107743252A (en) | 2017-11-01 | 2017-11-01 | A kind of method for reducing live delay |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711055882.1A CN107743252A (en) | 2017-11-01 | 2017-11-01 | A kind of method for reducing live delay |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107743252A true CN107743252A (en) | 2018-02-27 |
Family
ID=61233870
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711055882.1A Pending CN107743252A (en) | 2017-11-01 | 2017-11-01 | A kind of method for reducing live delay |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107743252A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108377399A (en) * | 2018-03-07 | 2018-08-07 | 广州图普网络科技有限公司 | Live video stream code-transferring method, device and computer readable storage medium |
| CN108495152A (en) * | 2018-03-30 | 2018-09-04 | 武汉斗鱼网络科技有限公司 | A kind of net cast method, apparatus, electronic equipment and medium |
| CN108881935A (en) * | 2018-07-16 | 2018-11-23 | 安徽国通亿创科技股份有限公司 | A kind of online interaction live streaming low delay optimization method |
| CN110365997A (en) * | 2019-08-06 | 2019-10-22 | 全播教育科技(广东)有限公司 | A kind of the interactive teaching live broadcasting method and system of low latency |
| CN111030832A (en) * | 2019-11-20 | 2020-04-17 | 杭州米络星科技(集团)有限公司 | WebRTC open interconnection system and method |
| CN111669605A (en) * | 2019-03-06 | 2020-09-15 | 腾讯科技（深圳）有限公司 | Method and device for synchronizing multimedia data and associated interactive data thereof |
| CN112887750A (en) * | 2021-02-04 | 2021-06-01 | 成都国翼电子技术有限公司 | Low-delay live broadcast method based on RTMP |
| CN114339284A (en) * | 2021-12-27 | 2022-04-12 | 北京京东拓先科技有限公司 | Method, device, storage medium and program product for monitoring live broadcast delay |
| CN115209230A (en) * | 2021-04-14 | 2022-10-18 | 吴振华 | Method for realizing real-time video transmission based on RTMP protocol |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101778104A (en) * | 2009-12-29 | 2010-07-14 | 常州中流电子科技有限公司 | System and method for playing stream media by using self-adaption bandwidth |
| CN101917613A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Acquiring and coding service system of streaming media |
| CN105872576A (en) * | 2016-04-25 | 2016-08-17 | 乐视控股（北京）有限公司 | Video playing method and device |
| CN106385594A (en) * | 2016-09-18 | 2017-02-08 | 深圳市青柠互动科技开发有限公司 | Method for optimizing video live broadcast services |
-
2017
- 2017-11-01 CN CN201711055882.1A patent/CN107743252A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917613A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Acquiring and coding service system of streaming media |
| CN101778104A (en) * | 2009-12-29 | 2010-07-14 | 常州中流电子科技有限公司 | System and method for playing stream media by using self-adaption bandwidth |
| CN105872576A (en) * | 2016-04-25 | 2016-08-17 | 乐视控股（北京）有限公司 | Video playing method and device |
| CN106385594A (en) * | 2016-09-18 | 2017-02-08 | 深圳市青柠互动科技开发有限公司 | Method for optimizing video live broadcast services |
Non-Patent Citations (2)
| Title |
|---|
| SAMIRCHEN: "直播中累积延时的优化", 《HTTPS://WWW.JIANSHU.COM/P/9087D1782CDE》 * |
| 七牛云: "视频直播技术详解之延迟优化", 《HTTPS://BLOG.CSDN.NET/QIANSG123/ARTICLE/DETAILS/80125628》 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108377399A (en) * | 2018-03-07 | 2018-08-07 | 广州图普网络科技有限公司 | Live video stream code-transferring method, device and computer readable storage medium |
| CN108377399B (en) * | 2018-03-07 | 2019-03-19 | 广州图普网络科技有限公司 | Live video stream code-transferring method, device and computer readable storage medium |
| CN108495152A (en) * | 2018-03-30 | 2018-09-04 | 武汉斗鱼网络科技有限公司 | A kind of net cast method, apparatus, electronic equipment and medium |
| CN108495152B (en) * | 2018-03-30 | 2021-05-28 | 武汉斗鱼网络科技有限公司 | Video live broadcast method and device, electronic equipment and medium |
| CN108881935A (en) * | 2018-07-16 | 2018-11-23 | 安徽国通亿创科技股份有限公司 | A kind of online interaction live streaming low delay optimization method |
| CN111669605A (en) * | 2019-03-06 | 2020-09-15 | 腾讯科技（深圳）有限公司 | Method and device for synchronizing multimedia data and associated interactive data thereof |
| CN111669605B (en) * | 2019-03-06 | 2021-10-26 | 腾讯科技（深圳）有限公司 | Method and device for synchronizing multimedia data and associated interactive data thereof |
| CN110365997A (en) * | 2019-08-06 | 2019-10-22 | 全播教育科技(广东)有限公司 | A kind of the interactive teaching live broadcasting method and system of low latency |
| CN111030832A (en) * | 2019-11-20 | 2020-04-17 | 杭州米络星科技(集团)有限公司 | WebRTC open interconnection system and method |
| CN112887750A (en) * | 2021-02-04 | 2021-06-01 | 成都国翼电子技术有限公司 | Low-delay live broadcast method based on RTMP |
| CN115209230A (en) * | 2021-04-14 | 2022-10-18 | 吴振华 | Method for realizing real-time video transmission based on RTMP protocol |
| CN114339284A (en) * | 2021-12-27 | 2022-04-12 | 北京京东拓先科技有限公司 | Method, device, storage medium and program product for monitoring live broadcast delay |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107743252A (en) | A kind of method for reducing live delay | |
| US10187608B2 (en) | Techniques for managing visual compositions for a multimedia conference call | |
| JP4981927B2 (en) | CAVLC extensions for SVCCGS enhancement layer coding | |
| US7817672B2 (en) | Method and device for providing programs to multiple end user devices | |
| Nightingale et al. | HEVStream: a framework for streaming and evaluation of high efficiency video coding (HEVC) content in loss-prone networks | |
| US8687114B2 (en) | Video quality adaptation based upon scenery | |
| US8627390B2 (en) | Method and device for providing programs to multiple end user devices | |
| US8254445B2 (en) | Video transmission using video quality metrics | |
| TW200426714A (en) | Method for coding sequences of pictures | |
| US8400918B2 (en) | Video traffic smoothing | |
| WO2011151647A2 (en) | Data transmission apparatus, system and method | |
| CN1812587A (en) | Video coding | |
| CN1852429A (en) | Video-code-flow grouped transmission method and system | |
| WO2017036070A1 (en) | Self-adaptive media service processing method and device therefor, encoder and decoder | |
| CA2795694A1 (en) | Video content distribution | |
| CN104320716A (en) | A video uplink transmission method based on collaborative multiple terminals | |
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| CN110602522A (en) | Multi-path real-time live webRTC stream synthesis method | |
| US20110274157A1 (en) | Method and system for 3d video pre-processing and post-processing | |
| WO2009103351A1 (en) | Method and apparatus for obtaining media over a communications network | |
| CN103024441A (en) | Method for playing television programs by mobile terminal | |
| CN102427531B (en) | Cross-layer interactive image quality continuous adjustable real-time video coding and decoding method | |
| CN103918258A (en) | Reducing amount of data in video encoding | |
| De Simone et al. | Comparison of DASH adaptation strategies based on bitrate and quality signalling | |
| CN105306970B (en) | A kind of control method and device of live streaming media transmission speed |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180227 |