CN106210785A - Media streaming networks self adaptation is unidirectionally controlled method and system - Google Patents
Media streaming networks self adaptation is unidirectionally controlled method and system Download PDFInfo
- Publication number
- CN106210785A CN106210785A CN201610665952.4A CN201610665952A CN106210785A CN 106210785 A CN106210785 A CN 106210785A CN 201610665952 A CN201610665952 A CN 201610665952A CN 106210785 A CN106210785 A CN 106210785A
- Authority
- CN
- China
- Prior art keywords
- media stream
- self adaptation
- media
- time
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23106—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
- H04N21/26216—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the channel capacity, e.g. network bandwidth
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a kind of media streaming networks self adaptation to be unidirectionally controlled method and system, is applied to media stream end, and wherein, the method includes: buffered media stream also sends these media and flow to receiving terminal；Monitor buffer data size and the transmission data volume of this transmitting terminal in real time, if buffer data size is more than sending data volume, then obtain real-time bandwidth；According to described real-time bandwidth, the selectivity triggering Media Stream sends.The application can improve image that receiving terminal causes due to real-time bandwidth big ups and downs off and on, the problem such as Ka Dun and stagnation, and without considering compatibility and third party's matching problem of many equipment, greatly reduce the maintenance cost and risk factor may brought due to complicated networking, complex technology and complex interaction etc..
Description
Technical field
The application relates to the communications field, is specifically related to a kind of media streaming networks self adaptation and is unidirectionally controlled method and system.
Background technology
At present, security protection industry has established multiple monitoring network in various places, the network traffics produced based on Video Applications
More and more higher in the ratio shared by the Internet total flow, along with increasing of video media stream, the phenomenon of network congestion can be produced,
Directly result in client terminal playing card pause, the phenomenon such as stagnation, cause poor user experience, time serious, there may be probability key message
Disappearance.And video effect is especially sensitive to network congestion, current Video coding uses predictive coding framework mostly, cause frame with
Time domain dependency the strongest between frame, once occurs that packet loss causes the decoding error of present frame, and this mistake can be along the line of prediction
Road is delivered in follow-up picture frame, finally be presented to user off and on, the video effect such as Hua Ping.
In network transmission process, to the judgement of bandwidth or the acquisition of current network conditions (such as information such as packet loss) it is
One important sport technique segment, coherent detection means have existed much, but mostly realize complicated and may finally or cannot be complete
The network organizing environment that full reply is instantly complicated.
The system adaptive recognition method currently taked for unstable bandwidth in network transmission has existed a lot, such as
Self adaptation is carried out by bandwidth prediction.
The first Media Stream adaptive transmission method existing, by setting up network congestion detection mould at media stream receiver end
Block also utilizes RTCP (Realtime Transport Control Protocol, RTCP Real-time Transport Control Protocol, i.e. feedback control
Method) testing result is fed back to transmitting terminal, transmitting terminal triggers encoder coding expansion strategy (as real-time streams according to this information
The frame-skipping coding etc. of scene) or selectivity lost frames transmission (for storage streaming on demand scene) complete Adaptive Transmission,
Realizing in the case of operation condition of network is continually changing eventually, client is obtained in that play quality as well as possible.These media
Stream adaptive transmission method needs the cooperation of multiple objects (transmitting terminal and receiving terminal), and multiple object not only can bring different factory
The compatibling problem of business's part product, also add the extra cost that third party coordinates.
Existing the second Media Stream adaptive transmission method, is also real by rtcp protocol perception at media stream receiver end
Time Bandwidth also sends to transmitting terminal, and transmitting terminal, before starting selective frame losing and dynamic code rate control, adds Media Stream
Packet transaction, control to send between the group of Media Stream interval according to real-time bandwidth, to attempt to reduce the burst in communication process
The impact that transmission of video is produced by packet loss.The second Media Stream adaptive transmission method equally exists compatibility and third party coordinates increasing
The extra cost problem added, although the method reduces the probability of Burst loss hit Media Stream to a certain extent, but occurs again
During the situation that real-time bandwidth is unstable and span is bigger, minimizing can only be relied on and send data (such as selective frame losing, reduction code check
Deng) mode, make the total data of transmission and bandwidth match, this can cause the disappearance of image detail.
Summary of the invention
In view of this, the application provides a kind of media streaming networks self adaptation to be unidirectionally controlled method and system, existing to solve
Present in technology, receiving terminal and transmitting terminal coordinate compatibility that the self adaptation carrying out media flow transmission brought and third party to coordinate
Problem.
Specifically, the application is achieved by the following technical solution:
A kind of media streaming networks self adaptation is unidirectionally controlled method, is applied to media stream end, and the method includes:
Buffered media stream also sends these media and flow to receiving terminal；
Monitor buffer data size and the transmission data volume of this transmitting terminal in real time, if buffer data size is more than sending data volume,
Then obtain real-time bandwidth；
According to described real-time bandwidth, the selectivity triggering Media Stream sends.
Further, the mode obtaining real-time bandwidth is: obtain buffer data size more than sending the default adaptive of data volume
Between Ying Shi, and the self adaptation point accumulation data volume of described transmitting terminal in this default auto-adaptive time；
According to default auto-adaptive time, self adaptation point accumulation data volume and the encoder bit rate of default transmitting terminal, calculate
Real-time bandwidth.
Further, the time that described media stream selective sends is when being preset time threshold, if total in this transmitting terminal
Data volume is more than or equal to self adaptation point accumulation data volume, then according to pre-configured code media streams allocation list, reduce this transmitting terminal
Encoder bit rate.
Further, the selectivity that described transmitting terminal realizes Media Stream by selective frame losing sends, and specifically includes:
Send the I frame of described Media Stream and be close to the part P frame of this I frame.
Further, if this transmitting terminal recovers to buffer data size equal to sending data volume, then exceed in the unit interval
The Media Stream of real-time bandwidth carries out do-nothing operation；Or, the media stream data sent in increasing the unit interval according to default frame gap
Amount.
The media streaming networks self adaptation of application the application is unidirectionally controlled method, and the application also provides for a kind of media streaming networks
Self adaptation unilateral control system.
A kind of media streaming networks self adaptation unilateral control system, is applied to media stream end, and this system includes:
Cache module, buffered media stream；
Business sending module, takes out Media Stream from cache module and sends to receiving terminal；
Self-adaptive control module, monitors buffer data size and the taking-up data volume of described cache module in real time, if caching number
According to amount more than taking out data volume, then obtain real-time bandwidth, and according to described real-time bandwidth, trigger described business sending module to matchmaker
The selectivity of body stream sends.
Further, the mode of described self-adaptive control module acquisition real-time bandwidth is: obtain the slow of described cache module
Deposit data amount is more than the default auto-adaptive time of taking-up data volume, and described cache module caching in this default auto-adaptive time
Self adaptation point accumulation data volume；
According to default auto-adaptive time, self adaptation point accumulation data volume and the encoder bit rate of default cache module, meter
Calculate real-time bandwidth.
Further, this system also includes:
Video encoding module, flow in cache module according to pre-arranged code code check storage media；
Described business sending module carries out the time of media stream selective transmission when being preset time threshold, described self adaptation
Control module obtains the total amount of data in described cache module, if the total amount of data in described cache module is more than or equal to self adaptation
Point accumulation data volume, described video encoding module, then according to pre-configured code media streams allocation list, reduces encoder bit rate.
Further, described business sending module is to realize the selectivity to Media Stream by selective frame losing to send, institute
The business sending module of stating specifically includes:
Send the I frame of described Media Stream and be close to the part P frame of this I frame.
Further, if described self-adaptive control module judges that described cache module recovers to buffer data size equal to taking out
Data volume, then trigger described business sending module and the Media Stream exceeding real-time bandwidth in the unit interval carried out do-nothing operation；Or,
Trigger in described business sending module increases the unit interval according to default frame gap the media stream data amount sent.
The beneficial effect of the application: regulate this transmission by the way of employing unidirectional sensing real-time bandwidth at transmitting terminal
The data of end send, and to adapt to the transmission of data when bandwidth is deteriorated, improve receiving terminal and cause due to real-time bandwidth big ups and downs
Image off and on, the problem such as Ka Dun and stagnation, meanwhile, unidirectional (transmitting terminal) sensing bandwidth is without considering the compatibility of many equipment
With third party's matching problem, greatly reduce the maintenance that may bring with complex interaction etc. due to complicated networking, complex technology and become
Basis and risk factor.
Accompanying drawing explanation
Fig. 1 is that the media streaming networks self adaptation that the present embodiment provides is unidirectionally controlled method flow diagram；
Fig. 2 is that the transmitting terminal of the present embodiment offer data when network fluctuation send schematic diagram；
Fig. 3 is the media streaming networks self adaptation unilateral control system structured flowchart that the present embodiment provides；
Fig. 4 is that schematic diagram is read/taken to the cache module of the present embodiment offer data when network is normal；
Fig. 5 is the data structure schematic diagram of the cache module storage that the present embodiment provides.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Explained below relates to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they are only with the most appended
The example of the apparatus and method that some aspects that described in detail in claims, the application are consistent.
Seeing Fig. 1, a kind of media streaming networks self adaptation that the present embodiment provides is unidirectionally controlled method, is applied to Media Stream and sends out
Sending end (such as video monitoring equipment), comprises the steps:
S101: buffered media stream also sends these media and flow to receiving terminal (such as server).
Encode according to user's configuration parameter (encoder bit rate such as preset), and the media stream data after coding is delayed
It is stored in this transmitting terminal, transmitting terminal timing ts(unit: the ms) time takes out ES (Elementary Steams, primary flow) data,
Send to receiving terminal according to after predetermined format encapsulation packing.
Wherein, media stream data is in units of frame.
The t of the present embodiments=1000/ frame per second, tsIt is transmitting terminal and sends the time interval of a frame media stream data.
Predetermined format when Media Stream creates it has been confirmed that the form of such as this Media Stream can be MPEG (Moving
Picture Experts Group, dynamic image expert group) form.
In one embodiment, in order to ensure the receiving terminal that is sent to that media stream data can be complete, select that there is weight
Pass the Transmission Control Protocol (Transmission Control Protocol, transmission control protocol) of mechanism as transmitting terminal and receiving terminal
Transport layer protocol, transmitting terminal by Transmission Control Protocol by media stream to receiving terminal, logical to ensure between transmitting terminal and receiving terminal
The reliability of letter.
S102: monitor buffer data size and the transmission data volume of this transmitting terminal in real time, if buffer data size is more than sending number
According to amount, then obtain real-time bandwidth.
When network environment is smooth and easy, the Media Stream buffer memory rate v of transmitting terminalg(i.e. encoder bit rate) and transmission rate vsIt it is phase
Deng, the data mode in transmitting terminal is similar " i.e. entering i.e. to go out ".When fluctuation (bandwidth variation) occurs in network, Transmission Control Protocol starts
Retransmit, can exist and successfully the data of transmitting terminal cannot be sent the situation to receiving terminal, now, transmitting terminal by Transmission Control Protocol
Buffer data size is more than sending data volume, and data stacking is in transmitting terminal.Network condition is the poorest, and the data volume that transmitting terminal is piled up is more
Seriously.
In a specific embodiment, see Fig. 2, due to the reliability transmission mechanism of Transmission Control Protocol, when network fluctuation,
The data sent by Transmission Control Protocol can ensure to arrive receiving terminal, but transmitting terminal can be caused every tsTime is sent to base
Data in the network structure of Transmission Control Protocol differ success surely, and under regular situation, this does not sends successful data and can be dropped, because of
And cause receiving terminal card to pause.In the present embodiment, transmitting terminal can be to the unsuccessful data sending into network structure based on Transmission Control Protocol
Preserve, tsNext time after time sends when being triggered, and can preferentially send this and not send successful data.
The present embodiment obtains the mode of real-time bandwidth: obtain the buffer data size of this transmitting terminal caching more than sending data
The default auto-adaptive time t (unit: s) of amount, and in this default auto-adaptive time t, the self adaptation point piled up in transmitting terminal tires out
Volume data amount A (unit: KB)；
According to default auto-adaptive time t, self adaptation point accumulation data volume A and the encoder bit rate B of default transmitting terminalv
(unit: kbps), calculates real-time bandwidth Ba(unit: kbps):
Ba=kBv； (1)
A=(t (1-k) Bv)/8； (2)
Wherein, k is that real-time bandwidth accounts for default encoder bit rate BvProportionality coefficient.
In conjunction with formula (1) and (2), draw: Ba=Bv-(A*8)/t。
Due to the data stacking of transmitting terminal, obtain relatively big if presetting auto-adaptive time t, if transmitting terminal continues according to caching speed
Rate vg=transmission rate vsCarry out caching and the transmission of data, then the Media Stream being transferred to receiving terminal can produce significant time delay.
If presetting auto-adaptive time t and obtaining less, it is easily caused self adaptation point accumulation data volume A not statistical uncertainty really, causes real-time bandwidth
BaCalculate inaccurate.
In the present embodiment, presetting auto-adaptive time t is dynamically configuration, for the adaptive middle transition of stacked strips, this reality
The foundation of the default auto-adaptive time t value executing example is: in this default auto-adaptive time t, self adaptation point accumulation data volume is little
In equal to preset data amount threshold value.
In one more preferred embodiment, preset data amount threshold value=(this transmitting terminal allows data volume/2 stored).
The default auto-adaptive time t acquiescence value of the present embodiment is 2tm/ 5, wherein, tmFor under conventional code check, transmitting terminal
Allowing the maximum time of storage data volume, unit is s (second).
S103: according to real-time bandwidth, the selectivity triggering Media Stream sends.
In the present embodiment, transmitting terminal is carried out the selectivity transmission of Media Stream and is realized by selective frame losing.
In one more preferred embodiment, selective frame losing is to be accomplished in that transmitting terminal only sends media
The I frame of stream and the part P frame of this I frame of next-door neighbour so that the media stream data amount sent in the unit interval is: real-time bandwidth Ba, from
And reducing the data volume of transmission so that the data volume that transmitting terminal sends matches with real-time bandwidth, to take into account currently practical network
Bandwidth be deteriorated the image that causes off and on, the problem such as Ka Dun or stagnation, do not interfere with again receiving terminal (i.e. decoding end) proper solution
Code.
Normally (i.e. network is smooth and easy) each interval time is then, and transmitting terminal can take coherent next frame group data and send, by
It is deteriorated in bandwidth, if transmitting terminal continues to send data in the manner described above, significant time delay can be caused, therefore the present embodiment is by choosing
The frame losing of selecting property, sends each in interval, and transmitting terminal should send some P frames (the most each frame group in each frame group data
Data end several P frame) it is arranged to send next frame group data, to reduce the data volume that transmitting terminal sends, progressively it catch up with this
The latest frame of sending end storage, so that delay recovery.
In one embodiment, transmitting terminal is configured to one frame group data of transmission per second (when network is smooth and easy
Frame group data are made up of 1 I frame and 24 P frames), ts=40ms, i.e. sends frame data every 40ms.Actual bandwidth deficiency meeting
Causing the accumulation that transmitting terminal is data cached, thus the selectivity triggering transmitting terminal sends, transmitting terminal only sends I frame and 10 P frames
Data volume, to reach the bandwidth that real network can be born, now, the next interval that sends when arriving, should send current
The 11st P frame in I/P frame group, transmitting terminal is directly skipped the 11-24 P frame and travels through the caching of this transmitting terminal, until inquiry
To the I frame of next frame group, it is transmitted.
After transmitting terminal selectivity sends media stream data, transmitting terminal can obtain buffer data size in real time and send data volume
And judge, if this transmitting terminal recovers to buffer data size equal to sending data volume (i.e. " i.e. entering i.e. to go out " state), then send
Hold exceeding real-time bandwidth B in the unit intervalaMedia Stream carry out do-nothing operation.I.e. recover to " i.e. entering i.e. to go out " state at transmitting terminal
After, transmitting terminal recovers to equal with the media stream data amount that this transmitting terminal caches in the media stream data amount that each interval sends,
Only for having exceeded B in the unit intervalaMedia Stream only carry out caching, but do not send (i.e. without take new frame send)
To receiving terminal.
Meanwhile, if this transmitting terminal recovers to buffer data size equal to sending data volume, transmitting terminal is then according to default frame gap
The media stream data amount sent in increasing the unit interval.If transmitting terminal maintains " i.e. entering i.e. to go out " the state t second, transmitting terminal is the most persistently pressed
The data volume sent is increased until the image of receiving terminal recovers normal according to default frame gap.
In the present embodiment, preset frame gap and send P frames (slowly rise, single-stage progressively go up strategy), transmitting terminal for more
By this small-gap suture sustained restoration send data volume, it is ensured that transmitting terminal send Media Stream time the most do not lose data and
Reach smooth and sound out the effect of rise.
In the present embodiment, after transmitting terminal selectivity sends media stream data, send out when transmitting terminal carries out media stream selective
When the time sent is preset time threshold, if total amount of data >=self adaptation point accumulation data volume A that in this transmitting terminal, caching is piled up,
Then transmitting terminal can reduce the encoder bit rate of this transmitting terminal according to pre-configured code media streams allocation list.
In one more preferred embodiment, preset time threshold=(presetting auto-adaptive time t/2).
Due at high resolutions, the too low meeting of code check of coding causes the effect of image bad, therefore the present embodiment is according to figure
As effect sets up the low allocation list of the Media Stream under each resolution.Seeing table 1, the code media streams for the present embodiment configures
Table.
Table 1
In table 1, code check, frame per second and GOP (Group of Pictures, picture group) are corresponding, GOP=frame per second.
In one embodiment, under resolution is 1080P, encoder bit rate is configured to Bv=2048kbps, actual band
Wide Ba=1599kbps, according to table 1, adjusts encoder bit rate Bv=1024kbps, the most at least reduces two-stage (fall soon), sends out to reduce
The data volume of sending end storage, so that when bandwidth is deteriorated, transmitting terminal can be automatically provided to what receiving terminal and bandwidth were agreed with mutually
Optimized image, i.e. transmitting terminal can be according to this table 1 automatic adaptation different bandwidths.
The present embodiment realizes classification by the principle of the low allocation list of Media Stream and " slowing down liter soon " and adjusts the data of transmitting terminal
Amount sends, with Step wise approximation actual bandwidth.
In another embodiment, for making video effect at least suitable, by video with the video effect under conventional code check
Carry out intelligently encoding or improve compression rates, then the media after storage coding flow to transmitting terminal, reduce the transmitting terminal unit interval
The data volume of interior transmission, with reduce transmitting terminal send data to receiving terminal time, for the dependence of high bandwidth.
In the present embodiment, when network fluctuation, owing to transmitting terminal has carried out the selectivity transmission of Media Stream, image can be caused
The loss of details, in consideration of it, the localization storage of transmitting terminal can be triggered, it is achieved the whole of Media Stream sending selectivity deposit
Storage, and then the target of double shield is reached in crucial sensitive occasion.
When needing the Media Stream browsing storage, hot-pluggable SD card (Secure Digital be can be used directly
Memory Card, safe digital card) copy receiving terminal to and browse；Or when bandwidth abundance, by FTP (File
Transfer Protocol, file transfer protocol (FTP)) instrument etc. carries out uploading to receiving terminal and browses.
The media streaming networks self adaptation of the present embodiment is unidirectionally controlled method and employs unidirectional sensing real-time bandwidth at transmitting terminal
Mode regulate the data of this transmitting terminal and send, to adapt to the transmission of data when bandwidth is deteriorated, improve receiving terminal due to reality
The image that Time Bandwidth big ups and downs cause off and on, the problem such as Ka Dun and stagnation, meanwhile, unidirectional (transmitting terminal) sensing bandwidth without
Compatibility and third party's matching problem of many equipment need to be considered, greatly reduce due to complicated networking, complex technology and complex interaction
Etc. the maintenance cost that may bring and risk factor.
Seeing Fig. 3, the media streaming networks self adaptation unilateral control system provided for the application one embodiment, with above-mentioned media
It is corresponding that flow network self adaptation is unidirectionally controlled method, can refer to above-mentioned media streaming networks self adaptation and is unidirectionally controlled the embodiment of method
Understand or explain the content of this media streaming networks self adaptation unilateral control system.
The media streaming networks self adaptation unilateral control system of the present embodiment is applied to media stream end, and this system includes delaying
Storing module 2, self-adaptive control module 5 and business sending module 3.
Wherein, cache module 2 is in order to buffered media stream.The present embodiment, should by arranging video encoding module 1 at transmitting terminal
Video encoding module 1 encodes according to user's configuration parameter (encoder bit rate such as preset), and according to pre-arranged code code check
Media stream data after coding is stored to cache module 2.
The storage data volume upper limit of cache module 2 can select as required.In the present embodiment, set cache module 2 to permit
The upper limit of the data volume being permitted caching is M0(unit: MB):
M0=(v*tm/8)/1024 (3)
Wherein, v is conventional code check, and unit is kbps；
tmFor under conventional code check, transmitting terminal allows the maximum time of storage data volume, and unit is s (second).
Business sending module 3 is in order to take out Media Stream from cache module 2 and to send to receiving terminal.Wherein, business sends mould
Block 3 is that (time such as selecting business sending module 3 to send data is t in timings) take out the data in cache module 2, and press
Send to receiving terminal according to after predetermined format encapsulation packing.
The business sending module 3 of the present embodiment includes that sending module caches (not shown), and storage service sends mould
The unsuccessful transmission of block 3 is to the Media Stream of receiving terminal and when sending next time, preferential by this media stream by business sending module 3
To receiving terminal.
When network is normal, seeing Fig. 4, within the unit interval (such as 1 second), business sending module 3 takes from cache module 2
The data volume gone out is equal to the buffer data size of video encoding module 1 code storage to this cache module 2, and cache module 2 is in " i.e.
Enter and i.e. go out " state.
But when network fluctuation (bandwidth variation), will appear from business sending module 3 cannot successfully by media stream to connecing
The situation of receiving end, now, business sending module 3 does not abandon and fails to send the Media Stream to receiving terminal, but by this Media Stream
Being stored in sending module caching, when next time sends triggering, business sending module 3 no longer fetches data from cache module 2, and
It is from sending module caches, preferentially to take the data that previous transmission is not fully complete be transmitted, thus causes the data in caching to be produced
Raw accumulation.The big I of sending module caching is arranged as required to, in the present embodiment, and storing of sending module caching
Data volume be 2-3 frame data amount.
For ensureing that what media stream data can be complete is sent to receiving terminal, the present embodiment also includes TCP transmitting module
4, this TCP transmitting module 4 is received from the Media Stream of service transmitting unit and forwards these media to flow to receive by Transmission Control Protocol
End, Transmission Control Protocol ensure that the reliability that transmitting terminal communicates with receiving terminal.
Due to the reliability transmission mechanism of Transmission Control Protocol, when network fluctuation, sent out by TCP transmitting module 4
The data gone can ensure to arrive receiving terminal, but transmitting terminal can be caused every tsTime is sent to the data of TCP transmitting module 4
Differ success surely, and under regular situation, this does not sends successful data and can be dropped, and thus results in receiving terminal card and pauses.The present embodiment
In, the data of unsuccessful feeding TCP transmitting module 4 can be protected by the sending module caching of business sending module 3
Deposit, tsNext time after time sends when being triggered, and can preferentially send this and not send successful data.
Self-adaptive control module 5 monitors buffer data size and the taking-up data volume of cache module 2 in real time, if buffer data size
More than taking out data volume, then obtain real-time bandwidth, and according to real-time bandwidth, trigger the business sending module 3 selection to Media Stream
Property send.
In the present embodiment, self-adaptive control module 5 obtains the mode of real-time bandwidth and is: obtain the caching number of cache module 2
According to amount more than taking out the default auto-adaptive time t of data volume, and in this default auto-adaptive time t, cache module 2 caching from
Adapt to some accumulation data volume A；
According to default auto-adaptive time t, self adaptation point accumulation data volume A and the encoder bit rate of default cache module 2
Bv, calculate real-time bandwidth Ba。
Seeing Fig. 5, each frame group data that video encoding module 1 caches to cache module 2 are by an I frame and some P
Frame forms.Wherein, frame per second is F, then GOP (Group of Pictures, picture group)=F.When network is normal, business sends mould
Block 3 can take out a complete frame group Data Concurrent from cache module 2 within the unit interval and send.
When network fluctuation, for adapting to the bandwidth being deteriorated, business sending module 3 needs to reduce the media stream data sent
Amount, thus improve receiving terminal due to bandwidth be deteriorated the image that causes off and on, the problem such as Ka Dun and stagnation, the industry of the present embodiment
Business sending module 3 is to realize the selectivity to Media Stream by selective frame losing to send.
In one more preferred embodiment, business sending module 3 selective frame losing realizes in the following way: industry
Business sending module 3 sends the I frame of Media Stream and is close to the part P frame of this I frame so that business sending module 3 is in the unit interval
Interior transmission is approximately equal to real-time bandwidth B to the data volume of receiving terminala, thus reduce the data volume that business sending module 3 sends, with
Take into account the currently practical network bandwidth be deteriorated the image that causes off and on, the problem such as Ka Dun or stagnation, do not interfere with again receiving terminal
Normal decoder.
Business sending module 3 sends in interval, by the some P frames that should send in each frame group data (such as each
Each frame group data end several P frame) it is arranged to send next frame group data, to reduce the data volume that transmitting terminal sends, progressively
It catch up with the latest frame of this Sender side Storage, so that delay recovery.
Meanwhile, judge that cache module 2 recovers to buffer data size equal to taking out data volume (i.e. at self-adaptive control module 5
Cache module 2 is in the state of " i.e. entering i.e. to go out ") time, trigger business sending module 3 to exceeding real-time bandwidth B in the unit intervala
Media Stream carry out do-nothing operation, i.e. business sending module 3 only from cache module 2 reading media stream and do not send these media and flow to
TCP transmitting module 4, the data volume sent within the unit interval to realize business sending module 3 reverts to and cache module 2
Frame generation amount (i.e. video encoding module 1 stores the data volume to cache module 2) is identical.
Certainly, when self-adaptive control module 5 judges that cache module 2 recovers to be equal to take out data volume to buffer data size,
Also trigger in business sending module 3 increases the unit interval according to default frame gap (such as one P frame) media stream data sent
Amount, it is ensured that transmitting terminal is not the most lost data and reaches the smooth effect souning out rise when sending Media Stream.
It is that preset time threshold is (when such as this is default when business sending module 3 carries out the time of media stream selective transmission
Between threshold value=preset auto-adaptive time t/2) time, self-adaptive control module 5 obtains the total amount of data in cache module 2, if adaptive
Answer total amount of data >=self adaptation point accumulation data volume that control module 5 is judged in cache module 2, then trigger video encoding module
1 according to pre-configured code media streams allocation list, reduces and stores the encoder bit rate to cache module 2, deposits reducing cache module 2
The data volume of storage, so that when bandwidth is deteriorated, transmitting terminal can be automatically provided to the optimal figure that receiving terminal agrees with mutually with bandwidth
Picture, i.e. transmitting terminal can be according to this code media streams allocation list automatic adaptation different bandwidths.
When network fluctuation, owing to business sending module 3 has carried out the selectivity transmission of Media Stream, image detail can be caused
Loss, therefore in one embodiment, this media streaming networks self adaptation unilateral control system also includes locally stored module 6,
This locally stored module 6, when self-adaptive control module 5 triggers the selectivity transmission that business sending module 3 carries out Media Stream, connects
Receive the Media Stream from cache module 2 and carry out locally stored, it is achieved the whole storages to the Media Stream that selectivity sends, Jin Er
Crucial sensitive occasion reaches the target of double shield.
The media streaming networks self adaptation unilateral control system of the present embodiment employs unidirectional sensing real-time bandwidth at transmitting terminal
Mode regulate the data of this transmitting terminal and send, to adapt to the transmission of data when bandwidth is deteriorated, improve receiving terminal due to reality
The image that Time Bandwidth big ups and downs cause off and on, the problem such as Ka Dun and stagnation, meanwhile, unidirectional (transmitting terminal) sensing bandwidth without
Compatibility and third party's matching problem of many equipment need to be considered, greatly reduce due to complicated networking, complex technology and complex interaction
Etc. the maintenance cost that may bring and risk factor.
The foregoing is only the preferred embodiment of the application, not in order to limit the application, all essences in the application
Within god and principle, any modification, equivalent substitution and improvement etc. done, should be included within the scope of the application protection.
Claims (10)
1. media streaming networks self adaptation is unidirectionally controlled a method, is applied to media stream end, it is characterised in that the method bag
Include:
Buffered media stream also sends these media and flow to receiving terminal；
Monitor buffer data size and the transmission data volume of this transmitting terminal in real time, if buffer data size is more than sending data volume, then obtain
Treating excess syndrome Time Bandwidth；
According to described real-time bandwidth, the selectivity triggering Media Stream sends.
2. media streaming networks self adaptation as claimed in claim 1 is unidirectionally controlled method, it is characterised in that obtain real-time bandwidth
Mode is: obtain buffer data size more than the default auto-adaptive time sending data volume, and institute in this default auto-adaptive time
State the self adaptation point accumulation data volume of transmitting terminal；
According to default auto-adaptive time, self adaptation point accumulation data volume and the encoder bit rate of default transmitting terminal, calculate in real time
Bandwidth.
3. media streaming networks self adaptation as claimed in claim 2 is unidirectionally controlled method, it is characterised in that described Media Stream selects
Property time of sending when being preset time threshold, if the total amount of data in this transmitting terminal is more than or equal to self adaptation point accumulation data
Amount, then according to pre-configured code media streams allocation list, reduce the encoder bit rate of this transmitting terminal.
4. media streaming networks self adaptation as claimed in claim 1 is unidirectionally controlled method, it is characterised in that described transmitting terminal passes through
Selective frame losing realizes the selectivity of Media Stream and sends, and specifically includes:
Send the I frame of described Media Stream and be close to the part P frame of this I frame.
5. media streaming networks self adaptation as claimed in claim 4 is unidirectionally controlled method, it is characterised in that if this transmitting terminal recovers
To buffer data size equal to sending data volume, then the Media Stream exceeding real-time bandwidth in the unit interval is carried out do-nothing operation；Or,
The media stream data amount sent in increasing the unit interval according to default frame gap.
6. a media streaming networks self adaptation unilateral control system, is applied to media stream end, it is characterised in that this system bag
Include:
Cache module, buffered media stream；
Business sending module, takes out Media Stream from cache module and sends to receiving terminal；
Self-adaptive control module, monitors buffer data size and the taking-up data volume of described cache module in real time, if buffer data size
More than taking out data volume, then obtain real-time bandwidth, and according to described real-time bandwidth, trigger described business sending module to Media Stream
Selectivity send.
7. media streaming networks self adaptation unilateral control system as claimed in claim 6, it is characterised in that described Self Adaptive Control
Module obtains the mode of real-time bandwidth: obtain the buffer data size of described cache module more than taking out the default adaptive of data volume
Between Ying Shi, and the self adaptation point accumulation data volume of described cache module caching in this default auto-adaptive time；
According to default auto-adaptive time, self adaptation point accumulation data volume and the encoder bit rate of default cache module, calculate real
Time Bandwidth.
8. media streaming networks self adaptation unilateral control system as claimed in claim 7, it is characterised in that this system also includes:
Video encoding module, flow in cache module according to pre-arranged code code check storage media；
Described business sending module carries out the time of media stream selective transmission when being preset time threshold, described Self Adaptive Control
Module obtains the total amount of data in described cache module, if the total amount of data in described cache module is tired out more than or equal to self adaptation point
Volume data amount, described video encoding module, then according to pre-configured code media streams allocation list, reduces encoder bit rate.
9. media streaming networks self adaptation unilateral control system as claimed in claim 6, it is characterised in that described business sends mould
Block is to realize the selectivity to Media Stream by selective frame losing to send, and described business sending module specifically includes: send described
The I frame of Media Stream and the part P frame of this I frame of next-door neighbour.
10. media streaming networks self adaptation unilateral control system as claimed in claim 9, it is characterised in that described self-adaptive controlled
If molding block judges that described cache module recovers to buffer data size equal to taking out data volume, then trigger described business sending module
The Media Stream exceeding real-time bandwidth in unit interval is carried out do-nothing operation；Or, trigger described business sending module according to presetting
The media stream data amount that frame gap sends in increasing the unit interval.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610665952.4A CN106210785B (en) | 2016-08-12 | 2016-08-12 | Self-adaptive unidirectional control method and system for media stream network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610665952.4A CN106210785B (en) | 2016-08-12 | 2016-08-12 | Self-adaptive unidirectional control method and system for media stream network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106210785A true CN106210785A (en) | 2016-12-07 |
| CN106210785B CN106210785B (en) | 2019-12-13 |
Family
ID=57515358
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610665952.4A Active CN106210785B (en) | 2016-08-12 | 2016-08-12 | Self-adaptive unidirectional control method and system for media stream network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210785B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109429076A (en) * | 2017-08-31 | 2019-03-05 | 杭州海康威视系统技术有限公司 | The broadcasting Caton processing method and device of multi-medium data |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN110868373A (en) * | 2018-08-27 | 2020-03-06 | 浙江宇视科技有限公司 | Multimedia data transmission method, device and computer readable storage medium |
| CN117294851A (en) * | 2023-11-23 | 2023-12-26 | 此芯科技(上海)有限公司 | Video streaming processing device and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1848958A (en) * | 2005-04-14 | 2006-10-18 | 中兴通讯股份有限公司 | Method for transmitting video-frequency flow in network |
| CN1946079A (en) * | 2006-11-02 | 2007-04-11 | 北京大学 | Selective frame losing method for network bandwidth self adaptive flow medium transmission |
| US20070242080A1 (en) * | 2006-04-17 | 2007-10-18 | Koichi Hamada | Image display apparatus |
| CN101577672A (en) * | 2008-05-07 | 2009-11-11 | 中国移动通信集团公司 | Method, system and devices for transmitting data in streaming media service |
| CN102325274A (en) * | 2011-10-13 | 2012-01-18 | 浙江万里学院 | A kind of video flowing transfer control method of network bandwidth adaptive |
| CN103475902A (en) * | 2013-09-06 | 2013-12-25 | 同观科技（深圳）有限公司 | Video coding and network transmission method and video forwarding server |
| CN104301185A (en) * | 2014-11-06 | 2015-01-21 | 盛科网络（苏州）有限公司 | Message sending rate detection method and device |
-
2016
- 2016-08-12 CN CN201610665952.4A patent/CN106210785B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1848958A (en) * | 2005-04-14 | 2006-10-18 | 中兴通讯股份有限公司 | Method for transmitting video-frequency flow in network |
| US20070242080A1 (en) * | 2006-04-17 | 2007-10-18 | Koichi Hamada | Image display apparatus |
| CN1946079A (en) * | 2006-11-02 | 2007-04-11 | 北京大学 | Selective frame losing method for network bandwidth self adaptive flow medium transmission |
| CN101577672A (en) * | 2008-05-07 | 2009-11-11 | 中国移动通信集团公司 | Method, system and devices for transmitting data in streaming media service |
| CN102325274A (en) * | 2011-10-13 | 2012-01-18 | 浙江万里学院 | A kind of video flowing transfer control method of network bandwidth adaptive |
| CN103475902A (en) * | 2013-09-06 | 2013-12-25 | 同观科技（深圳）有限公司 | Video coding and network transmission method and video forwarding server |
| CN104301185A (en) * | 2014-11-06 | 2015-01-21 | 盛科网络（苏州）有限公司 | Message sending rate detection method and device |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109429076A (en) * | 2017-08-31 | 2019-03-05 | 杭州海康威视系统技术有限公司 | The broadcasting Caton processing method and device of multi-medium data |
| CN109996094A (en) * | 2017-12-29 | 2019-07-09 | 杭州海康威视系统技术有限公司 | Video broadcasting method, apparatus and system |
| CN110868373A (en) * | 2018-08-27 | 2020-03-06 | 浙江宇视科技有限公司 | Multimedia data transmission method, device and computer readable storage medium |
| CN117294851A (en) * | 2023-11-23 | 2023-12-26 | 此芯科技(上海)有限公司 | Video streaming processing device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210785B (en) | 2019-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113271316B (en) | Multimedia data transmission control method and device, storage medium and electronic equipment | |
| US7443797B2 (en) | Medium streaming distribution system | |
| KR101734835B1 (en) | A method and apparatus for retransmission decision making | |
| KR101242663B1 (en) | Packet transmission apparatus, communication system and computer-readable recording medium | |
| KR101644215B1 (en) | A method and apparatus for parsing a network abstraction-layer for reliable data communication | |
| EP2786537B1 (en) | Device for obtaining content by choosing the transport protocol according to the available bandwidth | |
| JP2004525556A (en) | Method and system for buffering streamed media | |
| CN105357592A (en) | Selective frame dropping method for streaming media adaptive transmission | |
| EP2710778B1 (en) | Method for dynamic adaptation of the reception bitrate and associated receiver | |
| CN108494454A (en) | Link-aware steaming transfer is adaptive | |
| WO2003009581A1 (en) | Video stream switching | |
| CN106341738A (en) | Streaming media network transmission bandwidth calculation method, server and system | |
| JP2003152544A (en) | Data communication system, data transmitter, data receiver, data-receiving method and computer program | |
| CN101552660A (en) | Method as well as device and communication system for retransmitting streaming media data | |
| JP4748729B2 (en) | Apparatus and method for preparing to transmit data and corresponding products | |
| CN104519325A (en) | Wireless video monitoring system self-adaptive guaranteeing method based on 4G network | |
| CN106210785A (en) | Media streaming networks self adaptation is unidirectionally controlled method and system | |
| CN103414956A (en) | Real-time data transmission method and system based on transmission control protocol | |
| US8379083B1 (en) | Simultaneous viewing and reliable recording of multimedia content over a network | |
| CN104104924A (en) | Third-generation (3G) network based video monitoring system bandwidth self-adaption transmission method | |
| CN117014608A (en) | Video stream code rate adjusting method, device, computer equipment and storage medium | |
| Kozlov et al. | Adaptive scheduling of MPEG video frames during real-time wireless video streaming | |
| JP2005033556A (en) | Data transmitter, data transmitting method, data receiver, data receiving method | |
| CN113542685B (en) | Real-time ultra-high definition video transmission method based on reliable UDP | |
| Yang et al. | Improve IoT streaming QoS by determining the message propotion in CoAP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |