CN101459852B - Method and device for predicting video service occurrence delay - Google Patents
Method and device for predicting video service occurrence delay Download PDFInfo
- Publication number
- CN101459852B CN101459852B CN 200810241546 CN200810241546A CN101459852B CN 101459852 B CN101459852 B CN 101459852B CN 200810241546 CN200810241546 CN 200810241546 CN 200810241546 A CN200810241546 A CN 200810241546A CN 101459852 B CN101459852 B CN 101459852B
- Authority
- CN
- China
- Prior art keywords
- video
- sequence number
- sdu
- frame
- receiving terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/24—Systems for the transmission of television signals using pulse code modulation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method and a device for predicting the generation of delay of video service, wherein the method comprises the following steps: predicting the serial number of a video frame which is currently played on a receiving end, obtaining the serial number of the video frame of a transmitting end, which waits to transmit, if the serial number of the video frame which is currently played at the receiving end is larger than or equal to the serial number of the video frame of the transmitting end, which waits to transmit, judging whether the video frame of the transmitting end, which waits to transmit, will generate the delay. The device comprises a first predicting unit for predicting the serial number of the video frame which is currently played on the receiving end, a first obtaining unit for obtaining the serial number of the video frame of the transmitting end, which waits to transmit, a first delay judging unit, if the serial number of the video frame predicted by the first predicting unit is larger than or equal to that of the video frame obtained by the first obtaining unit, the video frame obtained by the first obtaining unit can generate delay. The method and the device can predict whether the video frame which waits to transmit generates the delay from the network side.
Description
Technical field
The present invention relates to the communications field, particularly a kind of method and apparatus of predicting video service occurrence delay.
Background technology
Video traffic is data in real time to be downloaded to portable terminal from service end play, and its maximum characteristics are that the user needn't wait until that whole file is all downloaded and finishes, and only need can use through the startup time delay of several seconds or ten several seconds.
The host-host protocol that video traffic uses has RTP (Real-time Transport Protocol, RTP), RTCP (RTP Control Protocol, RTP Control Protocol) and RTSP (Real-Time StreamingProtocol, real-time stream media protocol).RTSP is being positioned on the architecture on RTP and the RTCP.It uses TCP or RTP to finish transfer of data.
In the prior art, transmitting terminal is divided into the plurality of RTP bag with a frame of video, then these RTP bags is transmitted for carrier sends in the wireless network with SDU (Service Data Unit, service data unit).As shown in Figure 1, it is the subpackage and carrying schematic diagram of frame of video.Receiving terminal receives SDU, thereby obtains the RTP bag, and the RTP package that will belong to same frame of video then synthesizes a frame of video, and the frame of video after will making up is at last play on a frame one frame ground in order.
Tending to occur frequency hopping, mosaic phenomenon in the video display process, mainly is that packet loss causes, comprising the time delay packet loss.Time delay packet loss implication is a terminal displaying video frame in order, and each frame all has fixing broadcast constantly, and incoming terminal just is referred to as time delay if video data is later than its broadcast moment, and these data can be abandoned by terminal without any use, promptly produce the time delay packet loss.
Whether prior art still can not time delay can take place in frame of video to be sent such as network side predictions.
Summary of the invention
The embodiment of the invention discloses and a kind ofly can predict whether video traffic the method and apparatus of time delay takes place at network side, to improve the efficient of video traffic transmission, described scheme is as follows:
The embodiment of the invention discloses a kind of method of predicting video service occurrence delay, comprising:
The sequence number of the in progress frame of video of prediction receiving terminal;
Obtain the sequence number of frame of video to be sent such as transmitting terminal;
If the sequence number of the in progress frame of video of described receiving terminal, judges that time delay can take place frame of video to be sent such as described transmitting terminal more than or equal to the sequence number of frame of video to be sent such as described transmitting terminal.
The embodiment of the invention also discloses a kind of method of predicting video service occurrence delay, comprising:
The sequence number of the SDU of the in progress frame of video of prediction receiving terminal;
Obtain the sequence number of SDU to be sent such as transmitting terminal;
If the sequence number of the SDU of the in progress frame of video of described receiving terminal is greater than or equal to the sequence number of SDU to be sent such as described transmitting terminal, judge that time delay can take place SDU to be sent such as described transmitting terminal.
The embodiment of the invention also discloses a kind of device of predicting video service occurrence delay, comprising:
First predicting unit is used to predict the sequence number of the in progress frame of video of receiving terminal;
First acquiring unit is used to obtain the sequence number of frame of video to be sent such as transmitting terminal;
The first time delay judging unit if be used for the sequence number that the sequence number of the frame of video of described first predicting unit prediction is greater than or equal to the frame of video that described first acquiring unit obtains, judges that time delay can take place the frame of video that described first acquiring unit obtains.
The embodiment of the invention also discloses a kind of device of predicting video service occurrence delay, comprising:
Second predicting unit is used to predict the sequence number of the SDU of the in progress frame of video of receiving terminal;
Second acquisition unit is used to obtain the sequence number of SDU to be sent such as transmitting terminal;
The 3rd time delay judging unit if be used for the sequence number that the sequence number of the SDU of described second predicting unit prediction is greater than or equal to the SDU that described second acquisition unit obtains, judges that time delay can take place the SDU that described second acquisition unit obtains.
Whether the method and apparatus that the embodiment of the invention provides can time delay can take place in the network side predicted video frame, so that network side takes appropriate measures, improves the efficient of Network Transmission.
Description of drawings
Fig. 1 is the corresponding relation of frame of video, RTP and SDU in the prior art;
A kind of flow chart of predicting the method for video service occurrence delay that Fig. 2 provides for the embodiment of the invention one;
A kind of flow chart of predicting the method for video service occurrence delay that Fig. 3 provides for the embodiment of the invention two;
A kind of structure chart of predicting the device of video service occurrence delay that Fig. 4 provides for the embodiment of the invention three;
A kind of structure chart of predicting the device of video service occurrence delay that Fig. 5 provides for the embodiment of the invention four;
Fig. 6 is first record sheet that used in the embodiment of the invention and the data structure diagram of second record sheet.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, several embodiments of the present invention are done detailed further description below in conjunction with accompanying drawing.
Embodiment one
Referring to Fig. 2, a kind of schematic diagram of predicting the method for video service occurrence delay for the embodiment of the invention one provides comprises the steps:
Promptly estimate the sequence number of the in progress frame of video of receiving terminal current time, adopt the sequence number of the timestamp of frame of video generally speaking as frame of video.
The sequence number of the in progress frame of video of prediction receiving terminal, its specific implementation for example, is obtained the playing duration of receiving terminal and the broadcasting speed of receiving terminal, estimates the sequence number of the in progress frame of video of current time receiving terminal then.
Perhaps, obtain the network feedback information RTCP bag of receiving terminal feedback, comprise one or more fields in this RTCP bag and carry the sequence number of receiving terminal, wrap the sequence number of estimating the in progress frame of video of receiving terminal by this RTCP decoded SDU.
Can use two ports when the application program of receiving terminal begins a RTP session: one is used for service data transmission to RTP, and one is used for transmitting control to RTCP.In the process of video traffic transmission, RTCP periodically report network feed back to transmitting terminal, so that transmitting terminal takes appropriate measures, as reliability control, flow control or the congested control etc. transmitted.
Concrete implementation method, for example, after the network side of transmitting terminal receives the network feedback information RTCP bag that comes from receiving terminal, from this network feedback information, parse the next sequence number (being the sequence number of SDU) that needs decoded RTP bag, by this sequence number, just can obtain the sequence number that this SDU wraps pairing frame of video, this frame of video is that the receiving terminal next one is with the frame of video that is played.
Can obtain next sequence number in the following way with the frame of video that is played.For example, design one first record sheet (referring to Fig. 6), the corresponding relation between the sequence number (being the sequence number of SDU) of record RTP bag and the sequence number of the frame of video under the SDU.After having obtained next sequence number with decoded SDU, just can retrieve sequence of frames of video number under the SDU from first record sheet, this sequence of frames of video number is exactly next sequence number with the frame of video that is played.
Then by the sequence number of this next one with the current in progress frame of video of sequence number estimation receiving terminal of the frame of video that is played.
Generally speaking, the sequence number of adjacent video frames differs a timestamp.For example, if frame per second is 10 frames/s, representation unit has 10 frames in the time, and the pairing successively timestamp of frame of video is 0,0.1 if the timestamp of frame since 0, can be extrapolated so, 0.2......0.9 1.0.If the sequence number of frame of video is 11.0, the sequence number of a then adjacent last frame of video is 10.9 just, and differing 1 timestamp between the sequence number is 0.1.Timestamp generally equals the inverse of frame per second, but may some deviation.
Therefore, can be set to a timestamp by estimated value, deduct this estimated value with the sequence number of the next frame of video that will play and can obtain the in progress frame of video of receiving terminal.If the comparison severity of network delay, receiving terminal also might be skipped the next frame of video of playing, in this case, can be set to zero or negative by estimated value, the absolute value of estimated value equals the integral multiple of timestamp, sequence number with the next frame of video of playing deducts this estimated value again, obtains the sequence number of the in progress frame of video of receiving terminal.
Estimated value also can be set to a coefficient relevant with the network delay situation, network delay is severe more, then estimated value should be more little, and the frame of video that will play with the receiving terminal next one deducts the sequence number that this estimated value obtains the in progress frame of video of receiving terminal then.
Network side also can be predicted the frame of video of the current broadcast of receiving terminal by alternate manner, for example, size according to the sequence number of frame of video, the sequence number of the frame of video that network side has successfully been sent all records in the record sheet, after the sequence number that obtains the frame of video that the next one will play, from this record sheet, retrieve immediate that frame of video of sequence number of the frame of video that to play with this next one.
It should be noted that the in progress frame of video of alleged receiving terminal herein, only is a kind of prediction, does not represent the frame of video of the current actual play of receiving terminal, also is not limited to the frame of video of receiving terminal actual play.Can use the frame of video of other frame of video fully as current broadcast.For example can be directly with the pairing frame of video of next RTP that needs to decode frame of video as current broadcast, perhaps the sequence number with this frame of video directly deducts certain numerical value as the in progress frame of video of receiving terminal.
Frame of video all is to transmit with the form of SDU, as the network side of transmitting terminal, also needs to obtain SDU from other network element, and simultaneously transmitting terminal may exist a plurality of SDU etc. to be sent.Transmitting terminal can from etc. select a SDU the SDU formation to be sent, obtain the frame of video under this SDU, this frame of video is frame of video to be sent such as transmitting terminal.
Its specific implementation for example, designs one second record sheet (referring to Fig. 6), only writes down the current SDU that needs transmission, and the corresponding relation between SDU and the affiliated frame of video.From second record sheet, select the SDU of sequence number minimum, and from second record sheet, obtain the sequence number of the frame of video under this SDU.After this SDU successfully sends, it is deleted from second record sheet.
Further, step 202 can only be obtained the sequence number of the pairing frame of video of SDU that needs re-transmission.SDU may make a mistake in transmission course, needs to retransmit, and retransmits above certain number of times time delay just takes place easily.Can adopt one second record sheet to realize this function, for example only write down the SDU that needs re-transmission in second record sheet, thereby further raise the efficiency.
If the sequence number of the in progress frame of video of receiving terminal is more than or equal to the sequence number of frame of video to be sent such as transmitting terminal, be the sequence number of the frame of video obtained more than or equal to step 202 of the sequence number of the frame of video of step 201 prediction, time delay can take place in the frame of video that determining step 202 obtains.
The inventor finds, generally, as user's receiving terminal, in time will first play sequence number little frame of video, back play sequence number big frame of video, sequence number itself has implied the information of reproduction time.
Therefore, if the sequence number of the in progress frame of video of receiving terminal is more than or equal to the sequence number of frame of video to be sent such as transmitting terminal, then the reproduction time of frame of video to be sent such as this transmitting terminal is over and done with, even if these frame of video to be sent arrive receiving terminals, time delay takes place its result; Otherwise if frame of video to be sent such as transmitting terminal time delay can not take place, then time delay also may not can take place than big frame of video of frame of video to be sent such as transmitting terminals in sequence number.
So, embodiment one may further include step, when can taking place, frame of video to be sent such as step 203 judgement transmitting terminal delay, obtain the sequence number of other frame of video to be sent such as described transmitting terminal, if frame of video to be sent such as described transmitting terminal time delay can not take place, judge that sequence number time delay can not take place than big frame of video of frame of video to be sent such as described transmitting terminals yet in described other frame of video.
Its implementation, for example, can utilize second record sheet of step 202, sequence number from small to large the mode of second record sheet according to frame of video sorted, if time delay can not take place in frame of video to be sent such as transmitting terminal, time delay can not take place in the frame of video that then comes in second record sheet below the frame of video to be sent such as transmitting terminal yet, so can greatly improve efficient.
Whether prior art still can not time delay can take place in the frame of video that the network side prediction does not send, present embodiment provides a kind of forecast method, can make things convenient for frame of video to be sent such as network side prediction whether time delay can take place, thereby take appropriate measures, improve networks efficiency.
Embodiment two
As shown in Figure 3, a kind of schematic diagram of predicting the method for video service occurrence delay for the embodiment of the invention two provides comprises the steps:
Promptly estimate the sequence number of the SDU of the in progress frame of video of receiving terminal current time.Its specific implementation, a kind of is by the playing duration of receiving terminal and the broadcasting speed of receiving terminal, estimates current time, the sequence number of the in progress frame of video of receiving terminal obtains the sequence number of a SDU of this frame of video then.
Another kind method is to calculate the sequence number of the SDU of the in progress frame of video of receiving terminal by network feedback information.For example, can be used for carrying the SDU sequence number that the receiving terminal next one will be decoded by in network feedback information, increasing a field.This sequence number has been arranged, just can obtain the sequence number of the pairing frame of video of SDU, utilized the sequence number of this frame of video can infer the sequence number of the in progress frame of video of receiving terminal, selected the sequence number of a SDU of in progress frame of video then.Particularly, can predict the sequence number of the SDU of the in progress frame of video of receiving terminal as follows.
The first step is obtained the current network feedback information that comes from described receiving terminal.
Promptly obtain the current network feedback information RTCP bag that comes from receiving terminal, the one or more fields in the RTCP bag have been carried the sequence number of the SDU that receiving terminal will be decoded.
In second step, resolve described network feedback information.
Promptly from network feedback information RTCP bag, resolve the next sequence number of receiving terminal with decoded SDU.
In the 3rd step, obtain the next sequence number of receiving terminal with decoded frame of video.
For example, can design one first record sheet, the corresponding relation between the sequence number (being the sequence number of SDU) of record RTP bag and the sequence number of the frame of video under the SDU.After having obtained next sequence number with decoded SDU, just can retrieve sequence of frames of video number under the SDU from first record sheet, this sequence of frames of video number is exactly next sequence number with the frame of video that is played.
The 4th step, the sequence number of the frame of video of the current broadcast of estimation receiving terminal.
Promptly utilize the sequence number of the 3rd next one that obtained of step, deduct an estimated value, just can estimate the sequence number of the current in progress frame of video of receiving terminal the frame of video that is played.Can be set to a timestamp by estimated value; If the comparison severity of network delay, receiving terminal also might be skipped the next frame of video of playing, in this case, can be set to zero or negative by estimated value, the absolute value of estimated value equals the integral multiple of timestamp.
The 5th goes on foot, and obtains a SDU of the frame of video that belongs to current broadcast.
The corresponding a plurality of SDU of frame of video, can be subordinated to and select a SDU among the SDU of the in progress frame of video of receiving terminal, for example select the sequence number of a SDU of sequence number maximum in the in progress frame of video, as the sequence number of the SDU of in progress frame of video.
Step 302 is obtained the sequence number of SDU to be sent such as transmitting terminal;
May there be SDU to be sent such as a plurality of in network side, transmitting terminal can from etc. select a SDU the SDU formation to be sent.
For example, use one second record sheet, write down the sequence number that all transmitting terminals are waited for the SDU that transmits, and the SDU of selection sequence number minimum is as SDU to be sent such as transmitting terminals.After this SDU sends successfully, be about to it and from second record sheet, delete.
Further, step 302 can only be obtained the sequence number of the SDU that needs re-transmission, and is bigger because the possibility of time delay takes place the SDU that retransmits.Can adopt second record sheet to realize this function, for example can only write down the sequence number of the SDU that needs re-transmission in second record sheet, thereby raise the efficiency.
Step 301 and 302 execution sequence can be changed mutually.
Step 303 judges whether SDU to be sent such as described transmitting terminal time delay can take place.
If the sequence number of the SDU of the in progress frame of video of described receiving terminal is greater than or equal to the sequence number of SDU to be sent such as described transmitting terminal, be the sequence number of the SDU that obtains more than or equal to step 302 of the sequence number of the SDU of step 301 prediction, judge that time delay can take place SDU to be sent such as described transmitting terminal.
The inventor finds, generally speaking, the sequence number of SDU is to sort according to from small to large mode, if the pairing frame of video of the SDU that sequence number is big has been played, the broadcast that the pairing frame of video of SDU that sequence number is little is described is constantly over and done with, if promptly time delay will take place this SDU arrival receiving terminal.
Further, present embodiment can also comprise the steps, the SDU that obtains at step 303 determining step 302 delays in the time of can taking place, and obtains the sequence number of other SDU to be sent such as transmitting terminal, judges that the big SDU of SDU that sequence number obtains than step 302 among described other SDU time delay can not take place yet.
In the prior art, can not predict whether the SDU of the frame of video that does not send as yet time delay can take place at network side, whether the SDU that present embodiment provides a kind of method can predict the frame of video that transmitting terminal etc. is to be sent time delay can take place, and deals with in advance thereby be convenient to network side.
Embodiment three
As shown in Figure 4, a kind of schematic representation of apparatus of predicting video service occurrence delay for the embodiment of the invention three provides comprises:
First predicting unit 401 is used to predict the sequence number of the in progress frame of video of receiving terminal.
Receiving terminal can wrap by feedback network information RTCP, in order to obtain the sequence number of the in progress frame of video of receiving terminal, need in RTCP bag, carry the sequence number of the SDU that the receiving terminal next one will decode, by this sequence number, just can calculate the sequence number of the current in progress frame of video of receiving terminal.
Specific implementation, for example, first predicting unit 401 comprises feedback information acquiring unit, computing unit.
The feedback information acquiring unit is used to obtain the current network feedback information that comes from receiving terminal, and described network feedback information comprises one or more fields, is used for carrying the sequence number of the SDU that receiving terminal will be decoded.
Computing unit, be used for after the feedback information acquiring unit receives the network feedback information RTCP that comes from receiving terminal, from this network feedback information, parse the next sequence number (being the sequence number of SDU) that needs decoded RTP bag, by this sequence number, just can obtain the sequence number of the affiliated frame of video of this SDU bag, this frame of video is that the receiving terminal next one is with the frame of video that is played, utilize next sequence number then, the sequence number of the current in progress frame of video of estimation receiving terminal with the frame of video that is played.Particularly, can estimate by following subelement:
The first record sheet unit is used to write down the corresponding relation between the sequence number of the sequence number (being the sequence number of SDU) of RTP bag and the frame of video under the SDU.
Resolve subelement, be used to resolve the network feedback information that the feedback information acquiring unit obtains, to obtain the next sequence number of described receiving terminal decoded SDU.
After having obtained next sequence number with decoded SDU, the estimation subelement just can retrieve the frame of video of resolving under the SDU that subelement parses from the first record sheet unit, and the sequence number of this frame of video is exactly the next one with the sequence number of the frame of video that is played.The sequence number that the next frame of video that is played has been arranged, the estimation subelement deducts an estimated value with the sequence number of this frame of video, just can estimate the sequence number of the current in progress frame of video of receiving terminal.As for estimated value, can be set to a timestamp by estimated value; If the comparison severity of network delay, receiving terminal also might be skipped the next frame of video of playing, in this case, can be set to zero or negative by estimated value, the absolute value of estimated value equals one or more timestamps.
The frame of video of current broadcast is used for predicting the possibility of frame of video generation time delay to be sent only as a kind of judgment standard.Various definite modes can be arranged, be not limited to the frame of video of actual play.
First acquiring unit 402 is used to obtain the sequence number of frame of video to be sent such as transmitting terminal.
Frame of video all is to transmit with the form of SDU, as the network side of transmitting terminal, may exist a plurality of SDU etc. to be sent.Transmitting terminal can from etc. select a SDU the SDU formation to be sent, obtain the frame of video under this SDU, this frame of video is frame of video to be sent such as transmitting terminal.
For example, first acquiring unit 402 can comprise one second record sheet unit, and all need send to the SDU of reception to be used to be recorded in transmitting terminal, and the corresponding relation between SDU and the affiliated frame of video; First acquiring unit 402 also comprises a retrieval subelement, be used for selecting the SDU of sequence number minimum from the second record sheet unit, and from second record sheet, obtain the sequence number of the frame of video under this SDU, after this SDU successfully sends, it is deleted from second record sheet.
Time delay judging unit 403 is used to judge whether frame of video to be sent such as transmitting terminal time delay takes place.
If the sequence number of the frame of video that the transmitting terminal that the sequence number of the in progress frame of video of receiving terminal of first predicting unit, 401 predictions obtains more than or equal to first acquiring unit 402 etc. are to be sent judges that then time delay can take place the frame of video to be sent such as transmitting terminal that first acquiring unit 402 obtains.
The inventor finds, generally, as user's receiving terminal, in time will first play sequence number little frame of video, back play sequence number big frame of video, sequence number itself has implied the information of reproduction time.Therefore, if the sequence number of the in progress frame of video of receiving terminal is greater than the sequence number of frame of video to be sent such as transmitting terminal, then the reproduction time of frame of video to be sent such as this transmitting terminal is over and done with, even if these frame of video to be sent arrive receiving terminals, time delay takes place its result.
Present embodiment can further include the second time delay judging unit, be used to obtain other frame of video (not comprising the frame of video that first acquiring unit 402 obtains) to be sent such as transmitting terminal, if the first time delay judging unit 403 judges that the frame of video that first acquiring unit 402 obtains time delay can not take place, and judges that the big frame of video of sequence number that sequence number obtains than first acquiring unit 402 in described other frame of video time delay can not take place yet.
In the prior art, network side can not predict as yet whether the frame of video that sends time delay can not take place, and present embodiment provides a kind of device can predict that whether frame of video to be sent such as transmitting terminal time delay can take place, and deals with in advance thereby be convenient to network side.
Embodiment four
As shown in Figure 5, a kind of schematic representation of apparatus of predicting video service occurrence delay for the embodiment of the invention four is provided comprises:
Predict the in progress frame of video of receiving terminal, obtain the sequence number of a SDU of in progress frame of video.
Can carry the SDU sequence number that the receiving terminal next one will be decoded by network feedback information.This sequence number has been arranged, just can obtain the sequence number of the pairing frame of video of SDU, the sequence number of this frame of video can be inferred the sequence number of the in progress frame of video of receiving terminal, selects the sequence number of a SDU of an in progress frame of video then.
Specific implementation, for example, second predicting unit can comprise following subelement: the first record sheet unit, network feedback information acquiring unit, parsing subelement, estimation subelement and inquiry word unit.
The first record sheet unit is used to write down the corresponding relation between the sequence number of the sequence number (being the sequence number of SDU) of RTP bag and the frame of video under the SDU.
The network feedback information acquiring unit is used to obtain the current network feedback information that comes from described receiving terminal, and described network feedback information comprises the next sequence number with decoded SDU of described receiving terminal.
Resolve subelement, be used to resolve the network feedback information that described network feedback information acquiring unit obtains, to obtain the next sequence number of described receiving terminal decoded SDU.
The estimation subelement, be used for after the parsing subelement obtains next sequence number with decoded SDU, retrieve the sequence of frames of video number under this SDU from the first record sheet unit, this sequence of frames of video number is exactly next sequence number with the frame of video that is played, and the sequence number of this frame of video is deducted the sequence number that an estimated value can estimate the in progress frame of video of receiving terminal.As for the size of estimated value, can be set to a timestamp, if the comparison severity of network delay, receiving terminal also might be skipped the next frame of video of playing, in this case, can be set to zero or negative by estimated value, the absolute value of estimated value equals one or more timestamp.
The inquiry subelement is used for from the SDU of the in progress frame of video of described first record sheet unit retrieval genus, owing to the corresponding a plurality of SDU of a frame of video, can select the sequence number of a SDU of sequence number maximum in the in progress frame of video.
May there be SDU to be sent such as a plurality of in network side, second acquisition unit 502 can from etc. select a SDU the SDU formation to be sent.
For example, use one second record sheet, write down the sequence number that all transmitting terminals are waited for the SDU that transmits, and the SDU of selection sequence number minimum is as SDU to be sent such as transmitting terminals.After this SDU sends successfully, be about to it and from second record sheet, delete.
The 3rd time delay judging unit 503 is used to judge whether SDU to be sent such as described transmitting terminal time delay can take place.
If the sequence number that second predicting unit 501 is predicted is greater than or equal to the sequence number that second acquisition unit 502 is obtained, time delay can take place in the SDU that second acquisition unit 502 obtains.
The inventor finds, generally speaking, the sequence number of SDU is to sort according to from small to large mode, if the pairing frame of video of the SDU that sequence number is big has been played, the broadcast that the pairing frame of video of SDU that sequence number is little is described is constantly over and done with, if promptly time delay will take place this SDU arrival receiving terminal.
Further, present embodiment can also comprise the 4th time delay judging unit, be used to obtain other SDU to be sent such as transmitting terminal, if the SDU that second acquisition unit 502 obtains time delay can not take place, judge that the big SDU of SDU that sequence number obtains than second acquisition unit 502 among other SDU time delay can not take place yet.
In the prior art, network side can not predict as yet whether the SDU that sends time delay can not take place, and present embodiment provides a kind of device can predict that whether SDU to be sent such as transmitting terminal time delay can take place, and deals with in advance thereby be convenient to network side.
The above inventive embodiments can realize that corresponding software can be stored in the storage medium that can read, for example in the hard disk of computer, CD or the floppy disk by software.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, within the spirit and principles in the present invention not all, any modification of being done, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (12)
1. a method of predicting video service occurrence delay is characterized in that, described method comprises:
The sequence number of the in progress frame of video of prediction receiving terminal;
Obtain the sequence number of frame of video to be sent such as transmitting terminal;
If the sequence number of the in progress frame of video of described receiving terminal, judges that time delay can take place frame of video to be sent such as described transmitting terminal more than or equal to the sequence number of frame of video to be sent such as described transmitting terminal;
Wherein, the sequence number of the in progress frame of video of described prediction receiving terminal comprises, obtain the current network feedback information that comes from receiving terminal, described network feedback information comprises the next sequence number with decoded SDU of described receiving terminal, utilizes described network feedback information to estimate the sequence number of the in progress frame of video of described receiving terminal.
2. the method for claim 1 is characterized in that, the described step of utilizing described network feedback information to predict the sequence number of the in progress frame of video of described receiving terminal comprises:
From described network feedback information, parse the next sequence number of described receiving terminal with decoded SDU;
Obtain the next sequence number that will the frame of video under the decoded SDU of described receiving terminal from first record sheet, described first record sheet has write down the corresponding relation between the affiliated frame of video of SDU and SDU;
With the next sequence number of described receiving terminal, deduct the sequence number of a resulting result of estimated value as the in progress frame of video of described receiving terminal with the frame of video under the decoded SDU.
3. the method for claim 1 is characterized in that, the described step of obtaining the sequence number of frame of video to be sent such as transmitting terminal comprises:
Obtain the SDU of sequence number minimum from second record sheet, described second record sheet has write down the sequence number of frame of video under SDU formation to be sent such as current of described transmitting terminal and the SDU to be sent such as described;
Obtain the sequence number of the frame of video under the SDU of described sequence number minimum from described second record sheet, as the sequence number of frame of video to be sent such as described transmitting terminal.
4. the method for claim 1 is characterized in that, described method also comprises:
Obtain the sequence number of other frame of video to be sent such as described transmitting terminal, if frame of video to be sent such as described transmitting terminal time delay can not take place, judge that sequence number time delay can not take place than big frame of video of frame of video to be sent such as described transmitting terminals yet in described other frame of video.
5. a method of predicting video service occurrence delay is characterized in that, described method comprises:
The sequence number of the SDU of the in progress frame of video of prediction receiving terminal;
Obtain the sequence number of SDU to be sent such as transmitting terminal;
If the sequence number of the SDU of the in progress frame of video of described receiving terminal is greater than or equal to the sequence number of SDU to be sent such as described transmitting terminal, judge that time delay can take place SDU to be sent such as described transmitting terminal;
Wherein, the sequence number of the SDU of the in progress frame of video of described prediction receiving terminal comprises:
Obtain the current network feedback information that comes from described receiving terminal, described network feedback information comprises the next sequence number with decoded SDU of described receiving terminal;
Resolve described network feedback information, obtain the next sequence number of described receiving terminal decoded SDU;
Obtain the next sequence number that will the frame of video under the decoded SDU of described receiving terminal from first record sheet, described first record sheet has write down the corresponding relation between the affiliated frame of video of SDU and SDU;
The next sequence number with the frame of video under the decoded SDU of described receiving terminal is deducted the sequence number of a resulting result of estimated value as the frame of video of current broadcast;
Retrieval belongs to the SDU of the frame of video of described current broadcast from described first record sheet, gets the sequence number of the SDU of sequence number maximum.
6. method as claimed in claim 5 is characterized in that, described method also comprises:
Obtain the sequence number of other SDU to be sent such as transmitting terminal,, judge that sequence number time delay can not take place than big SDU of SDU to be sent such as described transmitting terminals among described other SDU yet if time delay can not take place SDU to be sent such as described transmitting terminal.
7. a device of predicting video service occurrence delay is characterized in that, described device comprises:
First predicting unit is used to predict the sequence number of the in progress frame of video of receiving terminal;
First acquiring unit is used to obtain the sequence number of frame of video to be sent such as transmitting terminal;
The first time delay judging unit if be used for the sequence number that the sequence number of the frame of video of described first predicting unit prediction is greater than or equal to the frame of video that described first acquiring unit obtains, judges that time delay can take place the frame of video that described first acquiring unit obtains;
Wherein, described first predicting unit comprises:
The feedback information acquiring unit is used to obtain the current network feedback information that comes from receiving terminal, and described network feedback information is included in the next sequence number with decoded SDU of described receiving terminal;
Computing unit, the network feedback information that is used for obtaining according to described feedback information acquiring unit is estimated the sequence number of the in progress frame of video of described receiving terminal.
8. device as claimed in claim 7 is characterized in that, described computing unit comprises:
The first record sheet unit is used to write down the corresponding relation between SDU and the frame of video;
Resolve subelement, be used to resolve the network feedback information that described feedback information acquiring unit obtains, to obtain the next sequence number of described receiving terminal decoded SDU;
The estimation subelement is used for obtaining from the described first record sheet unit sequence number of the frame of video under the SDU that described parsing subelement resolved, and deducts the sequence number of a resulting result of estimated value as the in progress frame of video of described receiving terminal.
9. device as claimed in claim 7 is characterized in that, described first acquiring unit comprises:
The second record sheet unit is used to write down the sequence number that described transmitting terminal is waiting frame of video under SDU formation to be sent and the SDU to be sent such as described;
The retrieval subelement is used for obtaining from the described second record sheet unit sequence number of the frame of video under the SDU of sequence number minimum, as the sequence number of frame of video to be sent such as described transmitting terminal.
10. device as claimed in claim 9 is characterized in that, described device also comprises:
The second time delay judging unit, be used to obtain other frame of video to be sent such as transmitting terminal, if the frame of video that described first acquiring unit of the described first time delay judgment unit judges obtains time delay can not take place, judge that the big frame of video of sequence number that sequence number obtains than described first acquiring unit in described other frame of video time delay can not take place yet.
11. a device of predicting video service occurrence delay is characterized in that, described device comprises:
Second predicting unit is used to predict the sequence number of the SDU of the in progress frame of video of receiving terminal;
Second acquisition unit is used to obtain the sequence number of SDU to be sent such as transmitting terminal;
The 3rd time delay judging unit if be used for the sequence number that the sequence number of the SDU of described second predicting unit prediction is greater than or equal to the SDU that described second acquisition unit obtains, judges that time delay can take place the SDU of described second acquisition unit prediction;
Wherein, described second predicting unit comprises:
The first record sheet unit is used to write down the corresponding relation between SDU and the frame of video;
The network feedback information acquiring unit is used to obtain the current network feedback information that comes from described receiving terminal, and described network feedback information comprises the next sequence number with decoded SDU of described receiving terminal;
Resolve subelement, be used to resolve the network feedback information that described network feedback information acquiring unit obtains, to obtain the next sequence number of described receiving terminal decoded SDU;
The estimation subelement is used for obtaining from the described first record sheet unit sequence number of the frame of video under the SDU that described parsing subelement resolved, and deducts the sequence number that an estimated value obtains the in progress frame of video of described receiving terminal;
The inquiry subelement is used for belonging to from the retrieval of the described first record sheet unit SDU of the frame of video that described estimation subunit computes goes out, and gets the sequence number of the SDU of sequence number maximum.
12. device as claimed in claim 11 is characterized in that, described device also comprises:
The 4th time delay judging unit, be used to obtain other SDU to be sent such as transmitting terminal, if the SDU that the described second acquisition unit of described the 3rd time delay judgment unit judges obtains time delay can not take place, judge that the big SDU of SDU that sequence number obtains than described second acquisition unit among described other SDU time delay can not take place yet.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810241546 CN101459852B (en) | 2008-12-22 | 2008-12-22 | Method and device for predicting video service occurrence delay |
| PCT/CN2009/074452 WO2010072099A1 (en) | 2008-12-22 | 2009-10-14 | Method and apparatus for prediction of time delay of video service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810241546 CN101459852B (en) | 2008-12-22 | 2008-12-22 | Method and device for predicting video service occurrence delay |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101459852A CN101459852A (en) | 2009-06-17 |
| CN101459852B true CN101459852B (en) | 2011-04-13 |
Family
ID=40770431
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200810241546 Active CN101459852B (en) | 2008-12-22 | 2008-12-22 | Method and device for predicting video service occurrence delay |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN101459852B (en) |
| WO (1) | WO2010072099A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101459852B (en) * | 2008-12-22 | 2011-04-13 | 华为技术有限公司 | Method and device for predicting video service occurrence delay |
| CN102063924B (en) * | 2009-11-18 | 2015-07-15 | 新奥特（北京）视频技术有限公司 | Method and device for playing animation |
| CN106982371B (en) * | 2016-12-09 | 2020-08-11 | 上海谐桐信息技术有限公司 | Code stream control method and system, code stream management method and system, and terminal equipment |
| CN111654690A (en) * | 2020-05-06 | 2020-09-11 | 北京百度网讯科技有限公司 | Live video delay time determination method and device and electronic equipment |
| CN112507163B (en) * | 2020-12-02 | 2023-07-21 | 北京奇艺世纪科技有限公司 | Duration prediction model training method, recommendation method, device, equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941737A (en) * | 2005-09-30 | 2007-04-04 | 富士通株式会社 | Method and device for pre-determining time delay in node, and method and device for guarantee of time delay |
| CN101141639A (en) * | 2007-09-28 | 2008-03-12 | 上海华为技术有限公司 | Method and device for identifying stream media video frame boundary |
| CN101296184A (en) * | 2008-05-30 | 2008-10-29 | 华为技术有限公司 | Method, system and device for data transmission |
| CN101321286A (en) * | 2008-06-27 | 2008-12-10 | 上海华为技术有限公司 | Method and device for computing caching of terminal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100592547B1 (en) * | 2003-06-03 | 2006-06-23 | 서울시립대학교 산학협력단 | Packet scheduling method for streaming multimedia |
| CN101459852B (en) * | 2008-12-22 | 2011-04-13 | 华为技术有限公司 | Method and device for predicting video service occurrence delay |
-
2008
- 2008-12-22 CN CN 200810241546 patent/CN101459852B/en active Active
-
2009
- 2009-10-14 WO PCT/CN2009/074452 patent/WO2010072099A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941737A (en) * | 2005-09-30 | 2007-04-04 | 富士通株式会社 | Method and device for pre-determining time delay in node, and method and device for guarantee of time delay |
| CN101141639A (en) * | 2007-09-28 | 2008-03-12 | 上海华为技术有限公司 | Method and device for identifying stream media video frame boundary |
| CN101296184A (en) * | 2008-05-30 | 2008-10-29 | 华为技术有限公司 | Method, system and device for data transmission |
| CN101321286A (en) * | 2008-06-27 | 2008-12-10 | 上海华为技术有限公司 | Method and device for computing caching of terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010072099A1 (en) | 2010-07-01 |
| CN101459852A (en) | 2009-06-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106792073B (en) | Method, playback equipment and the system that the audio, video data of striding equipment is played simultaneously | |
| CN111586480B (en) | Low-delay streaming media | |
| US8332486B2 (en) | Apparatus and method for multimedia file streaming in portable terminal | |
| RU2292657C2 (en) | Quantization of time on basis of clock impulses | |
| KR100492567B1 (en) | Http-based video streaming apparatus and method for a mobile communication system | |
| CN104040992B (en) | There is the Media Stream of improved efficiency in mobile network | |
| CN101422036B (en) | Method and system for managing video data based on a predicted next channel selection | |
| CN101674486B (en) | Streaming media audio and video synchronization method and system | |
| CN109889543A (en) | Method, root node, child node, P2P server and the system of transmission of video | |
| CN101459852B (en) | Method and device for predicting video service occurrence delay | |
| CN103560848A (en) | Techniques for utilization of spare bandwidth | |
| CN102948126A (en) | Method and apparatus for generating and handling streaming media quality-of-experience metrics | |
| US20090222576A1 (en) | Method and apparatus for reducing power consumption of a network communication device receiving streaming content via an ip-based network | |
| CN102006605A (en) | Methods and apparatus to identify wireless carrier performance effects | |
| MX2013015115A (en) | Technique for managing streaming media traffic at a network entity. | |
| WO2015058590A1 (en) | Control method, device and system for live broadcast of video, and storage medium | |
| EP1806870B1 (en) | Method for providing data and data transmission system | |
| CN103125108B (en) | Set up the system and method that emission control agreement connects | |
| CN102055718A (en) | Method, device and system for layering request content in http streaming system | |
| CN101827251A (en) | Method and device for playing network streaming media | |
| CN102387409A (en) | Method for video playing and based on stream media system | |
| CN104581340A (en) | Client-side, streaming media data receiving method and streaming media data transmission system | |
| JP2005051299A (en) | Packet transmission apparatus, packet reception apparatus, packet transmission method and packet reception method | |
| KR20080062692A (en) | Stream recording method, apparatus and system | |
| CN107302504B (en) | Multipath transmission scheduling method and system based on virtual sending queue |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |