WO2010072099A1

WO2010072099A1 - Method and apparatus for prediction of time delay of video service

Info

Publication number: WO2010072099A1
Application number: PCT/CN2009/074452
Authority: WO
Inventors: 周素萍; 李斌; 谷安文; 陈玉芳; 叶建涛
Original assignee: 华为技术有限公司
Priority date: 2008-12-22
Filing date: 2009-10-14
Publication date: 2010-07-01
Also published as: CN101459852A; CN101459852B

Abstract

The present invention discloses a method and an apparatus for prediction of time delay of video service, and said method includes: predicting the sequence number of the video frame being displayed in the receiver; obtaining the sequence number of the video frame waiting for being sent in the transmitter; judging the time delay would happen to the video frame waiting for being sent in the transmitter, if the sequence number of the video frame being displayed in said receiver is greater than or equal to the sequence number of the video frame waiting for being sent in said transmitter. Said apparatus comprises: the 1st prediction unit for predicting the sequence number of the video frame being displayed in the receiver; the 1st obtaining unit for obtaining the sequence number of the video frame waiting for being sent in the transmitter; the 1st time delay judging unit for judging the time delay would happen to the video frame obtained by said 1st obtaining unit, if the sequence number of the video frame predicted by said 1st prediction unit is greater than or equal to the sequence number of the video frame obtained by said 1st obtaining unit. Said method and apparatus are able to predict whether the time delay would happen to the video frame waiting for being sent or not on the network side.

Description

METHOD AND APPARATUS FOR PREDICTING TIME TENDENCY OF VIDEO SERVICE This application claims to be filed on Dec. 22, 2008, the Chinese Patent Application No. 200810241546.0, entitled "Method and Apparatus for Predicting Time Delay of Video Services" Priority is hereby incorporated by reference in its entirety. Technical field

The present invention relates to the field of communications, and in particular, to a method and apparatus for predicting a delay of a video service. Background technique

The video service downloads data from the server to the mobile terminal in real time for playback. The biggest feature is that the user does not have to wait until the entire file has been downloaded, and only needs a few seconds or ten seconds of startup delay to use.

The transmission protocols used by the video service include RTP (Real-time Transport Protocol), RTCP (RTP Control Protocol), and Real-Time Streaming Protocol (RTSP). RTSP is architecturally located on top of RTP and RTCP. It uses TCP or RTP for data transfer.

In the prior art, the transmitting end divides a video frame into several RTP packets, and then these

The RTP packet is transmitted to the wireless network by using an SDU (Service Data Unit) as a carrier for transmission. As shown in FIG. 1, it is a schematic diagram of packetization and bearer of a video frame. The receiving end receives the SDU, thereby obtaining the RTP packet, and then combining the RTP packets belonging to the same video frame into one video frame, and finally playing the combined video frames one frame at a time in sequence.

Frequency hopping and mosaic phenomena often occur during video playback, mainly due to packet loss, including delay packet loss. The delay is lost. The terminal plays the video frame in sequence, and each frame has a fixed playing time. If the video data arrives at the terminal later than the playing time, it is called a delay. The data has no use and will be discarded by the terminal, that is, the delay packet is lost.

The prior art cannot predict whether a video frame waiting to be transmitted will have a delay on the network side. Summary of the invention

The embodiment of the invention discloses a method and a device for predicting whether a video service has a delay on the network side, so that the network side can take corresponding measures in time to improve the efficiency of video service transmission. The solution is as follows:

The embodiment of the invention discloses a method for predicting the delay of a video service, which comprises: predicting a sequence number of a video frame being played by the receiving end;

Obtaining a sequence number of a video frame that the transmitting end is waiting to send;

If the sequence number of the video frame being played by the receiving end is greater than or equal to the sequence number of the video frame waiting to be sent by the transmitting end, it is determined that the video frame waiting for the sending end of the transmitting end is delayed.

The embodiment of the invention further discloses a method for predicting a delay of a video service, comprising: predicting a sequence number of an SDU of a video frame being played by the receiving end;

Obtaining the serial number of the SDU that the sender waits to send;

If the sequence number of the SDU of the video frame being played by the receiving end is greater than or equal to the sequence number of the SDU that the transmitting end is waiting to send, it is determined that the SDU waiting to be sent by the transmitting end has a delay.

The embodiment of the present invention further discloses an apparatus for predicting a delay of a video service, comprising: a first prediction unit, configured to predict a sequence number of a video frame being played by the receiving end; and a first acquiring unit, configured to acquire a sending end a sequence number of the transmitted video frame, where the first time delay determining unit is configured to determine, if the sequence number of the video frame predicted by the first prediction unit is greater than or equal to the sequence number of the video frame acquired by the first acquiring unit, The video frame acquired by the first acquiring unit will have a delay.

The embodiment of the invention further discloses an apparatus for predicting a delay of a video service, which comprises: a second prediction unit, configured to: predict a sequence number of the SDU of the video frame being played by the receiving end; a second acquiring unit, configured to acquire a sequence number of the SDU that the transmitting end is waiting to send; and a third time delay determining unit, configured to The sequence number of the SDU predicted by the second prediction unit is greater than or equal to the sequence number of the SDU acquired by the second acquiring unit, and the SDU obtained by the second acquiring unit is determined to have a delay.

The method and the device provided by the embodiments of the present invention can predict whether a video frame will have a delay on the network side, so that the network side takes corresponding measures to improve the efficiency of network transmission. DRAWINGS

FIG. 1 is a correspondence between a video frame, an RTP, and an SDU in the prior art;

2 is a flow chart of a method for predicting a delay of a video service according to Embodiment 1 of the present invention;

3 is a flow chart of a method for predicting a delay of a video service according to Embodiment 2 of the present invention;

4 is a structural diagram of an apparatus for predicting a delay of a video service according to Embodiment 3 of the present invention;

FIG. 5 is a structural diagram of an apparatus for predicting a delay of a video service according to Embodiment 4 of the present invention;

Figure 6 is a diagram showing the data structure of the first record table and the second record table used in the embodiment of the present invention. detailed description

In order to make the objects, technical solutions and advantages of the present invention more comprehensible, several embodiments of the present invention will be described in detail below.

Embodiment 1

Referring to FIG. 2, a method for predicting a delay of a video service according to Embodiment 1 of the present invention is provided. The flow chart of the method includes the following steps:

Step 201: Prediction of a sequence number of a video frame being played by the receiving end.

That is, the sequence number of the video frame currently being played by the receiving end is estimated. Generally, the time stamp of the video frame is used as the serial number of the video frame.

Predicting the sequence number of the video frame being played by the receiving end, for example, obtaining the playing duration of the receiving end and the playing speed of the receiving end, and then estimating the sequence number of the video frame being played by the receiving end at the current moment.

Or obtaining a network feedback information RTCP packet fed back by the receiving end, where the RTCP packet includes one or more fields carrying a sequence number of the SDU to be decoded by the receiving end, and estimating the sequence of the video frame being played by the receiving end by using the RTCP packet number.

When the receiving application starts an RTP session, it uses two ports: one for RTP to transmit service data and one for RTCP for transmission control. In the process of video service transmission, RTCP periodically reports network feedback information to the sender, so that the sender can take corresponding measures, such as reliability control, flow control or congestion control.

The RTCP packet is used to estimate the sequence number of the video frame being played by the receiving end. For example, when the network side of the transmitting end receives the network feedback information RTCP packet from the receiving end, it parses out the network feedback information. The sequence number of the next RTP packet to be decoded (ie, the sequence number of the SDU), through which the sequence number of the video frame corresponding to the SDU packet is obtained, and the video frame is the next receiver to be played. Video frame. The sequence number of the video frame currently being played by the receiving end is then estimated by the sequence number of the next video frame to be played.

The sequence number of the next video frame to be played can be obtained as follows. For example, a first record table (see FIG. 6) is designed to record the correspondence between the sequence number of the RTP packet (ie, the sequence number of the SDU) and the sequence number of the video frame to which the SDU belongs. After obtaining the serial number of the next SDU to be decoded, the sequence of the video frame to which the SDU belongs can be retrieved from the first record table, and the sequence number of the video frame is the sequence of the next video frame to be played. Column number.

The sequence number of the video frame currently being played by the receiving end is then estimated by the sequence number of the next video frame to be played.

In general, the sequence numbers of adjacent video frames differ by one time stamp. For example, if the frame rate is 10 frames/s, which means that there are 10 frames per unit time, if the timestamp of the frame starts from 0, then the timestamp corresponding to the video frame can be inferred to be 0, 0.1, 0.2... ..0.9 1.0. If the sequence number of the video frame is 11.0, the sequence number of the adjacent previous video frame is 10.9, and the sequence number differs by 1 time stamp, that is, 0.1. The timestamp is generally equal to the reciprocal of the frame rate, but there may be some deviation.

Therefore, the estimated value can be set to a time stamp, and the video frame being played by the receiving end can be obtained by subtracting the estimated value from the sequence number of the next video frame to be played. If the network delay is too strong, it is also possible for the receiving end to skip the next played video frame. In this case, the estimated value can be set to zero or negative, and the absolute value of the estimated value is equal to an integer multiple of the timestamp. The serial number of the next played video frame is subtracted from the estimated value to obtain the sequence number of the video frame being played by the receiving end.

The estimated value can also be set to a coefficient related to the network delay condition. The more the network delay is, the smaller the estimated value should be. Then, the video value of the next video frame to be played by the receiving end is subtracted from the estimated value to obtain the video being played by the receiving end. The serial number of the frame.

The network side can also predict the video frame currently being played by the receiving end by using other methods. For example, according to the sequence number of the video frame, all the serial numbers of the video frames that have been successfully sent by the network side are recorded in the record table, and the next one is obtained. After the serial number of the video frame to be played, the video frame closest to the sequence number of the next video frame to be played is retrieved from the record table.

It should be noted that the video frame being played by the receiving end is only a kind of prediction, and does not represent the video frame actually played by the receiving end, nor is it limited to the video frame actually played by the receiving end. Other video frames can also be used as the currently playing video frame: for example, it can be directly The video frame corresponding to the next RTP that needs to be decoded is used as the currently played video frame, or the sequence number of the video frame is directly subtracted by a certain value as the video frame being played by the receiving end.

Step 202: Acquire a sequence number of a video frame that the sending end is waiting to send.

The video frames are transmitted in the form of SDUs. As the network side of the transmitting end, the SDUs need to be obtained from other network elements. At the same time, there may be multiple SDUs waiting to be sent at the transmitting end. The sender can select an SDU from the SDU queue that is waiting to be sent, and obtain the video frame to which the SDU belongs. The video frame is the video frame that the sender waits to send.

The specific implementation manner, for example, designing a second record table (see FIG. 6), only records the SDU currently needed to be transmitted, and the correspondence between the SDU and the belonging video frame. The SDU with the smallest sequence number is selected from the second record table, and the sequence number of the video frame to which the SDU belongs is obtained from the second record table. When the SDU is successfully sent, it is deleted from the second record table.

Further, step 202 may only obtain the sequence number of the video frame corresponding to the SDU that needs to be retransmitted. SDUs may have errors during transmission and need to be retransmitted. If the retransmission exceeds a certain number of times, delays are likely to occur. This function can be implemented using a second record table, for example, only the SDUs that need to be retransmitted are recorded in the second record table, thereby further improving efficiency.

The order of execution of steps 201 and 202 can be interchanged.

Step 203: Determine whether a delay occurs in the video frame that the sending end waits for sending.

If the sequence number of the video frame being played by the receiving end is greater than or equal to the sequence number of the video frame that the transmitting end is waiting to send, that is, the sequence number of the video frame predicted by step 201 is greater than or equal to the sequence number of the video frame obtained in step 202, and the determining step The video frame acquired by 202 will have a delay.

The inventor has found that, in general, as the receiving end of the user, the video frame with a small serial number will be played in time, and then the video frame with a large serial number will be played, and the serial number itself implies the information of the playing time.

Therefore, if the sequence number of the video frame being played by the receiving end is greater than or equal to the sequence number of the video frame that the transmitting end is waiting to transmit, the playing time of the video frame waiting for the sending end of the transmitting end has passed, even if the video frame waiting to be sent arrives. At the receiving end, the result is also a delay; on the contrary, If the video frame waiting to be sent by the transmitting end does not have a delay, the video frame whose sequence number is larger than the video frame that the transmitting end is waiting to transmit may not have a delay.

Therefore, the first embodiment may further include the step of: after determining, in step 203, that the video frame waiting to be sent by the transmitting end is delayed, acquiring a sequence number of other video frames that the transmitting end is waiting to send, if the sending end is waiting to be sent. The video frame does not have a delay, and it is judged that the video frame in the other video frames is larger than the video frame that the transmitting end is waiting to transmit.

For example, the second record table of step 202 may be used to sort the second record table according to the sequence number of the video frame from small to large. If the video frame waiting for the sending end does not delay, the time is not delayed. The video frame below the video frame waiting to be transmitted by the transmitting end in the second recording table does not have a delay, which can greatly improve the efficiency.

In the prior art, it is not possible to predict whether a non-transmitted video frame will have a delay in the network. This embodiment provides a method for predicting whether the network side predicts whether a video frame waiting to be sent will be delayed, and accordingly Measures to improve the efficiency of the network.

Embodiment 2

As shown in FIG. 3, a flowchart of a method for predicting a delay of a video service according to Embodiment 2 of the present invention includes the following steps:

Step 301: Predict a sequence number of an SDU of a video frame being played by the receiving end.

That is, the sequence number of the SDU of the video frame currently being played by the receiving end is estimated. The specific implementation manner is that, by using the playing duration of the receiving end and the playing speed of the receiving end, the serial number of the video frame being played by the receiving end is estimated at the current moment, and then the serial number of an SDU of the video frame is obtained.

Another method is to calculate the sequence number of the SDU of the video frame being played by the receiving end through the network feedback information. For example, a field may be added to the network feedback information to carry the next SDU sequence number to be decoded at the receiving end. With this serial number, the serial number of the video frame corresponding to the SDU can be obtained, and the serial number of the video frame being played by the receiving end can be estimated by using the serial number of the video frame, and then an SDU of the video frame being played is selected. Serial number. Specifically, the following steps can be used to predict the video frame being played by the receiving end.

The serial number of the SDU.

The first step is to obtain network feedback information currently from the receiving end.

That is, the network feedback information RTCP packet currently received from the receiving end is obtained, and one or more fields in the RTCP packet carry the sequence number of the SDU to be decoded by the receiving end.

In the second step, the network feedback information is parsed.

That is, from the network feedback information RTCP packet, the sequence number of the next SDU to be decoded at the receiving end is parsed.

In the third step, the sequence number of the next video frame to be decoded at the receiving end is obtained.

For example, a first record table may be designed to record the correspondence between the sequence number of the RTP packet (i.e., the sequence number of the SDU) and the sequence number of the video frame to which the SDU belongs. After obtaining the sequence number of the next SDU to be decoded, the video frame sequence number to which the SDU belongs can be retrieved from the first record table, and the video frame sequence number is the sequence number of the next video frame to be played.

In the fourth step, the serial number of the video frame currently being played by the receiving end is estimated.

That is, by subtracting an estimated value from the sequence number of the next video frame to be played obtained obtained in the third step, the sequence number of the video frame currently being played by the receiving end can be estimated. The estimate can be set to a timestamp; if the network delay is too high, it is possible for the receiver to skip the next played video frame. In this case, the estimate can be set to zero or negative, the absolute value of the estimate. The value is equal to an integer multiple of the timestamp.

In the fifth step, an SDU belonging to the currently played video frame is obtained.

A video frame corresponds to multiple SDUs, and an SDU may be selected from the SDUs of the video frames that are being played by the receiving end, for example, selecting the serial number of the SDU with the largest serial number in the video frame being played, as the video frame being played. The serial number of the SDU.

Step 302: Obtain a sequence number of the SDU that the sending end is waiting to send.

There may be multiple SDUs waiting to be sent on the network side, and the sender can wait for SDUs to be sent. Select an SDU in the queue.

For example, a second record table is used to record the sequence numbers of all SDUs that the sender is waiting to transmit, and the SDU with the smallest sequence number is selected as the sender to wait for the SDU to be sent. When the SDU is successfully sent, it is deleted from the second record table.

Further, step 302 may only obtain the sequence number of the SDU that needs to be retransmitted, because the retransmission of the SDU is more likely to occur. This function can be implemented by using the second record table. For example, the second record table can record only the sequence number of the SDU that needs to be retransmitted, thereby improving efficiency.

The order of execution of steps 301 and 302 can be interchanged.

Step 303: Determine whether a delay occurs in the SDU that the sending end waits for sending.

If the sequence number of the SDU of the video frame being played by the receiving end is greater than or equal to the sequence number of the SDU that the transmitting end is waiting to send, that is, the sequence number of the SDU predicted by the step 301 is greater than or equal to the sequence number of the SDU obtained in step 302. It is determined that the SDU waiting to be sent by the transmitting end will have a delay.

The inventor has found that, in general, the sequence numbers of the SDUs are sorted in a small to large manner. If a video frame corresponding to an SDU having a large serial number has been played, the video frame corresponding to the SDU having a small serial number is described. The playback time has elapsed, that is, if the SDU arrives at the receiving end, a delay will occur.

Further, the embodiment may further include the following steps: after determining that the SDU obtained in step 302 is delayed, the sequence number of other SDUs that the sending end waits to send is obtained, and the sequence number ratio of the other SDUs is determined. The SDU with a large SDU obtained will not have a delay.

In the prior art, it is not possible to predict, on the network side, whether the SDU of the video frame that has not been sent will be delayed. This embodiment provides a method for predicting whether the SDU of the video frame that the transmitting end is waiting to send will have a delay. It is convenient for the network side to handle in advance.

Embodiment 3

As shown in FIG. 4, the delay of predicting video service is provided in Embodiment 3 of the present invention. The structural diagram of the device, including:

The first prediction unit 401 is configured to predict a sequence number of a video frame that is being played by the receiving end. The receiving end will feed back the network information RTCP packet. In order to obtain the serial number of the video frame being played by the receiving end, the RTCP packet needs to carry the sequence number of the next SDU to be decoded at the receiving end, and the serial number can be used to calculate the receiving. The serial number of the video frame currently being played.

For a specific implementation, for example, the first prediction unit 401 includes a feedback information acquisition unit and a calculation unit.

The feedback information obtaining unit is configured to obtain network feedback information currently received from the receiving end, where the network feedback information includes one or more fields for carrying the sequence number of the SDU to be decoded by the receiving end.

a calculating unit, configured to: after the feedback information acquiring unit receives the network feedback information RTCP from the receiving end, parse the sequence number of the next RTP packet that needs to be decoded (ie, the serial number of the SDU) from the network feedback information, and With this serial number, the sequence number of the video frame to which the SDU package belongs can be obtained. The video frame is the next video frame to be played by the receiving end, and then the serial number of the next video frame to be played is used to estimate the receiving end. The serial number of the video frame currently being played. Specifically, it can be estimated by the following subunits:

The first record table unit is configured to record a correspondence between a sequence number of the RTP packet (ie, a sequence number of the SDU) and a sequence number of the video frame to which the SDU belongs.

The parsing subunit is configured to parse the network feedback information acquired by the feedback information acquiring unit to obtain the sequence number of the next SDU to be decoded by the receiving end.

After obtaining the sequence number of the next SDU to be decoded, the estimation subunit can retrieve the video frame to which the SDU parsed by the parsing subunit belongs from the first record table unit, and the sequence number of the video frame is the next one. The serial number of the video frame being played. With the sequence number of the next played video frame, the estimation subunit subtracts the sequence number of the video frame by an estimated value, and can estimate the sequence number of the video frame currently being played by the receiving end. As for the estimated value, you can Set the estimate to a timestamp; if the network delay is too strong, it is possible for the receiver to skip the next played video frame. In this case, you can set the estimate to zero or negative, the absolute value of the estimate. Equal to one or more timestamps.

The currently played video frame is only used as a criterion for judging the possibility of delay in the video frame to be transmitted. There may be various ways of determining, and it is not limited to the actual played video frame.

The first obtaining unit 402 is configured to acquire a sequence number of a video frame that the transmitting end is waiting to send. Video frames are transmitted in the form of SDUs. As the network side of the sender, there may be multiple SDUs waiting to be sent. The sender can select an SDU from the SDU queue that is waiting to be sent, and obtain the video frame to which the SDU belongs. The video frame is the video frame that the sender waits to send.

For example, the first obtaining unit 402 may include a second recording table unit, configured to record all SDUs that need to be sent to the receiving end at the transmitting end, and a correspondence between the SDU and the associated video frame. The first obtaining unit 402 further includes a a search subunit, configured to select an SDU with the smallest sequence number from the second record table unit, and obtain a sequence number of the video frame to which the SDU belongs from the second record table, and after the SDU is successfully sent, remove the SDU from the second record table Deleted from the record table.

The first time delay determining unit 403 is configured to determine whether a video frame waiting to be sent by the transmitting end has a delay.

If the sequence number of the video frame being played by the receiving end predicted by the first prediction unit 401 is greater than or equal to the sequence number of the video frame that the first obtaining unit 402 is waiting to send, the terminal that is acquired by the first acquiring unit 402 is determined to wait. The video frame sent will have a delay.

The inventor has found that, in general, as the receiving end of the user, the video frame with a small serial number will be played in time, and then the video frame with a large serial number will be played, and the serial number itself implies the information of the playing time. Therefore, if the sequence number of the video frame being played by the receiving end is greater than the sequence number of the video frame that the transmitting end is waiting to transmit, the playing time of the video frame waiting for the sending end of the transmitting end has passed, even if the video frame waiting to be sent arrives at the receiving At the end, the result is also a delay.

The embodiment may further include a second time delay determining unit, configured to acquire the sending end and wait for The other video frames are sent (excluding the video frames acquired by the first obtaining unit 402). If the first time delay determining unit 403 determines that the video frames acquired by the first obtaining unit 402 do not have a delay, the other video frames are determined. The video frame whose sequence number is larger than the sequence number acquired by the first acquisition unit 402 does not have a delay.

In the prior art, the network side cannot predict whether a video frame that has not been sent will be delayed. This embodiment provides a device that can predict whether a video frame waiting to be sent by the transmitting end will have a delay, thereby facilitating the network side to make an advance. deal with.

Embodiment 4

As shown in FIG. 5, it is a structural diagram of an apparatus for predicting a delay of a video service according to Embodiment 4 of the present invention, including:

The second prediction unit 501 is configured to predict a sequence number of the SDU of the video frame being played by the receiving end.

Predicting the video frame being played by the receiving end, and obtaining the serial number of an SDU of the video frame being played.

The SDU serial number to be decoded by the receiving end can be carried through the network feedback information. With this serial number, the serial number of the video frame corresponding to the SDU can be obtained. The serial number of the video frame can estimate the serial number of the video frame being played by the receiving end, and then select an SDU of the video frame being played. Serial number.

For example, the second prediction unit 501 may include the following subunits: a first record table unit, a network feedback information acquisition unit, a parsing subunit, an estimation subunit, and a query word unit.

The network feedback information acquiring unit is configured to obtain network feedback information currently from the receiving end, where the network feedback information includes a sequence number of the next SDU to be decoded by the receiving end. And a parsing subunit, configured to parse the network feedback information acquired by the network feedback information acquiring unit, to obtain a sequence number of the SDU to be decoded by the receiving end.

An estimation subunit, configured to retrieve, from the parsing subunit, a sequence number of a video frame to which the SDU belongs, after the sequence number of the next SDU to be decoded, the video frame sequence number is the next one to be The serial number of the played video frame, the serial number of the video frame is subtracted from an estimated value to estimate the serial number of the video frame being played by the receiving end. As for the size of the estimate, it can be set to a timestamp. If the network delay is too strong, the receiver may skip the next played video frame. In this case, the estimated value can be set to zero or negative. The absolute value of the value is equal to one or more timestamps.

Querying a subunit, configured to retrieve, from the first record table unit, a video frame that is being played

SDU, since one video frame corresponds to multiple SDUs, the serial number of one SDU with the largest serial number in the video frame being played can be selected.

The second obtaining unit 502 is configured to obtain a sequence number of the SDU that the transmitting end is waiting to send. There may be multiple SDUs waiting to be sent on the network side, and the second obtaining unit 502 may select one SDU from the SDU queues waiting to be sent.

The third delay determining unit 503 is configured to determine whether a delay occurs in the SDU that the transmitting end is waiting to send.

If the sequence number predicted by the second prediction unit 501 is greater than or equal to the sequence number obtained by the second obtaining unit 502, the SDU acquired by the second obtaining unit 502 may be delayed.

The inventor has found that, in general, the sequence numbers of the SDUs are sorted in a small to large manner. If a video frame corresponding to an SDU having a large serial number has been played, the video frame corresponding to the SDU having a small serial number is described. The playback time has elapsed, that is, if the SDU arrives at the receiving end, a delay will occur. Further, the embodiment may further include a fourth time delay determining unit, configured to acquire other SDUs that the sending end is waiting to send, and if the SDU acquired by the second obtaining unit 502 does not have a delay, determine the serial number ratio of the other SDUs. The SDU with the SDU that is acquired by the second obtaining unit 502 does not have a delay.

In the prior art, the network side cannot predict whether the SDU that has not been sent will be delayed. This embodiment provides a device that can predict whether the SDU waiting to be sent by the sending end will delay, so that the network side can facilitate the processing in advance.

The above described embodiments of the invention may be implemented by software, and the corresponding software may be stored in a readable storage medium, such as a hard disk, an optical disk or a floppy disk of a computer.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims

Claim

A method for predicting a delay of a video service, the method comprising: predicting a sequence number of a video frame being played by a receiving end;

If the sequence number of the video frame being played by the receiving end is greater than or equal to the sequence number of the video frame to be sent by the sending end, it is determined that the video frame waiting to be sent by the transmitting end may be delayed.

2. The method according to claim 1, wherein the step of predicting a sequence number of a video frame being played by the receiving end comprises:

Obtaining network feedback information currently from the receiving end, where the network feedback information includes a sequence number of the next SDU to be decoded at the receiving end;

The network feedback information is used to estimate a sequence number of a video frame being played by the receiving end.

The method according to claim 2, wherein the step of estimating the sequence number of the video frame being played by the receiving end by using the network feedback information comprises:

Parsing, from the network feedback information, a sequence number of an SDU to be decoded by the receiving end;

Obtaining, from the first record table, a sequence number of a video frame to which the SDU to be decoded next to the receiving end belongs according to the sequence number of the SDU to be decoded next to the receiving end, where the first record table records The correspondence between the video frames to which the SDU and the SDU belong;

And taking the result of subtracting an estimated value from the sequence number of the video frame to which the SDU to be decoded next to the receiving end is used as the sequence number of the video frame being played by the receiving end.

The method of claim 1, wherein the step of acquiring a sequence number of a video frame that the transmitting end is waiting to send includes:

Obtaining, from the second record table, the SDU with the smallest sequence number, the second record table records the sequence number of the SDU queue that the sender is currently waiting to send and the video frame to which the SDU is waiting to be sent; The record table obtains the sequence number of the video frame to which the SDU with the smallest sequence number belongs, as the sequence number of the video frame that the sender waits to send.

The method according to claim 1, wherein the method further comprises: acquiring a sequence number of other video frames that the transmitting end is waiting to send, if the video frame waiting for the sending end does not occur when the sending end does not occur The delay does not occur when the video frame in the other video frames is larger than the video frame that the transmitting end is waiting to transmit.

A method for predicting a delay of a video service, the method comprising: predicting a sequence number of an SDU of a video frame being played by a receiving end;

Obtaining the serial number of the SDU that the sender waits to send;

If the sequence number of the SDU of the video frame being played by the receiving end is greater than or equal to the sequence number of the SDU that the transmitting end is waiting to send, it is determined that the SDU waiting for the transmitting end to generate a delay occurs.

7. The method according to claim 6, wherein the step of predicting the sequence number of the SDU of the video frame being played by the receiving end comprises:

Obtaining network feedback information currently from the receiving end, where the network feedback information includes a sequence number of an SDU to be decoded by the receiving end;

Parsing the network feedback information, and acquiring a sequence number of the SDU to be decoded by the receiving end;

Obtaining, according to the sequence number of the SDU to be decoded, the sequence number of the video frame to which the SDU to be decoded next to the receiving end belongs, and the first record table records the SDU Correspondence relationship with the video frame to which the SDU belongs;

And a result obtained by subtracting an estimated value from a sequence number of a video frame to which the SDU to be decoded is to be decoded is used as a sequence number of the currently played video frame;

Retrieving the SDU belonging to the currently played video frame from the first record table, and taking the sequence number of the SDU having the largest sequence number as the sequence number of the SDU of the video frame being played by the receiving end.

The method according to claim 6, wherein the method further comprises: obtaining a sequence number of other SDUs that the transmitting end is waiting to send, and if the sending end waits for the sent SDU to not delay, determining the location The serial number in the other SDU is waiting for the sender to send There is no delay in sending SDUs with large SDUs.

A device for predicting a delay of a video service, wherein the device includes: a first prediction unit, configured to predict a sequence number of a video frame being played by the receiving end; and a first acquiring unit, configured to acquire and send a sequence number of the video frame to be sent by the terminal; the first time delay determining unit is configured to: if the sequence number of the video frame predicted by the first prediction unit is greater than or equal to the sequence number of the video frame acquired by the first acquiring unit, It is determined that the video frame acquired by the first acquiring unit has a delay.

The device according to claim 9, wherein the first prediction unit comprises: a feedback information acquiring unit, configured to acquire network feedback information currently from the receiving end, where the network feedback information is included in the receiving The serial number of the next SDU to be decoded;

And a calculating unit, configured to estimate, according to the network feedback information acquired by the feedback information acquiring unit, a sequence number of the video frame that is being played by the receiving end.

The device according to claim 10, wherein the calculating unit comprises: a first recording table unit, configured to record a correspondence between the SDU and the video frame;

a parsing subunit, configured to parse the network feedback information acquired by the feedback information acquiring unit, to obtain a sequence number of the next SDU to be decoded by the receiving end;

An estimation subunit, configured to acquire, from the first record table unit, a sequence number of a video frame to which the SDU parsed by the parsing subunit belongs, and subtract a result obtained by using an estimated value as a video being played by the receiving end The serial number of the frame.

The device according to claim 9, wherein the first acquiring unit comprises: a second recording table unit, configured to record an SDU queue that the sending end is waiting to send, and the SDU that is waiting to be sent The serial number of the video frame;

And a search subunit, configured to obtain, from the second record table unit, a sequence number of a video frame to which the SDU having the smallest sequence number belongs, as a sequence number of the video frame that the sender waits to send.

The device according to claim 12, wherein the device further comprises: a second delay determining unit, configured to acquire other video frames that the transmitting end is waiting to send, if The first time delay determining unit determines that the video frame acquired by the first acquiring unit does not have a delay, and determines that the video frame in the other video frames that has a larger sequence number than the first obtaining unit does not. A delay will occur.

A device for predicting a delay of a video service, wherein the device includes: a second prediction unit, configured to predict a sequence number of an SDU of a video frame being played by the receiving end; and a second acquiring unit, configured to: Obtaining the sequence number of the SDU that the sender waits to send;

a third time delay determining unit, configured to determine that the SDU predicted by the second acquiring unit occurs if the sequence number of the SDU predicted by the second prediction unit is greater than or equal to the sequence number of the SDU acquired by the second acquiring unit Delay.

The device according to claim 14, wherein the second prediction unit comprises: a first recording table unit, configured to record a correspondence between the SDU and the video frame;

a network feedback information acquiring unit, configured to acquire network feedback information currently from the receiving end, where the network feedback information includes a sequence number of an SDU to be decoded by the receiving end, and a parsing subunit, configured to parse the The network feedback information acquired by the network feedback information acquiring unit is used to obtain a sequence number of the next SDU to be decoded by the receiving end;

An estimation subunit, configured to acquire, from the first record table unit, a sequence number of a video frame to which the SDU parsed by the parsing subunit belongs, and subtract an estimated value to obtain a sequence number of a video frame that is being played by the receiving end ;

a query subunit, configured to retrieve, from the first record table unit, an SDU belonging to the video frame calculated by the estimation subunit, and take the sequence number of the SDU with the largest sequence number as the sequence of the SDU of the video frame being played by the receiving end number.

The device according to claim 14, wherein the device further comprises: a fourth time delay determining unit, configured to acquire another SDU that the transmitting end is waiting to send, if the third time delay determining unit determines The SDU obtained by the second acquiring unit does not have a delay, and it is determined that the SDU in the other SDUs having a larger sequence number than the SDU obtained by the second acquiring unit does not have a delay.