WO2014153944A1

WO2014153944A1 - Method and apparatus for transmitting rtp media stream

Info

Publication number: WO2014153944A1
Application number: PCT/CN2013/084907
Authority: WO
Inventors: 郑波
Original assignee: 华为技术有限公司
Priority date: 2013-03-27
Filing date: 2013-10-09
Publication date: 2014-10-02
Also published as: CN103167359B; CN103167359A

Abstract

Disclosed are a method and apparatus for transmitting an RTP (Real-time Transport Protocol) media stream, the method comprising: a transmitting device transmitting a first RTP media stream to a receiving device; the transmitting device receiving serial number related information transmitted by the receiving device; the transmitting device determining the packet loss information of the first RTP media stream according to the serial number related information, and the serial number information of data packets in the first RTP media stream actually transmitted within a feedback cycle; the transmitting device determining a media coding parameter and a transmission parameter according to the packet loss information; the transmitting device transmitting a second RTP media stream according to the media coding parameter and the transmission parameter. In the embodiment of the invention, the problem of packet loss during the transmission of the RTP media stream between the transmitting device and the receiving device can be alleviated effectively, and the transmission efficiency of the RTP media stream can be improved.

Description

RTP media stream transmission method and device

[01] The present invention relates to the field of communications, and in particular, to a method and an apparatus for transmitting an RTP media stream. Background technique

[02] Real-time Transport Protocol (RTT) is a network protocol for real-time transmission of media stream data over the Internet Protocol (IP). The RTP protocol includes the RTP data protocol and the RTP control protocol (Real-time Transport Control Protocol, RTCP for short).

[03] In the prior art, when the RTP media stream is transmitted by using the RTP protocol, the transmission process of the RTP media stream between the sending device and the receiving device includes: the sending device sends the RTP media stream to the receiving device; The number of data packets in the RTP media stream received in the period, and the RTCP feedback message is sent to the sending device, where the RTCP feedback message carries the number of the data packets; the sending device sends the RTP according to the preset period. The number of data packets in the media stream and the number of the data packets carried in the RTCP feedback message adjust the transmission parameters, such as a redundancy parameter, a redundancy packet format, etc.; the sending device sends the adjusted transmission parameter to the receiving device. Send an RTP media stream.

[04] However, the above-mentioned RTP media stream transmission method cannot effectively solve the packet loss problem occurring when the RTP media stream is transmitted between the transmitting device and the receiving device, and the transmission efficiency of the RTP media stream is low. Summary of the invention

[05] In the embodiment of the present invention, a method and a device for transmitting an RTP media stream are provided, which can effectively alleviate the packet loss problem occurring when the RTP media stream is transmitted between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

[06] In a first aspect, an embodiment of the present invention provides a method for transmitting a real-time transport protocol RTP media stream, including:

[07] the sending device sends the first RTP media stream to the receiving device;

[08] receiving sequence number related information sent by the receiving device, where the sequence number related information is sequence number information of the data packet in the first RTP media stream received by the receiving device in a feedback period;

[09] determining packet loss information of the first RTP media stream according to the sequence number related information, the sequence number information of the data packet in the first RTP media stream that is actually sent in the feedback period;

[10] determining a media coding parameter and a transmission parameter of the second RTP media stream to be sent according to the packet loss information, and sending the second RTP media stream to the receiving device.

[11] In combination with the foregoing first aspect, in a first possible implementation manner of the first aspect, the The information, the sequence number information of the data packet in the first RTP media stream that is actually sent in the feedback period, determines the packet loss information of the first RTP media stream, and includes:

[12] determining a sequence of receiving status of the data packet according to the serial number related information and the serial number information of the data packet actually sent in the feedback period, where the receiving status sequence of the data packet is recorded according to the sending order of the data packet The sequence of whether the packet is lost;

[13] The sending device determines, according to the location of the packet loss packet in the receiving state sequence, whether the randomness of the packet loss matches the random packet loss characteristic;

[14] If the random packet loss feature matches, the packet loss information of the RTP media stream is determined to be random packet loss;

[15] If the random packet loss feature does not match, it is determined that the packet loss information of the RTP media stream is bandwidth limited.

[16] In combination with the foregoing first aspect, and/or the first possible implementation manner of the first aspect, in the second possible implementation manner of the first aspect, the determining, according to the packet loss information, Media encoding parameters and transmission parameters of the second RTP media stream, including:

[17] determining, according to the determined packet loss information and the receiving status sequence of the data packet, a network constraint parameter corresponding to the packet loss information;

[18] determining media coding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameter;

[19] When the packet loss information is limited in bandwidth, the network constraint parameter includes: a limit period, where the data packet of the packet is received and the packet is continuously lost. The total transmission time of the packet; the maximum traffic, where the maximum traffic is the total number of bytes of consecutive unpacked packets in the serial number related information;

[20] When the packet loss information is a random packet loss, the network constraint parameter includes: a packet loss rate, where the packet loss rate is the total number of packets lost in the received state sequence of the data packet divided by the data. The total number of packets in the receive status sequence of the packet.

[21] In combination with the second possible implementation manner of the foregoing first aspect, in a third possible implementation manner of the foregoing aspect, the determining, by the packet loss information and the network constraint parameter, the second RTP to be sent Media encoding parameters and transmission parameters of the media stream, including:

[22] The media encoding parameters and transmission parameters are determined according to the following formula:

[23] max f(x, y) = g(x) + h(y) _;

[24] s.t. a(x,y) P

[25] wherein x represents a media coding parameter, y represents a transmission parameter; g(x) represents a media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the media quality based on the transmission parameter The influence of the score is proofread; f ( x, y) represents the media quality score obtained by the media coding parameter and the transmission parameter in the actual network; a(x, y) represents the network constraint parameter corresponding to the media coding parameter and the transmission parameter, P Indicates a network constraint parameter corresponding to the packet loss information.

[26] In a second aspect, an embodiment of the present invention provides a method for transmitting a real-time transport protocol RTP media stream, including: [27] The receiving device receives the first RTP media stream sent by the sending device;

[28] determining sequence number related information of the first RTP media stream, where the sequence number related information is sequence number information of the data packet in the first RTP media stream received by the receiving device in a feedback period;

[29] sending the sequence number related information to the sending device, so that the sending device determines, according to the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period. Deleting information of the RTP media stream, determining, according to the packet loss information, a media encoding parameter and a transmission parameter of the second RTP media stream to be sent by the sending device;

[30] receiving a second RTP media stream sent by the sending device according to the media encoding parameter and the transmission parameter.

[31] In combination with the foregoing second aspect, in a first possible implementation manner of the second aspect, the sequence number related information is implemented by using a packet allocation bitmap, where determining the sequence number related information of the first RTP media stream includes:

[32] determining sequence number information of the data packet in the first RTP media stream received in one feedback period;

[33] generating the packet arrangement bitmap according to the sequence number information.

[34] In a third aspect, an embodiment of the present invention provides a real-time transmission protocol RTP media stream transmission apparatus, including:

[35] a first sending unit, configured to send a first RTP media stream to the receiving device;

[36] The first receiving unit is configured to receive sequence number related information sent by the receiving device, where the sequence number related information is sequence number information of the data packet in the first RTP media stream received by the receiving device in a feedback period. ;

[37] a packet loss information determining unit, configured to: according to the sequence number related information received by the first receiving unit, a data packet in a first RTP media stream actually sent by the first sending unit in the feedback period The sequence number information determines the packet loss information of the first RTP media stream;

[38] a parameter determining unit, configured to determine, according to the packet loss information, a media encoding parameter and a transmission parameter of the second RTP media stream to be sent;

[39] The first sending unit is further configured to: send the second RTP media stream.

[40] In combination with the foregoing third aspect, in a first possible implementation manner of the third aspect, the packet loss information determining unit includes:

[41] a sequence determining subunit, configured to determine, according to the sequence number related information and the sequence number information of the data packet actually sent in the feedback period, a sequence of receiving states of the data packet, where the receiving state sequence of the data packet is according to the data The sequence of whether each packet recorded in the transmission order of the packet is lost;

[42] a reason determining subunit, configured to determine, according to the location of the data packet of the packet loss in the sequence of receiving states of the data packet determined by the sequence determining subunit, whether the randomness of packet loss and random packet loss characteristics Matching, if it matches the random packet loss feature, it determines that the packet loss information of the media stream is a random packet loss; otherwise, it determines that the packet loss information of the media stream is bandwidth limited.

[43] In combination with the foregoing third aspect, and/or the first possible implementation manner of the third aspect, in the second possible implementation manner of the third aspect, the parameter determining unit includes:

[44] a first parameter determining subunit, configured to determine a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the received status sequence of the data packet; [45] a second parameter determining subunit, configured to determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameter determined by the first parameter determining subunit ;

[46] When the packet loss information is limited in bandwidth, the network constraint parameter includes: a limit period, where the data packet of the packet is received in the sequence of the received state and the data of the continuous packet loss is continuously lost. The total transmission time of the packet; the maximum traffic, where the maximum traffic is the total number of bytes of consecutive unpacked packets in the serial number related information;

[47] When the packet loss information is a random packet loss, the network constraint parameter includes: a packet loss rate, where the packet loss rate is the total number of packets lost in the received state sequence of the data packet divided by the data. The total number of packets in the receive status sequence of the packet.

[48] In combination with the second possible implementation manner of the foregoing third aspect, in a third possible implementation manner of the third aspect, the second parameter determining subunit is specifically configured to:

[49] The media encoding parameters and transmission parameters are determined according to the following formula:

[50] max f(x, y) = g(x) + h(y) _;

[51] s.t. a(x,y) P

[52] wherein x represents a media coding parameter, y represents a transmission parameter; g(x) represents a media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the media quality based on the transmission parameter The influence of the score is proofread; f ( x, y ) represents the media quality score obtained by the media coding parameter and the transmission parameter in the actual network; a(x, y) represents the network constraint parameter corresponding to the media coding parameter and the transmission parameter, P Indicates a network constraint parameter corresponding to the packet loss information.

[53] In a fourth aspect, the embodiment of the present invention provides a real-time transmission protocol RTP media stream transmission apparatus, including:

[54] a second receiving unit, configured to receive a first RTP media stream sent by the sending device;

[55] an information determining unit, configured to determine sequence number related information of the first RTP media stream received by the second receiving unit, where the sequence number related information is the first received by the second receiving unit in a feedback period The serial number information of the data packet in the RTP media stream;

a second sending unit, configured to send, to the sending device, the serial number related information determined by the information determining unit, so that the sending device actually sends the information according to the serial number related information and during the feedback period. The sequence number information of the data packet in the first RTP media stream determines the packet loss information of the first RTP media stream, and determines the media coding parameter and the transmission parameter of the second RTP media stream to be sent by the sending device according to the packet loss information;

The second receiving unit is further configured to: receive a second RTP media stream that is sent by the sending device according to the media encoding parameter and the transmission parameter.

[58] In combination with the foregoing fourth aspect, in a first possible implementation manner of the fourth aspect, the sequence number related information is implemented by using a packet allocation bitmap, where the information determining unit is specifically configured to:

[59] determining sequence number information of the data packet in the first RTP media stream received in one feedback period;

[60] generating the packet arrangement bitmap according to the sequence number information.

[61] In a fifth aspect, an embodiment of the present invention provides a real-time transmission protocol RTP media stream transmission system, including Sending device and receiving device, wherein

[62] The sending device is configured to send a first RTP media stream to the receiving device, and receive sequence number related information sent by the receiving device, where the sequence number related information is received by the receiving device in a feedback period. Determining the sequence number information of the data packet in the first RTP media stream, determining, according to the sequence number related information, the sequence number information of the data packet in the first RTP media stream that is actually sent in the feedback period, the first RTP media stream is lost. Packet information, determining media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and transmitting the second RTP media stream to the receiving device;

[63] The receiving device is configured to receive a first RTP media stream sent by the sending device, and determine sequence number related information of the first RTP media stream, where the sequence number related information is received by the receiving device in a feedback period. The sequence number information of the data packet in the first RTP media stream, and the sequence number related information is sent to the sending device, so that the sending device, according to the sequence number related information, and the first RTP media stream actually sent in the feedback period The sequence number information of the data packet determines the packet loss information of the first RTP media stream, determines the media coding parameter and the transmission parameter of the second RTP media stream to be sent by the sending device according to the packet loss information, and receives the sending device according to the The media encoding parameter and the second RTP media stream sent by the transmission parameter.

[64] In combination with the foregoing fifth aspect, in a first possible implementation manner of the foregoing aspect, the sending device is specifically configured to implement, according to the serial number related information, actually sending in the feedback period The sequence number information of the data packet in the first RTP media stream determines the packet loss information of the first RTP media stream:

[65] determining a sequence of receiving status of the data packet according to the serial number related information and sequence number information of the data packet actually sent in the feedback period, where the receiving status sequence of the data packet is recorded according to the sending order of the data packet The sequence of whether the packet is lost;

[66] The sending device determines, according to the location of the packet loss packet in the receiving state sequence, whether the randomness of the packet loss matches the random packet loss characteristic;

[67] If the random packet loss feature matches, the packet loss information of the RTP media stream is determined to be random packet loss;

[68] If the random packet loss feature does not match, it is determined that the packet loss information of the RTP media stream is bandwidth limited.

[69] In combination with the foregoing fifth aspect, and/or the first possible implementation manner of the fifth aspect, in the second possible implementation manner of the fifth aspect, the sending device is specifically configured to implement the The packet loss information determines a media coding parameter and a transmission parameter of the second RTP media stream to be sent:

[70] determining, according to the determined packet loss information and the receiving status sequence of the data packet, a network constraint parameter corresponding to the packet loss information;

[71] determining media coding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameter;

[72] When the packet loss information is limited in bandwidth, the network constraint parameter includes: a restriction period, where the data packet of the packet is continuously lost and the data of the continuous packet loss in the sequence of the received state of the data packet. The total transmission time of the packet; the maximum traffic, where the maximum traffic is the total number of bytes of consecutive unpacked packets in the serial number related information; [73] When the packet loss information is a random packet loss, the network constraint parameter includes: a packet loss rate, where the packet loss rate is the total number of packets lost in the received state sequence of the data packet divided by the data. The total number of packets in the receive status sequence of the packet.

In the embodiment of the present invention, the sending device sends the first RTP media stream to the receiving device, and receives the serial number related information sent by the receiving device, where the serial number related information is received by the receiving device in a feedback period. The sequence number information of the data packet in the first RTP media stream; determining, according to the sequence number related information, the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period, determining the first RTP media stream Packet loss information; determining media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and transmitting the second RTP media stream to the receiving device. Therefore, the sending device determines the packet loss information of the first RTP media stream, and determines the media encoding parameter and the transmission parameter according to the packet loss information; the sending device sends the second RTP media stream according to the media encoding parameter and the transmission parameter, so the present invention The embodiment can effectively alleviate the packet loss problem in the process of RTP media stream transmission between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream. DRAWINGS

[75] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are only the present drawings. Some embodiments of the invention may be obtained by those of ordinary skill in the art from the drawings without departing from the scope of the invention.

1 is a schematic diagram of a first embodiment of a method for transmitting an RTP media stream according to the present invention;

2 is a schematic diagram of a second embodiment of a method for transmitting an RTP media stream according to the present invention;

3 is a schematic diagram of a third embodiment of a method for transmitting an RTP media stream according to the present invention;

4 is a schematic diagram of a first embodiment of an apparatus for transmitting an RTP media stream according to the present invention;

5 is a schematic diagram of a second embodiment of an apparatus for transmitting an RTP media stream according to the present invention;

6 is a schematic structural diagram of a device for transmitting an RTP media stream according to the present invention;

7 is a schematic structural diagram of a receiving device of an RTP media stream according to the present invention;

8 is a schematic structural diagram of a transmission system of an RTP media stream according to the present invention. detailed description

[84] It is found through analysis that the causes of packet loss during the transmission of RTP media streams are different. Different packet loss reasons need to be overcome by different measures. If the reason for the packet loss is not accurately identified, the adjustment of the transmission parameters by the transmitting device is likely to be counterproductive. For example, if the bandwidth of the transport media stream between the sending device and the transmitting device is limited, the available bandwidth is smaller than the actual bandwidth of the RTP media stream, causing packet loss, if redundant coding such as forward error correction coding (FEC, Forward) is used. After Error Correction), the actual line bandwidth of the RTP media stream is increased, which causes the RTP media stream to be sent with more bandwidth resources, thereby aggravating packet loss; or The reason for the packet loss is that when the packet is randomly lost, if the traffic of the RTP media stream of the sending device is reduced, the RTP media stream sent by the sending device cannot be transmitted to the receiving device more efficiently. It can be seen that the reason for discarding the packet loss is to solve the problem of packet loss occurring in the process of RTP media stream transmission between the transmitting device and the receiving device, and to improve the transmission efficiency of the RTP media stream. However, in the prior art, the RTP media stream transmission method only adjusts the transmission parameters, and obviously can only effectively solve the loss in the RTP media stream transmission process between the transmitting device and the receiving device in certain specific situations or coincidences. The packet problem, in most cases, cannot effectively solve the packet loss problem during the RTP media stream transmission between the sending device and the receiving device.

[85] In view of the above, in the RTP media stream transmission method provided by the embodiment of the present invention, determining packet loss information of an RTP media stream, determining media coding parameters and transmission parameters according to the packet loss information, thereby effectively alleviating the sending device and receiving The packet loss problem occurs during the RTP media stream transmission between devices, and improves the transmission efficiency of the RTP media stream.

The device that is referred to in the embodiment of the present invention refers to a device that sends an RTP media stream, and the device that receives the RTP media stream is not used to limit whether the sending device can send and receive an RTP media stream. Other data than the other, whether the receiving device is capable of transmitting and receiving other data than the RTP media stream.

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. example. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any inventive effort are within the scope of the present invention.

[88] FIG. 1 is a schematic diagram of a first embodiment of a method for transmitting an RTP media stream according to the present invention. The method may be applied to a sending device, where the method includes:

[89] Step 101: The sending device sends the first RTP media stream to the receiving device.

[90] Step 102: The sending device receives the serial number related information sent by the receiving device, where the serial number related information is the serial number information of the data packet in the first RTP media stream received by the receiving device in a feedback period. ;

[91] The receiving device may send the sequence number related information to the sending device by using a message such as an RTCP feedback message.

[92] The sequence number related information may include: sequence number information of the data packet in the RTP media stream received by the receiving device in a feedback period, or a packet arrangement bitmap; the packet arrangement bitmap may be received by the receiving device The sequence number information of the data packet in the RTP media stream received in one feedback period is generated.

[93] Step 103: The sending device determines packet loss information of the first RTP media stream according to the sequence number related information, the sequence number information of the data packet in the RTP media stream actually sent in the feedback period;

[94] The packet loss information is information used to record the reason for packet loss of the RTP media stream.

[95] Step 104: The sending device determines a media encoding parameter and a transmission parameter of the second RTP media stream to be sent according to the packet loss information, and sends the second RTP media stream to the receiving device. [96] The first RTP media stream and the second RTP media stream are both RTP media streams, and the first and second are only used to distinguish the RTP media streams in step 101 and step 104.

[97] The first RTP media stream and the second RTP media stream may be the same or different RTP media streams. Generally, the first RTP media stream is different from the second RTP media stream, and the second RTP media stream is a media stream subsequent to the first RTP media stream, thereby determining the media by transmitting according to the previous first RTP media stream. Encoding parameters and transmission parameters, and then using the determined media stream coding parameters and transmission parameters for subsequent transmission of the RTP media stream.

[98] In this embodiment, the sending device determines the packet loss information of the first RTP media stream, and determines the media encoding parameter and the transmission parameter according to the packet loss information; the sending device sends the first according to the media encoding parameter and the transmission parameter. The second RTP media stream, so the embodiment of the present invention can determine different media coding parameters and transmission parameters for different packet loss reasons, thereby effectively alleviating the packet loss problem of the RTP media stream between the sending device and the receiving device, and improving the RTP media. The transmission efficiency of the stream.

[99] FIG. 2 is a schematic diagram of a second embodiment of a method for transmitting an RTP media stream according to the present invention. The method may be applied to a receiving device, where the method includes:

[100] Step 201: The receiving device receives the first RTP media stream sent by the sending device.

[101] Step 202: The receiving device determines sequence number related information of the first RTP media stream, where the sequence number related information is sequence number information of the data packet in the first RTP media stream received by the receiving device in a feedback period;

[102] wherein the sequence number related information includes the sequence number information of the data packet in the first RTP media stream received by the receiving device in a feedback period, and the sequence number related information may directly include the sequence number of each data packet;

[103] Alternatively, when the sequence number related information includes a packet arrangement bitmap, the receiving device determining the sequence number related information of the RTP media stream may include: the receiving device determining the sequence number information of the data packet in the RTP media stream received in a feedback period. The receiving device generates a packet arrangement bitmap according to the sequence number information.

[104] Step 203: The receiving device sends the serial number related information to the sending device, so that the sending device, according to the serial number related information, the serial number of the data packet in the first RTP media stream actually sent in the feedback period. Determining, by the information, the packet loss information of the first RTP media stream, determining, according to the packet loss information, a media coding parameter and a transmission parameter of the second RTP media stream to be sent by the sending device;

[105] Step 204: The receiving device receives a second RTP media stream that is sent by the sending device according to the media encoding parameter and the transmission parameter.

[106] In this embodiment, the receiving device determines the sequence number related information according to the sequence number information of the data packet in the first RTP media stream received in a feedback period, and sends the sequence number related information to the sending device, so as to Determining, by the sending device, the packet loss information of the first RTP media stream, determining the media encoding parameter and the transmission parameter, according to the sequence number related information, the sequence number information of the data packet in the RTP media stream actually sent in the feedback period, and then sending The device can perform the second RTP media stream transmission according to the determined media coding parameter and the transmission parameter. Therefore, the embodiment of the present invention can effectively alleviate the packet loss problem of the media stream between the sending device and the receiving device, and improve the RTP medium. The efficiency of body fluid transmission.

[107] FIG. 3 is a schematic diagram of a third embodiment of an RTP media stream transmission method according to the present invention, where the method includes:

[108] Step 301: The sending device sends the first RTP media stream to the receiving device.

[109] wherein, the sending device sends the first RTP media stream by using current media coding parameters and transmission parameters.

[110] Step 302: The receiving device receives the first RTP media stream, and determines sequence number related information of the first RTP media stream.

[111] wherein, the serial number related information includes the serial number information of the data packet in the first RTP media stream received by the receiving device in a feedback period, and the serial number related information may directly record the serial number of each data packet; for example, if The receiving device receives five data packets with sequence numbers 1, 3, 4, 5, and 7 in a feedback period, and the sequence number related information may be: 13457;

[112] Alternatively, when the sequence number related information includes a packet arrangement bitmap, the receiving device determining the sequence number related information of the first RTP media stream may include: the receiving device determining the data in the first RTP media stream received in one feedback period. The serial number information of the packet; the receiving device generates a packet arrangement bitmap according to the serial number information.

[113] In a possible implementation manner, the packet arrangement bitmap may include: a sequence number of the first data packet received in the one feedback period, and receiving according to the one feedback period A bitmap generated by a packet other than the first packet. For example, if the receiving device receives 7 data packets with sequence numbers 1, 2, 3, 5, 6, 7, 8 within the one feedback period, the packet arrangement bitmap may be:

[114] Header Packet SN: 1

[115] RcvMap: 0xF7

[116] wherein, the binary representation of 0xF7 is 11110111. If the lowest bit represents the first data packet and the bit is 1 indicating successful reception, then 0xF7 can express that the receiving device has received the sequence number 1, 2, 3, 5 7, 6 packets of 6, 7, and 8.

[117] wherein the specific time length and the starting time of the feedback period can be set autonomously in practical applications, and is not limited herein.

[118] Step 303: The receiving device sends an RTCP feedback message to the sending device, where the RTCP feedback message includes the sequence number related information.

[119] In an actual application, the receiving device may also carry the serial number related information through other messages, which is not limited herein.

[120] The RTCP feedback message may be sent by the receiving device to the sending device according to the feedback cycle timing in the process of receiving the RTP media stream. For example, at the end of each feedback period, the receiving device obtains the sequence number related information according to the sequence number information of the data packet in the RTP media stream received in the feedback cycle just ended, and sends the sequence number related information to the sending device. RTCP feedback message for information. [121] The RTCP feedback message may further include other information, for example, the total number of bytes of the RTP media stream received by the device in the feedback period, and/or the delay information.

[122] The total number of bytes may be used to calculate a bandwidth constraint between the sending device and the receiving device. Specifically, the bandwidth constraint is equal to: the total number of bytes / the length of time of the feedback period.

[123] The delay information may be used as one of the basis for the transmission path adjustment when the transmitting device adjusts the transmission path of the RTP media stream between the transmitting device and the receiving device. The specific implementation process is not described here.

[124] Step 304: The sending device receives the RTCP feedback message, and determines the first RTP media stream according to the sequence number related information, the sequence number information of the data packet in the RTP media stream actually sent in the one feedback period. Packet loss information.

In the embodiment of the present invention, the packet loss information is divided into two types: random packet loss and bandwidth limitation. In actual applications, the packet loss information may be further divided according to actual conditions, which is not limited herein.

[126] The network constraint parameters corresponding to the different packet loss information are different. When the packet loss information is a random packet loss, the network constraint parameter may include: a packet loss rate and a packet loss period of the packet random packet loss; When the information is bandwidth limited, the network constraint parameter may include: a maximum traffic and a restriction period between the sending device and the receiving device.

Specifically, the determining, according to the sequence number related information, the sequence information of the data packet in the RTP media stream that is actually sent in the one feedback period, the packet loss information of the first RTP media stream may include:

[128] The sending device determines, according to the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period, a sequence of receiving status of the data packet, and a sequence of receiving status of the data packet. Information indicating whether each packet is lost in accordance with the order in which the packets are sent;

[129] determining, according to the location of the packet loss packet in the receiving state sequence of the data packet, whether the randomness of the packet loss packet matches the random packet loss characteristic, and if it matches the random packet loss characteristic, determining the media stream. The packet loss information is a random packet loss; otherwise, the packet loss information of the media stream is determined to be bandwidth limited.

[130] For example, in the one feedback period, the sending device sends 10 data packets with sequence numbers 1 to 10 to the receiving device; and the sequence number related information is 1236789; the receiving state sequence of the data packet may be: rrrxxrrrrx , where r indicates that the packet is not dropped, and X indicates that the packet is lost.

[131] When determining whether the randomness of the packet loss is matched with the random packet loss characteristic according to the position of the packet in the received state sequence of the packet, the Poisson distribution can be combined with Similar models are implemented. For example, Poisson distribution is a discrete probability distribution that is common in statistics and probability. Poisson distribution is suitable ■

Describe the number of random events that occur within a unit of time. The Poisson distribution formula is as follows, where the expectation and variance of the Poisson distribution are both in, λ is the average incidence of random events per unit time or unit area, and k is the number of random events occurring per unit time, k=0, l ,2,.... Because the number of random packet loss events or the number of occurrences per unit time is approximately obeying the Poisson distribution, it can be calculated according to the Poisson distribution formula according to the position of the packet of the lost packet in the receiving state sequence of the data packet. The value of λ, and then the λ corresponding to λ is calculated according to the λ value The number of theoretical packet loss in the time period; any sequence of receiving states of the A t time from the sequence of receiving states of the data packet, determining the actual number of lost packets in the received state sequence of the A t time and the theoretical number of lost packets Whether the difference is not greater than the preset difference threshold. If yes, it is determined that the randomness of the packet loss matches the random packet loss feature. If not, the randomness and random packet loss characteristics of the packet loss are determined. match. The difference threshold may be set autonomously in an actual application.

[132] Therefore, in a possible implementation, the determining, according to the location of the data packet in the received state sequence of the data packet, whether the randomness of the packet loss meets the random packet loss characteristic may include :

The location of the data packet in the sequence of received states of the data packet according to the Poisson distribution formula

Calculating the value of λ; k is the position of the packet of the lost packet in the sequence of receiving states;

[134] calculating the theoretical number of lost packets corresponding to λ within Δt time;

[135] taking a sequence of received states of the Δt time from the sequence of received states of the data packet, and determining whether the difference between the actual number of lost packets and the theoretical number of lost packets in the received state sequence of the Δt time is less than The preset threshold, if less than, determines that the randomness of the packet loss matches the random packet loss feature. Otherwise, it determines that the randomness of the packet loss does not match the random packet loss feature.

[136] wherein, the calculation of the theoretical number of lost packets in the A t time corresponding to λ can be calculated according to the formula Ρ^ί, ί ₊ Δ ί = λΔ ί ₊ 0 Δ ί, where _t is the initial time, Pl (t+ A t ) indicates the probability of packet loss during t+ A t time; O ( A t) is a function formula of A t ; how to implement the calculation in detail, which is not described here.

[137] Step 305: The sending device determines, according to the determined packet loss information and the received status sequence of the data packet, a network constraint parameter corresponding to the packet loss information.

[138] wherein, when the packet loss information is limited in bandwidth, determining the network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the received status sequence of the data packet may include: receiving the data packet The total transmission duration of the packet that is not continuously lost in the sequence and the packet that is continuously lost is used as the limitation period; the total number of bytes of consecutive unpacked packets in the sequence number related information is taken as the maximum Traffic flow

[139] When the packet loss information is a random packet loss, determining, according to the determined packet loss information and the received status sequence of the data packet, the network constraint parameter corresponding to the packet loss information may include: The packet loss rate is obtained by dividing the total number of lost packets by the total number of packets in the received status sequence of the packet.

[140] wherein, the packet loss period can be generally calculated in combination with the packet loss rate, and the specific calculation method is not limited herein. In practical applications, the packet loss rate is introduced by the routing/switching device performance bottleneck, and the packet per second (PPS, Packet Per Second) is used as a common indicator. Therefore, the packet loss period can be directly set to Ls. Therefore, in a practical application, the value of the packet loss period may be pre-stored in the sending device, and when the network constraint parameter corresponding to the random packet loss is determined, the value of the pre-stored packet loss period may be read. [141] Specifically, when determining the restriction period, the first packet loss packet may be first searched from the received status sequence of the data packet, and then, after the first packet loss packet is checked. Find the first packet that has not been dropped, determine the number of consecutive undropped packets from the undropped packet, and determine the first packet that is dropped after the undropped packet. Determining the number of consecutively dropped packets from the packet of the lost packet, and calculating the sum of the number of consecutive undropped packets and the number of consecutively dropped packets, the sum Multiply the transmission duration of each data packet to obtain the restriction period.

[142] When determining the maximum traffic, it is possible to determine the total number of bytes of consecutive undropped packets starting from the undropped packet, and obtain the maximum traffic.

[143] For example, the receiving status sequence of the data packet is rrxxrrrxxrrrxx, and the first data packet identified by x may be first found, and then the first identifier is found after the third data packet. The data packet, that is, the 5th data packet, the packet that is continuously lost from the 5th data packet is the 5th data packet to the 7th data packet, and therefore, it is determined that the 5th data packet is continuously continuous. The number of packets lost is 3, and the first packet identified by X after the 5th packet is the 8th packet, and the packet that is continuously dropped from the 8th packet is 8th. Packets and ninth packet, therefore, it is determined that the number of consecutive packets lost from the 8th packet is 2, and the total number is 5, then the limiting period is 5t _; t is each The length of time the packet is sent.

[144] The maximum traffic is the total number of bytes from the 5th packet to the 7th packet.

[145] Step 306: The sending device determines, according to the packet loss information and the network constraint parameter corresponding to the packet loss information, a media encoding parameter and a transmission parameter of the second RTP media stream to be sent.

[146] wherein the media coding parameter may include at least one of the following parameters: RTP packet rate, media coding algorithm, and coding rate are constructed after media coding.

[147] wherein, the RTP packet rate after the media coding is performed refers to the number of data packets sent by the sending device per second;

[148] The media coding algorithm refers to a media compression algorithm format used by a sending device to encode an RTP media stream, and the media compression algorithm format includes: an adaptive multi-rate (AMR), G .711, etc.

[149] The encoding rate refers to the rate of the media compression algorithm. For example, the AMR media compression algorithm includes multiple rate formats, and the AMR media compression can be specifically indicated by the encoding rate. The rate format used by the algorithm.

[150] The transmission parameter may include at least one of the following parameters: a redundancy packet coding format, a redundancy parameter.

[151] wherein the redundancy parameter refers to a redundancy coefficient. For example, when the redundancy parameter is 1x redundancy, the sending device will each data in the RTP media stream when the RTP media stream is sent. Send one more package;

[152] The redundancy parameter may be a non-integer in practical application, for example, 10% means that only one 10% of all data packets are doubled, which can be implemented by means of important frame recognition, etc. Narration.

[153] The redundant packet coding format is used to indicate the coding format employed by the redundant data packets. Redundant formats as defined in RFC 2198, etc. [154] In practical applications, tests can be used to test the performance of different media parameters and transmission parameters under different network impairments, and the network constraint parameters corresponding to the packet loss information and the media are determined according to a constrained optimization method such as a mathematical regression method. The equations of coding parameters and transmission parameters, such as:

[155] max f(x,y) = g(x) + h(y)

[156] s.t. a(x,y) P

[157] wherein x represents a media coding parameter, y represents a transmission parameter; g(x) represents a media quality score that the media coding parameter can obtain under a lossless network, such as an average evaluation score describing a voice quality (MOS, Mean Opinion Score) /Perceptual evaluation of speech quality (PESQ); h(y) indicates proofreading based on the influence of the transmission parameter on the media quality score; f ( χ, y) indicates the media coding parameter and transmission The media quality score obtained by the parameter in the actual network; a(x, y) represents the network constraint parameter corresponding to the media coding parameter and the transmission parameter, and P represents the network constraint parameter corresponding to the packet loss information.

[158] Specifically, in the embodiment of the present invention, the network constraint parameter, the media coding parameter, and the transmission parameter corresponding to the random packet loss need to constitute a first equation, and the network constraint parameter, the media coding parameter, and the transmission parameter component corresponding to the bandwidth constraint are configured. The second equation; In the implementation of this step, the network constraint parameter corresponding to the packet loss information may be directly substituted into the equation corresponding to the packet loss information, and the media coding parameter and the transmission parameter are calculated.

[159] Step 307: The sending device sends the second RTP media stream according to the media encoding parameter and the transmission parameter determined in step 306.

[160] The media encoding parameter and the transmission parameter according to the packet loss information and the packet loss information are determined according to the packet loss information and the network constraint parameter of the packet loss information, so that the sending device can be effectively alleviated. The packet loss problem occurring during the RTP media stream transmission between the receiving device and the receiving device improves the transmission efficiency of the RTP media stream.

[161] In this embodiment, the sending device determines the packet loss information of the first RTP media stream and the network constraint parameter corresponding to the packet loss information, and determines, according to the packet loss information and the network constraint parameter corresponding to the packet loss information. The media encoding parameter and the transmission parameter; the sending device sends the second RTP media stream according to the media encoding parameter and the transmission parameter, so the embodiment of the present invention can effectively alleviate the occurrence of the RTP media stream transmission between the sending device and the receiving device. The packet loss problem improves the transmission efficiency of the RTP media stream.

[162] Referring to FIG. 4, it is a schematic diagram of a first embodiment of a transmission apparatus for an RTP media stream according to the present invention. The apparatus may be disposed on a transmitting device, and the apparatus 400 includes:

[163] The first sending unit 410 is configured to send, to the receiving device, the first RTP media stream.

[164] The first receiving unit 420 is configured to receive sequence number related information that is sent by the receiving device, where the sequence number related information is sent by the first sending unit 410 that is received by the receiving device in a feedback period. Sequence number information of a data packet in an RTP media stream;

[165] The packet loss information determining unit 430 is configured to receive the serial number related information according to the first receiving unit 420. The sequence number information of the data packet in the first RTP media stream that is actually sent by the first sending unit 410 in the feedback period determines the packet loss information of the first RTP media stream;

[166] The parameter determining unit 440 is configured to determine, according to the packet loss information determined by the packet loss information determining unit 430, a media encoding parameter and a transmission parameter of the second RTP media stream to be sent.

The first sending unit 410 is further configured to: send the second RTP media stream according to the media coding parameter and the transmission parameter determined by the parameter determining unit 440.

[168] Preferably, the packet loss information determining unit 430 may specifically include:

[169] a sequence determining subunit, configured to determine, according to the sequence number related information and sequence number information of a data packet actually sent in the feedback period, a sequence of receiving states of the data packet, where the sequence of receiving states of the data packet is according to data Information about whether each packet recorded in the order of transmission of the packet is lost;

[170] a reason determining subunit, configured to determine, according to the location of the data packet of the packet loss in the sequence of receiving states of the data packet determined by the sequence determining subunit, whether the randomness of packet loss and random packet loss characteristics Matching, if it matches the random packet loss feature, it determines that the packet loss information of the media stream is a random packet loss; otherwise, it determines that the packet loss information of the media stream is bandwidth limited.

[171] Preferably, the parameter determining unit 440 may include:

[172] a first parameter determining subunit, configured to determine a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the received state sequence of the data packet;

[173] a second parameter determining subunit, configured to determine, according to the packet loss information and the network constraint parameter determined by the first parameter determining subunit, a media encoding parameter and a transmission parameter of the second RTP media stream to be sent. ;

[174] When the packet loss information is limited in bandwidth, the network constraint parameter includes: a restriction period, where the data packet of the packet is continuously lost and the data of consecutive packet loss in the sequence of the received state of the data packet. The total transmission time of the packet; the maximum traffic, where the maximum traffic is the total number of bytes of consecutive unpacked packets in the serial number related information;

[175] When the packet loss information is a random packet loss, the network constraint parameter includes: a packet loss rate, where the packet loss rate is the total number of packets lost in the received state sequence of the data packet divided by the data. The total number of packets in the receive status sequence of the packet.

[176] The first parameter determining subunit may be specifically used to:

[177] When the packet loss information is limited in bandwidth, the total transmission duration of the continuously unpacked data packet and the continuously dropped packet in the reception status sequence of the data packet is taken as the limitation period; The total number of bytes of consecutive data packets that are not lost in the sequence number related information is used as the maximum traffic;

[178] When the packet loss information is a random packet loss, the network constraint parameter may include: dividing a total number of data packets lost in the reception status sequence of the data packet by a data packet in a reception status sequence of the data packet. The total number of packets is obtained.

[179] When the packet loss information is a random packet loss, the total number of data packets lost in the reception status sequence of the data packet is divided by the total number of data packets in the reception status sequence of the data packet, and the packet loss is obtained. rate.

[180] Preferably, the second parameter determining subunit is specifically applicable to: [181] The network constraint parameters are determined according to the following formula:

[182] max f(x, y) = g(x) + h(y) _;

[183] s.t. a(x,y) P

[184] wherein x represents a media coding parameter, y represents a transmission parameter; g(x) represents a media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the media quality based on the transmission parameter The influence of the score is proofread; f ( x, y) represents the media quality score obtained by the media coding parameter and the transmission parameter in the actual network; a(x, y) represents the network constraint parameter corresponding to the media coding parameter and the transmission parameter, P Indicates a network constraint parameter corresponding to the packet loss information.

[185] In this embodiment, determining packet loss information of the media stream, determining media coding parameters and transmission parameters according to the packet loss information, and transmitting the second RTP media stream according to the media coding parameter and the transmission parameter, thereby effectively alleviating The packet loss problem in the process of RTP media stream transmission between the sending device and the receiving device improves the transmission efficiency of the RTP media stream.

[186] FIG. 5 is a schematic diagram of a second embodiment of a transmission apparatus for an RTP media stream according to the present invention. The apparatus may be disposed on a receiving device, and the apparatus 500 includes:

[187] The second receiving unit 510 is configured to receive a first RTP media stream sent by the sending device.

[188] The information determining unit 520 is configured to determine sequence number related information of the RTP media stream received by the second receiving unit 510, where the sequence number related information is received by the second receiving unit 510 in a feedback period. Sequence number information of a data packet in an RTP media stream;

[189] The second sending unit 530 is configured to send the sequence number related information determined by the information determining unit 520 to the sending device, so that the sending device actually performs the feedback period according to the sequence number related information. The sequence number information of the data packet in the first RTP media stream is sent, the information about the packet loss information of the first RTP media stream is determined, and the media coding parameter of the second RTP media stream to be sent by the sending device is determined according to the packet loss information. Transmission parameter

The second receiving unit 510 is further configured to: receive, by the sending device, the second RTP media stream according to the media encoding parameter and the transmission parameter.

Preferably, the sequence number related information is implemented by using a packetized bitmap, and the information determining unit 520 may be specifically configured to:

[192] determining sequence number information of the data packet in the first RTP media stream received in one feedback period;

[193] generating the packet arrangement bitmap according to the sequence number information.

[194] In this embodiment, the sequence number related information is determined according to the RTP media stream received in a feedback period, and the sequence number related information is sent to the sending device, so that the sending device is based on the sequence number related information, The sequence number information of the data packet in the RTP media stream that is actually sent in the feedback period determines the packet loss information of the media stream, determines the media coding parameter and the transmission parameter according to the packet loss information, and then receives the media according to the determined transmission device. Encoding parameters and a second RTP media stream transmitted by the transmission parameters, thereby effectively alleviating the transmitting device and the receiving device The packet loss problem during the RTP media stream transmission between backups improves the transmission efficiency of the RTP media stream.

[195] FIG. 6 is a schematic structural diagram of a transmitting device of an RTP media stream according to the present invention. The transmitting device 600 includes: a first processor 610, a first memory 620, a first transceiver 630, and a first bus 640;

The first processor 610, the first memory 620, and the first transceiver 630 are connected to each other through a first bus 640; the first bus 640 may be an ISA bus, a PCI bus, or an EISA bus. The first bus 640 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 6, but it does not mean that there is only one bus or one type of bus.

The first memory 620 is configured to store a program, and the program is used to implement the RTP media stream transmission method performed by the transmitting device in the embodiment shown in FIG. 1 and FIG. In particular, the program can include program code, the program code including computer operating instructions. The first memory 620 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.

The first transceiver 630 is used to connect other devices, such as receiving devices, servers, and remote hosts, and to communicate with other devices. Specifically, the first transceiver 630 is configured to: send a first RTP media stream to the receiving device; receive sequence number related information sent by the receiving device, where the sequence number related information is received by the receiving device in a feedback period. Sequence number information of the data packet in the first RTP media stream; transmitting the second RTP media stream according to the media encoding parameter determined by the first processor 610 and the transmission parameter.

The first processor 610 executes the program code stored in the first memory 620, and the first transceiver 630 is configured according to the serial number related information received by the first transceiver 630. The sequence number information of the data packet in the first RTP media stream that is actually sent in the feedback period determines the information of the packet loss information of the media stream; and determines the media coding parameter and the transmission parameter of the second RTP media stream to be sent according to the packet loss information.

[00] Preferably, the first processor 610 is specifically configured to: determine, according to the sequence number related information and sequence number information of a data packet actually sent in the feedback period, a sequence of receiving status of the data packet, where the data is The receiving status sequence of the packet is information indicating whether each data packet is lost according to the sending order of the data packet; whether the randomness of the data packet loss is determined according to the position of the lost data packet in the receiving state sequence of the data packet If the random packet loss feature matches the random packet loss feature, the packet loss information of the media stream is determined to be random packet loss; otherwise, the packet loss information of the media stream is determined to be bandwidth limited.

Preferably, the first processor 610 is configured to: determine, according to the determined packet loss information and the received status sequence of the data packet, a network constraint parameter corresponding to the packet loss information;

Determining, according to the packet loss information and the network constraint parameter, a media coding parameter and a transmission parameter of the second RTP media stream to be sent.

[203] wherein, when the packet loss information is limited in bandwidth, the network constraint parameter may include: a restriction period, where the packet is continuously lost without packet loss in the sequence of receiving status of the data packet The total transmission duration of the data packet of the packet; the maximum traffic, the maximum traffic being the total byte of the consecutive undropped data packets in the sequence number related information Number

[204] When the packet loss information is a random packet loss, the network constraint parameter may include: dividing a total number of data packets that are lost in the receiving state sequence of the data packet by a data packet in a receiving state sequence of the data packet. The total number of packets is obtained.

[205] Preferably, the first processor 610 is specifically configured to: when the packet loss information is limited in bandwidth, the data packet of the received state sequence of the data packet is continuously unpacked and continuously lost. The total transmission duration of the data packet is used as the limitation period; the total number of bytes of consecutive data packets that are not lost in the sequence number related information is used as the maximum traffic volume; when the packet loss information is random packet loss, The packet loss rate is obtained by dividing the total number of packets lost in the received status sequence of the data packet by the total number of data packets in the received status sequence of the data packet.

[206] Preferably, the first processor 610 is specifically configured to determine the network constraint parameter according to the following formula:

[207] max f(x, y) = g(x) + h(y) _;

[208] s.t. a(x,y) P

[209] wherein x represents a media coding parameter, y represents a transmission parameter; g(x) represents a media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the media quality based on the transmission parameter The influence of the score is proofread; f ( x, y) represents the media quality score obtained by the media coding parameter and the transmission parameter in the actual network; a(x, y) represents the network constraint parameter corresponding to the media coding parameter and the transmission parameter, P Indicates a network constraint parameter corresponding to the packet loss information.

[210] In this embodiment, the sending device determines packet loss information of the first RTP media stream, and determines a media encoding parameter and a transmission parameter according to the packet loss information. The sending device sends the packet according to the media encoding parameter and the transmission parameter. The second RTP media stream, so the embodiment of the present invention can determine different media coding parameters and transmission parameters for different packet loss information, thereby effectively alleviating the packet loss problem of the RTP media stream between the sending device and the receiving device, and improving the RTP media. The transmission efficiency of the stream.

[211] FIG. 7 is a schematic structural diagram of a receiving device of an RTP media stream according to the present invention. The receiving device 700 may include: a second processor 710, a second memory 720, a second transceiver 730, and a second bus 740;

The second processor 710, the second memory 720, and the second transceiver 730 are connected to each other through the second bus 740; the second bus 740 may be an ISA bus, a PCI bus or an EISA bus or the like. The second bus 740 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 7, but it does not mean that there is only one bus or one type of bus.

[213] The second memory 720 is configured to store a program, and the program is used to implement the RTP media stream transmission method performed by the receiving device in the embodiment shown in FIG. 2 and FIG. In particular, the program can include program code, the program code including computer operating instructions. The second memory 720 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.

The second transceiver 730 is configured to connect to other devices, such as a transmitting device, a server, a remote host, etc., and to communicate with other devices. Specifically, the second transceiver 730 is configured to receive the first RTP media stream sent by the sending device. And sending the sequence number related information to the sending device, so that the sending device determines, according to the sequence number related information, the sequence number information of the data packet in the first RTP media stream that is actually sent in the feedback period, the first RTP media stream is lost. Determining, according to the packet loss information, a media coding parameter and a transmission parameter of the second RTP media stream to be sent according to the packet loss information; receiving a second RTP media stream sent by the sending device according to the media coding parameter and the transmission parameter;

The second processor 710 executes the program code stored in the second memory 720, and is configured to: determine, according to the first RTP media stream received by the second transceiver 730 in one feedback period, the first The serial number related information of the RTP media stream, where the serial number related information is the serial number information of the data packet in the first RTP media stream received by the second transceiver 730 in one feedback period.

[216] Preferably, the sequence number related information is implemented by using a packetized bitmap, and the second processor 710 is specifically configured to: determine, in a first RTP media stream received in a feedback period, a data packet. Sequence number information; generating the packet arrangement bitmap according to the sequence number information.

[217] In this embodiment, the receiving device generates sequence number related information according to the sequence number information of the data packet in the first RTP media stream received in a feedback period, and sends the sequence number related information to the sending device, so as to Determining, by the sending device, the packet loss information of the RTP media stream, and further determining the media coding parameter and the transmission parameter, according to the sequence number related information, the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period, and then the sending device may The sending of the second RTP media stream is performed according to the determined media encoding parameter and the transmission parameter. Therefore, the embodiment of the present invention can effectively alleviate the packet loss problem of the media stream between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

The embodiment of the present invention further provides a transmission system of a real-time transmission protocol RTP media stream. As shown in FIG. 8, the system 800 includes a transmitting device 810 and a receiving device 820, where

The sending device 810 is configured to send the first RTP media stream to the receiving device 820, and receive the serial number related information sent by the receiving device 820, where the serial number related information is that the receiving device 820 is in a feedback period. Receiving the sequence number information of the data packet in the first RTP media stream, determining, according to the sequence number related information, the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period, determining the first RTP a packet loss information of the media stream, determining, according to the packet loss information, a media coding parameter and a transmission parameter of the second RTP media stream to be sent, and sending the second RTP media stream to the receiving device;

[220] The receiving device 820 is configured to receive a first RTP media stream sent by the sending device 810, and determine sequence number related information of the first RTP media stream, where the sequence number related information is received by the receiving device in a feedback period. The sequence number information of the data packet in the first RTP media stream is sent to the sending device 810, so that the sending device sends the first information related information according to the serial number related information and the first actually sent in the feedback period. The sequence number information of the data packet in the RTP media stream determines the packet loss information of the first RTP media stream, determines the media coding parameter and the transmission parameter of the second RTP media stream to be sent by the sending device 810 according to the packet loss information, and receives the The second RTP media stream sent by the sending device 810 according to the media encoding parameter and the transmission parameter. [221] Preferably, the sending device 810 is specifically configured to implement, according to the sequence number related information, the serial number information of the data packet in the first RTP media stream that is actually sent in the feedback period. Determining packet loss information of the first RTP media stream:

[222] determining a sequence of receiving status of the data packet according to the serial number related information and sequence number information of the data packet actually sent in the feedback period, where the receiving status sequence of the data packet is recorded according to the sending order of the data packet. The sequence of whether the packet is lost;

[223] The sending device determines, according to the location of the packet loss packet in the receiving state sequence, whether the randomness of the packet loss matches the random packet loss characteristic;

[224] If the random packet loss characteristic is matched, the packet loss information of the RTP media stream is determined to be random packet loss;

[225] If the random packet loss feature does not match, it is determined that the packet loss information of the RTP media stream is bandwidth limited.

[226] Preferably, the sending device 810 is specifically configured to: according to the packet loss information, determine, according to the packet loss information, a media encoding parameter and a transmission parameter of a second RTP media stream to be sent:

[227] determining network constraint parameters corresponding to the packet loss information according to the determined packet loss information and the received status sequence of the data packet;

Determining, according to the packet loss information and the network constraint parameter, a media coding parameter and a transmission parameter of the second RTP media stream to be sent;

[229] When the packet loss information is limited in bandwidth, the network constraint parameter includes: a restriction period, where the data packet of the packet is continuously lost and the data of consecutive packet loss in the sequence of receiving status of the data packet. The total transmission time of the packet; the maximum traffic, where the maximum traffic is the total number of bytes of consecutive unpacked packets in the serial number related information;

[230] When the packet loss information is a random packet loss, the network constraint parameter includes: a packet loss rate, where the packet loss rate is the total number of packets lost in the received state sequence of the data packet divided by the data. The total number of packets in the receive status sequence of the packet.

[231] In this embodiment, the receiving device generates sequence number related information according to the sequence number information of the data packet in the first RTP media stream received in a feedback period, and sends the sequence number related information to the sending device, so as to Determining, by the sending device, the packet loss information of the RTP media stream, and further determining the media coding parameter and the transmission parameter, according to the sequence number related information, the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period, and then the sending device may The sending of the second RTP media stream is performed according to the determined media encoding parameter and the transmission parameter. Therefore, the embodiment of the present invention can effectively alleviate the packet loss problem of the media stream between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

It will be apparent to those skilled in the art that the techniques in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solution in the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product, and the computer software product may be stored in a storage medium such as a ROM/RAM. , disk, CD, etc., including a number of instructions to make a computer The device (which may be a personal computer, server, or network device, etc.) performs the methods described in various embodiments of the present invention or in certain portions of the embodiments.

Each of the embodiments in the present specification is described in a progressive manner, and the same or similar portions between the various embodiments may be referred to each other, and each embodiment focuses on differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

The above described embodiments of the invention are not intended to limit the scope of the invention. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims

1. A real-time transmission protocol RTP media stream transmission method, which is characterized by including:

The sending device sends the first RTP media stream to the receiving device;

Receive sequence number related information sent by the receiving device, where the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within a feedback cycle;

Determine the packet loss information of the first RTP media stream based on the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent within the feedback period;

Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent based on the packet loss information, and send the second RTP media stream to the receiving device.

2. The method according to claim 1, wherein the first RTP is determined based on the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent during the feedback period. Packet loss information of media streams, including:

The reception status sequence of the data packet is determined based on the sequence number related information and the sequence number information of the data packet actually sent within the feedback period. The reception status sequence of the data packet is whether each data packet is recorded according to the sending order of the data packet. The sequence of packet loss;

The sending device determines whether the randomness of the data packet loss matches the random packet loss characteristics based on the position of the lost data packet in the reception status sequence;

If it matches the random packet loss characteristics, determine that the packet loss information of the RTP media stream is random packet loss;

If it does not match the random packet loss characteristics, determine that the packet loss information of the RTP media stream is bandwidth limited.

3. The method according to claim 1 or 2, characterized in that, determining the media encoding parameters and transmission parameters of the second RTP media stream to be sent based on the packet loss information includes:

Determine the network constraint parameters corresponding to the packet loss information according to the determined packet loss information and the reception status sequence of the data packet;

Determine the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters;

When the packet loss information indicates that the bandwidth is limited, the network constraint parameters include: a limit period, which is the total number of consecutive non-lost data packets and consecutive packet loss data packets in the reception status sequence of the data packets. Transmission duration; Maximum flow rate, the maximum flow rate is the total number of bytes of consecutive unlost data packets in the sequence number related information; When the packet loss information is random packet loss, the network constraint parameters include: Packet loss rate , the packet loss rate is the The total number of lost packets in the packet's receive status sequence is divided by the total number of packets in the packet's receive status sequence.

4. The method according to claim 3, wherein determining the media encoding parameters and transmission parameters of the second RTP media stream to be sent based on the packet loss information and the network constraint parameters includes:

The media encoding parameters and transmission parameters are determined according to the following formula:

max f(x,y) = g(x) + h(y);

s.t. a(x,y) P

Where, x represents the media coding parameters, y represents the transmission parameters; g(x) represents the media quality score that can be obtained by the media coding parameters under the lossless network; h(y) represents the impact on the media quality score based on the transmission parameters. Proofreading; f (x, y) represents the media quality score obtained by the media coding parameters and transmission parameters under the actual network; a (x, y) represents the network constraint parameters corresponding to the media coding parameters and transmission parameters, and P represents the Network constraint parameters corresponding to packet loss information.

5. A real-time transmission protocol RTP media stream transmission method, which is characterized by including:

The receiving device receives the first RTP media stream sent by the sending device;

Determine the sequence number related information of the first RTP media stream, where the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within a feedback cycle;

Send the sequence number related information to the sending device, so that the sending device determines the first RTP media stream based on the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent within the feedback period. packet loss information, and determining the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device according to the packet loss information;

Receive the second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters.

6. The method according to claim 5, characterized in that, the sequence number related information is implemented through a packet allocation column bitmap, and the determining the sequence number related information of the first RTP media stream includes:

Determine the sequence number information of the data packet in the first RTP media stream received within a feedback cycle;

The packet arrangement bitmap is generated according to the sequence number information.

7. A real-time transmission protocol RTP media stream transmission device, which is characterized by including:

The first sending unit is used to send the first RTP media stream to the receiving device;

The first receiving unit is configured to receive sequence number related information sent by the receiving device, where the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within a feedback cycle; Packet loss information determination unit, configured to determine based on the sequence number related information received by the first receiving unit and the sequence number information of the data packet in the first RTP media stream actually sent by the first sending unit during the feedback period. Determine the packet loss information of the first RTP media stream;

A parameter determination unit, configured to determine the media encoding parameters and transmission parameters of the second RTP media stream to be sent based on the packet loss information;

The first sending unit is also used to: send the second RTP media stream.

8. The device according to claim 7, wherein the packet loss information determination unit includes: a sequence determination subunit, configured to determine based on the sequence number related information and the sequence number information of the data packet actually sent within the feedback period. Determine the reception status sequence of the data packet, which is the sequence of whether each data packet is lost according to the sending order of the data packet;

The cause determination subunit is used to determine whether the randomness of the data packet loss matches the random packet loss characteristics based on the position of the lost data packet in the reception status sequence of the data packet determined by the sequence determination subunit. If If it matches the random packet loss characteristics, it is determined that the packet loss information of the media stream is random packet loss; otherwise, it is determined that the packet loss information of the media stream is bandwidth limited.

9. The device according to claim 7 or 8, characterized in that the parameter determination unit includes: a first parameter determination sub-unit, configured to determine the loss based on the determined packet loss information and the reception status sequence of the data packet. Network constraint parameters corresponding to packet information;

The second parameter determination subunit is configured to determine the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters determined by the first parameter determination subunit; When the packet information is bandwidth limited, the network constraint parameters include: a limit period, which is the total sending time of consecutive non-lost data packets and consecutive lost data packets in the reception status sequence of the data packets. ; Maximum flow, the maximum flow is the total number of bytes of consecutive unlost data packets in the sequence number related information; When the packet loss information is random packet loss, the network constraint parameters include: Packet loss rate, so The packet loss rate is the total number of lost data packets in the reception status sequence of the data packet divided by the total number of data packets in the reception status sequence of the data packet.

10. The device according to claim 9, wherein the second parameter determination subunit is specifically configured to: determine the media encoding parameters and transmission parameters according to the following formula:

max f(x,y) = g(x) + h(y);

s.t. a(x,y) P

Among them, x represents the media coding parameters, y represents the transmission parameters; g(x) represents the media coding parameters in the lossless network. The media quality score that can be obtained under the actual network; h (y) represents the proofreading based on the impact of the transmission parameters on the media quality score; f (x, y) represents the media obtained under the actual network with the media encoding parameters and transmission parameters Quality score; a(x, y) represents the network constraint parameters corresponding to the media encoding parameters and transmission parameters, and P represents the network constraint parameters corresponding to the packet loss information.

11. A real-time transmission protocol RTP media stream transmission device, which is characterized by including:

The second receiving unit is used to receive the first RTP media stream sent by the sending device;

An information determining unit, configured to determine sequence number related information of the first RTP media stream received by the second receiving unit, where the sequence number related information is the first RTP media stream received by the second receiving unit within a feedback cycle. The sequence number information of the data packet;

The second sending unit is configured to send the sequence number related information determined by the information determining unit to the sending device, so that the sending device can determine the sequence number based on the sequence number related information and the first RTP actually sent within the feedback period. The sequence number information of the data packets in the media stream determines the packet loss information of the first RTP media stream, and determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device based on the packet loss information;

The second receiving unit is also configured to: receive a second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters.

12. The device according to claim 11, characterized in that, the serial number related information is implemented by packing a column bitmap, and the information determination unit is specifically used to:

13. A real-time transmission protocol RTP media stream transmission system, characterized by including a sending device and a receiving device, wherein,

The sending device is configured to send the first RTP media stream to the receiving device, and receive the sequence number related information sent by the receiving device, where the sequence number related information is the first RTP media stream received by the receiving device within a feedback cycle. The sequence number information of the data packets in the RTP media stream, determining the packet loss information of the first RTP media stream based on the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent within the feedback period, Determine the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and send the second RTP media stream to the receiving device;

The receiving device is configured to receive the first RTP media stream sent by the sending device, and determine the sequence number related information of the first RTP media stream. The sequence number related information is the first RTP received by the receiving device within a feedback cycle. Sequence number information of the data packet in the media stream, and send the sequence number related information to the sending device so that the sending device The sending device determines the packet loss information of the first RTP media stream based on the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent within the feedback period, and determines the sending device based on the packet loss information. Media encoding parameters and transmission parameters of the second RTP media stream to be sent by the device, and receiving the second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters.

14. The system according to claim 13, wherein the sending device is specifically configured to implement the first RTP media actually sent within the feedback period according to the sequence number related information in the following manner: The sequence number information of the data packets in the stream determines the packet loss information of the first RTP media stream:

15. The system according to claim 13 or 14, wherein the sending device is specifically configured to determine the media encoding parameters of the second RTP media stream to be sent according to the packet loss information in the following manner; Transmission parameters:

When the packet loss information indicates that the bandwidth is limited, the network constraint parameters include: a limit period, which is the total number of consecutive non-lost data packets and consecutive packet loss data packets in the reception status sequence of the data packets. Transmission duration; Maximum flow rate, the maximum flow rate is the total number of bytes of consecutive unlost data packets in the sequence number related information; When the packet loss information is random packet loss, the network constraint parameters include: Packet loss rate , the packet loss rate is the total number of lost data packets in the reception status sequence of the data packet divided by the total number of data packets in the reception status sequence of the data packet.