CN103167359B - The transmission method of RTP Media Stream and device - Google Patents

Abstract

The embodiment of the present invention discloses a method and device for transmitting an RTP media stream. The method includes: a sending device sends a first RTP media stream to a receiving device; the sending device receives serial number related information sent by the receiving device; the The sending device determines the packet loss information of the first RTP media stream according to the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period; the sending device determines the media packet loss information according to the packet loss information Coding parameters and transmission parameters; the sending device sends the second RTP media stream according to the media coding parameters and transmission parameters. The embodiments of the present invention can effectively alleviate the packet loss problem when transmitting RTP media streams between the sending device and the receiving device, and improve the transmission efficiency of the RTP media streams.

Description

Transmission method and device of RTP media stream

technical field

The invention relates to the communication field, in particular to a method and device for transmitting RTP media streams.

Background technique

Real-time Transport Protocol (RTP for short) is a network protocol that realizes real-time transmission of media stream data on the Internet Protocol (Internet Protocol, IP for short). The RTP protocol includes the RTP data protocol and the RTP control protocol (Real-timeTransportControlProtocol, RTCP for short).

In the prior art, when the RTP protocol is used to transmit the RTP media stream, the transmission process of the RTP media stream between the sending device and the receiving device includes: the sending device sends the RTP media stream to the receiving device; The number of data packets in the received RTP media stream sends an RTCP feedback message to the sending device, and the RTCP feedback message carries the number of data packets; The number of data packets and the number of data packets carried in the RTCP feedback message adjust the transmission parameters, such as redundant parameters, redundant packet formats, etc.; the sending device sends RTP media to the receiving device according to the adjusted transmission parameters flow.

However, the above method for transmitting the RTP media stream cannot effectively solve the problem of packet loss when transmitting the RTP media stream between the sending device and the receiving device, and the transmission efficiency of the RTP media stream is low.

Contents of the invention

Embodiments of the present invention provide a method and device for transmitting RTP media streams, which can effectively alleviate the problem of packet loss when transmitting RTP media streams between a sending device and a receiving device, and improve the transmission efficiency of RTP media streams.

In a first aspect, an embodiment of the present invention provides a method for transmitting a real-time transport protocol RTP media stream, including:

The sending device sends the first RTP media stream to the receiving device;

receiving sequence number related information sent by the receiving device, where the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within one feedback cycle;

Determine the packet loss information of the first RTP media stream according to the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent in the feedback period;

Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and send the second RTP media stream to the receiving device.

With reference to the first aspect above, in the first possible implementation of the first aspect, the sequence number information of the data packets in the first RTP media stream actually sent in the feedback period according to the sequence number related information Determining the packet loss information of the first RTP media stream, including:

Determine the receiving state sequence of the data packet according to the sequence number related information and the sequence number information of the data packet actually sent in the feedback cycle, the receiving state sequence of the data packet is whether each data packet recorded according to the sending order of the data packet is The sequence of packet loss;

The sending device determines whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the packet loss packet in the receiving state sequence;

If it matches the random packet loss feature, determine that the packet loss information of the RTP media stream is random packet loss;

If it does not match the random packet loss feature, determine that the packet loss information of the RTP media stream is bandwidth limited.

In combination with the above first aspect, and/or, the first possible implementation manner of the first aspect, in the second possible implementation manner of the first aspect, determining the second RTP media to be sent according to the packet loss information Stream media encoding parameters and transmission parameters, including:

determining a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet;

Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters;

When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information;

When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence.

With reference to the second possible implementation of the first aspect above, in the third possible implementation of the first aspect, the determining of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters Media encoding parameters and transmission parameters, including:

Determine the media encoding parameters and transmission parameters according to the following formula:

maxf(x,y)=g(x)+h(y);

s.t.a(x,y)≤P

Wherein, x represents a media coding parameter, y represents a transmission parameter; g(x) represents the media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the influence based on the transmission parameter on the media quality score Proofreading; f(x, y) represents the media quality score obtained by the media encoding parameters and transmission parameters under the actual network; a(x, y) represents the network constraint parameters corresponding to the media coding parameters and transmission parameters, and P represents the Network constraint parameters corresponding to packet loss information.

In a second aspect, embodiments of the present invention provide a method for transmitting a real-time transport protocol RTP media stream, including:

The receiving device receives the first RTP media stream sent by the sending device;

Determine the serial number related information of the first RTP media stream, the serial number related information is the serial number information of the data packet in the first RTP media stream received by the receiving device within a feedback cycle;

Sending the sequence number related information to the sending device, so that the sending device determines the first RTP media stream according to the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent in the feedback period Packet loss information, determining media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device according to the packet loss information;

Receive the second RTP media stream sent by the sending device according to the media encoding parameter and the transmission parameter.

In conjunction with the second aspect above, in the first possible implementation of the second aspect, the serial number-related information is implemented by using a packet configuration bitmap, and the determination of the serial number-related information of the first RTP media stream includes:

Determine the sequence number information of the data packet in the first RTP media stream received in a feedback cycle;

The packet arrangement bitmap is generated according to the sequence number information.

In a third aspect, an embodiment of the present invention provides a transmission device for a real-time transport protocol RTP media stream, including:

a first sending unit, configured to send a first RTP media stream to a receiving device;

A first receiving unit, configured to receive sequence number related information sent by the receiving device, where the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within one feedback cycle;

A packet loss information determining unit, configured to, according to the sequence number related information received by the first receiving unit, the sequence number information of the data packet in the first RTP media stream actually sent by the first sending unit within the feedback period Determine the packet loss information of the first RTP media stream;

A parameter determination unit, configured to determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information;

The first sending unit is further configured to: send the second RTP media stream.

In combination with the third aspect above, in the first possible implementation of the third aspect, the packet loss information determination unit includes:

A sequence determining subunit, configured to determine the receiving state sequence of data packets according to the sequence number related information and the sequence number information of the data packets actually sent in the feedback period, and the receiving state sequence of the data packets is according to the sending state of the data packets Sequence of whether each data packet recorded in sequence is lost or not;

The cause determination subunit is used to determine whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the lost packet in the receiving state sequence of the packet determined by the sequence determination subunit, if If it matches the random packet loss characteristic, it is determined that the packet loss information of the media stream is random packet loss; otherwise, it is determined that the packet loss information of the media stream is bandwidth limited.

In combination with the third aspect above, and/or the first possible implementation manner of the third aspect, in the second possible implementation manner of the third aspect, the parameter determination unit includes:

The first parameter determination subunit is configured to determine a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet;

A second parameter determination subunit, configured to determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters determined by the first parameter determination subunit;

When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information;

When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence.

In combination with the second possible implementation of the third aspect above, in the third possible implementation of the third aspect, the second parameter determination subunit is specifically used for:

Determine the media encoding parameters and transmission parameters according to the following formula:

maxf(x,y)=g(x)+h(y);

s.t.a(x,y)≤P

Wherein, x represents a media coding parameter, y represents a transmission parameter; g(x) represents the media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the influence based on the transmission parameter on the media quality score Proofreading; f(x, y) represents the media quality score obtained by the media encoding parameters and transmission parameters under the actual network; a(x, y) represents the network constraint parameters corresponding to the media coding parameters and transmission parameters, and P represents the Network constraint parameters corresponding to packet loss information.

In a fourth aspect, the embodiment of the present invention provides a real-time transport protocol RTP media stream transmission device, including:

The second receiving unit is configured to receive the first RTP media stream sent by the sending device;

An information determination unit, configured to determine sequence number related information of the first RTP media stream received by the second receiving unit, where the sequence number related information is the first RTP media stream received by the second receiving unit within a feedback cycle The serial number information of the data packet;

A second sending unit, configured to send the sequence number related information determined by the information determining unit to the sending device, so that the sending device can use the sequence number related information and the first RTP actually sent in the feedback period The sequence number information of the data packets in the media stream determines the packet loss information of the first RTP media stream, and determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device according to the packet loss information;

The second receiving unit is further configured to: receive a second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters.

In combination with the fourth aspect above, in the first possible implementation of the fourth aspect, the serial number-related information is realized by including a column bitmap, and the information determining unit is specifically configured to:

Determine the sequence number information of the data packet in the first RTP media stream received in a feedback cycle;

The packet arrangement bitmap is generated according to the sequence number information.

In the fifth aspect, an embodiment of the present invention provides a real-time transport protocol RTP media stream transmission system, including a sending device and a receiving device, wherein,

The sending device is configured to send a first RTP media stream to a receiving device, and receive sequence number related information sent by the receiving device, where the sequence number related information is the first RTP media stream received by the receiving device within a feedback cycle. The sequence number information of the data packet in the RTP media stream, according to the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent in the feedback cycle, determine the packet loss information of the first RTP media stream, determining media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and sending the second RTP media stream to the receiving device;

The receiving device is configured to receive the first RTP media stream sent by the sending device, and determine the sequence number related information of the first RTP media stream, where the sequence number related information is the first RTP received by the receiving device within a feedback cycle The sequence number information of the data packet in the media stream, and send the sequence number related information to the sending device, so that the sending device can use the sequence number related information and the data packet in the first RTP media stream actually sent in the feedback period The sequence number information of the first RTP media stream determines the packet loss information of the first RTP media stream, determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device according to the packet loss information, and receives the sending device according to the media The encoding parameters and the second RTP media stream sent by the transmission parameters.

With reference to the fifth aspect above, in a first possible implementation manner of the fifth aspect, the sending device is specifically configured to realize the actual sending of the information in the feedback period according to the sequence number related information in the following manner: The sequence number information of data packet in the first RTP media stream determines the packet loss information of the first RTP media stream:

Determine the receiving state sequence of the data packet according to the sequence number related information and the sequence number information of the data packet actually sent in the feedback cycle, the receiving state sequence of the data packet is whether each data packet recorded according to the sending order of the data packet is The sequence of packet loss;

The sending device determines whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the packet loss packet in the receiving state sequence;

If it matches the random packet loss feature, determine that the packet loss information of the RTP media stream is random packet loss;

If it does not match the random packet loss feature, determine that the packet loss information of the RTP media stream is bandwidth limited.

With reference to the fifth aspect above, and/or the first possible implementation manner of the fifth aspect, in the second possible implementation manner of the fifth aspect, the sending device is specifically configured to implement the The packet information determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent:

determining a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet;

Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters;

When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information;

When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence.

In the embodiment of the present invention, the sending device sends the first RTP media stream to the receiving device; receives the serial number related information sent by the receiving device, and the serial number related information is the first RTP media stream received by the receiving device within a feedback period The sequence number information of the data packet in an RTP media stream; determine the packet loss information of the first RTP media stream according to the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period ; Determine the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and send the second RTP media stream to the receiving device. Thus, the sending device determines the packet loss information of the first RTP media stream, and determines the media encoding parameters and transmission parameters according to the packet loss information; the sending device sends the second RTP media stream according to the media encoding parameters and transmission parameters, so the present invention The embodiment can effectively alleviate the problem of packet loss in the process of RTP media stream transmission between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required in the embodiments. Obviously, the accompanying drawings in the following description are only some of the present invention. Embodiments, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

Fig. 1 is the schematic diagram of the first embodiment of the transmission method of RTP media stream of the present invention;

Fig. 2 is the schematic diagram of the second embodiment of the transmission method of RTP media stream of the present invention;

Fig. 3 is the schematic diagram of the third embodiment of the transmission method of RTP media stream of the present invention;

FIG. 4 is a schematic diagram of a first embodiment of an RTP media stream transmission device according to the present invention;

5 is a schematic diagram of a second embodiment of an RTP media stream transmission device of the present invention;

Fig. 6 is a schematic structural diagram of the sending device of the RTP media stream of the present invention;

FIG. 7 is a schematic structural diagram of a receiving device for an RTP media stream of the present invention;

FIG. 8 is a schematic structural diagram of the transmission system of the RTP media stream according to the present invention.

detailed description

Through analysis, it is found that the causes of packet loss during the transmission of RTP media streams are different, and different causes of packet loss require different measures to overcome. If the cause of packet loss is not accurately identified, the adjustment of transmission parameters by the sending device may be counterproductive. For example, if the media stream transmission bandwidth between the sending device and the transmission device is limited, and the available bandwidth is less than the actual upstream bandwidth of the RTP media stream, causing data packet loss, if redundant coding such as forward error correction coding (FEC, ForwardErrorCorrection ), it will increase the actual uplink bandwidth of the RTP media stream, causing the transmission of the RTP media stream to require more bandwidth resources, thereby aggravating packet loss; or, when the cause of packet loss is random packet loss, if the sending device The flow rate of the RTP media stream does not guarantee that the RTP media stream sent by the sending device can be more effectively transmitted to the receiving device. It can be seen that identifying the cause of data packet loss is the core of solving the problem of packet loss in the process of RTP media stream transmission between the sending device and the receiving device and improving the transmission efficiency of the RTP media stream. However, the RTP media stream transmission method in the prior art only adjusts the transmission parameters, which obviously can only effectively solve the loss in the RTP media stream transmission process between the sending device and the receiving device in some specific situations or occasions. In most cases, it cannot effectively solve the packet loss problem during the RTP media stream transmission between the sending device and the receiving device.

In view of this, in the RTP media stream transmission method provided by the embodiment of the present invention, the packet loss information of the RTP media stream is determined, and the media encoding parameters and transmission parameters are determined according to the packet loss information, thereby effectively alleviating the tension between the sending device and the receiving device. The problem of packet loss in the process of RTP media stream transmission improves the transmission efficiency of RTP media stream.

Wherein, the sending device referred to in the embodiment of the present invention refers to the device sending the RTP media stream, and the receiving device refers to the device receiving the RTP media stream, and is not intended to limit whether the sending device can send and receive RTP media streams. Other data, whether the receiving device can send and receive other data than the RTP media stream.

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Referring to Fig. 1, it is a schematic diagram of the first embodiment of the transmission method of the RTP media stream of the present invention, the method can be applied to the sending device, and the method includes:

Step 101: the sending device sends the first RTP media stream to the receiving device;

Step 102: The sending device receives the serial number related information sent by the receiving device, and the serial number related information is the serial number information of the data packet in the first RTP media stream received by the receiving device within one feedback period;

Wherein, the receiving device may send the serial number related information to the sending device through a message such as an RTCP feedback message.

Wherein, the sequence number related information may include: the sequence number information of the data packet in the RTP media stream received by the receiving device within one feedback cycle, or the packet arrangement bitmap; the packet arrangement bitmap may be fed back by the receiving device The sequence number information of the data packet in the RTP media stream received in the cycle is generated.

Step 103: The sending device determines the packet loss information of the first RTP media stream according to the sequence number related information and the sequence number information of the data packets in the RTP media stream actually sent in the feedback period;

The packet loss information is information for recording the cause of RTP media stream packet loss.

Step 104: The sending device determines media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and sends the second RTP media stream to the receiving device.

Wherein, the first RTP media stream and the second RTP media stream are both RTP media streams, and the first and second RTP media streams are only used to distinguish the RTP media streams in step 101 and step 104 .

The first RTP media stream and the second RTP media stream may be the same or different RTP media streams. Generally, the first RTP media stream is different from the second RTP media stream, and the second RTP media stream is a subsequent media stream of the first RTP media stream, so that the media can be determined according to the transmission of the previous first RTP media stream encoding parameters and transmission parameters, and then use the determined media stream encoding parameters and transmission parameters to perform subsequent RTP media stream transmission.

In this embodiment, the sending device determines packet loss information of the first RTP media stream, and determines media encoding parameters and transmission parameters according to the packet loss information; the sending device sends the second RTP media stream according to the media encoding parameters and transmission parameters Therefore, the embodiment of the present invention can determine different media coding parameters and transmission parameters for different packet loss reasons, thereby effectively alleviating the packet loss problem of the RTP media stream between the sending device and the receiving device, and improving the transmission of the RTP media stream efficiency.

Referring to Fig. 2, it is a schematic diagram of the second embodiment of the transmission method of the RTP media stream of the present invention, the method can be applied to a receiving device, and the method includes:

Step 201: the receiving device receives the first RTP media stream sent by the sending device;

Step 202: The receiving device determines the sequence number related information of the first RTP media stream, and the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within one feedback cycle;

Wherein, when the serial number related information includes the serial number information of the data packet in the first RTP media stream received by the receiving device within a feedback cycle, the serial number related information may directly include the serial number of each data packet;

Or, when the sequence number related information includes a packet arrangement bitmap, the receiving device determines that the sequence number related information of the RTP media stream may include: the receiving device determines the sequence number information of the data packet in the RTP media stream received within a feedback cycle; the receiving device A packet arrangement bitmap is generated according to the sequence number information.

Step 203: The receiving device sends the sequence number related information to the sending device, so that the sending device determines the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period according to the sequence number related information Packet loss information of an RTP media stream, determining media encoding parameters and transmission parameters of a second RTP media stream to be sent by the sending device according to the packet loss information;

Step 204: The receiving device receives the second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters.

In this embodiment, the receiving device determines the sequence number related information according to the sequence number information of the data packet in the first RTP media stream received within one feedback cycle, and sends the sequence number related information to the sending device, so that the sending device Determine the packet loss information of the first RTP media stream according to the serial number related information and the serial number information of the data packets in the RTP media stream actually sent in the feedback period, and then determine the media encoding parameters and transmission parameters, and then the sending device can be based on The determined media encoding parameters and transmission parameters are used to send the second RTP media stream, so the embodiment of the present invention can effectively alleviate the packet loss problem of the media stream between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

Referring to Fig. 3, it is a schematic diagram of the third embodiment of the RTP media stream transmission method of the present invention, the method includes:

Step 301: The sending device sends a first RTP media stream to the receiving device.

Wherein, the sending device sends the first RTP media stream with current media encoding parameters and transmission parameters.

Step 302: The receiving device receives the first RTP media stream, and determines the sequence number related information of the first RTP media stream;

Wherein, when the serial number related information includes the serial number information of the data packet in the first RTP media stream received by the receiving device within a feedback cycle, the serial number of each data packet can be directly recorded in the serial number related information; If the receiving device receives 5 data packets with sequence numbers 1, 3, 4, 5, and 7 within the period, the sequence number-related information may be: 13457;

Alternatively, when the sequence number related information includes a packet arrangement bitmap, the receiving device determining the sequence number related information of the first RTP media stream may include: the receiving device determines the sequence number of the data packet in the first RTP media stream received within one feedback cycle information; the receiving device generates a packet arrangement bitmap according to the sequence number information.

In a possible implementation manner, the packet arrangement bitmap may include: the sequence number of the first data packet received in the one feedback cycle, and the sequence number of the first data packet received in the one feedback cycle Bitmaps generated by packets other than the first packet. For example, if the receiving device receives 7 data packets whose sequence numbers are 1, 2, 3, 5, 6, 7, and 8 in the feedback cycle, the packet arrangement bitmap may be:

HeaderPacketSN:1

RcvMap: 0xF7

Among them, the binary representation of 0xF7 is 11110111. If the lowest bit represents the first data packet, and the bit is 1, it means that it is successfully received, then 0xF7 can express that the receiving device has received the serial number 1, 2, 3, 5, 6, 7, 7 packets of 8.

Wherein, the specific time length and starting time of the feedback cycle can be set independently in practical applications, and are not limited here.

Step 303: The receiving device sends an RTCP feedback message to the sending device, where the RTCP feedback message includes the sequence number related information.

In practical applications, the receiving device may also carry the sequence number-related information through other messages, which is not limited here.

Wherein, the RTCP feedback message may be sent by the receiving device to the sending device according to the feedback period during the process of receiving the RTP media stream. For example, at the end of each feedback cycle, the receiving device obtains the sequence number related information according to the sequence number information of the data packets in the RTP media stream received in the feedback cycle just ended, and sends the sequence number related information to the sending device. Informational RTCP feedback messages.

Wherein, the RTCP feedback message may also include other information, for example: the total number of bytes of the RTP media stream received by the receiving device within the feedback period, and/or delay information.

Wherein, the total number of bytes may be used to calculate a bandwidth constraint between the sending device and the receiving device, specifically, the bandwidth constraint is equal to: the total number of bytes/time length of the feedback cycle.

The delay information may be used as one of the basis for adjusting the transmission path when the sending device adjusts the transmission path of the RTP media stream between the sending device and the receiving device. The specific implementation process will not be repeated here.

Step 304: The sending device receives the RTCP feedback message, and determines the packet loss information of the first RTP media stream according to the sequence number related information and the sequence number information of the data packets in the RTP media stream actually sent in the one feedback cycle .

In the embodiment of the present invention, packet loss information is divided into two types: random packet loss and bandwidth limitation. In practical applications, other divisions of the packet loss information may also be performed according to actual conditions, which is not limited here.

The network constraint parameters corresponding to different packet loss information are different. When the packet loss information is random packet loss, the network constraint parameters may include: packet loss rate and packet loss period of random packet loss of data packets; packet loss information is bandwidth When limited, the network constraint parameters may include: a maximum flow rate between the sending device and the receiving device and a limit period.

Specifically, the determining the packet loss information of the first RTP media stream according to the sequence number related information and the sequence number information of the data packets in the RTP media stream actually sent in the one feedback period may include:

The sending device determines the receiving state sequence of the data packet according to the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period, and the receiving state sequence of the data packet is according to the data Information about whether each data packet is lost or not recorded in the sending order of the packet;

Judging whether the randomness of packet loss matches the random packet loss characteristic according to the position of the packet loss data packet in the receiving state sequence of the data packet, if it matches the random packet loss characteristic, then determine the packet loss information of the media stream is random packet loss; otherwise, determine the packet loss information of the media stream as bandwidth limited.

For example, the sending device sends 10 data packets with serial numbers 1 to 10 to the receiving device during the feedback cycle; and the serial number related information is 1236789; then, the receiving state sequence of data packets can be: rrrxxrrrrx, where r Indicates that the data packet is not lost, and x indicates that the data packet is lost.

When judging whether the randomness of data packet loss matches the random packet loss characteristics according to the position of the lost data packet in the receiving state sequence of the data packet, it can be realized by combining Poisson distribution (Poisson distribution), self-similar model, etc. . For example, the Poisson distribution is a common discrete probability distribution in statistics and probability, and the Poisson distribution is suitable for describing the number of random events occurring per unit time. The Poisson distribution formula is as follows The expectation and variance of the Poisson distribution are both λ, λ is the average occurrence rate of random events per unit time or unit area, k is the number of times random events occur per unit time, k=0,1,2,…. Because the number or number of random packet loss events occurring per unit time approximately obeys the Poisson distribution, it can be calculated according to the above Poisson distribution formula according to the position of the lost data packet in the receiving state sequence of the data packet The value of λ, and then according to the λ value, calculate the theoretical packet loss number corresponding to the λ in the Δt time; from the receiving state sequence of the data packet, the receiving state sequence of the Δt time is arbitrarily taken, and the time of the Δt time is judged Whether the difference between the actual packet loss number and the theoretical packet loss number in the receiving state sequence is not greater than the preset difference threshold, if yes, it is judged that the randomness of the data packet loss matches the random packet loss characteristic, if not, Then it is judged that the randomness of packet loss does not match the random packet loss characteristic. Wherein, the difference threshold can be set independently in practical applications.

Therefore, in a possible implementation manner, the judging whether the randomness of the data packet loss conforms to the random packet loss characteristic according to the position of the lost data packet in the receiving state sequence of the data packet may include:

According to the position of the lost data packet in the receiving state sequence of the data packet according to the Poisson distribution formula Calculate the λ value; k is the position of the lost data packet in the receiving state sequence;

Calculate the number of theoretical packet loss corresponding to λ within Δt time;

From the receiving state sequence of the data packet, the receiving state sequence of Δt time is randomly selected, and it is judged whether the difference between the actual packet loss number and the theoretical packet loss number in the receiving state sequence of the Δt time is less than a preset threshold, if is less than, it is judged that the randomness of packet loss matches the random packet loss characteristic, otherwise, it is judged that the randomness of data packet loss does not match the random packet loss characteristic.

Among them, when calculating the number of theoretical packet loss corresponding to λ within Δt time, it can be calculated according to the formula P ₁ (t, t+Δt)=λΔt+Ο(Δt), where t is the initial time, P1(t+Δt) Indicates the probability of data packet loss within t+Δt time; O(Δt) is the functional formula of Δt; how to realize the calculation will not be repeated here.

Step 305: The sending device determines a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet.

Wherein, when the packet loss information is bandwidth limited, determining the network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet may include: continuously The total sending duration of the data packets without packet loss and the data packets with continuous packet loss is taken as the limit period; the total number of bytes of the data packets without packet loss in the sequence number related information is taken as the maximum flow rate;

When the packet loss information is random packet loss, determining the network constraint parameters corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet may include: the packet loss in the receiving state sequence of the data packet The total number of data packets is divided by the total number of data packets in the receiving state sequence of the data packets to obtain the packet loss rate.

Wherein, the packet loss period can generally be calculated in combination with the packet loss rate, and the specific calculation method is not limited here. In practical applications, because the packet loss rate is introduced by the performance bottleneck of routing/switching equipment, and packet per second (PPS, PacketPerSecond) is used as a common indicator in the performance of routing/switching equipment, the packet loss period can be directly set to 1s. Therefore, in practical applications, the value of the packet loss period can be pre-stored directly in the sending device, and the pre-stored value of the packet loss period can be read when determining the network constraint parameter corresponding to the random packet loss.

Specifically, when determining the limit period, the first lost data packet can be found from the receiving state sequence of the data packet, and then the first lost data packet can be found after the first lost data packet. non-lost data packets, determine the number of consecutive non-lost data packets starting from the non-lost data packets, and determine the first packet loss data packets after the non-lost data packets, determine from the non-lost data packets The packet loss data packet starts the number of consecutive packet loss data packets, calculates the sum of the number of the continuous non-packet loss data packets and the number of consecutive packet loss data packets, and combines the sum with each The sending duration of the data packets is multiplied to obtain the restriction period.

When determining the maximum flow rate, the total number of bytes of consecutive non-lost data packets starting from the non-packet loss data packet may be determined to obtain the maximum flow rate.

For example, the receiving state sequence of the data packet is rrxxrrrxxrrrxx, then the third data packet identified as x can be found first, and then the first data packet identified as r is found after the third data packet, That is, the fifth data packet, the data packets that have not been lost continuously since the fifth data packet are the fifth data packet to the seventh data packet, therefore, determine the data that has not been lost continuously since the fifth data packet The number of packets is 3, the first data packet marked as x after the 5th data packet is the 8th data packet, and the data packets that are continuously lost from the 8th data packet are the 8th data packet and The 9th data packet, therefore, it is determined that the number of data packets lost continuously from the 8th data packet is 2, and the total number is 5, then the restriction period is 5t; t is the sending of each data packet duration.

The maximum flow is the total number of bytes of the 5th data packet to the 7th data packet.

Step 306: The sending device determines media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and network constraint parameters corresponding to the packet loss information.

Wherein, the media encoding parameters may include at least one of the following parameters: RTP packet rate after media encoding, media encoding algorithm, and encoding rate.

Wherein, the RTP packet rate constructed after the media encoding refers to the number of data packets sent by the sending device per second;

The media encoding algorithm refers to the media compression algorithm format used by the sending device when encoding the RTP media stream, and the media compression algorithm format includes: Adaptive Multi-Rate (AMR, AdaptiveMulti-Rate), G.711, etc.;

The encoding rate refers to the rate at which the media compression algorithm is used. For example, the media compression algorithm AMR includes multiple rate formats, and the encoding rate can be used to specifically indicate the media compression algorithm used by AMR. rate format.

The transmission parameters may include at least one of the following parameters: redundant packet encoding format and redundant parameters.

Wherein, the redundancy parameter refers to a redundancy coefficient. For example, when the redundancy parameter is 1 times redundancy, the sending device will send each data packet in the RTP media stream by one more time when sending the RTP media stream. share;

The redundancy parameter may be a non-integer number in actual application. For example, 10% means that only 10% of all data packets are doubled. This can be achieved by means of important frame identification and other technologies, and will not be repeated here.

The encoding format of the redundant packet is used to indicate the encoding format adopted by the redundant data packet. Such as the redundant format defined by RFC2198, etc.

In practical applications, the performance of different media parameters and transmission parameters under different network damages can be tested by means of tests, and the network constraint parameters, media coding parameters, and Equations formed by transmission parameters, such as:

maxf(x,y)=g(x)+h(y)

s.t.a(x,y)≤P

Among them, x represents the media coding parameter, y represents the transmission parameter; g(x) represents the media quality score that the media coding parameter can obtain under the lossless network, such as the average evaluation score (MOS, MeanOpinionScore)/subjective speech quality evaluation describing the speech quality (PESQ, Perceptualevaluationofspeechquality) score; h(y) indicates proofreading based on the impact of the transmission parameters on the media quality score; f(x, y) indicates the media quality obtained by the media encoding parameters and transmission parameters under the actual network Score; a(x, y) represents the network constraint parameter corresponding to the media encoding parameter and the transmission parameter, and P represents the network constraint parameter corresponding to the packet loss information.

Specifically, in the embodiment of the present invention, it is necessary to form the first equation according to the network constraint parameters, media encoding parameters, and transmission parameters corresponding to the random packet loss, and form the second equation according to the network constraint parameters, media encoding parameters, and transmission parameters corresponding to the bandwidth constraints; In the implementation of this step, the network constraint parameters corresponding to the packet loss information can be directly substituted into the equation corresponding to the packet loss information to calculate the media encoding parameters and transmission parameters.

Step 307: The sending device sends the second RTP media stream according to the media encoding parameters and transmission parameters determined in step 306.

Wherein, in this step, the media encoding parameters and transmission parameters according to which the sending device sends the second RTP media stream are determined according to the packet loss information and the network constraint parameters corresponding to the packet loss information, so that the sending device and the receiving device can effectively alleviate the The packet loss problem that occurs during the transmission of RTP media streams between RTP media streams improves the transmission efficiency of RTP media streams.

In this embodiment, the sending device determines the packet loss information of the first RTP media stream and the network constraint parameters corresponding to the packet loss information, and determines the media encoding parameters according to the packet loss information and the network constraint parameters corresponding to the packet loss information and transmission parameters; the sending device sends the second RTP media stream according to the media encoding parameters and the transmission parameters, so the embodiment of the present invention can effectively alleviate the packet loss problem that occurs during the transmission of the RTP media stream between the sending device and the receiving device , improve the transmission efficiency of the RTP media stream.

Referring to FIG. 4 , it is a schematic diagram of a first embodiment of a device for transmitting an RTP media stream according to the present invention. The device can be set in a sending device. The device 400 includes:

The first sending unit 410 is configured to send the first RTP media stream to the receiving device;

The first receiving unit 420 is configured to receive the serial number-related information sent by the receiving device, where the serial number-related information is the first RTP media sent by the first sending unit 410 received by the receiving device within one feedback cycle Sequence number information of packets in the flow;

A packet loss information determining unit 430, configured to, according to the sequence number related information received by the first receiving unit 420, the data packets in the first RTP media stream actually sent by the first sending unit 410 within the feedback period The sequence number information determines the packet loss information of the first RTP media stream;

A parameter determining unit 440, configured to determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information determined by the packet loss information determining unit 430;

The first sending unit 410 is further configured to: send a second RTP media stream according to the media encoding parameters and transmission parameters determined by the parameter determining unit 440 .

Preferably, the packet loss information determining unit 430 may specifically include:

A sequence determining subunit, configured to determine the receiving state sequence of data packets according to the sequence number related information and the sequence number information of the data packets actually sent in the feedback period, and the receiving state sequence of the data packets is according to the sending state of the data packets Information about whether each data packet recorded sequentially is lost;

The cause determination subunit is used to determine whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the lost packet in the receiving state sequence of the packet determined by the sequence determination subunit, if If it matches the random packet loss characteristic, it is determined that the packet loss information of the media stream is random packet loss; otherwise, it is determined that the packet loss information of the media stream is bandwidth limited.

Preferably, the parameter determination unit 440 may include:

The first parameter determination subunit is configured to determine a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet;

A second parameter determination subunit, configured to determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters determined by the first parameter determination subunit;

When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information;

When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence.

The first parameter determination subunit can specifically be used for:

When the packet loss information is that the bandwidth is limited, the total sending time of the continuous non-lost data packets and the continuous packet loss data packets in the receiving state sequence of the data packets is used as the restriction period; the sequence number is correlated The total number of bytes of consecutive unlost data packets in the information is taken as the maximum flow rate;

When the packet loss information is random packet loss, the network constraint parameter may include: dividing the total number of data packets lost in the receiving state sequence of the data packets by the total number of data packets in the receiving state sequence of the data packets, Get the packet loss rate.

When the packet loss information is random packet loss, dividing the total number of lost data packets in the receiving state sequence of data packets by the total number of data packets in the receiving state sequence of data packets to obtain the packet loss rate.

Preferably, the second parameter determination subunit can specifically be used for:

Determine the network constraint parameters according to the following formula:

maxf(x,y)=g(x)+h(y);

s.t.a(x,y)≤P

Wherein, x represents a media coding parameter, y represents a transmission parameter; g(x) represents the media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the influence based on the transmission parameter on the media quality score Proofreading; f(x, y) represents the media quality score obtained by the media encoding parameters and transmission parameters under the actual network; a(x, y) represents the network constraint parameters corresponding to the media coding parameters and transmission parameters, and P represents the Network constraint parameters corresponding to packet loss information.

In this embodiment, the packet loss information of the media stream is determined, and the media coding parameters and transmission parameters are determined according to the packet loss information; and the second RTP media stream is sent according to the media coding parameters and transmission parameters, so that the sending device and transmission parameters can be effectively alleviated. The packet loss problem in the process of RTP media stream transmission between receiving devices improves the transmission efficiency of RTP media streams.

Referring to FIG. 5 , it is a schematic diagram of a second embodiment of an RTP media stream transmission device according to the present invention. The device can be set on a receiving device. The device 500 includes:

The second receiving unit 510 is configured to receive the first RTP media stream sent by the sending device;

An information determining unit 520, configured to determine sequence number related information of the RTP media stream received by the second receiving unit 510, where the sequence number related information is the first RTP media stream received by the second receiving unit 510 within one feedback cycle Sequence number information of packets in the flow;

The second sending unit 530 is configured to send the sequence number-related information determined by the information determining unit 520 to the sending device, so that the sending device actually sends the first sequence number in the feedback period according to the sequence number-related information. The sequence number information of the data packets in an RTP media stream determines the packet loss information information of the first RTP media stream, and determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device according to the packet loss information;

The second receiving unit 510 is further configured to: receive the second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters.

Preferably, the serial number-related information is implemented by including a column bitmap, and the information determination unit 520 can be specifically used for:

Determine the sequence number information of the data packet in the first RTP media stream received in a feedback cycle;

The packet arrangement bitmap is generated according to the sequence number information.

In this embodiment, the serial number-related information is determined according to the RTP media stream received within one feedback cycle, and the serial number-related information is sent to the sending device, so that the sending device can, according to the serial number-related information, The sequence number information of the data packets in the RTP media stream actually sent in the feedback period determines the packet loss information of the media stream, and determines the media encoding parameters and transmission parameters according to the packet loss information, and then the receiving and sending device determines the media encoding parameters and transmission parameters according to the determined media encoding parameters and The second RTP media stream sent by the transmission parameters can effectively alleviate the packet loss problem during the transmission of the RTP media stream between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

Referring to FIG. 6 , it is a schematic structural diagram of a sending device for an RTP media stream according to the present invention. The sending device 600 includes: a first processor 610, a first memory 620, a first transceiver 630 and a first bus 640;

The first processor 610, the first memory 620, and the first transceiver 630 are connected to each other through a first bus 640; the first bus 640 may be an ISA bus, a PCI bus, or an EISA bus. The first bus 640 can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 6 , but it does not mean that there is only one bus or one type of bus.

The first memory 620 is used to store a program, and the program is used to realize the RTP media stream transmission method performed by the sending device in the embodiment shown in FIG. 1 and FIG. 3 . Specifically, the program may include program code, and the program code includes computer operation instructions. The first memory 620 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

The first transceiver 630 is used to connect other devices, such as a receiving device, a server, and a remote host, and communicate with other devices. Specifically, the first transceiver 630 is configured to: send the first RTP media stream to the receiving device; receive the serial number related information sent by the receiving device, and the serial number related information is received by the receiving device within a feedback cycle Sequence number information of data packets in the first RTP media stream; sending the second RTP media stream according to the media encoding parameters and transmission parameters determined by the first processor 610 .

The first processor 610 executes the program code stored in the first memory 620, and is used to, according to the information related to the sequence number received by the first transceiver 630, the first transceiver 630 within the feedback cycle The sequence number information of the data packets in the actually sent first RTP media stream determines the packet loss information of the media stream; and determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information.

Preferably, the first processor 610 may be specifically configured to: determine the receiving state sequence of the data packet according to the sequence number related information and the sequence number information of the data packet actually sent in the feedback period, and the reception of the data packet The state sequence is the information of whether each data packet is lost according to the sending order of the data packet; whether the randomness of the data packet loss is judged according to the position of the lost data packet in the receiving state sequence of the data packet is consistent with random loss The packet characteristic matches, and if it matches the random packet loss characteristic, it is determined that the packet loss information of the media stream is random packet loss; otherwise, it is determined that the packet loss information of the media stream is bandwidth limited.

Preferably, the first processor 610 may be specifically configured to: determine a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet;

Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters.

Wherein, when the packet loss information is that the bandwidth is limited, the network constraint parameters may include: a limit cycle, the limit cycle is the continuous non-lost data packets and the continuous packet loss data in the receiving state sequence of the data packets The total sending time of the packet; the maximum flow, the maximum flow is the total number of bytes of the continuous non-lost data packets in the serial number related information;

When the packet loss information is random packet loss, the network constraint parameter may include: dividing the total number of data packets lost in the receiving state sequence of the data packets by the total number of data packets in the receiving state sequence of the data packets, Get the packet loss rate.

Preferably, the first processor 610 may be specifically configured to: when the packet loss information is bandwidth-limited, combine the data packets of consecutive non-lost data packets and consecutive packet loss data packets in the receiving status sequence of the data packets The total sending time is used as the limit cycle; the total number of bytes of the continuous non-lost data packets in the serial number related information is used as the maximum flow; when the packet loss information is random packet loss, the data packet The total number of lost data packets in the receiving state sequence of the data packet is divided by the total number of data packets in the receiving state sequence of the data packet to obtain the packet loss rate.

Preferably, the first processor 610 may be specifically configured to determine the network constraint parameter according to the following formula:

maxf(x,y)=g(x)+h(y);

s.t.a(x,y)≤P

Wherein, x represents a media coding parameter, y represents a transmission parameter; g(x) represents the media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the influence based on the transmission parameter on the media quality score Proofreading; f(x, y) represents the media quality score obtained by the media encoding parameters and transmission parameters under the actual network; a(x, y) represents the network constraint parameters corresponding to the media coding parameters and transmission parameters, and P represents the Network constraint parameters corresponding to packet loss information.

In this embodiment, the sending device determines packet loss information of the first RTP media stream; determines media encoding parameters and transmission parameters according to the packet loss information; and sends the second RTP media stream according to the media encoding parameters and transmission parameters. Therefore, the embodiment of the present invention can determine different media encoding parameters and transmission parameters for different packet loss information, thereby effectively alleviating the packet loss problem of the RTP media stream between the sending device and the receiving device, and improving the transmission of the RTP media stream efficiency.

Referring to FIG. 7 , it is a schematic structural diagram of a receiving device for an RTP media stream according to the present invention. The receiving device 700 may include: a second processor 710, a second memory 720, a second transceiver 730 and a second bus 740;

The second processor 710, the second memory 720, and the second transceiver 730 are connected to each other through a second bus 740; the second bus 740 may be an ISA bus, a PCI bus, or an EISA bus. The second bus 740 can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 7 , but it does not mean that there is only one bus or one type of bus.

The second memory 720 is used to store a program, and the program is used to realize the RTP media stream transmission method performed by the receiving device in the embodiment shown in FIG. 2 and FIG. 3 . Specifically, the program may include program code, and the program code includes computer operation instructions. The second memory 720 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

The second transceiver 730 is used to connect with other devices, such as a sending device, a server, and a remote host, and communicate with other devices. Specifically, the second transceiver 730 is used to receive the first RTP media stream sent by the sending device; and send sequence number related information to the sending device, so that the sending device can actually perform The sequence number information of the data packet in the first RTP media stream sent determines the packet loss information of the first RTP media stream, and determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information; receiving the The second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters;

The second processor 710 executes the program code stored in the second memory 720, configured to: determine the first RTP media stream according to the first RTP media stream received by the second transceiver 730 within one feedback cycle The sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the second transceiver 730 within one feedback period.

Preferably, the sequence number-related information is implemented through a packet configuration bitmap, and the second processor 710 can be specifically configured to: determine the sequence number information of the data packet in the first RTP media stream received within one feedback cycle; The packet arrangement bitmap is generated according to the sequence number information.

In this embodiment, the receiving device generates sequence number related information according to the sequence number information of the data packets in the first RTP media stream received within one feedback cycle, and sends the sequence number related information to the sending device, so that the sending device Determine the packet loss information of the RTP media stream according to the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent in the feedback period, and then determine the media encoding parameters and transmission parameters, and then the sending device can determine according to the determined The media encoding parameters and transmission parameters are used to send the second RTP media stream, so the embodiment of the present invention can effectively alleviate the packet loss problem of the media stream between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

The embodiment of the present invention also provides a real-time transport protocol RTP media stream transmission system, as shown in FIG. 8, the system 800 includes a sending device 810 and a receiving device 820, wherein,

The sending device 810 is configured to send the first RTP media stream to the receiving device 820, and receive the sequence number related information sent by the receiving device 820, the sequence number related information is received by the receiving device 820 within a feedback cycle The sequence number information of the data packets in the first RTP media stream is determined according to the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent in the feedback cycle. Packet loss information, determining media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and sending the second RTP media stream to the receiving device;

The receiving device 820 is configured to receive the first RTP media stream sent by the sending device 810, and determine sequence number related information of the first RTP media stream, where the sequence number related information is the first RTP media stream received by the receiving device within a feedback cycle. The sequence number information of the data packet in an RTP media stream, and send the sequence number related information to the sending device 810, so that the sending device can send the first RTP media stream according to the sequence number related information and the first RTP media stream actually sent in the feedback period The sequence number information of the data packet in the data packet determines the packet loss information of the first RTP media stream, determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device 810 according to the packet loss information, and receives the sending device 810 810 Send a second RTP media stream according to the media encoding parameters and transmission parameters.

Preferably, the sending device 810 can be specifically configured to determine the first according to the sequence number information of the data packet in the first RTP media stream actually sent in the feedback period according to the sequence number related information in the following manner: Packet loss information of RTP media stream:

Determine the receiving state sequence of the data packet according to the sequence number related information and the sequence number information of the data packet actually sent in the feedback cycle, the receiving state sequence of the data packet is whether each data packet recorded according to the sending order of the data packet is The sequence of packet loss;

The sending device determines whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the packet loss packet in the receiving state sequence;

If it matches the random packet loss feature, determine that the packet loss information of the RTP media stream is random packet loss;

If it does not match the random packet loss feature, determine that the packet loss information of the RTP media stream is bandwidth limited.

Preferably, the sending device 810 can be specifically configured to determine the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information in the following manner:

determining a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet;

Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters;

When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information;

When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence.

In this embodiment, the receiving device generates sequence number related information according to the sequence number information of the data packets in the first RTP media stream received within one feedback cycle, and sends the sequence number related information to the sending device, so that the sending device Determine the packet loss information of the RTP media stream according to the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent in the feedback period, and then determine the media encoding parameters and transmission parameters, and then the sending device can determine according to the determined The media encoding parameters and transmission parameters are used to send the second RTP media stream, so the embodiment of the present invention can effectively alleviate the packet loss problem of the media stream between the sending device and the receiving device, and improve the transmission efficiency of the RTP media stream.

Those skilled in the art can clearly understand that the technologies in the embodiments of the present invention can be implemented by means of software plus a necessary general-purpose hardware platform. Based on this understanding, the essence of the technical solutions in the embodiments of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in storage media, such as ROM/RAM , magnetic disk, optical disk, etc., including several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present invention.

Each embodiment in this specification is described in a progressive manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant parts, refer to part of the description of the method embodiment.

The embodiments of the present invention described above are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (12)

1. A transmission method of a real-time transport protocol RTP media stream, characterized in that, comprising: The sending device sends the first RTP media stream to the receiving device; receiving sequence number related information sent by the receiving device, where the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within one feedback cycle; Determine the packet loss information of the first RTP media stream according to the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent in the feedback period, including: Determine the receiving state sequence of the data packet according to the sequence number related information and the sequence number information of the data packet actually sent in the feedback cycle, the receiving state sequence of the data packet is whether each data packet recorded according to the sending order of the data packet is The sequence of packet loss; The sending device determines whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the packet loss packet in the receiving state sequence; If it matches the random packet loss feature, determine that the packet loss information of the RTP media stream is random packet loss; If it does not match the random packet loss feature, determine that the packet loss information of the RTP media stream is bandwidth limited; Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and send the second RTP media stream to the receiving device. 2. The method according to claim 1, wherein said determining the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information comprises: determining a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet; Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters; When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information; When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence. 3. The method according to claim 2, wherein said determining media encoding parameters and transmission parameters of the second RTP media stream to be sent according to said packet loss information and said network constraint parameters comprises: Determine the media encoding parameters and transmission parameters according to the following formula: maxf(x,y)=g(x)+h(y); s.t.a(x,y)≤P Wherein, x represents a media coding parameter, y represents a transmission parameter; g(x) represents the media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the influence based on the transmission parameter on the media quality score Proofreading; f (x, y) represents the media quality score obtained under the actual network of the media encoding parameters and transmission parameters; a (x, y) represents the network constraint parameters corresponding to the media encoding parameters and transmission parameters, and P represents the Network constraint parameters corresponding to packet loss information. 4. A transmission method of a real-time transport protocol RTP media stream, characterized in that, comprising: The receiving device receives the first RTP media stream sent by the sending device; Determine the serial number related information of the first RTP media stream, the serial number related information is the serial number information of the data packet in the first RTP media stream received by the receiving device within a feedback cycle; Sending the sequence number related information to the sending device, so that the sending device determines the first RTP media stream according to the sequence number related information and the sequence number information of the data packets in the first RTP media stream actually sent in the feedback period The packet loss information, according to the sequence number related information and the sequence number information of the data packets actually sent in the feedback cycle to determine whether each data packet is lost according to the sequence of data packets sent sequence sequence, according to the data packet loss Determine whether the randomness of packet loss in the receiving state sequence matches the random packet loss characteristic, determine that the packet loss information of the RTP media stream is random packet loss according to matching with the random packet loss characteristic, and determine whether the packet loss information of the RTP media stream is random packet loss according to the random packet loss characteristic. The characteristic mismatch determines that the packet loss information of the RTP media stream is bandwidth limited, and determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device according to the packet loss information; Receive the second RTP media stream sent by the sending device according to the media encoding parameter and the transmission parameter. 5. method according to claim 4, it is characterized in that, described sequence number related information realizes by packet arrangement bitmap, described determining the sequence number related information of the first RTP media stream comprises: Determine the sequence number information of the data packet in the first RTP media stream received in a feedback cycle; The packet arrangement bitmap is generated according to the sequence number information. 6. A transmission device for a real-time transport protocol RTP media stream, characterized in that it comprises: a first sending unit, configured to send a first RTP media stream to a receiving device; A first receiving unit, configured to receive sequence number related information sent by the receiving device, where the sequence number related information is the sequence number information of the data packet in the first RTP media stream received by the receiving device within one feedback cycle; A packet loss information determining unit, configured to, according to the sequence number related information received by the first receiving unit, the sequence number information of the data packet in the first RTP media stream actually sent by the first sending unit within the feedback period Determine the packet loss information of the first RTP media stream; The packet loss information determination unit includes: A sequence determining subunit, configured to determine the receiving state sequence of data packets according to the sequence number related information and the sequence number information of the data packets actually sent in the feedback period, and the receiving state sequence of the data packets is according to the sending state of the data packets Sequence of whether each data packet recorded in sequence is lost or not; The cause determination subunit is used to determine whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the lost packet in the receiving state sequence of the packet determined by the sequence determination subunit, if If it matches the random packet loss feature, it is determined that the packet loss information of the media stream is random packet loss; otherwise, the packet loss information of the media stream is determined to be bandwidth limited; A parameter determination unit, configured to determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information; The first sending unit is further configured to: send the second RTP media stream. 7. The device according to claim 6, wherein the parameter determining unit comprises: The first parameter determination subunit is configured to determine a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet; A second parameter determination subunit, configured to determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters determined by the first parameter determination subunit; When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information; When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence. 8. The device according to claim 7, wherein the second parameter determining subunit is specifically used for: Determine the media encoding parameters and transmission parameters according to the following formula: maxf(x,y)=g(x)+h(y); s.t.a(x,y)≤P Wherein, x represents a media coding parameter, y represents a transmission parameter; g(x) represents the media quality score that the media coding parameter can obtain under a lossless network; h(y) represents the influence based on the transmission parameter on the media quality score Proofreading; f (x, y) represents the media quality score obtained under the actual network of the media encoding parameters and transmission parameters; a (x, y) represents the network constraint parameters corresponding to the media encoding parameters and transmission parameters, and P represents the Network constraint parameters corresponding to packet loss information. 9. A transmission device for a real-time transport protocol RTP media stream, characterized in that, comprising: The second receiving unit is configured to receive the first RTP media stream sent by the sending device; An information determination unit, configured to determine sequence number related information of the first RTP media stream received by the second receiving unit, where the sequence number related information is the first RTP media stream received by the second receiving unit within a feedback cycle The serial number information of the data packet; A second sending unit, configured to send the sequence number related information determined by the information determining unit to the sending device, so that the sending device can use the sequence number related information and the first RTP actually sent in the feedback period The sequence number information of the data packets in the media stream determines the packet loss information of the first RTP media stream, and according to the sequence number related information and the sequence number information of the data packets actually sent in the feedback period, determines the data packets recorded according to the order in which the data packets are sent. Whether the data packet is a packet loss sequence, judge whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the packet loss data packet in the receiving state sequence, and determine the RTP media flow according to the match with the random packet loss characteristic The packet loss information is random packet loss, the packet loss information of the RTP media stream is determined to be bandwidth limited according to the mismatch with the random packet loss characteristic, and the second RTP media stream to be sent by the sending device is determined according to the packet loss information Media encoding parameters and transmission parameters; The second receiving unit is further configured to: receive a second RTP media stream sent by the sending device according to the media encoding parameters and transmission parameters. 10. The device according to claim 9, wherein the serial number-related information is implemented through a packet arrangement bitmap, and the information determination unit is specifically used for: Determine the sequence number information of the data packet in the first RTP media stream received in a feedback cycle; The packet arrangement bitmap is generated according to the sequence number information. 11. A transmission system of a real-time transport protocol RTP media stream, characterized in that it comprises a sending device and a receiving device, wherein, The sending device is configured to send a first RTP media stream to a receiving device, and receive sequence number related information sent by the receiving device, where the sequence number related information is the first RTP media stream received by the receiving device within a feedback cycle. The sequence number information of the data packet in the RTP media stream, according to the sequence number related information and the sequence number information of the data packet in the first RTP media stream actually sent in the feedback cycle, determine the packet loss information of the first RTP media stream, determining media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information, and sending the second RTP media stream to the receiving device; The sending device is specifically configured to determine the loss of the first RTP media stream according to the sequence number related information and the sequence number information of the data packets actually sent in the first RTP media stream in the feedback period in the following manner: Package information: Determine the receiving state sequence of the data packet according to the sequence number related information and the sequence number information of the data packet actually sent in the feedback cycle, the receiving state sequence of the data packet is whether each data packet recorded according to the sending order of the data packet is The sequence of packet loss; The sending device judges whether the randomness of the packet loss matches the random packet loss characteristic according to the position of the lost packet in the receiving state sequence; If it matches the random packet loss feature, determine that the packet loss information of the RTP media stream is random packet loss; If it does not match the random packet loss feature, determine that the packet loss information of the RTP media stream is bandwidth limited; The receiving device is configured to receive the first RTP media stream sent by the sending device, and determine the sequence number related information of the first RTP media stream, where the sequence number related information is the first RTP received by the receiving device within a feedback cycle The sequence number information of the data packet in the media stream, and send the sequence number related information to the sending device, so that the sending device can use the sequence number related information and the data packet in the first RTP media stream actually sent in the feedback period The sequence number information of the first RTP media stream determines the packet loss information of the first RTP media stream, determines the media encoding parameters and transmission parameters of the second RTP media stream to be sent by the sending device according to the packet loss information, and receives the sending device according to the media The encoding parameters and the second RTP media stream sent by the transmission parameters. 12. The system according to claim 11, wherein the sending device is specifically configured to determine the media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information in the following manner : determining a network constraint parameter corresponding to the packet loss information according to the determined packet loss information and the receiving state sequence of the data packet; Determine media encoding parameters and transmission parameters of the second RTP media stream to be sent according to the packet loss information and the network constraint parameters; When the packet loss information is that the bandwidth is limited, the network constraint parameters include: a limit cycle, the limit cycle is the total number of consecutive non-lost data packets and continuous packet loss data packets in the receiving state sequence of the data packets The length of sending; the maximum flow, the maximum flow is the total number of bytes of the continuous unlost data packets in the serial number related information; When the packet loss information is random packet loss, the network constraint parameters include: packet loss rate, the packet loss rate is divided by the total number of data packets lost in the receiving state sequence of the data packets divided by the reception of the data packets The total number of packets in the state sequence.