WO2013029468A1

WO2013029468A1 - Method for dynamic packet loss compensation of conference television terminal, and conference television terminal

Info

Publication number: WO2013029468A1
Application number: PCT/CN2012/080176
Authority: WO
Inventors: 王德壮
Original assignee: 中兴通讯股份有限公司
Priority date: 2011-08-26
Filing date: 2012-08-15
Publication date: 2013-03-07
Also published as: CN102300076A; CN102300076B

Abstract

The present invention discloses a method for dynamic packet loss compensation of a conference television terminal and the conference television terminal. The method includes: detecting packet loss times of a code stream; when the packet loss times exceed preset times, starting and performing a packet loss compensation process. The method and terminal provided by the present invention can avoid the waste of system resources caused by still coding and decoding redundancy packets in the case of no packet loss.

Description

Method for dynamic packet loss compensation of conference television terminal and conference television terminal

The present invention relates to the field of multimedia processing technologies, and in particular, to a method for dynamic packet loss compensation of a conference television terminal and a conference television terminal. Background technique

Currently, the transmission protocol used in the video conferencing system is Real Time Transport Protocol (RTP), which has high real-time requirements. That is to say, if a packet loss occurs in the video conference system, the pair will not be required. The end resends the lost packet, and the sender does not know that the code stream sent by itself has dropped packets. If this happens, the screen will appear when the receiver decodes, which seriously affects the user's visual experience.

In response to this situation, various packet loss compensation techniques have emerged, the most commonly used of which is a forward error correction technique, which groups normal audio/video packets, and adds an appropriate amount of redundancy packets after each packet. The number of redundant packets is determined according to the packet size; the redundant packet coding module first records the packet information of the previous complete packet, and then constructs a redundant packet through a specific algorithm, and finally sends the normal packet and the redundant packet together. The receiving end parses the redundant packet according to the negotiated algorithm. If the normal packet in the packet is lost, the lost packet is constructed according to the redundant packet, so that the effect of packet loss compensation can be achieved, and the image clarity is ensured to the utmost extent. And smooth.

The packet loss compensation application provided in the related art is always enabled, but the coding redundancy of the redundant packet can be dynamically adjusted. No matter how small the coding redundancy is, the coding and decoding of the redundant packet consume system resources. It is still a waste of system resources to decode redundant packets without packet loss. Summary of the invention

The main purpose of the embodiments of the present invention is to provide a method for dynamic packet loss compensation of a conference television terminal and a conference television terminal, so as to avoid the waste of system resources caused by redundant packets without packet loss.

The technical solution adopted by the embodiment of the present invention to solve the technical problem is:

A method for dynamic packet loss compensation of a conference television terminal, comprising:

Detecting the number of packet loss of the code stream;

When the number of lost packets in the code stream exceeds a preset number of times, a packet loss compensation process is initiated and performed. Preferably, the starting and performing a packet loss compensation process includes:

Calculating a packet loss rate of the code stream;

Calculating a coding redundancy of the redundancy packet according to the conference bandwidth and the packet loss rate;

Sending parameters of the redundant packet to the peer device;

Receiving and parsing the redundant packet sent by the peer device according to the parameter. Preferably, after the packet loss compensation process is started and performed, the method further includes: turning off the packet loss compensation process when the number of normal packets of the code stream does not exceed the preset number of times.

Preferably, the closing packet loss compensation process includes:

When the number of times the normal packet of the code stream does not drop exceeds the preset number of times, the redundant packet is stopped from being decoded and the peer device is notified to close the encoding of the redundant packet.

Preferably, the parameters of the redundant packet include: a command to start encoding, a redundant algorithm for encoding, and coding redundancy.

The invention also provides a conference television terminal, comprising:

a packet loss detecting unit, configured to detect a packet loss time of the code stream;

The packet loss compensation unit is configured to start and perform a packet loss compensation process when the number of packet loss times exceeds a preset number of times.

Preferably, the packet loss compensation unit includes: a packet loss rate obtaining subunit, configured to calculate a packet loss rate of the code stream;

a redundancy obtaining subunit, configured to calculate a coding redundancy of the redundancy packet according to the conference bandwidth and the packet loss rate;

The parameter sending subunit is configured to send the parameter of the redundant packet to the peer device, and the redundant packet parsing subunit is configured to receive and parse the redundant packet sent by the peer device according to the parameter.

Preferably, the conference television terminal further includes a compensation closing unit, configured to close the packet loss compensation process when the number of times the normal packet of the code stream does not drop exceeds a preset number of times.

Preferably, the compensation closing unit is configured to stop decoding the redundant packet and notify the peer device to close the redundant packet when the number of times the normal packet of the code stream does not drop exceeds a preset number of times The coding performed.

The technical solution of the present invention has the following beneficial effects:

The method and the terminal provided by the embodiment of the present invention can avoid the waste caused by the redundant packet to the system resource without the packet loss, according to the detected packet loss situation and the dynamic startup and shutdown packet loss compensation process. At the same time, each time it starts, it can set the appropriate coding redundancy according to the current packet loss rate, which improves the adaptability of the system. DRAWINGS

1 is a schematic structural diagram of a conference television terminal according to an embodiment of the present invention;

FIG. 2 is a flowchart of a method for compensating for dynamic packet loss of a conference television terminal according to an embodiment of the present invention; FIG. 3 is a specific flowchart of a process for starting and performing packet loss compensation in FIG. 2;

4 is another flow chart of a method for dynamically reducing packet loss of a conference television terminal according to an embodiment of the present invention;

FIG. 5 is another schematic structural diagram of a conference television terminal according to an embodiment of the present disclosure; 6 is a schematic structural diagram of a packet loss compensation unit in FIG. 5;

FIG. 7 is still another schematic structural diagram of a conference television terminal according to an embodiment of the present invention. detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The embodiment of the invention provides a method for dynamic packet loss compensation of a conference television terminal. The method is applied to a conference television terminal. As shown in FIG. 1 , the conference television terminal includes three parts:

Upper application module: mainly responsible for logic control, determining whether to start or stop packet loss compensation according to the packet loss rate reported by the media protocol subsystem, and determining appropriate coding parameters;

The protocol stack subsystem is mainly responsible for signaling interaction with the peer device, and transmitting the signaling sent by the upper application module to the other party, and reporting the signaling of the received peer device to the upper application module;

The media protocol subsystem: the packet loss detection module of the media protocol subsystem is responsible for detecting the received code stream, and reporting the packet loss rate to the upper application module, where the redundant coding module of the media protocol subsystem is responsible for coding redundancy. Packet, the redundant decoding module of the media protocol subsystem is responsible for decoding the redundancy packet.

The method for dynamically losing packet loss of the conference television terminal is as shown in FIG. 2, including the steps:

S110. Detecting a number of packet loss times of the code stream.

In the step S110, the packet loss detection module of the media protocol subsystem periodically reports the result of the detection to the upper layer application module, such as: a packet loss rate of one cycle, the number of consecutive packet loss, and the like;

S120. Start and perform a packet loss compensation process when the number of lost packets in the code stream exceeds a preset number of times.

As shown in FIG. 3, in the step S120, the starting and performing a packet loss compensation process specifically includes: 5121. Calculate a packet loss rate of the code stream.

The upper application module judges that there are 5 consecutive cycles (may also be judged for more or fewer cycles, such as 4, 6, etc.), and the packet loss compensation process is enabled, and the average loss is 5 times. The packet rate is used as the packet loss rate.

5122. Calculate a coding redundancy of the redundancy packet according to the conference bandwidth and the packet loss rate.

In step S122, the upper application module of the conference television terminal determines the coding redundancy according to the conference bandwidth (the bandwidth of the conference system, such as 2M, 4M, 6M, etc.) and the packet loss rate, and then the redundancy package. The parameters are sent to the media protocol subsystem and the protocol stack subsystem, and the redundant decoding module of the media protocol subsystem receives the parameter and decodes the parameter. Since the appropriate coding redundancy is set according to the current packet loss rate at each startup, the adaptability of the system is improved.

5123. Send the parameter to the peer device. The parameters include: a command to start encoding, a redundant algorithm for encoding, and coding redundancy.

For example, the conference television terminal sends the parameter to the peer device through the protocol interaction module of the protocol stack subsystem, and the protocol stack subsystem of the peer device reports the parameter to the peer device after receiving the signaling. In the upper application module, the upper application module of the peer device sends the parameter to the media protocol subsystem of the peer device, and the redundancy coding module of the media protocol subsystem performs the coding of the redundancy packet according to the parameter.

5124. Receive and parse a redundant packet sent by the peer device according to the parameter. The local device receives the encoded redundant packet sent by the peer device, and performs decoding of the redundant packet according to the foregoing parameter by using the redundancy decoding module.

As shown in FIG. 4, in an embodiment, after performing the startup in step S120 and performing the packet loss compensation process, the method further includes the step S130: when the normal packet of the code stream does not lose more than the preset number of times When the packet loss compensation process is turned off. In a more specific embodiment, the packet loss compensation process is closed in the step S130, which specifically includes:

Stopping the redundancy when the number of normal packets of the code stream does not exceed the preset number of times The packet is decoded and the peer device is notified to close the encoding of the redundant packet.

For example, the conference television terminal separately collects statistics on the normal packet and the redundant packet, and the upper application module determines the statistical result. If the normal packet does not continuously lose more than 10 times (may be more times or less, For example, 8 times, 12 times, etc., the packet loss compensation process is closed. The upper application module of the conference television terminal notifies the peer device to disable the encoding of the redundant packet by signaling, and the signaling is notified to the peer device by a parameter, which is a command to stop encoding. The upper application module of the peer device notifies the redundant coding module of the media protocol subsystem of the peer device to stop encoding the redundant packet. The upper application module of the conference television terminal of the present invention informs the media protocol subsystem to stop the decoding of the redundant packet by a message, and the message is notified by a parameter, the parameter is a command to stop decoding, and the media protocol subsystem receives the message. The redundant decoding module of the media protocol subsystem stops decoding of the redundant packet.

The method provided by the foregoing embodiment can dynamically start and close the packet loss compensation process according to the detected packet loss condition, and avoid the waste of system resources caused by the redundancy package without any packet loss. At the second startup, the appropriate coding redundancy can be set according to the current packet loss rate, which improves the adaptability of the system.

The embodiment of the present invention further provides a conference television terminal 200. As shown in FIG. 5, the conference television terminal 200 includes:

The packet loss detecting unit 210 is configured to detect the number of packet loss times of the code stream.

The packet loss compensation unit 220 is configured to start and perform a packet loss compensation process when the number of packet loss times exceeds a preset number of times.

In a more specific embodiment, as shown in FIG. 6, the packet loss compensation unit 220 includes: a packet loss rate acquisition subunit 221, configured to calculate a packet loss rate of the code stream;

The redundancy obtaining sub-unit 222 is configured to calculate a coding redundancy of the redundancy packet according to the conference bandwidth and the packet loss rate;

a parameter sending subunit 223, configured to send parameters of the redundant packet to a peer device, where the parameter The numbers include: a command to start encoding, a redundant algorithm for encoding, and coding redundancy;

The redundant packet parsing subunit 224 is configured to receive and parse the redundant packet sent by the peer device according to the parameter.

The working process of the conference television terminal 200 in the embodiment of the present invention is as follows:

The packet loss detecting unit 210 periodically detects the packet loss of the code stream, for example, the packet loss rate of one cycle, the number of consecutive packet loss, and the like;

The packet loss rate acquisition sub-unit 221 determines whether there are 5 consecutive cycles (may also be judged by more or fewer cycles, such as 4, 6, etc.), and if any, packet loss compensation is enabled. The process, taking the average packet loss rate of 5 times as the packet loss rate;

The redundancy acquisition sub-unit 222 determines the coding redundancy according to the conference bandwidth (such as 2M, 4M, 6M, etc.) and the packet loss rate, and then sends the parameters of the redundancy packet to the redundancy packet analysis sub-unit 224;

The redundant packet parsing subunit 224 decodes the parameter after receiving the parameter;

The parameter sending sub-unit 223 sends the parameter to the peer device by using the signaling, and the protocol stack subsystem of the peer device reports the parameter to the upper-layer application module of the peer device, and the upper-layer application of the peer device The module sends the parameter to the media protocol subsystem of the peer device, and the redundant packet parsing subunit on the media protocol subsystem performs the encoding of the redundancy packet according to the parameter.

The redundant packet parsing subunit 224 parses the redundant packet sent by the peer device and encoded according to the parameter. Since the appropriate coding redundancy is set according to the current packet loss rate at each startup, the adaptability of the system is improved.

In other embodiments, further, as shown in FIG. 7, the conference television terminal 200 further includes a compensation closing unit 230, where the number of times the normal packet is not lost in the code stream exceeds a preset number of times. When the packet loss compensation process is turned off. In a more specific embodiment, the compensation closing unit 230 is configured to stop decoding the redundant packet and notify the opposite end when the number of times that the normal packet of the code stream does not drop exceeds a preset number of times. The device turns off the encoding of the redundant packets. Above The parameters of the redundant packet include: a command to start encoding, a redundant algorithm for encoding, and coding redundancy. For example, the compensation closing unit 230 separately counts the normal packet and the redundant packet, and if the normal packet does not continuously lose more than 10 times (may be more times or less, such as 8 times, 12 times, etc.), It is necessary to close the packet loss compensation process. The upper application module of the conference television terminal notifies the peer device to close the encoding of the redundant packet by signaling, and the signaling notifies the peer device by a parameter, which is a command to stop encoding. The upper application module of the peer device notifies the redundant coding module of the media protocol subsystem of the peer device to stop encoding the redundant packet. The upper application module of the conference television terminal of the present invention informs the media protocol subsystem to stop the decoding of the redundant packet by a message, and the message is notified by a parameter, the parameter is a command to stop decoding, and the media protocol subsystem receives the message. The redundant packet parsing subunit 224 stops the decoding of the redundant packet.

The conference television terminal provided by the foregoing embodiment can process the packet loss according to the detected code stream, dynamically start and close the packet loss compensation process, and avoid the waste of the system resources caused by the redundancy package without the packet loss. At the same time, each time it starts, it can set the appropriate coding redundancy according to the current packet loss rate, which improves the adaptability of the system.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, and improvements made within the spirit and scope of the present invention should be included in the scope of the present invention. Inside.

Claims

Claim

Detecting the number of packet loss of the code stream;

When the number of lost packets in the code stream exceeds a preset number of times, a packet loss compensation process is initiated and performed.

2. The method according to claim 1, wherein the initiating and performing a packet loss compensation process comprises:

Calculating a packet loss rate of the code stream;

Sending parameters of the redundant packet to the peer device;

Receiving and parsing the redundant packet sent by the peer device according to the parameter.

The method of claim 1 or 2, wherein, after the packet loss compensation process is initiated and performed, the method further includes: when the number of times the normal packet of the code stream is not lost exceeds a preset number of times, Packet loss compensation process.

The method of claim 3, wherein the closing the packet loss compensation process comprises: stopping the redundant packet when the number of times the normal packet of the code stream does not drop exceeds a preset number of times Decode and notify the peer device to disable encoding of the redundant packet.

5. The method of claim 2, wherein the parameters of the redundant packet comprise: a command to start coding, a redundant algorithm to encode, and a coding redundancy.

6. A conference television terminal, comprising:

The conference television terminal according to claim 6, wherein the packet loss compensation unit comprises: a packet loss rate acquisition subunit, configured to calculate a packet loss rate of the code stream;

a redundancy obtaining subunit, configured to calculate a redundancy packet according to the conference bandwidth and the packet loss rate Code redundancy;

The conference television terminal according to claim 6 or 7, further comprising a compensation closing unit, configured to close the packet loss compensation when the number of times the normal packet of the code stream does not drop exceeds a preset number of times process.

The conference television terminal according to claim 8, wherein the compensation closing unit is configured to stop performing the redundant packet when the number of normal packets of the code stream does not exceed a preset number of times Decode and notify the peer device to disable encoding of the redundant packet.

10. The conference television terminal according to claim 7, wherein the parameters of the redundant packet include: a command to start encoding, a redundant algorithm for encoding, and coding redundancy.