CN1482779A - Forward error correction in internet multimedia realtime communication - Google Patents

Abstract

The invention relates to a method for controlling the errors in the internet multimedia real-time communication aiming to solve the problem of package loss in the multimedia internet communication, wherein a plurality of data packs are built-up to form a data pack set on the data sending end, creating a forward error correction redundant data package, on the receiving end, when package loss is detected, the lost packages are recovered through the data packs in the same group and the relevant redundant data packs. The invention substantially reduces the package loss ration of the system on the basis of guaranteeing the system real time performance.

Description

Forward error correction in the internet multimedia realtime communication

The present invention relates to the error control method in a kind of internet multimedia realtime communication.

In the network multimedia real time communication, because the requirement of real-time, multi-medium data generally transmits by unreliable host-host protocol UDP.And when network bandwidth deficiency or network environment instability,, or claim packet loss because the phenomenon of data-bag lost will appear in the unreliability of udp protocol.This can reduce communication quality greatly.

For the communication quality that suppresses to cause because of Network Packet Loss descends, the present invention proposes a kind of forward error correction algorithm.Promptly, add different redundant informations to packet, when receiving terminal is found data-bag lost is arranged, can obliterated data be recovered out according to redundant information at data sending terminal according to the difference of network environment.

When the Internet transmitting data, because basic communication protocol has been done verification to the error code that produces in the transmission, so can guarantee the accuracy of the packet received.But for the so unreliable host-host protocol of UDP, packet loss still can take place.The method of traditional solution packet loss is automatic repetitive requests (ARQ), and the maximum cost of this method is exactly to have introduced a large amount of time-delays, and the time-delay that increases can directly cause the availability of real-time communication system to reduce greatly.

For solving problems of the prior art, the present invention proposes a kind of algorithm little and that can recover packet loss preferably of delaying time.

Below method of the present invention is made an explanation:

(1) at the transmitting terminal of system, regards continuous several real time data bags as a data package;

(2) according to the packet loss size of network, be that the data packet group generation is superfluous by forward error correction (FEC) algorithm

Surplus verification bag sends with packet;

(3) after the recipient received packet, if find that the packet loss phenomenon is arranged, then the packet by on the same group

Through corresponding redundancy check bag packet loss is recovered.

In accompanying drawing 1, the packet of transmitting terminal is D1, D2, D3, and these three packets have formed a data package.Generate two redundant data packets F1, F2 by forward error correction (FEC) encoder.In Network Transmission, suppose that D3, F1 packet are lost, then at receiving terminal, can pass through the fec decoder device, utilize the information among D1, D2, the F2 that original D3 data packet recovery is come out, thereby guarantee the quality of communication.The selection and the restoration methods of just wrong (FEC) algorithm of forward direction

In the communications field, FEC has many implementation methods, at paroxysmal mistake, generally adopts methods such as interlaced code, BCH code, Reed-Solomon sign indicating number.

The data-bag lost of UDP has some characteristics so as can be seen in our problem that will solve:

1. the data of receiving all are correct

2. the data of losing are all known its corresponding position

In addition, consider the control of time-delay, the block length of forward error correction also should guarantee in 2 or 3.According to above these characteristics, we can adopt the error correction algorithm simpler, that specific aim is stronger to realize FEC.What in the present invention, we used is the XOR method.

In order to represent conveniently, (m n) represents the FEC that realizes by XOR with XOR for we.Wherein, m be through or after, whole group packet number; N is an original multi-medium data bag number in the group; M-n is exactly process or the redundant data packets number that generates.XOR(4，3)

Suppose that forward error correction is 3 packet (D ₁, D ₂, D ₃) one group, generate a redundant data packets (F ₁), by XOR, its generation method is:

D ₁D ₂D ₃＝F ₁

Like this, lose a bag arbitrarily in these four bags, can be errorless recover three original VoPs.Method is as follows:

D ₂＝D ₁D ₃F ₁XOR(5，3)

If will generate a plurality of redundant data packets, also can realize by the method for XOR at one group of packet.Its implementation is diversified, such as generating 2 redundant data packets from 3 packets, just can realize like this:

D ₁D ₂＝F ₁

D ₁D ₃＝F ₂

By such FEC mechanism, when 5 packets are lost one arbitrarily, can recover out fully; And if lost two arbitrarily in 5 packets, just have only 80% probability packet loss can be recovered out fully.

Form 1

The packet of receiving	Restoration methods	Recover number
			?D 1、D 2、F 2	?D 3＝D 1F 2	?3
?D 1、D 3、F 1	?D 2＝D 1F 1	?3
			?D 1、D 2、D 3		?3
?D 1、F 1、F 2	?D 2＝D 1F 1?D 3＝D 1F 2	?3
			?D 1、D 2、F 1		?2
?D 1、D 3、F 2		?2
			?D 2、D 3、F 1	?D 1＝D 2F 1	?3
?D 2、D 3、F 2	?D 1＝D 3F 2	?3
			?D 2、F 1、F 2	?D 1＝D 2F 1；D 3＝D 1F 2	?3
?D 3、F 1、F 2	?D 1＝D 3F 2；D 2＝D 1F 1	?3

If lost 3 in 5 packets, recovery situation is as follows so:

Form 2

The packet of receiving	Restoration methods	Recover number
			?D 1、F 1	?D 2＝D 1F 1	?2
?D 1、F 2	?D 3＝D 1F 2	?2
			?D 2、F 1	?D 1＝D 2F 1	?2
?D 3、F 2	?D 1＝D 3F 2	?2
			?D 1、D 2		?2
?D 1、D 3		?2
			?D 2、D 3		?2
?D 2、F 2		?1
			?D 3、F 1		?1
?F 1、F 2		?0

XOR(6，3)

Generate 3 redundant data packets by 3 packets, can realize with the following method:

D ₁D ₂＝F ₁

D ₁D ₃＝F ₂

D ₂D ₃＝F ₃

Like this, in 6 packets as long as can guarantee that any 4 are received by the other side, just can be errorless fully recover all raw data packets.

If only receive 3 packets, have following 4 kinds of situations can only recover partial data:

Form 3

The packet of receiving	Restoration methods	Recover number
			?D 1、D 2、F 1		?2
?D 1、D 3、F 2		?2
			?D 2、D 3、F 3		?2
?F 1、F 2、F 3		?0
			Other (16 kinds of distributions)	?D 1＝D 2F 1?D 2＝D 1F 1?D 3＝D 2F 3	?3

If only receive 2 packets, data recovery situations is as follows:

Form 4

The packet of receiving	Restoration methods	Recover number
			?D 1、F 1	?D 2＝D 1F 1	?2
?D 1、F 2	?D 3＝D 1F 2	?2
			?D 2、F 1	?D 1＝D 2F 1	?2
?D 3、F 2	?D 1＝D 3F 2	?2
			?D 2、F 3	?D 1＝D 2F 3	?2
?D 3、F 3	?D 2＝D 3F 3	?2
			?D 1、D 2		?2
?D 1、D 3		?2
			?D 2、D 3		?2
?D 1、F 3		?1
			?D 2、F 2		?1

?D 3、F 1		?1
			?F 1、F 2		?0
?F 1、F 3		?0
			?F 2、F 3		?0

The theory analysis of the loss recovery effect of several FEC mechanism

Several FEC mechanism that draw by the XOR algorithm have been introduced in the front, and different FEC mechanism can produce different loss recovery rates and also introduce different costs simultaneously.Below we analyze each parameter of three kinds of FEC mechanism at first theoretically.

The packet loss phenomenon of network can be regarded as the Gilbert model of second order.Transition probability from state 0 (not packet loss) to state 1 (packet loss) is p, and 0 transition probability is q from state 1 to state.Under the situation of not doing any error control, the packet loss of network should for:

loss?rate＝p/(p+q)

For the purpose of following discussion was clear, we supposed p+q=1.Gilbert model like this, is originally just simplified and is become a Bemoulli model.And network packet loss rate has also just become p.Obviously, this simplification can not exert an influence to the character and the conclusion of our problem.XOR(4，3)

Per 3 packets are one group, generate 1 redundancy packet, and the efficiency of transmission of valid data is 3/4=75% so

Below we are one group with these 4 bags, its loss recovery effect specifically is discussed:

Receive the packet situation	The raw data packets number that recovers	Probability
			All 4 packets	3	?C 4 4*(1-p) 4
Any 3 packets	3	?C 4 3*p(1-p) 3
			Have only 2 raw data packets	2	?C 3 2*p 2(1-p) 2
Have only 1 raw data packets and 1 FEC bag	1	?C 3 1*p 2(1-p) 2
			Has only 1 raw data packets	1	?C 3 1*p 3(1-p)

Restrain by top derivation, carry out error control through XOR (4,3) after, the averaging network packet loss that obtains should for:

$1-1/3*[C_4^4*{(1-p)}^4*3+C_4^3*p{(1-p)}^3*3+C_3^2*p^2{(1-p)}^2*2$

${+C}_3^1*p^2{(1-p)}^2*1+C_3^1*p^3(1-p)*1]$

$=3p^2-3p^3+p^4$

For instance, if original network packet loss rate p=20%, after XOR (4,3) error control, packet loss should be p ' ≈ 9.8%XOR (5,3)

Per 3 packets are one group, generate 2 redundancy packet, and the efficiency of transmission of valid data is 3/5=60% so

Below we are one group with these 5 bags, its loss recovery effect specifically is discussed:

Receive the packet situation	The raw data packets number that recovers	Probability
			All 5 packets	3	?C 5 5*(1-p) 5
Any 4 packets	3	?C 5 4*p(1-p) 4
			Any 3 packets	3	?8*p 2(1-p) 3
2	?2*p 2(1-p) 3
		Any 2 packets		2	?7*p 3(1-p) 2
1	?2*p 3(1-p) 2
			1 raw data packets	1	?3*p 4(1-p)

Restrain by top derivation, carry out error control through XOR (5,3) after, the averaging network packet loss that obtains should for:

$1-1/3*[C_5^5*{(1-p)}^5*3+C_5^4*p{(1-p)}^4*3+8{*p}^2{(1-p)}^3*3$

$+2*p^2{(1-p)}^3*2+7*p^3{(1-p)}^2*2+2*p^3{(1-p)}^2*1+3*p^4(1-p)*1]$

$=(2{\mathrm{<figure-callout\; id="2"\; label="p"\; filenames="A0213120800111.png"\; state="\{\{state\}\}">p</figure-callout>}}^2+8p^3-10p^4+3p^5)/3$

For instance, if original network packet loss rate p=20%, after XOR (5,3) error control, packet loss should be p ' ≈ 4.3%XOR (6,3)

Per 3 packets are one group, generate 3 redundancy packet, and the efficiency of transmission of valid data is 3/6=50% so

Below we are one group with these 6 bags, its loss recovery effect specifically is discussed:

Receive the packet situation	The raw data packets number that recovers	Probability
			All 6 packets	3	?C 6 6*(1-p) 6
Any 5 packets	3	?C 6 5*p(1-p) 5
			Any 4 packets	3	?C 6 4*p 2(1-p) 4

Any 3 packets	3	?16*p 3(1-p) 3
			2	?3*p 3(1-p) 3
	Any 2 packets	2			?9*p 4(1-p) 2
1			?3*p 4(1-p) 2
		1 raw data packets		1	?3*p 5(1-p)

Restrain by top derivation, carry out error control through XOR (6,3) after, the averaging network packet loss that obtains should for:

$1-1/3*[C_6^6*{(1-p)}^6*3+C_6^5*p{(1-p)}^5*3+C_6^4*p^2{(1-p)}^4*3$

$+16*p^3{(1-p)}^3*3+9*p^3(1-p{)}^3*2+9*p^4{(1-p)}^2*2$

$+3*p^4{(1-p)}^2*1+3*p^5(1-p)*1]$

$=2p^3+2p^4-5p^5+2p^6$

For instance, if original network packet loss rate p=20%, after XOR (6,3) error control, packet loss should be p ' ≈ 1.8%

The front has been introduced three kinds and has been realized the scheme of FEC, XOR (4,3), XOR (5,3) and XOR (6,3) by XOR.In the realization of reality, consider that the send mode of error correction information also has very big influence to loss recovery rate, time-delay and efficiency of transmission.We will carry out finer division to these three kinds of error correcting systems, be respectively:

Scheme 1:FEC (4,3), error correction packets F sends separately, is designated as FEC (4,3)-3.3 last expression decoding delay (is unit with the packet).See accompanying drawing 2.

Scheme 2:FEC (5,3), error correction packets F ₁, F ₂Follow at D respectively ₄, D ₅The back sends, and is designated as FEC (5,3)-5.See accompanying drawing 3.

Scheme 3:FEC (6,3), error correction packets F ₁, F ₂, F ₃Follow at D respectively ₄, D ₅, D ₆The back sends, and is designated as FEC (6,3)-6.See accompanying drawing 4.The adaptive error controlling schemes

By theory analysis and the lot of experiment results analysis to FEC mechanism, we have proposed a cover adaptive error controlling schemes at last.

Yuan Shi Lost bag rate	Error-control schemes	Decoding delay
			＜3％	Do not do error control	?60ms
3％～10％	FEC(4，3)-3	?180ms

10％～25％	FEC(5，3)-5	?300ms
			＞25％	FEC(6，3)-6	?360ms

Claims (4)

1. error control method of in the internet multimedia realtime communication system, using, its feature comprises:

(a) use udp protocol as the bottom multimedia communication protocol, multi-medium data transmits in network with the form of UDP message bag.

(b) system to the requirement of multimedia communication in real time or quasi real time.

(c) recover by the packet loss of forward error correction multi-medium data in the network service.

2. in claim 1, multimedia can be audio frequency, video or the combination of the two.

3. in claim 1 (b), the end-to-end delay of multimedia realtime communication is generally in 1 second.And multimedia communications system end-to-end delay quasi real time is generally in 30 seconds.Have such feature communication system we be referred to as real-time communication system or communication system quasi real time.

4. according to the method described in the claim 1 (c), it is characterized in that utilizing forward error correction that UDP message is wrapped in the packet loss that takes place in the Internet transmission and recover.

Images