CN101686106B - Self-adaptive forward error correction (FEC) method, device and system - Google Patents

Self-adaptive forward error correction (FEC) method, device and system Download PDF

Info

Publication number
CN101686106B
CN101686106B CN 200810223805 CN200810223805A CN101686106B CN 101686106 B CN101686106 B CN 101686106B CN 200810223805 CN200810223805 CN 200810223805 CN 200810223805 A CN200810223805 A CN 200810223805A CN 101686106 B CN101686106 B CN 101686106B
Authority
CN
China
Prior art keywords
error correction
forward error
data
transmission
quality data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 200810223805
Other languages
Chinese (zh)
Other versions
CN101686106A (en
Inventor
陈兵
张卫娥
艾常权
鲁亚东
张庚
向少华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN 200810223805 priority Critical patent/CN101686106B/en
Publication of CN101686106A publication Critical patent/CN101686106A/en
Application granted granted Critical
Publication of CN101686106B publication Critical patent/CN101686106B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The present invention provides a self-adaptive forward error correction (FEC) method, a device and a system, wherein, the self-adaptive FEC method comprises steps of obtaining data of the quality of a current transmission network and determining an FEC strategy according to the data of the quality of the current transmission network, expectant transmission quality data and selected parameters having influences on network transmission content quality. The self-adaptive FEC device comprises an obtaining module for obtaining the data of the quality of the current transmission network; a strategy determining module for determining an FEC strategy according to the data of the quality of the current transmission network, expectant transmission quality data and selected parameters having influences on network transmission content quality. The present invention also provides a self-adaptive FEC system. According to the invention, because influence of parameters having influences on network transmission content quality is considered in the selecting process of an FEC strategy, the FEC effect can be improved.

Description

The methods, devices and systems of adaptive forward error correction
Technical field
The embodiment of the invention relates to technical field of data transmission, particularly a kind of methods, devices and systems of adaptive forward error correction.
Background technology
In the communication network of based on data bag, especially Internet protocol (the Internet Protocol that does not have the service quality that is guaranteed, IP) in the network, often can suffer the not data-bag lost of determined number during transfer of data, the reason of data-bag lost is a lot, for example may be that bit error causes in router or data segment overload, the packet; At streaming media, particularly in the transmission of the video data of compression, be subjected to the impact of data-bag lost very large.
In the technical scheme that the implementation data bag recovers, can utilize re-transmission, forward error correction (ForwardError Correction, hereinafter to be referred as FEC) or the re-transmission method of being combined with forward error correction come recovery data packets, but for streaming media service, its requirement to real-time is very high, especially in the situation of live, multicast, fast forwarding and fast rewinding pattern and video calling, adopt the mode that retransmits to solve the packet loss problem and have significant limitation.In the prior art, FEC be recover damaged by sending redundant information, be dropped or the missing data bag in the data that comprise, this redundant information can be received device and be used for the data of reconstruction of lost, therefore, FEC can provide than retransmitting faster data recovery, and do not need receive channel, FEC is particularly suitable for streaming media.
The FEC technology can be divided into static FEC technology and adaptive forward error correction (Adapted Forward ErrorCorrection is hereinafter to be referred as AFEC) technology.In wireless network, use the FEC technology to become the active research field that wireless video is used, the characteristics of FEC are suitable for multicast exactly, and FEC does not need to carry out alternately with video encoder, and therefore, FEC can be applicable to any video coding technique and program request and live video.But owing to be unmatched between the amount of redundancy that Internet resources and static FEC algorithm add, and amount of redundancy will consume the finite bandwidth of wireless network, and static FEC algorithm might the performance grade.
With respect to static FEC technology, adaptive forward error correction (Adapted Forward ErrorCorrection, hereinafter to be referred as AFEC) technology more is conducive to improve network performance, and all AFEC technology all need to feed back to estimate the available network bandwidth, then feed back to revise amount of redundancy based on this.Feedback can be explicit, control protocol report in the time of strictly according to the facts, or implicit expression, as use wireless generator bottom newspaper to retransmit.Generally speaking, when network condition is poor, increase the number of redundant packets that will send, when network condition is excellent, only need to send a small amount of redundancy packet; Below do not consider the transferring content characteristic to the impact of FEC, such as the impact on FEC of data packet length, speed bit stream and media coding technology, thereby so that be the different transferring contents of k for same block length, the strategy that FEC adopts is identical.
The inventor finds that there are the following problems at least for prior art in realizing process of the present invention: existing error correction method all is the adaptive FEC algorithm that comes from link layer, briefly is exactly: condition is good, reduces redundant; Condition is bad, increases redundant.But different in the length of application layer data bag, its packet loss can not be equal to the bit error rate of link layer, especially concerning video, and under different scenes, different bags, different coded systems has different impacts to video quality.In sum, in the prior art in error correction procedure only for the network parameter adjustment, and do not consider concrete transferring content characteristic.
Summary of the invention
The embodiment of the invention is for the shortcoming of only not considering concrete transferring content characteristic in the existing forward error correction process for network parameter, and a kind of methods, devices and systems of adaptive forward error correction are provided.
The one side of the embodiment of the invention provides a kind of method of adaptive forward error correction, comprising:
Obtain current transmission network qualitative data;
Determine the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality.
The embodiment of the invention provides a kind of device of adaptive forward error correction on the other hand, comprising:
Acquisition module is used for obtaining current transmission network qualitative data;
The strategy determination module is used for determining the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality.
The embodiment of the invention more on the one hand, a kind of system of adaptive forward error correction is provided, comprising:
The adaptive forward error correction device is used for obtaining current transmission network qualitative data, and determines the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality;
The adaptive forward error correction encoder is used for according to the forward error correction strategy that described adaptive forward error correction device is determined data being encoded, and generates redundancy packet.
The methods, devices and systems of the adaptive forward error correction that the embodiment of the invention provides, take into account by the factor that when selecting forward error correction, will affect the Internet Transmission content quality, so that the forward error correction of selecting adapts to the real network situation more, can improve the forward error correction effect.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art, apparently, accompanying drawing in the following describes only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the schematic flow sheet of the embodiment of the method one of adaptive forward error correction of the present invention;
Fig. 2 is the schematic flow sheet of the embodiment of the method two of adaptive forward error correction of the present invention;
Fig. 3 is the system architecture diagram of a specific embodiment of the present invention;
Fig. 4 is the schematic flow sheet of a specific embodiment of the present invention;
Fig. 5 is the schematic flow sheet of the embodiment of the method three of adaptive forward error correction of the present invention;
Fig. 6 is the structural representation of the device embodiment one of adaptive forward error correction of the present invention;
Fig. 7 is the structural representation of the device embodiment two of adaptive forward error correction of the present invention;
Fig. 8 is the structural representation of the device embodiment three of adaptive forward error correction of the present invention;
Fig. 9 is the structural representation of the system embodiment of adaptive forward error correction of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
The embodiment of the invention provides a kind of the QoS parameter of transmission network and transferring content has been combined the method that is applied to adaptive forward error correction, Fig. 1 is the schematic flow sheet of the embodiment of the method one of adaptive forward error correction of the present invention, as shown in Figure 1, comprise the steps:
Step 101, obtain current transmission network qualitative data;
Step 102, determine the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality.
Consider to affect the parameter of Internet Transmission content quality in the present embodiment in the process of selecting the forward error correction strategy, so that more reasonable, the more realistic Internet Transmission situation of forward error correction strategy of selecting, the effect of forward error correction will be more obvious.
Current transmission network qualitative data in above-described embodiment can for the current service quality (Qualityof Service, hereinafter to be referred as QoS) parameter, qos parameter can feed back by the receiving terminal feedback or by network node; The parameter that affects the Internet Transmission content quality includes but not limited to that host-host protocol, error diffusion, decoder error are hidden, the packing strategy of packet, picture group are arranged these parameters.
The method of the adaptive forward error correction that the embodiment of the invention provides, when selecting error correction strategies, consider the character of Internet Transmission content, the parameters such as host-host protocol, packing strategy in the estimation to transmission quality, have been considered, can select suitable forward error correction strategy, improve the effect of forward error correction, can be applied in the error correcting technique of network data transmission, especially the transmission technique field of video data stream.
Fig. 2 is the schematic flow sheet of the embodiment of the method two of adaptive forward error correction of the present invention, and as shown in Figure 2, the method comprises the steps:
Step 201, obtain current transmission network qualitative data;
Step 202, in the selected parameter situation that affects the Internet Transmission content quality, the transmission quality data when calculating a plurality of network quality data and a plurality of forward error correction strategy and making up respectively;
Step 203, determine the forward error correction strategy according to the transmission quality data of current transmission network qualitative data, expection and the transmission quality data of above-mentioned calculating, the transmission quality data of this expection are that the user expects to be set by the user the Internet Transmission quality that reaches.
In the present embodiment is after getting access to current transmission network qualitative data, by calculating in the selected parameter that affects the Internet Transmission content quality, the heterogeneous networks qualitative data, the transmission quality data that adopt different forward error correction strategies to reach, then according to current transmission network qualitative data, the transmission quality data of expection are selected the forward error correction strategy from above-mentioned result of calculation (being the transmission quality data), this selection course can for: when Internet Transmission qualitative data one regularly, forward error correction strategy and transmission quality data are to concern one to one, for example adopt A, B, Internet Transmission qualitative data during three error correction strategies of C (can be the average frame spoilage) is respectively 3%, 2%, 0.5%, if the transmission quality data of expection are less than 1%, then select error correction strategies C.
In above-mentioned implementation process, also can be the step of calculating first, set up in advance the mapping relations of network quality data, forward error correction strategy and transmission quality data, and then obtain current transmission network qualitative data and carry out policy selection.
Fig. 3 is the system architecture diagram of a specific embodiment of the present invention, as shown in Figure 3, system based on IPTV comprises that at transmitting terminal video encoding module 11, data encapsulation module 12, FEC encoder 13 and FEC select adjusting module 14, opposite side in IP network, be receiving terminal, comprise fec decoder device 15, player 16 and network QoS statistical module 17.Wherein 11 pairs of videos of video encoding module are encoded, bit stream data behind 12 pairs of Video codings of data encapsulation module encapsulates, then transmit as loading on the network of host-host protocol with the form of packet, IPTV is mainly by two kinds of transmission meanss: TS over IP and Native RTP over IP; FEC selects adjusting module 14 by obtaining the parameter that affects video quality from media video coding module 11 and data encapsulation module 12, calculates under the heterogeneous networks quality, the video quality that adopts different FEC strategies to reach; Then the information of coming by the receiving terminal feedback, estimate the variation of network quality, adjust the FEC strategy, FEC encoder 13 is exactly to encode according to the strategy that FEC selects adjusting module 14 to provide, be transferred to receiving terminal by IP network, the fec decoder device 15 of receiving terminal can recover the missing data bag according to the forward error correction strategy, carry out video playback by player 16 at last, also be provided with network QoS statistical module 17 at receiving terminal, can obtain the qos parameter of transmission network, the network state that particularly can distinguish FEC coding front and back changes, and this module can also be arranged on the network node.
Fig. 4 is the schematic flow sheet of a specific embodiment of the present invention, as shown in Figure 4, comprising:
Step 301, obtain the parameter that affects video quality, the parameter that affects the Internet Transmission content quality of namely mentioning in above-described embodiment is obtained the network QoS parameter of statistics simultaneously;
Wherein the above-mentioned parameter that affects video quality has multiple combination, can select according to concrete condition, does not consider in the present embodiment error concealing, selects following parameter:
A, picture group (GOP) are arranged and picture group (GOP) length;
B, error diffusion, when video sequence is arranged according to GOP, each GOP begins with the I frame, comprises continuously afterwards several P frames, B frame.Losing of I frame data bag can be diffused into whole GOP, the losing the mistake of bringing and will exert an influence to subsequent frame of P frame data bag, until next GOP suppresses at first, there is not error diffusion in the B frame;
H.264 C, host-host protocol and packing strategy can adopt among coding, Native RTP host-host protocol and the RFC3984 NALU to the mapping ruler (not considering AggregationPackets) of RTP in the present embodiment;
In addition, only consider average packet loss ratio during the network QoS parameter obtained in the present embodiment, Internet Transmission largest unit (Maximum Transmission Unit) MTU is 1500B.
Step 302, estimate under different network quality data, adopt different FEC strategies on the impact of video quality, the transmission quality data when namely a plurality of network quality data and a plurality of FEC strategy make up respectively;
Be exactly in the present embodiment, consider in different average packet loss ratio, adopt H.264 coding and Real-time Transport Protocol, in the situation of the referring-to relation of considering I, P, B frame and GOP arrangement, different FEC strategies is on the impact of video quality.How following specific description sets up this mapping relations:
A, cycle tests: the sample_h264_lmbit.mp4 that provides take Darwin wherein surveys I frame average length 13333B, P frame average length 4367B, B frame average length 1961B as cycle tests; The RTP mean size is 1046B, RTP number 5964; GOP length 60, its internal arrangement are { I 1, P 1, B 1, P 2, B 2... P 29, B 29, P 30;
B, by average packet loss ratio derivation frame spoilage:
Definition frame spoilage (P at first f), in the packet of component frame, there is one or more packet to damage: P f=1-(1-PER) (packet number of frame), paket number offrame wherein represents average frame length, PER represents packet loss; Then by average frame length and the MTU of I frame, P frame, B frame, can obtain respectively P I, P PAnd P B
C, calculating average frame spoilage:
Define average spoilage and equal total frame and damage desired value divided by GOP length, wherein, total frame damages desired value and equals that the spoilage of every frame and its are affected frame number and multiply each other; With these desired value additions, just obtain the total frame of whole GOP and damage desired value after obtaining this frame to damage desired value, table 1 is that each frame damages desired value among the GOP;
Frame Frame damages desired value Frame Frame damages desired value
I 1 60×P I
P 1 59×(1-P I)P PP B 1 (1-P I)(1-P P)(1-P P)P B
P 2 58×(1-P I)(1-P P)P P B 2 (1-P I)(1-P P) 3P B
P 3 56×(1-P I)(1-P P)(1-P P)P P B 3 (1-P I)(1-P P) 4P B
Pi (62-2×i)(1-P I)(1-P P) (i-1)P P B i (1-P I)(1-P P) (i+1)P B
P 30 2×(1-P I)(1-P P) 29P P B 29 (1-P I)(1-P P) 30P B
Table 1
D, consider that FEC is on the impact of average frame spoilage:
The FEC encoder increases t extra bag to packaged packet in every k the bag, in k+t bag, as long as the packet loss number can both be recovered in t.K is wrapped all correct probability is the correct probability of each bag, adds the probability of a lucky t packet loss.With probability calculation, the frame spoilage can be with the correct probability calculation of whole grouping, after again with the bag number of frame divided by k.
E, draw at the heterogeneous networks qualitative data, the video quality (average frame spoilage) that adopts different FEC strategies to reach, table 2 is under the heterogeneous networks state, the video quality that different FEC strategies reach, table 3 is under the heterogeneous networks, different FEC strategies and video quality mapping relations.
PER 1×10 -1 5×10 -2 3×10 -2 1×10 -2 5×10 -3 3×10 -3
The average frame spoilage 98.67% 94.18% 86.69% 56.15% 35.23% 23.36%
PER 1×10 -3 5×10 -4 3×10 -4 1×10 -4 1×10 -5
The average frame spoilage 8.65% 4.46% 2.70% 0.91% 0.09%
Table 2
Table 3
Step 303, monitor, determine network state:
In the present embodiment, obtain the network QoS parameter of transmission network, this parameter comprises carries out the forward and backward different average packet loss ratio of FEC, then from above-mentioned result of calculation, determine the forward error correction strategy according to the transmission quality data of current network qos parameter and expection, concrete is in the situation that average packet loss ratio is determined, selects to satisfy the FEC strategy corresponding to transmission quality data of expection.
Step 304, under the continuous situation of change of network state, need to according to the real-time adjustment FEC of network state strategy, specifically comprise following step:
Step 3041, judge whether receiving terminal reaches the video quality of expection, if reach the expection expectation, forward step 3042 to, otherwise, forward step 3043 to;
Step 3042, basis are carried out the forward and backward packet loss of FEC, judge whether to reduce redundancy, if can, then reduce redundancy, namely select to have the FEC strategy of less amount of redundancy, otherwise, the end adjustment process;
Step 3043, judge whether transmitting terminal has redundancy bandwidth, if having, then increase redundantly, namely select to have the FEC strategy of larger amount of redundancy, otherwise forward step 3044 to;
Step 3044, judgement are not increasing in the redundant situation, whether can change the source block size of FEC coding, if can, then increase the source block size; Otherwise need to take additive method to process.
Wherein, the additive method of mentioning in the step 3044 refers to the method beyond the FEC, as changing the media frame number, changes media quality grade etc.
A specific embodiment: the video quality of supposing expection is that packet loss is less than 1 * 10 -4, namely the average frame spoilage is less than 1%, and corresponding relation sees Table lattice 2; Network QoS parameter by feedback can obtain that packet loss is 3 * 10 before the FEC -2, packet loss is 6 * 10 behind the FEC -3, the FEC strategy that adopts at present is FEC (15,16), wherein (15,16) are illustrated in increases extra packet, i.e. a redundant data packets in per 15 packets; By FEC strategy and video quality mapping relations in the form 3, obtain at packet loss 3 * 10 -2In the situation, if so that the FEC strategy that the average frame spoilage less than desired value 1%, needs is FEC (13,16), have 3 redundant data packets.
In the present embodiment, when selecting the forward error correction strategy, consider current network conditions, this current network condition not only comprises the network QoS parameter of receiving terminal feedback, but also comprise and judge whether to have redundancy bandwidth, consider simultaneously the characteristic of Internet Transmission content, can select the forward error correction strategy that is more suitable for, improve the error correction effect.
The network QoS parameter is the average packet loss ratio of selecting in a period of time in the above-described embodiment, and in the practical IP network, sometimes can not reflect the actual packet loss characteristic of network fully with average packet loss ratio, so the number of times (loss period) that adopts in the present embodiment the continual data package dropout length (lossdistance) that proposes among the RFC3357 and lose event is measured the missing mode of the packet of single channel transmission.
According to gilbert (Gilbert) model, can access
π 0 = q p + q , π 1 = p p + q , p k = ( 1 - q ) k - 1 · q
Wherein, π 0Be expressed as average packet loss ratio, π 1Be expressed as average arrival rate, represent the next losing probability that wraps when previous bag has reached with p, and q represent the probability of not losing of next bag when previous bag has reached, p kThe probability-distribution function that length is k is lost in expression continuously.
In concrete the application, can obtain p, q value according to the network measure data of reality, for example can utilize the method for losing the distribution of lengths statistics.Use m i(i=1,2 ..., n-1) expression continual data package dropout length is the number of times of the event of losing of i, n-1 is the maximum of continual data package dropout length, uses m 0The bag number that expression is not lost, then p and q are expressed as respectively:
p = ( Σ i - 1 n - 1 m i ) / m 0 , q = 1 - ( Σ i - 2 n - 1 m i · ( i - 1 ) ) / ( Σ i - 1 n - 1 m i · i )
In the present embodiment, be to utilize the statistical method lose distribution of lengths, can be comprehensively for the previous period network measure data, carry out the assessment of network state, receiving terminal not only needs to feed back average packet loss ratio, but also will feed back length and the number of times of continual data package dropout event.
In addition, according to p k=(1-q) K-1Among the q to losing continuously the probability-distribution function that length is k, can critic network in the number of continual data package dropout and the probability of generation, thereby realize adjustment to the FEC strategy.
When under estimating the heterogeneous networks qualitative data, adopting different FEC strategies on the affecting of video quality in above-described embodiment, what use is that current average packet loss ratio is calculated FEC to the impact of average frame spoilage, also can at first estimate the average packet loss ratio π after using different FEC strategies under the current transmission network qualitative data in specific implementation process v, calculate the FEC strategy to the impact of average frame spoilage according to this packet loss again.In this case, consider in different average packet loss ratio, adopt H.264 coding and Real-time Transport Protocol, in the situation of the referring-to relation of considering I, P, B frame and GOP arrangement, different FEC strategies can be set up as follows on the mapping relations of the impact of video quality:
A, select a cycle tests: the sample_h264_lmbit.mp4 that provides take Darwin wherein surveys I frame average length 13333B, P frame average length 4367B, B frame average length 1961B as cycle tests; The RTP mean size is 1046B, RTP number 5964; GOP length 60, its internal arrangement are { I 1, P 1, B 1, P 2, B 2... P 29, B 29, P 30;
B, according to Gilbert model, by RTCP feedback or current average packet loss ratio π and the average packet loss length alpha of some network measure data acquisition.Estimate on this basis the recovery effects that different FEC strategies reaches, namely obtain FEC packet loss π afterwards v
C, at new packet loss π vDown, average length and the MTU by I frame, P frame, B frame calculates each frame spoilage;
D, calculate the average frame spoilage of whole GOP, wherein, total frame damages desired value and equals that the spoilage of every frame and its are affected frame number and multiply each other; After obtaining this frame to damage desired value, with these desired value additions, just obtain the total frame of whole GOP and damage desired value;
E, draw under the heterogeneous networks state video quality that different FEC strategies reach (average frame spoilage).
It is the impact of when calculating packet loss, considering the FEC strategy among the embodiment that above-mentioned steps provides.
In the above-described embodiment, all estimated out under different network quality data the video quality that adopts different FEC strategies to reach, set up a kind of tabular mapping relations before the FEC strategy is adjusted, adjusting tables look-up according to current network conditions at every turn gets final product.In concrete implementation process, also can not set up this kind relation, but in the needs adjustment by calculating the average packet loss ratio π that uses in the required FEC strategy present embodiment in above-described embodiment v, and set up average frame spoilage and FEC packet loss π afterwards vFunctional relation P Gop(k, n)=f (π (k, n)), method by iteration calculates in certain F EC strategy scope can arrive both (k, n) of the average frame spoilage of provisioning request, (k, n) be illustrated in t redundant data packets of increase in k the packet, obtain the datagram of n transmission.
Fig. 5 is the schematic flow sheet of the embodiment of the method three of adaptive forward error correction of the present invention, comprises as shown in Figure 5 following step:
Step 401, obtain the relevant parameter and the current network qos parameter that affect video quality, concrete identical with step 301;
Then, select the FEC strategy according to the current network qos parameter, specifically can be divided into:
Step 402, determine the cycle tests parameter;
Step 403, determine selectable FEC strategy, and arrange from big to small by redundancy;
Step 404, judge whether receiving terminal reaches the video quality of expection, if fall flat forwards step 405 to, otherwise forward step 406 to;
Average packet loss ratio before the FEC of step 405, acquisition receiving terminal feedback according to current FEC strategy, according to a kind of FEC strategy under the redundancy selective sequential from small to large, has judged whether enough redundancy bandwidth, if having, and the average packet loss ratio π after the estimation FEC v, calculate the average frame spoilage, judge whether to reach the video quality of expection, if produce a desired effect, finish to select this flow process; If do not reach the video quality of expection, then continue to carry out this step, there are not enough redundancy bandwidth if determine, then adopt other method to process; Additive method refers to the method beyond the FEC, as changing the media frame number, changes media quality grade etc.
Average packet loss ratio before the FEC of step 406, acquisition receiving terminal feedback, according to current FEC strategy, according to a kind of FEC strategy under the redundancy selective sequential from small to large, estimate FEC average packet loss ratio π v afterwards, calculate the average frame spoilage, judge whether to reach the video quality of expection, if produce a desired effect, continue to carry out this step, until satisfy the minimal redundancy FEC strategy of video quality requirement, finish to adjust.
A specific embodiment: the sample_h264_lmbit.mp4 that adopts Darwin to provide is cycle tests, supposes Bao Changwei 500B, and the video quality that need to reach is 10%, and the packet loss that obtains before the FEC by feedback information is 3 * 10 -2, the current FEC that do not use selects lower a kind of FEC strategy (15,16), the average frame spoilage that calculates is 78.2%, does not reach requirement, then continue lower a kind of FEC strategy (14,16), judging has redundancy bandwidth, calculating the average frame spoilage is 24.81%, and still backlog demand continues lower a kind of FEC strategy (13,16), still have redundancy bandwidth, calculating the average frame spoilage is 2.4%, reach required video quality, finish to calculate.
The embodiment of the invention also provides a kind of device of adaptive forward error correction, Fig. 6 is the structural representation of the device embodiment one of adaptive forward error correction of the present invention, as shown in Figure 6, the device of adaptive forward error correction comprises acquisition module 21 and tactful determination module 22, wherein acquisition module 21 is used for obtaining current transmission network qualitative data, and these data can be by receiving terminal or network node feedback; Strategy determination module 22 is used for determining the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality.
The device of the adaptive forward error correction in the present embodiment is to have considered to affect the parameter factor of Internet Transmission content quality in definite error correction strategies, more is conducive to choose suitable forward error correction strategy.
Above-mentioned current transmission network qualitative data is the current service mass parameter, and the current service mass parameter can be fed back by the receiving terminal feedback or by network node.The selected parameter that affects the Internet Transmission content quality comprises following any one or its combination in above-described embodiment: host-host protocol, error diffusion, decoder error are hidden, the packing strategy of packet, picture group are arranged.
Considered a series of parameter that affects the Internet Transmission content quality in the present embodiment, prejudged under the heterogeneous networks qualitative data, the effect of using different forward error correction strategies to reach.Therefore behind the QoS parameter that has obtained transmission network, be easy to select suitable forward error correction strategy.
Fig. 7 is the structural representation of the device embodiment two of adaptive forward error correction of the present invention, as shown in Figure 7, in above-described embodiment, the device of adaptive forward error correction comprises: acquisition module 31 and tactful determination module 32, wherein tactful determination module 32 can be further divided into the first computing unit 321, memory cell 322 and the first policy selection unit 323; Acquisition module 31 is used for obtaining current transmission network qualitative data, and these data can be by receiving terminal or network node feedback; The first computing unit 321 is used in the selected parameter situation that affects the Internet Transmission content quality, transmission quality data when calculating a plurality of network quality data and a plurality of forward error correction strategy and making up respectively, memory cell 322 are used for the first computing unit 321 is obtained mapping relations between network quality data, forward error correction strategy and the transmission quality data three; The first policy selection unit 323 is used for selecting the forward error correction strategy according to the transmission quality data of current transmission network qualitative data, expection from memory cell 322.
The device of the adaptive forward error correction that provides in the present embodiment, when selecting the forward error correction strategy, not only consider to reflect the network quality data of current network quality, but also the impact that the difference of considering the Internet Transmission content is brought, can choose more suitable forward error correction strategy, concrete selection course is: when one timing of Internet Transmission qualitative data, forward error correction strategy and transmission quality data are to concern one to one, for example adopt A, B, Internet Transmission quality during three error correction strategies of C (can be the average frame spoilage) is respectively 3%, 2%, 0.5%, if user's expection transmission quality is less than 1%, then select error correction strategies C.
In concrete implementation process, can be by calculating the mapping relations that obtain between network quality data, forward error correction strategy and the transmission quality data by computing unit first, obtain again current transmission network qualitative data and select the forward error correction strategy, or obtain first current transmission network qualitative data and calculated by the first computing unit again.
The structural representation of the device embodiment three of Fig. 8 adaptive forward error correction of the present invention, as shown in Figure 8, the device of adaptive forward error correction comprises: acquisition module 41 and tactful determination module 42, wherein acquisition module 31 is used for obtaining current transmission network qualitative data, and these data can be by receiving terminal or network node feedback; Policy selection module 42 comprises judging unit 421, the second computing unit 422 and the second policy selection unit 423, and judging unit 421 is used for judging whether described current transmission network qualitative data reaches the transmission quality data of expection; 422 1 kinds of situations of the second computing unit are when current transmission network qualitative data does not reach the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and current transmission network qualitative data, the descending order of the redundancy that has according to a plurality of forward error correction strategies calculates the transmission quality data that each forward error correction strategy can reach successively, another kind of situation is when current transmission network qualitative data reaches the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and current transmission network qualitative data, the from small to large order of the redundancy that has according to a plurality of forward error correction strategies is calculated the transmission quality data that each forward error correction strategy can reach successively; The second policy selection unit corresponding forward error correction strategy when in the first situation, selecting to satisfy the transmission quality data of expection; Perhaps in the second situation, select to satisfy the transmission quality data of expection and have the forward error correction strategy of minimal redundancy.
From embodiment illustrated in fig. 7 different be, in a upper embodiment, be to precompute the transmission quality data of taking different forward error correction strategies to reach under the diverse network qualitative data, and set up a mapping table, then after the network quality data according to reality, the transmission quality data selection forward error correction strategy that reaches according to concrete expection gets final product, and in the present embodiment, after obtaining network quality data, calculate successively the different achieved transmission qualities of forward error correction strategy, until transmission quality meets pre-after date, just determine the forward error correction strategy.
The embodiment of the invention also provides a kind of system of adaptive forward error correction, Fig. 9 is the structural representation of the system embodiment of adaptive forward error correction of the present invention, as shown in Figure 9, the system of adaptive forward error correction comprises: adaptive forward error correction device 5 and adaptive forward error correction encoder 6, wherein adaptive forward error correction device 5 is used for obtaining current transmission network qualitative data, and determines the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality; Adaptive forward error correction encoder 6 is used for according to the forward error correction strategy that described adaptive forward error correction device is determined data being encoded, and generates redundancy packet.
The system of the adaptive forward error correction in the present embodiment can also comprise network quality data statistical module 7, is used for adding up current transmission network qualitative data, and wherein, network quality data statistical module 7 is arranged on receiving terminal or the network node.
The system of the adaptive forward error correction in the present embodiment is to consider to affect the parameter of current network transferring content quality selecting error correction strategies, can select more effectively forward error correction strategy, more is fit to the needs of current network state.
The methods, devices and systems of the adaptive forward error correction that the embodiment of the invention provides, when selecting the forward error correction strategy, not only consider current network conditions, but also the parameter that will affect the Internet Transmission content quality takes into account, so that the forward error correction strategy of selecting more can adapt to current network state, improve the effect of forward error correction.
One of ordinary skill in the art will appreciate that all or part of flow process that realizes in above-described embodiment method, to come the relevant hardware of instruction to finish by computer program, described program can be stored in the computer read/write memory medium, this program can comprise the flow process such as the embodiment of above-mentioned each side method when carrying out.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-Only Memory, ROM) or store-memory body (Random Access Memory, RAM) etc. at random.
It should be noted that at last: above embodiment is only in order to technical scheme of the present invention to be described but not limit it, although with reference to preferred embodiment the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be made amendment or be equal to replacement technical scheme of the present invention, and these modifications or be equal to replacement and also can not make amended technical scheme break away from the spirit and scope of technical solution of the present invention.

Claims (12)

1. the method for an adaptive forward error correction is characterized in that, comprising:
Obtain current transmission network qualitative data;
Determine the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality;
Described transmission quality data and the selected parameter that affects the Internet Transmission content quality according to current transmission network qualitative data, expection determines that the step of forward error correction strategy comprises:
When described current transmission network qualitative data does not reach the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and current transmission network qualitative data, calculate successively the transmission quality data that each forward error correction strategy can reach according to the redundancy order from small to large that a plurality of forward error correction strategies have, corresponding forward error correction strategy when select satisfying the transmission quality data of expection;
Perhaps,
When described current transmission network qualitative data reaches the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and current transmission network qualitative data, the descending order of the redundancy that has according to a plurality of forward error correction strategies calculates the transmission quality data that each forward error correction strategy can reach successively, the forward error correction strategy of selecting to satisfy the transmission quality data of expection and having minimal redundancy;
Perhaps,
In the selected parameter situation that affects the Internet Transmission content quality, the transmission quality data when calculating a plurality of network quality data and a plurality of forward error correction strategy and making up respectively; Determine the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the transmission quality data of described calculating.
2. the method for adaptive forward error correction according to claim 1 is characterized in that, described current transmission network qualitative data is the current service mass parameter, and wherein, described current service mass parameter is fed back by the receiving terminal feedback or by network node.
3. the method for adaptive forward error correction according to claim 1 is characterized in that, the described selected parameter that affects the Internet Transmission content quality comprises following any one or its combination:
Host-host protocol, error diffusion, decoder error are hidden, the packing strategy of packet, picture group are arranged.
4. the method for adaptive forward error correction according to claim 1 is characterized in that, described a plurality of network quality data are average packet loss ratio or the drop probabilities distribution function that calculated by the number of times of the length of continual data package dropout event and continual data package dropout event.
5. the method for adaptive forward error correction according to claim 1, it is characterized in that, described in the selected parameter situation that affects the Internet Transmission content quality, the step of the transmission quality data when calculating a plurality of network quality data and a plurality of forward error correction strategy combination comprises:
The frame length value of each frame of transfer sequence, group of pictures length value in the selected network;
Calculate the frame spoilage of each frame according to the frame length value of described each frame, the average packet loss ratio of setting;
Frame spoilage and group of pictures length according to described each frame are calculated the average frame spoilage;
The average frame spoilage of calculating after using the forward error correction strategy of setting;
Select different average packet loss ratio and/or different forward error correction strategies to carry out successively above-mentioned steps.
6. the method for adaptive forward error correction according to claim 1, it is characterized in that, described in the selected parameter situation that affects the Internet Transmission content quality, the step of the transmission quality data when calculating a plurality of network quality data and a plurality of forward error correction strategy combination further comprises:
The frame length value of each frame of transfer sequence, group of pictures length value in the selected network;
According to the average packet loss ratio of average packet loss ratio calculating after using the forward error correction strategy of setting of setting;
Calculate the frame spoilage of each frame according to the frame length value of each frame, average packet loss ratio after using the forward error correction strategy of setting;
Frame spoilage, group of pictures length according to each frame are calculated the average frame spoilage;
Select different average packet loss ratio and/or different forward error correction strategies to carry out successively above-mentioned steps.
7. according to claim 5 or the method for 6 described adaptive forward error corrections, it is characterized in that, described according to current transmission network qualitative data, expection the transmission quality data and the transmission quality data of described calculating determine the forward error correction strategy step after also comprise:
When the current transmission network qualitative data that obtains reaches the transmission quality data of described expection, select to have the forward error correction strategy of less amount of redundancy;
When the current transmission network qualitative data that obtains does not reach the transmission quality data of described expection, select to have the forward error correction strategy of larger amount of redundancy or increase the source block size.
8. the device of an adaptive forward error correction is characterized in that, comprising:
Acquisition module is used for obtaining current transmission network qualitative data;
The strategy determination module is used for determining the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the selected parameter that affects the Internet Transmission content quality;
Described tactful determination module specifically comprises:
The first computing unit is used in the selected parameter situation that affects the Internet Transmission content quality, the transmission quality data when calculating a plurality of network quality data and a plurality of forward error correction strategy and making up respectively;
Memory cell is used for the mapping relations between storage networking qualitative data, forward error correction strategy and the transmission quality data three;
The first policy selection unit is used for selecting the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection from described memory cell;
Perhaps, described tactful determination module specifically comprises:
Judging unit is used for judging whether described current transmission network qualitative data reaches the transmission quality data of expection;
The second computing unit, be used for when described current transmission network qualitative data does not reach the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and described current transmission network qualitative data, calculate successively the transmission quality data that each forward error correction strategy can reach according to the redundancy order from big to small that a plurality of forward error correction strategies have; Perhaps, when described current transmission network qualitative data reaches the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and described current transmission network qualitative data, the from small to large order of the redundancy that has according to a plurality of forward error correction strategies is calculated the transmission quality data that each forward error correction strategy can reach successively;
The second policy selection unit, corresponding forward error correction strategy when be used for to select satisfying the transmission quality data of expection; Perhaps, the forward error correction strategy of selecting to satisfy the transmission quality data of expection and having minimal redundancy.
9. the device of adaptive forward error correction according to claim 8 is characterized in that, described current transmission network qualitative data is the current service mass parameter, and wherein, described current service mass parameter is fed back by the receiving terminal feedback or by network node.
10. the device of adaptive forward error correction according to claim 8 is characterized in that, the described selected parameter that affects the Internet Transmission content quality comprises following any one or its combination:
Host-host protocol, error diffusion, decoder error are hidden, the packing strategy of packet, picture group are arranged.
11. the system of an adaptive forward error correction is characterized in that, comprises adaptive forward error correction device and adaptive forward error correction encoder, wherein:
The adaptive forward error correction device, be used for obtaining current transmission network qualitative data, when described current transmission network qualitative data does not reach the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and current transmission network qualitative data, calculate successively the transmission quality data that each forward error correction strategy can reach according to the redundancy order from small to large that a plurality of forward error correction strategies have, corresponding forward error correction strategy when select satisfying the transmission quality data of expection; Perhaps,
When described current transmission network qualitative data reaches the transmission quality data of expection, according to the parameter that affects the Internet Transmission content quality and current transmission network qualitative data, the descending order of the redundancy that has according to a plurality of forward error correction strategies calculates the transmission quality data that each forward error correction strategy can reach successively, the forward error correction strategy of selecting to satisfy the transmission quality data of expection and having minimal redundancy; Perhaps,
In the selected parameter situation that affects the Internet Transmission content quality, the transmission quality data when calculating a plurality of network quality data and a plurality of forward error correction strategy and making up respectively; Determine the forward error correction strategy according to the transmission quality data of described current transmission network qualitative data, expection and the transmission quality data of described calculating;
The adaptive forward error correction encoder is used for according to the forward error correction strategy that described adaptive forward error correction device is determined data being encoded, and generates redundancy packet.
12. the system of adaptive forward error correction according to claim 11 is characterized in that, also comprises:
The network quality data statistical module is used for adding up current transmission network qualitative data, and wherein, described network quality data statistical module is arranged on receiving terminal or the network node.
CN 200810223805 2008-09-28 2008-09-28 Self-adaptive forward error correction (FEC) method, device and system Expired - Fee Related CN101686106B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200810223805 CN101686106B (en) 2008-09-28 2008-09-28 Self-adaptive forward error correction (FEC) method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200810223805 CN101686106B (en) 2008-09-28 2008-09-28 Self-adaptive forward error correction (FEC) method, device and system

Publications (2)

Publication Number Publication Date
CN101686106A CN101686106A (en) 2010-03-31
CN101686106B true CN101686106B (en) 2013-04-17

Family

ID=42049096

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200810223805 Expired - Fee Related CN101686106B (en) 2008-09-28 2008-09-28 Self-adaptive forward error correction (FEC) method, device and system

Country Status (1)

Country Link
CN (1) CN101686106B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115225209A (en) * 2022-09-20 2022-10-21 江苏为是科技有限公司 Data transmission method, data transmission device, data transmission system, and storage medium

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102752184A (en) * 2011-04-20 2012-10-24 河海大学 Data communication system for real-time multicast service and method thereof
US10009144B2 (en) * 2011-12-15 2018-06-26 Qualcomm Incorporated Systems and methods for pre-FEC metrics and reception reports
JP6380935B2 (en) * 2012-06-04 2018-08-29 パナソニックIpマネジメント株式会社 TRANSMISSION DEVICE, RECEPTION DEVICE, TRANSMISSION METHOD, AND RECEPTION METHOD
CN105227894B (en) * 2014-07-01 2019-08-27 三亚中兴软件有限责任公司 A kind of implementation method and multipoint control unit of video conference
CN105992023B (en) * 2015-02-11 2019-06-04 杭州海康威视数字技术股份有限公司 The processing method and processing device of video image data
CN108702245B (en) * 2016-02-19 2021-01-15 联发科技股份有限公司 Adaptive application layer forward error correction for MPEG media transport
CN105897378A (en) * 2016-04-06 2016-08-24 上海华为技术有限公司 Method and device of reducing transmission packet loss rate
CN106209118B (en) * 2016-06-29 2019-09-20 深圳忆联信息系统有限公司 A kind of information processing method and electronic equipment
CN107920279B (en) 2016-10-08 2020-03-20 华为技术有限公司 Method and apparatus for evaluating video quality
CN108322286B (en) * 2017-01-17 2020-12-15 华为技术有限公司 Method and device for obtaining Forward Error Correction (FEC) parameters
CN108809893B (en) * 2017-04-27 2020-03-27 华为技术有限公司 Video quality evaluation method and device
CN109428690B (en) * 2017-09-04 2021-07-30 瑞昱半导体股份有限公司 Ethernet connection method and Ethernet device
CN110299963A (en) * 2019-06-05 2019-10-01 西安万像电子科技有限公司 Data processing method and device
CN110247736B (en) * 2019-06-27 2022-04-22 北京奇艺世纪科技有限公司 Data transmission method and device
CN110602452B (en) * 2019-09-05 2020-12-25 杭州米络星科技(集团)有限公司 Method for guaranteeing remote real-time transmission smoothness of global UDP audio and video stream
CN115134307B (en) * 2022-06-27 2024-01-26 长沙理工大学 Load balancing method based on packet loss rate coding in cloud computing
CN117353866A (en) * 2022-06-28 2024-01-05 中兴通讯股份有限公司 Forward error correction pattern switching method, apparatus and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1479976A (en) * 2000-12-06 2004-03-03 Ħ��������˾ Apparatus and method for providing optimal self-adaptive forward error correction in communication system
CN1845611A (en) * 2005-04-08 2006-10-11 华为技术有限公司 Video transmission protection method based on H.264

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1479976A (en) * 2000-12-06 2004-03-03 Ħ��������˾ Apparatus and method for providing optimal self-adaptive forward error correction in communication system
CN1845611A (en) * 2005-04-08 2006-10-11 华为技术有限公司 Video transmission protection method based on H.264

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115225209A (en) * 2022-09-20 2022-10-21 江苏为是科技有限公司 Data transmission method, data transmission device, data transmission system, and storage medium

Also Published As

Publication number Publication date
CN101686106A (en) 2010-03-31

Similar Documents

Publication Publication Date Title
CN101686106B (en) Self-adaptive forward error correction (FEC) method, device and system
CN100592670C (en) System and method for controlling self-adaptive forward error dynamically in IPTV network
CN1878049B (en) Method of controlling transmission rate by using error correction packets and communication apparatus using the same
CN102790666B (en) Error control method, receiving end, transmitting end and system
CN101505202B (en) Adaptive error correction method for stream media transmission
CN101383679B (en) Fec transmission processing apparatus and method and program recording medium
CN102546081B (en) Method for detecting packet loss, system and media client
CN101179362B (en) Automatic retransmission request mechanism suitable for mobile stream media application
CN106341738A (en) Streaming media network transmission bandwidth calculation method, server and system
EP2437421B1 (en) Method, device and communication system for retransmitting based on forward error correction
US20090092152A1 (en) Method and System for Dynamically Adjusting Forward Error Correction (FEC) Rate to Adapt for Time Varying Network Impairments in Video Streaming Applications Over IP Networks
CN102017491A (en) A method and system for adapting forward error correction in multicast over wireless networks
CN101826937B (en) Link layer error control system suitable for next generation mobile Internet and method thereof
CN101945427A (en) Efficient streaming media transmission method
CN108174234A (en) A kind of flow-medium transmission method and system
CN102239658B (en) Error control on-demand
Khalaf et al. Improving video transmission over heterogeneous network by using ARQ and FEC error correction algorithm
CN108781139A (en) Data in packet network retransmit
Chieochan et al. Wireless fountain coding with IEEE 802.11 e block ACK for media streaming in wireline-cum-WiFi networks: a performance study
Yavatkar et al. Optimistic strategies for large-scale dissemination of multimedia information
CN102752184A (en) Data communication system for real-time multicast service and method thereof
CN103607255A (en) Wireless channel video communication packet loss rate control method
CN106792265A (en) A kind of network real-time flow-medium transmission method and system
CN115037416A (en) Data forward error correction processing method, device, electronic equipment and storage medium
JP5592235B2 (en) Multicast pre-delivery method, system, and apparatus

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130417

Termination date: 20150928

EXPY Termination of patent right or utility model