CN111385055A

CN111385055A - Data transmission method and device

Info

Publication number: CN111385055A
Application number: CN201811608511.6A
Authority: CN
Inventors: 邹翰
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2018-12-27
Filing date: 2018-12-27
Publication date: 2020-07-07
Anticipated expiration: 2038-12-27
Also published as: CN111385055B

Abstract

The application provides a data transmission method and a device, wherein the method comprises the following steps: transmitting FEC encoding data to receiving end equipment; receiving FEC parameter adjustment factors sent by the receiving end equipment; and adjusting FEC encoding parameters according to the FEC parameter adjusting factors, and sending FEC encoding data to the receiving terminal equipment according to the adjusted FEC encoding parameters. The method can realize the dynamic adjustment of the FEC encoding parameters and improve the flexibility of the FEC encoding parameters.

Description

Data transmission method and device

Technical Field

The present application relates to network communication technologies, and in particular, to a data transmission method and apparatus.

Background

In the era of mobile internet, multimedia communication is more and more widely applied to a mobile terminal, and compared with a traditional PC (personal computer), a mobile terminal has the disadvantages of unstable performance, insufficient network bandwidth, large network fluctuation and the like, which may cause network data packet loss. The application of the FEC (Forward Error Correction) technology can better solve the problem of network packet loss.

However, practice shows that in the application scheme of the existing FEC technology, FEC coding parameters are single and fixed, and flexibility is poor.

Disclosure of Invention

In view of this, the present application provides a data transmission method and apparatus.

Specifically, the method is realized through the following technical scheme:

according to a first aspect of the embodiments of the present application, a data transmission method is provided, which is applied to a sending end device, and the method includes:

forward Error Correction (FEC) coded data are sent to receiving end equipment;

receiving FEC parameter adjustment factors sent by the receiving end equipment;

and adjusting FEC encoding parameters according to the FEC parameter adjusting factors, and sending FEC encoding data to the receiving terminal equipment according to the adjusted FEC encoding parameters.

According to a second aspect of the embodiments of the present application, there is provided a data transmission method applied to a receiving end device, the method including:

receiving Forward Error Correction (FEC) coded data sent by sending end equipment;

determining FEC parameter adjustment factors according to the FEC encoding data;

and sending the FEC parameter adjustment factor to the sending end equipment so that the sending end equipment adjusts the FEC encoding parameter according to the FEC parameter adjustment factor, and sending FEC encoding data to the receiving end equipment according to the adjusted FEC encoding parameter.

According to a third aspect of the embodiments of the present application, there is provided a data transmission apparatus, applied to a sending end device, the apparatus including:

a sending unit, configured to send forward error correction FEC encoded data to a receiving end device;

a receiving unit, configured to receive the FEC parameter adjustment factor sent by the receiving end device;

the adjusting unit is used for adjusting the FEC encoding parameters according to the FEC parameter adjusting factors;

the sending unit is further configured to send FEC encoded data to the receiving end device according to the adjusted FEC encoding parameter.

According to a fourth aspect of the embodiments of the present application, there is provided a data transmission apparatus, which is applied to a receiving end device, and includes:

a receiving unit, configured to receive forward error correction FEC encoded data sent by a sending end device;

a determining unit, configured to determine an FEC parameter adjustment factor according to the FEC encoded data;

and a sending unit, configured to send the FEC parameter adjustment factor to the sending end device, so that the sending end device performs FEC coding parameter adjustment according to the FEC parameter adjustment factor, and sends FEC coding data to the receiving end device according to the adjusted FEC coding parameter.

According to a fifth aspect of the embodiments of the present application, there is provided an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

and the processor is used for realizing the data transmission method provided by the first aspect when executing the program stored in the memory.

According to a sixth aspect of embodiments of the present application, there is provided a computer-readable storage medium having stored therein a computer program, which when executed by a processor, implements the steps of the data transmission method provided by the first aspect described above.

According to a seventh aspect of the embodiments of the present application, there is provided an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;

a memory for storing a computer program;

and the processor is used for realizing the data transmission method provided by the second aspect when executing the program stored in the memory.

According to an eighth aspect of embodiments of the present application, there is provided a computer-readable storage medium having stored therein a computer program which, when executed by a processor, implements the steps of the data transmission method provided by the second aspect described above.

According to the data transmission method, the FEC encoding data are sent to the receiving end equipment, the FEC parameter adjusting factors sent by the receiving end equipment are received, the FEC encoding parameters are adjusted according to the received FEC parameter adjusting factors, and the FEC encoding data are sent to the receiving end equipment according to the adjusted FEC encoding parameters, so that the dynamic adjustment of the FEC encoding parameters is realized, and the flexibility of the FEC encoding parameters is improved.

Drawings

Fig. 1 is a schematic flow chart diagram illustrating a data transmission method according to an exemplary embodiment of the present application;

FIG. 2 is a flow chart diagram illustrating a data transmission method according to an exemplary embodiment of the present application;

FIG. 3 is a diagram illustrating an encoding parameter block structure according to an exemplary embodiment of the present application;

FIG. 4 is a diagram illustrating an RTP payload format according to an exemplary embodiment of the present application;

FIG. 5 is a flow chart illustrating a data transmission according to an exemplary embodiment of the present application;

fig. 6 is a schematic structural diagram of a data transmission apparatus according to an exemplary embodiment of the present application;

fig. 7 is a schematic structural diagram of a data transmission apparatus according to another exemplary embodiment of the present application;

FIG. 8 is a diagram illustrating a hardware configuration of an electronic device according to an exemplary embodiment of the present application;

fig. 9 is a schematic structural diagram of a data transmission apparatus according to an exemplary embodiment of the present application;

fig. 10 is a schematic diagram of a hardware structure of an electronic device according to an exemplary embodiment of the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

In order to make the technical solutions provided in the embodiments of the present application better understood and make the above objects, features and advantages of the embodiments of the present application more comprehensible, the technical solutions in the embodiments of the present application are described in further detail below with reference to the accompanying drawings.

Referring to fig. 1, a schematic flow chart of a data transmission method provided in an embodiment of the present application is shown, where the data transmission method may be applied to a sending end device, and as shown in fig. 1, the data transmission method may include the following steps:

step S100, transmitting the FEC encoded data to the receiving end device.

In the embodiment of the present application, in order to improve reliability of data transmission, when sending data to receiving end equipment, sending end equipment may use an FEC algorithm to encode the data to be sent, and send FEC encoded data to the receiving end equipment.

The FEC encoding data comprises an original data packet and a redundant data packet obtained by encoding the original data packet according to an FEC algorithm.

It should be noted that, in this embodiment of the present application, when the sending end device sends data to the receiving end device for the first time, the FEC coding parameters used, such as the FEC algorithm, the algorithm redundancy, and the like, may be negotiated in advance by the sending end device and the receiving end device, or configured statically, and specific implementation thereof is not described herein again.

Step S110, receiving the FEC parameter adjustment factor sent by the receiving end device.

In the embodiment of the present application, in order to improve flexibility of FEC encoding parameters used in a data transmission process, when receiving FEC encoding data sent by a sending end device, a receiving end device may determine an FEC parameter adjustment factor according to the received FEC encoding data, and send the determined FEC parameter adjustment factor to the sending end device.

The specific implementation of determining the FEC parameter adjustment factor according to the received FEC encoded data by the receiving end device may be described below with reference to a specific example, which is not described herein again in this embodiment of the present application.

And step S120, adjusting the FEC encoding parameters according to the received FEC parameter adjusting factors, and sending the FEC encoded data to the receiving terminal equipment according to the adjusted FEC encoding parameters.

In this embodiment, when receiving the FEC parameter adjustment factor sent by the receiving end device, the sending end device may adjust the FEC encoding parameter according to the received FEC parameter adjustment factor, and send FEC encoded data to the receiving end device according to the adjusted FEC encoding parameter.

The FEC encoded data may carry FEC encoding parameters (adjusted FEC encoding parameters) currently used by the sending end device.

In an embodiment of the present application, the adjusting the FEC coding parameters according to the received FEC parameter adjustment factor may include:

determining an FEC encoding parameter adjustment strategy according to the FEC parameter adjustment factors;

and adjusting the FEC encoding parameters according to the FEC encoding parameter adjusting strategy.

In this embodiment, when the sending end device receives the FEC parameter adjustment factor sent by the receiving end device, the sending end device may determine an FEC coding parameter adjustment policy according to the FEC parameter adjustment factor, and perform FEC coding parameter adjustment according to the determined FEC coding parameter adjustment policy.

Optionally, the FEC parameter adjustment factors may include, but are not limited to, one or more of data reception parameters, device performance parameters, and the like; the FEC coding parameter adjustment strategy may include, but is not limited to, one or more of adjusting algorithm redundancy, adjusting algorithm complexity, and the like.

Optionally, the data receiving parameters may include, but are not limited to, one or more of packet loss rate, recovery rate, and RTT (Round-trip-time); device performance parameters may include, but are not limited to, CPU (central processing Unit) host frequency, and the like.

In an example, the determining the FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor may include:

and when the packet loss rate is higher than a preset packet loss rate threshold value or/and the recovery rate is lower than a preset recovery rate threshold value, determining the FEC encoding parameter adjustment strategy to improve the algorithm redundancy.

In this example, the data receiving parameters include a packet loss rate or/and a recovery rate.

When the FEC parameter adjustment factor sent by the receiving end device is received by the sending end device, the sending end device may compare the packet loss rate with a preset packet loss rate threshold (which may be set according to an actual scene), and compare the recovery rate with a preset recovery rate threshold (which may be set according to an actual scene).

When the sending end device determines that the packet loss rate is higher than a preset packet loss rate threshold, or/and the recovery rate is lower than a preset recovery rate threshold, the sending end device may determine that the FEC coding parameter adjustment strategy is to improve the algorithm redundancy, so as to reduce the packet loss rate of the receiving end device and improve the recovery rate of the receiving end device.

In another example, the determining the FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor may include:

and when the RTT is larger than a preset time threshold, determining the FEC encoding parameter adjustment strategy as to reduce the algorithm redundancy.

In this example, the FEC parameter adjustment factor includes RTT as an example.

In this example, when the sending end device receives the FEC parameter adjustment factor sent by the receiving end device, the sending end device may compare the RTT with a preset time threshold (which may be set according to an actual scene).

When the sending end device determines that the RTT is greater than the preset time threshold, the sending end device may determine that the FEC encoding parameter adjustment policy is to reduce algorithm redundancy, so as to reduce the RTT.

It should be noted that, in this embodiment of the application, when the FEC parameter adjustment factor includes a packet loss rate, a recovery rate, and an RTT, the sending-end device may calculate a value (which may be referred to as a receptivity value herein) for determining an FEC coding parameter adjustment policy according to the packet loss rate, the recovery rate, and the RTT, and determine the FEC coding parameter adjustment policy according to the receptivity value.

For example, a calculation formula of the reception performance value with the packet loss rate, the recovery rate, and the RTT as variables may be configured in the sending end device in advance, and when the sending end device receives the FEC parameter adjustment factor sent by the receiving end device, the values of the packet loss rate, the recovery rate, and the RTT may be substituted into the calculation formula to calculate the reception performance value of the receiving end device.

The packet loss rate and the RTT may be negatively correlated with the reception performance value, that is, the higher the packet loss rate and the larger the RTT, the smaller the reception performance value is; the recovery rate is positively correlated with the reception performance value, i.e., the higher the recovery rate, the larger the reception performance value; the larger the reception performance value is, the better the reception performance of the receiving-end device is.

Furthermore, the sending end device may determine the FEC coding parameter adjustment policy according to the receiving performance value of the receiving end device, for example, when the receiving performance value of the receiving end device is lower than the preset threshold, the FEC coding parameter adjustment policy is determined to improve the algorithm redundancy.

Or, in this embodiment of the application, when the FEC parameter adjustment factor includes the packet loss rate, the recovery rate, and the RTT, the sending end device may preferentially determine the FEC encoding parameter adjustment policy according to the packet loss rate and the recovery rate, or preferentially determine the FEC encoding parameter policy (which may be set according to an actual scene) according to the RTT.

For example, taking the determination of the FEC coding parameters according to the packet loss rate and the recovery rate as an example, when the sending end device receives the FEC parameter adjustment factor sent by the receiving end device, the sending end device may first compare the packet loss rate with the preset packet loss rate threshold, and compare the recovery rate with the preset recovery rate threshold, and when the packet loss rate is higher than the preset packet loss rate threshold and the recovery rate is lower than the preset recovery rate threshold, determine the FEC coding parameter adjustment policy to improve the algorithm redundancy; when the packet loss rate is not higher than the preset packet loss rate threshold, or/and the recovery rate is not lower than the preset recovery rate threshold, the sending end device may further compare the RTT with a preset time threshold, and if the RTT is greater than the preset time threshold, determine that the FEC coding parameter adjustment policy is to reduce the algorithm redundancy.

In yet another example, the determining the FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor may include:

when the CPU main frequency is higher than a preset main frequency threshold, determining an FEC encoding parameter adjustment strategy to improve algorithm complexity;

and when the CPU main frequency is lower than a preset main frequency threshold, determining the FEC encoding parameter adjustment strategy as reducing the algorithm complexity.

In this example, considering that the higher the complexity of the FEC algorithm is, the higher the requirement on the device processing performance is, the sending end device may also adjust the FEC encoding parameters according to the device processing performance of the receiving end device.

In this example, for example, the device processing performance is represented by the CPU master frequency, the higher the CPU master frequency, the better the device processing performance, and the lower the CPU device processing performance, the worse the device performance processing.

When the sending end device receives the FEC parameter adjustment factor sent by the receiving end device, the sending end device may compare the CPU dominant frequency of the receiving end device with a preset dominant frequency threshold (which may be set according to an actual scene).

When the sending end equipment determines that the CPU main frequency of the receiving end equipment is higher than the preset main frequency threshold value, the sending end equipment can determine that the processing performance of the receiving end equipment is better, and at the moment, the sending end equipment can determine the FEC encoding parameter adjustment strategy to improve the algorithm complexity so as to improve the reliability of data transmission.

When the sending end device determines that the CPU dominant frequency of the receiving end device is lower than the preset threshold, the sending end device determines that the processing performance of the receiving end device is poor, and at the moment, the sending end device can determine that the FEC encoding parameter adjustment strategy is to reduce the algorithm complexity so as to avoid overlarge processing pressure of the receiving end device.

In this embodiment of the present application, when the FEC coding parameter adjustment policy determined by the sending end device is to improve the algorithm complexity, the sending end device may adjust the FEC algorithm currently used to the FEC algorithm with higher complexity.

If the FEC algorithm currently used by the sending end device is the FEC algorithm with the highest complexity, the sending end device may keep the FEC algorithm currently used unchanged.

Similarly, when the FEC coding parameter adjustment policy determined by the sending end device is to reduce the algorithm complexity, the sending end device may adjust the FEC algorithm currently used to the FEC algorithm with lower complexity.

If the FEC algorithm currently used by the sending end device is the FEC algorithm with the lowest complexity, the sending end device may keep the FEC algorithm currently used unchanged.

Further, in the embodiment of the present application, in consideration of the possible differences in the importance of different types of data, correspondingly, the reliability requirements of different types of data may also differ, and therefore, the FEC coding parameters used may be different for different types of data.

Accordingly, in an example, the determining the FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor may include:

and determining an FEC encoding parameter adjusting strategy according to the data type and the FEC parameter adjusting factors.

In this example, when the sending end device receives the FEC coding parameter adjustment factor sent by the receiving end device, the sending end device may determine the FEC coding parameter adjustment policy according to the data type of the data to be coded and the received FEC coding parameter adjustment factor.

Wherein, the adjustment strategy of the FEC coding parameters of different types of data can be different.

For example, priorities of data of different types of data types may be preset, and when the sending end device receives the FEC encoding parameter adjustment factor of the receiving end device, the sending end device may determine the priority of the data to be encoded according to the data type of the data to be encoded, determine the FEC encoding parameter adjustment policy according to the priority of the data to be encoded and the FEC parameter adjustment factor, and then adjust the FEC encoding parameter of the corresponding data to be encoded according to the determined FEC encoding parameter adjustment policy.

Preferably, the algorithm redundancy of the high priority data after FEC coding parameter adjustment is higher than that of the low priority data, or/and the algorithm complexity of the high priority data after FEC coding parameter adjustment is higher than that of the low priority data.

For example, taking video data as an example, when FEC encoding parameter adjustment is performed according to the determined FEC encoding parameter adjustment policy, the FEC encoding parameter of I frame data may be adjusted to a first FEC encoding parameter, and the FEC encoding parameter of P frame data may be adjusted to a second FEC encoding parameter;

the first FEC encoding parameters comprise first algorithm redundancy or/and first algorithm complexity, and the second FEC encoding parameters comprise second algorithm redundancy or/and second algorithm complexity; the first algorithm redundancy is higher than the second algorithm redundancy, or/and the first algorithm complexity is higher than the second algorithm complexity.

Specifically, assuming that the sending end device determines that the algorithm redundancy needs to be reduced according to the received FEC parameter adjustment factor, and the initial values of the algorithm redundancies of the I frame data and the P frame data are the same, when the sending end device performs FEC encoding parameter adjustment on the data to be encoded, the sending end device may reduce the algorithm redundancy of the I frame data by a first preset value, and reduce the algorithm redundancy of the P frame data by a second preset value, where the second preset value is greater than the first preset value; or, the sending end device may only reduce the algorithm redundancy of the P frame data, and keep the algorithm redundancy of the I frame data unchanged, so that the algorithm redundancy of the I frame data after FEC encoding parameter adjustment is higher than the algorithm redundancy of the P frame data.

Assuming that the sending end device determines that the algorithm complexity needs to be improved according to the received FEC parameter adjustment factor, and the algorithm complexity of the I frame data and the P frame data is the same initially, when the sending end device performs FEC encoding parameter adjustment on the data to be encoded, the algorithm type of the I frame data may be adjusted to a first algorithm type, and the algorithm type of the P frame data may be adjusted to a second algorithm type, where the algorithm complexity of the FEC algorithm of the first algorithm type is higher than that of the FEC algorithm of the second algorithm type; or, the sending end device may only adjust the algorithm type of the I frame data to an algorithm type with a higher algorithm complexity, and keep the algorithm type of the P frame data unchanged.

Referring to fig. 2, a schematic flow chart of a data transmission method provided in an embodiment of the present application is shown, where the data transmission method may be applied to a receiving end device, and as shown in fig. 2, the data transmission method may include the following steps:

and step S200, receiving the FEC encoding data sent by the sending end equipment.

In this embodiment of the present application, specific implementation of sending, by a sending end device, FEC encoded data to a receiving end device may refer to related description in the method flow shown in fig. 1, and this embodiment of the present application is not described herein again.

Step S210, determining an FEC parameter adjustment factor according to the received FEC encoded data.

In this embodiment, when receiving end equipment receives FEC encoded data sent by sending end equipment, it may determine an FEC parameter adjustment factor according to a data receiving condition.

The FEC parameter adjustment factors may include, but are not limited to, a packet loss rate, a recovery rate, and RTT.

In addition, it is considered that data encoded by different FEC encoding parameters may also have differences in device performance requirements of the receiving end device, and therefore, when the receiving end device determines the FEC parameter adjustment factor, the receiving end device may also consider its own device performance parameter, that is, the FEC parameter adjustment factor may also include the device performance parameter.

In an embodiment of the present application, the determining an FEC parameter adjustment factor according to received FEC encoded data may include:

and for any packet, counting the packet loss rate according to the algorithm redundancy carried in the FEC encoding data and the number of data packets in the packet.

In this embodiment, when the receiving end device receives the FEC encoded data sent by the sending end device, the number of original data packets and the number of redundant data packets in one packet may be determined according to the algorithm grouping information and the algorithm redundancy in the FEC encoded data.

When the receiving end device has received the FEC encoded data of a packet, it may determine whether the original data packet has a packet loss according to the number of the received original data packets and the determined number of the original data packets in the packet, and count a packet loss rate.

Further, in this embodiment, for any packet, when the receiving end device determines that there is a packet loss (that is, the packet loss rate is greater than 0), the receiving end device may recover the lost original data packet according to the algorithm type carried in the FEC encoded data and the received redundant data packet, and count the recovery rate.

Step S220, sending the FEC parameter adjustment factor to the sending end device, so that the sending end device performs FEEC encoding parameter adjustment according to the FEC parameter adjustment factor, and sending FEC encoded data to the receiving end device according to the adjusted FEC encoding parameter.

In this embodiment, when the receiving end device determines the FEC parameter adjustment factor, the determined FEC parameter adjustment factor may be sent to the sending end device.

The processing flow after the sending end device receives the FEC parameter adjustment factor may refer to the related description in the method flow shown in fig. 1, and details of the embodiment of the present application are not repeated here.

In order to enable those skilled in the art to better understand the technical solutions provided by the embodiments of the present application, the technical solutions provided by the embodiments of the present application are described below with reference to specific examples.

In this embodiment, it is considered that the sending end device needs to adjust the FEC encoding parameters according to the FEC parameter adjustment factor sent by the receiving end device, so that, in order to ensure that the receiving end device can timely obtain the FEC encoding parameters actually used by the sending end device, the sending end device may carry the FEC encoding data actually used by the sending end device when sending the FEC encoding data to the receiving end device.

Fig. 3 is a schematic diagram of a coding parameter block structure according to an embodiment of the present disclosure. In this embodiment, the sending end device may carry the actually used FEC encoding parameters through the encoding parameter block, and the sending end device may carry the encoding parameter block in a data packet to be sent (an original data packet or a redundant data packet).

As shown in fig. 3, the encoded parameter block may include a parameter block length field, an algorithm type field, an algorithm redundancy field, an algorithm grouping information field, and a Padding field. Wherein:

the parameter block length refers to the length of the coded parameter block data structure, which is used to distinguish from the coded data for easy extraction.

The algorithm type refers to a type of FEC algorithm actually used by the sending end device, and may include an XOR-FEC (exclusive or operation based FEC) algorithm, an RS-FEC (Reed-Solomon algorithm based FEC) algorithm, and other FEC algorithms.

The algorithm redundancy refers to the proportion of redundant data packets to original data packets in the data packets sent by the sending end.

The algorithm grouping information may include a group number (uniquely identifying a group, and the group numbers of the data packets of the same group are the same), the number of data packets in each group, the position of the current data packet within the group, and the size of the data packet.

The size of the coding parameter block structure is variable, Padding is filling and expanding the coding parameter block, and the size of the coding parameter block is adjusted by adjusting the size of a Padding field.

It should be noted that, in this embodiment, the number of data packets in each packet included in the algorithm packet information in the coding parameter block structure shown in fig. 3 may be the total number of original data packets + redundant data packets, the number of original data packets, or the number of redundant data packets.

And when the number of the data packets in the packet is the number of the original data packets or the number of the redundant data packets, and the algorithm redundancy determines the number of the redundant data packets or the number of the original data packets.

Referring to fig. 4, a schematic diagram of an RTP (Real-time Transport Protocol) Payload format provided in this embodiment of the present application is shown in fig. 4, in which an RTP Header and a Payload form a complete RTP packet, which is original data to be transmitted. The EX data block is a coding parameter block structure (the structure can be shown in fig. 3), and is combined with the RTP packet to form k (k is a positive integer) original data packets. The k original Data packets are encoded to obtain FEC Data (Data) of m encoded redundant Data packets (m is a positive integer), and an encoding parameter Data block EX and an RTP Header are added to the packets to form FEC packets (i.e., redundant Data packets). After the k + m data packets are sent to the receiving end equipment, the original data packets and the redundant data packets can be obtained through FEC decoding and unpacking.

Referring to fig. 5, a schematic flow chart of data transmission provided in this embodiment is shown in fig. 5, where in this embodiment, a sending end device performs FEC encoding on an RTP code stream to be sent (assuming that an FEC encoding algorithm used for the first time is an XOR-FEC algorithm).

Before FEC coding is carried out on an original RTP packet by sending end equipment, a coding parameter block can be added in the original RTP packet; after FEC encoding is performed on the original RTP packet to generate a redundant packet, the encoded parameter block and the RTP Header may be added according to the RTP load format shown in fig. 4, and the encoded RTP data packets (the original data packet + the redundant data packet) are sent to the receiving end device.

Receiving end equipment receives an RTP packet, firstly, coding parameter blocks in the RTP packet are extracted, and algorithm type, algorithm redundancy and algorithm grouping information are determined. After receiving an RTP packet of a packet, the receiving end device may determine whether there is a packet loss in the original data packet, if so, recover the packet using the redundant data packet and the corresponding FEC decoding algorithm, and count data receiving parameters such as a packet loss rate, a recovery rate, and an RTT.

The packet loss rate can be determined according to the ratio of the number of the received original data packets to the number of the original data packets; the recovery rate may be determined by a ratio of the number of times of data reception in which packet loss occurs and recovery is successful to the total number of times of data reception in which packet loss occurs.

After receiving the data sent by the sending end device, the receiving end device may feed back FEC parameter adjustment factors to the sending end device, where the FEC parameter adjustment factors may include data receiving parameters such as statistical packet loss rate, recovery rate, RTT, and device performance parameters such as CPU dominant frequency of the receiving end device.

After receiving the FEC parameter adjustment factor fed back by the receiving end device, the sending end device may determine an FEC parameter adjustment policy according to the FEC parameter adjustment factor, and adjust an actually used FEC encoding parameter, such as an FEC algorithm, an algorithm redundancy, and the like, according to the FEC parameter adjustment policy.

For example, when the sending end device determines that the packet loss rate of the receiving end device is higher than a preset packet loss rate threshold, the recovery rate is lower than a preset recovery rate threshold, the RTT is smaller than a preset time threshold, and the CPU master frequency is higher than a preset master frequency threshold, the sending end device may adjust the FEC algorithm from the XOR-FEC algorithm to the RS-FEC algorithm (increase algorithm complexity), and increase algorithm redundancy, and then, the sending end device may perform FEC encoding on data sent to the receiving end device according to the adjusted FEC encoding parameters.

It should be noted that, in this embodiment of the present application, the receiving end device may feed back the FEC parameter adjustment factor to the sending end device once every time data of one packet is received, or may receive data of multiple packets once.

For example, the receiving end device may adjust the feedback frequency according to the network condition, and when the network condition is good, the FEC parameter adjustment factor is fed back once every time data of one packet is received; when the network state is poor, data of a plurality of packets is received to be fed back once.

In addition, when the data sent by the sending end device to the receiving end device includes multiple different types of data, for example, I frames and P frames of video data, the sending end device may perform differentiated processing on the different types of data when performing FEC coding parameter adjustment.

For example, when the FEC coding parameter adjustment policy is to reduce algorithm redundancy, the sending end device may preferentially reduce algorithm redundancy of data with the lowest priority among the multiple different types of data. The priority of different types of data can be configured by a user according to a certain policy, for example, the priority is configured according to the importance of the data, and the higher the importance of the data is, the higher the priority is. For example, the priority of an I frame of video data is higher than the priority of a P frame.

When the FEC coding parameter adjustment policy is to improve the algorithm complexity, the sending end device may preferentially improve the algorithm complexity of the data with the highest priority among the multiple different types of data.

For example, taking video data as an example, assuming that the sending end device determines that algorithm redundancy needs to be reduced, the sending end device may only reduce algorithm redundancy of P frame data, or the sending end device may reduce algorithm redundancy of I frame data and P frame data, but the reduction amplitude of P frame data is larger.

For another example, still taking video data as an example, assuming that the sending end device determines that the algorithm complexity needs to be increased, the sending end device may only increase the algorithm complexity of I frame data.

In the embodiment of the application, the FEC coding data are sent to the receiving end device, the FEC parameter adjustment factor sent by the receiving end device is received, the FEC coding parameter is adjusted according to the received FEC parameter adjustment factor, and the FEC coding data are sent to the receiving end device according to the adjusted FEC coding parameter, so that the dynamic adjustment of the FEC coding parameter is realized, and the flexibility of the FEC coding parameter is improved.

The methods provided herein are described above. The following describes the apparatus provided in the present application:

referring to fig. 6, a schematic structural diagram of a data transmission apparatus provided in an embodiment of the present application is shown, where the data transmission apparatus may apply the sending end device in the foregoing method embodiment, and as shown in fig. 6, the data transmission apparatus may include:

a sending unit 610, configured to send forward error correction FEC encoded data to a receiving end device;

a receiving unit 620, configured to receive the FEC parameter adjustment factor sent by the receiving end device;

an adjusting unit 630, configured to perform FEC encoding parameter adjustment according to the FEC parameter adjustment factor;

the sending unit 610 is further configured to send FEC encoded data to the receiving end device according to the adjusted FEC encoding parameter.

In an optional implementation manner, the sending unit 610 is specifically configured to send, to the receiving end device, FEC encoded data carrying an encoded parameter block;

wherein the encoded parameter block comprises one or more of an algorithm type, an algorithm redundancy, and algorithm grouping information; the algorithm type is used for identifying the type of the FEC algorithm used by the sending end equipment; the algorithm redundancy is used for identifying the proportion of redundant data packets to original data packets in a group; the algorithm grouping information is used for identifying grouping information of the data packet.

In an alternative embodiment, each original packet and each redundant packet in a packet includes the encoded parameter block.

In an alternative embodiment, as shown in fig. 7, the apparatus further comprises:

a determining unit 640, configured to determine an FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor;

the adjusting unit 630 is specifically configured to perform FEC encoding parameter adjustment according to the FEC encoding parameter adjustment policy.

In an optional embodiment, the FEC parameter adjustment factor includes a data reception parameter or/and a device performance parameter; the FEC encoding parameter adjustment strategy comprises adjustment algorithm redundancy or/and adjustment algorithm complexity.

In an optional implementation manner, the determining unit 640 is specifically configured to determine that the FEC encoding parameter adjustment policy is to improve algorithm redundancy when the packet loss rate is higher than a preset packet loss rate threshold or/and the recovery rate is lower than a preset recovery rate threshold.

In an optional implementation manner, the determining unit 640 is specifically configured to determine that the FEC encoding parameter adjustment policy is to reduce algorithm redundancy when the round trip time RTT is greater than a preset time threshold.

In an optional implementation manner, the determining unit 640 is specifically configured to determine that the FEC coding parameter adjustment policy is to improve algorithm complexity when a central processing unit CPU dominant frequency is higher than a preset dominant frequency threshold;

and when the CPU main frequency is lower than a preset main frequency threshold, determining the FEC encoding parameter adjustment strategy to be the reduction of the algorithm complexity.

In an optional implementation manner, the determining unit 640 is specifically configured to determine an FEC encoding parameter adjustment policy according to a data type and the FEC parameter adjustment factor.

In an optional implementation manner, the determining unit 640 is specifically configured to determine the priority of the data to be encoded according to the data type of the data to be encoded; and determining an FEC encoding parameter adjusting strategy according to the priority of the data to be encoded and the FEC parameter adjusting factor.

In an alternative embodiment, the algorithm redundancy of the high-priority data after FEC coding parameter adjustment is higher than that of the low-priority data, or/and the algorithm complexity of the high-priority data after FEC coding parameter adjustment is higher than that of the low-priority data.

In an optional implementation manner, the adjusting unit 630 is specifically configured to adjust the FEC encoding parameter of the I frame data to be a first FEC encoding parameter, and adjust the FEC encoding parameter of the P frame data to be a second FEC encoding parameter;

wherein the first FEC encoding parameter comprises a first algorithm redundancy or/and a first algorithm complexity, and the second FEC encoding parameter comprises a second algorithm redundancy or/and a second algorithm complexity; the first algorithm redundancy is higher than the second algorithm redundancy, or/and the first algorithm complexity is higher than the second algorithm complexity.

Please refer to fig. 8, which is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure. The electronic device may include a processor 801, a communication interface 802, a memory 803, and a communication bus 804. The processor 801, the communication interface 802, and the memory 803 communicate with each other via a communication bus 804. Among them, the memory 803 stores a computer program; the processor 801 may execute the data transfer method described in the method flow shown in fig. 1 by executing a program stored in the memory 803.

The memory 803 referred to herein may be any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, and the like. For example, the memory 802 may be: RAM (random access memory), volatile memory, non-volatile memory, flash memory, a storage drive (e.g., a hard drive), a solid state drive, any type of storage disk (e.g., an optical disk, dvd, etc.), or similar storage medium, or a combination thereof.

The present embodiment also provides a machine-readable storage medium, such as the memory 803 in fig. 8, storing a computer program, which can be executed by the processor 801 in the electronic device shown in fig. 8 to implement the data transmission method described in the method flow shown in fig. 1.

Please refer to fig. 9, which is a schematic structural diagram of a data transmission apparatus according to an embodiment of the present application, wherein the data transmission apparatus may apply the receiving end device in the foregoing method embodiment, as shown in fig. 9, the data transmission apparatus may include:

a receiving unit 910, configured to receive forward error correction FEC encoded data sent by a sending end device;

a determining unit 920, configured to determine an FEC parameter adjustment factor according to the FEC encoded data;

a sending unit 930, configured to send the FEC parameter adjustment factor to the sending end device, so that the sending end device performs FEC coding parameter adjustment according to the FEC parameter adjustment factor, and sends FEC coding data to the receiving end device according to the adjusted FEC coding parameter.

In an optional implementation manner, the determining unit 920 is specifically configured to, for any packet, count a packet loss rate according to the algorithm redundancy carried in the FEC encoded data and the number of data packets in the packet.

In an optional implementation manner, the determining unit 920 is further specifically configured to, for any packet, when the packet loss rate is greater than 0, recover the lost original data packet according to the algorithm type carried in the FEC encoded data and the received redundant data packet, and count the recovery rate.

Fig. 10 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure. The electronic device may include a processor 1001, a communication interface 1002, a memory 1003, and a communication bus 1004. The processor 1001, the communication interface 1002, and the memory 1003 communicate with each other via a communication bus 1004. Wherein, the memory 1003 stores a computer program; the processor 1001 can execute the data transmission method described in the method flow shown in fig. 2 by executing the program stored in the memory 1003.

Memory 1003, as referred to herein, may be any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, and the like. For example, the memory 1002 may be: RAM (random access memory), volatile memory, non-volatile memory, flash memory, a storage drive (e.g., a hard drive), a solid state drive, any type of storage disk (e.g., an optical disk, dvd, etc.), or similar storage medium, or a combination thereof.

An embodiment of the present application further provides a machine-readable storage medium, such as the memory 1003 in fig. 10, storing a computer program, which can be executed by the processor 1001 in the electronic device shown in fig. 10 to implement the data transmission method described in the method flow shown in fig. 2.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims

1. A data transmission method is applied to sending end equipment, and is characterized in that the method comprises the following steps:

forward Error Correction (FEC) coded data are sent to receiving end equipment;

receiving FEC parameter adjustment factors sent by the receiving end equipment;

2. The method of claim 1, wherein the transmitting FEC encoded data to a receiving device comprises:

transmitting FEC encoding data carrying encoding parameter blocks to the receiving end equipment;

3. The method of claim 2 wherein each original packet and each redundant packet in a packet includes the encoded parameter block.

4. The method according to claim 1, wherein said FEC encoding parameter adjustment according to the FEC parameter adjustment factor comprises:

determining an FEC encoding parameter adjusting strategy according to the FEC parameter adjusting factors;

5. The method according to claim 4, wherein the FEC parameter adjustment factors comprise data reception parameters or/and device performance parameters; the data receiving parameters comprise packet loss rate, recovery rate or/and round trip time RTT; the FEC encoding parameter adjustment strategy comprises adjustment algorithm redundancy or/and adjustment algorithm complexity.

6. The method according to claim 5, wherein said determining a FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor comprises:

and when the packet loss rate is higher than a preset packet loss rate threshold or/and the recovery rate is lower than a preset recovery rate threshold, determining the FEC encoding parameter adjustment strategy as improving the algorithm redundancy.

7. The method according to claim 5, wherein said determining a FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor comprises:

and when the RTT is greater than a preset time threshold, determining the FEC encoding parameter adjustment strategy as reducing algorithm redundancy.

8. The method according to claim 5, wherein said determining a FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor comprises:

when the CPU main frequency is higher than a preset main frequency threshold, determining the FEC encoding parameter adjustment strategy to be the improvement of algorithm complexity;

9. The method according to claim 4, wherein said determining a FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor comprises:

10. The method according to claim 9, wherein said determining a FEC encoding parameter adjustment policy according to a data type and the FEC parameter adjustment factor comprises:

determining the priority of the data to be encoded according to the data type of the data to be encoded;

and determining an FEC encoding parameter adjusting strategy according to the priority of the data to be encoded and the FEC parameter adjusting factor.

11. The method according to claim 10, wherein the algorithm redundancy of the high priority data after FEC coding parameter adjustment is higher than the algorithm redundancy of the low priority data, or/and the algorithm complexity of the high priority data after FEC coding parameter adjustment is higher than the algorithm complexity of the low priority data.

12. The method according to claim 11, wherein said FEC encoding parameter adjustment according to the FEC encoding parameter adjustment policy comprises:

adjusting the FEC encoding parameter of the I frame data into a first FEC encoding parameter, and adjusting the FEC encoding parameter of the P frame data into a second FEC encoding parameter;

13. A data transmission method is applied to receiving end equipment, and is characterized in that the method comprises the following steps:

14. The method of claim 13, wherein determining an FEC parameter adjustment factor based on the FEC encoded data comprises:

15. The method of claim 14, wherein determining an FEC parameter adjustment factor based on the FEC encoded data further comprises:

and for any packet, when the packet loss rate is greater than 0, recovering the lost original data packet according to the algorithm type carried in the FEC encoding data and the received redundant data packet, and counting the recovery rate.

16. A data transmission device is applied to sending end equipment, and is characterized in that the device comprises:

17. The apparatus of claim 16,

the sending unit is specifically configured to send FEC encoded data carrying an encoded parameter block to the receiving end device;

18. The apparatus of claim 17 wherein each original packet and each redundant packet in a packet includes the encoded parameter block.

19. The apparatus of claim 17, further comprising:

a determining unit, configured to determine an FEC encoding parameter adjustment policy according to the FEC parameter adjustment factor;

the adjusting unit is specifically configured to perform FEC encoding parameter adjustment according to the FEC encoding parameter adjustment policy.

20. The apparatus according to claim 19, wherein the FEC parameter adjustment factor comprises a data reception parameter or/and a device performance parameter; the data receiving parameters comprise packet loss rate, recovery rate or/and round trip time RTT; the FEC encoding parameter adjustment strategy comprises adjustment algorithm redundancy or/and adjustment algorithm complexity.

21. The apparatus of claim 20,

the determining unit is specifically configured to determine that the FEC coding parameter adjustment policy is to improve algorithm redundancy when the packet loss rate is higher than a preset packet loss rate threshold or/and the recovery rate is lower than a preset recovery rate threshold.

22. The apparatus of claim 20,

the determining unit is specifically configured to determine that the FEC coding parameter adjustment policy is to reduce algorithm redundancy when the RTT is greater than a preset time threshold.

23. The apparatus of claim 20,

the determining unit is specifically configured to determine that the FEC coding parameter adjustment strategy is to improve algorithm complexity when the CPU master frequency is higher than a preset master frequency threshold;

24. The apparatus of claim 19,

the determining unit is specifically configured to determine an FEC encoding parameter adjustment policy according to a data type and the FEC parameter adjustment factor.

25. The apparatus of claim 24,

the determining unit is specifically configured to determine a priority of the data to be encoded according to a data type of the data to be encoded; and determining an FEC encoding parameter adjusting strategy according to the priority of the data to be encoded and the FEC parameter adjusting factor.

26. The apparatus according to claim 25, wherein the algorithm redundancy of the high priority data after FEC coding parameter adjustment is higher than the algorithm redundancy of the low priority data, or/and the algorithm complexity of the high priority data after FEC coding parameter adjustment is higher than the algorithm complexity of the low priority data.

27. The apparatus of claim 26,

the adjusting unit is specifically configured to adjust the FEC encoding parameter of the I frame data to a first FEC encoding parameter, and adjust the FEC encoding parameter of the P frame data to a second FEC encoding parameter;