WO2023160403A1

WO2023160403A1 - Data processing method and apparatus

Info

Publication number: WO2023160403A1
Application number: PCT/CN2023/075196
Authority: WO
Inventors: 马云飞; 郑智隆; 刘洪强
Original assignee: 阿里巴巴（中国）有限公司
Priority date: 2022-02-25
Filing date: 2023-02-09
Publication date: 2023-08-31
Also published as: CN116709423A

Abstract

Provided in the embodiments of the present description are a data processing method and apparatus. The data processing method comprises: determining a queue length of a data queue corresponding to an original data packet; when it is determined that the queue length is less than or equal to a queue length threshold value, sending, to a data receiving end, the original data packet in the data queue by means of a multipath transport mode; or when it is determined that the queue length is greater than the queue length threshold value, performing data coding on the original data packet in the data queue, so as to obtain a coded data packet; and sending the coded data packet to the data receiving end by means of the multipath transport mode. The method may be applied to a high-mobility multipath transport scenario, and low-latency and high-efficiency transport of data is realized by using a data packet sending and dynamic coding strategy based on a queue length.

Description

Data processing method and device

This application claims the priority of the Chinese patent application with the application number 202210182252.5 and the application title "data processing method and device" submitted to the China Patent Office on February 25, 2022, the entire contents of which are incorporated in this application by reference.

technical field

The embodiments of this specification relate to the technical field of computer networks, and in particular to a data processing method.

Background technique

In a traditional network transmission system, after the transmission path between two nodes is determined, all messages between the two nodes are transmitted along this path, so all traffic is concentrated on one path, which is easy Congestion occurs.

The method for solving the above problems in the prior art is to adopt multipath transport (Multipath Transport): communication data is transmitted on more than two physical paths at the same time. For example, use 4G and wifi to transmit video and files at the same time in mobile communication, or use multiple 4G or 5G modules to transmit data at the same time. However, the current multi-path transmission schemes all have the problems of high data transmission delay and low transmission efficiency when performing data transmission.

Contents of the invention

In view of this, the embodiment of this specification provides a data processing method. One or more embodiments of this specification also relate to a data processing device, a video transmission method and system, a computing device, a computer-readable storage medium, a computer program, and a self-driving vehicle to solve Technical defects existing in the prior art.

According to the first aspect of the embodiments of this specification, there is provided a data processing method applied to a data sending end, including:

Determine the queue length of the data queue corresponding to the original data packet, wherein the original data packet is a data packet waiting to be sent to the data receiving end;

When it is determined that the queue length is less than or equal to the queue length threshold, sending the original data packet in the data queue to the data receiving end through multipath transmission; or

When it is determined that the queue length is greater than the queue length threshold, data encoding is performed on the original data packets in the data queue to obtain encoded data packets;

and sending the coded data packet to the data receiving end through multipath transmission.

According to the second aspect of the embodiment of this specification, there is provided a data sending end, including:

A queue length determination module configured to determine the queue length of the data queue corresponding to the original data packet, wherein the original data packet is a data packet waiting to be sent to the data receiving end;

The original data packet sending module is configured to, when it is determined that the queue length is less than or equal to the queue length threshold, sending the original data packets in the data queue to the data receiving end through multipath transmission; or

An encoded data packet obtaining module configured to perform data encoding on the original data packets in the data queue to obtain encoded data packets when it is determined that the queue length is greater than the queue length threshold;

The coded data packet sending module is configured to send the coded data packet to the data receiving end through multi-path transmission.

According to a third aspect of the embodiments of this specification, a video transmission method is provided, including:

The video data sending end splits the video to be played into video frames, and packages the video frames into original video data packets and sends them to the data queue,

determining the queue length of the data queue corresponding to the original video data packet, wherein the original video data packet is a data packet waiting to be sent to the video data receiving end,

When it is determined that the queue length is less than or equal to the queue length threshold, sending the original video data packets in the data queue to the video data receiving end through multipath transmission, or

In the case of determining that the queue length is greater than the queue length threshold, data encoding is performed on the original video data packets in the data queue to obtain coded video data packets,

Send the encoded video data packet to the video data receiving end through multi-path transmission;

The video data receiving end performs video playback according to the received original video data packets and/or the encoded video data packets.

According to the fourth aspect of the embodiments of this specification, a video transmission system is provided, including a video data sending end and a video data receiving end, wherein:

The video data sending end splits the video to be played into video frames, and packs the video frames into original video data packets and sends them to the data queue,

According to a fifth aspect of the embodiments of this specification, a computing device is provided, including:

memory and processor;

The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the above-mentioned data processing method or video transmission method are realized.

According to a sixth aspect of the embodiments of the present specification, there is provided a computer-readable storage medium, which stores computer-executable instructions, and when the instructions are executed by a processor, the steps of the above-mentioned data processing method or video transmission method are implemented.

According to a seventh aspect of the embodiments of the present specification, there is provided a computer program, wherein, when the computer program is executed in a computer, it causes the computer to execute the steps of the above-mentioned data processing method or video transmission method.

According to an eighth aspect of the embodiments of the present specification, an autonomous vehicle is provided, and the autonomous vehicle includes the above-mentioned computing device, and/or the above-mentioned computer-readable storage medium.

An embodiment of this specification implements a data processing method, the method is applied to the data sending end, including determining the queue length of the data queue corresponding to the original data packet; when the queue length is determined to be less than or equal to the queue length threshold, the data The original data packets in the queue are sent to the data receiving end through multi-path transmission; or in the case of determining that the queue length is greater than the queue length threshold, data encoding is performed on the original data packets in the data queue to obtain encoded data Packet; send the encoded data packet to the data receiving end through multi-path transmission. The method can be applied to high-mobility multi-path transmission scenarios, and adopts data packet transmission based on queue length and a dynamic coding strategy to realize low-delay and high-efficiency data transmission.

Description of drawings

FIG. 1 is a schematic diagram of a specific application scenario of data packet loss and retransmission in a data processing method provided by an embodiment of this specification;

Fig. 2 is a flowchart of a data processing method provided by an embodiment of this specification;

Fig. 3 is a schematic structural diagram of a data processing device provided by an embodiment of this specification;

Fig. 4 is a flowchart of a video transmission method provided by an embodiment of this specification;

Fig. 5 is a schematic structural diagram of a video transmission system provided by an embodiment of this specification;

Fig. 6 is a structural block diagram of a computing device provided by an embodiment of this specification.

Detailed ways

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the specification. However, this specification can be implemented in many other ways different from those described here, and those skilled in the art can make similar extensions without violating the connotation of this specification, so this specification is not limited by the specific implementations disclosed below.

Terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only, and are not intended to limit one or more embodiments of this specification. As used in one or more embodiments of this specification and the appended claims, the singular forms "a", "the", and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and/or" used in one or more embodiments of the present specification refers to and includes any or all possible combinations of one or more associated listed items.

It should be understood that although the terms first, second, etc. may be used in one or more embodiments of this specification to describe each information, but such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, the first may also be referred to as the second, and similarly, the second may also be referred to as the first without departing from the scope of one or more embodiments of the present specification. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination."

First, terms and terms involved in one or more embodiments of this specification are explained.

Multipath Transport: Communication data is transmitted on more than two physical paths at the same time. For example, use 4G and wifi to transmit video and files at the same time in mobile communication, or use multiple 4G or 5G modules to transmit data at the same time.

Scheduler: The scheduler is a decision-making module in multi-path transmission. Its main function is to decide which path (path) a packet to be sent will be distributed from.

Scheduling: The process in which a scheduler assigns a data packet to a certain path/paths according to certain algorithms and rules is called scheduling.

QUIC transport protocol: an Internet transport layer protocol, which is a transport protocol located in user mode. Transmission delay, to better meet the challenges of the current transport layer and application layer.

Transmission path (Path): A path is a data path formed by all connections and routing nodes between two communication nodes. A path can be logically expressed as a quadruple composed of (source IP, destination IP, source port, destination port).

Quality of Experience (QoE): refers to the comprehensive subjective experience of users on the quality and performance (including effectiveness and availability) of equipment, networks and systems, applications or services, which is defined from the comfort of business applications. Through QoE scoring, operators can comprehensively evaluate users' video service quality and performance, and optimize the network.

High-speed wireless gateway (CPE): CPE is a device that converts high-speed 4G/5G signals into common WiFi signals for mobile terminals such as tablets, smartphones, and notebooks. It can support multiple terminals to access the Internet at the same time. place, it can be used by plugging in the power supply, no need to pull the network cable, and it is very convenient to use and carry. The AP function and router performance of the CPE are stronger, and it can be connected to dozens of mobile terminals such as tablets, smart phones, and notebooks at the same time. It has relatively complete user authentication function and billing function.

Random Linear Network Coding (RLNC): RLNC uses a random strategy to re-encode the intermediate nodes. The encoding process is a linear combination of multiple data messages. The intermediate nodes randomly select encoding coefficients from the finite field to input data during encoding. Encode and send the encoded data.

Tunneling: Tunneling is a method of passing data between networks by using the infrastructure of the Internet. The data (or payload) transmitted through the tunnel may be data frames or packets of different protocols. The tunneling protocol re-encapsulates the data frames or packets of these other protocols in new packet headers and sends them. The new header provides routing information so that the encapsulated payload data can be passed across the Internet.

The data processing method provided in the embodiment of this specification can be applied to the Internet of Vehicles scenario, but is not limited to this scenario, and can also be applied to other scenarios with large market orders, such as takeaway meal delivery scenarios. For ease of understanding, this description In the embodiments of the book, the data processing method is applied to the scene of the Internet of Vehicles for specific introduction.

In the Internet of Vehicles scenario, multi-path QUIC technology is generally used to provide high-performance aggregation tunnel services by using multiple wireless links. During the mobile process, it is necessary to provide a smooth connection experience with large bandwidth, low latency, and no stuttering. The data processing method provided by the embodiment of this specification can be understood as a multi-path aggregation scheme based on network coding, which can enable high-mobility multi-path transmission while maintaining low delay, large bandwidth, and good anti-packet loss capability.

In this specification, a data processing method is provided, and this specification also relates to a data processing device, a video transmission method and device, a computing device, a computer-readable storage medium, and an automatic driving vehicle, Each will be described in detail in the following examples.

Referring to FIG. 1 , FIG. 1 shows a schematic diagram of a specific application scenario of data packet retransmission in a data processing method according to an embodiment of the present specification.

FIG. 1 includes a data sending end 102, a transmission path 104 (BWE1-3), and a data receiving end 106.

During specific data transmission, the data packets flow into the data sending end 102 (i.e. the tunnel entrance), the tunnel program encodes and encapsulates the data packets 1-8, and then distributes the encoded and encapsulated data packets 1-8 to multiple transmission paths (Multipath transmission) 104 transmits; Data receiver 106 (being the other end of the tunnel) receives the data packets 1-8 that have been coded and encapsulated, and decodes the data packets 1-8 that have been coded and encapsulated, And the decoded data packets 1-8 are forwarded to the next hop (the next hop refers to the next hop selected by the router).

In the process of sending data packets, if the data sending end 102 determines that the data receiving end 106 has not received all the data packets sent by it, it can determine the original data packets lost in the data transmission process, such as data packets 2-6 Carry out retransmission coding to lost original data packet 2-6 again by the coding mode of RLNC, form the retransmission coding packet (as ΣP in Fig. 1), and the coding packet that forms after coding is carried out by a plurality of transmission paths 104 Retransmission; to overcome the problem of random continuous packet loss in high mobility scenarios.

Referring to FIG. 2 , FIG. 2 shows a flowchart of a data processing method according to an embodiment of the present specification, wherein the data processing method is applied to a data sending end, and specifically includes the following steps.

Step 202: Determine the queue length of the data queue corresponding to the original data packet, where the original data packet is a data packet waiting to be sent to the data receiving end.

Specifically, the data processing method provided by the embodiment of this specification can be applied to CPE equipment, and the CPE equipment includes multiple SIM (Subscriber Identity Module, subscriber identification card) card modules, zero or several Ethernet WAN (Wide Area Network , WAN) port, 0 or several Ethernet LAN (local area network, local area network) ports, support 0 or more WiFi frequency band access, and an operating system is installed.

Wherein, the original data packet may be any type of data packet, such as a video data packet, an audio data packet, or a file data packet.

During data transmission, the data sending end will place the original data packet to be sent in the data queue, and send it to the data receiving end through the data queue, where the data queue follows the first-in-first-out principle; therefore, the queue length of the data queue can be reasonably The solution is the length of the original data packet cached in the data queue; for example, when the data sender is sending the original data packet, if it is determined that there are 3 original data packets cached in the current data queue, then the length of the data queue corresponding to the original data packet can be determined The queue length is 3.

Step 204: When it is determined that the queue length is less than or equal to the queue length threshold, send the original data packets in the data queue to the data receiving end through multi-path transmission.

Wherein, the queue length threshold can be set according to the actual application, and the embodiment of this specification does not make any limitation on this; for example, in an actual application, when the queue length exceeds 8, it can be determined that there are too many original data packets cached in the data queue, It may cause a delay in sending the original data packet. At this time, the queue length threshold can be set to 7.

During specific implementation, the data sender will judge whether the queue length of the current data queue is less than or equal to the queue length threshold before sending an original data packet, and if so, send the original data packet in the data queue to the data receiver.

That is, when the data sender determines that the queue length of the current data queue is less than or equal to the queue length threshold, it can determine that the original data packets cached in the data queue have not yet caused accumulation, and generally will not cause transmission delay. At this time, pass The data queue only needs to send the original data packets to the data receiving end sequentially.

Step 206: When it is determined that the queue length is greater than the queue length threshold, perform data encoding on the original data packets in the data queue to obtain encoded data packets.

In practical applications, when the data sending end determines that the queue length of the current data queue is greater than the queue length threshold, it can be determined that the original data packets cached in the data queue may not cause accumulation, and subsequent data transmission may be delayed. At this point, data encoding can be performed on the original data packets in the data queue to obtain encoded data packets, and then data can be sent to the data receiving end by means of encoded data packets.

Step 208: Send the coded data packet to the data receiving end through multipath transmission.

In the case of obtaining the coded data packet, the coded data packet can be sent to the data receiving end through multi-path transmission.

In practical applications, in order to overcome the sudden interruption of any path and avoid the occurrence of random continuous packet loss in high mobility, the original data packets in the data queue can be encoded by random linear network coding; at the same time, in multi-path transmission Including multiple data transmission channels, and the number of currently available paths for each data transmission channel is limited, so in order to avoid the blockage of the data transmission channel during data transmission and affect other data transmissions, the original data in the data queue When packets are encoded, the number of encoded data packets can be determined according to the number of currently available paths in multipath transmission, so as to ensure that subsequent encoded data packets can reserve a part of the available paths for the data transmission channel of multipath transmission when sending other data. transmission. The specific implementation is as follows:

The data encoding of the original data packets in the data queue to obtain the encoded data packets includes:

determining the number of currently available paths in a multipath transmission;

Determine the number of codes according to the number of currently available paths;

Data coding is performed on the original data packets in the data queue by random linear network coding to obtain the same number of coded data packets as the coded data packets.

Wherein, the multipath transmission includes multiple data transmission channels, and each data transmission channel includes multiple paths. For example, a data transmission channel can transmit 100 data packets at the same time, then there are 50 data packets currently being transmitted, and then the number of remaining available paths is 50.

Specifically, the data sender first determines the number of all currently available paths of multiple data transmission channels in multi-path transmission, and then determines the number of encodings according to the number of currently available paths; and then performs random linear network coding on the original data packets in the data queue. Data encoding to get as many encoded packets as there are encoded.

In practical applications, when the number of codes is smaller than the number of currently available paths, data transmission congestion can be avoided. Therefore, after the number of currently available paths is determined, the determined number of codes can be smaller than the number of currently available paths.

Referring to Figure 1 of the above embodiment, Figure 1 includes three data transmission channels: BWE1, BWE2, and BWE3; if the number of currently available paths of BWE1 is 2, the number of currently available paths of BWE2 is 1, and the number of currently available paths of BWE3 is 1 ; Then the number of all currently available paths is 4, and at this time, it can be determined that the number of encodings is 3 or 2, etc.

In practical applications, in order to improve the transmission efficiency of the coded data packets, the data transmission may be performed by using a preset sending method. The specific implementation is as follows:

The sending the encoded data packet to the data receiving end through multipath transmission includes:

Selecting a corresponding target data transmission channel for the encoded data packet from the initial data transmission channels of multi-path transmission according to a preset transmission mode;

sending the encoded data packet to the data receiving end through the target data transmission channel.

Wherein, the preset transmission mode includes but not limited to min_rtt_scheduler (minimum delay scheduling) mode or polling mode.

Take the default sending mode as min_rtt_scheduler as an example to introduce.

During specific implementation, that is, each time a coded data packet is transmitted, the minimum delay initial data transmission channel is determined from the initial data transmission channel according to the sending mode of min_rtt_scheduler, and is transmitted as the target data transmission channel.

The polling transmission method is to determine a target data transmission channel for each encoded data packet through polling. For example, the initial data transmission channel includes 1-4, and there are available paths, and the encoded data packet is also 4, the first initial data transmission channel is transmitted as the target data transmission channel of the first encoded data packet, and the second initial data transmission channel is transmitted as the target data transmission channel of the second encoded data packet, By analogy, the third encoded data packet is transmitted through the third initial data transmission channel, and the fourth encoded data packet is transmitted through the fourth initial data transmission channel.

The data processing method provided by the embodiment of this specification is applied to the data sending end, including determining the queue length of the data queue corresponding to the original data packet; when the queue length is determined to be less than or equal to the queue length threshold, the The original data packet is sent to the data receiving end through multi-path transmission; or in the case of determining that the queue length is greater than the queue length threshold, data encoding is performed on the original data packet in the data queue to obtain the encoded data packet; The encoded data packet is sent to the data receiving end through multipath transmission. The method can be applied to high-mobility multi-path transmission scenarios, and adopts data packet transmission based on queue length and a dynamic coding strategy to realize low-delay and high-efficiency data transmission.

In addition, during the specific implementation, there will be packet loss in the process of data transmission. If the packet loss and retransmission are not performed in time, the data received by the data receiving end will be incomplete and cannot be correctly analyzed; therefore, in order to To avoid this situation, in the process of data transmission, the data sending end will timely base on the queue position of the original data packet sent in the data queue and the queue of the successfully received original data packet returned by the data receiving end. Position, etc., determine the queue length of the target queue, and then judge whether there is packet loss according to the queue length of the target queue, and retransmit the lost packet in time. The specific implementation is as follows:

After sending the original data packets in the data queue to the data receiving end through multi-path transmission, it also includes:

Determining the queue position of the unconfirmed original data packet in the data queue, wherein the unconfirmed original data packet is sent to the data receiving end but has not received the confirmation reception information of the data receiving end at the current moment the original data packet;

Determine the queue position of the original data packet at the tail of the queue at the current moment in the data queue;

Determine the queue length of the target queue according to the queue position of the unacknowledged original data packet and the queue position of the original data packet at the tail of the queue.

Referring to FIG. 1 of the above embodiment, 1-8 in FIG. 1 can be understood as 8 original data packets, and the numbers 1-8 can be understood as the queue position of each original data packet in the data queue.

If it is determined that the unconfirmed original data packets in the data queue are original data packets 3, original data packets 4, original data packets 5, and original data packets 6; then the queue positions of unconfirmed original data packets in the data queues are 3-6 . If the original data packet at the tail of the queue at the current moment in the data queue is original data packet 8, then the queue position of the original data packet at the tail of the queue at the current moment in the data queue is 8.

After determining the queue position of the unacknowledged original data packet and the queue position of the original data packet at the end of the team, it can be calculated according to the queue position of the unconfirmed original data packet and the queue position of the original data packet at the tail of the team. The queue length of the target queue; wherein, the target queue can be understood as a queue of lost original data packets.

In practical applications, the target queue represents: the earliest data packet that has not been acked (the confirmation message sent by the data receiving end to the data sending end to successfully receive the original data packet) at the current moment to the last original data packet that needs to be sent queue. Therefore, when determining the target queue, it is necessary to select the first target data packet from unacknowledged original data packets, and then accurately determine the target queue according to the queue position of the first target data packet and the queue position of the original data packet at the end of the queue the queue length. The specific implementation is as follows:

According to the queue position of the unacknowledged original data packet and the queue position of the original data packet at the end of the queue settings to determine the queue length of the target queue, including:

determining the queue position of the first target data packet among the unacknowledged original data packets, wherein the queue position of the first target data packet is smaller than the queue positions of other unconfirmed original data packets;

Determine the queue length of the target queue according to the queue position of the first target data packet and the queue position of the original data packet at the tail of the queue.

Following the above example, if the unconfirmed original data packets are original data packet 3, original data packet 4, original data packet 5, and original data packet 6, it can be determined that the queue position of original data packet 3 is smaller than that of original data Packet 5, original data packet 6, then the first target data packet in the unconfirmed original data packet is the original data packet 3, and it can be determined that the queue position of the first target data packet in the unconfirmed original data packet is 3.

Finally, according to the queue position 3 of the first target data packet and the queue position 8 of the original data packet at the end of the queue, the queue length of the target queue is determined to be 5.

In practical applications, the data processing method provided by the embodiment of this specification can be applied to the video scene of real-time video transmission. If a video data packet is not acked, in fact, the video frame corresponding to the video data packet cannot be decoded, because The decoding of the following video frames depends on the previous video frames, which means that the decoding of all video frames corresponding to the latest video data packets from the unacked video data packet will introduce delay. In order to avoid excessive delay, the data During the transmission process, when the queue length of the target queue exceeds a certain threshold, the retransmission encoding is enabled to ensure the correct and low-latency decoding of subsequent videos and improve the user's video viewing experience. The specific implementation is as follows:

After said determining the queue length of the target queue, it also includes:

When it is determined that the queue length of the target queue is greater than or equal to a preset length threshold, the lost original data packet is determined according to the queue position of the first target data packet and the queue position of the original data packet at the tail of the queue , wherein the sent original data packet is the original data packet sent to the data receiving end.

Wherein, the preset length threshold can be set according to actual applications, and is not limited in this embodiment of the specification. For example, the preset length threshold is 5, 6 and so on.

Still using the above example, if the queue length of the target queue is 5 and the preset length threshold is 5, it can be determined that the queue length of the target queue is equal to the preset length threshold. At this time, the queue position of the first target data packet and the The queue position of the original data packet at the end of the queue to determine the lost original data packet. The specific implementation is as follows:

The determining the lost original data packet according to the queue position of the first target data packet and the queue position of the original data packet at the end of the queue includes:

calculating the queue position of the first target data packet and the queue position of the original data packet at the end of the queue through preset calculation rules to obtain the number of lost original data packets;

According to the queue position of the first target data packet and the quantity of the lost original data packets, trace back to the original data packets at the tail of the queue to obtain the lost original data packets.

Among them, the preset calculation rule can be set according to the actual application, for example, the preset calculation rule is the original number of the queue tail Add 1 to the difference between the queue position of the data packet and the queue position of the first target data packet.

Still using the above example, if the queue position of the first target data packet is 3, and the queue position of the original data packet at the end of the queue is 8, according to the example of the above preset calculation rules, the calculated number of lost original data packets is 8-5+1=4.

After obtaining the number of lost original data packets, from the queue position 3 of the first target data packet, combined with the number of lost original data packets 4, trace back to the original data packets at the end of the queue to obtain the lost original data packets: original Packet 3, Packet 4, Packet 5, Packet 6. For example, referring to the above-mentioned embodiment, the original data packets in the window in FIG. 1 (that is, the original data packets 3-6 in the rectangular frame) are all lost original data packets.

In the embodiment of this specification, through the queue position of the first target data packet and the queue position of the original data packet at the end of the queue, combined with the preset calculation rules, the lost original data packet can be accurately obtained, and the subsequent coding method of the sliding window can be used , that is, the data packets (lost original data packets) participating in encoding all belong to a sliding window, and the retransmission of the lost original data packets is performed.

After determining the lost original data packet, whether to retransmit the lost original data packet is an important procedure that needs to be analyzed according to the lost original data packet to determine the specific data contained in the lost original data packet It is determined; only when it is determined that the lost original data packet is indeed the original data packet that needs to be retransmitted, it will be encoded and retransmitted. The specific implementation is as follows:

After the original data packet is determined to be lost, it also includes:

Analyzing the lost original data packet;

In the case of determining that the lost original data packet is an original data packet to be retransmitted according to the analysis result, encoding the lost original data packet to generate a retransmission encoded packet;

sending the retransmission coded packet to the data receiving end through the multipath transmission.

In practical applications, any analysis method can be used to analyze the lost original data packet to determine the content in the lost original data packet, and then determine the lost original data packet as the original data to be retransmitted according to the analysis result In the case of a packet (such as an original data packet whose data content is important and needs to be retransmitted), encode the lost original data packet to generate a retransmission encoded packet; send the retransmitted encoded packet to the data receiving end through multipath transmission .

In the embodiment of this specification, when determining whether the lost original data packet is the original data packet to be retransmitted, it needs to be determined in combination with the actual application scenario. For example, in the video transmission scenario, in order to ensure the integrity of the video, each All lost original data packets are coded and retransmitted; in the file transfer scenario, according to the importance level of the file, the lost original data packet containing a file with a higher level can be selected as the original data packet to be retransmitted for subsequent Encoded retransmission to save network overhead.

In practical applications, in order to prevent the current retransmission encoded packets from blocking the transmission of subsequent data packets, the number of retransmitted encoded packets can be determined according to the number of remaining available paths of the current data transmission channel, so as to ensure that the number of retransmitted encoded packets is less than that of the current data transmission The number of remaining available paths for the channel. The specific implementation is as follows:

The encoding of the lost original data packet to generate the retransmission encoded packet includes:

determining the number of currently available paths in said multipath transmission;

Data encoding is performed on the lost original data packets by random linear network coding to obtain retransmission encoded packets having the same number of encodings.

Specifically, the data sender first determines the number of all currently available paths of multiple data transmission channels in multi-path transmission, and then determines the number of encodings according to the number of currently available paths; then performs data encoding on the lost original data packets through random linear network coding , get the same number of retransmitted encoded packets as encoded.

In the embodiment of this specification, for each retransmission coded packet, only the data transmission channel resources released within the corresponding time can be used for transmission, so as to prevent the current retransmission coded packet from blocking the arrival of subsequent data and achieve redundancy under strong network Approaching 0, the redundancy rate in weak networks is limited to below the multiple of the path, and the rateless (no code rate) method is used for sending retransmission coded packets, considering the resources released by the path within a certain period of time (similar to the token bucket mechanism), Flexible sending of retransmission encoded packets overcomes the disadvantage of fixed overhead of traditional FEC encoding and prevents the problem of data accumulation in the case of insufficient path bandwidth.

In practical applications, in order to improve the retransmission efficiency of the retransmitted coded packets, a preset sending method may be used for data transmission. The specific implementation is as follows:

The sending the retransmission coded packet to the data receiving end through the multipath transmission method includes:

Selecting a corresponding target data transmission channel for the retransmission coded packet from the initial data transmission channel of the multi-path transmission according to the preset transmission mode;

sending the retransmission encoded packet to the data receiving end through the target data transmission channel.

Take the default sending mode as min_rtt_scheduler as an example to introduce.

During specific implementation, that is, each time a retransmission encoded packet is transmitted, the initial data transmission channel with the minimum delay is determined from the initial data transmission channel according to the sending mode of min_rtt_scheduler, and is transmitted as the target data transmission channel.

The polling sending method is to determine a target data transmission channel for each retransmission coded packet by polling. For example, the initial data transmission channel includes 1-4, and there are available paths, and the retransmission coded packet If there are also 4, the first initial data transmission channel is used as the target data transmission channel of the first retransmission coded packet, and the second initial data transmission channel is used as the target data transmission of the second retransmission coded packet channel for transmission, and so on, the third retransmission coded packet is transmitted through the third initial data transmission channel, and the fourth retransmission coded packet is transmitted through the fourth initial data transmission channel.

The data processing method provided by the embodiment of this specification proposes a random linear coding (System RLNC) network transmission method for tunneling, based on RLNC for forward data error correction of data, and overcomes the technical problem of high packet loss rate of wireless links ; At the same time, the use of RLNC's non-fixed code rate rateless and random properties increases the resistance to random and continuous packet loss in multi-path transmission; at the same time, a token bucket mode system RLNC code is proposed, and the original data is sent first in the encoding packets, and then send encoded data packets, the number of encoded data packets sent depends on the number of tokens, which is equivalent to the "budget" for encoding. The token increases with time, and the number of tokens decreases correspondingly every time an encoded packet is sent; and a sliding window encoding method is proposed, that is, the data packets participating in encoding belong to a sliding window, and a dynamic encoding based on queue length is proposed Strategy, when the length of the data queue in the CPE is less than a threshold, send the original data packet (do not send the encoded message), when the length of the data queue in the CPE is greater than a threshold, send the encoded data message, and the encoded data message is sent The number of is determined by the number of tokens.

Corresponding to the foregoing method embodiments, this specification also provides an embodiment of a data processing device. FIG. 3 shows a schematic structural diagram of a data processing device provided by an embodiment of this specification. As shown in Figure 3, the device is applied to the data sending end, including:

The queue length determination module 302 is configured to determine the queue length of the data queue corresponding to the original data packet, wherein the original data packet is a data packet waiting to be sent to the data receiving end;

The original data packet sending module 304 is configured to send the original data packet in the data queue to the data receiving end through multi-path transmission when it is determined that the queue length is less than or equal to the queue length threshold;

The encoded data packet obtaining module 306 is configured to perform data encoding on the original data packets in the data queue to obtain encoded data packets when it is determined that the queue length is greater than the queue length threshold;

The coded data packet sending module 308 is configured to send the coded data packet to the data receiving end through multi-path transmission.

Optionally, the encoded data packet obtaining module 306 is further configured to:

Optionally, after the device, it also includes:

A queue length determination module configured to:

Optionally, the queue length determination module is further configured to:

Optionally, the device also includes:

The packet loss determination module is configured to:

Optionally, the packet loss determining module is further configured to:

Optionally, the device also includes:

The packet loss retransmission module is configured as:

Analyzing the lost original data packet;

Optionally, the packet loss retransmission module is further configured to:

Carry out data encoding on the lost original data packet by random linear network coding, and obtain the number corresponding to the encoding The same retransmission encoded packets.

Optionally, the encoded data packet sending module 308 is further configured to:

Optionally, the packet loss retransmission module is further configured to:

The data processing device provided in the embodiment of this specification is applied to the data sending end, including determining the queue length of the data queue corresponding to the original data packet; when the queue length is determined to be less than or equal to the queue length threshold, the original The data packet is sent to the data receiving end through multi-path transmission; or in the case of determining that the queue length is greater than the queue length threshold, data encoding is performed on the original data packet in the data queue to obtain an encoded data packet; The data packet is sent to the data receiving end through multi-path transmission. The method can be applied to high-mobility multi-path transmission scenarios, and adopts data packet transmission based on queue length and a dynamic coding strategy to realize low-delay and high-efficiency data transmission.

The foregoing is a schematic solution of a data processing device in this embodiment. It should be noted that the technical solution of the data processing device and the technical solution of the above-mentioned data processing method belong to the same concept, and details of the technical solution of the data processing device that are not described in detail can be found in the description of the technical solution of the above-mentioned data processing method .

Referring to FIG. 4, FIG. 4 shows a flow chart of a video transmission method provided according to an embodiment of this specification, which specifically includes the following steps:

Step 402: The video data sending end splits the video to be played into video frames, packs the video frames into original video data packets and sends them to the data queue, and determines the queue of the data queue corresponding to the original video data packets length, wherein the original video data packet is a data packet waiting to be sent to the video data receiving end, and when it is determined that the queue length is less than or equal to the queue length threshold, the original video data packet in the data queue Send to the video data receiving end through multi-path transmission, or in the case of determining that the queue length is greater than the queue length threshold, perform data encoding on the original video data packets in the data queue to obtain the encoded video A data packet, sending the coded video data packet to the video data receiving end through multi-path transmission.

Specifically, the video transmission method provided by the embodiment of this specification can be applied to CPE equipment. In actual use, the CPE equipment is installed in the vehicle, and is used to transfer the video data of the 4G/5G signal to the CPE equipment during the high-speed movement of the vehicle. The data is converted into video data based on the WIFI signal and sent to the terminal for video playback. In a feasible scenario, the CPE device can also be used as the on-board device of the vehicle, and communicate with the vehicle's video playback on-board device through wireless communication technology to form a car networking system (of course, in practical applications, the car networking system does not It is not necessarily necessary to use CPE equipment to interconnect with other vehicle-mounted equipment to realize signal conversion, and other signal conversion equipment can also be used. This manual The embodiment is not limited in any way here); thereby realizing the conversion of video data based on 4G/5G signals received from the information network platform into video data of WIFI signals, and also supporting multiple other mobile terminals surfing the Internet at the same time. In this way, the efficiency of video playback during high-speed vehicle movement is improved, and the user's video viewing experience is improved.

Among them, the video data sending end can be understood as the video data sending end of the CPE equipment; the video data receiving end can be understood as any type of video receiving terminal (such as mobile phone, tablet computer, vehicle terminal, etc.); After the video data of the 4G/5G signal, it is converted into the video data of the WIFI signal, and then the converted video data is split into video frames, and after being packaged into original video data packets, the video data transmission according to the embodiment of this specification The method is sent to the video receiving terminal, so that the user can watch the video smoothly and without stuttering through the video receiving terminal during high-speed movement.

During specific implementation, the video data sending end of the CPE device splits the transcoded video to be played into video frames, and packs the video frames into original video data packets and sends them to the data queue; in the process of sending the original video data packets In , the video sender will obtain the queue length of the data queue in real time. When it is determined that the queue length is less than or equal to the queue length threshold, it can be considered that the original video data packets in the data queue have not accumulated. The original video data packets in the data queue are sent to the video data receiving end through multi-path transmission, and the video data receiving end can directly split and play the original video data packets after receiving the original video data packets.

And in the case of determining that the queue length is greater than the queue length threshold, it can be considered that there are many original video data packets in the data queue, and data packets may accumulate. Low problem, the video data sending end can encode the original video data packets in the data queue to obtain the encoded video data packets, and then send the encoded video data packets to the video data receiving end through multi-path transmission, and the video data receiving The terminal receives the encoded video data packet to decode, then split and play. Thereby improving data transmission efficiency and ensuring low-latency and smooth video playback.

Step 402: The video data receiver performs video playback according to the received original video data packet and/or the encoded video data packet.

Specifically, when the video data receiving end receives the original video data packet sent by the video sending end, it can directly unpack to obtain the video frame for video playback, and in the case of obtaining the encoded video data packet, first encode the The video data packets are decoded and unpacked to obtain video frames for video playback.

In practical applications, in order to ensure the transmission efficiency and low delay of video data, the video data sender will monitor the queue length of the data queue in real time, and when the queue length of the data queue is less than or equal to the queue length threshold, send the video data to the video data receiver. The original video data packet, and when the queue length of the data queue is greater than the queue length threshold, the encoded video data packet is sent to the video data receiving end, and the transcoded video data according to the WIFI signal is sent to the terminal through this dynamic adjustment strategy Implement video playback.

In addition, when encoding the original video data packets, in order to avoid packet loss and avoid congestion of other transmission data, the original video data packets can be encoded by random linear network coding, and transmitted through multipath The number of currently available paths in the middle, and limit the number of encodings. The specific implementation is as follows:

The data encoding of the original video data packets in the data queue to obtain the encoded video data packets includes:

Data encoding is performed on the original video data packets in the data queue by random linear network coding to obtain the same number of encoded video data packets as the encoding number.

During specific implementation, data encoding is performed on the original video data packets in the data queue to obtain encoded video data packets. Refer to the introduction of the above-mentioned embodiments, and details are not repeated here.

The video transmission method provided in the embodiment of this specification can be applied to any high-speed moving vehicle equipped with CPE equipment, such as logistics vehicles, public service vehicles, medical service vehicles, terminal service vehicles, etc., and is not limited to CPE equipment, any In a vehicle moving at high speed, any device that can implement data transmission can be used. The embodiment of this specification only uses the CPE device as an example for illustration, but does not make any limitation.

Referring to FIG. 5 , FIG. 5 shows a schematic structural diagram of a video transmission system provided according to an embodiment of the present specification.

Specifically, a video transmission system includes a video data sending end 502 of a CPE device, and a video data receiving end 504 connected to the CPE device, wherein,

The video data sending end 502 splits the video to be played into video frames, and packs the video frames into original video data packets and sends them to the data queue,

The video data receiving end 504 performs video playback according to the received original video data packets and/or the encoded video data packets.

The video transmission system provided in the embodiment of this specification includes a video data sending end 502 of a CPE device, and a video data receiving end 504 connected to the CPE device; in a specific application, the video transmission system is applied to a high-mobility multi-path transmission scenario, The transmission of dynamic video data packets based on queue length and dynamic coding strategy are adopted to realize low-latency and high-efficiency transmission of video data.

FIG. 6 shows a structural block diagram of a computing device 600 provided according to an embodiment of this specification. Components of the computing device 600 include, but are not limited to, memory 610 and processor 620 . The processor 620 is connected to the memory 610 through the bus 630, and the database 650 is used for saving data.

Computing device 600 also includes an access device 640 that enables computing device 600 to communicate via one or more networks 660 . Examples of these networks include the Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or a combination of communication networks such as the Internet. Access device 640 may include one or more of any type of network interface (e.g., a network interface card (NIC)), wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, Worldwide Interoperability for Microwave Access ( Wi-MAX) interface, Ethernet interface, Universal Serial Bus (USB) interface, cellular network interface, Bluetooth interface, Near Field Communication (NFC) interface, etc.

In an embodiment of the present specification, the above-mentioned components of the computing device 600 and other components not shown in FIG. 6 may also be connected to each other, for example, through a bus. It should be understood that the structural block diagram of the computing device shown in FIG. 6 is only for the purpose of illustration, rather than limiting the scope of this description. Those skilled in the art can add or replace other components as needed.

Computing device 600 may be any type of stationary or mobile computing device, including mobile computers or mobile computing devices (e.g., tablet computers, personal digital assistants, laptop computers, notebook computers, netbooks, etc.), mobile telephones (e.g., smartphones), ), wearable computing devices (eg, smart watches, smart glasses, etc.), or other types of mobile devices, or stationary computing devices such as desktop computers or PCs. Computing device 600 may also be a mobile or stationary server.

Wherein, the processor 620 is configured to execute the following computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the above-mentioned data processing method or video transmission method are implemented.

The foregoing is a schematic solution of a computing device in this embodiment. It should be noted that the technical solution of the computing device and the above-mentioned technical solution of the data processing method or the video transmission method belong to the same concept, and details not described in detail in the technical solution of the computing device can be found in the above-mentioned data processing method or video transmission method. Description of the technical solution of the method.

An embodiment of the present specification also provides a computer-readable storage medium, which stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the steps of the above-mentioned data processing method or video transmission method are implemented.

The foregoing is a schematic solution of a computer-readable storage medium in this embodiment. It should be noted that the technical solution of the storage medium belongs to the same idea as the above-mentioned technical solution of the data processing method or the video transmission method, and details not described in detail in the technical solution of the storage medium can be referred to above Description of the technical solution of the method.

An embodiment of the present specification further provides a computer program, wherein, when the computer program is executed in a computer, the computer is caused to execute the steps of the above-mentioned data processing method or video transmission method.

The foregoing is a schematic solution of a computer program in this embodiment. It should be noted that the technical solution of the computer program belongs to the same idea as the technical solution of the above-mentioned data processing method or video transmission method. For details not described in detail in the technical solution of the computer program, please refer to Description of the technical solution of the method.

The foregoing describes specific embodiments of this specification. Other implementations are within the scope of the following claims. exist In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. Multitasking and parallel processing are also possible or may be advantageous in certain embodiments.

The computer instructions include computer program code, which may be in source code form, object code form, executable file or some intermediate form or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, computer-readable media Excludes electrical carrier signals and telecommunication signals.

It should be noted that, for the sake of simplicity of description, the aforementioned method embodiments are expressed as a series of action combinations, but those skilled in the art should know that the embodiments of this specification are not limited by the described action sequences. Because according to the embodiment of the present specification, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the embodiments of the specification.

In the above-mentioned embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

The preferred embodiments of the present specification disclosed above are only for helping to explain the present specification. Alternative embodiments are not exhaustive in all detail, nor are the inventions limited to specific implementations described. Obviously, many modifications and changes can be made according to the contents of the embodiments of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the embodiments of this specification, so that those skilled in the art can well understand and use this specification. This specification is to be limited only by the claims, along with their full scope and equivalents.

Claims

A data processing method applied to a data sending end, comprising:

Determine the queue length of the data queue corresponding to the original data packet, wherein the original data packet is a data packet waiting to be sent to the data receiving end;

When it is determined that the queue length is less than or equal to the queue length threshold, sending the original data packet in the data queue to the data receiving end through multipath transmission; or

When it is determined that the queue length is greater than the queue length threshold, data encoding is performed on the original data packets in the data queue to obtain encoded data packets;

and sending the coded data packet to the data receiving end through multipath transmission.
The data processing method according to claim 1, said performing data encoding on the original data packets in said data queue to obtain encoded data packets, comprising:

determining the number of currently available paths in a multipath transmission;

Determine the number of codes according to the number of currently available paths;

Data coding is performed on the original data packets in the data queue by random linear network coding to obtain the same number of coded data packets as the coded data packets.
The data processing method according to claim 1, after sending the original data packets in the data queue to the data receiving end through multi-path transmission, further comprising:

Determining the queue position of the unconfirmed original data packet in the data queue, wherein the unconfirmed original data packet is sent to the data receiving end but has not received the confirmation reception information of the data receiving end at the current moment the original data packet;

Determine the queue position of the original data packet at the tail of the queue at the current moment in the data queue;

Determine the queue length of the target queue according to the queue position of the unacknowledged original data packet and the queue position of the original data packet at the tail of the queue.
The data processing method according to claim 3, determining the queue length of the target queue according to the queue position of the unconfirmed original data packet and the queue position of the original data packet at the tail of the queue, comprising:

determining the queue position of the first target data packet among the unacknowledged original data packets, wherein the queue position of the first target data packet is smaller than the queue positions of other unconfirmed original data packets;

Determine the queue length of the target queue according to the queue position of the first target data packet and the queue position of the original data packet at the tail of the queue.
The data processing method according to claim 4, after said determining the queue length of the target queue, further comprising:

When it is determined that the queue length of the target queue is greater than or equal to a preset length threshold, the lost original data packet is determined according to the queue position of the first target data packet and the queue position of the original data packet at the tail of the queue ,That In, the sent original data packet is the original data packet sent to the data receiving end.
The data processing method according to claim 5, said determining the lost original data packet according to the queue position of the first target data packet and the queue position of the original data packet at the tail of the team, comprising:

calculating the queue position of the first target data packet and the queue position of the original data packet at the end of the queue through preset calculation rules to obtain the number of lost original data packets;

According to the queue position of the first target data packet and the quantity of the lost original data packets, trace back to the original data packets at the tail of the queue to obtain the lost original data packets.
The data processing method according to claim 5, after said determining the lost original data packet, further comprising:

Analyzing the lost original data packet;

In the case of determining that the lost original data packet is an original data packet to be retransmitted according to the analysis result, encoding the lost original data packet to generate a retransmission encoded packet;

sending the retransmission coded packet to the data receiving end through the multipath transmission.
The data processing method according to claim 7, said encoding said lost original data packet to generate said retransmission encoded packet, comprising:

determining the number of currently available paths in said multipath transmission;

Determine the number of codes according to the number of currently available paths;

Data encoding is performed on the lost original data packets by random linear network coding to obtain retransmission encoded packets having the same number of encodings.
A data processing device applied to a data sending end, comprising:

A queue length determination module configured to determine the queue length of the data queue corresponding to the original data packet, wherein the original data packet is a data packet waiting to be sent to the data receiving end;

The original data packet sending module is configured to send the original data packet in the data queue to the data receiving end through multi-path transmission when it is determined that the queue length is less than or equal to the queue length threshold; or

An encoded data packet obtaining module configured to perform data encoding on the original data packets in the data queue to obtain encoded data packets when it is determined that the queue length is greater than the queue length threshold;

The coded data packet sending module is configured to send the coded data packet to the data receiving end through multi-path transmission.
A video transmission method, comprising:

The video data sending end splits the video to be played into video frames, and packages the video frames into original video data packets and sends them to the data queue,

determining the queue length of the data queue corresponding to the original video data packet, wherein the original video data packet is a data packet waiting to be sent to the video data receiving end,

When it is determined that the queue length is less than or equal to the queue length threshold, sending the original video data packets in the data queue to the video data receiving end through multipath transmission, or

In the case of determining that the queue length is greater than the queue length threshold, data encoding is performed on the original video data packets in the data queue to obtain coded video data packets,

Sending the encoded video data packet to the video data receiving end through multipath transmission;

The video data receiving end performs video playback according to the received original video data packets and/or the encoded video data packets.
The video transmission method according to claim 10, said performing data encoding on the original video data packets in said data queue to obtain encoded video data packets, comprising:

determining the number of currently available paths in a multipath transmission;

Determine the number of codes according to the number of currently available paths;

Data encoding is performed on the original video data packets in the data queue by random linear network coding to obtain the same number of encoded video data packets as the encoding number.
A computing device comprising:

memory and processor;

The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the data processing method described in any one of claims 1 to 8 are implemented. Or the steps of any one video transmission method of claims 10-11.
A computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed by a processor, the steps of the data processing method described in any one of claims 1 to 8 or any one of claims 10-11 are implemented. The steps of the item video transmission method.
An autonomous vehicle comprising the computing device of claim 12, and/or the computer-readable storage medium of claim 13.