CN112995055A - Efficient data packet transmission method and system - Google Patents
Efficient data packet transmission method and system Download PDFInfo
- Publication number
- CN112995055A CN112995055A CN202110181053.8A CN202110181053A CN112995055A CN 112995055 A CN112995055 A CN 112995055A CN 202110181053 A CN202110181053 A CN 202110181053A CN 112995055 A CN112995055 A CN 112995055A
- Authority
- CN
- China
- Prior art keywords
- data
- packet
- transmission
- compression
- original data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 185
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000007906 compression Methods 0.000 claims abstract description 158
- 230000006835 compression Effects 0.000 claims abstract description 151
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 42
- 230000006837 decompression Effects 0.000 claims abstract description 30
- 238000011156 evaluation Methods 0.000 claims description 19
- 238000001514 detection method Methods 0.000 claims description 9
- 238000004806 packaging method and process Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/38—Flow control; Congestion control by adapting coding or compression rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
Abstract
The embodiment of the invention relates to the technical field of data transmission, and discloses a method and a system for efficiently transmitting a data packet, wherein the method comprises the following steps: acquiring original data and a transmission protocol of current data transmission; analyzing the data characteristics of the original data, and calculating and estimating transmission delay based on the data characteristics and a transmission protocol; if the estimated transmission delay exceeds the preset delay upper limit, compressing the original data based on the data characteristics to obtain a bag body; processing a transmission protocol and data characteristics to obtain a packet header; and encapsulating the packet head and the packet body to obtain a data packet and transmitting the data packet. The embodiment of the invention can analyze and evaluate the original data in the data transmission process, and the original data occupying a large amount of time in the compression process is not compressed, and is directly packaged and transmitted, so that the transmission time is saved; and for the original data needing to be compressed, a compression algorithm matched with the data type is selected to shorten the compression/decompression time of the original data, so that the efficient transmission of the data packet is realized.
Description
Technical Field
The invention relates to the technical field of data transmission, in particular to a method and a system for efficiently transmitting data packets.
Background
When data transmission is performed, in order to ensure a transmission rate and avoid an excessive data volume from blocking a transmission channel, data is often compressed on local equipment based on a data transmission protocol, the data is packed into a data packet which has a small volume and contains a receiving and sending address and compressed data, the data packet is uploaded to the transmission channel for transmission, and a receiving party decompresses the data packet to obtain original data. The transmission mode accelerates the transmission rate and also increases the safety of the transmission process, thereby being widely applied to the field of data transmission.
When communication with higher requirement on transmission delay is carried out, the bandwidth of a transmission channel is generally designed to exceed the standard, and under the condition, the volume of a data packet basically does not influence the transmission time, but the compression process of the data packet occupies most of the transmission time; the compression and decompression algorithms applicable to different data types are different, and when a certain specific compression algorithm is adopted for data packet compression, the problems that the compression rate is difficult to guarantee, the time consumption is long and the like exist.
Disclosure of Invention
The embodiment of the invention discloses a method and a system for efficiently transmitting data packets, which can analyze and evaluate original data in the data transmission process, do not compress the original data occupying a large amount of time in the compression process, directly package and transmit the original data, and save the transmission time; and for the original data needing to be compressed, a compression algorithm matched with the data type is selected to shorten the compression/decompression time of the original data, so that the efficient transmission of the data packet is realized.
The first aspect of the embodiments of the present invention discloses a method for efficiently transmitting a data packet, where the method includes:
acquiring original data and a transmission protocol of current data transmission;
analyzing data characteristics of the original data, wherein the data characteristics refer to data types contained in the original data and data capacity corresponding to each data type;
calculating estimated transmission delay based on the data characteristics and the transmission protocol;
if the estimated transmission delay exceeds the preset delay upper limit, compressing the original data based on the data characteristics to obtain a bag body;
processing the transmission protocol and the data characteristics to obtain a packet header;
and encapsulating the packet header and the packet body to obtain a data packet and transmitting the data packet.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, if the transmission delay is not greater than the preset delay upper limit, the method further includes:
packaging the original data to obtain a bag body;
executing the processing of the transmission protocol and the data characteristics to obtain a packet header; and encapsulating the packet header and the packet body to obtain a data packet and transmitting the data packet.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, if the transmission delay exceeds a preset delay upper limit, the compressing the original data based on the data feature to obtain a packet body includes:
obtaining a compression weight corresponding to each data type according to the data capacity analysis;
estimating and obtaining the estimated compression duration corresponding to each compression algorithm based on the compression weight and the data capacity;
and selecting a compression algorithm with the shortest estimated compression time to compress the original data to obtain the bag body.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the encapsulating the packet header and the body, and obtaining a data packet and transmitting the data packet, the method further includes:
detecting whether a compression mark exists in the packet header, wherein the compression mark records a compression algorithm adopted by the current data packet;
if the packet body exists, decompressing the packet body according to the compression algorithm recorded by the compression mark to obtain the original data;
if the original data do not exist, extracting the original data from the bag body;
and receiving the original data to finish data packet transmission.
As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:
recording the transmission record of each data packet, wherein the transmission record comprises the estimated transmission delay, the compression ratio, the compression time length, the transmission time length and the decompression time length;
calculating to obtain the total processing time length based on the compression time length, the transmission time length and the decompression time length of each data packet;
comparing the total processing time length with the estimated transmission time delay;
if an overtime data packet with the total processing time length exceeding the estimated transmission time delay exists, outputting an evaluation error signal corresponding to the overtime data packet;
and updating the evaluation method based on the compression ratio of the overtime data packet and the data characteristics of the original data in the overtime data packet.
A second aspect of the embodiments of the present invention discloses a system for efficiently transmitting a data packet, where the system for efficiently transmitting a data packet includes:
the acquisition unit is used for acquiring the original data and the transmission protocol of the current data transmission;
the characteristic analysis unit is used for analyzing data characteristics of the original data, wherein the data characteristics refer to data types contained in the original data and data capacity corresponding to each data type;
a delay evaluating unit, configured to calculate an estimated transmission delay based on the data characteristics and the transmission protocol;
the bag body processing unit is used for compressing the original data based on the data characteristics to obtain a bag body when the estimated transmission time delay exceeds a preset time delay upper limit;
the packet header processing unit is used for processing the transmission protocol and the data characteristics to obtain a packet header;
and the packaging unit is used for packaging the packet head and the packet body to obtain a data packet and transmitting the data packet.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the bag body processing unit is further configured to encapsulate the original data to obtain the bag body when the transmission delay is evaluated to be not greater than the preset upper delay limit.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the bag body processing unit includes:
the weight determining subunit is used for obtaining a compression weight corresponding to each data type according to the data capacity analysis;
the time length evaluation subunit is used for evaluating and obtaining the estimated compression time length corresponding to each compression algorithm based on the compression weight and the data capacity;
and the bag body processing subunit is used for selecting a compression algorithm with the shortest estimated compression time to compress the original data to obtain the bag body.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the system further includes:
the compression detection unit is used for detecting whether a compression mark exists in the packet header after the packet header and the packet body are packaged by the packaging unit to obtain a data packet and the data packet is transmitted, and the compression mark records a compression algorithm adopted by the current data packet;
the decompression unit is used for decompressing the bag body according to a compression algorithm recorded by the compression mark to obtain the original data when the compression detection unit detects that the compression mark exists in the packet header;
the decompression unit is further configured to extract the original data from the packet body when the compression detection unit detects that the packet header does not have the compression flag;
and the receiving unit is used for receiving the original data and finishing data packet transmission.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the system further includes:
the recording unit is used for recording the transmission record of each data packet, and the transmission record comprises the estimated transmission time delay, the compression ratio, the compression time length, the transmission time length and the decompression time length;
the time length calculating unit is used for calculating the total processing time length based on the compression time length, the transmission time length and the decompression time length of each data packet;
a comparison unit, configured to compare the total processing duration with the estimated transmission delay;
an error reporting unit, configured to output an evaluation error signal corresponding to the timeout data packet when the timeout data packet exists, where the total processing duration exceeds the estimated transmission delay;
and the updating unit is used for updating the evaluation method based on the compression ratio of the overtime data packet and the data characteristics of the original data in the overtime data packet.
A third aspect of the embodiments of the present invention discloses a system for efficiently transmitting data packets, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the efficient data packet transmission method disclosed by the first aspect of the embodiment of the invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium, which stores a computer program, where the computer program enables a computer to execute the method for efficiently transmitting a data packet disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.
A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where the computer program product is configured to, when running on a computer, cause the computer to perform part or all of the steps of any one of the methods in the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the original data can be analyzed and evaluated in the data transmission process, the original data occupying a large amount of time in the compression process is not compressed, and the original data is directly packaged and transmitted, so that the transmission time is saved; and for the original data needing to be compressed, a compression algorithm matched with the data type is selected to shorten the compression/decompression time of the original data, so that the efficient transmission of the data packet is realized.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for efficiently transmitting a data packet according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an efficient data packet transmission system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of another efficient packet transmission system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first", "second", "third", "fourth", and the like in the description and the claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a method and a system for efficiently transmitting data packets, which can analyze and evaluate original data in the data transmission process, do not compress the original data occupying a large amount of time in the compression process, directly package and transmit the original data, and save the transmission time; and for the original data needing to be compressed, a compression algorithm matched with the data type is selected to shorten the compression/decompression time of the original data, so that the efficient transmission of the data packet is realized. The following detailed description is made with reference to the accompanying drawings.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a method for efficiently transmitting a data packet according to an embodiment of the present invention. As shown in fig. 1, the method for efficiently transmitting data packets may include the following steps.
101. And acquiring the original data and the transmission protocol of the current data transmission.
In the embodiment of the invention, the received original data and the transmission protocol are obtained, wherein the transmission protocol comprises information necessary for the data transmission process such as a receiving address.
102. The data characteristics of the raw data are analyzed.
In the embodiment of the present invention, the data characteristics refer to data types included in the original data and data volumes corresponding to each data type.
103. And calculating the estimated transmission delay based on the data characteristics and the transmission protocol.
In the embodiment of the invention, the estimated transmission time delay which does not compress the original data and directly performs encapsulation transmission is estimated according to the transmission protocol and the data characteristics of the original data. If the estimated transmission delay exceeds the preset delay upper limit, executing step 104; if the estimated transmission delay does not exceed the preset delay upper limit, the original data is directly packaged to obtain a bag body, and the step 105 is executed.
104. And compressing the original data based on the data characteristics to obtain the bag body.
In the embodiment of the invention, the transmission process can be accelerated by compressing the original data.
As an optional implementation manner, a compression weight corresponding to each data type is obtained according to data capacity analysis; estimating and obtaining the estimated compression duration corresponding to each compression algorithm based on the compression weight and the data capacity; and selecting a compression algorithm with the shortest estimated compression time to compress the original data to obtain the bag body. Specifically, for high-capacity data with estimated transmission delay exceeding a preset delay upper limit, compression is carried out to ensure rapid transmission, and the original data is compressed by selecting a compression algorithm which corresponds to the data type and has the shortest estimated compression time, and the compression algorithm is processed to obtain the bag body.
105. And processing the transmission protocol and the data characteristics to obtain a packet header.
In the embodiment of the invention, the packet header is obtained based on the transmission protocol and the data characteristic processing and is used for identifying the transmission process.
106. And encapsulating the packet head and the packet body to obtain a data packet and transmitting the data packet.
In the embodiment of the invention, the packet header and the packet body are encapsulated to obtain the complete data packet, and the data packet is transmitted based on a transmission protocol.
In the embodiment of the invention, the transmission process comprises sending and receiving, and as part of original data is compressed, the data packet needs to be detected, and the compressed data packet is decompressed.
As an optional implementation manner, detecting whether a compression tag exists in a packet header, and recording a compression algorithm adopted by a current data packet by the compression tag; if the packet exists, decompressing the packet body according to the compression algorithm recorded by the compression mark to obtain original data; if the data does not exist, extracting the original data from the bag body; and receiving the original data to finish the data packet transmission. Specifically, decompression is performed by adopting a compression algorithm based on the compression marks, and then original data can be obtained; for the uncompressed inclusion, the original data can be directly extracted.
As another optional implementation, recording a transmission record of each data packet, where the transmission record includes an estimated transmission delay, a compression ratio, a compression duration, a transmission duration, and a decompression duration; calculating to obtain the total processing time length based on the compression time length, the transmission time length and the decompression time length of each data packet; comparing the total processing time length with the estimated transmission time delay; if an overtime data packet with the total processing time length exceeding the estimated transmission time delay exists, outputting an evaluation error signal corresponding to the overtime data packet; and updating the evaluation method based on the compression ratio of the overtime data packet and the data characteristics of the original data in the overtime data packet. Specifically, each transmission process records the transmission record, and for the transmission process with estimated transmission delay error, the estimation method in the estimation process is updated based on the compression ratio and the data characteristics, so that the estimation method is more and more accurate along with the increase of the transmission data volume, and the transmission efficiency is improved.
It can be seen that, by implementing the data packet efficient transmission method described in fig. 1, the original data can be analyzed and evaluated in the data transmission process, the original data occupying a large amount of time in the compression process is not compressed, and is directly packaged and transmitted, so that the transmission time is saved; and for the original data needing to be compressed, a compression algorithm matched with the data type is selected to shorten the compression/decompression time of the original data, so that the efficient transmission of the data packet is realized.
Example two
Referring to fig. 2, fig. 2 is a schematic structural diagram of a system for efficient transmission of data packets according to an embodiment of the present invention. As shown in fig. 2, the system for efficient transmission of data packets may include:
an obtaining unit 201, configured to obtain original data and a transmission protocol of current data transmission;
a characteristic analysis unit 202, configured to analyze data characteristics of the raw data, where the data characteristics refer to data types included in the raw data and data capacities corresponding to each data type;
a delay evaluating unit 203, configured to calculate an estimated transmission delay based on the data characteristics and the transmission protocol;
the bag body processing unit 204 is configured to, when the estimated transmission delay exceeds the preset delay upper limit, compress the original data based on the data characteristics to obtain a bag body;
the bag body processing unit 204 is further configured to encapsulate the original data to obtain a bag body when the transmission delay obtained through evaluation does not exceed a preset delay upper limit;
a packet header processing unit 205, configured to process a transmission protocol and data characteristics to obtain a packet header;
an encapsulating unit 206, configured to encapsulate the packet header and the packet body, obtain a data packet, and transmit the data packet;
a compression detection unit 207, configured to package the packet header and the packet body in the packaging unit, obtain a data packet, and transmit the data packet, detect whether a compression flag exists in the packet header, where the compression flag records a compression algorithm adopted by the current data packet;
the decompression unit 208 is configured to decompress the packet body according to a compression algorithm recorded by the compression tag when the compression detection unit detects that the packet header has the compression tag, so as to obtain original data;
the decompressing unit 208 is further configured to extract the original data from the packet body when the compression detecting unit detects that the packet header does not have the compression flag;
a receiving unit 209, configured to receive original data and complete data packet transmission;
a recording unit 210, configured to record a transmission record of each data packet, where the transmission record includes an estimated transmission delay, a compression ratio, a compression duration, a transmission duration, and a decompression duration;
a time length calculating unit 211, configured to calculate a total processing time length based on the compression time length, the transmission time length, and the decompression time length of each data packet;
a comparing unit 212, configured to compare the total processing duration with the estimated transmission delay;
an error reporting unit 213, configured to output an evaluation error signal corresponding to the timeout packet when there is the timeout packet whose total processing duration exceeds the estimated transmission delay;
the updating unit 214 is configured to update the evaluation method based on the compression ratio of the timeout data packet and the data characteristics of the original data in the timeout data packet.
Wherein, the inclusion processing unit 204 further comprises:
the weight determination subunit 2041 is configured to obtain a compression weight corresponding to each data type according to data capacity analysis;
a duration evaluation subunit 2042, configured to evaluate to obtain an estimated compression duration corresponding to each compression algorithm based on the compression weight and the data capacity;
and the bag body processing subunit 2043 is configured to select a compression algorithm with the shortest estimated compression duration to compress the original data, so as to obtain a bag body.
As an optional implementation manner, the weight determining subunit 2041 obtains a compression weight corresponding to each data type according to data capacity analysis; the duration evaluation subunit 2042 evaluates to obtain the estimated compression duration corresponding to each compression algorithm based on the compression weight and the data capacity; the bag body processing subunit 2043 selects the compression algorithm with the shortest estimated compression duration to compress the original data, so as to obtain a bag body. Specifically, for high-capacity data with estimated transmission delay exceeding a preset delay upper limit, compression is carried out to ensure rapid transmission, and the original data is compressed by selecting a compression algorithm which corresponds to the data type and has the shortest estimated compression time, and the compression algorithm is processed to obtain the bag body.
As an optional implementation manner, the compression detection unit 207 detects whether a compression flag exists in the packet header, and the compression flag records a compression algorithm adopted by the current data packet; if the packet exists, the decompression unit 208 decompresses the packet body according to the compression algorithm recorded by the compression flag to obtain the original data; if not, the decompression unit 208 extracts the original data from the bag body; the receiving unit 210 receives the original data and completes the data packet transmission. Specifically, decompression is performed by adopting a compression algorithm based on the compression marks, and then original data can be obtained; for the uncompressed inclusion, the original data can be directly extracted.
As another optional implementation manner, the recording unit 210 records a transmission record of each data packet, where the transmission record includes an estimated transmission delay, a compression ratio, a compression duration, a transmission duration, and a decompression duration; the duration calculation unit 211 calculates a total processing duration based on the compression duration, the transmission duration, and the decompression duration of each packet; the comparison unit 213 compares the total processing duration with the estimated transmission delay; if there is an overtime data packet whose total processing duration exceeds the estimated transmission delay, the error reporting unit 213 outputs an evaluation error signal corresponding to the overtime data packet; the updating unit 214 updates the evaluation method based on the compression ratio of the timeout packet and the data characteristics of the original data in the timeout packet. Specifically, each transmission process records the transmission record, and for the transmission process with estimated transmission delay error, the estimation method in the estimation process is updated based on the compression ratio and the data characteristics, so that the estimation method is more and more accurate along with the increase of the transmission data volume, and the transmission efficiency is improved.
It can be seen that, by implementing the data packet efficient transmission system described in fig. 2, the original data can be analyzed and evaluated in the data transmission process, the original data occupying a large amount of time in the compression process is not compressed, and is directly packaged and transmitted, so that the transmission time is saved; and for the original data needing to be compressed, a compression algorithm matched with the data type is selected to shorten the compression/decompression time of the original data, so that the efficient transmission of the data packet is realized.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic structural diagram of another efficient packet transmission system according to an embodiment of the present invention. As shown in fig. 3, the system for efficient transmission of data packets may include:
a memory 301 storing executable program code;
a processor 302 coupled to the memory 301;
the processor 302 calls the executable program code stored in the memory 301 to execute a packet efficient transmission method of fig. 1.
The embodiment of the invention discloses a computer readable storage medium which stores a computer program, wherein the computer program enables a computer to execute the data packet efficient transmission method of figure 1.
Embodiments of the present invention also disclose a computer program product, wherein, when the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the method as in the above method embodiments.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The above detailed description is provided for a method and a system for efficient transmission of data packets disclosed in the embodiments of the present invention, and a specific example is applied in the present disclosure to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A method for efficient transmission of data packets, the method comprising:
acquiring original data and a transmission protocol of current data transmission;
analyzing data characteristics of the original data, wherein the data characteristics refer to data types contained in the original data and data capacity corresponding to each data type;
calculating estimated transmission delay based on the data characteristics and the transmission protocol;
if the estimated transmission delay exceeds the preset delay upper limit, compressing the original data based on the data characteristics to obtain a bag body;
processing the transmission protocol and the data characteristics to obtain a packet header;
and encapsulating the packet header and the packet body to obtain a data packet and transmitting the data packet.
2. The method of claim 1, wherein if the transmission delay is evaluated not to exceed the predetermined delay bound, the method further comprises:
packaging the original data to obtain a bag body;
executing the processing of the transmission protocol and the data characteristics to obtain a packet header; and encapsulating the packet header and the packet body to obtain a data packet and transmitting the data packet.
3. The method of claim 1, wherein when the transmission delay exceeds a preset delay upper limit, compressing the original data based on the data characteristics to obtain a packet body, comprises:
obtaining a compression weight corresponding to each data type according to the data capacity analysis;
estimating and obtaining the estimated compression duration corresponding to each compression algorithm based on the compression weight and the data capacity;
and selecting a compression algorithm with the shortest estimated compression time to compress the original data to obtain the bag body.
4. The method of claim 2, wherein after encapsulating the header and the body to obtain a data packet and transmitting the data packet, the method further comprises:
detecting whether a compression mark exists in the packet header, wherein the compression mark records a compression algorithm adopted by the current data packet;
if the packet body exists, decompressing the packet body according to the compression algorithm recorded by the compression mark to obtain the original data;
if the original data do not exist, extracting the original data from the bag body;
and receiving the original data to finish data packet transmission.
5. The method according to any one of claims 1 to 4, further comprising:
recording the transmission record of each data packet, wherein the transmission record comprises the estimated transmission delay, the compression ratio, the compression time length, the transmission time length and the decompression time length;
calculating to obtain the total processing time length based on the compression time length, the transmission time length and the decompression time length of each data packet;
comparing the total processing time length with the estimated transmission time delay;
if an overtime data packet with the total processing time length exceeding the estimated transmission time delay exists, outputting an evaluation error signal corresponding to the overtime data packet;
and updating the evaluation method based on the compression ratio of the overtime data packet and the data characteristics of the original data in the overtime data packet.
6. A system for efficient transmission of data packets, the system comprising:
the acquisition unit is used for acquiring the original data and the transmission protocol of the current data transmission;
the characteristic analysis unit is used for analyzing data characteristics of the original data, wherein the data characteristics refer to data types contained in the original data and data capacity corresponding to each data type;
a delay evaluating unit, configured to calculate an estimated transmission delay based on the data characteristics and the transmission protocol;
the bag body processing unit is used for compressing the original data based on the data characteristics to obtain a bag body when the estimated transmission time delay exceeds a preset time delay upper limit;
the packet header processing unit is used for processing the transmission protocol and the data characteristics to obtain a packet header;
and the packaging unit is used for packaging the packet head and the packet body to obtain a data packet and transmitting the data packet.
7. The system of claim 6, wherein the bag body processing unit is further configured to encapsulate the original data to obtain the bag body when the transmission delay is evaluated to not exceed the preset upper delay limit.
8. The system of claim 6, wherein the packet processing unit comprises:
the weight determining subunit is used for obtaining a compression weight corresponding to each data type according to the data capacity analysis;
the time length evaluation subunit is used for evaluating and obtaining the estimated compression time length corresponding to each compression algorithm based on the compression weight and the data capacity;
and the bag body processing subunit is used for selecting a compression algorithm with the shortest estimated compression time to compress the original data to obtain the bag body.
9. The system of claim 7, further comprising:
the compression detection unit is used for detecting whether a compression mark exists in the packet header after the packet header and the packet body are packaged by the packaging unit to obtain a data packet and the data packet is transmitted, and the compression mark records a compression algorithm adopted by the current data packet;
the decompression unit is used for decompressing the bag body according to a compression algorithm recorded by the compression mark to obtain the original data when the compression detection unit detects that the compression mark exists in the packet header;
the decompression unit is further configured to extract the original data from the packet body when the compression detection unit detects that the packet header does not have the compression flag;
and the receiving unit is used for receiving the original data and finishing data packet transmission.
10. The system of any of claims 6 to 9, further comprising:
the recording unit is used for recording the transmission record of each data packet, and the transmission record comprises the estimated transmission time delay, the compression ratio, the compression time length, the transmission time length and the decompression time length;
the time length calculating unit is used for calculating the total processing time length based on the compression time length, the transmission time length and the decompression time length of each data packet;
a comparison unit, configured to compare the total processing duration with the estimated transmission delay;
an error reporting unit, configured to output an evaluation error signal corresponding to the timeout data packet when the timeout data packet exists, where the total processing duration exceeds the estimated transmission delay;
and the updating unit is used for updating the evaluation method based on the compression ratio of the overtime data packet and the data characteristics of the original data in the overtime data packet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110181053.8A CN112995055A (en) | 2021-02-10 | 2021-02-10 | Efficient data packet transmission method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110181053.8A CN112995055A (en) | 2021-02-10 | 2021-02-10 | Efficient data packet transmission method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112995055A true CN112995055A (en) | 2021-06-18 |
Family
ID=76393018
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110181053.8A Pending CN112995055A (en) | 2021-02-10 | 2021-02-10 | Efficient data packet transmission method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112995055A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101729322A (en) * | 2009-12-21 | 2010-06-09 | 烽火通信科技股份有限公司 | Method for measuring equivalent delay of data message in PTN system |
| CN102638579A (en) * | 2012-03-29 | 2012-08-15 | 深圳市高正软件有限公司 | Data processing method and system based on data transmission of mobile equipment |
| CN103139609A (en) * | 2013-02-01 | 2013-06-05 | 深圳市深信服电子科技有限公司 | Method and device for optimizing remote application video play |
| US20170012641A1 (en) * | 2015-07-07 | 2017-01-12 | Tidal Systems, Inc. | Compression engine with consistent throughput |
| CN110535869A (en) * | 2019-09-05 | 2019-12-03 | 厦门市美亚柏科信息股份有限公司 | A kind of data transmission method based on compression algorithm, terminal device and storage medium |
-
2021
- 2021-02-10 CN CN202110181053.8A patent/CN112995055A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101729322A (en) * | 2009-12-21 | 2010-06-09 | 烽火通信科技股份有限公司 | Method for measuring equivalent delay of data message in PTN system |
| CN102638579A (en) * | 2012-03-29 | 2012-08-15 | 深圳市高正软件有限公司 | Data processing method and system based on data transmission of mobile equipment |
| CN103139609A (en) * | 2013-02-01 | 2013-06-05 | 深圳市深信服电子科技有限公司 | Method and device for optimizing remote application video play |
| US20170012641A1 (en) * | 2015-07-07 | 2017-01-12 | Tidal Systems, Inc. | Compression engine with consistent throughput |
| CN110535869A (en) * | 2019-09-05 | 2019-12-03 | 厦门市美亚柏科信息股份有限公司 | A kind of data transmission method based on compression algorithm, terminal device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110225417B (en) | Data processing method and server, and method and server for detecting stuck state | |
| CN105676023B (en) | The recording method and system of fault recorder data | |
| EP0810532B1 (en) | A lossless data compression method and apparatus that also facilitates signal analysis | |
| CN111211980B (en) | Transmission link management method, transmission link management device, electronic equipment and storage medium | |
| CN106374933A (en) | Data compression device and method | |
| CN112995055A (en) | Efficient data packet transmission method and system | |
| CN116800796A (en) | Method, device, equipment and medium for transmitting internet of vehicles data | |
| CN109741483B (en) | Automobile collision detection method based on Internet of vehicles platform | |
| JP4543283B2 (en) | Radio identification method and apparatus | |
| CN108880559B (en) | Data compression method, data decompression method, compression equipment and decompression equipment | |
| CN110611644A (en) | Data transmission method and device | |
| CN110851871A (en) | File decompression method and device, electronic equipment and storage medium | |
| CN111198855A (en) | Method and device for processing log data | |
| US20190020443A1 (en) | Packet classification apparatus, packet classification method and storage medium | |
| CN114244911A (en) | Voice analysis method and device, receiving terminal equipment and storage medium | |
| CN109584889A (en) | Audio frequency transmission method and device and storage medium | |
| JP6471085B2 (en) | Network connection device, data compression collection method and program | |
| CN114531332A (en) | Data transmission method, data processing method, device and storage medium | |
| CN110334047B (en) | System and method for collecting equipment data, frequency converter and computer readable medium | |
| CN109655269B (en) | Motor vibration detection method and device | |
| CN112905697B (en) | High-speed network data packet capturing method and system | |
| CN100527851C (en) | Error code recognition and processing method of compression image | |
| CN103312792A (en) | Method and system for reading file from external storage equipment | |
| CN114257338B (en) | Data processing method and device, communication system and communication device, equipment and medium | |
| CN116437134B (en) | Method and device for detecting audio and video synchronicity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210618 |