CN114125072A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN114125072A CN114125072A CN202111406781.0A CN202111406781A CN114125072A CN 114125072 A CN114125072 A CN 114125072A CN 202111406781 A CN202111406781 A CN 202111406781A CN 114125072 A CN114125072 A CN 114125072A
- Authority
- CN
- China
- Prior art keywords
- data
- encoded
- encoding
- amount
- coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
Abstract
The invention provides a data processing method and a device thereof, which can be applied to the computer field or the financial field, after encoding data to be transmitted by using a preset fixed-length encoding method to obtain first encoded data, encoding the first encoded data by using a preset indefinite-length encoding method, the first coding data with higher frequency of occurrence is subjected to short coding, particularly, the effective compression of the transmission data is realized under the condition of large-scale data transmission and more repeated data in the data, and by in case that the total amount of data of the second encoded data and the corresponding encoding table is smaller than the amount of data of the first encoded data, and the second coded data and the corresponding coding table are sent to the receiving end together, so that the data sent to the receiving end is ensured to be data with relatively small transmission quantity, the occupation of network bandwidth by data transmission is reduced, and the data transmission efficiency is improved.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data processing method and apparatus.
Background
With the development of science and technology, communication between devices or systems is more and more frequent, and with the higher and higher definition requirement on multimedia data such as pictures and videos, the transmitted data volume is also larger and larger, and the network bandwidth is greatly consumed.
Disclosure of Invention
In view of this, the present invention provides a data processing method and apparatus, which reduce the occupation of network bandwidth by data transmission and improve data transmission efficiency.
In order to achieve the above purpose, the invention provides the following specific technical scheme:
a data processing method is applied to a sending end, and the method comprises the following steps:
encoding data to be transmitted by using a preset fixed length encoding method to obtain first encoded data;
encoding the first encoded data by using a preset indefinite length encoding method to obtain second encoded data and a corresponding encoding table;
judging whether the total data quantity of the second coded data and the corresponding coding table is smaller than the data quantity of the first coded data;
and under the condition that the total data quantity of the second coded data and the corresponding coding table is less than that of the first coded data, sending the second coded data and the corresponding coding table to a receiving end together.
Optionally, in a case that a total amount of data of the second encoded data and the corresponding encoding table is not less than a data amount of the first encoded data, the method further includes:
and transmitting the first coded data to a receiving end.
Optionally, in a case that a total amount of data of the second encoded data and the corresponding encoding table is not less than a data amount of the first encoded data, the method further includes:
encoding the second encoded data by using a preset indefinite length encoding method to obtain recoded second encoded data and a corresponding encoding table;
judging whether the total data quantity of the recoded second coded data and the corresponding coding table is smaller than that of the first coded data or not;
under the condition that the total data amount of the second coded data after recoding and the corresponding coding table is smaller than the data amount of the first coded data, the second coded data after recoding and the corresponding coding table are sent to a receiving end together;
and under the condition that the total data amount of the second coded data after re-coding and the corresponding coding table is not less than the data amount of the first coded data, repeatedly utilizing a preset indefinite length coding method to code the second coded data after re-coding until the total data amount of the second coded data after re-coding and the corresponding coding table is less than the data amount of the first coded data.
Optionally, the encoding the data to be sent by using a preset fixed-length encoding method to obtain first encoded data includes:
encoding the data to be transmitted by using an ASCII encoding method to obtain a decimal encoded value;
converting the decimal encoded value into the first encoded data of unsigned binary bytes.
Optionally, the encoding the first encoded data by using a preset indefinite length encoding method to obtain second encoded data and a corresponding encoding table includes:
and coding the first coded data by utilizing a Huffman coding method to obtain the second coded data and a corresponding coding table.
Optionally, sending the second encoded data and the corresponding encoding table to a receiving end together includes:
and sending the second coded data and the corresponding coded table to a receiving end together according to a TCP protocol.
A data processing device is applied to a transmitting end, and the device comprises:
the first coding unit is used for coding data to be sent by using a preset fixed length coding method to obtain first coded data;
the second coding unit is used for coding the first coded data by using a preset indefinite length coding method to obtain second coded data and a corresponding coding table;
the first judging unit is used for judging whether the total data amount of the second coded data and the corresponding coding table is smaller than the data amount of the first coded data or not, and triggering the first sending unit under the condition that the total data amount of the second coded data and the corresponding coding table is smaller than the data amount of the first coded data;
and the first sending unit is used for sending the second coded data and the corresponding code table to a receiving end together.
Optionally, the first determining unit is further configured to trigger a second sending unit when a total data amount of the second encoded data and the corresponding encoding table is not less than a data amount of the first encoded data;
and the second sending unit is used for sending the first coded data to a receiving end.
Optionally, the first determining unit is further configured to trigger a third encoding unit when a total data amount of the second encoded data and the corresponding encoding table is not less than a data amount of the first encoded data;
the third coding unit is configured to code the second coded data by using a preset indefinite length coding method to obtain recoded second coded data and a corresponding coding table;
the second judging unit is used for judging whether the total data amount of the re-encoded second encoded data and the corresponding encoding table is smaller than the data amount of the first encoded data or not, triggering the first sending unit under the condition that the total data amount of the re-encoded second encoded data and the corresponding encoding table is smaller than the data amount of the first encoded data, and triggering the third encoding unit under the condition that the total data amount of the re-encoded second encoded data and the corresponding encoding table is not smaller than the data amount of the first encoded data;
the first sending unit is further configured to send the re-encoded second encoded data and the corresponding encoding table to the receiving end together.
Optionally, the first encoding unit is specifically configured to:
encoding the data to be transmitted by using an ASCII encoding method to obtain a decimal encoded value;
converting the decimal encoded value into the first encoded data of unsigned binary bytes.
Optionally, the second encoding unit is specifically configured to encode the first encoded data by using a huffman coding method to obtain the second encoded data and a corresponding encoding table.
Optionally, the first sending unit is specifically configured to send the second encoded data and the corresponding encoding table to a receiving end together according to a TCP protocol.
Compared with the prior art, the invention has the following beneficial effects:
the invention discloses a data processing method, which is characterized in that after data to be transmitted is coded by a preset fixed length coding method to obtain first coded data, the first coded data is coded by a preset indefinite length coding method, the first coded data with higher occurrence frequency is subjected to short coding, especially, effective compression of transmitted data is realized under the condition of large-scale data transmission and more repeated data in the data, and the second coded data and a corresponding coding table are transmitted to a receiving end together under the condition that the total amount of the second coded data and the corresponding coding table is less than the data amount of the first coded data, so that the data transmitted to the receiving end is ensured to be the data with relatively smaller transmission amount, the occupation of network bandwidth by data transmission is reduced, and the data transmission efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic diagram of a conventional ASCII encoding;
FIG. 2 is a flow chart illustrating a data processing method according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a comparison between data transmission in a conventional manner and data transmission after byte encoding according to an embodiment of the present invention;
FIG. 4 is a flow chart illustrating another data processing method according to the embodiment of the present invention;
FIG. 5 is a flow chart illustrating another data processing method according to the embodiment of the present invention;
fig. 6 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The inventor finds out through research that: at present, the traditional ASCII coding is generally adopted to code data to be transmitted, and then the coded data is transmitted to a receiving terminal. As shown in fig. 1, the conventional ASCII encoding is defined by a byte with an equal length of 8 bits, which consumes a large amount of network bandwidth if the transmission data size is large. Since all data (such as text, picture, audio, video) are finally stored or transmitted in a form of being converted into a specific coded value (the coded value is an unsigned integer) through a specific coding table, and then the decimal integer corresponding to the coded value is converted into a corresponding unsigned binary byte to be stored in a calculation, and the data finally consist of the 256 bytes, that is, no matter how large a file is or even 100G, the 100G finally consists of 256 bytes, only the occurrence frequency of each byte is different, so that the bytes can be encoded again, originally, one byte is represented by 8 bits, for the byte with higher occurrence frequency, one bit can be used to correspond to one byte, and based on the fact that the more the same data amount is transmitted, the higher the encoding compression efficiency is obtained, the faster the network transmission efficiency, especially when transmitting audio, video, file, etc. communications in a large data volume real-time communication system, there is a tremendous performance improvement.
On this basis, the invention provides a data processing method, which is applied to a sending end, wherein the sending end can be a sending end of communication equipment or a system sending end, the invention is not particularly limited, after the data to be sent is coded by using a preset fixed-length coding method to obtain first coded data, the first coded data with higher frequency of occurrence is coded by using a preset indefinite-length coding method, and especially, the invention realizes effective compression of the transmitted data aiming at large-scale data transmission and the condition that the data has more repeated data.
Specifically, the present embodiment discloses a data processing method, please refer to fig. 1, which includes the following steps:
s101: encoding data to be transmitted by using a preset fixed length encoding method to obtain first encoded data;
the preset fixed-length encoding method may be any existing encoding method with the same byte length after encoding, such as an ASCII encoding method.
Taking a preset fixed-length coding method as an ASCII coding method as an example, firstly, coding data to be transmitted by using an ASCII coding method to obtain a decimal coded value, taking data to be transmitted as aaabbbccd as an example, each character occupies one byte in a decimal code, and obtaining 97,97,97,98,98,98,99, 100 after coding, and then converting the decimal coded value into first coded data of unsigned binary bytes, such as 01100001, 01100001, 01100001, 01100010, 01100010, 01100010, 01100011, 01100011, 01100100.
S102: encoding the first encoded data by using a preset indefinite length encoding method to obtain second encoded data and a corresponding encoding table;
the preset indefinite length coding method can be any existing method for carrying out indefinite length coding according to the occurrence frequency of characters, such as a Huffman coding method, and the method constructs a code word with the shortest average length of the special-shaped heads completely according to the occurrence probability of the characters.
Referring to fig. 3, taking aaabbbccd as an example of data to be transmitted, the data amount obtained by encoding the data to be transmitted in a conventional manner is 72 bits, and after the data processing method provided in this embodiment is used, the data to be transmitted is encoded by using a predetermined fixed-length encoding method to obtain first encoded data, and the first encoded data is encoded by using a predetermined indefinite-length encoding method to obtain 12 bits of data amount, which obviously reduces the data amount.
S103: judging whether the total data quantity of the second coded data and the corresponding coding table is smaller than that of the first coded data or not;
s104: and under the condition that the total data quantity of the second coded data and the corresponding coding table is less than that of the first coded data, the second coded data and the corresponding coding table are transmitted to the receiving end together.
It can be understood that, for the case of large-scale data transmission and more repeated data in the data, the first encoded data is encoded by using a preset indefinite length encoding method, so that effective compression of the transmitted data can be realized, the total data amount of the second encoded data and the corresponding encoding table is smaller than that of the first encoded data, the second encoded data and the corresponding encoding table are transmitted to the receiving end together in an optimal data processing manner, and after the receiving end receives the second encoded data, the second encoded data is decoded by using the corresponding encoding table and the preset indefinite length encoding method, and the preset definite length encoding method is used for further decoding, so that the original data is obtained.
However, for the situation that the amount of the transmitted data is small or the amount of the repeated data in the data is small, because the first encoded data is encoded by using the preset indefinite length encoding method, the transmitted data may not be effectively compressed, the total amount of the second encoded data and the corresponding encoding table may be larger than the amount of the first encoded data, and because the data to be transmitted needs to be encoded into the first encoded data first during encoding, and the first encoded data needs to be encoded by using the preset indefinite length encoding method, the number of times of encoding and decoding between the transmitting side and the receiving side is increased, therefore, in order to ensure that the data transmitted to the receiving side is the data with the least amount of data, after the first encoded data is encoded by using the preset indefinite length encoding method to obtain the second encoded data and the corresponding encoding table, whether the total amount of the second encoded data and the corresponding encoding table is smaller than the amount of the first encoded data is determined, and transmitting the second coded data and the corresponding coding table to the receiving end together only under the condition that the total data amount of the second coded data and the corresponding coding table is less than the data amount of the first coded data.
For the case that the total amount of data of the second encoded data and the corresponding encoding table is smaller than the amount of data of the first encoded data, the present invention provides two processing modes, which are respectively introduced by two embodiments as follows:
referring to fig. 4, the data processing method disclosed in this embodiment for the case of a small amount of transmitted data includes the following steps:
s201: encoding data to be transmitted by using a preset fixed length encoding method to obtain first encoded data;
s202: encoding the first encoded data by using a preset indefinite length encoding method to obtain second encoded data and a corresponding encoding table;
s203: judging whether the total data quantity of the second coded data and the corresponding coding table is smaller than that of the first coded data or not;
in the case that the total amount of data of the second encoded data and the corresponding encoding table is smaller than the amount of data of the first encoded data, S204 is performed: and sending the second coded data and the corresponding coded table to a receiving end together.
In the case where the total amount of data of the second encoded data and the corresponding encoding table is not less than the amount of data of the first encoded data, S205 is performed: the first encoded data is transmitted to a receiving end.
That is to say, for the case of less transmitted data amount, if the same data in the transmitted data is less, that is, the frequency is lower, after the data to be transmitted is encoded by using the predetermined fixed-length encoding method to obtain the first encoded data, the first encoded data is encoded by using the predetermined indefinite-length encoding method, which is not advantageous, and the total data amount of the second encoded data and the corresponding encoding table is not less than the data amount of the first encoded data, so that transmitting the first encoded data to the receiving end is the optimal data processing manner.
Referring to fig. 5, the data processing method disclosed in this embodiment for the case of large amount of transmitted data includes the following steps:
s301: encoding data to be transmitted by using a preset fixed length encoding method to obtain first encoded data;
s302: encoding the first encoded data by using a preset indefinite length encoding method to obtain second encoded data and a corresponding encoding table;
s303: judging whether the total data quantity of the second coded data and the corresponding coding table is smaller than that of the first coded data or not;
in the case that the total amount of data of the second encoded data and the corresponding encoding table is smaller than the amount of data of the first encoded data, S304 is performed: and sending the second coded data and the corresponding coded table to a receiving end together.
In the case where the total amount of data of the second encoded data and the corresponding encoding table is not less than the amount of data of the first encoded data, S305 is performed: encoding the second encoded data by using a preset indefinite length encoding method to obtain the recoded second encoded data and a corresponding encoding table;
s306: judging whether the total data quantity of the recoded second coded data and the corresponding coding table is smaller than that of the first coded data or not;
in the case where the total amount of data of the re-encoded second encoded data and the corresponding encoding table is smaller than the amount of data of the first encoded data, S304 is performed.
In the case that the total amount of data of the re-encoded second encoded data and the corresponding encoding table is not less than the amount of data of the first encoded data, S305 is returned to be executed until the total amount of data of the re-encoded second encoded data and the corresponding encoding table is less than the amount of data of the first encoded data.
That is to say, for the case of large amount of transmitted data, the minimum data set after encoding can be obtained by encoding for many times, and then the minimum data set is sent to the receiving end as the optimal data mode, so that the scheme of selecting and using the transmission layer UDP (packet loss without retransmission) protocol for increasing the speed in the conventional mode can be completely abandoned to a certain extent, and the effect of the equivalent UDP protocol can be achieved by using the safe TCP + compression mode.
Based on the data processing method disclosed in the foregoing embodiment, this embodiment correspondingly discloses a data processing apparatus, which is applied to a sending end, please refer to fig. 6, and the apparatus includes:
a first encoding unit 401, configured to encode data to be sent by using a preset fixed-length encoding method to obtain first encoded data;
a second encoding unit 402, configured to encode the first encoded data by using a preset indefinite length encoding method to obtain second encoded data and a corresponding encoding table;
a first judging unit 403, configured to judge whether a total data amount of the second encoded data and the corresponding encoding table is smaller than a data amount of the first encoded data, and trigger a first sending unit 404 when the total data amount of the second encoded data and the corresponding encoding table is smaller than the data amount of the first encoded data;
the first sending unit 404 is configured to send the second encoded data and the corresponding encoding table to a receiving end together.
Optionally, the first determining unit 403 is further configured to trigger a second sending unit when the total data amount of the second encoded data and the corresponding encoding table is not less than the data amount of the first encoded data;
and the second sending unit is used for sending the first coded data to a receiving end.
Optionally, the first determining unit 403 is further configured to trigger a third encoding unit when a total data amount of the second encoded data and the corresponding encoding table is not less than a data amount of the first encoded data;
the third coding unit is configured to code the second coded data by using a preset indefinite length coding method to obtain recoded second coded data and a corresponding coding table;
the second judging unit is used for judging whether the total data amount of the re-encoded second encoded data and the corresponding encoding table is smaller than the data amount of the first encoded data or not, triggering the first sending unit under the condition that the total data amount of the re-encoded second encoded data and the corresponding encoding table is smaller than the data amount of the first encoded data, and triggering the third encoding unit under the condition that the total data amount of the re-encoded second encoded data and the corresponding encoding table is not smaller than the data amount of the first encoded data;
the first sending unit 404 is further configured to send the re-encoded second encoded data and the corresponding encoding table to the receiving end together.
Optionally, the first encoding unit 401 is specifically configured to:
encoding the data to be transmitted by using an ASCII encoding method to obtain a decimal encoded value;
converting the decimal encoded value into the first encoded data of unsigned binary bytes.
Optionally, the second encoding unit 402 is specifically configured to encode the first encoded data by using a huffman coding method to obtain the second encoded data and a corresponding encoding table.
Optionally, the first sending unit 404 is specifically configured to send the second encoded data and the corresponding encoding table to a receiving end together according to a TCP protocol.
The data processing apparatus disclosed in this embodiment encodes data to be transmitted by using a preset fixed-length encoding method to obtain first encoded data, encodes the first encoded data by using a preset indefinite-length encoding method, and performs short encoding on the first encoded data having a high frequency of occurrence, in particular, in case of large-scale data transmission and a large amount of repeated data in the data, realizes effective compression on the transmitted data, and transmits the second encoded data and a corresponding encoding table to a receiving end together under the condition that the total amount of the second encoded data and the corresponding encoding table is smaller than the amount of the first encoded data, so as to ensure that the data transmitted to the receiving end is data having a relatively small transmission amount, reduce the occupation of the data transmission on a network bandwidth, and improve the data transmission efficiency.
It should be noted that the data processing method and apparatus provided by the present invention can be applied to the computer field or the financial field. The foregoing is merely an example, and does not limit the application field of the data processing method and apparatus provided by the present invention.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above embodiments can be combined arbitrarily, and the features described in the embodiments in the present specification can be replaced or combined with each other in the above description of the disclosed embodiments, so that those skilled in the art can implement or use the present application.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A data processing method is applied to a sending end, and the method comprises the following steps:
encoding data to be transmitted by using a preset fixed length encoding method to obtain first encoded data;
encoding the first encoded data by using a preset indefinite length encoding method to obtain second encoded data and a corresponding encoding table;
judging whether the total data quantity of the second coded data and the corresponding coding table is smaller than the data quantity of the first coded data;
and under the condition that the total data quantity of the second coded data and the corresponding coding table is less than that of the first coded data, sending the second coded data and the corresponding coding table to a receiving end together.
2. The method according to claim 1, wherein in case that the total amount of data of the second encoded data and the corresponding encoding table is not less than the amount of data of the first encoded data, the method further comprises:
and transmitting the first coded data to a receiving end.
3. The method according to claim 1, wherein in case that the total amount of data of the second encoded data and the corresponding encoding table is not less than the amount of data of the first encoded data, the method further comprises:
encoding the second encoded data by using a preset indefinite length encoding method to obtain recoded second encoded data and a corresponding encoding table;
judging whether the total data quantity of the recoded second coded data and the corresponding coding table is smaller than that of the first coded data or not;
under the condition that the total data amount of the second coded data after recoding and the corresponding coding table is smaller than the data amount of the first coded data, the second coded data after recoding and the corresponding coding table are sent to a receiving end together;
and under the condition that the total data amount of the second coded data after re-coding and the corresponding coding table is not less than the data amount of the first coded data, repeatedly utilizing a preset indefinite length coding method to code the second coded data after re-coding until the total data amount of the second coded data after re-coding and the corresponding coding table is less than the data amount of the first coded data.
4. The method according to claim 1, wherein the encoding the data to be transmitted by using a predetermined fixed-length encoding method to obtain first encoded data comprises:
encoding the data to be transmitted by using an ASCII encoding method to obtain a decimal encoded value;
converting the decimal encoded value into the first encoded data of unsigned binary bytes.
5. The method of claim 1, wherein the encoding the first encoded data by using a predetermined indefinite length encoding method to obtain a second encoded data and a corresponding encoding table comprises:
and coding the first coded data by utilizing a Huffman coding method to obtain the second coded data and a corresponding coding table.
6. The method of claim 1, wherein transmitting the second encoded data to a receiving end together with a corresponding encoding table comprises:
and sending the second coded data and the corresponding coded table to a receiving end together according to a TCP protocol.
7. A data processing apparatus, applied to a transmitting end, the apparatus comprising:
the first coding unit is used for coding data to be sent by using a preset fixed length coding method to obtain first coded data;
the second coding unit is used for coding the first coded data by using a preset indefinite length coding method to obtain second coded data and a corresponding coding table;
the first judging unit is used for judging whether the total data amount of the second coded data and the corresponding coding table is smaller than the data amount of the first coded data or not, and triggering the first sending unit under the condition that the total data amount of the second coded data and the corresponding coding table is smaller than the data amount of the first coded data;
and the first sending unit is used for sending the second coded data and the corresponding code table to a receiving end together.
8. The apparatus according to claim 7, wherein the first determining unit is further configured to trigger a second sending unit if a total amount of data of the second encoded data and the corresponding encoding table is not less than a data amount of the first encoded data;
and the second sending unit is used for sending the first coded data to a receiving end.
9. The apparatus according to claim 7, wherein the first determining unit is further configured to trigger a third encoding unit if a total amount of data of the second encoded data and the corresponding encoding table is not less than a data amount of the first encoded data;
the third coding unit is configured to code the second coded data by using a preset indefinite length coding method to obtain recoded second coded data and a corresponding coding table;
the second judging unit is used for judging whether the total data amount of the re-encoded second encoded data and the corresponding encoding table is smaller than the data amount of the first encoded data or not, triggering the first sending unit under the condition that the total data amount of the re-encoded second encoded data and the corresponding encoding table is smaller than the data amount of the first encoded data, and triggering the third encoding unit under the condition that the total data amount of the re-encoded second encoded data and the corresponding encoding table is not smaller than the data amount of the first encoded data;
the first sending unit is further configured to send the re-encoded second encoded data and the corresponding encoding table to the receiving end together.
10. The apparatus according to claim 7, wherein the first sending unit is specifically configured to send the second encoded data to a receiving end together with a corresponding encoding table according to a TCP protocol.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111406781.0A CN114125072A (en) | 2021-11-24 | 2021-11-24 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111406781.0A CN114125072A (en) | 2021-11-24 | 2021-11-24 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114125072A true CN114125072A (en) | 2022-03-01 |
Family
ID=80372199
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111406781.0A Pending CN114125072A (en) | 2021-11-24 | 2021-11-24 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114125072A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015007389A1 (en) * | 2013-07-17 | 2015-01-22 | Gurulogic Microsystems Oy | Encoder and decoder, and method of operation |
| CN111274950A (en) * | 2020-01-19 | 2020-06-12 | 青岛海信移动通信技术股份有限公司 | Feature vector data encoding and decoding method, server and terminal |
| CN113346911A (en) * | 2021-06-18 | 2021-09-03 | 安谋科技（中国）有限公司 | Compression encoding method, electronic device, and storage medium |
-
2021
- 2021-11-24 CN CN202111406781.0A patent/CN114125072A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015007389A1 (en) * | 2013-07-17 | 2015-01-22 | Gurulogic Microsystems Oy | Encoder and decoder, and method of operation |
| CN111274950A (en) * | 2020-01-19 | 2020-06-12 | 青岛海信移动通信技术股份有限公司 | Feature vector data encoding and decoding method, server and terminal |
| CN113346911A (en) * | 2021-06-18 | 2021-09-03 | 安谋科技（中国）有限公司 | Compression encoding method, electronic device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10003356B2 (en) | Devices and methods of source-encoding and decoding of data | |
| EP1817917A1 (en) | Golomb-rice lossless compression of satellite images | |
| US7461161B2 (en) | Information processing apparatus and method for decoding encoded data | |
| CN103546161A (en) | Lossless compression method based on binary processing | |
| CN106851733A (en) | A kind of adaptive H TTP message compression methods for mobile network's application | |
| CN110995753A (en) | Combined compression method for remote communication message in electricity consumption information acquisition system | |
| TWI527408B (en) | Method of dynamic coding scheme to compress wireless communication in wireless networks | |
| US8473428B2 (en) | Generation and use of specific probability tables for arithmetic coding in data compression systems | |
| CN114125072A (en) | Data processing method and device | |
| CN115632661B (en) | Efficient compression transmission method for network security information | |
| CN115499506B (en) | MQTT information transmission data compression method based on LZW algorithm and server | |
| CN103096049A (en) | Video processing method and system and associated equipment | |
| WO2002075928A2 (en) | Lossless data compression method for uniform entropy data | |
| CN110856144B (en) | LT code-based atomization caching method in mobile edge computing network | |
| EP2312498B1 (en) | System and method for arithmetic encoding and decoding | |
| US10666986B1 (en) | Sub-block based entropy coding for embedded image codec | |
| CN113704206A (en) | Metadata processing method and device, electronic equipment and storage medium | |
| KR102123839B1 (en) | System and method for adaptive transmitting of text stream data in network environment | |
| CN111490984A (en) | Network data coding and encryption algorithm thereof | |
| CN111885125A (en) | Data transmission method, system and computer readable storage medium for end-to-end network | |
| Fong et al. | Multimedia applications of self-synchronizing T-codes | |
| WO2023231775A1 (en) | Filtering method, filtering model training method and related device | |
| CN110099279B (en) | Method for adjusting lossy compression based on hardware | |
| KR100625670B1 (en) | Method, system and recording-medium for coding of image data | |
| CN116193113A (en) | Data decompression and compression method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |