CN106534152B - Remote data transmission method based on data compression and encryption - Google Patents
Remote data transmission method based on data compression and encryption Download PDFInfo
- Publication number
- CN106534152B CN106534152B CN201611083871.XA CN201611083871A CN106534152B CN 106534152 B CN106534152 B CN 106534152B CN 201611083871 A CN201611083871 A CN 201611083871A CN 106534152 B CN106534152 B CN 106534152B
- Authority
- CN
- China
- Prior art keywords
- data
- encryption
- compression
- encrypted
- compressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The invention discloses a remote data transmission method based on data compression and encryption, which is characterized in that according to the precision requirements of different data, compression and encryption processing are carried out before data is sent, a new data compression and encryption algorithm is formulated, the data uploading speed and the safety are improved, and data is decompressed and decrypted at a data receiving end, so that the integrity of the data is ensured.
Description
Technical Field
The invention relates to the technical field of data compression and encryption, in particular to a remote data transmission method based on data compression and encryption.
Background
With the continuous deepening of people in the big data era on data mining, the information security problem gradually draws attention. Particularly for enterprises, the security guarantee of data information is beneficial to keeping certain competitiveness in the industry. Due to the limitation of data bus load and network bandwidth, the transmission efficiency is lower when the data is larger. In order to improve the data uploading rate, the data is urgently required to be packed and compressed, and the data storage space is reduced on the premise of ensuring the data accuracy.
Most of the existing data compression and encryption methods are based on the IEEE754 floating-point arithmetic standard to convert data into floating-point numbers, but the algorithm cannot meet different precision requirements and maximum compression of the data.
In the prior art, the floating point number conversion of data based on the IEEE754 floating point number arithmetic standard has the following disadvantages: such algorithms do not meet the different accuracy requirements and maximization of the degree of compression of the data. Due to the requirement difference of different data precision, the number of bytes after data compression is limited to the minimum precision, namely the higher the precision requirement is, the larger the number of bytes after compression is. Therefore, after data compression, the bytes with low precision requirement have partial invalid data, thereby reducing the utilization rate of the storage space and leading to insufficient data compression degree.
In response to the above deficiencies, the present invention is directed to meeting the minimum accuracy requirement of data and maximizing the degree of data compression. Aiming at different data precision requirements, a new compression algorithm suitable for the data is formulated, so that the minimum precision is met and the minimum data length can be ensured.
Disclosure of Invention
The invention discloses a remote data transmission method based on data compression and encryption, which is characterized in that according to the precision requirements of different data, compression and encryption processing are carried out before data is sent, a new data compression and encryption algorithm is formulated, the data uploading speed and the safety are improved, and data is decompressed and decrypted at a data receiving end, so that the integrity of the data is ensured.
The technical scheme of the invention is as follows:
a remote data transmission method based on data compression and encryption comprises the following steps:
the vehicle-mounted end acquires original data through the data acquisition unit and compresses and encrypts the acquired original data to obtain compressed and encrypted data, and the original data compression and encryption process specifically comprises the following steps:
(11) classifying the original data according to the byte length and precision requirements;
(12) the classified data are respectively arranged according to the sequence structure arrangement rule, and then are converted into a character string array, and are packed into corresponding one-frame complete sentences including first-class sentences, second-class sentences and third-class sentences after self-defined sentence initial identifiers are added,
the first type of sentences are compressed and encrypted with 8-bit precision to obtain compressed and encrypted first data, the second type of sentences are compressed and encrypted with 12-bit precision to obtain compressed and encrypted second data, and the third type of sentences are compressed and encrypted with 28-bit precision to obtain compressed and encrypted third data;
the 3G network transmits the compressed and encrypted first, second and third data to a server;
the server side decompresses and decrypts the received compressed and encrypted first, second and third data to obtain original data, and the decompression and decryption process is a reverse process of compression and encryption.
Further, the 8-bit precision compression and encryption process comprises the step of passing the first type statement through h + f.2-8And calculating to obtain first data, wherein h is an integer part and f is a decimal part.
Further, the 12-bit precision compression and encryption process includes passing the second type statement (-1)s·(h+f·2-12) And calculating to obtain second data, wherein s is a sign bit, h is an integer part, and f is a decimal part.
Further, the 28-bit precision compression and encryption process includes passing the third type statement through 2e·(1+z·2-28) Calculating to obtain third data, e is exponent bit, z is mantissa bit。
Further, the original data comprises tire temperature and tire pressure, tire sinking, automobile acceleration, automobile temperature and humidity, data acquisition controller time and automobile longitude and latitude.
Further, the first type of data includes car time information.
Further, the second type of data includes tire temperature and tire pressure, tire sinking amount, automobile acceleration and automobile temperature and humidity.
Further, the third type of data includes the longitude and latitude of the automobile.
The invention has the following technical effects:
(1) on the premise of meeting the minimum precision of data, the data are fully compressed, and the utilization rate of a storage space is improved.
(2) A set of algorithm is formulated to encrypt the original data, so that the data transmission safety is improved.
(3) The data decryption and encryption processes are reciprocal, and the accuracy of the original data is guaranteed.
Detailed Description
During the running process of the automobile, the vehicle-mounted data acquisition unit acquires original data such as tire temperature and tire pressure, tire sinking, automobile acceleration, automobile temperature and humidity, time information of the data acquisition controller, automobile longitude and latitude and the like in real time. According to the precision requirements of different data, encryption processing is carried out before data are sent, a new data compression and encryption algorithm is formulated, the data uploading speed and the data uploading safety are improved, and data are decompressed and decrypted at a data receiving end, so that the integrity of the data is guaranteed.
The remote data transmission method based on data compression and encryption comprises the following steps:
the vehicle-mounted end acquires original data through the data acquisition unit and compresses and encrypts the acquired original data to obtain compressed and encrypted data, and the original data compression and encryption process specifically comprises the following steps:
classifying the original data according to the byte length and precision requirements;
the classified data are respectively arranged according to the sequence structure arrangement rule, and then are converted into a character string array, and are packed into corresponding one-frame complete sentences including first-class sentences, second-class sentences and third-class sentences after self-defined sentence initial identifiers are added,
the first type of sentences are compressed and encrypted with 8-bit precision to obtain compressed and encrypted first data, the second type of sentences are compressed and encrypted with 12-bit precision to obtain compressed and encrypted second data, and the third type of sentences are compressed and encrypted with 28-bit precision to obtain compressed and encrypted third data;
the 3G network transmits the compressed and encrypted first, second and third data to a server;
the server side decompresses and decrypts the received compressed and encrypted first, second and third data to obtain original data, and the decompression and decryption process is a reverse process of compression and encryption.
The classification of the original data according to byte length and precision requirements specifically comprises the steps that the data are divided into an integer part and a decimal part, the digits are different after decimal points of different data, 1 decimal is reserved after decimal points such as time information of a digital acquisition controller of the data with low precision requirements, the tire temperature tire pressure, the ambient temperature, acceleration information and the like generally reserve 2 decimal points, some data are required to be accurate to 6 digits after the decimal points of longitude and latitude data, and the original data are split according to the difference of the digits after the decimal points of the different data.
The original data comprises tire temperature and tire pressure, tire sinking, automobile acceleration, automobile temperature and humidity, data acquisition controller time information and automobile longitude and latitude, the first type of data comprises automobile time information, the second type of data comprises tire temperature and tire pressure, tire sinking, automobile acceleration and automobile temperature and humidity, and the third type of data comprises automobile longitude and latitude.
The data can be divided into three types of 12 bits, 28 bits and 8 bits according to decimal precision requirements. Corresponding data compression and encryption and decryption algorithms are formulated for the three precisions respectively as shown in the following table. The compression and encryption with different precision requirements are divided according to decimal precision requirements and can be divided into three types of 8 bits, 12 bits and 28 bits.
Wherein, the compression and encryption processing with 8-bit precision comprises the step of passing the first type statement through h + f.2-8First data were calculated, with the parameters shown in table 1.
Table 18 bit precision compression and encryption parameters
| Integer part | Fractional part |
| h | f |
| 32bit | 8bit |
Wherein, the compression and encryption processing with 12-bit precision comprises passing the second type statement (-1)s·(h+f·2-12) Second data were calculated and the parameters are shown in table 2.
Table 212 bit precision compression and encryption parameters
| Sign bit | Integer part | Fractional part |
| s | h | f |
| 1bit | 11bit | 12bit |
As in the above formula, 100.375 is taken as an example, the sign bit is positive s ═ 0, the integer part h is 100, the corresponding 11-bit binary floating point number is represented as 00001100100, and the similar fractional part f is (100.375-100)/2-12＝29+210Indicated as 011000000000. Thus, the decimal 100.375 is converted to a binary number, denoted as: 000001100100011000000000.
the encryption processing of the data is realized through the algorithm conversion, the transmission efficiency of the data stored and read in a binary system is higher, the data length is reduced, and the effect of data compression is achieved.
On the contrary, the decryption process and the encryption process of the data are reversible, and the original decimal number can be obtained by restoring the binary number according to the same algorithm.
Wherein the compression and encryption process with 28-bit precision comprises passing the third type statement through 2e·(1+z·2-28) Third data were calculated and the parameters are shown in table 3.
Table 328 bit precision compression and encryption parameters
| Exponent bit | Mantissa bit |
| e | z |
| 4bit | 28bit |
When the vehicle-mounted end and the server end carry out remote communication, data of the vehicle-mounted end are compressed and encrypted and then sent to the server end through the 3G network, and when the server end receives the data, the server end carries out decryption and decompression to obtain the originally collected data. The algorithm greatly improves the data transmission efficiency when the server side uploads the historical data, and the transmission efficiency is greatly increased compared with the transmission efficiency when the historical data is not compressed.
The time information adopts 8-bit precision encryption algorithm, firstly, the character string data is converted into numerical value, the integer part is obtained, the numerical value is converted into binary representation according to the maximum possible time bit number, and then the decimal part is also converted into binary representation, in order to achieve the preset precision, a coefficient, namely 2, is required to be multiplied-8。
The encryption algorithm with 12-bit precision is adopted for tire temperature and tire pressure, tire sinking amount, automobile acceleration and automobile temperature and humidity, the precision is different from 8-bit precision, a sign bit is added to data for judging whether the data is positive or negative, the data is also divided into an integer part and a decimal part, binary numbers of the data are respectively taken, and the binary numbers are matched with corresponding required precision and multiplied by corresponding coefficients.
A28-digit decimal accuracy algorithm is adopted for longitude and latitude information, the integral part of the longitude and latitude information is judged firstly, the smallest exponent number can be the size of e, and the rest mantissa part comprises the integral part and the decimal part, and is multiplied by a coefficient to ensure the data accuracy.
The information is arranged according to a certain rule and then converted into a character string array, corresponding statement identifiers are added and then packaged into a frame of completed statements, and the statements are encrypted and compressed and then sent to a server through a 3G network. Therefore, the data is compressed into binary number from the original character string, the occupied space is reduced from 2067 bytes in one second to 925 bytes in one second, the bytes are reduced, the data rate is improved, and the data compression and encryption process is realized.
When receiving data, the server side decrypts the corresponding data, which is opposite to the encryption mode, firstly converts the character string into a numerical value during decryption, respectively converts the binary numbers into different character strings according to different algorithms after removing the identifier, and then divides the data by taking the identifier as a separator, calculates according to an encryption protocol specified by the encryption algorithm, reversely obtains encryption parameters of each data, and then converts the binary numbers into decimal numbers to obtain the original data before encryption, namely time, longitude and latitude, tire temperature and pressure, tire sinking, automobile acceleration and automobile temperature and humidity data. Thus, the data decompression and decryption process is realized.
Claims (5)
1. A remote data transmission method based on data compression and encryption is characterized by comprising the following steps:
(1) the vehicle-mounted end acquires original data through the data acquisition unit and compresses and encrypts the acquired original data to obtain compressed and encrypted data, and the original data compression and encryption process specifically comprises the following steps:
(11) classifying the original data according to the classification categories of byte length and precision requirements,
(12) the classified data are respectively arranged according to the sequence structure arrangement rule, and then are converted into a character string array, and are packed into corresponding one-frame complete sentences including first-class sentences, second-class sentences and third-class sentences after self-defined sentence initial identifiers are added,
(13) the first type of sentences are compressed and encrypted with 8-bit precision to obtain compressed and encrypted first data, the second type of sentences are compressed and encrypted with 12-bit precision to obtain compressed and encrypted second data, and the third type of sentences are compressed and encrypted with 28-bit precision to obtain compressed and encrypted third data;
the 8-bit precision compression and encryption processing in the step (13) comprises the step of enabling the first type of statement to pass through h + f.2-8Calculating to obtain first data, wherein h is an integer part and f is a decimal part;
the compression and encryption processing of 12 bit precision in the step (13) comprises the step of passing the second type statement (-1)s·(h+f·2-12) Calculating to obtain second data, s being sign bitH is an integer part and f is a fractional part;
the compression and encryption processing with 28-bit precision in the step (13) comprises the step of enabling the third type of statement to pass through 2e·(1+z·2-28) Calculating to obtain third data, wherein e is an exponent bit, and z is a mantissa bit; judging the integer part of the third type of statement, wherein the exponent bit reaching the minimum is the value of e, and the rest mantissa part comprises the integer part and the decimal part and is multiplied by a coefficient;
(2) the 3G network transmits the compressed and encrypted first, second and third data to a server;
(3) the server side decompresses and decrypts the received compressed and encrypted first, second and third data to obtain original data, and the decompression and decryption process is a reverse process of compression and encryption.
2. The remote data transmission method based on data compression and encryption as claimed in claim 1, wherein the raw data includes tire temperature and tire pressure, tire subsidence, automobile acceleration, automobile temperature and humidity, data acquisition controller time and automobile latitude and longitude.
3. The remote data transmission method based on data compression and encryption as claimed in claim 2, wherein the first type of data includes data acquisition controller time information.
4. The remote data transmission method based on data compression and encryption as claimed in claim 2, wherein the second type of data includes tire temperature and tire pressure, tire sinking amount, automobile acceleration and automobile temperature and humidity.
5. The remote data transmission method based on data compression and encryption as claimed in claim 2, wherein the third type of data includes longitude and latitude of the car.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611083871.XA CN106534152B (en) | 2016-11-30 | 2016-11-30 | Remote data transmission method based on data compression and encryption |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611083871.XA CN106534152B (en) | 2016-11-30 | 2016-11-30 | Remote data transmission method based on data compression and encryption |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106534152A CN106534152A (en) | 2017-03-22 |
| CN106534152B true CN106534152B (en) | 2019-12-20 |
Family
ID=58355277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611083871.XA Active CN106534152B (en) | 2016-11-30 | 2016-11-30 | Remote data transmission method based on data compression and encryption |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106534152B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107592636A (en) * | 2017-08-17 | 2018-01-16 | 深圳市诚壹科技有限公司 | A kind of method of processing information, terminal and server |
| CN108494721A (en) * | 2017-10-24 | 2018-09-04 | 深圳市沃特沃德股份有限公司 | The data transmission method and device of onboard system |
| CN108512831A (en) * | 2018-03-02 | 2018-09-07 | 天津宏达瑞信科技有限公司 | Data compression method and device suitable for remote meter reading |
| CN109245884B (en) * | 2018-09-29 | 2021-06-01 | 北京金风科创风电设备有限公司 | Data communication method and device of wind generating set |
| CN111404907B (en) * | 2020-03-10 | 2022-04-22 | 桂林电子科技大学 | Data compression transmission method based on IEEE754 format |
| CN112665886B (en) * | 2020-12-11 | 2023-06-27 | 浙江中控技术股份有限公司 | Data conversion method for measuring high-frequency original data by vibration of large rotary machine |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101685383A (en) * | 2008-09-28 | 2010-03-31 | 杨高祥 | Calculator and direct match-exponent based operational circuit of free-precision floating point |
| CN105227634A (en) * | 2015-08-31 | 2016-01-06 | 徐州工程学院 | A kind of compression of the binary data based on Residential soil and encryption method |
| CN106209942A (en) * | 2015-05-07 | 2016-12-07 | 阿里巴巴集团控股有限公司 | A kind of data compression transmission method and system and terminal thereof and server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140270409A1 (en) * | 2013-03-15 | 2014-09-18 | Eyelock, Inc. | Efficient prevention of fraud |
-
2016
- 2016-11-30 CN CN201611083871.XA patent/CN106534152B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101685383A (en) * | 2008-09-28 | 2010-03-31 | 杨高祥 | Calculator and direct match-exponent based operational circuit of free-precision floating point |
| CN106209942A (en) * | 2015-05-07 | 2016-12-07 | 阿里巴巴集团控股有限公司 | A kind of data compression transmission method and system and terminal thereof and server |
| CN105227634A (en) * | 2015-08-31 | 2016-01-06 | 徐州工程学院 | A kind of compression of the binary data based on Residential soil and encryption method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106534152A (en) | 2017-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106534152B (en) | Remote data transmission method based on data compression and encryption | |
| CN106549673B (en) | Data compression method and device | |
| CN115333735B (en) | Safe data transmission method | |
| CN105868305B (en) | A kind of cloud storage data deduplication method for supporting fuzzy matching | |
| CN104168085B (en) | A kind of data compression method changed based on redundancy Entropy Changes | |
| US9219499B2 (en) | Run time compression method for a vehicle communication bus | |
| CN112953550B (en) | Data compression method, electronic device and storage medium | |
| CN108153483B (en) | Time sequence data compression method based on attribute grouping | |
| US10015285B2 (en) | System and method for multi-stream compression and decompression | |
| CN113258935B (en) | Communication compression method based on model weight distribution in federated learning | |
| CN108873062A (en) | A kind of Multi-encoder high-speed seismic data parallel lossless compression method based on FPGA | |
| WO2021046970A1 (en) | Arithmetic coding-based neural network model compression encryption method and system | |
| CN112134568A (en) | Lossy data compression and decompression method and system | |
| CN103227644A (en) | Compression method of automobile body small-format data | |
| CN112559462A (en) | Data compression method and device, computer equipment and storage medium | |
| CN114025024B (en) | Data transmission method and device | |
| CN112948639B (en) | Unified storage management method and system for data of highway middling station | |
| US20230016080A1 (en) | Method, a transmitter and a system for continuously optimizing data compression using frequency-based dictionary lookup tables in a vehicle | |
| CN113254259A (en) | Method for improving transmission efficiency of low-precision floating-point number | |
| CN106341135A (en) | Real-time compression method based on UAV multi-channel particles | |
| CN112821496A (en) | System and method for controlling power-off and discharge of battery through Bluetooth controller | |
| KR20190066691A (en) | Method for transmitting and receiving compressed data and apparatus using the same | |
| CN117240409B (en) | Data processing method for smart phone and smart wearable device | |
| CN118138609A (en) | New energy micro-grid communication data processing method suitable for novel power system | |
| CN116208170B (en) | Data decompression system, method and equipment for distributed energy grid-connected monitoring |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |