CN106850141A - A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms - Google Patents
A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms Download PDFInfo
- Publication number
- CN106850141A CN106850141A CN201710041161.9A CN201710041161A CN106850141A CN 106850141 A CN106850141 A CN 106850141A CN 201710041161 A CN201710041161 A CN 201710041161A CN 106850141 A CN106850141 A CN 106850141A
- Authority
- CN
- China
- Prior art keywords
- string
- message system
- physical message
- strstart
- matching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
- H04L1/0002—Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
- H04L67/5651—Reducing the amount or size of exchanged application data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The present invention relates to the technical field of data transmission in computer physical message system, the physical message system data Lossless Compression transmission method of more particularly to a kind of use DEFLATE algorithms.When transmitting data in physical message system, it is likely to duplicate in a stream.When there is a repetition, polyisomenism is with locality, if a character string will be repeated, so it is also nearby to repeat, remote place is just kept the change, therefore is provided with a sliding window, and such as sliding window is 32KB, gone in the data of 32KB forward, this 32KB is constantly carried out and past front slide with coding.The invention provides a kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms, it is directed to substantial amounts of data transfer in physical message system, it is possible to increase data transmission bauds and efficiency.
Description
Technical field
The present invention relates to the technical field of data transmission in computer physical message system, more particularly to one kind is used
The physical message system data Lossless Compression transmission method of DEFLATE algorithms.
Background technology
Physical message system is integrated calculating, communicates and be controlled in one as calculation procedure and the entity of physics process
The intelligence system of future generation of body.Information physical system realizes the interaction with physics process by Man Machine Interface, uses network
Change space and manipulate a physical entity in the way of long-range, reliable, real-time, safety, cooperation.Physical message system bag
The system engineerings such as environment sensing ubiquitous in the future, embedding assembly, network service and network control are contained, have made physical system
With calculating, communication, precise control, remote collaboration and autonomy function.Its emphasis computing resource is combined closely with physical resource
With coordination, it is mainly used in some intelligence systems equipment such as and interconnects, Internet of Things sensing, smart home, robot, intelligent navigation etc..
On the basis of environment sensing, the controllable credible expansible networking physics of depth integration calculating, communication and control ability sets
Standby system, it realizes depth integration and real-time, interactive to increase by calculation procedure and the interactional feedback cycle of physics process
Or new function is extended, a physical entity is detected or controlled in safe, reliable, efficient and real-time mode.
DEFLATE is the default algorithm of ZIP compressed files, is a kind of algorithm of compressed data stream, any required streaming pressure
The place of contracting can be used.DEFLATE is while having used LZ77 algorithms to be calculated with a lossless data compression of Huffman encoding
Method.It is defined in his PKZIP filing instrument second editions, RFC 1951 to be defined on later and is advised as Phil Katz that it is initially
Fan Zhong.
Under prior art, due to there is substantial amounts of data transfer in physical message system, its current transmission method is caused
Data transmission bauds is slow, and efficiency of transmission is low.
The content of the invention
In order to solve problem of the prior art, the invention provides a kind of physical message system of use DEFLATE algorithms
Lossless date-compress transmission method, it is directed to substantial amounts of data transfer in physical message system, it is possible to increase data transmission bauds
And efficiency.
The technical solution adopted in the present invention is as follows：
A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms, is in physical message system
A sliding window is provided with data flow, the size of sliding window is set as X bytes, then in the above data of X bytes
Look for, it is intended to find the string matched with the data in this sliding window, and this X byte with coding constantly carry out and forward
Slide.
Method is specifically included：
A, from described data flow the content of 64KB is read in in a buffering area, use a variable for strstart functions
In buffering area array, it is moved rearwards by always since 0；Strstart on each position, in the region all before it,
Find and first 3 bytes match of string that current strstart starts string, and attempt to be found from these matching strings most long
Matching string；
If the string that B, current strstart start, it is 3 matching strings of byte, current strstart that can find minimum
The matching length of beginning string so long, it will by the value of a matching length to the distance of matching string beginning to replacing；
If the string that current strstart starts, can not find any is at least 3 matching strings of byte, then current
The place byte of strstart will without modification.
When finding matching string for current string every time, found using Hash table.
During due to transmitting data in physical message system, it is likely to duplicate in a stream.When appearance one
When repeating, polyisomenism be with locality, if character string will be repeated, then be also nearby to repeat, remote ground
Side just keeps the change, therefore is provided with a sliding window, and such as sliding window is 32KB, is gone in the data of 32KB forward, this
Individual 32KB is constantly carried out and past front slide with coding.
The beneficial effect brought of technical scheme that the present invention is provided is：
A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms of the invention, it is directed to physics
Substantial amounts of data transfer in information system, it is possible to increase data transmission bauds and efficiency.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be to that will make needed for embodiment description
Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 is a kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms of the invention
Method schematic.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention
Formula is described in further detail.
Embodiment one
（1）In physical message system, polytype data transfer is had, primary pressure is mainly wherein in digital display circuit
The binary data stream of contracting.
（2）To binary data stream, according to the size of network bag, or transmission unit demand, be divided into the block of 64KByte
Size.
（3）For each block, the symbol for being occurred inside searching, or repetitive sequence symbol, formation may go out
Existing assemble of symbol.
（4）For each symbol finds new binary representation, so that generally symbol uses little position, uncommon symbol
Use more position.Detailed process is：
I. the content of 64KB is read in from the data flow to be compressed in a buffering area, a variable of strstart is used
In buffering area array, it is moved rearwards by always since 0.Strstart on each position, in the region all before it,
Find and first 3 bytes match of string that current strstart starts string, and attempt to be found from these matching strings most long
Matching string.
If the string that ii. current strstart starts, it is 3 matching strings of byte that can find minimum, current
The matching length that strstart starts string so long, it will by the value of a matching length to the distance of matching string beginning to replacing
Change.
If the string that iii. current strstart starts, can not find it is any it is minimum be 3 matching strings of byte, then
The place byte of current strstart will without modification.
（5）If find matching string for current string every time, at least 3 bytes that will be gone here and there with before each are compared
Compared with if, then comparative quantity will be extremely big.Compare speed to improve, it is possible to use Hash table.
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all it is of the invention spirit and
Within principle, any modification, equivalent substitution and improvements made etc. should be included within the scope of the present invention.
Claims (3)
1. a kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms, is in physical message system
Data flow in be provided with a sliding window, the size of sliding window is set as X bytes, then in the above data of X bytes
Go for, it is intended to find the string matched with the data in this sliding window, and this X byte is past with continuous the carrying out of coding
Front slide.
2. the physical message system data Lossless Compression transmission side of a kind of use DEFLATE algorithms according to claim 1
Method, it is characterised in that described method is specifically included：
A, from described data flow the content of 64KB is read in in a buffering area, use a variable for strstart functions
In buffering area array, it is moved rearwards by always since 0；Strstart on each position, in the region all before it,
Find and first 3 bytes match of string that current strstart starts string, and attempt to be found from these matching strings most long
Matching string；
If the string that B, current strstart start, it is 3 matching strings of byte, current strstart that can find minimum
The matching length of beginning string so long, it will by the value of a matching length to the distance of matching string beginning to replacing；
If the string that current strstart starts, can not find any is at least 3 matching strings of byte, then current
The place byte of strstart will without modification.
3. the physical message system data Lossless Compression transmission side of a kind of use DEFLATE algorithms according to claim 2
Method, it is characterised in that when described is every time that current string searching matching is gone here and there, found using Hash table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710041161.9A CN106850141A (en) | 2017-01-20 | 2017-01-20 | A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710041161.9A CN106850141A (en) | 2017-01-20 | 2017-01-20 | A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106850141A true CN106850141A (en) | 2017-06-13 |
Family
ID=59119398
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710041161.9A Pending CN106850141A (en) | 2017-01-20 | 2017-01-20 | A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106850141A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107688439A (en) * | 2017-08-15 | 2018-02-13 | 深圳前海信息技术有限公司 | Deflate-based generation method and device of unassociated compressed block |
| CN108441420A (en) * | 2018-05-11 | 2018-08-24 | 南京思达捷信息科技有限公司 | A kind of gene detection system under controller and its method |
| CN112929334A (en) * | 2021-01-20 | 2021-06-08 | 努比亚技术有限公司 | Data transmission method, terminal and storage medium |
| CN115225724A (en) * | 2021-04-21 | 2022-10-21 | 北京特纳飞电子技术有限公司 | Data compression techniques using partitioning and irrelevant bit elimination |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248369A (en) * | 2013-05-21 | 2013-08-14 | 南京畅洋科技有限公司 | Compression system and method based on FPFA (Field Programmable Gate Array) |
| CN104811209A (en) * | 2015-04-22 | 2015-07-29 | 北京理工大学 | Compressed file data embedding method and device capable of resisting longest matching detection |
| CN105187071A (en) * | 2015-09-29 | 2015-12-23 | 东北大学 | Pipeline millisecond online data compound compression/decompression method |
| CN105743509A (en) * | 2016-01-26 | 2016-07-06 | 华为技术有限公司 | Data compression device and method |
| CN105808513A (en) * | 2015-01-19 | 2016-07-27 | 富士通株式会社 | Converting device and converting method |
-
2017
- 2017-01-20 CN CN201710041161.9A patent/CN106850141A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248369A (en) * | 2013-05-21 | 2013-08-14 | 南京畅洋科技有限公司 | Compression system and method based on FPFA (Field Programmable Gate Array) |
| CN105808513A (en) * | 2015-01-19 | 2016-07-27 | 富士通株式会社 | Converting device and converting method |
| CN104811209A (en) * | 2015-04-22 | 2015-07-29 | 北京理工大学 | Compressed file data embedding method and device capable of resisting longest matching detection |
| CN105187071A (en) * | 2015-09-29 | 2015-12-23 | 东北大学 | Pipeline millisecond online data compound compression/decompression method |
| CN105743509A (en) * | 2016-01-26 | 2016-07-06 | 华为技术有限公司 | Data compression device and method |
Non-Patent Citations (1)
| Title |
|---|
| 肖武德: "几种无损数据压缩算法的探讨及在JAVAWeb程序中的应用", 《甘肃科技》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107688439A (en) * | 2017-08-15 | 2018-02-13 | 深圳前海信息技术有限公司 | Deflate-based generation method and device of unassociated compressed block |
| CN108441420A (en) * | 2018-05-11 | 2018-08-24 | 南京思达捷信息科技有限公司 | A kind of gene detection system under controller and its method |
| CN112929334A (en) * | 2021-01-20 | 2021-06-08 | 努比亚技术有限公司 | Data transmission method, terminal and storage medium |
| CN112929334B (en) * | 2021-01-20 | 2023-11-14 | 努比亚技术有限公司 | Data transmission method, terminal and storage medium |
| CN115225724A (en) * | 2021-04-21 | 2022-10-21 | 北京特纳飞电子技术有限公司 | Data compression techniques using partitioning and irrelevant bit elimination |
| CN115225724B (en) * | 2021-04-21 | 2023-04-07 | 北京特纳飞电子技术有限公司 | Data compression techniques using partitioning and irrelevant bit elimination |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106850141A (en) | A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms | |
| CN1671103B (en) | Data compression method and device | |
| Calderbank et al. | Nonequiprobable signaling on the Gaussian channel | |
| CN108156140B (en) | Multi-keyword searchable encryption method supporting numerical value attribute comparison | |
| US4939555A (en) | Trellis coding arrangement | |
| US8704686B1 (en) | High bandwidth compression to encoded data streams | |
| WO2008083046A2 (en) | Data segmentation using shift-varying predicate function fingerprinting | |
| CN105723673B (en) | A kind of high order modulation, demodulating equipment, method and system | |
| JP2004511928A (en) | System and method for progressive and continuous data compression | |
| CN107851118A (en) | Storage, transmission and the compression of sequencing data of future generation | |
| CN106992844B (en) | M-QAM-based digital fountain code degree distribution optimization method | |
| CN108631792B (en) | Method and device for encoding and decoding polarization code | |
| WO2011140930A1 (en) | Data segmentation method and device in data compression | |
| US10897270B2 (en) | Dynamic dictionary-based data symbol encoding | |
| CN105807266A (en) | Compression method for early-warning radar track data transmission | |
| US20220263694A1 (en) | Apparatus for multi-level encoding | |
| CN103152606B (en) | Video file processing method and device, system | |
| US20090256729A1 (en) | Difference coding adaptive context model using counting | |
| CN106791267A (en) | A kind of physical message system data compression transmitting method based on bits compression | |
| CA2984940C (en) | Wireless traffic optimization for ism radios | |
| CN107688439A (en) | Deflate-based generation method and device of unassociated compressed block | |
| CN106850785A (en) | A kind of physical message system data compression transmitting method of use sliding window caching | |
| CN102594504A (en) | Digital signal processor (DSP) hardware implementation method of Luby transform (LT) encoding and decoding algorithm | |
| TW202344015A (en) | Methods and apparatus for signal modulation using lattice-based signal constellations | |
| CN107852240A (en) | A kind of data transmission method for uplink and sending ending equipment based on visible light communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170613 |
|
| RJ01 | Rejection of invention patent application after publication |