CN114070327A - Compression and decompression method for FPGA code stream data - Google Patents
Compression and decompression method for FPGA code stream data Download PDFInfo
- Publication number
- CN114070327A CN114070327A CN202111373243.6A CN202111373243A CN114070327A CN 114070327 A CN114070327 A CN 114070327A CN 202111373243 A CN202111373243 A CN 202111373243A CN 114070327 A CN114070327 A CN 114070327A
- Authority
- CN
- China
- Prior art keywords
- data
- code stream
- row
- compression
- compressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 93
- 238000007906 compression Methods 0.000 title claims abstract description 50
- 230000006835 compression Effects 0.000 title claims abstract description 47
- 230000006837 decompression Effects 0.000 title claims abstract description 44
- 230000011218 segmentation Effects 0.000 claims abstract description 4
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 238000003860 storage Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000013144 data compression Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000005336 cracking Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The invention discloses a compression and decompression method of FPGA code stream data, which comprises the following steps: firstly, acquiring the position of code stream data to be compressed in equipment; analyzing the position of the whole code stream data to be compressed in the equipment, and dividing the code stream data to be compressed into a plurality of data blocks in a row unit according to the position; thirdly, compressing the data block under two conditions that all the data in each row are the same and the individual data in each row are different; the decompression method comprises the following steps: analyzing whether the code stream data can be fully compressed or partially compressed in a segmentation mode, and when the full compression is enabled, decompressing by adopting a partial decompression method; when segmented portion compression is enabled, decompression is performed using a segmented portion decompression method. The invention has higher compression ratio to the code stream data with high repetition rate, can occupy less resources, greatly improves the configuration efficiency and can further carry out confidentiality to the user circuit.
Description
Technical Field
The invention belongs to the technical field of FPGA application, and particularly relates to a compression and decompression method of FPGA code stream data.
Background
In recent years, with the appearance of large-scale and high-performance FPGAs and the improvement of software and hardware design flows and design methods, the reconfigurable system based on the FPGA gradually becomes a new hot spot for the research in the field of computer systems. Hardware information in the reconfigurable system based on the FPGA, namely configuration information of the FPGA can be modified or dynamically called like software by using an advanced EDA tool, so that the system has high performance of hardware calculation and high flexibility of the software.
A reconfigurable system is utilized to realize a computational logic, and the running overhead of the computational logic comprises two parts: the first is the calculation time, i.e. the time used for the actual calculation; the second is the configuration time, i.e. the delay time generated by configuring the internal programmable device. However, with the continuous expansion of the FPGA scale and the continuous enrichment of internal resources, the configuration time becomes longer and longer, and the application of reconfigurable computing is severely restricted. One main part of the FPGA configuration time is consumed in the process of transferring the configuration file from the off-chip memory to the FPGA, so that the scale of the configuration file is reduced, and the FPGA configuration time can be shortened; in addition, the size of the off-chip memory can be reduced, thereby saving system cost.
The compression process of the FPGA code stream data is as shown in fig. 1, and the configuration file generated by the EDA tool is compressed first, and then the compressed configuration file is stored in an off-chip nonvolatile memory (such as a memory based on a Flash process).
The decompression process of the FPGA code stream data is as shown in fig. 2, when the FPGA system needs to configure the file, the system will immediately read the data of the configuration file from the off-chip nonvolatile memory, then obtain the original configuration data stream through on-chip decompression, and directly send the original configuration data stream into the FPGA for configuration.
In the prior art, a dictionary-based compression method is mostly adopted for FPGA code stream data. When a character or a string in the input data stream matches a character or a string in the dictionary, the compressor outputs an identification of the matching location in the dictionary. The purpose of compression can be achieved as long as the number of coded word bits used to represent the corresponding matching position is less than the number of bits of the corresponding matching string in the input data stream. If the design is carefully made, a quite good compression effect can be achieved. The dictionary can be divided into static dictionary compression and dynamic dictionary compression according to whether the dictionary can be updated in the compression process.
A static dictionary is a substantially fixed dictionary that sometimes allows strings to be added, but does not allow strings to be deleted. Dynamic dictionaries are generally based on the empty dictionary, and the content and size of the dictionary is variable during compression.
However, the general dictionary compression and decompression method has the following two defects:
(1) when most of repeated contents exist in the code stream, the compressed code needs to be generated every fixed byte number, and the compression rate is reduced.
(2) Only the storage size and the data transmission time can be reduced, and the configuration time cannot be reduced.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a compression method for FPGA code stream data, which has a higher compression ratio for code stream data with a high repetition rate and can occupy less resources, in view of the above-mentioned deficiencies in the prior art.
In order to solve the technical problems, the invention adopts the technical scheme that: a compression method of FPGA code stream data comprises the following steps:
step one, acquiring the position of code stream data to be compressed in equipment;
analyzing the position of the whole code stream data to be compressed in the equipment, and dividing the code stream data to be compressed into a plurality of data blocks in a row unit according to the position;
and step three, compressing the data block under two conditions that all the data in each row are the same and the individual data in each row are different.
In the third step, the specific method for compressing the data block under the two conditions that all the data in each row are the same and the individual data in each row are different comprises the following steps:
analyzing whether the data of each row of data blocks are all the same, and compressing the data blocks by adopting a method of skipping the whole row when the data of each row of data blocks are all the same; when the data of each row of data blocks are different from each other, compressing the data blocks by adopting a method of skipping in sections;
the method for compressing the data block by adopting the method of skipping the whole line comprises the following steps: when the data of each row of data blocks are all the same, replacing the whole data with a key representing skipping a row of data blocks at the end of the last data block; when the data blocks of the continuous rows of data are the same, replacing the data blocks of the rows of data by keywords representing the data blocks of the rows of data;
the method for compressing the data block by adopting the segment skipping method comprises the following steps: analyzing the data of each row of data blocks, using a certain number of data of each row of data blocks as a group, and replacing the previous groups of data with part of special keywords when the data continuously exceeding the certain group are the same.
The invention also discloses a method for decompressing the FPGA code stream data, which greatly improves the configuration efficiency and can further keep the user circuit secret, and the method comprises the following steps: analyzing whether the code stream data can be fully compressed or partially compressed in a segmentation mode, and when the full compression is enabled, decompressing by adopting a partial decompression method; when the segmented portion compression is enabled, decompressing by adopting a segmented portion decompression method;
the method for decompressing by adopting the partial decompression method comprises the following steps: analyzing a key word representing one row of data blocks and key words representing a plurality of row of data blocks in the code stream data, and controlling addresses and data needing to be skipped during configuration according to the key words and a decompression protocol;
the method for decompressing by adopting the segmented partial decompression method comprises the following steps: and analyzing part of special keywords in the code stream data, and configuring corresponding data and addresses according to the keywords and the decompression protocol.
Compared with the prior art, the invention has the following advantages:
1. compared with the traditional method, the method for compressing and decompressing the FPGA code stream data can compress the code stream with high repetition rate at a higher compression rate, and consumes less time when the FPGA is configured, thereby improving the configuration speed.
2. According to the FPGA code stream data compression method, the data values representing the same data in the uncompressed and non-encrypted code stream are replaced by the keywords of the relevant protocol, so that the purpose of compression is achieved; the size of the code stream file with high repetition rate can be compressed to be smaller, so that the compressed code stream is placed in the off-chip storage device, and less resources can be occupied.
3. According to the FPGA code stream data compression method, the code stream length of each compression is determined by the same data number, and the data with the fixed length does not need to be compressed according to a dictionary, so that the compression rate of code stream data with high repetition rate is higher.
4. According to the FPGA code stream data decompression method, the partial decompression method does not need to decompress the data and then configure the data, the data configuration can be directly skipped according to the decompression method, and the segmented partial decompression method decompresses the segmented compressed data of a certain part and then configures the data at one time, so that the configuration efficiency is greatly improved.
5. The FPGA code stream data decompression method has the advantages that partial contents do not need to be decompressed completely, and the possibility that a user circuit is cracked is reduced, so that the user circuit can be further kept secret.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
Fig. 1 is a schematic diagram of a compression process of FPGA code stream data.
Fig. 2 is a schematic diagram of a decompression process of FPGA code stream data.
Fig. 3 is a schematic flow chart of the compression method of the FPGA code stream data of the present invention.
Fig. 4 is a schematic flow chart of the decompression method of the FPGA code stream data according to the present invention.
Detailed Description
The following describes a compression method of FPGA code stream data according to the present invention with embodiment 1, and a decompression method of FPGA code stream data according to the present invention with embodiment 2.
Example 1
As shown in fig. 3, the method for compressing FPGA code stream data of this embodiment includes the following steps:
step one, acquiring the position of code stream data to be compressed in equipment;
analyzing the position of the whole code stream data to be compressed in the equipment, and dividing the code stream data to be compressed into a plurality of data blocks in a row unit according to the position;
and step three, compressing the data block under two conditions that all the data in each row are the same and the individual data in each row are different.
In this embodiment, the specific method for compressing the data block in the three steps under the two conditions that all the data in each row are the same and that individual data in each row are different includes:
analyzing whether the data of each row of data blocks are all the same, and compressing the data blocks by adopting a method of skipping the whole row when the data of each row of data blocks are all the same; when the data of each row of data blocks are different from each other, compressing the data blocks by adopting a method of skipping in sections;
the method for compressing the data block by adopting the method of skipping the whole line comprises the following steps: when the data of each row of data blocks are all the same, replacing the whole data with a key representing skipping a row of data blocks at the end of the last data block; when the data blocks of the continuous rows of data are the same, replacing the data blocks of the rows of data by keywords representing the data blocks of the rows of data;
the method for compressing the data block by adopting the segment skipping method comprises the following steps: analyzing the data of each row of data blocks, using a certain number of data of each row of data blocks as a group, and replacing the previous groups of data with part of special keywords when the data continuously exceeding the certain group are the same.
The compression of FPGA code stream data is realized on a software level and divided into a full compression method and a segmented partial compression method, when the data block is compressed by adopting the full compression method, the data of the whole data block is directly skipped, and the address is directly skipped, namely, the skipping configuration is carried out; when the data block is compressed by adopting a method of segmented partial compression, the whole part cannot be skipped because individual data in the data block are different, the method of segmented partial compression is adopted for the part of data, and a certain group of identical data in the data block is replaced by a part of special keywords for compression. According to the FPGA code stream data compression method, the data values representing the same data in the uncompressed and non-encrypted code stream are replaced by the keywords of the relevant protocol, so that the purpose of compression is achieved; the size of the code stream file with high repetition rate can be compressed to be smaller, so that the compressed code stream is placed in the off-chip storage device, and less resources can be occupied.
The compression method of FPGA code stream data of the invention does not need a dictionary, and can compress a larger data volume with fewer keywords; moreover, the code stream length of each compression of the compression method is determined by the same data number, and the data with fixed length does not need to be compressed according to a dictionary, so that the compression rate of the code stream data with high repetition rate is higher; the invention not only reduces the configuration time from the file size and data transmission, but also reduces the configuration time from the internal configuration efficiency.
Example 2
As shown in fig. 4, the method for decompressing FPGA code stream data of this embodiment includes: analyzing whether the code stream data can be fully compressed or partially compressed in a segmentation mode, and when the full compression is enabled, decompressing by adopting a partial decompression method; when the segmented portion compression is enabled, decompressing by adopting a segmented portion decompression method;
the method for decompressing by adopting the partial decompression method comprises the following steps: analyzing a key word representing one row of data blocks and key words representing a plurality of row of data blocks in the code stream data, and controlling addresses and data needing to be skipped during configuration according to the key words and a decompression protocol;
the method for decompressing by adopting the segmented partial decompression method comprises the following steps: and analyzing part of special keywords in the code stream data, and configuring corresponding data and addresses according to the keywords and the decompression protocol.
The decompression of FPGA code stream data is realized on a software level, the decompression is carried out according to two conditions of full compression and segmented partial compression corresponding to a compression method, the partial decompression method does not need to carry out configuration after data decompression, the data configuration can be directly skipped according to the decompression method, and the segmented partial decompression method carries out one-time configuration after some part of segmented compressed data is decompressed, so that the configuration efficiency is greatly improved.
The decompression method in the invention has the advantages that partial content does not need to be decompressed completely, and the possibility of cracking the user circuit is reduced, so that the user circuit can be further kept secret.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing descriptions of specific exemplary embodiments of the present invention have been presented for purposes of illustration and description. It is not intended to limit the invention to the precise form disclosed, and obviously many modifications and variations are possible in light of the above teaching. The exemplary embodiments were chosen and described in order to explain certain principles of the invention and its practical application to enable one skilled in the art to make and use various exemplary embodiments of the invention and various alternatives and modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims and their equivalents.
Claims (3)
1. A compression method of FPGA code stream data is characterized by comprising the following steps:
step one, acquiring the position of code stream data to be compressed in equipment;
analyzing the position of the whole code stream data to be compressed in the equipment, and dividing the code stream data to be compressed into a plurality of data blocks in a row unit according to the position;
and step three, compressing the data block under two conditions that all the data in each row are the same and the individual data in each row are different.
2. The method for compressing FPGA code stream data according to claim 1, characterized in that: in the third step, the specific method for compressing the data block under the two conditions that all the data in each row are the same and the individual data in each row are different is as follows:
analyzing whether the data of each row of data blocks are all the same, and compressing the data blocks by adopting a method of skipping the whole row when the data of each row of data blocks are all the same; when the data of each row of data blocks are different from each other, compressing the data blocks by adopting a method of skipping in sections;
the method for compressing the data block by adopting the method of skipping the whole line comprises the following steps: when the data of each row of data blocks are all the same, replacing the whole data with a key representing skipping a row of data blocks at the end of the last data block; when the data blocks of the continuous rows of data are the same, replacing the data blocks of the rows of data by keywords representing the data blocks of the rows of data;
the method for compressing the data block by adopting the segment skipping method comprises the following steps: analyzing the data of each row of data blocks, using a certain number of data of each row of data blocks as a group, and replacing the previous groups of data with part of special keywords when the data continuously exceeding the certain group are the same.
3. A method for decompressing FPGA code stream data using the compression method according to claim 2, the method comprising: analyzing whether the code stream data can be fully compressed or partially compressed in a segmentation mode, and when the full compression is enabled, decompressing by adopting a partial decompression method; when the segmented portion compression is enabled, decompressing by adopting a segmented portion decompression method;
the method for decompressing by adopting the partial decompression method comprises the following steps: analyzing a key word representing one row of data blocks and key words representing a plurality of row of data blocks in the code stream data, and controlling addresses and data needing to be skipped during configuration according to the key words and a decompression protocol;
the method for decompressing by adopting the segmented partial decompression method comprises the following steps: and analyzing part of special keywords in the code stream data, and configuring corresponding data and addresses according to the keywords and the decompression protocol.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111373243.6A CN114070327A (en) | 2021-11-19 | 2021-11-19 | Compression and decompression method for FPGA code stream data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111373243.6A CN114070327A (en) | 2021-11-19 | 2021-11-19 | Compression and decompression method for FPGA code stream data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114070327A true CN114070327A (en) | 2022-02-18 |
Family
ID=80278198
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111373243.6A Pending CN114070327A (en) | 2021-11-19 | 2021-11-19 | Compression and decompression method for FPGA code stream data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114070327A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09289591A (en) * | 1996-04-23 | 1997-11-04 | Canon Inc | Image encoding device, image decoding device, and their method |
| CN1567378A (en) * | 2003-06-24 | 2005-01-19 | 德鑫科技股份有限公司 | Compressing and decompressing method of digital image data |
| CN112713899A (en) * | 2020-12-18 | 2021-04-27 | 广东高云半导体科技股份有限公司 | Compression method and device for FPGA code stream data and storage medium |
-
2021
- 2021-11-19 CN CN202111373243.6A patent/CN114070327A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09289591A (en) * | 1996-04-23 | 1997-11-04 | Canon Inc | Image encoding device, image decoding device, and their method |
| CN1567378A (en) * | 2003-06-24 | 2005-01-19 | 德鑫科技股份有限公司 | Compressing and decompressing method of digital image data |
| CN112713899A (en) * | 2020-12-18 | 2021-04-27 | 广东高云半导体科技股份有限公司 | Compression method and device for FPGA code stream data and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| MARCO DELLA TORRE ET.AL: "A Configuration System Architecture Supporting Bit-Stream Compression for FPGAs", ACSAC 2005, 31 December 2005 (2005-12-31), pages 415 - 428, XP019022376 * |
| 解维坤 等: "FPGA测试压缩技术研究", 电子与封装, vol. 18, no. 5, 31 May 2018 (2018-05-31), pages 9 - 10 * |
| 邢虹 等: "一种FPGA 配置文件压缩算法", 计算机工程, vol. 34, no. 11, 30 June 2008 (2008-06-30), pages 260 - 262 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107609644B (en) | Method and system for data analysis in a state machine | |
| CN106852185B (en) | Parallelly compressed encoder based on dictionary | |
| WO2020025006A1 (en) | Data compression and decompression method and related apparatus, electronic device, and system | |
| CN108256164B (en) | Boolean logic in a state machine lattice | |
| US7538695B2 (en) | System and method for deflate processing within a compression engine | |
| CN103326732B (en) | The method of compression data, the decompression method of data, encoder | |
| CN106549673B (en) | Data compression method and device | |
| CN108287877B (en) | FPGA (field programmable Gate array) compression/decompression system and hardware decompression method for RIB (run in Box) rendering compressed file | |
| EP3094004A1 (en) | Hardware data compressor using dynamic hash algorithm based on input block type | |
| US9094039B2 (en) | Efficient deflate decompression | |
| JP2009542092A (en) | Data compression method | |
| TW201706998A (en) | Hardware data compressor that directly huffman encodes output tokens from LZ77 engine | |
| Andrzejewski et al. | GPU-WAH: Applying GPUs to compressing bitmap indexes with word aligned hybrid | |
| TW201640832A (en) | Hardware data compressor that pre-Huffman encodes to decide whether to Huffman encode a matched string or a back pointer thereto | |
| US9137336B1 (en) | Data compression techniques | |
| Kim et al. | Data dependency reduction for high-performance FPGA implementation of DEFLATE compression algorithm | |
| CN117493386B (en) | Database access method and device, storage medium and electronic equipment | |
| CN103198127B (en) | Large files sort method and system | |
| US7167115B1 (en) | Method, apparatus, and computer-readable medium for data compression and decompression utilizing multiple dictionaries | |
| Shcherbakov et al. | A parallel adaptive range coding compressor: algorithm, FPGA prototype, evaluation | |
| Gao et al. | FPGA bitstream compression and decompression based on LZ77 algorithm and BMC technique | |
| US9197243B2 (en) | Compression ratio for a compression engine | |
| CN114070327A (en) | Compression and decompression method for FPGA code stream data | |
| CN111832257A (en) | Conditional transcoding of encoded data | |
| CN111427857B (en) | FPGA configuration file compression and decompression method based on partition reference technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |