TWI758825B - Method and device of compressing configuration data, and method and device of decompressing configuration data - Google Patents

Abstract

A method of compressing configuration data is provided. The configuration data is pre-compressed data used in a reconfigurable processor. The pre-compressed data includes a number of data blocks. The method includes obtaining a current data block used in the reconfigurable processor, and calculating a current CRC of the current data block. The method further includes comparing the current CRC with a previous CRC, indicating that a tag of the current data block is a first tag if the current CRC is different from the previous CRC, and indicating that the tag of the current data block is a second tag if the current CRC is the same as the previous CRC. The method further includes saving the data block with the first tag. A device of compressing configuration data, a method of decompressing configuration data, a device of decompressing configuration data are also provided.

Description

Method and device for compressing data, method and device for decompressing data

The present invention relates to the technical field of data processing, in particular to a method and device for compressing data, and a method and device for decompressing data.

At present, the data in the reconfigurable processor can be very large, and a large amount of traffic is generated when the data is transferred. Meanwhile, a reconfigurable processor is hardware capable of rapidly processing multiple functional units of large-scale functions, and a reconfigurable processor usually stores data in a configuration memory. However, due to the large number of functional units in the reconfigurable processor, the length of the data is also very long, which will cause the configuration memory to occupy a larger area of the reconfigurable processor. Therefore, a suitable method for compressing data and decompressing data is needed to avoid the large amount of data transmission caused by the large amount of data and the configuration memory occupying the reconfigurable processor due to the long data volume. larger area.

In view of this, it is necessary to provide a method and device for compressing data, and a method and device for decompressing data, which can avoid the large amount of data transmission caused by the large amount of data and the configuration memory occupation caused by the long data. Larger area of a reconfigurable processor.

A first aspect of the present application provides a method for compressing data. The data is to-be-compressed data used in a reconfigurable processor, and the to-be-compressed data has a plurality of data blocks. The method includes:

Get the current data block used in the reconfigurable processor;

Calculate the current check code of the current data block;

Compare the current check code with the previous check code;

If the current check code is different from the previous check code, marking the label of the current data block as the first label;

If the current check code is the same as the previous check code, marking the label of the current data block as the second label;

The data block whose label is the first label is reserved.

Preferably, the method also includes:

Data blocks with the label second label are ignored.

Preferably, the first label is 1, and the second label is 0.

Preferably, the data block is obtained by the reconfigurable processor according to a predetermined data size.

Preferably, the method also includes:

If the current check code is the current check code of the first current data block, the preset current check code is different from the previous check code.

Preferably, the label indicating the current data block includes:

Label the current data block in the order of acquisition time;

The data block whose reserved tag is the first tag includes:

The data block whose label is the first label is reserved in the order of acquisition time.

A second aspect of the present application provides a method for decompressing data, the data being to-be-decompressed data used in a reconfigurable processor, the method comprising:

receiving data blocks and tags to be decompressed in the reconfigurable processor;

Get the current tag from the tag;

If the current tag is the first tag, obtain the data block corresponding to the current tag from the data block to be decompressed;

If the current tag is the second tag, the data block corresponding to the tag of the first tag that is closest to the current tag is obtained from the data block to be decompressed.

Preferably, the obtaining the current label from the label includes:

The current tags are acquired one by one from the tags in the order of tag marking.

A third aspect of the present application provides an apparatus for compressing data, the data being data to be compressed for use in a reconfigurable processor, the apparatus includes a processor and a memory, the processor is configured to execute the data in the memory The stored at least one instruction implements the method of compressing data as described in any of the above.

A fourth aspect of the present application provides an apparatus for decompressing data, the data being data to be decompressed for use in a reconfigurable processor, the apparatus comprising a processor and a memory, the processor being used to execute the memory At least one instruction stored in the body implements the method of decompressing data as described in any of the above.

In this case, the current data block used in the reconfigurable processor is obtained, the current check code of the current data block is calculated, and the current check code and the previous check code are compared. If the code is different, the label indicating the current data block is the first label. If the current check code is the same as the previous check code, the label indicating the current data block is the second label, and the reserved label is the first label. data block. At the same time, in this case, the data can be compressed without distortion without a statistical model, and a lot of hardware costs can be saved. In addition, the method of compressing data can not only be used alone, but also can be used simultaneously with other known methods of compressing data, so that the speed of compression can be improved.

In this case, by receiving the data block to be decompressed and each label in the reconfigurable processor, the current label is obtained from the label, and if the current label is the first label, the data block to be decompressed is obtained from the data block. Acquire the data block corresponding to the current tag, and if the current tag is the second tag, acquire the data block corresponding to the tag of the first tag before the current tag from the data block to be decompressed. Thus, in this case, the data can be decompressed without a distortion without a statistical model. In addition, the method for decompressing data can not only be used alone, but also can be used simultaneously with other known methods for decompressing data, so that the speed of decompression can be improved.

In order to more clearly understand the above objects, features and advantages of the present invention, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features of the embodiments may be combined with each other without conflict.

In the following description, many specific details are set forth in order to facilitate a full understanding of the present invention, and the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terms used herein in the description of the present invention are for the purpose of describing specific embodiments only, and are not intended to limit the present invention.

FIG. 1 is a flowchart of a method for compressing data provided by Embodiment 1 of the present invention. The data is data to be compressed for use in the reconfigurable processor, and the data to be compressed has a plurality of data blocks. The method of compressing data may include the following steps:

S11: Acquire the current data block used in the reconfigurable processor.

The acquiring the current data block used in the reconfigurable processor includes: when receiving the data to be compressed, acquiring the current data block used in the reconfigurable processor. The receiving of the data to be compressed may be that the reconfigurable processor receives the data to be compressed from an external element, or it may be that one element in the reconfigurable processor receives the data to be compressed from another element . The data to be compressed may include configuration data and network parameters. When receiving the data to be compressed, obtaining the current data block used in the reconfigurable processor may be:

For example, when receiving the initial 10 consecutive data of the data to be compressed, the current data block is obtained from the beginning of receiving the data to be compressed to the 10th data received. When receiving the 11th to 20th data of the data to be compressed, The data obtained from the 11th to the 20th time is the current data block. Wherein, the current data block composed of the 10 data obtained initially and the current data block composed of the 10 data obtained for the second time may be the same or different. For example, as shown in FIG. 2A , FIG. 2A shows the current data block acquired during the data transmission process. In FIG. 2A , the current data block A is the first data block obtained, the current data block B is the second data block obtained, the current data block C is the third data block obtained, and the current data block D is the obtained data block The fourth data block, the current data block E is the fifth data block obtained. The current data block B is the same as the current data block A, the current data block C is different from the current data block B, the current data block D is the same as the current data block C, and the current data block E is the same as the current data block D.

In this embodiment, the data block is obtained by the reconfigurable processor according to a predetermined data size. In this embodiment, the method further includes: if the data size of the last remaining data block of the data to be compressed is smaller than the predetermined data size, acquiring the last remaining data block of the data to be compressed is the current data block.

S12: Calculate the current check code of the current data block.

The calculating the current check code of the current data block includes calculating the current check code of the current data block by a CRC check code circuit. Wherein, when the current data blocks are the same, the current check codes are also the same, and when the current data blocks are different, the current check codes are also different. For example, as shown in FIG. 2B, FIG. 2B shows the current check codes of different current data blocks in FIG. 2A. In FIG. 2B, the current check code a of the current data block A is CRC1, the current check code b of the current data block B is CRC1, the current check code c of the current data block C is CRC2, and the current data block D of the current The check code d is CRC2, and the current check code e of the current data block E is CRC2.

In this case, since the current data block used in the reconfigurable processor is obtained when the data to be compressed is received, the current check code can be generated synchronously when the data to be compressed is received. Thus, the delay time is reduced, so that in the process of data processing, the consistency of the data is maintained.

S13: Compare the current check code with the previous check code.

The comparing the current check code and the previous check code may include comparing whether the current check code and the previous check code are completely identical and substantially the same. The substantial sameness can be determined by a preset rule. For example, there are differences in fonts and font sizes, which can be set to be substantially the same.

S14: If the current check code is different from the previous check code, mark the label of the current data block as the first label.

The difference between the current check code and the previous check code means that the current data block corresponding to the current check code is different from the previous data block corresponding to the previous check code. The different includes completely different and substantially different. The method further includes: if the current check code is the current check code of the first current data block, presetting the current check code to be different from the previous check code.

S15: If the current check code is the same as the previous check code, mark the label of the current data block as the second label.

The fact that the current check code is the same as the previous check code means that the current data block corresponding to the current check code is the same as the previous data block corresponding to the previous check code. The identical includes identical and substantially identical.

For example, if the current check code of the current data block obtained at the 60th time is the same as the check code before the previous data block obtained at the 59th time, the label of the current data block obtained at the 60th time is the second label. The current check code of the current data block obtained at the 61st time is the same as the check code before the previous data block obtained at the 60th time, and the label of the current data block obtained at the 61st time is the second label.

In this embodiment, the labeling of the current data block includes: labeling the current data block in order of acquisition time. The tags of the current data block indicated in the order of acquisition time include the tag of the current data block which is the first tag and the tag of the current data block which is the second tag. Therefore, the tags of the current data block are marked in the order of the acquisition time of the current data block. In this embodiment, the first label is 1, and the second label is 0. For example, as shown in FIG. 3A, FIG. 3A shows the label of each current data block in FIG. 2A marked. In FIG. 3A, the label 100 of the current data block A is 1, the label 200 of the current data block B is 0, the label 300 of the current data block C is 1, the label 400 of the current data block D is 0, and the current data block E The label 500 is 0. Among them, the tag 1 of the current data block A is stored in front of the tag 0 of the current data block B, the tag 0 of the current data block B is stored in front of the tag 1 of the current data block C, and the tag 1 of the current data block C is stored in the current Before the label 0 of the data block D, the label 0 of the current data block D is stored before the label 0 of the current data block E. In other embodiments, the first label is 0 and the second label is 1.

S16: The data block whose label is the first label is reserved.

The data block whose label is the first label is a data block different from the previous data block. The reserving the data block with the first tag includes: reserving the data block with the first tag in the order of acquisition time. Therefore, the data blocks whose label is the first label are reserved in the order of the acquisition time of the data blocks. For example, as shown in FIG. 3B , FIG. 3B shows the remaining data block with the label of the first label in FIG. 3A . In FIG. 3B, the data block A labeled as the first label is stored before the data block C labeled as the first label.

In this embodiment, the method further includes:

Data blocks with the label second label are ignored.

The data block whose label is the second label is the same data block as the previous data block. The data block whose label is the second label is ignored is the data block whose label is the second label is not reserved.

Embodiment 1 Obtain the current data block used in the reconfigurable processor, calculate the current check code of the current data block, and compare the current check code with the previous check code. If the check codes are different, the label indicating the current data block is the first label. If the current check code is the same as the previous check code, the label indicating the current data block is the second label, and the reserved label is the first label. The data block of the label. Therefore, this case can avoid the large amount of data transmission caused by the large amount of data, and the large area of the reconfigurable processor caused by the configuration memory occupying a large area caused by the long data. At the same time, in this case, the data can be compressed without distortion without a statistical model, and only the CRC check code circuit can be used to compress the data, which saves a lot of hardware costs. In addition, the method of compressing data can not only be used alone, but also can be used simultaneously with other known methods of compressing data, such as statistical scheme or dictionary scheme, so as to improve the speed of compression.

FIG. 4 is a flowchart of a method for decompressing data provided by Embodiment 2 of the present invention. The data is the data to be decompressed for use in the reconfigurable processor. The method of decompressing data may include the following steps:

S41: Receive the data block and each tag to be decompressed in the reconfigurable processor.

The receiving of the data block to be decompressed in the reconfigurable processor may be an external element receiving the data block to be decompressed in the reconfigurable processor from the reconfigurable processor, or it may be the reconfigurable processor. One element within the reconstruction processor receives from another element the block of data to be decompressed in the reconfigurable processor. The receiving of the data blocks and labels to be decompressed in the reconfigurable processor may be, for example, receiving the data blocks retained in the reconfigurable processor and the labels shown in FIG. 3A as shown in FIG. 3B .

S42: Obtain the current label from the label.

The acquiring the current tag from the tags includes: acquiring the current tags one by one from the tags in the order of tag marking. For example, as shown in FIG. 3A, the first label is label 100, the second label is label 200, the third label is label 300, the fourth label is label 400, and the fifth label is label 500. The acquisition of the current tags from the tags one by one in the order of tag marking may be, for example, the value 1 of the tag 100 acquired in the first second is the current tag, and the value of the tag 200 acquired in the 11th second is 0. the current label.

S43: If the current tag is the first tag, obtain the data block corresponding to the current tag from the data block to be decompressed.

If the current tag is 1, it means that the current data block corresponding to the current tag is different from the previous data block. At this time, the data block corresponding to the current tag is stored in the compressed data block. For example, as shown in FIG. 5, FIG. 5 shows the data block after decompression of the compressed data block shown in FIG. 3B. In FIG. 5 , if the first tag 100 is the current tag, at this time, the data block A corresponding to the first tag 100 is obtained from the compressed data block shown in FIG. 3B . The size of the data block corresponding to each label is basically the same. Specifically, the data blocks of the data blocks to be decompressed except the last data block have the same data size, and each may be the same as or different from the data size of the last data block in the data blocks to be decompressed. same.

S44: If the current tag is the second tag, obtain the data block corresponding to the tag of the first tag before the current tag from the data block to be decompressed.

The fact that the current label is the second label means that the current data block corresponding to the current label is the same as the previous data block. Wherein, the current data block may not only be the same as the previous data block, but also may be the same as the previous two data blocks or the previous N data blocks. The N is any integer greater than two. The label that is the first label before the current label can be, for example, as shown in FIG. 5 , the current label is label 500. At this time, the label that is the first label most recently before the label 500 is 300, and this , the data block C corresponding to the tag 300 that is the first tag before the tag 500 is obtained from the reserved data block shown in FIG. 3B .

The second embodiment obtains the current label from the label by receiving the data block and each label to be decompressed in the reconfigurable processor, and if the current label is the first label, obtains the current label from the data to be decompressed Obtain the data block corresponding to the current tag from the block, and if the current tag is the second tag, obtain the data block corresponding to the tag of the first tag before the current tag from the data block to be decompressed . Thus, in this case, the data can be decompressed without a distortion without a statistical model. In addition, the method of decompressing data can not only be used alone, but also can be used simultaneously with other known methods of decompressing data, such as statistical scheme or dictionary scheme, so that the speed of decompression can be improved.

FIG. 6 is a block diagram of an apparatus for compressing data provided by Embodiment 3 of the present invention. The apparatus 6 for compressing data includes a memory 61 , at least one processor 62 , and computer-readable instructions 63 stored in the memory 61 and executable on the at least one processor 62 . When the at least one processor 62 executes the computer-readable instructions 63, the steps in the above-described method embodiments for compressing data are implemented.

Exemplarily, the computer readable instructions 63 may be divided into one or more modules/units, the one or more modules/units are stored in the memory 61, and the at least one The processor 62 executes to complete the application. The one or more modules/units may be a series of computer-readable instruction segments capable of accomplishing specific functions, and the instruction segments are used to describe the execution process of the computer-readable instructions 63 in the device 6 for compressing data .

The device 6 for compressing data can be any product, such as a decoder, a reconfigurable processor, and the like. Those skilled in the art can understand that the schematic diagram 6 is only an example of the device 6 for compressing data, and does not constitute a limitation to the device 6 for compressing data, and may include more or less components than the one shown, or combine some parts, or different parts.

The at least one processor 62 may be a central processing unit (Central Processing Unit, CPU), and may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The processor 62 can be a microprocessor or the processor 62 can also be any conventional processor, etc. The processor 62 is the control center of the device 6 for compressing data, and uses various interfaces and lines to connect the entire compressed data various parts of the equipment 6.

The memory 61 can be used to store the computer-readable instructions 63 and/or modules/units, and the processor 62 executes or executes the computer-readable instructions and/or modules stored in the memory 61. Groups/units, as well as calling the data stored in the memory 61, realize various functions of the device 6 for compressing the data. The memory 61 may mainly include a storage program area and a storage data area, wherein the storage program area may store the operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; storage data The area may store data (such as audio data, etc.) created according to the use of the device 6 for compressing the data, and the like. In addition, the memory 61 may include non-volatile computer readable memory such as hard disk, memory, plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card , a flash memory card (Flash Card), at least one disk memory device, flash memory device, or other non-volatile solid state memory device. If the modules/units integrated in the device 6 for compressing data are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium.

FIG. 7 is a block diagram of a device for decompressing data provided by Embodiment 4 of the present invention. The apparatus 7 for decompressing data includes a memory 71 , at least one processor 72 , and computer-readable instructions 73 stored in the memory 71 and executable on the at least one processor 72 . When the at least one processor 72 executes the computer-readable instructions 73, the steps of the above-described method embodiments for compressing data are implemented.

Exemplarily, the computer-readable instructions 73 may be divided into one or more modules/units, the one or more modules/units are stored in the memory 71, and the at least one The processor 72 executes to complete the application. The one or more modules/units may be a series of computer readable instruction segments capable of performing specific functions, the instruction segments being used to describe the execution of the computer readable instructions 73 in the device 7 for decompressing data process.

The device 7 for decompressing data can be any product, such as a decoder, a reconfigurable processor, and the like. Those skilled in the art can understand that the schematic diagram 7 is only an example of the device 7 for decompressing data, and does not constitute a limitation on the device 7 for decompressing data, and may include more or less components than those shown in the figure, or combinations thereof some parts, or different parts.

The at least one processor 72 may be a central processing unit (Central Processing Unit, CPU), and may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The processor 72 can be a microprocessor or the processor 72 can also be any conventional processor, etc. The processor 72 is the control center of the device 7 for decompressing data, and uses various interfaces and lines to connect the entire decompression Parts of equipment 7 for compressing data.

The memory 71 can be used to store the computer-readable instructions 73 and/or modules/units, and the processor 72 executes or executes the computer-readable instructions and/or modules stored in the memory 71. Groups/units, as well as calling the data stored in the memory 71, realize various functions of the device 7 for decompressing the data. The memory 71 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; storage data The area may store data (such as audio data, etc.), etc., created according to the use of the device 7 for decompressing the data. In addition, the memory 71 may include non-volatile computer readable memory such as hard disk, memory, plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card , a flash memory card (Flash Card), at least one disk memory device, flash memory device, or other non-volatile solid state memory device. If the modules/units integrated in the device 7 for decompressing data are implemented in the form of software functional units and sold or used as independent products, they may be stored in a non-volatile computer-readable storage medium.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be Modifications or equivalent substitutions can be made without departing from the spirit and scope of the technical solutions of the present invention.

S11: Get the current data block used in the reconfigurable processor S12: Calculate the current check code of the current data block S13: Compare the current check code with the previous check code S14: If the current check code is different from the previous check code, mark the label of the current data block as the first label S15: If the current check code is the same as the previous check code, mark the label of the current data block as the second label S16: Keep the data block whose label is the first label S41: Receive data blocks and tags to be decompressed in the reconfigurable processor S42: Get the current label from the label S43: If the current tag is the first tag, obtain the data block corresponding to the current tag from the data block to be decompressed S44: If the current tag is the second tag, obtain the data block corresponding to the tag of the first tag before the current tag from the data block to be decompressed 6: Equipment for compressing data 7: Equipment for decompressing data 61,71: memory 62,72: Processor 63,73: Computer-readable instructions

FIG. 1 is a flowchart of a method for compressing data provided by Embodiment 1 of the present invention. FIG. 2A shows current data blocks acquired at different times; FIG. 2B shows current check codes of different current data blocks in FIG. 2A . FIG. 3A is a schematic diagram of a label indicating each current data block in FIG. 2A ; FIG. 3B is a schematic diagram of a data block whose reserved label is the first label in FIG. 3A . FIG. 4 is a flowchart of a method for decompressing data provided by Embodiment 2 of the present invention. FIG. 5 is a decompressed data block of the reserved data block shown in FIG. 3B. FIG. 6 is a block diagram of an apparatus for compressing data provided by Embodiment 3 of the present invention. FIG. 7 is a block diagram of a device for decompressing data provided by Embodiment 4 of the present invention.

without

S11: Get the current data block used in the reconfigurable processor S12: Calculate the current check code of the current data block S13: Compare the current check code with the previous check code S14: If the current check code is different from the previous check code, mark the label of the current data block as the first label S15: If the current check code is the same as the previous check code, mark the label of the current data block as the second label S16: Keep the data block whose label is the first label

Claims (10)

A method for compressing data, the data is data to be compressed used in a reconfigurable processor, and the data to be compressed has a plurality of data blocks, wherein the method includes: Get the current data block used in the reconfigurable processor; Calculate the current check code of the current data block; Compare the current check code with the previous check code; If the current check code is different from the previous check code, marking the label of the current data block as the first label; If the current check code is the same as the previous check code, marking the label of the current data block as the second label; The data block whose label is the first label is reserved. The method for compressing data according to claim 1, wherein the method further comprises: Data blocks with the label second label are ignored. The method for compressing data according to claim 1, wherein the first tag is 1, and the second tag is 0. The method for compressing data according to claim 1, wherein the data block is obtained by the reconfigurable processor according to a predetermined data size. The method for compressing data according to claim 1, wherein the method further comprises: If the current check code is the current check code of the first current data block, the preset current check code is different from the previous check code. The method of compressing data as described in claim 1, wherein: The label identifying the current data block includes: Label the current data block in the order of acquisition time; The data block whose reserved tag is the first tag includes: The data block whose label is the first label is reserved in the order of acquisition time. A method of decompressing data, the data is to-be-decompressed data used in a reconfigurable processor, wherein the method comprises: receiving data blocks and tags to be decompressed in the reconfigurable processor; Get the current tag from the tag; If the current tag is the first tag, obtain the data block corresponding to the current tag from the data block to be decompressed; If the current tag is the second tag, the data block corresponding to the tag of the first tag that is closest to the current tag is obtained from the data block to be decompressed. The method for decompressing data according to claim 7, wherein the obtaining the current tag from the tag comprises: The current tags are acquired one by one from the tags in the order of tag marking. A device for compressing data, the data is data to be compressed for use in a reconfigurable processor, wherein the device includes a processor and a memory, the processor is used to execute at least one instruction stored in the memory When implementing the method of compressing data as described in any one of claims 1 to 6. A device for decompressing data, the data is data to be decompressed for use in a reconfigurable processor, wherein the device includes a processor and a memory, the processor is used to execute at least one stored in the memory A single instruction implements the method for decompressing data as described in any one of claims 7 to 8.

Images