CN113360314A - Data processing method, system, equipment and computer readable storage medium - Google Patents

Data processing method, system, equipment and computer readable storage medium Download PDF

Info

Publication number
CN113360314A
CN113360314A CN202010135848.0A CN202010135848A CN113360314A CN 113360314 A CN113360314 A CN 113360314A CN 202010135848 A CN202010135848 A CN 202010135848A CN 113360314 A CN113360314 A CN 113360314A
Authority
CN
China
Prior art keywords
compressed data
data
compressed
processing
length information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010135848.0A
Other languages
Chinese (zh)
Other versions
CN113360314B (en
Inventor
何星宏
李永亮
丁宁
叶婷
张巍
吴文杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Verisilicon Holdings Co ltd
VeriSilicon Microelectronics Shanghai Co Ltd
VeriSilicon Microelectronics Chengdu Co Ltd
Original Assignee
Verisilicon Holdings Co ltd
VeriSilicon Microelectronics Shanghai Co Ltd
VeriSilicon Microelectronics Chengdu Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Verisilicon Holdings Co ltd, VeriSilicon Microelectronics Shanghai Co Ltd, VeriSilicon Microelectronics Chengdu Co Ltd filed Critical Verisilicon Holdings Co ltd
Priority to CN202010135848.0A priority Critical patent/CN113360314B/en
Publication of CN113360314A publication Critical patent/CN113360314A/en
Application granted granted Critical
Publication of CN113360314B publication Critical patent/CN113360314B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1008Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
    • G06F11/1048Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices using arrangements adapted for a specific error detection or correction feature
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Detection And Correction Of Errors (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

The invention provides a data processing method, a system, equipment and a computer readable storage medium, wherein the data processing method comprises the following steps: when a decompression request is to be initiated, judging whether compressed data needs to be corrected or not; if not, correcting the compressed data, and turning to the next step; if yes, outputting the compressed data, and turning to the next step; judging whether the compressed data needs error correction; if yes, performing error correction operation corresponding to the key information of the compressed data so as to decompress the compressed data; and if not, directly decompressing the compressed data. The invention can effectively avoid the problem of chip locking caused by key information loss, and can not cause too large area consumption to the system and has no adverse effect on the system performance.

Description

Data processing method, system, equipment and computer readable storage medium
Technical Field
The present invention relates to a processing method and system, and in particular, to a data processing method, system, device, and computer readable storage medium.
Background
Under the background of the increasing development of very large scale integrated circuits, the data volume processed by a system and the complexity of the system are multiplied, the application scenes of an electronic system are also increasingly complex, and various interferences are more difficult to expect. In the image compression and decompression system of the graphics chip, the compression result sent by the compression algorithm core contains all information needed in the decompression process. In the process, if interference factors occur or some modules of the system are in error to cause some information to be illegally modified, which causes that the compressed data is in error when being sent into the decompression module, a bit is inverted, and at the moment, the data transmitted into the decompression core cannot be analyzed to obtain correct original data. If the bit of the decompressed data error appears at the critical place, the decompression core will be locked due to the wrong critical data if the method is not applied.
Therefore, the decompression core is highly sensitive to data, and an error in any one of the data transmission, calculation and storage processes can have a significant effect on the image compression core and even cause a system downtime.
Therefore, how to provide a data processing method, system, device and computer readable storage medium to solve the defects of poor data fault tolerance and poor error correction capability in the graphics compression and decompression processes in the prior art has become a technical problem to be solved by those skilled in the art.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide a method, a system, a device and a computer readable storage medium for processing data, which are used to solve the problems of poor data error tolerance and poor error correction capability during the compression and decompression of graphics in the prior art.
To achieve the above and other related objects, an aspect of the present invention provides a data processing method, including: when a decompression request is to be initiated, judging whether compressed data needs to be corrected or not; if yes, correcting the compressed data, and turning to the next step; if not, outputting the compressed data, and turning to the next step; judging whether the compressed data needs error correction; if yes, performing error correction operation corresponding to the key information of the compressed data so as to decompress the compressed data; and if not, directly decompressing the compressed data.
In an embodiment of the present invention, the data processing method further includes: and initiating a compression request, compressing the data to be compressed, generating compressed data and generating a check code associated with the compressed data.
In an embodiment of the present invention, the data processing method further includes: and storing the compressed data and the check code.
In an embodiment of the present invention, the step of determining whether the compressed data needs to be corrected includes: and comparing the compressed data with the check code associated with the compressed data to judge whether the compressed data is consistent with the check code.
In an embodiment of the present invention, the step of determining whether the compressed data further needs error correction includes: and judging whether the key information of the compressed data is consistent with the expected information of the compressed data.
In an embodiment of the present invention, the key information of the compressed data is current length information of the compressed data; the expected information of the compressed data is expected length information of the compressed data; the condition that the key information of the compressed data is not in line with the expected information of the compressed data comprises: the current length information of the compressed data is longer than the expected length information of the compressed data; the current length information of the compressed data is shorter than the expected length information of the compressed data.
In an embodiment of the present invention, the step of performing an error correction operation corresponding to the key information of the compressed data includes: if the current length information of the compressed data is shorter than the expected length information of the compressed data, discarding the compressed data; and if the current length information of the compressed data is longer than the expected length information of the compressed data, performing zero padding on the compressed data.
Another aspect of the present invention provides a system for processing data, including: the first processing module is used for judging whether the compressed data needs to be corrected or not when a decompression request is to be initiated; if not, correcting the compressed data; if yes, outputting the compressed data; the second processing module is used for judging whether the compressed data needs error correction; if yes, performing error correction operation corresponding to the key information of the compressed data so as to decompress the compressed data; and if not, directly decompressing the compressed data.
Yet another aspect of the present invention provides a computer-readable storage medium having stored thereon a computer program which is executed by a processor as a method of processing the data.
A final aspect of the present invention provides a data processing apparatus, comprising: a processor and a memory; the memory is used for storing computer programs, and the processor is used for executing the computer programs stored by the memory so as to enable the data processing equipment to execute the data processing method.
In an embodiment of the present invention, the data processing apparatus further includes: the compression core is connected with the processor and used for compressing data to be compressed; and the decompression core is connected with the processor and used for decompressing the compressed data.
As described above, the data processing method, system, device and computer readable storage medium according to the present invention have the following advantages:
firstly, the invention can effectively avoid the problem of chip locking caused by key information loss;
secondly, the ECC is used for error correction, so that the method has certain error correction capability, the system is simple and easy to realize, and the existing system cannot be greatly consumed in area;
thirdly, the invention does not block the post-level data processing when processing, and has no influence on the system performance.
Drawings
Fig. 1 is a flow chart illustrating a data processing method according to an embodiment of the invention.
Fig. 2 shows an exemplary diagram of the concatenated compressed data of the present invention.
FIG. 3 is a diagram of an accumulated packet unit according to the present invention.
FIG. 4 is a schematic block diagram of a data processing system according to an embodiment of the present invention.
Fig. 5 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
Description of the element reference numerals
4 Data processing system
41 First processing module
40 Memory module
42 Second processing module
5 Data processing device
51 Graphics processing apparatus
52 Memory device
53 Bus transmission device
54 Processor with a memory having a plurality of memory cells
55 Compression core
56 Decompression core
S11~S19 Step (ii) of
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Example one
The embodiment provides a data processing method, which includes:
when a decompression request is to be initiated, judging whether compressed data needs to be corrected or not; if yes, correcting the compressed data, and turning to the next step; if not, outputting the compressed data, and turning to the next step;
judging whether the compressed data needs error correction; if yes, performing error correction operation corresponding to the key information of the compressed data so as to decompress the compressed data; and if not, directly decompressing the compressed data.
The following describes the processing method of data provided in the present embodiment in detail with reference to the drawings. Please refer to fig. 1, which is a flowchart illustrating a data processing method according to an embodiment. As shown in fig. 1, the data processing method specifically includes the following steps:
and S10, initiating a compression request to compress the data to be compressed. In this embodiment, the data to be compressed is image data.
Specifically, the compressed data (Packet Unit, PU) of each color channel (e.g., ARGB format, 4 color channels) is packed, the length information is put into the PU header as the key information, and after compression is completed, the compressed data of each channel is spliced. Referring to FIG. 2, an exemplary diagram of compressed data for stitching is shown. As shown in fig. 2, the compressed data is composed of PU0, PU1, PU2, and PU 3by concatenation. PU0, PU1, PU2, and PU3 are each comprised of key information and other data.
S11, generating compressed data, and generating a check code associated with the compressed data. In this embodiment, the check code is an ecc (error Correcting code) check code.
And S12, storing the compressed data and the check code related to the compressed data.
S13, when a decompression request is to be initiated, judging whether the compressed data needs to be corrected; if not, S14 is executed. If yes, go to S15.
In this embodiment, the step S13 includes comparing the compressed data with the check code associated with the compressed data to determine whether the compressed data and the check code are consistent. If the compressed data is consistent with the check code, indicating that the compressed data does not need to be corrected, and switching to S14; if the compressed data does not match the check code, it indicates that the compressed data needs to be corrected, and the process proceeds to S15.
S14, the compressed data without correction is output, and the process proceeds to S16.
S15, correcting the compressed data by ECC check code, and turning to S14.
S16, a complete Packet Unit (PU) is accumulated.
Please refer to fig. 3, which shows a diagram of accumulated grouping units. As shown in FIG. 3, PU0, PU1, PU2 and PU3 are added together to form a PU.
S17, judging whether the compressed data needs error correction; if yes, go to S18; if not, S19 is executed.
In this embodiment, the step S17 includes determining whether the key information of the compressed data matches the expected information of the compressed data. In this embodiment, the key information of the compressed data is current length information of the compressed data. The expected information of the compressed data is expected length information of the compressed data.
Specifically, if the current length information of the compressed data matches the expected length information of the compressed data, the key information indicating the compressed data matches the expected length information of the compressed data.
If the current length information of the compressed data is inconsistent with the expected length information of the compressed data, the key information of the compressed data is inconsistent with the expected information of the compressed data.
In this embodiment, the condition that the key information of the compressed data is not compliant with the expected information of the compressed data includes:
the current length information of the compressed data is longer than the expected length information of the compressed data;
the current length information of the compressed data is shorter than the expected length information of the compressed data.
S18, the error correction operation corresponding to the key information of the compressed data is performed, and the process proceeds to S19.
Performing an error correction operation corresponding to the key information of the compressed data includes:
if the current length information of the compressed data is shorter than the expected length information of the compressed data, discarding the compressed data;
and if the current length information of the compressed data is longer than the expected length information of the compressed data, performing zero padding on the compressed data.
Continuing with fig. 3, if the length information of PU2 is disturbed and changed, if the data error correction of PU2 fails, the correct lengths of PU2 and PU3 can no longer be obtained during decompression, and the PU2 will decompress normally but the decompression result is incorrect. Since the 4 PUs are closely related, PU3 may have an error in the size of the data block cut by PU2, which may result in PU3 fetching the data block with the wrong length, and zero padding or discarding may be performed. Where PU3 is expected to be 0000_0011, i.e., 3 bytes, in length
If the current length information of PU3 is 0000_0010, which is shorter than the expected length of PU3, then the other excess data (other) in PU3 is discarded.
If the current length information of PU3 is 0000_0111, which is longer than the expected length of PU3, then the insufficient portion of the other excess data (other) in PU3 is complemented by 0.
In this embodiment, since the key information required for decompression is already collected, normal decompression operation can be performed without occurrence of deadlock
And S19, decompressing the compressed data.
The data processing method has the following beneficial effects:
firstly, the problem of chip locking caused by loss of key information can be effectively avoided;
secondly, on the basis of ECC data correction, the fault tolerance of data decompression is enhanced, the error correction capability is improved, the system is simple and easy to implement, and large area consumption cannot be caused to the existing system;
thirdly, the post-level data processing is not blocked by the processing, and the system performance is not adversely affected.
The present embodiment also provides a computer-readable storage medium on which a computer program is stored, which, when executed by a processor, implements the processing method of the above-described data.
One of ordinary skill in the art will appreciate that the computer-readable storage medium is: all or part of the steps for implementing the above method embodiments may be performed by hardware associated with a computer program. The aforementioned computer program may be stored in a computer readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Example two
The present embodiment provides a data processing system, including:
the first processing module is used for judging whether the compressed data needs to be corrected or not when a decompression request is to be initiated; if not, correcting the compressed data; if yes, outputting the compressed data;
the second processing module is used for judging whether the compressed data needs error correction; if yes, performing error correction operation corresponding to the key information of the compressed data so as to decompress the compressed data; and if not, directly decompressing the compressed data.
The following describes the processing system of data provided in the present embodiment in detail with reference to the drawings. Please refer to fig. 4, which is a schematic structural diagram of a data processing system according to an embodiment. As shown in fig. 4, the data processing system 4 specifically includes: a first processing module 41, a storage module 40 and a second processing module 42.
The first processing module 41 is configured to initiate a compression request and compress data to be compressed; compressed data is generated and a check code associated with the compressed data is generated.
The storage module 40 coupled to the first processing module 41 is configured to store the compressed data and the check code associated with the compressed data.
The first processing module 41 is further configured to determine whether compressed data needs to be corrected when a decompression request is to be initiated; if not, outputting the compressed data without correction. If yes, correcting the compressed data by using an ECC check code, outputting the compressed data without correction, and accumulating a complete Packet Unit (PU).
In this embodiment, the first processing module 41 compares the compressed data with the check code associated with the compressed data to determine whether the compressed data is consistent with the check code. If the compressed data is consistent with the check code, the compressed data does not need to be corrected, and a complete Packet Unit (PU) is output and accumulated; and if the compressed data is inconsistent with the check code, indicating that the compressed data needs to be corrected, correcting the compressed data by using the ECC check code, and accumulating a complete Packet Unit (PU).
A second processing module 42 coupled to the first processing module 41 for determining whether error correction is needed for the compressed data; if yes, performing corresponding error correction operation on the key information of the compressed data, and decompressing the compressed data; and if not, decompressing the compressed data.
In this embodiment, the second processing module 42 is configured to determine whether the key information of the compressed data conforms to the expected information of the compressed data. In this embodiment, the key information of the compressed data is current length information of the compressed data. The expected information of the compressed data is expected length information of the compressed data.
Specifically, if the current length information of the compressed data matches the expected length information of the compressed data, the key information indicating the compressed data matches the expected length information of the compressed data.
If the current length information of the compressed data is inconsistent with the expected length information of the compressed data, the key information of the compressed data is inconsistent with the expected information of the compressed data.
In this embodiment, the condition that the key information of the compressed data is not compliant with the expected information of the compressed data includes:
the current length information of the compressed data is longer than the expected length information of the compressed data;
the current length information of the compressed data is shorter than the expected length information of the compressed data.
Specifically, if the current length information of the compressed data is shorter than the expected length information of the compressed data, the second processing module 42 performs discarding processing on the compressed data; and if the current length information of the compressed data is longer than the expected length information of the compressed data, performing zero padding on the compressed data.
It should be noted that the division of the modules of the above system is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And the modules can be realized in a form that all software is called by the processing element, or in a form that all the modules are realized in a form that all the modules are called by the processing element, or in a form that part of the modules are called by the hardware. For example: the x module can be a separately established processing element, and can also be integrated in a certain chip of the system. In addition, the x-module may be stored in the memory of the system in the form of program codes, and may be called by one of the processing elements of the system to execute the functions of the x-module. Other modules are implemented similarly. All or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software. These above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), one or more Microprocessors (MPUs), one or more Field Programmable Gate Arrays (FPGAs), and the like. When a module is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. These modules may be integrated together and implemented in the form of a System-on-a-chip (SOC).
EXAMPLE III
Fig. 5 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention. As shown in fig. 5, the data processing device 5 includes: a graphics processing device 51, a memory 52, a bus transfer device 53, a processor 54, a compression core 55, and a decompression core 56.
The graphics processing apparatus 51 inputs data into the compression core 55 through the bus transfer apparatus 53.
After the compression core 55 completes the compression, the compressed data and the check code are stored in the memory 52.
When a decompression request is to be initiated, the processor 54 determines whether the compressed data needs to be corrected; if not, correcting the compressed data; if yes, outputting the compressed data; judging whether the compressed data needs error correction; if yes, performing an error correction operation corresponding to the key information of the compressed data, so that the decompression core 56 decompresses the compressed data; if not, the decompression core 56 directly decompresses the compressed data.
Specifically, the processor 54 determines whether the compressed data needs to be corrected by comparing the compressed data with a check code associated with the compressed data to determine whether the compressed data is consistent with the check code. If the compressed data is consistent with the check code, indicating that the compressed data does not need to be corrected, outputting the compressed data which does not need to be corrected, and accumulating a complete Packet Unit (PU); and if the compressed data is inconsistent with the check code, indicating that the compressed data needs to be corrected, correcting the compressed data by using the ECC check code, and accumulating a complete Packet Unit (PU).
Specifically, the processor 54 determines whether the compressed data still needs error correction, that is, determines whether the key information of the compressed data conforms to the expected information of the compressed data; if yes, executing error correction operation corresponding to the key information of the compressed data; if not, directly enabling the decompression core 56 to decompress the compressed data.
In this embodiment, the condition that the key information of the compressed data is not compliant with the expected information of the compressed data includes:
the current length information of the compressed data is longer than the expected length information of the compressed data;
the current length information of the compressed data is shorter than the expected length information of the compressed data.
The processor 54 performs an error correction operation corresponding to the key information of the compressed data, including:
if the current length information of the compressed data is shorter than the expected length information of the compressed data, discarding the compressed data; and if the current length information of the compressed data is longer than the expected length information of the compressed data, performing zero padding on the compressed data.
After the decompression core 56 decompresses the compressed data, the decompressed data is transmitted to the graphics processing apparatus 51.
The protection scope of the data processing method according to the present invention is not limited to the execution sequence of the steps illustrated in the embodiment, and all the solutions implemented by adding, subtracting, and replacing steps according to the principles of the present invention are included in the protection scope of the present invention.
The present invention also provides a data processing system, which can implement the data processing method of the present invention, but the implementation device of the data processing method of the present invention includes, but is not limited to, the structure of the data processing system recited in this embodiment, and all structural modifications and substitutions of the prior art made according to the principles of the present invention are included in the scope of the present invention.
In summary, the data processing method, system, device and computer readable storage medium of the present invention have the following effects:
firstly, the invention can effectively avoid the problem of chip locking caused by key information loss;
secondly, on the basis of ECC data correction, the error tolerance of data decompression is enhanced, the error correction capability is improved, the system is simple and easy to realize, and too large area consumption cannot be caused to the existing system;
thirdly, the invention does not block the post-level data processing when processing, and has no adverse effect on the system performance.
Effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims (11)

1. A method for processing data, comprising:
when a decompression request is to be initiated, judging whether compressed data needs to be corrected or not; if yes, correcting the compressed data, and turning to the next step; if not, outputting the compressed data, and turning to the next step;
judging whether the compressed data needs error correction; if yes, performing error correction operation corresponding to the key information of the compressed data so as to decompress the compressed data; and if not, directly decompressing the compressed data.
2. The method of processing data according to claim 1, further comprising:
and initiating a compression request, compressing the data to be compressed, generating compressed data and generating a check code associated with the compressed data.
3. The method of processing data according to claim 2, further comprising:
and storing the compressed data and the check code.
4. The data processing method according to any one of claims 1 to 3, wherein the step of determining whether the compressed data needs to be corrected includes: and comparing the compressed data with the check code associated with the compressed data to judge whether the compressed data is consistent with the check code.
5. The method according to claim 1, wherein the step of determining whether the compressed data further requires error correction comprises: and judging whether the key information of the compressed data is consistent with the expected information of the compressed data.
6. The data processing method according to claim 5,
the key information of the compressed data is the current length information of the compressed data;
the expected information of the compressed data is expected length information of the compressed data;
the condition that the key information of the compressed data is not in line with the expected information of the compressed data comprises:
the current length information of the compressed data is longer than the expected length information of the compressed data;
the current length information of the compressed data is shorter than the expected length information of the compressed data.
7. The data processing method according to claim 6,
the step of performing an error correction operation corresponding to the key information of the compressed data includes:
if the current length information of the compressed data is shorter than the expected length information of the compressed data, discarding the compressed data;
and if the current length information of the compressed data is longer than the expected length information of the compressed data, performing zero padding on the compressed data.
8. A system for processing data, comprising:
the first processing module is used for judging whether the compressed data needs to be corrected or not when a decompression request is to be initiated; if not, correcting the compressed data; if yes, outputting the compressed data;
the second processing module is used for judging whether the compressed data needs error correction; if yes, performing error correction operation corresponding to the key information of the compressed data so as to decompress the compressed data; and if not, directly decompressing the compressed data.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method for processing data according to any one of claims 1 to 7.
10. An apparatus for processing data, comprising: a processor and a memory;
the memory is used for storing a computer program, and the processor is used for executing the computer program stored by the memory so as to cause the data processing device to execute the data processing method according to any one of claims 1 to 7.
11. The apparatus for processing data according to claim 10,
the data processing device further comprises:
the compression core is connected with the processor and used for compressing data to be compressed;
and the decompression core is connected with the processor and used for decompressing the compressed data.
CN202010135848.0A 2020-03-02 2020-03-02 Data processing method, system, equipment and computer readable storage medium Active CN113360314B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010135848.0A CN113360314B (en) 2020-03-02 2020-03-02 Data processing method, system, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010135848.0A CN113360314B (en) 2020-03-02 2020-03-02 Data processing method, system, equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN113360314A true CN113360314A (en) 2021-09-07
CN113360314B CN113360314B (en) 2023-07-18

Family

ID=77523252

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010135848.0A Active CN113360314B (en) 2020-03-02 2020-03-02 Data processing method, system, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN113360314B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102122959A (en) * 2011-03-29 2011-07-13 西安交通大学 Data compression device for improving main memory reliability of computer, and method thereof
CN106648955A (en) * 2016-11-15 2017-05-10 杭州华为数字技术有限公司 Compression method and relevant device
CN107071451A (en) * 2017-05-14 2017-08-18 华中科技大学 A kind of Larger Dynamic real-time decompression system based on variable input traffic
CN108182125A (en) * 2017-12-27 2018-06-19 武汉理工大学 The detection of cache multidigit hard error and fault tolerance facility and method under nearly threshold voltage
CN108351818A (en) * 2015-11-02 2018-07-31 高通股份有限公司 System and method for realizing error correcting code in memory
CN109802922A (en) * 2017-11-16 2019-05-24 电信科学技术研究院 A kind of processing method and equipment of cache synchronization exception
CN110213259A (en) * 2019-05-29 2019-09-06 武汉大学 The UDP transmission method of electric power observation and control message sends terminal and receives terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102122959A (en) * 2011-03-29 2011-07-13 西安交通大学 Data compression device for improving main memory reliability of computer, and method thereof
CN108351818A (en) * 2015-11-02 2018-07-31 高通股份有限公司 System and method for realizing error correcting code in memory
CN106648955A (en) * 2016-11-15 2017-05-10 杭州华为数字技术有限公司 Compression method and relevant device
CN107071451A (en) * 2017-05-14 2017-08-18 华中科技大学 A kind of Larger Dynamic real-time decompression system based on variable input traffic
CN109802922A (en) * 2017-11-16 2019-05-24 电信科学技术研究院 A kind of processing method and equipment of cache synchronization exception
CN108182125A (en) * 2017-12-27 2018-06-19 武汉理工大学 The detection of cache multidigit hard error and fault tolerance facility and method under nearly threshold voltage
CN110213259A (en) * 2019-05-29 2019-09-06 武汉大学 The UDP transmission method of electric power observation and control message sends terminal and receives terminal

Also Published As

Publication number Publication date
CN113360314B (en) 2023-07-18

Similar Documents

Publication Publication Date Title
EP3820048A1 (en) Data compression and decompression method and related apparatus, electronic device, and system
US20140129882A1 (en) Encoding diagnostic data in an error message for a computer program
CN110489428B (en) Multi-dimensional sparse matrix compression method, decompression method, device, equipment and medium
CN110958022A (en) Data compression method and device for continuity curve and related equipment
CN111491169B (en) Digital image compression method, device, equipment and medium
CN112181522A (en) Data processing method and device and electronic equipment
CN112380046A (en) Calculation result checking method, system, device, equipment and storage medium
CN112486848A (en) Test data generation method and device, chip and storage medium
CN109960866B (en) Signal processing method, verification method and electronic equipment
US20240176585A1 (en) Data processing method, computer device and storage medium
CN113360314A (en) Data processing method, system, equipment and computer readable storage medium
CN113448764A (en) Check code generation method and device, electronic equipment and computer storage medium
CN109756231B (en) Cyclic shift processing device and method
US9455742B2 (en) Compression ratio for a compression engine
CN114548028B (en) Method for performing low-power design, electronic device and storage medium
CN114564336A (en) Data consistency checking method, device, equipment and storage medium
CN115827308A (en) Solid state disk data error correction method and solid state disk
CN107341113B (en) Cache compression method and device
CN113722471A (en) Text abstract generation method, system, electronic equipment and medium
US6144321A (en) Microprocessor dedicated to processing of bit streams in a system of compression/decompression of animated images
CN107835158B (en) Method and device for transmitting interactive data under SNA network system
US6133859A (en) Microprocessor dedicated to processing of bit streams in a system of compression/decompression of animated images
CN111384976A (en) Storage method and reading method of sparse check matrix
CN216313198U (en) Image processing chip and electronic equipment
WO2021237518A1 (en) Data storage method and apparatus, processor and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant