CN115640162A - Data processing system, method, computer equipment and readable storage medium - Google Patents
Data processing system, method, computer equipment and readable storage medium Download PDFInfo
- Publication number
- CN115640162A CN115640162A CN202211103174.1A CN202211103174A CN115640162A CN 115640162 A CN115640162 A CN 115640162A CN 202211103174 A CN202211103174 A CN 202211103174A CN 115640162 A CN115640162 A CN 115640162A
- Authority
- CN
- China
- Prior art keywords
- data
- processed
- module
- recovered
- cache region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing system, a method, computer equipment and a readable storage medium, wherein the system comprises: the device comprises a data arbitration module, a plurality of calculation modules, a data transmission module, a cache region and a data recovery control module; responding to the data needing to be processed, the data arbitration module receives the data to be processed and acquires an identifier of the data to be processed, and transmits the data to be processed to a corresponding calculation module or a data transmission module based on the identifier of the data to be processed; responding to the data needing to be recovered, the recovery data control module acquires the data to be recovered and transmits the data to be recovered to the corresponding computing module or data transmission module based on the address of the data to be recovered; the calculation module acquires corresponding data from the cache region based on the received identifier of the data to be processed or the address of the data to be recovered to perform exclusive-or calculation, and stores the calculation result in the cache region through the data transmission module. By the scheme of the invention, RAID data processing and data recovery can be simultaneously carried out.
Description
Technical Field
The present invention relates to the field of storage technologies, and in particular, to a data processing system, a data processing method, a computer device, and a readable storage medium.
Background
Data read by a NAND (flash memory) may be erroneous in the process of reading and writing data by a Solid State Disk (SSD), and under the condition that an ECC (Error correction Code) controlled by the SSD cannot correct errors and correct data cannot be read out by rereading, a function of data recovery can be realized based on a RAID (Redundant array of Independent Disks) technology, and data security is ensured. However, in the prior art, the RAID technology may select different operation modes according to the actual conditions of the storage system, but only one operation mode may be executed at the same time, and the two operation modes are not supported to be executed simultaneously.
Disclosure of Invention
In view of this, the present invention provides a data processing system, a data processing method, a computer device, and a readable storage medium, which can perform RAID data processing and data recovery simultaneously by an improved data processing system, thereby improving the efficiency of RAID data processing when an error occurs in read data.
In view of the foregoing, an aspect of the embodiments of the present invention provides a data processing system, including: the device comprises a data arbitration module, a plurality of calculation modules, a data transmission module, a cache region and a data recovery control module;
in response to the data needing to be processed, the data arbitration module is configured to receive the data to be processed, acquire an identifier of the data to be processed, and transmit the data to be processed to a corresponding calculation module or the data transmission module based on the identifier of the data to be processed;
the computing module is configured to obtain corresponding data from the cache region through the data transmission module based on the identifier of the received data to be processed, perform exclusive or computation on the data obtained from the cache region and the received data to be processed, and store a computation result under an address corresponding to the cache region through the data transmission module;
in response to the fact that data needs to be restored, the data restoration control module is configured to acquire data to be restored and transmit the data to be restored to the corresponding computing module or the data transmission module based on the address of the data to be restored;
the calculation module is further configured to obtain corresponding data from the cache region through the data transmission module based on the address of the received data to be recovered, perform exclusive or calculation on the data obtained from the cache region and the received data to be recovered, and store a calculation result to the address corresponding to the cache region through the data transmission module.
In some embodiments, in response to data needing to be processed, the data arbitration module is configured to:
judging whether the data to be processed is first data or not based on the identifier of the data to be processed;
if the data to be processed is the first data under the identifier, storing the data to be processed in the cache region through the data transmission module;
if the data to be processed is not the first data under the identifier, acquiring the state of each computing module, and distributing the data to be processed to the corresponding computing module for computing;
the calculation module is configured to:
acquiring corresponding data from the cache region through the data transmission module based on the received identifier of the data to be processed;
and performing exclusive or calculation on the data acquired from the cache region and the received data to be processed, and storing the calculation result to an address corresponding to the cache region through the data transmission module.
In some embodiments, the identifier includes a priority, a count, a storage address, and the data arbitration module is configured to:
counting the data to be processed based on the priority of the data to be processed, and judging whether the data to be processed corresponds to first data under the priority based on the counting and the counting times;
if the data to be processed is the first data under the corresponding priority, storing the data to be processed to the cache region through the data transmission module based on the storage address of the data to be processed;
and if the data to be processed is not the first data under the corresponding priority, acquiring the state of each computing module, and distributing the data to be processed to the corresponding computing module for computing based on the priority of the data to be processed and the state of the computing module.
In some embodiments, the calculation module is configured to obtain corresponding data from the cache region through the data transmission module based on the priority, the calculation number, and the storage address of the received to-be-processed data.
In some embodiments, the recovery data control module is configured to:
acquiring a start address and a data length of data to be recovered, and calculating an end address based on the start address and the data length;
reading corresponding data to be recovered from the position between the starting address and the ending address in sequence through a bus;
judging whether the data to be recovered is first data to be recovered or not based on the read address of the data to be recovered, and selecting to store the data to be recovered to the cache region through the data transmission module or distribute the data to be recovered to a corresponding calculation module for calculation based on a judgment result;
the calculation module is configured to obtain corresponding data from the cache region through the data transmission module based on the address of the data to be recovered, perform exclusive or operation calculation on the data obtained from the cache region and the data to be recovered, and store a calculation result to the address corresponding to the cache region through the data transmission module.
In some embodiments, selecting, based on the determination result, to store the data to be recovered in the buffer area through the data transmission module or allocate the data to be recovered to a corresponding calculation module for calculation includes:
if the data to be recovered is the first data to be recovered, storing the data to be recovered to the cache region through the data transmission module;
and if the data to be recovered is not the first data to be recovered, acquiring the state of each computing module, and distributing the data to be recovered to the corresponding computing module for computing.
In some embodiments, the system is applied to a redundant array of independent disks (raid) cache, where the cache is a raid cache, and the raid cache includes any one or more of the following storage devices: static random access memory and dynamic random access memory.
In another aspect of the embodiments of the present invention, a data processing method is further provided, where the data processing method is applied to a data processing system, where the data processing system includes a data arbitration module, multiple computation modules, a data transmission module, a cache region, and a data recovery control module, and the method includes:
responding to the fact that data needs to be processed, the data arbitration module receives data to be processed, obtains an identifier of the data to be processed, and transmits the data to be processed to a corresponding calculation module or a data transmission module based on the identifier of the data to be processed;
the computing module acquires corresponding data from the cache region through the data transmission module based on the identifier of the received data to be processed, performs exclusive or computation on the data acquired from the cache region and the received data to be processed, and stores the computation result to an address corresponding to the cache region through the data transmission module;
responding to the fact that data needs to be restored, the data restoration control module obtains data to be restored and transmits the data to be restored to a corresponding computing module or the data transmission module based on the address of the data to be restored;
the calculation module acquires corresponding data from the cache region through the data transmission module based on the address of the received data to be recovered, performs exclusive or calculation on the data acquired from the cache region and the received data to be recovered, and stores the calculation result to the address corresponding to the cache region through the data transmission module.
In another aspect of the embodiments of the present invention, there is also provided a computer device, including: at least one processor; and a memory storing a computer program executable on the processor, the computer program when executed by the processor implementing the steps of the method as above.
In a further aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, in which a computer program for implementing the above method steps is stored when the computer program is executed by a processor.
The invention has at least the following beneficial technical effects: by the scheme of the invention, RAID data processing and data recovery can be simultaneously carried out, and the efficiency of RAID data processing when read data has errors is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained according to the drawings without creative efforts.
FIG. 1 is a block diagram of a data processing system according to an embodiment of the present invention;
FIG. 2 is a flow diagram illustrating RAID data processing according to an embodiment of the present invention;
FIG. 3 is a flow diagram illustrating one embodiment of RAID data recovery provided in accordance with the present invention;
FIG. 4 is a block diagram of an embodiment of a data processing method provided by the present invention;
FIG. 5 is a schematic structural diagram of an embodiment of a computer device provided in the present invention;
fig. 6 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
In view of the above objects, a first aspect of embodiments of the present invention proposes an embodiment of a data processing system. As shown in fig. 1, the system comprises: the data arbitration module 10, the plurality of computing modules 20, the data transmission module 30, the buffer 40, and the recovery data control module 50, in response to a data need to be processed, the data arbitration module 10 is configured to receive data to be processed and obtain an identifier of the data to be processed, and transmit the data to be processed to the corresponding computing module 20 or the data transmission module 30 based on the identifier of the data to be processed;
the calculation module 20 is configured to obtain corresponding data from the buffer 40 through the data transmission module 30 based on the identifier of the received data to be processed, perform xor calculation on the data obtained from the buffer 40 and the received data to be processed, and store the calculation result in the address corresponding to the buffer 40 through the data transmission module 30;
in response to that there is data to be recovered, the recovered data control module 50 is configured to obtain data to be recovered, and transmit the data to be recovered to the corresponding computing module 20 or the data transmission module 30 based on the address of the data to be recovered;
the calculation module 20 is further configured to obtain corresponding data from the buffer 40 through the data transmission module 30 based on the address of the received data to be recovered, perform xor calculation on the data obtained from the buffer 40 and the received data to be recovered, and store the calculation result in the address corresponding to the buffer 40 through the data transmission module 30.
Specifically, the data arbitration module 10 transmits data to be subjected to RAID processing from an NFC (Nand flash controller), receives the data according to the priority of the data, and converts the data format of the received data into a self-defined data format inside the calculation module, so as to facilitate calculation of the transmitted data; the data are transmitted to the corresponding computing modules by acquiring the states of the computing modules, wherein the states of the computing modules comprise a working state and a processing state, the working state is working or idle, and the processing state is the current execution of the computing module on which priority data are computed.
And the recovery data control module 50 is applied to a data recovery process, reads data to be recovered from the bus in the data recovery process, converts the data format of the data to be recovered into a data format which can be recognized by the computing module, and transmits the data to be processed to the corresponding computing module or data transmission module based on the address of the data to be processed.
The calculation module 20 receives data to be processed or data to be restored, performs an exclusive or operation with corresponding data taken out of the buffer, outputs an exclusive or calculation result, and transmits the calculation result to the data transmission module 30.
The data transmission module 30 temporarily stores the calculation result or the data transmitted by the data arbitration module 10 or the recovery data control module 50 into a RAID cache, such as an SRAM (Static Random Access Memory) or a DRAM Dynamic Random Access Memory. The temporary data is read out and transmitted to the calculation module 20 for the next calculation, and the exclusive or calculation is performed with the data transmitted by the data arbitration module 10 or the recovery data control module 50.
By the data processing system of the embodiment of the invention, RAID data processing and data recovery can be simultaneously carried out, and the efficiency of RAID data processing when read data has errors is improved.
In some embodiments, in response to there being data to be processed, the data arbitration module 10 is configured to:
judging whether the data to be processed is first data or not based on the identifier of the data to be processed;
if the data to be processed is the first data under the identifier, storing the data to be processed in the buffer area 40 through the data transmission module 30;
if the data to be processed is not the first data under the identifier, acquiring the state of each computing module, and distributing the data to be processed to the corresponding computing module for computing;
the calculation module 20 is configured to:
acquiring corresponding data from the buffer area 40 through the data transmission module 30 based on the identifier of the received data to be processed;
and performing exclusive or calculation on the data acquired from the cache region 40 and the received data to be processed, and storing the calculation result in an address corresponding to the cache region 40 through the data transmission module 30.
In some embodiments, the identifier comprises a priority, a count, a storage address, and the data arbitration module is configured to:
counting the data to be processed based on the priority of the data to be processed, and judging whether the data to be processed corresponds to first data under the priority based on the counting and the counting times;
if the data to be processed is the first data under the corresponding priority, storing the data to be processed to the cache region through the data transmission module based on the storage address of the data to be processed;
and if the data to be processed is not the first data under the corresponding priority, acquiring the state of each computing module, and distributing the data to be processed to the corresponding computing module for computing based on the priority of the data to be processed and the state of the computing module.
In some embodiments, the calculation module 20 is configured to obtain the corresponding data from the buffer 40 through the data transmission module 30 based on the priority, the calculation times and the storage address of the received data to be processed.
In one embodiment, RAID data processing is described with reference to FIG. 2.
The data arbitration module receives data from NFC and starts transmission according to a certain priority, if the received data is the first data under the priority, the data is directly transmitted to SRAM or DRAM for temporary storage through the data transmission module, and if the received data is the second data, the data is transmitted to the corresponding calculation module;
when the second data is transmitted to the computing module, the first exclusive-or computation is carried out on the second data, the exclusive-or computation is carried out on the second data loaded by the data arbitration module and the first data transmitted by the data transmission module, the computation result is temporarily stored in the SRAM or the DRAM by the data transmission module, and the steps are repeated until the computation is completed when the new data is transmitted to the data arbitration module.
After the RAID processing is finished, the host reads the calculation result from the DRAM or the SRAM and transmits the calculation result to the corresponding hard disk for storage.
In some embodiments, the recovery data control module 50 is configured to:
acquiring a starting address and a data length of data to be recovered, and calculating an ending address based on the starting address and the data length;
reading corresponding data to be recovered from the position between the starting address and the ending address in sequence through a bus;
judging whether the data to be recovered is first data to be recovered or not based on the read address of the data to be recovered, and selecting to store the data to be recovered to the cache region through the data transmission module or distribute the data to be recovered to a corresponding calculation module for calculation based on a judgment result;
the calculation module 20 is configured to obtain corresponding data from the buffer 40 through the data transmission module 30 based on the address of the data to be recovered, perform an xor operation on the data obtained from the buffer 40 and the data to be recovered, and store the calculation result in the address corresponding to the buffer 40 through the data transmission module 30.
In some embodiments, selecting, based on the determination result, to store the data to be recovered in the buffer area through the data transmission module or allocate the data to be recovered to a corresponding calculation module for calculation includes:
if the data to be recovered is the first data to be recovered, storing the data to be recovered in the buffer area 40 through the data transmission module 30;
and if the data to be recovered is not the first data to be recovered, acquiring the state of each computing module, and distributing the data to be recovered to the corresponding computing module for computing.
In one embodiment, the RAID data recovery process is described in conjunction with FIG. 3.
The method comprises the following steps that data to be recovered are transmitted in through a bus, a recovered data control module receives data from the bus, whether the data are first data to be recovered is judged based on the address of the data to be recovered, if the first data to be recovered are received, the first data to be recovered are directly and temporarily stored in an SRAM or a DRAM through a data transmission module, and if the second data to be recovered are received, the data are transmitted to a computing module special for recovered data, wherein the computing module is one of a plurality of computing modules in the embodiment, the computing module can be reserved for data recovery according to actual requirements, and can be selected based on the real-time state of the computing module;
when the second data is transmitted to the special calculation module for recovery, the first XOR calculation is carried out, the second data loaded by the recovery data control module and the first data transmitted by the data transmission module are subjected to XOR calculation, the calculation result is temporarily stored in the SRAM or the DRAM by the data transmission module, and when a new data is transmitted to the recovery data control module, the steps are repeated until the calculation is completed.
And after the recovery data is finished, the host reads the calculation result from the DRAM or the SRAM and transmits the calculation result to the corresponding hard disk for storage.
In some embodiments, the system is applied to a redundant array of independent disks, the cache block 40 is a redundant array of independent disks cache block, and the redundant array of independent disks cache block includes any one or more of the following storage devices: static random access memory, dynamic random access memory.
Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 4, an embodiment of the present invention further provides a data processing method applied to a data processing system, where the data processing system includes a data arbitration module, a plurality of computation modules, a data transmission module, a buffer, and a recovery data control module, and the method includes:
s10, responding to the fact that data needs to be processed, the data arbitration module receives data to be processed, acquires an identifier of the data to be processed, and transmits the data to be processed to a corresponding calculation module or a data transmission module based on the identifier of the data to be processed;
s20, the computing module acquires corresponding data from the cache region through the data transmission module based on the identifier of the received data to be processed, performs exclusive OR computation on the data acquired from the cache region and the received data to be processed, and stores a computation result to an address corresponding to the cache region through the data transmission module;
s30, responding to the fact that data needs to be restored, the data to be restored are obtained by the data restoring control module, and the data to be restored are transmitted to the corresponding computing module or the data transmission module based on the address of the data to be restored;
and S40, the calculation module acquires corresponding data from the cache region through the data transmission module based on the address of the received data to be recovered, performs exclusive OR calculation on the data acquired from the cache region and the received data to be recovered, and stores the calculation result to the address corresponding to the cache region through the data transmission module.
Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 5, the embodiment of the present invention further provides a computer device 30, in which the computer device 30 comprises a processor 310 and a memory 320, the memory 320 stores a computer program 321 that can run on the processor, and the processor 310 executes the program to perform the steps of the method.
The memory, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules corresponding to the data processing method in the embodiments of the present application. The processor executes various functional applications and data processing of the system by executing nonvolatile software programs, instructions and modules stored in the memory, that is, the data processing method of the above method embodiment is realized.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the system, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory optionally includes memory located remotely from the processor, and these remote memories may be connected to the local module over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 6, an embodiment of the present invention further provides a computer-readable storage medium 40, where the computer-readable storage medium 40 stores a computer program 410, which when executed by a processor, performs the above method.
Finally, it should be noted that, as understood by those skilled in the art, all or part of the processes in the methods of the embodiments described above may be implemented by instructing relevant hardware by a computer program, and the program may be stored in a computer-readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. The storage medium of the program may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like. The embodiments of the computer program may achieve the same or similar effects as any of the above-described method embodiments.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. The numbers of the embodiments disclosed in the above embodiments of the present invention are merely for description, and do not represent the advantages or disadvantages of the embodiments. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant only to be exemplary, and is not intended to intimate that the scope of the disclosure, including the claims, is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A data processing system, comprising: the device comprises a data arbitration module, a plurality of calculation modules, a data transmission module, a cache region and a data recovery control module;
in response to the data needing to be processed, the data arbitration module is configured to receive the data to be processed, acquire an identifier of the data to be processed, and transmit the data to be processed to a corresponding calculation module or the data transmission module based on the identifier of the data to be processed;
the computing module is configured to obtain corresponding data from the cache region through the data transmission module based on the identifier of the received data to be processed, perform exclusive or computation on the data obtained from the cache region and the received data to be processed, and store a computation result under an address corresponding to the cache region through the data transmission module;
in response to the fact that data needs to be restored, the data restoration control module is configured to acquire data to be restored and transmit the data to be restored to the corresponding computing module or the data transmission module based on the address of the data to be restored;
the calculation module is further configured to obtain corresponding data from the cache region through the data transmission module based on the address of the received data to be recovered, perform exclusive or calculation on the data obtained from the cache region and the received data to be recovered, and store a calculation result to the address corresponding to the cache region through the data transmission module.
2. The system of claim 1, wherein in response to there being data to process, the data arbitration module is configured to:
judging whether the data to be processed is first data or not based on the identifier of the data to be processed;
if the data to be processed is the first data under the identifier, storing the data to be processed in the cache region through the data transmission module;
if the data to be processed is not the first data under the identifier, acquiring the state of each computing module, and distributing the data to be processed to the corresponding computing module for computing;
the computing module is configured to:
acquiring corresponding data from the cache region through the data transmission module based on the received identifier of the data to be processed;
and performing exclusive or calculation on the data acquired from the cache region and the received data to be processed, and storing the calculation result to an address corresponding to the cache region through the data transmission module.
3. The system of claim 1, wherein the identifier comprises a priority, a count, a memory address, and wherein the data arbitration module is configured to:
counting the data to be processed based on the priority of the data to be processed, and judging whether the data to be processed corresponds to first data under the priority based on the counting and the counting times;
if the data to be processed is the first data under the corresponding priority, storing the data to be processed to the cache region through the data transmission module based on the storage address of the data to be processed;
and if the data to be processed is not the first data under the corresponding priority, acquiring the state of each computing module, and distributing the data to be processed to the corresponding computing module for computing based on the priority of the data to be processed and the state of the computing module.
4. The system according to claim 3, wherein the computing module is configured to obtain the corresponding data from the buffer area through the data transmission module based on the received priority, the computing number and the storage address of the data to be processed.
5. The system of claim 1, wherein the recovery data control module is configured to:
acquiring a starting address and a data length of data to be recovered, and calculating an ending address based on the starting address and the data length;
reading corresponding data to be recovered from the position between the starting address and the ending address in sequence through a bus;
judging whether the data to be recovered is first data to be recovered or not based on the read address of the data to be recovered, and selecting to store the data to be recovered to the cache region through the data transmission module or distribute the data to be recovered to a corresponding calculation module for calculation based on a judgment result;
the calculation module is configured to obtain corresponding data from the cache region through the data transmission module based on the address of the data to be recovered, perform exclusive or operation calculation on the data obtained from the cache region and the data to be recovered, and store a calculation result to the address corresponding to the cache region through the data transmission module.
6. The system according to claim 5, wherein selecting to store the data to be restored to the buffer area through the data transmission module or allocate the data to be restored to a corresponding calculation module for calculation based on the determination result comprises:
if the data to be recovered is the first data to be recovered, storing the data to be recovered to the cache region through the data transmission module;
and if the data to be recovered is not the first data to be recovered, acquiring the state of each computing module, and distributing the data to be recovered to the corresponding computing module for computing.
7. The system of claim 1, applied to a Redundant Array of Independent Disks (RAID) cache, wherein the cache is a RAID cache comprising any one or more of the following memory devices: static random access memory and dynamic random access memory.
8. A data processing method is applied to a data processing system, the data processing system comprises a data arbitration module, a plurality of calculation modules, a data transmission module, a cache region and a data recovery control module, and the method comprises the following steps:
responding to the fact that data needs to be processed, the data arbitration module receives data to be processed, obtains an identifier of the data to be processed, and transmits the data to be processed to a corresponding calculation module or a data transmission module based on the identifier of the data to be processed;
the computing module acquires corresponding data from the cache region through the data transmission module based on the identifier of the received data to be processed, performs exclusive or computation on the data acquired from the cache region and the received data to be processed, and stores the computation result to an address corresponding to the cache region through the data transmission module;
responding to the situation that data needs to be recovered, the recovery data control module acquires data to be recovered and transmits the data to be recovered to a corresponding computing module or the data transmission module based on the address of the data to be recovered;
the calculation module acquires corresponding data from the cache region through the data transmission module based on the address of the received data to be recovered, performs exclusive or calculation on the data acquired from the cache region and the received data to be recovered, and stores the calculation result in the address corresponding to the cache region through the data transmission module.
9. A computer device, comprising:
at least one processor; and
memory storing a computer program operable on the processor, characterized in that the processor executes the program to perform the steps of the method as claimed in claim 8.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method as claimed in claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211103174.1A CN115640162A (en) | 2022-09-09 | 2022-09-09 | Data processing system, method, computer equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211103174.1A CN115640162A (en) | 2022-09-09 | 2022-09-09 | Data processing system, method, computer equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115640162A true CN115640162A (en) | 2023-01-24 |
Family
ID=84942448
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211103174.1A Pending CN115640162A (en) | 2022-09-09 | 2022-09-09 | Data processing system, method, computer equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115640162A (en) |
-
2022
- 2022-09-09 CN CN202211103174.1A patent/CN115640162A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110089035B (en) | Storage controller, data processing chip and data processing method | |
| CN101937724B (en) | Method for performing copy back operations and flash storage device | |
| CN105706059B (en) | Error correction in nonvolatile memory | |
| CN109783014B (en) | Data storage method and device | |
| CN110532126B (en) | Method and device for rapidly recovering erasure code storage system data and storage medium | |
| CN108563532B (en) | Data processing method and related device | |
| CN108334419B (en) | Data recovery method and device | |
| US20170250714A1 (en) | Error correction circuit and error correction method | |
| CN110018783B (en) | Data storage method, device and system | |
| KR101983208B1 (en) | Data management method, node and system for database cluster | |
| CN111818124B (en) | Data storage method, data storage device, electronic equipment and medium | |
| WO2017028494A1 (en) | Data recovery method, data storage method, and corresponding apparatus and system | |
| CN110442298B (en) | Storage equipment abnormality detection method and device and distributed storage system | |
| CN109254956B (en) | Data downloading method and device and electronic equipment | |
| CN115640162A (en) | Data processing system, method, computer equipment and readable storage medium | |
| CN113448770A (en) | Method, electronic device and computer program product for recovering data | |
| CN115878052A (en) | RAID array inspection method, inspection device and electronic equipment | |
| CN105354107A (en) | Data transmission method and system for NOR Flash | |
| JP2016059012A (en) | Receiver, transmitter, and data transfer system | |
| CN115113816A (en) | Erasure code data processing system, method, computer device and medium | |
| CN115129509A (en) | Data transmission method, device and medium | |
| CN110287716B (en) | Data storage method and device | |
| WO2018165943A1 (en) | Storage controller, data processing chip, and data processing method | |
| CN106844088B (en) | Data sending method and device of RAID storage system | |
| CN112948173A (en) | Data recovery method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |