CN114546272A - Method, system, apparatus and storage medium for fast universal RAID demotion to RAID5 - Google Patents
Method, system, apparatus and storage medium for fast universal RAID demotion to RAID5 Download PDFInfo
- Publication number
- CN114546272A CN114546272A CN202210153471.0A CN202210153471A CN114546272A CN 114546272 A CN114546272 A CN 114546272A CN 202210153471 A CN202210153471 A CN 202210153471A CN 114546272 A CN114546272 A CN 114546272A
- Authority
- CN
- China
- Prior art keywords
- degraded
- raid
- raid group
- check code
- raid5
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 29
- 238000004364 calculation method Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 230000000593 degrading effect Effects 0.000 abstract description 6
- 230000008901 benefit Effects 0.000 abstract description 4
- 238000013508 migration Methods 0.000 abstract description 4
- 230000005012 migration Effects 0.000 abstract description 4
- 230000015556 catabolic process Effects 0.000 description 9
- 238000006731 degradation reaction Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Techniques For Improving Reliability Of Storages (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method, a system, equipment and a storage medium for rapidly and universally degrading RAID (redundant array of independent disks) to RAID5, wherein the method comprises the following steps: determining parameter information of the RAID group code to be degraded according to the configuration position relationship of load balance; drawing and calling out a corresponding disk in the RAID group to be degraded according to requirements, and rearranging and numbering the rest RAID groups; calculating a new arrangement position based on a load balancing arrangement algorithm, and shifting the data block or the check block with the changed position; and updating the shifted check code of the RAID group according to the check code of the RAID group to be degraded. The invention can reduce data migration, reduce new RAID5 RAID group check code, ensure simple operation on the premise of ensuring correct function, and has the advantage of universality for any RAID group.
Description
Technical Field
The present invention relates to the field of disk arrays, and more particularly, to a method, system, device, and storage medium for fast and universal RAID destaging to RAID 5.
Background
Raid (redundant Arrays of Independent disks), i.e. a disk array with redundancy capability, is obtained by combining a plurality of Independent disks together, so as to obtain a disk group with huge capacity. By adopting the RAID storage technology, the storage capacity can be greatly improved, the input and output request processing capacity of the system is improved, and the reliability of data is improved by the distributed storage technology of data, a parallel access means and an information redundancy technology. RAID may be divided into different levels according to different policies and architectures: RAID 0, 1, 5, 6, 10.
RAID5 (distributed parity independent disk architecture). Its parity code exists on all disks, with p0 representing the parity value for stripe 0, and the same applies otherwise. RAID5 has high read efficiency and general write efficiency, and block type collective access efficiency is good. Because the parity codes are on different disks, reliability is improved. It does not solve well for the parallelism of the data transfer and the design of the controller is rather difficult. For RAID5, most data transfers operate on only one disk, and parallel operations may be performed. There is a "write penalty" in RAID5, i.e., each write operation will result in four actual read/write operations, where the old data and parity information is read twice and the new data and parity information is written twice.
RAID6 is a parity-check code independent disk architecture with two types of distributed storage. It is an extension to RAID5 and is mainly used in situations where data is absolutely required to be error-free. Due to the introduction of the second parity check value, N +2 disks are needed, and the design of the controller becomes very complicated, so that the data reliability of the disk array is further improved. More space is required to store the check value with a higher performance penalty in write operations.
In an actual application scenario, a user has a need to degrade an already-organized RAID group, where the degradation is operations such as reducing RAID6 to RAID5, 1, and 0 or reducing TP-RAID to RAID6 or RAID5, 1, and 0, and whichever degradation involves extracting a disk originally used for storing verification from the RAID group, and the original RAID group needs to complete data migration, calculation of the degraded RAID group, and the like. The traditional RAID degradation is based on a load balancing algorithm to migrate data again and then complete coding after extracting the disk, and the operation is complex.
Disclosure of Invention
In view of this, an object of the embodiments of the present invention is to provide a method, a system, a computer device, and a computer-readable storage medium for rapidly and universally degrading RAID to RAID5, which can reduce data migration, reduce new RAID group check codes of RAID5, and ensure that operations are simple and universal for any RAID group on the premise of ensuring correct functions.
Based on the above objectives, an aspect of the embodiments of the present invention provides a method for fast and universal RAID downgrading to RAID5, including the following steps: determining parameter information of the RAID group code to be degraded according to the configuration position relationship of load balance; drawing and calling out a corresponding disk in the RAID group to be degraded according to requirements, and rearranging and numbering the rest RAID groups; calculating a new arrangement position based on a load balancing arrangement algorithm, and shifting the data block or the check block with the changed position; and updating the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shifting the data block or the check block with the changed position includes: and reading all the data of the RAID group to be degraded into a dynamic memory, and writing the data into a corresponding position according to the new arrangement position.
In some embodiments, the updating the shifted parity code of the RAID group according to the parity code of the RAID group to be downgraded includes: and carrying out exclusive OR calculation on the check code of the RAID group to be degraded to obtain the degraded check code.
In some embodiments, the method further comprises: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
In another aspect of the embodiments of the present invention, a fast and general RAID demotion to RAID5 system is provided, including: the acquisition module is configured to determine parameter information of the RAID group code to be degraded according to the configuration position relation of load balance; the configuration module is used for drawing and dispatching the corresponding disk in the RAID group to be degraded according to the requirement and rearranging and numbering the rest RAID groups; the shifting module is configured to calculate a new arrangement position based on a load balancing arrangement algorithm and shift the data block or the check block with the changed position; and the updating module is configured to update the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shifting module is configured to: and reading all the data of the RAID group to be degraded into a dynamic memory, and writing the data into a corresponding position according to the new arrangement position.
In some embodiments, the update module is configured to: and carrying out exclusive OR calculation on the check code of the RAID group to be degraded to obtain the degraded check code.
In some embodiments, the system further comprises a write module configured to: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
In another aspect of the embodiments of the present invention, there is also provided a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method as above.
In a further aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, in which a computer program for implementing the above method steps is stored when the computer program is executed by a processor.
The invention has the following beneficial technical effects: the method can reduce data migration, reduce new RAID5 RAID group check codes, ensure simple operation on the premise of ensuring correct functions, and has the advantage of universality for any RAID group.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
FIG. 1 is a schematic diagram of an embodiment of a method for fast generic RAID destage to RAID5 provided by the present invention;
FIG. 2 is an architecture diagram of an embodiment of a method for fast generic RAID destage to RAID5 provided by the present invention;
FIG. 3 is a schematic diagram of an embodiment of a system for fast generic RAID destage to RAID5 provided by the present invention;
FIG. 4 is a schematic diagram of a hardware configuration of an embodiment of a fast general RAID destage to RAID5 provided by the present invention;
FIG. 5 is a schematic diagram of an embodiment of a fast general RAID destage to RAID5 computer storage media provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
In a first aspect of the embodiments of the present invention, an embodiment of a method for fast and general RAID demotion to RAID5 is provided. FIG. 1 is a schematic diagram illustrating an embodiment of a method for fast and universal RAID destage to RAID5 provided by the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:
s1, determining parameter information of the RAID group code to be degraded according to the load balancing arrangement position relation;
s2, extracting and dispatching the corresponding disk in the RAID group to be degraded according to the requirement, and rearranging and numbering the rest RAID groups;
s3, calculating a new arrangement position based on a load balancing arrangement algorithm, and shifting the data block or the check block with the changed position; and
and S4, updating the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
Fig. 2 is an architecture diagram of an embodiment of a method for fast and general RAID downgrading to RAID5 according to the present invention, and the embodiment of the present invention is described with reference to fig. 2. After completing the RAID group, based on the needs of the user, the RAID group may need to be degraded, where the degradation refers to lowering the existing RAID group with good group by one or two levels, and freeing up a location where check data is originally stored, so as to enable the hard disk to be freed up for use by other functional needs, and the degradation generally includes degrading the existing RAID group to RAIDs 5, 6, and 0 by TP-RAID, and degrading the existing RAID group to RAIDs 5 and 0 by RAID 6.
A common RAID algorithm needs to determine parameter information of RAID encoding first, the parameter information is generally determined based on a specific arrangement position relationship of load balancing, and taking common load balancing arrangement with left-handed misalignment as an example, when a data disk is 3 and a check disk is 2, and a RAID6 group is performed, an arrangement form of a general RAID group is shown as (r) in fig. 2.
The invention can ensure the relation during degradation, and can quickly and simply realize the requirement of degrading any RAID algorithm into RAID 5. To illustrate the correctness of the operation method, the algorithms of RAID5 and RAID6 will be described first.
The conventional algorithm principle of RAID5 uses:
d1+d2+d3+...+dm+p＝0 (1)
the algorithm principle of RAID6 is:
the coding and decoding algorithm of RAID is to solve the above relation equation with p as unknown number. The operation here uses galois field operation in storage, so it can be seen that in conventional RAIDs 5 and 6, the relationship of p is:
RAID5：
RAID6：
in a storage system, in order to reduce the operation complexity and ensure that data does not overflow, the above unified and stored encoding and decoding operations are generally implemented by galois fields. That is, in the hardware implementation, the addition and subtraction are implemented by exclusive or operation, and the multiplication and division are implemented by galois multiplication and division for different galois field polynomials.
In normal RAID operation, after degradation occurs, all the related data is rephotographed and then encoded again based on the algorithm arrangement requirement of load balancing. For illustration, the operation mode of RAID6 downgrading to RAID5 in the left-handed misalignment mode in fig. 2 is taken as an example:
and determining parameter information of the RAID group code to be degraded according to the configuration position relationship of the load balance. P1 and P2 in FIG. 2 represent two parity checks in a RAID6 group, D0-D14 are different user data blocks, rows represent stripes, and columns represent actual hard disks. The data blocks and the check blocks are arranged in RAID6 group formed by 5 hard disks based on load balancing mode, and the positions of the check blocks are different for each band based on left-handed misalignment mode, thereby realizing the averaging of disk access requirements. The coding and decoding parameter relationship of RAID6 can be obtained based on disk numbers (1-5), and the coding of each stripe can be completed by using corresponding data blocks based on the relationship. If degradation occurs, the corresponding check block needs to be removed firstly, then the corresponding data block is moved based on the requirement of a load balancing algorithm, and the information of the coding check block is rewritten.
And drawing out the corresponding disk from the RAID group to be degraded according to the requirement, and rearranging and numbering the rest RAID groups. Any one disk is abstracted out on demand, here for convenience of example, disk number 3 is abstracted out arbitrarily. The snapshot disk is shown in fig. 2 by a dashed line, and the host and other records will indicate that the disk is not in the RAID group, and if a new request is made, new information is written to the dashed disk. The Data in the dotted line needs to be read into a dynamic memory such as a DDR (Double Data Rate) because the Data information relates to rewriting to a new location, and the check information relates to calculating new RAID group check information.
And calculating a new arrangement position based on a load balancing arrangement algorithm, and shifting the data block or the check block with the changed position. The gray blocks in FIG. 2 (i.e., D0, D1, D5, D7, D9, D12, D13, and D14) represent blocks of data or parity that have changed from the previous blocks based on the new assignment positions calculated by the load balancing assignment algorithm. The data blocks therein need to be processed by a shift operation.
In some embodiments, the shifting the data block or the check block with the changed position includes: and reading all the data of the RAID group to be degraded into a dynamic memory, and writing the data into a corresponding position according to the new arrangement position. The shift operation is to read the original data into a dynamic memory such as DDR, and then write the data into the data at the correct position. The read and write sequence is based on the condition that the correctness of data is not influenced and the integrity of the data is ensured, and the DDR is accessed as little as possible.
And updating the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the updating the shifted parity code of the RAID group according to the parity code of the RAID group to be downgraded includes: and carrying out exclusive OR calculation on the check code of the RAID group to be degraded to obtain the degraded check code.
RAID6 or RAID-TP and other high-level RAID groups that may be involved all involve updating the parity code when downgrading to RAID5, because the parity code value must change when the RAID algorithm changes. While the traditional method is to recalculate the parity code based on the RAID5 algorithm, the embodiment of the present invention provides a fast algorithm for updating the parity code of the RAID5 based on load balancing. The algorithm is as follows:
here, p' is the parity after destaging to RAID5, and p1p2 is the original parity in the corresponding RAID 6. Other RAID algorithms degrade in the same manner. The following verification of algorithm feasibility, taking RAID6 encoding of formula (4) as an example, and summing up P1P2, can obtain:
the result is the same as P of RAID5 of formula (3), which proves the method of the present invention is correct. Correspondingly, other RAID algorithms can be obtained, and the same operation result can be obtained through the method of the invention, namely the method for updating the check code is proved to meet the encoding requirement of RAID5, and the check code is correct.
In some embodiments, the method further comprises: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position. The first step of using the updating method of the embodiment of the present invention is to directly perform an exclusive or operation by taking the parity data from the disk, which is, for example, RAID6, so that there are two parity disk data, and for other advanced RAID algorithms, it is only necessary to take out a corresponding amount of parity data. And in the second step, the result of the exclusive-or operation is stored in other storage media which can access data, such as DDR or buffer. And then, the third step, based on the arrangement mode of load balancing operation, writing the data into a new disk at a proper time.
According to the embodiment of the invention, a degradation operation mode different from the traditional RAID group is obtained through derivation and improvement of the algorithm, the data is simply operated to obtain corresponding check data, and based on the mode, the operation method is improved in a targeted manner, and the operation of degrading RAID5 by any advanced RAID algorithm can be implemented in a universal and simple manner, so that the operation complexity is reduced, the DDR access times are reduced, and the advantage of completing the operation at a high speed is achieved.
It should be particularly noted that, the steps in the embodiments of the method for fast universal RAID downgrading to RAID5 may be interleaved, replaced, added, or deleted, and therefore, these methods for fast universal RAID downgrading to RAID5 should also fall within the scope of the present invention, and should not limit the scope of the present invention to the embodiments.
In view of the above, a second aspect of the embodiments of the present invention provides a fast and general RAID downgrade to RAID5 system. As shown in fig. 3, the system 200 includes the following modules: the acquisition module is configured to determine parameter information of the RAID group code to be degraded according to the configuration position relation of load balance; the configuration module is used for drawing and dispatching the corresponding disk in the RAID group to be degraded according to the requirement and rearranging and numbering the rest RAID groups; the shifting module is configured to calculate a new arrangement position based on a load balancing arrangement algorithm and shift the data block or the check block with the changed position; and the updating module is configured to update the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shifting module is configured to: and reading all the data of the RAID group to be degraded into a dynamic memory, and writing the data into a corresponding position according to the new arrangement position.
In some embodiments, the update module is configured to: and carrying out exclusive OR calculation on the check code of the RAID group to be degraded to obtain the degraded check code.
In some embodiments, the system further comprises a write module configured to: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
In view of the above object, a third aspect of the embodiments of the present invention provides a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions being executable by the processor to perform the steps of: s1, determining parameter information of the RAID group code to be degraded according to the load balancing arrangement position relation; s2, extracting and dispatching the corresponding disk in the RAID group to be degraded according to the requirement, and rearranging and numbering the rest RAID groups; s3, calculating a new arrangement position based on a load balancing arrangement algorithm, and shifting the data block or the check block with the changed position; and S4, updating the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shifting the data block or the check block with the changed position includes: and reading all the data of the RAID group to be degraded into a dynamic memory, and writing the data into a corresponding position according to the new arrangement position.
In some embodiments, the updating the shifted parity code of the RAID group according to the parity code of the RAID group to be downgraded includes: and carrying out exclusive OR calculation on the check code of the RAID group to be degraded to obtain the degraded check code.
In some embodiments, the steps further comprise: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
Fig. 4 is a schematic hardware configuration diagram of an embodiment of the computer apparatus for fast and universal RAID downgrading to RAID5 according to the present invention.
Taking the device shown in fig. 4 as an example, the device includes a processor 301 and a memory 302.
The processor 301 and the memory 302 may be connected by a bus or other means, such as the bus connection shown in fig. 4.
The memory 302 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from the use of the fast universal RAID demotion to RAID5 method, and the like. Further, the memory 302 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 302 optionally includes memory located remotely from processor 301, which may be connected to a local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more computer instructions 303 corresponding to the method of fast universal RAID downgrading to RAID5 are stored in memory 302 and when executed by processor 301 perform the method of fast universal RAID downgrading to RAID5 in any of the method embodiments described above.
Any embodiment of a computer device that performs the above-described fast generic RAID destaging to RAID5 method may achieve the same or similar effects as any of the preceding method embodiments to which it corresponds.
The present invention also provides a computer readable storage medium having stored thereon a computer program for executing the method of fast universal RAID demotion to RAID5 when executed by a processor.
FIG. 5 is a schematic diagram of one embodiment of the above described fast general RAID destage to RAID5 computer storage media provided in accordance with the present invention. Taking the computer storage medium as shown in fig. 5 as an example, the computer readable storage medium 401 stores a computer program 402 which, when executed by a processor, performs the method as described above.
Finally, it should be noted that, as one of ordinary skill in the art can appreciate that all or part of the processes of the methods of the above embodiments can be implemented by a computer program to instruct related hardware to implement the method of fast universal RAID downgrading to RAID5, where the program can be stored in a computer readable storage medium, and when executed, the program can include the processes of the embodiments of the methods described above. The storage medium of the program may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like. The embodiments of the computer program may achieve the same or similar effects as any of the above-described method embodiments.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A method for fast and universal RAID destaging to RAID5, comprising the steps of:
determining parameter information of the RAID group code to be degraded according to the configuration position relationship of load balance;
drawing and calling out a corresponding disk in the RAID group to be degraded according to requirements, and rearranging and numbering the rest RAID groups;
calculating a new arrangement position based on a load balancing arrangement algorithm, and shifting the data block or the check block with the changed position; and
and updating the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
2. The method of claim 1, wherein shifting the changed location data block or parity block comprises:
and reading all the data of the RAID group to be degraded into a dynamic memory, and writing the data into a corresponding position according to the new arrangement position.
3. The method of claim 1, wherein the updating the shifted parity code of the RAID group according to the parity code of the RAID group to be downgraded comprises:
and carrying out exclusive OR calculation on the check code of the RAID group to be degraded to obtain the degraded check code.
4. The method of claim 3, further comprising:
and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
5. A system for fast universal RAID destaging to RAID5, comprising:
the acquisition module is configured to determine parameter information of the RAID group code to be degraded according to the configuration position relation of load balance;
the configuration module is used for extracting and dispatching a corresponding disk in the RAID group to be degraded according to requirements and rearranging and numbering the rest RAID groups;
the shifting module is configured to calculate a new arrangement position based on a load balancing arrangement algorithm and shift the data block or the check block with the changed position; and
and the updating module is configured to update the shifted check code of the RAID group according to the check code of the RAID group to be degraded.
6. The system of claim 5, wherein the shifting module is configured to:
and reading all the data of the RAID group to be degraded into a dynamic memory, and writing the data into a corresponding position according to the new configuration position.
7. The system of claim 5, wherein the update module is configured to:
and carrying out exclusive OR calculation on the check code of the RAID group to be degraded to obtain the degraded check code.
8. The system of claim 7, further comprising a write module configured to:
and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
9. A computer device, comprising:
at least one processor; and
a memory storing computer instructions executable on the processor, the instructions when executed by the processor implementing the steps of the method of any one of claims 1 to 4.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210153471.0A CN114546272B (en) | 2022-02-18 | 2022-02-18 | Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210153471.0A CN114546272B (en) | 2022-02-18 | 2022-02-18 | Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114546272A true CN114546272A (en) | 2022-05-27 |
| CN114546272B CN114546272B (en) | 2024-04-26 |
Family
ID=81674757
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210153471.0A Active CN114546272B (en) | 2022-02-18 | 2022-02-18 | Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114546272B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115167787A (en) * | 2022-09-06 | 2022-10-11 | 苏州浪潮智能科技有限公司 | Data unloading method, system, equipment and computer readable storage medium |
| CN116501537A (en) * | 2023-06-26 | 2023-07-28 | 苏州浪潮智能科技有限公司 | Disk array switching method, system, electronic device and storage medium |
Citations (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6138125A (en) * | 1998-03-31 | 2000-10-24 | Lsi Logic Corporation | Block coding method and system for failure recovery in disk arrays |
| US6347359B1 (en) * | 1998-02-27 | 2002-02-12 | Aiwa Raid Technology, Inc. | Method for reconfiguration of RAID data storage systems |
| US20030221060A1 (en) * | 2002-05-23 | 2003-11-27 | Umberger David K. | Managing data in a multi-level raid storage array |
| US20050086429A1 (en) * | 2003-10-15 | 2005-04-21 | Paresh Chatterjee | Method, apparatus and program for migrating between striped storage and parity striped storage |
| JP2005293119A (en) * | 2004-03-31 | 2005-10-20 | Toshiba Solutions Corp | Disk array control device, processing method applied to this device upon detection of data defect, and program |
| CN101526885A (en) * | 2009-04-21 | 2009-09-09 | 杭州华三通信技术有限公司 | Method for improving capability of redundant array of independent disk and controller therefor |
| US20100199039A1 (en) * | 2009-01-30 | 2010-08-05 | International Business Machines Corporation | Systems and Methods for Optimizing Host Reads and Cache Destages in a Raid System |
| CN101923501A (en) * | 2010-07-30 | 2010-12-22 | 华中科技大学 | Disk array multi-level fault tolerance method |
| US8307271B1 (en) * | 2009-09-17 | 2012-11-06 | Emc Corporation | Fast verification of data block cycle redundancy checks |
| CN104932835A (en) * | 2015-05-31 | 2015-09-23 | 上海交通大学 | Erasure code based distributed storage system capacity expansion and reduction method |
| CN105824725A (en) * | 2016-03-10 | 2016-08-03 | 中国人民解放军国防科学技术大学 | X-coding extension method capable of quickly recovering and realizing load balance |
| CN106933707A (en) * | 2017-03-15 | 2017-07-07 | 李经纬 | A kind of data storage device data restoration methods and system |
| US9898224B1 (en) * | 2012-09-12 | 2018-02-20 | EMC IP Holding Company LLC | Automatic adjustment of capacity usage by data storage optimizer for data migration |
| US20180095824A1 (en) * | 2016-10-03 | 2018-04-05 | International Business Machines Corporation | Parity delta caching for short writes |
| CN108228086A (en) * | 2016-12-21 | 2018-06-29 | 伊姆西Ip控股有限责任公司 | The method and apparatus that RAID is rebuild |
| US20180300212A1 (en) * | 2017-04-17 | 2018-10-18 | EMC IP Holding Company LLC | Method, device and computer readable storage media for rebuilding redundant array of independent disks |
| CN108874314A (en) * | 2018-05-31 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of reconstructing method and device of raid-array |
| CN109002263A (en) * | 2018-07-20 | 2018-12-14 | 腾讯科技（深圳）有限公司 | The method of adjustment and device of memory capacity |
| US20190163409A1 (en) * | 2017-10-27 | 2019-05-30 | EMC IP Holding Company LLC | Methods and devices for writing data in a disk array in storage system |
| CN110442306A (en) * | 2019-06-28 | 2019-11-12 | 苏州浪潮智能科技有限公司 | A kind of fault handling method of distributed memory system, equipment and storage medium |
| US20200133809A1 (en) * | 2018-10-31 | 2020-04-30 | EMC IP Holding Company LLC | Method, device and program product for managing data of storage device |
| CN111104046A (en) * | 2018-10-25 | 2020-05-05 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer-readable storage medium for managing redundant disk array |
| WO2020173092A1 (en) * | 2019-02-28 | 2020-09-03 | 华为技术有限公司 | Data processing method, redundant array of independent disks controller, and data storage system |
| CN111857540A (en) * | 2019-04-25 | 2020-10-30 | 伊姆西Ip控股有限责任公司 | Data access method, device and computer program product |
| CN111966291A (en) * | 2020-08-14 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Data storage method, system and related device in storage cluster |
| CN113535082A (en) * | 2021-06-09 | 2021-10-22 | 杭州电子科技大学 | Method for realizing wear inverse equilibrium |
-
2022
- 2022-02-18 CN CN202210153471.0A patent/CN114546272B/en active Active
Patent Citations (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6347359B1 (en) * | 1998-02-27 | 2002-02-12 | Aiwa Raid Technology, Inc. | Method for reconfiguration of RAID data storage systems |
| US6138125A (en) * | 1998-03-31 | 2000-10-24 | Lsi Logic Corporation | Block coding method and system for failure recovery in disk arrays |
| US20030221060A1 (en) * | 2002-05-23 | 2003-11-27 | Umberger David K. | Managing data in a multi-level raid storage array |
| US20050086429A1 (en) * | 2003-10-15 | 2005-04-21 | Paresh Chatterjee | Method, apparatus and program for migrating between striped storage and parity striped storage |
| JP2005293119A (en) * | 2004-03-31 | 2005-10-20 | Toshiba Solutions Corp | Disk array control device, processing method applied to this device upon detection of data defect, and program |
| US20100199039A1 (en) * | 2009-01-30 | 2010-08-05 | International Business Machines Corporation | Systems and Methods for Optimizing Host Reads and Cache Destages in a Raid System |
| CN101526885A (en) * | 2009-04-21 | 2009-09-09 | 杭州华三通信技术有限公司 | Method for improving capability of redundant array of independent disk and controller therefor |
| US8307271B1 (en) * | 2009-09-17 | 2012-11-06 | Emc Corporation | Fast verification of data block cycle redundancy checks |
| CN101923501A (en) * | 2010-07-30 | 2010-12-22 | 华中科技大学 | Disk array multi-level fault tolerance method |
| US9898224B1 (en) * | 2012-09-12 | 2018-02-20 | EMC IP Holding Company LLC | Automatic adjustment of capacity usage by data storage optimizer for data migration |
| CN104932835A (en) * | 2015-05-31 | 2015-09-23 | 上海交通大学 | Erasure code based distributed storage system capacity expansion and reduction method |
| CN105824725A (en) * | 2016-03-10 | 2016-08-03 | 中国人民解放军国防科学技术大学 | X-coding extension method capable of quickly recovering and realizing load balance |
| US20180095824A1 (en) * | 2016-10-03 | 2018-04-05 | International Business Machines Corporation | Parity delta caching for short writes |
| CN108228086A (en) * | 2016-12-21 | 2018-06-29 | 伊姆西Ip控股有限责任公司 | The method and apparatus that RAID is rebuild |
| CN106933707A (en) * | 2017-03-15 | 2017-07-07 | 李经纬 | A kind of data storage device data restoration methods and system |
| US20180300212A1 (en) * | 2017-04-17 | 2018-10-18 | EMC IP Holding Company LLC | Method, device and computer readable storage media for rebuilding redundant array of independent disks |
| US20190163409A1 (en) * | 2017-10-27 | 2019-05-30 | EMC IP Holding Company LLC | Methods and devices for writing data in a disk array in storage system |
| CN108874314A (en) * | 2018-05-31 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of reconstructing method and device of raid-array |
| CN109002263A (en) * | 2018-07-20 | 2018-12-14 | 腾讯科技（深圳）有限公司 | The method of adjustment and device of memory capacity |
| CN111104046A (en) * | 2018-10-25 | 2020-05-05 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer-readable storage medium for managing redundant disk array |
| US20200133809A1 (en) * | 2018-10-31 | 2020-04-30 | EMC IP Holding Company LLC | Method, device and program product for managing data of storage device |
| WO2020173092A1 (en) * | 2019-02-28 | 2020-09-03 | 华为技术有限公司 | Data processing method, redundant array of independent disks controller, and data storage system |
| CN111857540A (en) * | 2019-04-25 | 2020-10-30 | 伊姆西Ip控股有限责任公司 | Data access method, device and computer program product |
| CN110442306A (en) * | 2019-06-28 | 2019-11-12 | 苏州浪潮智能科技有限公司 | A kind of fault handling method of distributed memory system, equipment and storage medium |
| CN111966291A (en) * | 2020-08-14 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Data storage method, system and related device in storage cluster |
| CN113535082A (en) * | 2021-06-09 | 2021-10-22 | 杭州电子科技大学 | Method for realizing wear inverse equilibrium |
Non-Patent Citations (3)
| Title |
|---|
| 李梓杨;于炯;卞琛;王跃飞;鲁亮;: "基于负载感知的数据流动态负载均衡策略", 计算机应用, no. 10 * |
| 来燃;冯兴杰;王晴;李杰;焦文欢;: "一种可行的优化降级读性能RAID-6编码算法", 中国民航大学学报, no. 04, 15 August 2018 (2018-08-15) * |
| 罗梅;程波;: "磁盘阵列多级恢复系统的设计与实现", 计算机工程, no. 10 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115167787A (en) * | 2022-09-06 | 2022-10-11 | 苏州浪潮智能科技有限公司 | Data unloading method, system, equipment and computer readable storage medium |
| WO2024051114A1 (en) * | 2022-09-06 | 2024-03-14 | 苏州元脑智能科技有限公司 | Data transfer method, system and device, and nonvolatile readable storage medium |
| CN116501537A (en) * | 2023-06-26 | 2023-07-28 | 苏州浪潮智能科技有限公司 | Disk array switching method, system, electronic device and storage medium |
| CN116501537B (en) * | 2023-06-26 | 2023-09-19 | 苏州浪潮智能科技有限公司 | Disk array switching method, system, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114546272B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Corbett et al. | Row-diagonal parity for double disk failure correction | |
| US9063910B1 (en) | Data recovery after triple disk failure | |
| US5351246A (en) | Method and means for coding and rebuilding that data contents of unavailable DASDs or rebuilding the contents of DASDs in error in the presence of reduced number of unavailable DASDs in a DASD array | |
| CN114546272A (en) | Method, system, apparatus and storage medium for fast universal RAID demotion to RAID5 | |
| CN115080303B (en) | Encoding method, decoding method, device and medium for RAID6 disk array | |
| JPH1139104A (en) | Parity storage and data restoration method for external storage sub system | |
| US10558524B2 (en) | Computing system with data recovery mechanism and method of operation thereof | |
| WO2013147794A1 (en) | Enhanced storage of metadata utilizing improved error detection and correction in computer memory | |
| US20140164695A1 (en) | Method and system for storing and rebuilding data | |
| WO2023151290A1 (en) | Data encoding method and apparatus, device, and medium | |
| CN101281788A (en) | Flash memory system as well as control method thereof | |
| CN114816278B (en) | Data migration method, system, equipment and storage medium of storage server | |
| CN114610244A (en) | Method, system and equipment for degrading independent redundant disk array | |
| CN114610525A (en) | Data updating method, system and storage medium for disk array | |
| CN114115729B (en) | Efficient data migration method under RAID | |
| US20050132134A1 (en) | [raid storage device] | |
| US9323616B2 (en) | Accelerated data recovery using a repeating stripe group arrangement | |
| CN114895842A (en) | TP-RAID (transport protocol-redundant array of independent disks) encoding and decoding method, system, equipment and storage medium | |
| CN116501553B (en) | Data recovery method, device, system, electronic equipment and storage medium | |
| KR101053948B1 (en) | Memory systems and computer systems | |
| CN110600070B (en) | Coding and repairing method for improving repairing performance of solid state disk array system | |
| CN115167787B (en) | Data unloading method, system, equipment and computer readable storage medium | |
| JP5360666B2 (en) | Method and system for performing I / O operations of multiple disk arrays | |
| CN116450048A (en) | Method for degrading RAID6 disk array into RAID5 disk array | |
| CN114756175A (en) | Decoding method, system, equipment and medium for disk array |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |