CN114546272B - Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) - Google Patents
Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) Download PDFInfo
- Publication number
- CN114546272B CN114546272B CN202210153471.0A CN202210153471A CN114546272B CN 114546272 B CN114546272 B CN 114546272B CN 202210153471 A CN202210153471 A CN 202210153471A CN 114546272 B CN114546272 B CN 114546272B
- Authority
- CN
- China
- Prior art keywords
- raid
- raid group
- degraded
- check
- check code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000003860 storage Methods 0.000 title claims abstract description 34
- 230000000593 degrading effect Effects 0.000 title abstract description 16
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 30
- 230000015654 memory Effects 0.000 claims description 25
- 230000015556 catabolic process Effects 0.000 claims description 19
- 238000006731 degradation reaction Methods 0.000 claims description 19
- 238000004364 calculation method Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 7
- 230000005012 migration Effects 0.000 abstract description 3
- 238000013508 migration Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 9
- 230000008901 benefit Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
Abstract
The invention provides a method, a system, equipment and a storage medium for degrading RAID (redundant array of independent disks) into RAID5, wherein the method comprises the following steps: determining parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing; drawing out corresponding disks from the RAID groups to be degraded according to requirements, and rearranging and numbering the rest RAID groups; calculating new arrangement positions based on a load balancing arrangement algorithm, and shifting the data blocks or check blocks with changed positions; and updating the check code of the shifted RAID group according to the check code of the RAID group to be degraded. The invention can reduce data migration, reduce the RAID group check code of new RAID5, and ensure simple operation and general purpose for any RAID group on the premise of ensuring correct function.
Description
Technical Field
The present invention relates to the field of disk arrays, and in particular, to a method, system, device, and storage medium for fast and versatile RAID degradation to RAID 5.
Background
RAID (Redundant Arrays of INDEPENDENT DISKS) is a redundant disk array, and the disk array is formed by combining a plurality of independent disks together, so that a disk group with huge capacity is obtained. By adopting the RAID storage technology, the storage capacity can be greatly improved, the request processing capacity of the input and output of the system is improved, and the reliability of the data is improved by a parallel access means and an information redundancy technology through a data distributed storage technology. RAID may be classified into different levels according to different policies and architectures: RAID 0, 1, 5, 6, 10.
RAID 5 (distributed parity independent disk architecture). Its parity code is present on all disks, where p0 represents the parity value of the 0 th stripe, and so on. RAID 5 has high read efficiency, and generally has good write efficiency and block-type collective access efficiency. Because the parity codes are on different disks, reliability is improved. But it does not solve well the parallelism of data transmission and the design of the controller is quite difficult. For RAID 5, most data transfers operate on only one disk, and may operate in parallel. In RAID 5, there is a "write penalty," i.e., each write operation will result in four actual read/write operations, where the old data and parity information are read twice and the new data and parity information are written twice.
RAID 6 is a parity independent disk structure with two distributed storages. The method is an expansion of RAID 5 and is mainly used for occasions requiring that data cannot be in error absolutely. Since the second parity value is introduced, n+2 disks are required, and the design of the controller becomes very complex, further improving the data reliability of the disk array. More space is required to store the check values while having a higher performance penalty in the write operation.
In an actual application scenario, a user needs to demote an already-assembled RAID group, where demotion is to reduce RAID6 to RAID5, 1, 0 or reduce TP-RAID to RAID6 or RAID5, 1, 0, and whichever demotion involves extracting a block of disk originally used for storing and checking from the RAID group, where the original RAID group needs to complete data movement, and the demoted RAID group calculates. Conventional RAID degradation is complicated by migrating the data again and then completing the encoding based on a load balancing algorithm after the disk is extracted.
Disclosure of Invention
In view of this, an objective of the embodiments of the present invention is to provide a method, a system, a computer device and a computer readable storage medium for degrading a fast and general RAID to RAID5, which can reduce data migration, reduce new RAID group check codes of RAID5, and guarantee simple operation on the premise of ensuring correct functions, and is general for any RAID group.
Based on the above objects, an aspect of the embodiments of the present invention provides a method for degrading a fast and general RAID to RAID5, which includes the following steps: determining parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing; drawing out corresponding disks from the RAID groups to be degraded according to requirements, and rearranging and numbering the rest RAID groups; calculating new arrangement positions based on a load balancing arrangement algorithm, and shifting the data blocks or check blocks with changed positions; and updating the check code of the shifted RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shifting the data block or the check block whose position has been changed includes: and reading all the data of the RAID group to be demoted into a dynamic memory, and writing the data into the corresponding position according to the new arrangement position.
In some embodiments, the updating the check code of the shifted RAID group according to the check code of the RAID group to be downgraded includes: and performing exclusive OR calculation on the check codes of the RAID group to be demoted to obtain demoted check codes.
In some embodiments, the method further comprises: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
In another aspect of the embodiments of the present invention, a system for degrading a fast general RAID to RAID5 is provided, including: the acquisition module is configured to determine the parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing; the arrangement module is configured to extract corresponding disks from the RAID groups to be degraded according to requirements, and rearrange and number the rest RAID groups; the shifting module is configured to calculate new arrangement positions based on a load balancing arrangement algorithm and shift the data blocks or the check blocks with the positions changed; and the updating module is configured to update the check code of the shifted RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shift module is configured to: and reading all the data of the RAID group to be demoted into a dynamic memory, and writing the data into the corresponding position according to the new arrangement position.
In some embodiments, the update module is configured to: and performing exclusive OR calculation on the check codes of the RAID group to be demoted to obtain demoted check codes.
In some embodiments, the system further comprises a write module configured to: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
In yet another aspect of the embodiment of the present invention, there is also provided a computer apparatus, including: at least one processor; and a memory storing computer instructions executable on the processor, which when executed by the processor, perform the steps of the method as above.
In yet another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium storing a computer program which, when executed by a processor, implements the method steps as described above.
The invention has the following beneficial technical effects: the data migration can be reduced, the RAID group check code of the new RAID5 is reduced, and the operation is ensured to be simple and the method is universal for any RAID group on the premise of ensuring the correct function.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an embodiment of a method for fast universal RAID degradation to RAID5 provided by the present invention;
FIG. 2 is a block diagram of an embodiment of a method for fast universal RAID degradation to RAID5 provided by the present invention;
FIG. 3 is a schematic diagram of an embodiment of a system for fast universal RAID degradation to RAID5 provided by the present invention;
FIG. 4 is a schematic diagram of a hardware architecture of an embodiment of a fast general RAID downgrade to RAID5 computer device according to the present invention;
FIG. 5 is a schematic diagram of an embodiment of a fast general RAID downgrade to RAID5 computer storage medium according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention will be described in further detail with reference to the accompanying drawings.
It should be noted that, in the embodiments of the present invention, all the expressions "first" and "second" are used to distinguish two entities with the same name but different entities or different parameters, and it is noted that the "first" and "second" are only used for convenience of expression, and should not be construed as limiting the embodiments of the present invention, and the following embodiments are not described one by one.
In a first aspect of the embodiment of the present invention, an embodiment of a method for degrading a fast general RAID to RAID5 is provided. FIG. 1 is a schematic diagram of an embodiment of a method for fast universal RAID degradation to RAID5 provided by the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:
s1, determining parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing;
s2, extracting corresponding disks from the RAID groups to be degraded according to requirements, and rearranging and numbering the rest RAID groups;
S3, calculating new arrangement positions based on a load balancing arrangement algorithm, and shifting the data blocks or check blocks with changed positions; and
S4, updating the check code of the shifted RAID group according to the check code of the RAID group to be degraded.
FIG. 2 is a block diagram of an embodiment of a method for fast universal RAID degradation to RAID5 according to the present invention, and the embodiment of the present invention is described with reference to FIG. 2. After the RAID group is completed, the RAID group may need to be downgraded based on the requirement of a user, the downgrade refers to that the existing RAID group with good group is downgraded by one level or two levels, the position where the check data is originally stored is vacated, the vacation of the hard disk is realized for the use of other functional requirements, the downgrade generally comprises that the TP-RAID is downgraded to RAID5, 6 and 0, and RAID6 is downgraded to RAID5 and 0.
The conventional RAID algorithm needs to determine the parameter information of the RAID code first, where the parameter information is generally determined based on a specific arrangement position relationship of load balancing, and taking common load balancing arrangement with non-aligned left-handed threads as an example, when the data disk is 3, the check disk is 2, and the RAID6 group is performed, the general RAID group arrangement form is shown in ① in fig. 2.
The invention can realize the fast and simple realization aiming at the requirement that any RAID algorithm is degraded into RAID5 besides ensuring the above relation when degrading. To illustrate the correctness of its method of operation, the algorithms for RAID5 and RAID6 will first be described.
The algorithm principle of conventional RAID5 uses:
d1+d2+d3+...+dm+p＝0 (1)
the algorithm principle of RAID6 is:
The RAID encoding and decoding algorithm is to solve the equation with p as the unknown number by making the relation. The operation here uses a Galois field operation in storage, so it is known that the relationship of p in conventional RAID5 and 6 is:
RAID5：
RAID6：
In a stored system, in order to reduce the operation complexity and ensure that data cannot overflow, the above unified and stored codec operation is generally implemented through a galois field. That is, in a hardware implementation, the addition and subtraction are implemented by exclusive or operation, and the multiplication and division are implemented by galois multiplication and division for different galois field polynomials.
In normal RAID operation, after degradation occurs, all related data are re-patted based on algorithm arrangement requirements of load balancing, and then encoding is performed again. The operation of the present invention is different from the conventional operation, and for illustration, the operation of degrading RAID6 to RAID5 in the left-hand misalignment mode in FIG. 2 is taken as an example for illustration:
And determining the parameter information of the RAID group codes to be degraded according to the distribution position relation of the load balancing. P1 and P2 in FIG. 2 represent two checks in a RAID6 group, D0-D14 are different user data blocks, row represents stripes, and column represents actual hard disks. The data blocks and the check blocks are distributed in a RAID6 group formed by 5 hard disks based on a load balancing mode, and the positions of the check blocks are different in each band based on a left-hand misalignment mode, so that the disk access requirements are averaged. Based on the disk numbers (1-5), the encoding and decoding parameter relation of RAID6 can be obtained, and based on the relation, the corresponding data blocks are used, so that the encoding of each stripe can be completed. If degradation occurs, the corresponding check block needs to be removed firstly, then the corresponding data block is moved based on the requirement of a load balancing algorithm, and the information of the coding check block is rewritten.
And drawing out corresponding disks from the RAID groups to be degraded according to requirements, and rearranging and numbering the rest RAID groups. Any disk is swapped out based on the requirements, and the disk with the number 3 is arbitrarily swapped out for the sake of convenience of example. The swapped disk is shown in dashed lines in fig. 2, and the host and other records would indicate that the disk is not in the RAID group, and if new needs exist, new information would be written to the dashed disk. The Data in the dotted line needs to be read into dynamic memories such as DDR (Double Data Rate) and the like, because the Data information thereof involves rewriting a new location, and the verification information involves calculating new RAID group verification information.
And calculating new arrangement positions based on a load balancing arrangement algorithm, and shifting the data blocks or check blocks with changed positions. The new arrangement positions are calculated based on the load balancing arrangement algorithm, and the gray blocks (i.e., D0, D1, D5, D7, D9, D12, D13, and D14) in fig. 2 represent data blocks or check blocks that have changed from before. Wherein the data blocks need to be processed by shifting operations.
In some embodiments, the shifting the data block or the check block whose position has been changed includes: and reading all the data of the RAID group to be demoted into a dynamic memory, and writing the data into the corresponding position according to the new arrangement position. The shift operation is performed by first reading original data into a dynamic memory such as a DDR and then writing the data into the data at the correct position. The sequence of reading and writing is based on the premise of not affecting the correctness of the data and guaranteeing the integrity of the data, and is based on the condition that DDR is accessed as little as possible.
Updating the check code of the shifted RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the updating the check code of the shifted RAID group according to the check code of the RAID group to be downgraded includes: and performing exclusive OR calculation on the check codes of the RAID group to be demoted to obtain demoted check codes.
RAID6 or RAID-TP, and other high level RAID groups that may be involved, when downgraded to RAID5, involve updating of the check code because of changes in the RAID algorithm, where the check code value must change. The traditional method is to recalculate the RAID5 based algorithm, and the embodiment of the invention provides a quick algorithm for updating the RAID5 check code based on load balancing arrangement. The algorithm is as follows:
where p' is the check after downgrading to RAID5, and p1p2 is the original check in the corresponding RAID 6. Degradation of other RAID algorithms is also performed in the same manner. The algorithm feasibility is verified by taking RAID6 coding of the formula (4) as an example, and summing the P1P2 of the code to obtain the following algorithm feasibility:
The obtained result is the same as the P of RAID5 in the formula (3), and the method is proved to be correct. Correspondingly, other RAID algorithms can be deduced, and the same operation results can be obtained by the method of the invention, namely, the method for updating the check code is proved to be in accordance with the coding requirement of RAID5, and the check code is correct.
In some embodiments, the method further comprises: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position. The first step in the update method of the embodiment of the present invention is to directly exclusive-or the check data from the disk, here, for example, RAID6, so there are two check disk data, and for other advanced RAID algorithms, a corresponding amount of check data may be taken out. And the second step is to store the result of the exclusive OR operation into DDR or buffer and other storage media which can access data. And thirdly, writing the data into a new magnetic disk at a proper time based on the arrangement mode of the load balancing operation.
The embodiment of the invention obtains a degradation operation mode different from the traditional RAID group through deducing and improving the algorithm, and the data is simply operated to obtain corresponding check data, and based on the mode, the operation method is purposefully improved, and the operation of degrading RAID5 by any advanced RAID algorithm can be implemented in a universal and simple mode, thereby reducing the operation complexity and DDR access times, and achieving the advantage of completing the operation at high speed.
It should be noted that, in the embodiments of the method for degrading the fast general RAID to RAID5, the steps may be intersected, replaced, added and subtracted, so that the method for degrading the fast general RAID to RAID5 by using the reasonable permutation and combination transformation should also belong to the protection scope of the present invention, and should not limit the protection scope of the present invention to the embodiments.
Based on the above objects, a second aspect of the embodiments of the present invention proposes a system for degrading a fast general-purpose RAID to RAID 5. As shown in fig. 3, the system 200 includes the following modules: the acquisition module is configured to determine the parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing; the arrangement module is configured to extract corresponding disks from the RAID groups to be degraded according to requirements, and rearrange and number the rest RAID groups; the shifting module is configured to calculate new arrangement positions based on a load balancing arrangement algorithm and shift the data blocks or the check blocks with the positions changed; and the updating module is configured to update the check code of the shifted RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shift module is configured to: and reading all the data of the RAID group to be demoted into a dynamic memory, and writing the data into the corresponding position according to the new arrangement position.
In some embodiments, the update module is configured to: and performing exclusive OR calculation on the check codes of the RAID group to be demoted to obtain demoted check codes.
In some embodiments, the system further comprises a write module configured to: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
In view of the above object, a third aspect of the embodiments of the present invention provides a computer device, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions being executable by the processor to perform the steps of: s1, determining parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing; s2, extracting corresponding disks from the RAID groups to be degraded according to requirements, and rearranging and numbering the rest RAID groups; s3, calculating new arrangement positions based on a load balancing arrangement algorithm, and shifting the data blocks or check blocks with changed positions; and S4, updating the check code of the shifted RAID group according to the check code of the RAID group to be degraded.
In some embodiments, the shifting the data block or the check block whose position has been changed includes: and reading all the data of the RAID group to be demoted into a dynamic memory, and writing the data into the corresponding position according to the new arrangement position.
In some embodiments, the updating the check code of the shifted RAID group according to the check code of the RAID group to be downgraded includes: and performing exclusive OR calculation on the check codes of the RAID group to be demoted to obtain demoted check codes.
In some embodiments, the steps further comprise: and storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
As shown in FIG. 4, a hardware configuration diagram of an embodiment of the fast universal RAID degradation to RAID5 computer device is provided in the present invention.
Taking the example of the apparatus shown in fig. 4, a processor 301 and a memory 302 are included in the apparatus.
The processor 301 and the memory 302 may be connected by a bus or otherwise, for example in fig. 4.
The memory 302 is used as a non-volatile computer readable storage medium for storing non-volatile software programs, non-volatile computer executable programs, and modules, such as program instructions/modules corresponding to the method for fast general purpose RAID degradation to RAID5 in embodiments of the present application. The processor 301 executes various functional applications of the server and data processing, i.e., a method of implementing fast general purpose RAID degradation to RAID5, by running non-volatile software programs, instructions, and modules stored in the memory 302.
Memory 302 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the fast general RAID degradation to RAID5 method, etc. In addition, memory 302 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 302 may optionally include memory located remotely from processor 301, which may be connected to the local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Computer instructions 303 corresponding to one or more methods of fast general RAID downgrading to RAID5 are stored in memory 302 that, when executed by processor 301, perform the method of fast general RAID downgrading to RAID5 in any of the method embodiments described above.
Any one embodiment of a computer device that performs the above-described method of fast universal RAID degradation to RAID5 may achieve the same or similar effects as any of the previously described method embodiments corresponding thereto.
The present invention also provides a computer readable storage medium storing a computer program which when executed by a processor performs a method of fast general purpose RAID degradation to RAID 5.
As shown in FIG. 5, a schematic diagram of one embodiment of a computer storage medium for degrading the fast universal RAID described above to RAID5 is provided. Taking a computer storage medium as shown in fig. 5 as an example, the computer readable storage medium 401 stores a computer program 402 that when executed by a processor performs the above method.
Finally, it should be noted that, as will be appreciated by those skilled in the art, implementing all or part of the above-described embodiments of the method, the method for quickly degrading RAID to RAID5 may be implemented by a computer program to instruct related hardware, and the program of the method for quickly degrading RAID to RAID5 may be stored in a computer readable storage medium, where the program may include the steps of the embodiments of the methods described above when executed. The storage medium of the program may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (RAM), or the like. The computer program embodiments described above may achieve the same or similar effects as any of the method embodiments described above.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that as used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The foregoing embodiment of the present invention has been disclosed with reference to the number of embodiments for the purpose of description only, and does not represent the advantages or disadvantages of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, and the program may be stored in a computer readable storage medium, where the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will appreciate that: the above discussion of any embodiment is merely exemplary and is not intended to imply that the scope of the disclosure of embodiments of the invention, including the claims, is limited to such examples; combinations of features of the above embodiments or in different embodiments are also possible within the idea of an embodiment of the invention, and many other variations of the different aspects of the embodiments of the invention as described above exist, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the embodiments should be included in the protection scope of the embodiments of the present invention.
Claims (8)
1. A method for fast universal RAID degradation to RAID5, comprising the steps of:
Determining parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing;
Drawing out corresponding disks from the RAID groups to be degraded according to requirements, and rearranging and numbering the rest RAID groups;
Calculating new arrangement positions based on a load balancing arrangement algorithm, and shifting the data blocks or check blocks with changed positions; and
Updating the check code of the shifted RAID group according to the check code of the RAID group to be degraded,
The updating the check code of the shifted RAID group according to the check code of the RAID group to be degraded comprises the following steps:
and performing exclusive OR calculation on the check codes of the RAID group to be demoted to obtain demoted check codes.
2. The method of claim 1, wherein shifting the changed position of the data block or the check block comprises:
and reading all the data of the RAID group to be demoted into a dynamic memory, and writing the data into the corresponding position according to the new arrangement position.
3. The method according to claim 1, wherein the method further comprises:
And storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
4. A system for fast universal RAID degradation to RAID5, comprising:
the acquisition module is configured to determine the parameter information of RAID group codes to be degraded according to the distribution position relation of load balancing;
The arrangement module is configured to extract corresponding disks from the RAID groups to be degraded according to requirements, and rearrange and number the rest RAID groups;
The shifting module is configured to calculate new arrangement positions based on a load balancing arrangement algorithm and shift the data blocks or the check blocks with the positions changed; and
An updating module configured to update the check code of the shifted RAID group according to the check code of the RAID group to be demoted,
The update module is further configured to:
and performing exclusive OR calculation on the check codes of the RAID group to be demoted to obtain demoted check codes.
5. The system of claim 4, wherein the shift module is configured to:
and reading all the data of the RAID group to be demoted into a dynamic memory, and writing the data into the corresponding position according to the new arrangement position.
6. The system of claim 4, further comprising a write module configured to:
And storing the degraded check code into a storage medium, and writing the degraded check code into a corresponding disk according to the new arrangement position.
7. A computer device, comprising:
At least one processor; and
A memory storing computer instructions executable on the processor, which instructions when executed by the processor implement the steps of the method of any one of claims 1-3.
8. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method of any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210153471.0A CN114546272B (en) | 2022-02-18 | 2022-02-18 | Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210153471.0A CN114546272B (en) | 2022-02-18 | 2022-02-18 | Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114546272A CN114546272A (en) | 2022-05-27 |
| CN114546272B true CN114546272B (en) | 2024-04-26 |
Family
ID=81674757
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210153471.0A Active CN114546272B (en) | 2022-02-18 | 2022-02-18 | Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114546272B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115167787B (en) * | 2022-09-06 | 2023-01-24 | 苏州浪潮智能科技有限公司 | Data unloading method, system, equipment and computer readable storage medium |
| CN116501537B (en) * | 2023-06-26 | 2023-09-19 | 苏州浪潮智能科技有限公司 | Disk array switching method, system, electronic device and storage medium |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6138125A (en) * | 1998-03-31 | 2000-10-24 | Lsi Logic Corporation | Block coding method and system for failure recovery in disk arrays |
| US6347359B1 (en) * | 1998-02-27 | 2002-02-12 | Aiwa Raid Technology, Inc. | Method for reconfiguration of RAID data storage systems |
| JP2005293119A (en) * | 2004-03-31 | 2005-10-20 | Toshiba Solutions Corp | Disk array control device, processing method applied to this device upon detection of data defect, and program |
| CN101526885A (en) * | 2009-04-21 | 2009-09-09 | 杭州华三通信技术有限公司 | Method for improving capability of redundant array of independent disk and controller therefor |
| CN101923501A (en) * | 2010-07-30 | 2010-12-22 | 华中科技大学 | Disk array multi-level fault tolerance method |
| US8307271B1 (en) * | 2009-09-17 | 2012-11-06 | Emc Corporation | Fast verification of data block cycle redundancy checks |
| CN104932835A (en) * | 2015-05-31 | 2015-09-23 | 上海交通大学 | Erasure code based distributed storage system capacity expansion and reduction method |
| CN105824725A (en) * | 2016-03-10 | 2016-08-03 | 中国人民解放军国防科学技术大学 | X-coding extension method capable of quickly recovering and realizing load balance |
| CN106933707A (en) * | 2017-03-15 | 2017-07-07 | 李经纬 | A kind of data storage device data restoration methods and system |
| US9898224B1 (en) * | 2012-09-12 | 2018-02-20 | EMC IP Holding Company LLC | Automatic adjustment of capacity usage by data storage optimizer for data migration |
| CN108228086A (en) * | 2016-12-21 | 2018-06-29 | 伊姆西Ip控股有限责任公司 | The method and apparatus that RAID is rebuild |
| CN108874314A (en) * | 2018-05-31 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of reconstructing method and device of raid-array |
| CN109002263A (en) * | 2018-07-20 | 2018-12-14 | 腾讯科技（深圳）有限公司 | The method of adjustment and device of memory capacity |
| CN110442306A (en) * | 2019-06-28 | 2019-11-12 | 苏州浪潮智能科技有限公司 | A kind of fault handling method of distributed memory system, equipment and storage medium |
| CN111104046A (en) * | 2018-10-25 | 2020-05-05 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer-readable storage medium for managing redundant disk array |
| WO2020173092A1 (en) * | 2019-02-28 | 2020-09-03 | 华为技术有限公司 | Data processing method, redundant array of independent disks controller, and data storage system |
| CN111857540A (en) * | 2019-04-25 | 2020-10-30 | 伊姆西Ip控股有限责任公司 | Data access method, device and computer program product |
| CN111966291A (en) * | 2020-08-14 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Data storage method, system and related device in storage cluster |
| CN113535082A (en) * | 2021-06-09 | 2021-10-22 | 杭州电子科技大学 | Method for realizing wear inverse equilibrium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6898667B2 (en) * | 2002-05-23 | 2005-05-24 | Hewlett-Packard Development Company, L.P. | Managing data in a multi-level raid storage array |
| US7206991B2 (en) * | 2003-10-15 | 2007-04-17 | Lsi Logic Corporation | Method, apparatus and program for migrating between striped storage and parity striped storage |
| US20100199039A1 (en) * | 2009-01-30 | 2010-08-05 | International Business Machines Corporation | Systems and Methods for Optimizing Host Reads and Cache Destages in a Raid System |
| US10055292B2 (en) * | 2016-10-03 | 2018-08-21 | International Buisness Machines Corporation | Parity delta caching for short writes |
| CN108733314B (en) * | 2017-04-17 | 2021-06-29 | 伊姆西Ip控股有限责任公司 | Method, apparatus, and computer-readable storage medium for Redundant Array of Independent (RAID) reconstruction |
| CN109725824A (en) * | 2017-10-27 | 2019-05-07 | 伊姆西Ip控股有限责任公司 | Method and apparatus for from the disk array write-in data to storage system |
| CN111124266B (en) * | 2018-10-31 | 2023-09-29 | 伊姆西Ip控股有限责任公司 | Data management method, apparatus and computer program product |
-
2022
- 2022-02-18 CN CN202210153471.0A patent/CN114546272B/en active Active
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6347359B1 (en) * | 1998-02-27 | 2002-02-12 | Aiwa Raid Technology, Inc. | Method for reconfiguration of RAID data storage systems |
| US6138125A (en) * | 1998-03-31 | 2000-10-24 | Lsi Logic Corporation | Block coding method and system for failure recovery in disk arrays |
| JP2005293119A (en) * | 2004-03-31 | 2005-10-20 | Toshiba Solutions Corp | Disk array control device, processing method applied to this device upon detection of data defect, and program |
| CN101526885A (en) * | 2009-04-21 | 2009-09-09 | 杭州华三通信技术有限公司 | Method for improving capability of redundant array of independent disk and controller therefor |
| US8307271B1 (en) * | 2009-09-17 | 2012-11-06 | Emc Corporation | Fast verification of data block cycle redundancy checks |
| CN101923501A (en) * | 2010-07-30 | 2010-12-22 | 华中科技大学 | Disk array multi-level fault tolerance method |
| US9898224B1 (en) * | 2012-09-12 | 2018-02-20 | EMC IP Holding Company LLC | Automatic adjustment of capacity usage by data storage optimizer for data migration |
| CN104932835A (en) * | 2015-05-31 | 2015-09-23 | 上海交通大学 | Erasure code based distributed storage system capacity expansion and reduction method |
| CN105824725A (en) * | 2016-03-10 | 2016-08-03 | 中国人民解放军国防科学技术大学 | X-coding extension method capable of quickly recovering and realizing load balance |
| CN108228086A (en) * | 2016-12-21 | 2018-06-29 | 伊姆西Ip控股有限责任公司 | The method and apparatus that RAID is rebuild |
| CN106933707A (en) * | 2017-03-15 | 2017-07-07 | 李经纬 | A kind of data storage device data restoration methods and system |
| CN108874314A (en) * | 2018-05-31 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of reconstructing method and device of raid-array |
| CN109002263A (en) * | 2018-07-20 | 2018-12-14 | 腾讯科技（深圳）有限公司 | The method of adjustment and device of memory capacity |
| CN111104046A (en) * | 2018-10-25 | 2020-05-05 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer-readable storage medium for managing redundant disk array |
| WO2020173092A1 (en) * | 2019-02-28 | 2020-09-03 | 华为技术有限公司 | Data processing method, redundant array of independent disks controller, and data storage system |
| CN111857540A (en) * | 2019-04-25 | 2020-10-30 | 伊姆西Ip控股有限责任公司 | Data access method, device and computer program product |
| CN110442306A (en) * | 2019-06-28 | 2019-11-12 | 苏州浪潮智能科技有限公司 | A kind of fault handling method of distributed memory system, equipment and storage medium |
| CN111966291A (en) * | 2020-08-14 | 2020-11-20 | 苏州浪潮智能科技有限公司 | Data storage method, system and related device in storage cluster |
| CN113535082A (en) * | 2021-06-09 | 2021-10-22 | 杭州电子科技大学 | Method for realizing wear inverse equilibrium |
Non-Patent Citations (3)
| Title |
|---|
| 一种可行的优化降级读性能RAID-6编码算法;来燃;冯兴杰;王晴;李杰;焦文欢;;中国民航大学学报;20180815(第04期);正文 * |
| 基于负载感知的数据流动态负载均衡策略;李梓杨;于炯;卞琛;王跃飞;鲁亮;;计算机应用(第10期);正文 * |
| 磁盘阵列多级恢复系统的设计与实现;罗梅;程波;;计算机工程(第10期);正文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114546272A (en) | 2022-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114546272B (en) | Method, system, device and storage medium for degrading RAID (redundant array of independent disks) to RAID5 (redundant array of independent disks) | |
| US5351246A (en) | Method and means for coding and rebuilding that data contents of unavailable DASDs or rebuilding the contents of DASDs in error in the presence of reduced number of unavailable DASDs in a DASD array | |
| CN110089035B (en) | Storage controller, data processing chip and data processing method | |
| JP2002312130A (en) | Method for improved parity-stripe processing | |
| US8762823B2 (en) | Method for performing data shaping, and associated memory device and controller thereof | |
| CN114090345B (en) | Disk array data recovery method, system, storage medium and equipment | |
| CN111782439B (en) | Double-disk circulation verification method based on horizontal coding | |
| CN103914402A (en) | Reconfiguration optimization method based on erasure code caching | |
| CN114610244A (en) | Method, system and equipment for degrading independent redundant disk array | |
| CN115080303A (en) | Encoding method, decoding method, device and medium for RAID6 disk array | |
| US10127106B2 (en) | Redundant disk array system and data storage method thereof | |
| CN107885620B (en) | Method and system for improving performance and reliability of solid-state disk array | |
| CN114115729B (en) | Efficient data migration method under RAID | |
| CN115657946A (en) | Off-chip DDR bandwidth unloading method under RAID sequential writing scene, terminal and storage medium | |
| KR101053948B1 (en) | Memory systems and computer systems | |
| US9594629B2 (en) | Data error correction from cached error correction information | |
| CN112435157B (en) | Graphics processing system including different types of memory devices and method of operating the same | |
| CN105027084B (en) | The apparatus and method of control memory in mobile communication system | |
| CN110600070B (en) | Coding and repairing method for improving repairing performance of solid state disk array system | |
| CN115167787B (en) | Data unloading method, system, equipment and computer readable storage medium | |
| CN116450048A (en) | Method for degrading RAID6 disk array into RAID5 disk array | |
| CN110333965B (en) | Solid state disk controller device and solid state disk data verification method | |
| CN110431531A (en) | Storage control, data processing chip and data processing method | |
| Fu et al. | Ec-frm: An erasure coding framework to speed up reads for erasure coded cloud storage systems | |
| CN117472287B (en) | Redundant disk array inspection method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |