CN104571963A - Method and device for processing RAID (Redundant Array of Independent Disks) metadata - Google Patents
Method and device for processing RAID (Redundant Array of Independent Disks) metadata Download PDFInfo
- Publication number
- CN104571963A CN104571963A CN201410855159.1A CN201410855159A CN104571963A CN 104571963 A CN104571963 A CN 104571963A CN 201410855159 A CN201410855159 A CN 201410855159A CN 104571963 A CN104571963 A CN 104571963A
- Authority
- CN
- China
- Prior art keywords
- raid
- metadata
- disk
- information
- keyboard
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
Abstract
The invention discloses a method and a device for processing RAID (Redundant Array of Independent Disks) metadata; the processing method comprises the steps: choosing a plurality of disks in a system as key disks according to user commands, wherein the key disks are used for storing RAID metadata information; formatting the disks chosen by the user; and storing the RAID metadata information to the key disks. All RAID metadata information in the system are uniformly organized and stored in a plurality of the same key disks, so that the metadata information stored in the key disks is identical and the storage safety and reliability of the RAID metadata are improved.
Description
Technical field
The present invention relates to RAID field, specifically, relate to disposal route and the device of the metadata of a kind of RAID.
Background technology
Storage system is the important component part of computer system, especially when current mass data, has higher requirement to storage system.Raid-array (RAID:RedundantArrays of Inexpensive Disks) is one of requisite technology in storage system, be ensure data can high-speed secure store key.And Metadata mechanism is the gordian technique that software RAID realizes, its placement strategy directly has influence on the security of data.
RAID metadata layout in present linux system adopts dispersal mechanism, be distributed in each RAID member's disk by metadata record, when creating RAID, just metadata is write the deviation post of specifying of every block member disk, during each generation major event, this part metadata can be upgraded.Fig. 1 gives existing metadata placement strategy, the metadata of RAID1 writes in the sector of RAID1 member's disk forward part, the metadata of RAID2 writes in the forward part sector of member's disk of RAID2, the like, the metadata of RAIDn writes in member's disk forward part sector of RAIDn.
But by above-mentioned magnetic disk, process is carried out to the metadata of RAID and can there is following problem: 1, information dropout problem, after in system, certain RAID disk is all pulled out, whole system will lose all information of this RAID, and this can cause puzzlement concerning whole disc array system; 2, data security sex chromosome mosaicism, the data that RAID preserves carry out record by metadata entirely, if the deletion of the record metadata of disk damages, the data of RAID will read failure, and data security will be caused to be on the hazard.
For the problems referred to above in correlation technique, at present effective solution is not yet proposed.
Summary of the invention
For the problems referred to above in correlation technique, the present invention proposes disposal route and the device of the metadata of a kind of RAID, can improve the safety and reliability of the metadata store of RAID.
Technical scheme of the present invention is achieved in that
According to an aspect of the present invention, the disposal route of the metadata of a kind of RAID is provided.
This disposal route comprises:
According to the multiple disks in user instruction selective system respectively as pass keyboard, wherein, keyboard is closed for storing the metadata information of RAID;
Format process is carried out to multiple disks that user selects;
The metadata information of RAID is stored to pass keyboard.
Wherein, close keyboard and at least comprise system banner region, for storage system identification information; Data statistics region, for the statistical information of storing metadata; Metadata area, for the metadata information of member's disk of RAID all in storage system.
Wherein, metadata area comprises multiple metadata subregion, for storing the metadata information of member's disk of corresponding different RAID.
Wherein, when the metadata information of RAID being stored to pass keyboard, by the meta-data region domain lookup free space at pass keyboard; Thus by the metadata information of each member's disk of RAID in clear area sequential storage.
In addition, the metadata information of each member's disk by RAID in clear area sequential storage time, by reading the data in the system banner region of each member's disk of RAID, when not reading system identification information, at the label information of the system banner region of this member's disk write member disk, by the metadata information of this member's disk in clear area sequential storage.
Optionally, this disposal route comprises further:
When receive delete the instruction of RAID, close in keyboard determine to should RAID metadata information and remove;
Remove the information in the system banner region of member's disk of RAID.
According to a further aspect in the invention, the treating apparatus of the metadata of a kind of RAID is provided.
This treating apparatus comprises:
Select module, for according to the multiple disks in user instruction selective system respectively as pass keyboard, wherein, close keyboard for storing the metadata information of RAID;
Formatting module, the multiple disks for selecting user carry out format process;
Memory module, for being stored to pass keyboard by the metadata information of RAID.
Wherein, close keyboard and at least comprise system banner region, for storage system identification information; Data statistics region, for the statistical information of storing metadata; Metadata area, for the metadata information of member's disk of RAID all in storage system.
Wherein, metadata area comprises multiple metadata subregion, for storing the metadata information of member's disk of corresponding different RAID.
In addition, this memory module comprises:
Search module, for the meta-data region domain lookup free space at pass keyboard;
Sub module stored, for the metadata information of each member's disk by RAID in clear area sequential storage.
The present invention passes through the metadata information organization of unity of RAID all in system, and is stored in multiple identical pass keyboard, makes the metadata information of multiple crucial disk storage identical, thus improves the safety and reliability of the metadata store of RAID.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the schematic layout pattern of the metadata of RAID according to prior art;
Fig. 2 is the process flow diagram of the disposal route of the metadata of RAID according to the embodiment of the present invention;
Fig. 3 is the schematic layout pattern of the metadata of RAID according to the embodiment of the present invention;
Fig. 4 is the block diagram of the treating apparatus of the metadata of RAID according to the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art obtain, all belongs to the scope of protection of the invention.
According to embodiments of the invention, provide the disposal route of the metadata of a kind of RAID.
As shown in Figure 1, comprise according to the disposal route of the metadata of the RAID of the embodiment of the present invention:
Step S101, according to the multiple disks in user instruction selective system respectively as pass keyboard, wherein, closes keyboard for storing the metadata information of RAID;
Step S103, carries out format process to multiple disks that user selects;
Step S105, is stored to pass keyboard by the metadata information of RAID.
Wherein, in one embodiment, close keyboard and at least comprise system banner region, for storage system identification information; Data statistics region, for the statistical information of storing metadata; Metadata area, for the metadata information of member's disk of RAID all in storage system.
Wherein, in one embodiment, metadata area can comprise multiple metadata subregion, for storing the metadata information of member's disk of corresponding different RAID.
Wherein, in one embodiment, when the metadata information of RAID being stored to pass keyboard, by the meta-data region domain lookup free space at pass keyboard; Thus by the metadata information of each member's disk of RAID in clear area sequential storage.
In addition, in another embodiment, the metadata information of each member's disk by RAID in clear area sequential storage time, by reading the data in the system banner region of each member's disk of RAID, when not reading system identification information, at the label information of the system banner region of this member's disk write member disk, by the metadata information of this member's disk in clear area sequential storage.
Optionally, comprise further according to the disposal route of the embodiment of the present invention:
When receive delete the instruction of RAID, close in keyboard determine to should RAID metadata information and remove;
Remove the information in the system banner region of member's disk of RAID.
Technique scheme for a better understanding of the present invention, the schematic layout pattern below in conjunction with the metadata of the RAID shown in Fig. 3 is described in detail technique scheme of the present invention.
Disks all in system are divided into global metadata district and data field two parts by global metadata layout according to the present invention, the former deposits the metadata information of raid, the latter deposits the data of user's write, the present invention mainly operates global metadata district, and this part is sightless concerning user.Global metadata zoning is divided into three parts, be called label district, summary district and specific district, wherein label district houses the system banner that marked system information, distribute PkB space, be inserted in native system with the disk being different from other arrays, the summary information that summary district houses metadata comprises disk chassis information, overall situation HotSpare disk information, distributes QkB space.Specific district houses the metadata information of member's disk of all raid in system, and each magnetic disk metadata distributes the space of XKB size, and each raid distributes Y member's disk, supports that N number of raid, specific district is divided into and join X*Y*N size space in system.Pass keyboard global metadata in system writes corresponding information, RAID member's dish in non-key dish, overall situation HotSpare disk write label information, other free disk global metadata districts write zero, in order to support extendability, reserved part space after specific district, can expand member's number of disks of RAID support and the RAID quantity of system support.
For the global metadata placement strategy that invention proposes, its concrete writing mechanism is as described below:
1, format manipulation need be carried out when system first time uses, automatically the unique identification of native system is generated during format, this mark forms the label region of global metadata, and label district is written in the pass keyboard that user specifies, then generate fixed part metadata in summary district, be written in the pass keyboard that user specifies.Close unification in the specific district in keyboard to carry out writing Z-operation, by unified for global metadata district, Z-operation is write to non-key dish;
2, for ensureing the consistance of closing keyboard metadata, when every subsystem starts, keyboard metadata is closed in self-verifying, and the pass keyboard different to metadata carries out automatic synchronization;
3, when creating raid, the present invention can be closed in figure 3 in RAID_1 to the RAID_N of keyboard and be found idle region, such as: RADI_X is idle, the metadata information of each disk is write in order in RAID_X, this process writes in the keyboard of all passes, in order to realize mutual exclusion write, this process is completed by kernel.Judge whether this disk label district has system banner simultaneously, label district metadata can be write in this member's disk without system banner, mark its member's disk for raid in this system have system banner then can not as raid member's disk;
4, when adding overall HotSpare disk in system, the information writing this HotSpare disk in the summary district of keyboard can be closed, simultaneously at the unique identification of the label district of this disk write native system.
Just constructed the global metadata layout shown in Fig. 3 by above-mentioned four steps, it is as described below that it reads mechanism:
1, when recombinating raid, the present invention reads raid metadata by kernel, according to the metadata of kernel, User space judges that raid member is coiled, then User space oneself checks whether the label district of these disks exists, exist and then think that raid member is coiled, set up raid, otherwise failure;
2, overall HotSpare disk can, according to the recorded information in the summary metadata read, join in raid member by overall HotSpare disk mechanism in good time;
3, system can read system banner in the label district of closing keyboard, and more whether contrast non-key dish and come to be the disk in native system, external disk can be reported to the police.
By above-mentioned three steps, achieve the application of global metadata, it is as described below that it deletes Metadata mechanism:
1, when deleting raid, User space notice kernel deletes the metadata of closing keyboard relevant position, and after completing, User space oneself deletes the label district of this disk;
2, when deleting overall HotSpare disk, kernel can delete the information of closing summary district record in keyboard, and User space deletes the label district information on this disk;
Known by foregoing description, present invention achieves layout and the write thereof of global metadata, read, deleting mechanism, ensure that the integrality of information and the security of data.
According to embodiments of the invention, additionally provide the treating apparatus of the metadata of a kind of RAID.
As shown in Figure 4, comprise according to the treating apparatus of the metadata of the RAID of the embodiment of the present invention:
Select module 41, for according to the multiple disks in user instruction selective system respectively as pass keyboard, wherein, close keyboard for storing the metadata information of RAID;
Formatting module 42, the multiple disks for selecting user carry out format process;
Memory module 43, for being stored to pass keyboard by the metadata information of RAID.
Wherein, in one embodiment, close keyboard and at least comprise system banner region, for storage system identification information; Data statistics region, for the statistical information of storing metadata; Metadata area, for the metadata information of member's disk of RAID all in storage system.
Wherein, in another embodiment, metadata area comprises multiple metadata subregion, for storing the metadata information of member's disk of corresponding different RAID.
In addition, can comprise according to the memory module 43 of the embodiment of the present invention:
Search module (not shown), for the meta-data region domain lookup free space at pass keyboard;
Sub module stored (not shown), for the metadata information of each member's disk by RAID in clear area sequential storage.
In sum, by means of technique scheme of the present invention, by the metadata information organization of unity by RAID all in system, and be stored in multiple identical pass keyboard, make the metadata information of multiple crucial disk storage identical, good solution information dropout problem, data security sex chromosome mosaicism, thus improve the safety and reliability of the metadata store of RAID, wherein, the present invention is by closing in keyboard by meta-data preservation, any read-write operation to raid metadata all carries out in the keyboard of pass, user can specify N block to close keyboard to ensure the safety of metadata information, in the crucial adjustment debit of N-1 block bad, system still can be closed keyboard from remaining one piece and be read raid information, thus ensure the security of data, and user can some disk be for closing keyboard in appointing system flexibly, and key also can use as raid member's disk, can not cause the waste of disk like this.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a disposal route for the metadata of raid-array RAID, is characterized in that, comprising:
According to the multiple disks in user instruction selective system respectively as pass keyboard, wherein, described pass keyboard is for storing the metadata information of described RAID;
Format process is carried out to described multiple disk that user selects;
The metadata information of described RAID is stored to described pass keyboard.
2. disposal route according to claim 1, is characterized in that, described pass keyboard at least comprises system banner region, for storage system identification information; Data statistics region, for the statistical information of storing metadata; Metadata area, for the metadata information of member's disk of RAID all in storage system.
3. disposal route according to claim 2, is characterized in that, described metadata area comprises multiple metadata subregion, for storing the metadata information of member's disk of corresponding different RAID.
4. disposal route according to claim 2, is characterized in that, the metadata information of described RAID is stored to described pass keyboard and comprises:
At the meta-data region domain lookup free space of described pass keyboard;
By the metadata information of each member's disk of described RAID in described clear area sequential storage.
5. disposal route according to claim 4, is characterized in that, is comprised by the metadata information of each member's disk of described RAID in described clear area sequential storage:
Read the data in the system banner region of each member's disk of described RAID, when not reading described system identification information, at the label information of the system banner region of this member's disk write member disk, by the metadata information of this member's disk in described clear area sequential storage.
6. disposal route according to claim 4, is characterized in that, comprises further:
When receive delete the instruction of RAID, determine in the keyboard of described pass to should RAID metadata information and remove;
Remove the information in the system banner region of member's disk of described RAID.
7. a treating apparatus for the metadata of raid-array RAID, is characterized in that, comprising:
Select module, for according to the multiple disks in user instruction selective system respectively as pass keyboard, wherein, described pass keyboard is for storing the metadata information of described RAID;
Formatting module, the described multiple disk for selecting user carries out format process;
Memory module, for being stored to described pass keyboard by the metadata information of described RAID.
8. treating apparatus according to claim 7, is characterized in that, described pass keyboard at least comprises system banner region, for storage system identification information; Data statistics region, for the statistical information of storing metadata; Metadata area, for the metadata information of member's disk of RAID all in storage system.
9. treating apparatus according to claim 8, is characterized in that, described metadata area comprises multiple metadata subregion, for storing the metadata information of member's disk of corresponding different RAID.
10. treating apparatus according to claim 8, is characterized in that, described memory module comprises:
Search module, for the meta-data region domain lookup free space at described pass keyboard;
Sub module stored, for the metadata information of each member's disk by described RAID in described clear area sequential storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410855159.1A CN104571963A (en) | 2014-12-31 | 2014-12-31 | Method and device for processing RAID (Redundant Array of Independent Disks) metadata |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410855159.1A CN104571963A (en) | 2014-12-31 | 2014-12-31 | Method and device for processing RAID (Redundant Array of Independent Disks) metadata |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104571963A true CN104571963A (en) | 2015-04-29 |
Family
ID=53088148
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410855159.1A Pending CN104571963A (en) | 2014-12-31 | 2014-12-31 | Method and device for processing RAID (Redundant Array of Independent Disks) metadata |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104571963A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107291399A (en) * | 2017-06-30 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of rear end storage method based on SPDK, apparatus and system |
| CN110007868A (en) * | 2019-04-12 | 2019-07-12 | 苏州浪潮智能科技有限公司 | A kind of SSD disk metadata storing method, device, controller and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090150599A1 (en) * | 2005-04-21 | 2009-06-11 | Bennett Jon C R | Method and system for storage of data in non-volatile media |
| CN102024059A (en) * | 2010-12-31 | 2011-04-20 | 成都市华为赛门铁克科技有限公司 | Method and device for protecting redundant array of independent disk in file system |
| CN104216660A (en) * | 2013-05-30 | 2014-12-17 | 华为软件技术有限公司 | Method and device for improving disk array performance |
-
2014
- 2014-12-31 CN CN201410855159.1A patent/CN104571963A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090150599A1 (en) * | 2005-04-21 | 2009-06-11 | Bennett Jon C R | Method and system for storage of data in non-volatile media |
| CN102024059A (en) * | 2010-12-31 | 2011-04-20 | 成都市华为赛门铁克科技有限公司 | Method and device for protecting redundant array of independent disk in file system |
| CN104216660A (en) * | 2013-05-30 | 2014-12-17 | 华为软件技术有限公司 | Method and device for improving disk array performance |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107291399A (en) * | 2017-06-30 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of rear end storage method based on SPDK, apparatus and system |
| CN107291399B (en) * | 2017-06-30 | 2020-11-24 | 苏州浪潮智能科技有限公司 | Back-end storage method, device and system based on SPDK |
| CN110007868A (en) * | 2019-04-12 | 2019-07-12 | 苏州浪潮智能科技有限公司 | A kind of SSD disk metadata storing method, device, controller and storage medium |
| CN110007868B (en) * | 2019-04-12 | 2022-07-22 | 苏州浪潮智能科技有限公司 | SSD disc metadata storage method, device, controller and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104461391B (en) | A kind of storage device metadata management approach and system | |
| CN106055431B (en) | The method and device of backup and recovery based on the online rollback of snapshot | |
| US6658438B1 (en) | Method for deleting stored digital data from write-once memory device | |
| CN102096561B (en) | Hierarchical data storage processing method, device and storage equipment | |
| CN102063943B (en) | Nand flash memory parameter automatic detecting system | |
| KR101813786B1 (en) | System and method for copy on write on an ssd | |
| KR101910840B1 (en) | Dynamic granule-based intermediate storage | |
| KR101678868B1 (en) | Apparatus for flash address translation apparatus and method thereof | |
| CN101782875B (en) | Storage unit and data storage method | |
| CN104636266B (en) | Cover tile magnetic recording hard disk, cover tile magnetic recording hard disk write method and the device of data | |
| CN103530237B (en) | A kind of rubbish recovering method of Solid-state disc array | |
| CN104050090B (en) | Stop sorting data in intermediate storage | |
| CN104268088B (en) | Vehicle-mounted DVR hard disc data storage method | |
| CN102682012A (en) | Method and device for reading and writing data in file system | |
| CN103049224B (en) | By the methods, devices and systems of data importing physical tape | |
| CN104063187B (en) | Hard disk file system suitable for security application and operation method thereof | |
| CN103699457A (en) | Method and device for restoring disk arrays based on stripping | |
| CN110674056B (en) | Garbage recovery method and device | |
| KR20100065786A (en) | Cache synchronization method and system for fast power-off | |
| CN103677670A (en) | Method and device for reading data | |
| CN103034592A (en) | Data processing method and device | |
| CN104166601A (en) | Storage data backup method and device | |
| CN105302665A (en) | Improved copy-on-write snapshot method and system | |
| US9047923B1 (en) | Fast shingled tracks recording | |
| CN107092443B (en) | Data migration method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150429 |