CN107479998A - A kind of efficient fault-tolerance approach of storage medium - Google Patents
A kind of efficient fault-tolerance approach of storage medium Download PDFInfo
- Publication number
- CN107479998A CN107479998A CN201710592562.3A CN201710592562A CN107479998A CN 107479998 A CN107479998 A CN 107479998A CN 201710592562 A CN201710592562 A CN 201710592562A CN 107479998 A CN107479998 A CN 107479998A
- Authority
- CN
- China
- Prior art keywords
- data
- storage medium
- write
- tolerance approach
- efficient fault
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F11/1004—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's to protect a block of data words, e.g. CRC or checksum
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of efficient fault-tolerance approach of storage medium, it is characterised in that comprises the following steps：Step S1：All write operations are encapsulated into affairs by file system interface layers；Step S2：Collect the affairs and be put into a transaction set；Step S3：Transaction set writes hard disk in the form of synchronous or be asynchronous.The verification on object block that is verified again for the increase of each block pointer when reading and, ensure that data are realized in copy procedure and constantly verify；Copy on write transaction model is established, ensures the integrality of data.
Description
Technical field
The invention belongs to the fault-tolerant field of data storage, and in particular to a kind of efficient fault-tolerance approach of storage medium.
Background technology
As a kind of ripe, reliable disk system End Data Protection standard, raid technologies have been used as and deposited always since birth
The basic technology of storage system and exist, but recently as the rapid growth of data storage requirement, performance application it is continuous
Emerge in large numbers, traditional raid gradually exposes the problem of more and more.
First, in order to meet the needs of data growth, constantly lift technique increases disk list for disk unit manufacturer
Bit packing density.When these high-capacity disks due to there is disk failure and need carry out data reconstruction when, the process meeting of reconstruct
Occupying system resources, application system overall performance is caused to decline., can be with disk size when conventional reconstruction mechanism creates raid
Increase slack-off；Its reconstructed velocity is limited to the write-in bandwidth of HotSpare disk and the reading bandwidth of hard disk groups survival disk.In very long number
According in restructuring procedure, heavy read-write operation may cause in raid groups other disks also to break down or mistake, cause therefore
Barrier probability is substantially improved, and greatly increases the risk of loss of data.Secondly, traditional RAID, which writes, is divided into two steps：Update the data first,
Secondly renewal verification（By new data and old verification XOR to cause all disk XORs as zero）.If occur during writing disconnected
Mismatch just occurs in the failures such as electricity, system crash, the data stored on disk and verification, if none of good daily record or
Snapshot mechanism is come if being recovered, the data of mistake can not correct being stored in forever on disk.
Finally, traditional raid structures are limited to hard disk quantity, in the age that data capacity increases severely enterprise can not be met to money
The demand that source is unifiedly and flexibly allocated, meanwhile, with the increase of hard-disk capacity, data are managed in units of hard disk and also seemed
It is more and more unable to do what one wishes.This is the deficiencies in the prior art part.
Therefore, for drawbacks described above of the prior art, there is provided design a kind of efficient fault-tolerance approach of storage medium；To solve
Above-mentioned technical problem, it is necessary.
The content of the invention
It is an object of the present invention in view of the above-mentioned drawbacks of the prior art, a kind of storage medium of offer design is efficient
Fault-tolerance approach, to solve above-mentioned technical problem.
To achieve the above object, the present invention provides following technical scheme：
A kind of efficient fault-tolerance approach of storage medium, it is characterised in that comprise the following steps：
All write operations, including metadata and real data are encapsulated into affairs by file system interface layers, multiple write operations
An affairs are put into, the affairs can't write physical hard disk at once, but collect and be put into a things group, finally with same
Step or asynchronous mode write hard disk.
Preferably, the write operation in the step S1 includes metadata and real data.
Preferably, write operation specifically includes following steps in the step S3：
Using dynamic strip width, a new position is write data into first, then rewrites original sensing legacy data again
Pointer, in the enterprising row write of full band, guarantee data integrity.
It is preferably, further comprising the steps of after the step S3：
Step S4：Hardware problem or driving Bug for hard disk, using corresponding mirror image and data verification mode.
Preferably, the step S4 specifically includes following steps：
Metadata is traveled through when reading data every time and automatic and 256 bit check codes are verified, actively discovers data block mistake
By mistake, and correct data is obtained by corresponding mirror image data or other hard disks and return to upper layer application, it is automatic to repair original firmly
The error in data of disk.
So far, by the data check characteristic and Copy on write technology of file system, it can effectively ensure that data self
Reparation and integrity function, realize the efficient fault-tolerant of storage medium.
The beneficial effects of the present invention are the school on object block verified again for the increase of each block pointer when reading
Test and ensure that data are realized in copy procedure and constantly verify；Copy on write transaction model is established, ensures the integrality of data.This
Outside, design principle of the present invention is reliable, has very extensive application prospect.
As can be seen here, the present invention compared with prior art, has prominent substantive distinguishing features and significantly improved, it is implemented
Beneficial effect be also obvious.
Brief description of the drawings
Fig. 1 is a kind of functional block diagram for storage medium colleges and universities fault-tolerance approach that the present invention provides.
Embodiment
Below in conjunction with the accompanying drawings and the present invention will be described in detail by specific embodiment, and following examples are to the present invention
Explanation, and the invention is not limited in implementation below.
With reference to Fig. 1, the present invention provides following technical scheme：
A kind of efficient fault-tolerance approach of storage medium, comprises the following steps：
All write operations, including metadata and real data are encapsulated into affairs by file system interface layers, multiple write operations
An affairs are put into, the affairs can't write physical hard disk at once, but collect and be put into a things group, finally with same
Step or asynchronous mode write hard disk.
In the present embodiment, the write operation in the step S1 includes metadata and real data.
Write operation specifically includes following steps in the step S3：
Using dynamic strip width, a new position is write data into first, then rewrites original sensing legacy data again
Pointer, in the enterprising row write of full band, guarantee data integrity.
It is further comprising the steps of after the step S3：
Step S4：Hardware problem or driving Bug for hard disk, using corresponding mirror image and data verification mode.
The step S4 specifically includes following steps：
Metadata is traveled through when reading data every time and automatic and 256 bit check codes are verified, actively discovers data block mistake
By mistake, and correct data is obtained by corresponding mirror image data or other hard disks and return to upper layer application, it is automatic to repair original firmly
The error in data of disk.
So far, by the data check characteristic and Copy on write technology of file system, it can effectively ensure that data self
Reparation and integrity function, realize the efficient fault-tolerant of storage medium.
The present embodiment provides implementation in detail below：
The storage mediums such as hard disk, file, virtual unit are constructed into unique storage pool, form depositing based on this dynamic regulation
New logic hard disk on reservoir, can be in use by the file system, and can automatically select the parameter optimized.
Any write operation, all it is a write operation to one piece of new data block in above-mentioned logic hard disk.This document
System dynamically picks out an optimal equipment from storage pool, and is linearly writing with an affairs, substantially effectively utilizes
The bandwidth of existing equipment, decrease the number of read-write conversion.
Use Copy on write（copy-on-write）Technology, it is ensured that continuity of the data on disk.When data become
It can't excessively be write when more, and it always before pointer points to change data, is written in a new block.Old
Data may be saved, the snapshot of establishment file system during changing.
Disclosed above is only the preferred embodiment of the present invention, but the present invention is not limited to this, any this area
What technical staff can think does not have creative change, and some improvement made without departing from the principles of the present invention and
Retouching, should all be within the scope of the present invention.
Claims (5)
1. a kind of efficient fault-tolerance approach of storage medium, it is characterised in that comprise the following steps：
Step S1：All write operations are encapsulated into affairs by file system interface layers；
Step S2：Collect the affairs and be put into a transaction set；
Step S3：Transaction set writes hard disk in the form of synchronous or be asynchronous.
A kind of 2. efficient fault-tolerance approach of storage medium according to claim 1, it is characterised in that writing in the step S1
Operation includes metadata and real data.
3. the efficient fault-tolerance approach of a kind of storage medium according to claim 1 or 2, it is characterised in that in the step S3
Write operation specifically includes following steps：
Using dynamic strip width, a new position is write data into first, then rewrites original sensing legacy data again
Pointer, in the enterprising row write of full band, guarantee data integrity.
4. the efficient fault-tolerance approach of a kind of storage medium according to claim 3, it is characterised in that also wrapped after the step S3
Include following steps：
Step S4：Hardware problem or driving Bug for hard disk, using corresponding mirror image and data verification mode.
5. the efficient fault-tolerance approach of a kind of storage medium according to claim 4, it is characterised in that the step S4 is specifically wrapped
Include following steps：
Metadata is traveled through when reading data every time and automatic and 256 bit check codes are verified, actively discovers data block mistake
By mistake, and correct data is obtained by corresponding mirror image data or other hard disks and return to upper layer application, it is automatic to repair original firmly
The error in data of disk.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710592562.3A CN107479998A (en) | 2017-07-19 | 2017-07-19 | A kind of efficient fault-tolerance approach of storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710592562.3A CN107479998A (en) | 2017-07-19 | 2017-07-19 | A kind of efficient fault-tolerance approach of storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107479998A true CN107479998A (en) | 2017-12-15 |
Family
ID=60595661
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710592562.3A Pending CN107479998A (en) | 2017-07-19 | 2017-07-19 | A kind of efficient fault-tolerance approach of storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107479998A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104679442A (en) * | 2013-12-02 | 2015-06-03 | 中兴通讯股份有限公司 | Method and device for improving performance of disk array |
| CN106681848A (en) * | 2016-12-13 | 2017-05-17 | 中国科学院计算技术研究所 | Data consistency guarantee method and system of erasure code RAID |
-
2017
- 2017-07-19 CN CN201710592562.3A patent/CN107479998A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104679442A (en) * | 2013-12-02 | 2015-06-03 | 中兴通讯股份有限公司 | Method and device for improving performance of disk array |
| CN106681848A (en) * | 2016-12-13 | 2017-05-17 | 中国科学院计算技术研究所 | Data consistency guarantee method and system of erasure code RAID |
Non-Patent Citations (1)
| Title |
|---|
| 0X011954: "《copy-on-write 写时复制_0X011954 -CSDN博客》", 《HTTPS://BLOG.CSDN.NET/U010712083/ARTICLE/DETAILS/8963202》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9405627B2 (en) | Flexible data storage system | |
| US8060772B2 (en) | Storage redundant array of independent drives | |
| US6751136B2 (en) | Drive failure recovery via capacity reconfiguration | |
| US8812902B2 (en) | Methods and systems for two device failure tolerance in a RAID 5 storage system | |
| CN101291347B (en) | Network storage system | |
| CN109814807B (en) | Data storage method and device | |
| US20080126700A1 (en) | System for optimizing the performance and reliability of a storage controller cache offload circuit | |
| CN103761058A (en) | RAID1 and RAID4 hybrid structure network storage system and method | |
| CN106407040A (en) | Remote data copy method and system | |
| TWI501080B (en) | System and method for loose coupling between raid volumes and drive groups | |
| CN101984400B (en) | RAID control method, device and system | |
| CN102110154B (en) | File redundancy storage method in cluster file system | |
| CN103929609B (en) | A kind of video recording playback method and device | |
| JP2000099282A (en) | File management system | |
| CN101609420A (en) | Realize method and the redundant arrays of inexpensive disks and the controller thereof of rebuilding of disc redundant array | |
| CN110187830A (en) | A kind of method and system accelerating disk array reconstruction | |
| CN102147713B (en) | Method and device for managing network storage system | |
| CN111858189B (en) | Offline processing of storage disks | |
| CN103150128A (en) | Implementation method of solid state drive (SSD) and disk-based reliable mixed storage system | |
| WO2015058542A1 (en) | Reconstruction method and device for redundant array of independent disks | |
| CN108733326B (en) | Disk processing method and device | |
| US10409682B1 (en) | Distributed RAID system | |
| CN105302667A (en) | Cluster architecture based high-reliability data backup and recovery method | |
| CN106227464A (en) | A kind of double-deck redundant storage system and data write, reading and restoration methods | |
| CN102135862B (en) | Disk storage system and data access method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171215 |