CN110457163A - A kind of data reconstruction method, device and the storage medium of distributed block storage - Google Patents

A kind of data reconstruction method, device and the storage medium of distributed block storage Download PDF

Info

Publication number
CN110457163A
CN110457163A CN201910605476.0A CN201910605476A CN110457163A CN 110457163 A CN110457163 A CN 110457163A CN 201910605476 A CN201910605476 A CN 201910605476A CN 110457163 A CN110457163 A CN 110457163A
Authority
CN
China
Prior art keywords
file
storage unit
storage
unit file
size
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910605476.0A
Other languages
Chinese (zh)
Other versions
CN110457163B (en
Inventor
王刚
张天炯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Yuanhen Cloud Technology Co Ltd
Original Assignee
Suzhou Yuanhen Cloud Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Yuanhen Cloud Technology Co Ltd filed Critical Suzhou Yuanhen Cloud Technology Co Ltd
Priority to CN201910605476.0A priority Critical patent/CN110457163B/en
Publication of CN110457163A publication Critical patent/CN110457163A/en
Application granted granted Critical
Publication of CN110457163B publication Critical patent/CN110457163B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/13File access structures, e.g. distributed indices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • G06F3/0619Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0643Management of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • G06F3/0674Disk device
    • G06F3/0676Magnetic disk device

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses data reconstruction method, device and the storage mediums of a kind of storage of distributed block.Wherein, a kind of data reconstruction method of distributed block storage is the following steps are included: S1, the element storing unit file set for reading the disk of storage server and obtaining block storage equipment mirror image, to the redundant file duplicate removal in the storage unit file set;S2, the storage unit file in the storage unit file set is not up to storage unit file size maximum value carry out write zero padding;Logically sequence of addresses is successively renamed S3 storage unit file by number, reads storage unit file according to stripe unit size and strip width and new image file is written;S4, the new image file is restored to described piece of storage equipment.By reading storage unit file set, and duplicate removal is carried out to storage unit file, writes Z-operation and recombination, solved the data of distributed block storage in catastrophe situations and restore, guarantee the safety of data.

Description

A kind of data reconstruction method, device and the storage medium of distributed block storage
Technical field
The present invention relates to technical field of data storage, especially a kind of data reconstruction method, the device of distributed block storage And storage medium.
Background technique
Distributed storage is a kind of data storage technology, empty by the disk on every machine in Web vector graphic enterprise Between, and the storage resource of these dispersions is constituted into a virtual storage equipment, each angle for being stored in enterprise of data dispersion It falls.
The key technology of distributed storage is data metadata management, storage system resilient expansion technology, fault self-recovery, deposits Performance technologies etc. are stored up to meet storage system High Availabitity, highly reliable and high-performance.According to storage protocol classification, distributed storage can It is divided into distributed file system, distributed block storage and distributed objects storage.Distributed block storage is always by continuous in logic Image file composition, image file is dispersed on different physical disks according to storage unit and copy number.It is read to improve The parallel efficiency write, general distributed block memory image group organization data in a manner of striping.
In data age, distributed block storage is the infrastructure in cloud storage.Block device passes through IP-SAN or FC-SAN Service is provided for application, wherein the application scenarios of block storage are mainly that cloud host provides that virtualization storage, this is with regard to inevitable requirement point The Information Security of cloth storage is able to carry out data recovery under various failures and disaster.Under generic failure, due to distribution Storage is that the capacity datas such as with uniformity, more copies, fault self-recovery can be restored automatically.But in extreme or specific disaster scenario Under, burst such as metadata is lost, operating system or storage software are run quickly, when part hard disc data is lost if in hard disk data it is difficult To restore.
Summary of the invention
The present invention is directed to solve at least some of the technical problems in related technologies.For this purpose, of the invention One purpose is to provide data reconstruction method, device and the storage medium of a kind of distributed block storage, advantageously accounts for distribution The data of block storage in catastrophe situations are restored, and guarantee the safety of data.
For this purpose, the first purpose of the invention is to provide a kind of data reconstruction methods of distributed block storage.
The technical scheme adopted by the invention is that:
In a first aspect, the present invention provides a kind of data reconstruction method of distributed block storage, comprising the following steps:
S1, the disk for reading storage server and the element storing unit file set for obtaining block storage equipment mirror image, to institute State the redundant file duplicate removal in storage unit file set;
S2, the storage unit file in the storage unit file set is not up to storage unit file size maximum value It carries out writing zero padding;
Logically sequence of addresses is successively renamed S3 storage unit file by number, according to stripe unit size and Strip width reads storage unit file and new image file is written;
S4, the new image file is restored to described piece of storage equipment.
Further, the S1 the following steps are included:
S11, the disk for reading storage server simultaneously obtain the element storing unit file set that equipment mirror image is stored from block;
S12, it is divided into one group for the storage unit file size in storage unit file set is identical;
S13, the logical address of the storage unit file of same group of size is compared, it will if logical address repeats The storage unit file for repeating logical address is deleted.
Further, the S3 the following steps are included:
S31, according to the size relation of the storage unit file set and the storage unit file, calculate described in reading The number M of storage unit file set calculates reading storage according to the size relation of the storage unit file and stripe cell The number Q of unit file;
S32, file successively is read according to strip width K and the stripe unit size from storage unit file and is write Enter to new image file, repeats this process Q times;
S33, remaining storage unit file is read according to the S32 step, and repeated M times, and described deposit remaining Storage unit file is written to new image file.
Further, the S4 the following steps are included:
S41, the new image file is mapped to local winding equipment, then is mounted to local directory;
S42, the data in the new image file are accessed with filesystem manner.
Further, the S4 the following steps are included:
S41, the new image file is mapped to local winding equipment;
The access protocol that S42, the winding equipment store equipment according to described piece exports, and accesses the number of new image file According to.
Second aspect, the present invention provide a kind of Data Recapture Unit of distributed block storage, comprising:
Deduplication module is obtained, for obtaining the storage unit file set in block storage equipment, the storage unit text that will acquire Part concentrates duplicate storage unit file to delete, and only retains a complete storage unit file set;
Preprocessing module, for being not up to writing for the storage unit file maximum value to the storage unit file Z-operation, and logically address successively carries out renaming number to the storage unit file;
Module is assembled, for storage unit file in the preprocessing module to be reassembled into new image file;
Recovery module, for restoring the new image file to described piece of storage equipment.
Further, the acquisition deduplication module includes:
Acquiring unit, for reading the disk of storage server and obtaining the storage unit file set in block storage equipment, Storage unit file in storage unit file set is grouped according to identical file size;
Duplicate removal unit, the logical address for the storage unit file to same group is compared, and logical address is identical Storage unit file is deleted.
Further, the assembling module includes:
The assembling module includes:
Read computing unit, for according to the storage unit file set size and the storage unit file size most Big value calculates the number M for reading the storage unit file set, according to storage unit file size and stripe cell it is big It is small, calculate the number Q for reading storage unit file;
Writing unit, for reading file according to stripe unit size and strip width K from storage unit file and being written Into new image file, to form new image file.
Further, the recovery module includes:
Map unit, for the new image file to be mapped to local winding equipment, local winding equipment carry is local Catalogue;
Access unit, for accessing data with filesystem manner.
A kind of computer readable storage medium, the computer-readable recording medium storage have computer executable instructions, The computer executable instructions are for making computer execute such as method described in any one of claim 1 to 5.
The beneficial effects of the present invention are:
The data that the present invention stores the storage unit file of equipment by obtaining block from disk, and it is single to storage is collected into Meta file collection is pre-processed, and pretreatment includes writing zero padding, duplicate removal, renumbering for storage unit file, then according to band Unit and strip width carry out the re-assemble of storage unit file, finally recover original storage unit file.To provide A kind of distributed block, which is stored in storage system software, runs quickly and bursts etc. under disasters, can efficiently and accurately carry out the side of data recovery Method.
Detailed description of the invention
Fig. 1 is the structural block diagram of the embodiment of the present invention one and embodiment two;
Fig. 2 is the flow chart of the embodiment of the present invention one and embodiment two;
Fig. 3 is the flow chart of step S3 in the embodiment of the present invention one and embodiment two.
Specific embodiment
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination.
Embodiment one: referring to Fig.1, the invention discloses a kind of Data Recapture Units of distributed block storage, comprising: obtains Deduplication module 1, preprocessing module 2, assembling module 3 and recovery module 4 obtain deduplication module 1 for obtaining block storage equipment In storage unit file set, duplicate storage unit file is deleted in the storage unit file set that will acquire, and is only retained a Complete storage unit file set;Preprocessing module 2 is for being not up to storage unit file maximum value to storage unit file It carries out writing Z-operation, and logically address successively carries out renaming number to storage unit file;Assembling module 3 is used for will be pre- Storage unit file is reassembled into new image file in processing module 2, and recovery module 4 is used to new image file being restored to block Store equipment.
It is stored in equipment by obtaining the disk of the reading storage server of deduplication module 1 and obtaining distributed storage in block Storage unit file is deleted storage unit file extra in storage unit file set to obtain a complete storage Unit file collection, then the storage unit file of similar empty file is carried out writing spot patch and is filled, by being carried out to storage unit file It writes spot patch and is filled with and prevent empty file data is caused not restore.It writes and storage unit file is carried out according to patrolling after spot patch is filled It collects sequence and carries out renaming number, assembling module 3 re-assemblies the storage unit file set for writing zero padding and recodification To obtain new image file, and new image file is restored to original piece of storage equipment, in order to the direct access number of user According to.It provides a kind of distributed block and is stored in storage system software and runs quickly and burst etc. under disasters, can efficiently and accurately carry out data The device of recovery.
Obtaining deduplication module 1 includes acquiring unit and duplicate removal unit, for reading disk and the acquisition of storage server Block stores the storage unit file set in equipment, and the storage unit file in storage unit file set is big according to identical file Small to be grouped, duplicate removal unit, the logical address for the storage unit file to same group is compared, and logical address is identical Storage unit file delete.The data processing of duplicate removal unit is as follows: initialization HashMap<md5, count>, d5 indicates file Md5 value, count indicates the number of identical md5 value;Traversal calculates the md5 value of subclass file, if md5's is a in hashmap Number count > 1, then it represents that current file is redundant file, and file is done delete operation;If in hashmap not including the md5 value, Then md5 value is added in hashmap, count=1.
Assembling module 3 includes reading computing unit and writing unit, reads computing unit and is used for according to storage unit text The maximum value calculation of part collection size and storage unit file size goes out to read the number M of storage unit file set, single according to storage The size of meta file and the size of stripe cell, calculate the number Q for reading storage unit file, and writing unit is used for from storage Unit file reads file according to stripe unit size and is written in new image file.
It reads computing unit and passes through storage unit file set size divided by storage unit file size maximum value to be read The number M of storage unit file set is taken, then passes through storage unit file size divided by stripe cell file size to be read The number of storage unit file, wherein band is the data block for continuous data being divided into same size, every segment data point It is not written to the method for the different storage unit files in the different disk in distributed type assemblies.Stripe cell: band is referred to Size, be also stripe size.This parameter refers to the size of the strip data block write on every piece of disk.Data block size Generally between 16KB to 512KB (or bigger), numerical value is 2 power, i.e. 16KB, and 32KB, 64KB, 128KB is in this way.Item The bin number that bandwidth: referring to while can concurrently read or write.This quantity is equal to the storage unit number of concurrent operations.Example Such as a distributed block equipment mirror image by striping, stripe size 256KB, strip width 8, in data reading operation When, 8 storage units are concurrently read, reading size every time is 256KB.Increase strip width, the read-write of block device can be increased Performance.Reason also increases the bin number that can while concurrently read or write it is obvious that increase more hard disks.Write-in is single It is first first successively to read file according to stripe unit size and strip width from storage unit file and disposable according to strip width Multiple storage units can be read and be written to new storage unit file, further according to a storage unit file and band list The size of member forms new image file repeatedly to read, and repeats the process Q times, then reads remaining N-K storage unit text Part reads write-in again and repeats M times, to obtain new image file.
Recovery module 4 includes map unit and access unit, and map unit is used to new image file being mapped to local Winding equipment, local winding equipment carry local directory, carry refer to by operating system make a storage equipment (such as hard disk, CD-ROM or shared resource) on computer documents and a mistake being accessed for user by the file system of computer of catalogue Journey.Access unit is used to access data with filesystem manner.New image file is mapped to local winding equipment by map unit Then being mounted to local directory, then access unit is accessed with filesystem manner, so that data be made to restore efficient.
Embodiment two: being with one difference of embodiment, and recovery module 4 includes lead-out unit and access unit, and export is single For member for new image file to be mapped to local winding equipment and is exported according to the access protocol of original piece of storage equipment, access is single Member is for accessing derived data.The block storage device access agreement after mapping is exported by lead-out unit, then access is single Member exports data, to keep data recovery operation simply and efficient.
Referring to Fig. 2, the invention discloses a kind of data reconstruction methods of distributed block storage, comprising the following steps:
S1, the disk for reading storage server simultaneously obtain the element storing unit file set of block storage equipment mirror image, to depositing Redundant file duplicate removal in storage unit file set;
S2, the progress that the storage unit file in storage unit file set is not up to storage unit file size maximum value Write zero padding;
Logically sequence of addresses is successively renamed S3 storage unit file by number, according to stripe unit size and Strip width reads storage unit file and new image file is written;
S4, new image file is restored to block storage equipment.
The storage unit file set for storing equipment by obtaining block from the disk of all storage servers, and to being collected into Storage unit file in storage unit file set is pre-processed, wherein pretreatment includes the storage unit of similar empty file File writes zero padding, extra storage unit file is deleted, logically sequence renumbers to storage unit file, then according to The strip parameter of block storage equipment is last extensive to the stripe cell and strip width progress data recombination dress in storage unit file The distributed block storing data for appearing again original is run quickly the disasters such as burst to provide a kind of distributed block and be stored in storage system software Under, data reconstruction method efficiently and accurately.
S1 is the following steps are included: S11, the disk for reading storage server and acquisition are deposited from block storage the original of equipment mirror image Storage unit file set;
S12, it is divided into one group for the storage unit file size in storage unit file set is identical;
S13, the logical address of the storage unit file of same group of size is compared, it will if logical address repeats The storage unit file for repeating logical address is deleted, and as follows for the processing method of duplicate storage unit file: initialization HashMap<md5, count>, md5 indicates the md5 value of file, and count indicates the number of identical md5 value;Traversal calculates subclass The md5 value of file, if in hashmap md5 number count > 1, then it represents that current file is redundant file, and file is deleted Operation;If not including the md5 value in hashmap, md5 value is added in hashmap, count=1.By by original list After metadata file set is grouped by size, then same group of the identical storage unit file of logical address is deleted A storage unit file is left behind, prevents duplicate storage unit file residual from causing Data duplication and data is caused to restore wrong Accidentally, and then the accuracy that data are restored is improved.
As shown in figure 3, S3 the following steps are included:
S31, according to the size relation of storage unit file set and storage unit file, calculate and read storage unit file The number M of collection calculates the number Q for reading storage unit file according to the size relation of storage unit file and stripe cell;
S32, file successively is read according to strip width K and stripe unit size from storage unit file and is written to New image file repeats this process Q times;
S33, remaining storage unit file is read according to S32 step, and repeated M times, and remaining storage unit is literary Part is written to new image file.
It obtains reading storage unit divided by the size of storage unit file by the size according to storage unit file set The number of file set obtains the reading of storage unit file further according to the size of storage unit file divided by stripe unit size Number successively reads file according to stripe unit size from storage file first and is written in new image file, and each deposits Storage unit file, which is read, repeats Q times a new image file to be written completely, then also by the storage unit text of remaining N-K Part reads according to stripe unit size and strip width and is written in new image file, is K in the present embodiment strip width The data that namely disposably can concurrently read K storage unit, and read stripe unit size every time enter new mirror image text Part is finally obtained new image file and is repeated to read write-in M times due to the relationship of storage unit file size and stripe unit size To form complete new image file, so in the present embodiment, needing concurrently to read K when reading data into new image file A storage unit, and reading size every time is 256KB, and can both have been read a storage unit file for repetition reading Q times complete As new image file, so that storage unit file data be made to restore quickly and complete.
S4 is mounted to local directory the following steps are included: S41, new image file is mapped to local winding equipment;
S42, the data in new image file are accessed with filesystem manner, to make data convert to local memory device It is simple and efficient.
Embodiment two: being with one difference of embodiment, and S4 is the following steps are included: S41, by new image file be mapped to local Winding equipment;
S42, winding equipment are exported according to the access protocol of block storage equipment, access the data of new image file.
Image file collection after recovery causes after being mapped to local winding equipment according to original piece of storage device access agreement, Data are directly accessed, keep data convert simple to the operation of local device.
A kind of computer readable storage medium, computer-readable recording medium storage have computer executable instructions, calculate Machine executable instruction is for making computer execute S1-S4 step.
It is to be illustrated to preferable implementation of the invention, but the invention is not limited to the implementation above Example, those skilled in the art can also make various equivalent variations on the premise of without prejudice to spirit of the invention or replace It changes, these equivalent deformations or replacement are all included in the scope defined by the claims of the present application.

Claims (10)

1. a kind of data reconstruction method of distributed block storage, which comprises the following steps:
S1, the disk for reading storage server and the element storing unit file set for obtaining block storage equipment mirror image, are deposited to described Redundant file duplicate removal in storage unit file set;
S2, the progress that the storage unit file in the storage unit file set is not up to storage unit file size maximum value Write zero padding;
Logically sequence of addresses is successively renamed S3 storage unit file by number, according to stripe unit size and band Width reads storage unit file and new image file is written;
S4, the new image file is restored to described piece of storage equipment.
2. a kind of data reconstruction method of distributed block storage according to claim 1, which is characterized in that the S1 includes Following steps:
S11, the disk for reading storage server simultaneously obtain the element storing unit file set that equipment mirror image is stored from block;
S12, it is divided into one group for the storage unit file size in storage unit file set is identical;
S13, the logical address of the storage unit file of same group of size is compared, will be repeated if logical address repeats The storage unit file of logical address is deleted.
3. a kind of data reconstruction method of distributed block storage according to claim 1 or 2, which is characterized in that the S3 The following steps are included:
S31, according to the size relation of the storage unit file set and the storage unit file, calculate and read the storage The number M of unit file collection calculates reading storage unit according to the size relation of the storage unit file and stripe cell The number Q of file;
S32, file successively is read according to strip width K and the stripe unit size from storage unit file and is written to New image file repeats this process Q times;
S33, remaining storage unit file is read according to the S32 step, and repeated M times, and the remaining storage is single Meta file is written to new image file.
4. a kind of data reconstruction method of distributed block storage according to claim 1 or 2, which is characterized in that the S4 The following steps are included:
S41, the new image file is mapped to local winding equipment, then is mounted to local directory;
S42, the data in the new image file are accessed with filesystem manner.
5. a kind of data reconstruction method of distributed block storage according to claim 1 or 2, which is characterized in that the S4 The following steps are included:
S41, the new image file is mapped to local winding equipment;
The access protocol that S42, the winding equipment store equipment according to described piece exports, and accesses the data of new image file.
6. a kind of Data Recapture Unit of distributed block storage characterized by comprising
Deduplication module is obtained, for obtaining the storage unit file set in block storage equipment, the storage unit file set that will acquire In duplicate storage unit file delete, only retain a complete storage unit file set;
Preprocessing module, for the storage unit file be not up to the storage unit file maximum value carry out write zero behaviour Make, and logically address successively carries out renaming number to the storage unit file;
Module is assembled, for storage unit file in the preprocessing module to be reassembled into new image file;
Recovery module, for restoring the new image file to described piece of storage equipment.
7. a kind of Data Recapture Unit of distributed block storage according to claim 6, which is characterized in that the acquisition is gone Molality block includes:
Acquiring unit will be deposited for reading the disk of storage server and obtaining the storage unit file set in block storage equipment Storage unit file in storage unit file set is grouped according to identical file size;
Duplicate removal unit, the logical address for the storage unit file to same group are compared, by the identical storage of logical address Unit file is deleted.
8. a kind of Data Recapture Unit of distributed block storage according to claim 6 or 7, which is characterized in that described group Die-filling piece includes:
Computing unit is read, for the maximum value according to the storage unit file set size and the storage unit file size The number M for reading the storage unit file set is calculated, according to the size of storage unit file and the size of stripe cell, meter Calculate the number Q for reading storage unit file;
Writing unit, for reading file according to stripe unit size and strip width K from storage unit file and being written to new In image file, to form new image file.
9. a kind of Data Recapture Unit of distributed block storage according to claim 7, which is characterized in that the recovery mould Block includes:
Map unit, for the new image file to be mapped to local winding equipment, local winding equipment carry local directory;
Access unit, for accessing data with filesystem manner.
10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer can It executes instruction, the computer executable instructions are for making computer execute such as method described in any one of claim 1 to 5.
CN201910605476.0A 2019-07-05 2019-07-05 Data recovery method and device for distributed block storage and storage medium Active CN110457163B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910605476.0A CN110457163B (en) 2019-07-05 2019-07-05 Data recovery method and device for distributed block storage and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910605476.0A CN110457163B (en) 2019-07-05 2019-07-05 Data recovery method and device for distributed block storage and storage medium

Publications (2)

Publication Number Publication Date
CN110457163A true CN110457163A (en) 2019-11-15
CN110457163B CN110457163B (en) 2022-05-03

Family

ID=68482298

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910605476.0A Active CN110457163B (en) 2019-07-05 2019-07-05 Data recovery method and device for distributed block storage and storage medium

Country Status (1)

Country Link
CN (1) CN110457163B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114564456A (en) * 2022-03-03 2022-05-31 北京天融信网络安全技术有限公司 Distributed storage file recovery method and device
CN117971774A (en) * 2024-03-29 2024-05-03 苏州元脑智能科技有限公司 File set recovery method, apparatus, computer device, medium and program product

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040153479A1 (en) * 2002-11-14 2004-08-05 Mikesell Paul A. Systems and methods for restriping files in a distributed file system
CN102736961A (en) * 2011-03-11 2012-10-17 微软公司 Backup and restore strategies for data deduplication
CN103955530A (en) * 2014-05-12 2014-07-30 暨南大学 Data reconstruction and optimization method of on-line repeating data deletion system
CN109933278A (en) * 2017-12-19 2019-06-25 中国电信股份有限公司 For realizing the method and apparatus of block device carry access

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040153479A1 (en) * 2002-11-14 2004-08-05 Mikesell Paul A. Systems and methods for restriping files in a distributed file system
CN102736961A (en) * 2011-03-11 2012-10-17 微软公司 Backup and restore strategies for data deduplication
CN103955530A (en) * 2014-05-12 2014-07-30 暨南大学 Data reconstruction and optimization method of on-line repeating data deletion system
CN109933278A (en) * 2017-12-19 2019-06-25 中国电信股份有限公司 For realizing the method and apparatus of block device carry access

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114564456A (en) * 2022-03-03 2022-05-31 北京天融信网络安全技术有限公司 Distributed storage file recovery method and device
CN114564456B (en) * 2022-03-03 2022-09-23 北京天融信网络安全技术有限公司 Distributed storage file recovery method and device
CN117971774A (en) * 2024-03-29 2024-05-03 苏州元脑智能科技有限公司 File set recovery method, apparatus, computer device, medium and program product
CN117971774B (en) * 2024-03-29 2024-06-07 苏州元脑智能科技有限公司 File set recovery method, apparatus, computer device, medium and program product

Also Published As

Publication number Publication date
CN110457163B (en) 2022-05-03

Similar Documents

Publication Publication Date Title
US11687500B1 (en) Updating metadata for a synchronously replicated dataset
US11687265B2 (en) Transferring snapshot copy to object store with deduplication preservation and additional compression
US9002785B2 (en) Stubbing systems and methods in a data replication environment
US11144498B2 (en) Defragmentation for objects within object store
US8725698B2 (en) Stub file prioritization in a data replication system
US8352422B2 (en) Data restore systems and methods in a replication environment
US6915397B2 (en) System and method for generating point in time storage copy
CN106354582B (en) A kind of continuous data protection method
US11003547B2 (en) Method, apparatus and computer program product for managing data storage
CN101777017B (en) Rapid recovery method of continuous data protection system
CN109726033A (en) The life-span stop detection and Active Replication based on driver panel in the RAID data storage system of mapping
CN103763383A (en) Integrated cloud storage system and storage method thereof
MX2013015361A (en) Managing replicated virtual storage at recovery sites.
CN101784996A (en) Emulated storage system
CN100504799C (en) Method for snapping magnetic disc using snap index
CN107885616A (en) A kind of mass small documents back-up restoring method based on file system parsing
US11797397B2 (en) Hybrid NVRAM logging in filesystem namespace
US12001724B2 (en) Forwarding operations to bypass persistent memory
CN110457163A (en) A kind of data reconstruction method, device and the storage medium of distributed block storage
US11861199B2 (en) Data management across a persistent memory tier and a file system tier
US20200042617A1 (en) Method, apparatus and computer program product for managing data storage
CN103473258A (en) Cloud storage file system
US10896152B2 (en) Method, apparatus and computer program product for managing data storage
US20230350758A1 (en) Volume group restore from remote object store
US20230350573A1 (en) Volume group backup to remote object store

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant