CN106503051A - A kind of greediness based on meta data category prefetches type data recovery system and restoration methods - Google Patents
A kind of greediness based on meta data category prefetches type data recovery system and restoration methods Download PDFInfo
- Publication number
- CN106503051A CN106503051A CN201610847382.0A CN201610847382A CN106503051A CN 106503051 A CN106503051 A CN 106503051A CN 201610847382 A CN201610847382 A CN 201610847382A CN 106503051 A CN106503051 A CN 106503051A
- Authority
- CN
- China
- Prior art keywords
- block
- data
- metadata
- file
- backup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The invention discloses a kind of greediness based on meta data category prefetches type data recovery system and restoration methods, the data recovery system includes the reading meta data block being linked in sequence successively, block data search module and recovers data module, wherein, reading meta data block is used for concurrently reading backup metadata information；Looking up function of the block data search module for the block of the LRU cache in providing based on internal memory, and the dsc data for being responsible for being related to recover backup；Recovering data module is used for rebuilding desired data in local disk.The present invention will back up metadata organization into file metadata and block metadata, file metadata is prefetched to segmentation completely after internal memory, then carry out Greedy to block metadata to prefetch, high efficiency data recovery is realized on the premise of not sacrificing duplicate removal rate and making full use of hardware resource, operation need not be written over when to Backup Data duplicate removal to data block simultaneously, thereby may be ensured that the duplicate removal rate of data.
Description
Technical field
The present invention relates to the related technical field of data recovery in duplicate removal standby system, and in particular to a kind of based on metadata
The greediness of classification prefetches type data recovery system and restoration methods.
Background technology
With the arriving in big data epoch, the swift and violent growth of data volume to data center limited storage space bring huge
Big challenge.Data de-duplication technology greatly reduces the disk expense needed for data storage and network transmission desire bandwidth, gradually
Gradually become a critical data reduction technology of current standby system.The purpose of duplicate removal standby system data storage is in order to after
Timely can recover, if enterprise disk break down or database-relative file damage etc. disaster occur when its can not and
When ground recover data, the loss that is born will be inestimable, and data backup also becomes to have little significance.Due to the continuous data of logic
By physical dispersion in different Disk Localities, the fragment that traditional De-weight method is produced has had a strong impact on the restorability of system.
Some optimization methods for existing before are all an attempt to improve the restorability in later stage in backup using algorithm is rewritten, but heavy
It is exactly must to obtain more preferable data recovery performance with the cost for sacrificing duplicate removal rate to write the drawbacks of algorithm itself is present, and finally leads
Cause the result for wasting disk space.And traditional method can only generate a backup metadata after the completion of backup so as to the later stage
Recover, continually poor efficiency accesses the metadata on disk in recovery process to cause system, have impact on the restorability of system.
Content of the invention
First purpose of the present invention is to solve drawbacks described above of the prior art, there is provided a kind of divided based on metadata
The greediness of class prefetches type data recovery system, and the system is realized on the premise of not sacrificing duplicate removal rate and making full use of hardware resource
High efficiency data recovery, while need not be written over operation to data block when to Backup Data duplicate removal, thereby may be ensured that
The duplicate removal rate of data.
Another object of the present invention is to solve drawbacks described above of the prior art, there is provided a kind of divided based on metadata
The greediness of class prefetches type data reconstruction method.
First purpose of the present invention can be reached by adopting the following technical scheme that：
A kind of greediness based on meta data category prefetches type data recovery system, and the data recovery system includes suitable successively
The reading meta data block of sequence connection, block data search module and recovery data module,
Wherein, the reading meta data block is used for concurrently reading backup metadata information, wherein described backup metadata
Information is stored in two files, the logical message of file, referred to as file metadata in the backup of a file record, another
File then have recorded the relevant information of block, referred to as block metadata；
Looking up function of the described piece of data search module for the block of the LRU cache in providing based on internal memory, and it is responsible for pipe
Reason is related to the dsc data for recovering backup；
The recovery data module is used for rebuilding desired data in local disk；
When the data recovery system receives the request for recovering a certain Backup Data, first by described reading meta data block from
The backup is opened in disk and backs up metadata information file accordingly, by the content of file metadata, can learn that recovery should
Block metadata needed for Backup Data, after obtaining the fingerprint of block and the positional information at its place, by described piece of data search module
The looking up function of the block that the LRU cache in based on internal memory is provided, according to the read request that the fingerprint of each block induces a block number evidence,
The container sequence number being located by block, searches the container comprising the block in the LRU cache that the data recovery system is maintained, if
Cache hit, then block number evidence in the queue for maintaining in filling internal memory, subsequently into the recovery data module, if caching is not ordered
In, the data recovery system will find corresponding block number evidence from container cell, and prefetch the container comprising the block to caching,
The recovery data module is entered back into afterwards.
Further, the file metadata includes：Number after the included file number of the sequence number of backup, backup, backup
According to the name of each file, the length of name in the path of storage and the length of pathname and backup, the block for being included
Number, the size of file and file ID number, described piece of metadata include：The fingerprint of each block, block be located container sequence number, block big
Little.
Further, multiple threads are run while to setting up multiple differences under same catalogue in the recovery data module
File.
Further, the file ID number is by the skew in backup sequence number, block metadata and the block number after file declustering
Formed by displacement operation, the skew in described piece of metadata refers to the reading block metadata operation of each induction in block metadata
Start the skew of read operation in file.
Further, the reading meta data block is complete first file metadata after reading backup metadata information starts
Portion is read in the LRU cache of internal memory in advance, then carries out greedy reading according to the information in which to block metadata.
Further, the file metadata that reads in advance in the LRU cache of internal memory is divided into multiple fragments, wraps in each fragment
Backup metadata information containing several files, and each fragment can induce the operation of a reading block metadata.
Further, parallel reading block metadata operation is induced by the file ID number.
Further, described piece of data search module opens up a global LRU cache, the data recovery in internal memory
The mechanism of the shared caching of internal system, meanwhile, when peripheral operation unit writes shared buffer memory to LRU cache, LRU cache
It is locked, other modules can not be modified to LRU cache operation, it is necessary to after waiting caching unblock, can just carry out associative operation.
Further, the reading meta data block, described piece of data search module and the recovery data module are parallel
Work.
Another object of the present invention can be reached by adopting the following technical scheme that：
A kind of greediness based on meta data category prefetches type data reconstruction method, and the data reconstruction method includes：
S1, when data recovery system receives the request for recovering a certain Backup Data, read meta data block and open from disk
The backup metadata information file, the LRU cache that file metadata in backup metadata information file is all read internal memory in advance
In, by the content of file metadata in meta data file, the block metadata that recovers needed for the backup is learnt, obtain the finger of block
Line, the container sequence number at block place, the size of block；
S2, greedy reading is carried out to block metadata, read the file metadata in internal memory in advance and be divided into multiple fragments, each
The backup metadata information of multiple files is contained in fragment, and each fragment can induce the operation of a reading block metadata；
S3, by block data search module based on internal memory in the looking up function of block that provides of LRU cache, according to each
The fingerprint of block induces the read request of a block number evidence, and the container sequence number being located by block searches bag in the caching that system is maintained
Container containing the block, if cache hit, fills the block data queue maintained in internal memory, subsequently into recovery data module；
If cache miss, corresponding block number evidence is found from container cell, and prefetches the container comprising the block to caching, Zhi Houzai
Enter and recover data module；
S4, recovery data module specify a restoration path, all of write data unit to build under specified restoration path
Founding respective catalogue and file carries out reconstruction desired data.
The present invention is had the following advantages relative to prior art and effect：
(1), the present invention will back up metadata organization into file metadata and block metadata, and file metadata is prefetched completely
The segmentation to after internal memory, then carries out Greedy to block metadata and prefetches, improve the restorability of data reconstruction method.
(2), the present invention is for classical rewriting algorithm, it is to avoid the phenomenon for sacrificing duplicate removal rate occurs, so as to save
About disk storage overhead.
(3), the present invention for traditional data reconstruction method employs parallel mechanism to reduce the extensive of system
The multiple time.
Description of the drawings
Fig. 1 is the structural representation for prefetching type data recovery system based on the greediness of meta data category disclosed in the present invention
Figure；
Fig. 2 is the organization chart of backup metadata information classification in the present invention.
Specific embodiment
Purpose, technical scheme and advantage for making the embodiment of the present invention is clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, to the embodiment of the present invention in technical scheme be clearly and completely described, it is clear that described embodiment is
The a part of embodiment of the present invention, rather than whole embodiments.Embodiment in based on the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Embodiment one
The present embodiment discloses a kind of greediness based on meta data category and prefetches type data recovery system.
The purpose of data backup is exactly to recover.Due to the continuous data of logic by physical dispersion in different disk positions
Put, the fragment that traditional De-weight method is produced has had a strong impact on the restorability of system.Some optimization methods for existing before are all
Be an attempt to the restorability in later stage be improved in backup using algorithm is rewritten, but rewriting algorithm itself the drawbacks of presence is exactly
More preferable data recovery performance must be obtained to sacrifice the cost of duplicate removal rate, ultimately result in the result for wasting disk space.And
And traditional method can only generate a backup metadata after the completion of backup so that the later stage recovers, and cause system in recovery process
In the continually inefficient metadata accessed on disk.
As shown in figure 1, the present embodiment discloses a kind of greediness based on meta data category and prefetching type data recovery system and including：
Read meta data block, block data search module, recover data module.Read the preparation that meta data block carries out early stage for data recovery
Work, such as concurrently reads backup metadata information.Block data search module based on internal memory in LRU cache provide block and seeking
Function is looked for, which is responsible for the dsc data that part is related to recover backup.Recover data module to be responsible for needed for local disk is rebuild
Data.
These three modules are concurrently to complete respective work in recovery process each other.Each module is each independent complete
Information exchange there is also with completing into needs between task, and module.
When system receives the request for recovering a certain Backup Data, reading meta data block is initially entered, which is immediately from disk
The corresponding meta data file of the backup is opened, by the content of meta data file, can be learnt and be recovered which the backup specifically needs
A little block messages for having stored, after obtaining the information such as fingerprint and its position being located of block, immediately enter block data search module, per
Individual fingerprint induces the read request of a block number evidence, by the fingerprint of block, searches the appearance comprising the block in the caching that system is maintained
Device, if cache hit, fills block number evidence in the queue maintained in internal memory, subsequently into recovery data module.If caching is not
Hit, system will find corresponding block number evidence from container cell, and prefetch the container comprising the block to caching, enter back into afterwards
Recover data module.
Wherein, recover to run multiple threads while to setting up multiple different files under same catalogue in data module,
Each thread is to be independently completed respective task, such recovery operation avoid the need for wait each data recovery after again again
Splicing data, it is to avoid increase extra calculating and time overhead.
System is deposited backup metadata information hereof, and backup metadata information is divided into two, and is distributed in
In two files, the logical message of file, i.e. file metadata in the backup of a file record, another file then have recorded
The relevant information of block, referred to as block metadata.File metadata houses the sequence number of backup, the file number included by the backup,
The length of the path of data storage and pathname after backup.Due to once back up in contain multiple files, each file by
Division is blocking, so file metadata also houses the name of each file, the length of name, the block for being included in backup successively
Number, the size of file and file ID number.Container sequence number that the block metadata record fingerprint of each block, block are located, block
Size.
The relation of file metadata and block metadata is closely coupled, plays the role of guide in recovery process,
Once record order entanglement in the order entanglement in which, especially block metadata, Backup Data will be unable to recover.
The size of file metadata less than block metadata size because backup in file number be far smaller than each
The summation of file block number.
As shown in Fig. 2 classification metadata institutional framework proposed by the present invention, when recovering to start, complete file metadata
Portion is read in internal memory in advance, then carries out greedy reading according to the information in which to block metadata.Prefetching file metadata completely can
To reduce access times of the system to disk.In order to increase the greedy dynamics for reading data, the file unit number in internal memory is read in advance
According to multiple fragments are divided into, the metadata information of multiple files is contained in a fragment, and each fragment can induce one
Read the operation of block metadata.In order to make the reading block metadata operation of induction parallel, file ID number this index value has been introduced.Pass through
This index value is analyzed, the reading block metadata operation of each induction is known that from the relevant position of block meta data file and starts to read
The relevant metadata information of block.File ID number is by the block number included in the skew in backup sequence number, block metadata and file
Formed by displacement operation, the skew in block metadata refers to the reading block metadata operation of each induction in block meta data file
The middle skew for starting read operation.Can see in figure, file metadata shows File1、Filem、FilenThree No. ID, pass through
Each No. ID is analyzed, recovery file File can be learnt1Need to read k1Individual block metadata information, FilemNeed to read k2Individual, Filen
Need to read k3Individual, it is assumed that three is S respectively1、Sm、SnThree different fragment start files ID, due to S1、Sm、SnEach lure
The block metadata operation of reading that sends out corresponds respectively to different filec descriptors and file structure, reads between metadata operation mutually not
Interference, adds the information offset in No. ID, it is possible to which the diverse location in block meta data file finds required block metadata
Information.The greediness of block metadata is prefetched to be realized premised on file ID number, if there is no this index value, each reading block unit
The information that data manipulation is read will be rambling.
The greediness of block metadata is prefetched, and when recovering to start, file metadata is all read in advance the LRU cache of internal memory
In, greedy reading is carried out to block metadata according to the information in which then, in order to increase the greedy dynamics for reading data, is read in advance
File metadata in internal memory is divided into multiple fragments, contains the metadata information of multiple files in a fragment, and every
Individual fragment can induce the operation of a reading block metadata.
The data recovery system realizes Cache Design, and block data search module is global by opening up one in internal memory
LRU cache, the mechanism of the shared caching of all operations module in system, so just can fully using between data
Locality.
When peripheral operation unit writes shared buffer memory to LRU cache, LRU cache is locked, and other modules can not be right
LRU cache is modified operation, it is necessary to can just carry out associative operation after waiting caching unblock.
The data recovery system parallel recovery, in recovery process, read the metadata of block, block data search, recover data it
Between be parallel, for the recovery of identical file, their operation order can not be overturned.The system is regarded parallel one
One streamline.When recovery process starts, system is prefetched to file metadata in internal memory completely, file metadata is divided into many
After individual fragment, each fragment gives pipeline processes, means that a streamline can complete the recovery of multiple files.So
One, system just has multiple streamlines, and correspondingly corresponding fragment is recovered, between streamline built-in function be parallel, and
And the operation between streamline and streamline is also parallel.
Embodiment two
Present embodiment discloses a kind of greediness based on meta data category prefetches type data reconstruction method, the data recovery side
Method specifically includes following steps：
S1, when data recovery system receives the request for recovering a certain Backup Data, read meta data block and open from disk
The backup metadata information file, the LRU cache that file metadata in backup metadata information file is all read internal memory in advance
In, by the content of file metadata in meta data file, the block metadata that recovers needed for the backup can be learnt, obtain block
Fingerprint, the container sequence number at block place, the size of block.
S2, greedy reading is carried out to block metadata, read the file metadata in internal memory in advance and be divided into multiple fragments, each
The backup metadata information of multiple files is contained in fragment, and each fragment can induce the operation of a reading block metadata；
S3, by block data search module based on internal memory in the looking up function of block that provides of LRU cache, according to each
The fingerprint of block induces the read request of a block number evidence, and the container sequence number being located by block searches bag in the caching that system is maintained
Container containing the block, if cache hit, fills the block data queue maintained in internal memory, subsequently into recovery data module；
If cache miss, corresponding block number evidence is found from container cell, and prefetches the container comprising the block to caching, Zhi Houzai
Enter and recover data module；
S4, recovery data module specify a restoration path, all of write data unit to build under specified restoration path
Founding respective catalogue and file carries out reconstruction desired data.
A global LRU cache is opened in block data search module, the shared caching of all operations unit
Mechanism, system can fully using the locality between data, such as active cell be the container that caching adds can be another
Unit provides the data of relevant block.
In sum, the present embodiment proposes a kind of greediness based on meta data category and prefetches type data reconstruction method, and one
Backup meta data category is organized into file metadata and block metadata by aspect, the rational storage for arranging data；On the other hand
In not sacrificial system duplicate removal rate and on the premise of making full use of hardware resource, by pre- having fetched to the more radical formula of metadata
Effect improves restorability and handling capacity, based on the recovery that the data reconstruction method that greediness is prefetched can effectively optimize required file
Time, meet requirement of the modernization to data storage.
Above-described embodiment is the present invention preferably embodiment, but embodiments of the present invention are not by above-described embodiment
Limit, other any Spirit Essences without departing from the present invention and the change, modification, replacement that is made under principle, combine, simplification,
Equivalent substitute mode is should be, is included within protection scope of the present invention.
Claims (10)
1. a kind of greediness based on meta data category prefetches type data recovery system, it is characterised in that the data recovery system
Including the reading meta data block, block data search module and the recovery data module that are linked in sequence,
Wherein, the reading meta data block is used for concurrently reading backup metadata information, wherein described backup metadata information
It is stored in two files, the logical message of file, referred to as file metadata, another file in the backup of a file record
The relevant information of block, referred to as block metadata then have recorded；
Looking up function of the described piece of data search module for the block of the LRU cache in providing based on internal memory, and be responsible for relating to
And recover the dsc data of backup；
The recovery data module is used for rebuilding desired data in local disk；
When the data recovery system receives the request for recovering a certain Backup Data, first by the reading meta data block from disk
Middle opening the backup back up metadata information file accordingly, by the content of file metadata, can learn recovery the backup
Block metadata needed for data, after obtaining the fingerprint of block and the positional information at its place, is based on by described piece of data search module
The looking up function of the block that the LRU cache in internal memory is provided, according to the read request that the fingerprint of each block induces a block number evidence, passes through
The container sequence number that block is located, searches the container comprising the block in the LRU cache that the data recovery system is maintained, if caching
Hit, then block number evidence in the queue for maintaining in filling internal memory, subsequently into the recovery data module, if cache miss, institute
State data recovery system and corresponding block number evidence will be found from container cell, and prefetch the container comprising the block to caching, afterwards
Enter back into the recovery data module.
2. a kind of greediness based on meta data category according to claim 1 prefetches type data recovery system, and its feature exists
In the file metadata includes：The sequence number of backup, back up included file number, after backup the path of data storage and
The name of each file in the length of pathname and backup, the length of name, the number of block for being included, the size of file and
File ID number, described piece of metadata include：The fingerprint of each block, the container sequence number at block place, the size of block.
3. a kind of greediness based on meta data category according to claim 1 prefetches type data recovery system, and its feature exists
In, described recovery data module in run multiple threads while to setting up multiple different files under same catalogue.
4. a kind of greediness based on meta data category according to claim 1 prefetches type data recovery system, and its feature exists
In block number of the file ID number by the skew in backup sequence number, block metadata and after file declustering passes through displacement operation shape
Into the skew in described piece of metadata refers to the reading block metadata operation of each induction and starts to read behaviour in block meta data file
The skew of work.
5. a kind of greediness based on meta data category according to claim 1 prefetches type data recovery system, and its feature exists
In the reading meta data block all reads internal memory file metadata after reading backup metadata information starts first in advance
In LRU cache, greedy reading is carried out to block metadata according to the information in which then.
6. a kind of greediness based on meta data category according to claim 1 prefetches type data recovery system, and its feature exists
In, to read the file metadata in the LRU cache of internal memory in advance and be divided into multiple fragments, each fragment is standby comprising several files
Part metadata information, and each fragment can induce the operation of a reading block metadata.
7. a kind of greediness based on meta data category according to claim 4 prefetches type data recovery system, and its feature exists
In by the parallel reading block metadata operation of the file ID number induction.
8. a kind of greediness based on meta data category according to claim 1 prefetches type data recovery system, and its feature exists
In,
Described piece of data search module opens up a global LRU cache, the data recovery system intra-sharing in internal memory
The mechanism of one caching, meanwhile, when peripheral operation unit writes shared buffer memory to LRU cache, LRU cache is locked, other
Module can not be modified to LRU cache operation, it is necessary to can just carry out associative operation after waiting caching unblock.
9. a kind of greediness based on meta data category according to claim 1 prefetches type data recovery system, and its feature exists
In the reading meta data block, described piece of data search module and the recovery data module are concurrent working.
10. a kind of greediness based on meta data category prefetches type data reconstruction method, it is characterised in that the data reconstruction method
Including：
S1, when data recovery system receives the request for recovering a certain Backup Data, reading meta data block, to open this from disk standby
Part metadata information file, all reads file metadata in backup metadata information file in advance in the LRU cache of internal memory, leads to
The content of file metadata in meta data file is crossed, the block metadata that recovers needed for the backup is learnt, fingerprint, the block institute of block is obtained
Container sequence number, block size；
S2, greedy reading is carried out to block metadata, read the file metadata in internal memory in advance and be divided into multiple fragments, each fragment
In contain the backup metadata information of multiple files, and each fragment can induce the operation of a reading block metadata；
S3, by block data search module based on internal memory in the looking up function of block that provides of LRU cache, according to each block
Fingerprint induces the read request of a block number evidence, and the container sequence number being located by block is searched to include in the caching that system is maintained and is somebody's turn to do
The container of block, if cache hit, fills the block data queue maintained in internal memory, subsequently into recovery data module；If
Cache miss, finds corresponding block number evidence from container cell, and prefetches the container comprising the block to caching, enter back into afterwards
Recover data module；
S4, recovery data module specify a restoration path, all of write data unit to set up under specified restoration path respectively
From catalogue and file carry out reconstruction desired data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610847382.0A CN106503051B (en) | 2016-09-23 | 2016-09-23 | A kind of greediness based on meta data category prefetches type data recovery system and restoration methods |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610847382.0A CN106503051B (en) | 2016-09-23 | 2016-09-23 | A kind of greediness based on meta data category prefetches type data recovery system and restoration methods |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106503051A true CN106503051A (en) | 2017-03-15 |
| CN106503051B CN106503051B (en) | 2019-05-14 |
Family
ID=58291007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610847382.0A Active CN106503051B (en) | 2016-09-23 | 2016-09-23 | A kind of greediness based on meta data category prefetches type data recovery system and restoration methods |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106503051B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107885463A (en) * | 2017-11-10 | 2018-04-06 | 下代互联网重大应用技术（北京）工程研究中心有限公司 | The processing method and processing device of file destination |
| CN108733361A (en) * | 2017-04-20 | 2018-11-02 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus for realizing concurrent container |
| CN108984338A (en) * | 2018-06-01 | 2018-12-11 | 暨南大学 | A kind of offline optimal caching alternative and method towards the recovery of duplicate removal standby system data |
| WO2019052213A1 (en) * | 2017-09-14 | 2019-03-21 | 华为技术有限公司 | Data recovery method and apparatus |
| CN109508254A (en) * | 2017-09-14 | 2019-03-22 | 华为技术有限公司 | A kind of data reconstruction method and device |
| CN109710180A (en) * | 2018-12-07 | 2019-05-03 | 国云科技股份有限公司 | A kind of distributed storage block device restoration methods |
| CN109992708A (en) * | 2019-04-12 | 2019-07-09 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of metadata query, equipment and storage medium |
| CN110018990A (en) * | 2017-11-28 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus for caching snapshot, reading snapshot |
| CN113626381A (en) * | 2021-06-30 | 2021-11-09 | 济南浪潮数据技术有限公司 | Method and device for optimizing interleaved read-ahead based on distributed file system |
| CN113625961A (en) * | 2021-07-07 | 2021-11-09 | 暨南大学 | Self-adaptive threshold repeated data deleting method based on greedy selection |
| CN114328030A (en) * | 2022-03-03 | 2022-04-12 | 成都云祺科技有限公司 | File data backup method, system and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102541751A (en) * | 2010-11-18 | 2012-07-04 | 微软公司 | Scalable chunk store for data deduplication |
| CN102736961A (en) * | 2011-03-11 | 2012-10-17 | 微软公司 | Backup and restore strategies for data deduplication |
| CN103345449A (en) * | 2013-06-19 | 2013-10-09 | 暨南大学 | Method and system for prefetching fingerprints oriented to data de-duplication technology |
| CN103473150A (en) * | 2013-08-28 | 2013-12-25 | 华中科技大学 | Fragment rewriting method for data repetition removing system |
| CN104050103A (en) * | 2014-06-06 | 2014-09-17 | 华中科技大学 | Cache replacement method and system for data recovery |
-
2016
- 2016-09-23 CN CN201610847382.0A patent/CN106503051B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102541751A (en) * | 2010-11-18 | 2012-07-04 | 微软公司 | Scalable chunk store for data deduplication |
| CN102736961A (en) * | 2011-03-11 | 2012-10-17 | 微软公司 | Backup and restore strategies for data deduplication |
| CN103345449A (en) * | 2013-06-19 | 2013-10-09 | 暨南大学 | Method and system for prefetching fingerprints oriented to data de-duplication technology |
| CN103473150A (en) * | 2013-08-28 | 2013-12-25 | 华中科技大学 | Fragment rewriting method for data repetition removing system |
| CN104050103A (en) * | 2014-06-06 | 2014-09-17 | 华中科技大学 | Cache replacement method and system for data recovery |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108733361B (en) * | 2017-04-20 | 2022-03-04 | 北京京东尚科信息技术有限公司 | Method and device for realizing concurrent containers |
| CN108733361A (en) * | 2017-04-20 | 2018-11-02 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus for realizing concurrent container |
| CN109508254A (en) * | 2017-09-14 | 2019-03-22 | 华为技术有限公司 | A kind of data reconstruction method and device |
| WO2019052213A1 (en) * | 2017-09-14 | 2019-03-21 | 华为技术有限公司 | Data recovery method and apparatus |
| US11397537B2 (en) | 2017-09-14 | 2022-07-26 | Huawei Technologies Co., Ltd. | Data restoration method and apparatus |
| CN109508254B (en) * | 2017-09-14 | 2020-09-08 | 华为技术有限公司 | Data recovery method and device |
| CN107885463A (en) * | 2017-11-10 | 2018-04-06 | 下代互联网重大应用技术（北京）工程研究中心有限公司 | The processing method and processing device of file destination |
| CN110018990B (en) * | 2017-11-28 | 2023-07-18 | 阿里巴巴集团控股有限公司 | Method and device for caching snapshot and method and device for reading snapshot |
| CN110018990A (en) * | 2017-11-28 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus for caching snapshot, reading snapshot |
| CN108984338B (en) * | 2018-06-01 | 2021-11-12 | 暨南大学 | Offline optimal cache replacement device and method for data recovery of duplicate removal backup system |
| CN108984338A (en) * | 2018-06-01 | 2018-12-11 | 暨南大学 | A kind of offline optimal caching alternative and method towards the recovery of duplicate removal standby system data |
| CN109710180B (en) * | 2018-12-07 | 2022-04-01 | 国云科技股份有限公司 | Distributed storage block equipment recovery method |
| CN109710180A (en) * | 2018-12-07 | 2019-05-03 | 国云科技股份有限公司 | A kind of distributed storage block device restoration methods |
| CN109992708A (en) * | 2019-04-12 | 2019-07-09 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of metadata query, equipment and storage medium |
| CN113626381A (en) * | 2021-06-30 | 2021-11-09 | 济南浪潮数据技术有限公司 | Method and device for optimizing interleaved read-ahead based on distributed file system |
| CN113626381B (en) * | 2021-06-30 | 2023-12-22 | 济南浪潮数据技术有限公司 | Optimization method and device based on interleaving read-ahead of distributed file system |
| CN113625961A (en) * | 2021-07-07 | 2021-11-09 | 暨南大学 | Self-adaptive threshold repeated data deleting method based on greedy selection |
| CN114328030A (en) * | 2022-03-03 | 2022-04-12 | 成都云祺科技有限公司 | File data backup method, system and storage medium |
| CN114328030B (en) * | 2022-03-03 | 2022-05-20 | 成都云祺科技有限公司 | File data backup method, system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106503051B (en) | 2019-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106503051A (en) | A kind of greediness based on meta data category prefetches type data recovery system and restoration methods | |
| CN104765575B (en) | information storage processing method | |
| CN105335098B (en) | A kind of log file system performance improvement method based on storage level memory | |
| CN104350477B (en) | For solid-state drive device（SSD）Optimization context remove | |
| US11756618B1 (en) | System and method for atomic persistence in storage class memory | |
| US9836419B2 (en) | Efficient data movement within file system volumes | |
| US8280858B2 (en) | Storage pool scrubbing with concurrent snapshots | |
| US10956324B1 (en) | System and method for persisting hardware transactional memory transactions to persistent memory | |
| US6216199B1 (en) | Hardware mechanism for managing cache structures in a data storage system | |
| CN103473150B (en) | A kind of fragment rewrite method in data deduplication system | |
| CN109416681A (en) | The data de-duplication of workload optimization is carried out using ghost fingerprint | |
| CN106662981A (en) | Storage device, program, and information processing method | |
| US10061775B1 (en) | Scalable and persistent L2 adaptive replacement cache | |
| JPH06259197A (en) | Control system for array type disk system | |
| US20210311877A1 (en) | Key-value store architecture for key-value devices | |
| CN104765574A (en) | Data cloud storage method | |
| WO2011049051A1 (en) | Cache memory and control method thereof | |
| CN106469123A (en) | A kind of write buffer distribution based on NVDIMM, method for releasing and its device | |
| CN101515295B (en) | Realization method for supporting high-speed buffer of hardware database on chip | |
| CN101840310B (en) | Data read-write method and disk array system using same | |
| CN104778100A (en) | Safe data backup method | |
| US8683145B2 (en) | Packed storage commands and storage command streams | |
| CN108733584A (en) | Method and apparatus for optimizing data buffer storage | |
| TW202103155A (en) | Method for facilitating recovery from crash of solid-state storage device, method of data synchronization, computer system, and solid-state storage device | |
| CN103838647B (en) | A kind of method and system of the data mode conversion remapped based on snapshot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190730 Address after: 511400 Room 3102, 82 Hanxing East Road, Zhongcun Street, Panyu District, Guangzhou, Guangdong Province Patentee after: Guangzhou Mo wing Mdt InfoTech Ltd Address before: 510632 Whampoa West Road, Guangdong, Guangzhou, No. 601, No. Patentee before: Jinan University |
|
| TR01 | Transfer of patent right |