CN104965772A - Method and device for recovering files - Google Patents
Method and device for recovering files Download PDFInfo
- Publication number
- CN104965772A CN104965772A CN201510455481.XA CN201510455481A CN104965772A CN 104965772 A CN104965772 A CN 104965772A CN 201510455481 A CN201510455481 A CN 201510455481A CN 104965772 A CN104965772 A CN 104965772A
- Authority
- CN
- China
- Prior art keywords
- file
- data
- recover
- metadata
- recovering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a method for recovering files. The method includes the steps of selecting the to-be-recovered files; recovering the files; recovering the next files after the files are completely recovered. By means of the method in the technical scheme, data are recovered in the unit of the files, delaying caused by the insufficient network bandwidth when the large quantity of data are recovered is avoided, and the data recovering efficiency is effectively improved.
Description
Technical field
The present invention relates to technical field of data storage, particularly relate to a kind of file access pattern method and device.
Background technology
In Linux file management, a file, except the data of self, also has a satellite information, the i.e. metadata (metadata) of file.This metadata is used for many information of log file, such as file size, possessor, affiliated group, amendment date etc.Metadata is not comprised in the data of file, but safeguarded by operating system.In fact, this so-called metadata is just included in inode.Region occupied by inode is different from the region of data block.Each inode has unique integer numbering (inode number) expression.
At Preservation Metadata, inode is that " file " is from being abstracted into concrete key.Inode stores by some pointers, and some data blocks in these pointed memory devices, the content of file is just stored in these data blocks.When Linux wants to open a file, only need the inode finding file corresponding, then along pointer, all data blocks are collected, just can form the data of a file in internal memory.
In time being backed up by the data of backup software to needs protection, not only need backup file data itself, the metadata that file is corresponding simultaneously also needs backup.When loss of data time, come recovery file data and correlation attribute information by recovery file metadata and data itself.
Prior art is, when the quantity of documents needing to recover is a lot, and the metadata of first batch save All Files, then the data of batch save All Files, as everyone knows, under lan environment, the network bandwidth becomes the bottleneck of data backup and restore; The restriction of and the network bandwidth larger due to data volume, data transmission needs the longer time, totally sees, causes the whole date restoring cycle long.
Summary of the invention
In order to solve the problem, the invention provides a kind of file access pattern method, described method comprises:
Choose the file that will recover;
Recover described file;
Described file access pattern is complete, then recovers next file.
Alternatively,
The described file of described recovery, comprising: the metadata recovering described file; Recover the data of described file.
Alternatively, before the data of the described file of described recovery, comprising: the data finding file corresponding to the metadata of described file.
A kind of file restoring device, described device comprises:
Document management module, for choosing the file that will recover;
Recover module; For recovering described file;
Described file access pattern is complete, then recovers next file.
Alternatively, described recovery module, for recovering the metadata of described file; Recover the data of described file.
Alternatively, also comprise and search module; For before the data recovering file described in module recovery, according to the metadata of described file, find the data of file corresponding to the metadata of described file.
Technical scheme of the present invention is that unit carries out date restoring by file, and the time delay caused because of the network bandwidth deficiency when avoiding recovery mass data, effectively improves data recovering efficiency.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of a kind of file access pattern method of the present invention;
Fig. 2 is the structural drawing of a kind of file restoring device of the present invention.
Embodiment
Below in conjunction with drawings and Examples, technical scheme of the present invention is described in detail.
It should be noted that, if do not conflicted, each feature in the embodiment of the present invention and embodiment can be combined with each other, all within protection scope of the present invention.In addition, although show logical order in flow charts, in some cases, can be different from the step shown or described by order execution herein.
A kind of file access pattern method, described method comprises:
Choose the file that will recover;
Recover described file;
Described file access pattern is complete, then recovers next file.
Alternatively,
The described file of described recovery, comprising: the metadata recovering described file; Recover the data of described file.
Alternatively, before the data of the described file of described recovery, comprising: the data finding file corresponding to the metadata of described file.
Fig. 1 is the process flow diagram of a kind of file access pattern method of the present invention;
Step S01: choose the file that will recover;
Step S02: recover described file;
Step S03: described file access pattern is complete, then recover next file.
Technical scheme of the present invention, has fully taken into account the network bandwidth, has recovered in units of Single document, instead of in employing prior art, the metadata of batch save heap file, then the method for the data of batch save heap file, thus avoid the not enough time delay caused of the network bandwidth.
Recover in units of Single document, such as, first recover first file, first recover the metadata of first file; Find corresponding data with lookup algorithm, after metadata being recovered, then recover corresponding data, first file access pattern terminates.And then recover second file, method is identical.Recover all files successively.
Technical scheme of the present invention, when file is in enormous quantities, just can embody advantage.Save bandwidth, improve the time.
Split into and recover with Single document, recovered the metadata of a file, then recover the data of this file, and then recover next file, until all file access pattern are complete.For network, the maximum amount of data passed through each time is the data volume of Single document.
Make use of the network bandwidth.Thus improve transfer efficiency.
Technical scheme of the present invention, has taken into full account the factor of the network bandwidth, has recovered in units of Single document, solves prior art not enough due to the network bandwidth, extends the problem of data restore time.
Fig. 2 is the structural drawing of a kind of file restoring device of the present invention;
Comprise document management module 201, recover module 202, search module 203;
Search module 203, for searching the data corresponding with metadata; Recover module 202, for recovering metadata, data;
For Single document, search module, find corresponding data according to metadata; After finding, notice recovers module, recovers module and recovers the data found;
Above-mentioned process of searching can recover module before recovery metadata, or simultaneously, or afterwards, carry out;
To carry out simultaneously,
When recovering module 202 pairs of metadata and recovering, notice is searched module 203 and is searched;
Search module 203 and search corresponding data, reinform to recovery module 202;
Document management module 201, for management document group, comprises and being sorted by the file in file group, select the file that will recover each time; After a file access pattern completes, recover module 202 circular document administration module, this file access pattern completes; Document management module 201 notifies to recover module 202, recovers next file.
The all or part of step that one of ordinary skill in the art will appreciate that in said method is carried out instruction related hardware by program and is completed, and described program can be stored in computer-readable recording medium, as ROM (read-only memory), disk or CD etc.Alternatively, all or part of step of above-described embodiment also can use one or more integrated circuit to realize.Correspondingly, each module/unit in above-described embodiment can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
Certainly; the present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those of ordinary skill in the art are when making various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection domain that all should belong to claim of the present invention.
Claims (6)
1. a file access pattern method, is characterized in that, described method comprises:
Choose the file that will recover;
Recover described file;
Described file access pattern is complete, then recovers next file.
2., as profit requires the method as described in 1, it is characterized in that
The described file of described recovery, comprising: the metadata recovering described file; Recover the data of described file.
3. method as claimed in claim 2, is characterized in that, before the data of the described file of described recovery, comprising: the data finding file corresponding to the metadata of described file.
4. a file restoring device, is characterized in that, described device comprises:
Document management module, for choosing the file that will recover;
Recover module; For recovering described file;
Described file access pattern is complete, then recovers next file.
5. device as claimed in claim 4, is characterized in that, described recovery module, for recovering the metadata of described file; Recover the data of described file.
6. device as claimed in claim 5, is characterized in that, also comprise and search module; For before the data recovering file described in module recovery, according to the metadata of described file, find the data of file corresponding to the metadata of described file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510455481.XA CN104965772A (en) | 2015-07-29 | 2015-07-29 | Method and device for recovering files |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510455481.XA CN104965772A (en) | 2015-07-29 | 2015-07-29 | Method and device for recovering files |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104965772A true CN104965772A (en) | 2015-10-07 |
Family
ID=54219807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510455481.XA Pending CN104965772A (en) | 2015-07-29 | 2015-07-29 | Method and device for recovering files |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104965772A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002054241A1 (en) * | 2000-12-29 | 2002-07-11 | Chapararal Network Storage Inc. | Recovering data from arrays of storage devices after certain failures |
| CN101814045A (en) * | 2010-04-22 | 2010-08-25 | 华中科技大学 | Data organization method for backup services |
| CN102737032A (en) * | 2011-04-06 | 2012-10-17 | 腾讯科技（深圳）有限公司 | Method and device for file recovery |
-
2015
- 2015-07-29 CN CN201510455481.XA patent/CN104965772A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002054241A1 (en) * | 2000-12-29 | 2002-07-11 | Chapararal Network Storage Inc. | Recovering data from arrays of storage devices after certain failures |
| CN101814045A (en) * | 2010-04-22 | 2010-08-25 | 华中科技大学 | Data organization method for backup services |
| CN102737032A (en) * | 2011-04-06 | 2012-10-17 | 腾讯科技（深圳）有限公司 | Method and device for file recovery |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103098035B (en) | Storage system | |
| US8924366B2 (en) | Data storage deduplication systems and methods | |
| CN108255647B (en) | High-speed data backup method under samba server cluster | |
| CN106874348B (en) | File storage and index method and device and file reading method | |
| CN109445702B (en) | block-level data deduplication storage system | |
| US10802923B2 (en) | Method and apparatus for incremental backup based on file paths and a prefix tree | |
| CN102831222A (en) | Differential compression method based on data de-duplication | |
| CN104461390A (en) | Method and device for writing data into imbricate magnetic recording SMR hard disk | |
| CN102142032B (en) | Method and system for reading and writing data of distributed file system | |
| US10496612B2 (en) | Method for reliable and efficient filesystem metadata conversion | |
| CN104238962A (en) | Method and device for writing data into cache | |
| CN102508913A (en) | Cloud computing system with data cube storage index structure | |
| CN112612576B (en) | Virtual machine backup method and device, electronic equipment and storage medium | |
| CN104965835B (en) | A kind of file read/write method and device of distributed file system | |
| CN105183399A (en) | Data writing and reading method and device based on elastic block storage | |
| CN105447168A (en) | Method for restoring and recombining fragmented files in MP4 format | |
| CN112732191A (en) | Method, system, device and medium for merging tree merging data based on log structure | |
| CN105068885A (en) | JPG fragmented file recovery and reconstruction method | |
| CN103106200A (en) | Synchronization system of non-relational type database and double-writing synchronization method | |
| CN111522791A (en) | Distributed file repeating data deleting system and method | |
| CN112800007B (en) | Directory entry expansion method and system suitable for FAT32 file system | |
| CN102253938B (en) | Method and device for writing and restoring file | |
| CN104636218A (en) | Data recovery method and device | |
| US10262000B1 (en) | Global distributed file append using log-structured file system | |
| CN104965772A (en) | Method and device for recovering files |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151007 |