CN103995757A - Rapid file backup method based on changed file monitoring - Google Patents
Rapid file backup method based on changed file monitoring Download PDFInfo
- Publication number
- CN103995757A CN103995757A CN201410196549.2A CN201410196549A CN103995757A CN 103995757 A CN103995757 A CN 103995757A CN 201410196549 A CN201410196549 A CN 201410196549A CN 103995757 A CN103995757 A CN 103995757A
- Authority
- CN
- China
- Prior art keywords
- file
- backup
- module
- list
- path
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a rapid file backup method based on changed file monitoring. The rapid file backup method includes the specific steps that a file monitoring module, a file list generation module, a file path ranking module and a file backup module are arranged; the file backup module calls the file list generation module to generate a backup file list; the file list generation module reads changed file paths monitored by the file monitoring module and transmits the paths to the file path ranking module; the file path ranking module ranks the paths transmitted to the file path ranking module and feeds the ranking result back to the file list generation module; the file backup module merges a last-time backup file list and the backup file list to generate a final backup file list and carries out file backup according to the backup file list. Compared with the prior art, the rapid file backup method based on changed file monitoring has the advantages that backup content indexing and backup content positioning are simplified, cost is accordingly reduced, the practicability is high, and the rapid file backup method is easy to popularize.
Description
Technical field
The present invention relates to computing machine calamity for technical field, specifically a kind of fast file backup method based on changing file monitor.
Background technology
Along with the arrival in the data centralization epoch in IT Information System configuration process, the standby important ring that must consider in Constructing data center that becomes of data calamity.So-called data calamity is standby is to adopt certain measure or technology that certain data redundancy is provided, and in the time that raw data is unavailable, can use the data of redundancy replace or recover.Visible, the essence technology during data calamity is standby is data backup.According to the granularity difference of Backup Data, can be divided into two kinds, a kind of is the data backup of piece rank, common as RAID technology, remote copy technology etc.; Another kind is the data backup of file-level, and how it is used by data backup software.The data backup of piece rank, owing to being positioned under file system layer, possesses performance high, the feature that resume speed is fast; But also just because of it under file system, its exist equally backup granularity larger, cannot carry out compatible shortcoming with multiple file system.The data backup of file-level is used the API of file system to back up, and its speed is not as the backup of piece rank, but its granularity can be as accurate as Single document, and due to the API that uses operating system to provide, multiple file system is all possessed to versatility.In the use, the data backup of piece rank mostly is the additional function that storage system provides, for whole disk is backed up; The data backup of file-level mostly is the function that data backup software provides, for file or file are backed up.This patent concentrates on the data backup of file-level.
The data backup of file-level has 3 kinds of backup policy, full backup, differential backup and incremental backups substantially.In user's use scenes, the combination of common full backup and incremental backup, the efficiency of lifting incremental backup, can obviously shorten backup window, promotes overall backup rate.
The key point of incremental backup is to determine which file this increment need to back up, and determines the file changing.It can adopt traditional scan mode, but its sweep time can be long; Also can use the mode of archived bits, but need concrete file system to support.Based on this, now provide a kind of mode that changes file monitor that adopts to change determining of file, do not need file system support, improve the fast file backup method of versatility.
Summary of the invention
Technical assignment of the present invention is to solve the deficiencies in the prior art, provide a kind of mode that adopts initiatively monitoring to determine the file changing, incremental backup directly uses the variation listed files of record to carry out file backup, effectively shortened backup window, promoted backup efficiency, fast file backup method based on variation file monitor.
Technical scheme of the present invention realizes in the following manner, this kind of fast file backup method based on changing file monitor, and its specific implementation process is:
One, following four modules are set: file monitor module, listed files generation module, file path order module and file backup module, wherein
File monitor module, the file change of responsible monitoring assigned catalogue;
Listed files generation module, for file backup module generates the listed files that needs backup;
File path order module, the listed files that listed files generation module is generated sorts, identical to make the document order of backup and user carry out the order that file directory browses, so that carry out searching of backup file;
File backup module, its effect is that file is carried out to substantial backup;
Two, file backup module is called listed files generation module and carries out the generation of backup file list;
Three, the variation file path that listed files generation module file reading monitoring module monitors, and by these path transmissions to file path order module;
Four, file path order module sorts to the path that passes to it, and ranking results is returned to the listed files generation module of feeding;
Five, last, file backup module merges last backup file list and this, generates final backup file list, and carries out file backup according to this list.
Described file monitor module comprises the monitoring of WINDOWS system file, the monitoring of LINUX system file and unix system file monitor.
Described file backup module in one-time backup, each file of specifying in a backup file list
Described file backup process also comprises step 6, be the step that last backup file list and this backup file list merge: read successively in last backup file list with this backup file list in each path, and compare, get the final backup file list of less generation, if two paths are identical, get the final business part listed files of generation in this backup file list.
The detailed process of described step 6 is:
1) read the node A in last backup file list, if read error writes backup file list by this backup file list content;
2) read the node B in this backup file list, if read error is written to backup file list by last backup file list content;
3) compare path A and path B, if A=B writes A in backup file list, and repeat to enter step 1); If A < is B, A is write in backup list, and read the node A in last backup file list, if read error, this backup file list content is written in backup file list, if read correctly, repeat to enter comparison path A and path B; If A > is B, B write in backup list, and read the node B in this backup file list, if read error, last backup file list content is written to backup file list, if read correctly, repeats to enter comparison path A and path B.
The beneficial effect that the present invention compared with prior art produced is:
A kind of fast file backup method based on changing file monitor of the present invention adopts the mode of initiatively monitoring to determine the file changing, in the time carrying out incremental backup, directly backup file is monitored the file path intercepting, and save, file system is scanned to determine this process of file that needs backup, thereby shortening backup window, improve the efficiency of incremental backup, design the file path sort algorithm that is suitable for catalogue browsing, use this algorithm to backup file list sort, ensure that file path in backup file list order is the order while browsing step by step by catalogue, backup content indexing and backup content location are simplified, thereby reduce costs, practical, be easy to promote.
Brief description of the drawings
The structural drawing that accompanying drawing 1 is fast file backup method.
Accompanying drawing 2 is the sequential chart that while carrying out incremental backup, listed files merges.
Embodiment
Below in conjunction with accompanying drawing, a kind of fast file backup method based on changing file monitor of the present invention is described in detail below.
As shown in accompanying drawing 1, Fig. 2, a kind of fast file backup method based on changing file monitor is now provided, its specific implementation process is:
One, following four modules are set: file monitor module, listed files generation module, file path order module and file backup module, wherein
File monitor module, the file change of responsible monitoring assigned catalogue;
Listed files generation module, for file backup module generates the listed files that needs backup;
File path order module, the listed files that listed files generation module is generated sorts, identical to make the document order of backup and user carry out the order that file directory browses, so that carry out searching of backup file;
File backup module, its effect is that file is carried out to substantial backup;
Two, file backup module is called listed files generation module and carries out the generation of backup file list;
Three, the variation file path that listed files generation module file reading monitoring module monitors, and by these path transmissions to file path order module;
Four, file path order module sorts to the path that passes to it, and ranking results is returned to the listed files generation module of feeding;
Five, last, file backup module merges last backup file list and this, generates final backup file list, and carries out file backup according to this list.
Described file monitor module comprises the monitoring of WINDOWS system file, the monitoring of LINUX system file and unix system file monitor.
Described file backup module in one-time backup, each file of specifying in a backup file list.
Described file backup process also comprises step 6, the step that last backup file list and this backup file list merge.Why need last back-up list and this backup file list to merge, because should comprise the All Files information of user ID catalogue in backup file list, and in this backup file list, only have the information of increment part, therefore need synthetic with last time, to generate the All Files information of user ID catalogue.In Fig. 2, Catalog part is last backup file list, the backup file list that IncFileList is this.The content of this step is: read successively in last backup file list with this backup file list in each path, and compare, get the final backup file list of less generation, if two paths are identical, get the final business part listed files of generation in this backup file list.
The detailed process of described step 6 is:
1) read the node A in last backup file list, if read error writes backup file list by this backup file list content;
2) read the node B in this backup file list, if read error is written to backup file list by last backup file list content;
3) compare path A and path B, if A=B writes A in backup file list, and repeat to enter step 1); If A < is B, A is write in backup list, and read the node A in last backup file list, if read error, this backup file list content is written in backup file list, if read correctly, repeat to enter comparison path A and path B; If A > is B, B write in backup list, and read the node B in this backup file list, if read error, last backup file list content is written to backup file list, if read correctly, repeats to enter comparison path A and path B.
In the time carrying out concrete listed files sequence, adopt algorithm as in the table below to sort.Order when this algorithm has ensured that putting in order of file path is user and carries out catalogue browsing.
This algorithm ensures to sort according to directory tree, under same parent directory according to file front, the posterior order of file sorts, file or folder is similar to sort according to character order relatively time.
ret:-1?for?A<B,?0?for?A=B,?1?for?A>B.
/
int?PathCmp(char?*A,?char?*B){
int?i?=?0;
bool?isFolderNameA?=?false;
bool?isFolderNameB?=?false;
while(A[i]&&B[i]&&A[i]?==?B[i])i++;
IsFolderNameA=IsFolderName (A, i); // judge whether current location is in a Folder, for '/' special circumstances at last in folder, for ' 0 ' not very in folder
isFolderNameB?=?IsFolderName(B,?i);
if(isFolderNameA?==?isFolderNameB){
if(A[i]?==?‘/’)return?-1;
if(B[i]?==?‘/’)return?1;
return?A[i]?–?B[i];
}
if(!isFolderNameA)return?-1;
if(!isFolderNameB)return?1;
return?0;
}
Algorithm described in upper table is the algorithm in two paths of comparison, uses this algorithm to compare to the each path in backup file list, has completed sequence.
The foregoing is only embodiments of the invention, within the spirit and principles in the present invention all, any amendment of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (4)
1. the fast file backup method based on changing file monitor, is characterized in that its specific implementation process is:
One, following four modules are set: file monitor module, listed files generation module, file path order module and file backup module, wherein
File monitor module, the file change of responsible monitoring assigned catalogue;
Listed files generation module, for file backup module generates the listed files that needs backup;
File path order module, the listed files that listed files generation module is generated sorts, identical to make the document order of backup and user carry out the order that file directory browses, so that carry out searching of backup file;
File backup module, its effect is that file is carried out to substantial backup;
Two, file backup module is called listed files generation module and carries out the generation of backup file list;
Three, the variation file path that listed files generation module file reading monitoring module monitors, and by these path transmissions to file path order module;
Four, file path order module sorts to the path that passes to it, and ranking results is returned to the listed files generation module of feeding;
Five, last, file backup module merges last backup file list and this, generates final backup file list, and carries out file backup according to this list.
2. a kind of fast file backup method based on changing file monitor according to claim 1, is characterized in that: described file monitor module comprises the monitoring of WINDOWS system file, the monitoring of LINUX system file and unix system file monitor.
3. according to claim 1 a kind of based on changing the fast file backup method of file monitor, it is characterized in that: described file backup module in one-time backup, each file of specifying in a backup file list
According to arbitrary described a kind of fast file backup method based on changing file monitor in claim 1～3, it is characterized in that: described file backup process also comprises step 6, be the step that last backup file list and this backup file list merge: read successively in last backup file list with this backup file list in each path, and compare, get the final backup file list of less generation, if two paths are identical, get the final business part listed files of generation in this backup file list.
4. a kind of fast file backup method based on changing file monitor according to claim 4, is characterized in that: the detailed process of described step 6 is:
1) read the node A in last backup file list, if read error writes backup file list by this backup file list content;
2) read the node B in this backup file list, if read error is written to backup file list by last backup file list content;
3) compare path A and path B, if A=B writes A in backup file list, and repeat to enter step 1); If A < is B, A is write in backup list, and read the node A in last backup file list, if read error, this backup file list content is written in backup file list, if read correctly, repeat to enter comparison path A and path B; If A > is B, B write in backup list, and read the node B in this backup file list, if read error, last backup file list content is written to backup file list, if read correctly, repeats to enter comparison path A and path B.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410196549.2A CN103995757A (en) | 2014-05-12 | 2014-05-12 | Rapid file backup method based on changed file monitoring |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410196549.2A CN103995757A (en) | 2014-05-12 | 2014-05-12 | Rapid file backup method based on changed file monitoring |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103995757A true CN103995757A (en) | 2014-08-20 |
Family
ID=51309930
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410196549.2A Pending CN103995757A (en) | 2014-05-12 | 2014-05-12 | Rapid file backup method based on changed file monitoring |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103995757A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605586A (en) * | 2013-11-21 | 2014-02-26 | 浪潮电子信息产业股份有限公司 | Data recovery method for tape media |
| CN104714864A (en) * | 2015-03-20 | 2015-06-17 | 成都云祺科技有限公司 | Intelligent computer data backup method |
| CN107229538A (en) * | 2017-05-31 | 2017-10-03 | 广州鼎甲计算机科技有限公司 | A kind of method of file synthesis backup |
| CN108829544A (en) * | 2018-06-28 | 2018-11-16 | 北京金风科创风电设备有限公司 | Data storage method and equipment of wind generating set |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080235297A1 (en) * | 2007-03-22 | 2008-09-25 | Innerbus Co., Ltd. | Method for Indexing a Large Log File, Computer-Readable Medium for Storing a Program for Executing the Method, and System for Performing the Same |
| CN101833489A (en) * | 2010-05-06 | 2010-09-15 | 北京邮电大学 | Method for file real-time monitoring and intelligent backup |
| CN103678041A (en) * | 2013-12-11 | 2014-03-26 | 浪潮(北京)电子信息产业有限公司 | Incremental backup method and system |
| CN103713972A (en) * | 2014-01-02 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | Incremental backup system and method |
-
2014
- 2014-05-12 CN CN201410196549.2A patent/CN103995757A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080235297A1 (en) * | 2007-03-22 | 2008-09-25 | Innerbus Co., Ltd. | Method for Indexing a Large Log File, Computer-Readable Medium for Storing a Program for Executing the Method, and System for Performing the Same |
| CN101833489A (en) * | 2010-05-06 | 2010-09-15 | 北京邮电大学 | Method for file real-time monitoring and intelligent backup |
| CN103678041A (en) * | 2013-12-11 | 2014-03-26 | 浪潮(北京)电子信息产业有限公司 | Incremental backup method and system |
| CN103713972A (en) * | 2014-01-02 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | Incremental backup system and method |
Non-Patent Citations (2)
| Title |
|---|
| 刚红润: "用于大量文档管理的ShowMore文档管理器的设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
| 邱丽琴: "数据备份恢复系统中文件匹配方法设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605586A (en) * | 2013-11-21 | 2014-02-26 | 浪潮电子信息产业股份有限公司 | Data recovery method for tape media |
| CN104714864A (en) * | 2015-03-20 | 2015-06-17 | 成都云祺科技有限公司 | Intelligent computer data backup method |
| CN107229538A (en) * | 2017-05-31 | 2017-10-03 | 广州鼎甲计算机科技有限公司 | A kind of method of file synthesis backup |
| CN108829544A (en) * | 2018-06-28 | 2018-11-16 | 北京金风科创风电设备有限公司 | Data storage method and equipment of wind generating set |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8738668B2 (en) | System and method for creating a de-duplicated data set | |
| US11321291B2 (en) | Persistent version control for data transfer between heterogeneous data stores | |
| US10649980B2 (en) | Methods and systems for resilient, durable, scalable, and consistent distributed timeline data store | |
| CN111078667B (en) | Data migration method and related device | |
| US20140156671A1 (en) | Index Constructing Method, Search Method, Device and System | |
| CN103914458A (en) | Mass data migration method and device | |
| CN103995757A (en) | Rapid file backup method based on changed file monitoring | |
| CN105701190A (en) | Data synchronizing method and device | |
| US11294603B2 (en) | Sub-cluster recovery using a partition group index | |
| CN109298978B (en) | Recovery method and system for database cluster of specified position | |
| US11748215B2 (en) | Log management method, server, and database system | |
| US10409691B1 (en) | Linking backup files based on data partitions | |
| US8332678B1 (en) | Power save mode operation for continuous data protection | |
| CN101883135A (en) | Selective mirroring method | |
| US11221983B1 (en) | Multi-level indexing of backup files | |
| CN102779138A (en) | Hard disk access method of real time data | |
| CN102820998B (en) | Realize the dual computer fault-tolerant service system towards office application and date storage method thereof | |
| CN102799503A (en) | Recover method applied to large quantity of small files | |
| CN103176867A (en) | Fast file differential backup method | |
| CN105955989A (en) | Method for establishing master and slave servers of cloud platform database | |
| CN103176866A (en) | File permission back-up method applied in new technology file system (NTFS) | |
| CN105095102A (en) | Automatic expansion method and device for snapshot volume | |
| US11079960B2 (en) | Object storage system with priority meta object replication | |
| US8595271B1 (en) | Systems and methods for performing file system checks | |
| CN106383901A (en) | Method for unidirectional data synchronization between multiple data sources |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140820 |
|
| WD01 | Invention patent application deemed withdrawn after publication |