CN103678041A - Incremental backup method and system - Google Patents
Incremental backup method and system Download PDFInfo
- Publication number
- CN103678041A CN103678041A CN201310680320.1A CN201310680320A CN103678041A CN 103678041 A CN103678041 A CN 103678041A CN 201310680320 A CN201310680320 A CN 201310680320A CN 103678041 A CN103678041 A CN 103678041A
- Authority
- CN
- China
- Prior art keywords
- backup
- module
- file
- modification information
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides an incremental backup method which is applied to the technical field of data backup. The incremental backup method includes the following steps that a directory monitoring management module adds a backup directory to be monitored and obtains change information when files or the directory changes; a change information processing module uniformly processes the change information and obtains a processing result; a database recording module sets up a file change list according to the obtained processing result; a file backup module extracts information before the backup time point from the file change list according to the backup time point and conducts corresponding backup operation on a route according to the change type. By means of the technical scheme, the whole backup directory does not need to be traversed when the incremental backup is executed, and executing efficiency of the incremental backup is greatly improved.
Description
Technical field
The present invention relates to technology of data copy field, relate in particular to a kind of incremental backup method and system.
Background technology
According to IDC statistics, show, the U.S. occurred between 10 years in the company of data disaster before 2000, had 55% to close down at that time, and in remaining 45%, because loss of data has again 29% also to close down within 2 years, what survive only accounts for 16%.The company that has effective backup method and backup policy can drop to loss minimum.Therefore, the backup of data is brought into schedule.Data backup for magnanimity, if all adopt the mode of full backup, not only can waste a large amount of space resources and also backup efficiency also very under, so what often adopt at present is the mode that full backup adds incremental backup, the efficiency of incremental backup directly has influence on whole standby system operational efficiency.
Traditional file level incremental backup need to carry out traversing operation for each file, and when data volume reaches millions, such backup efficiency is very low.
Summary of the invention
The invention provides a kind of incremental backup method and system, to address the above problem.
The invention provides a kind of incremental backup method.Said method comprises the following steps:
Catalogue monitoring management module is added backup directory in monitoring to, and when file or catalogue variation, catalogue monitoring management module obtains modification information;
Modification information processing module is unified to process to described modification information, obtains result;
Data-base recording module, according to the described result of obtaining, is set up file change list;
File backup module, according to BACKUP TIME point, is extracted described BACKUP TIME point information before from file change list, in conjunction with change type, corresponding backup operation is carried out in path.
The present invention also provides a kind of incremental backup system, comprising: catalogue monitoring management module 1, modification information processing module 2, data-base recording module 3, file backup module 4; Catalogue monitoring management module 1 is connected with data-base recording module 3 by modification information processing module 2; Modification information processing module 2 is connected with file backup module 4 by data-base recording module 3;
Catalogue monitoring management module 1, adds, removes monitored directory for being responsible for, and obtains modification information and notifies 2 pairs of modification informations of modification information processing module to process;
Modification information processing module 2, unifies to process to described modification information for being responsible for, and comprising: short path is converted to long path, and acquisition time information, resolves change type;
Data-base recording module 3, for according to the result of modification information processing module 2 outputs of obtaining, sets up and storage file variation list;
File backup module 4 for the file change list of obtaining from data-base recording module 3, is extracted this time point information before from file change list according to BACKUP TIME point, according to change type, corresponding backup operation is carried out in path.
The present invention adopts the incremental backup method of file change list, adopt the mode of real time record file change information to carry out record to carrying out the file of incremental backup, when carrying out incremental backup, do not need whole backup directory to travel through, greatly improved the execution efficiency of incremental backup.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms the application's a part, and schematic description and description of the present invention is used for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Figure 1 shows that the incremental backup process flow diagram of the file change list of the embodiment of the present invention 1;
Figure 2 shows that the incremental backup system construction drawing of the file change list of the embodiment of the present invention 2.
Embodiment
Hereinafter with reference to accompanying drawing, also describe the present invention in detail in conjunction with the embodiments.It should be noted that, in the situation that not conflicting, embodiment and the feature in embodiment in the application can combine mutually.
The invention provides a kind of incremental backup method, comprise the following steps:
Catalogue monitoring management module is added backup directory in monitoring to, and when file or catalogue variation, catalogue monitoring management module obtains modification information;
Modification information processing module is unified to process to described modification information, obtains result;
Data-base recording module, according to the described result of obtaining, is set up file change list;
File backup module, according to BACKUP TIME point, is extracted described BACKUP TIME point information before from file change list, in conjunction with change type, corresponding backup operation is carried out in path.
Wherein, catalogue monitoring management module is added backup directory in monitoring to, when file or catalogue variation, after catalogue monitoring management module obtains modification information, also comprise: notice modification information processing module is processed described modification information, wherein, in described notice, carry described modification information.
Wherein, modification information processing module is unified to process to described modification information, the process that obtains result is: modification information processing module is unified to process to described modification information, comprise: short path is converted to long path, acquisition time information, resolve change type, obtain result; Wherein, described change type comprises newly-built, modification, rename.
Wherein, data-base recording module is according to the described result of obtaining, and the process of setting up file change list is: data-base recording module, according to the result of the modification information processing module output of obtaining, is set up also storage file and changed list.
Wherein, data-base recording module 3 is stored change information by setting up the table of three fields, and three fields are respectively time point, absolute path, change type.
Wherein, file backup module, according to BACKUP TIME point, is extracted described BACKUP TIME point information before from file change list, and the process of corresponding backup operation being carried out in path in conjunction with change type is:
File backup module, according to the file change list of obtaining from data-base recording module, is extracted this time point information before from file change list according to BACKUP TIME point, in conjunction with change type, corresponding backup operation is carried out in path.
The core technology point of the embodiment of the present invention is:
Catalogue monitoring management module 1 is added backup directory in monitoring to; When file or catalogue variation, catalogue monitoring management module 1 obtains modification information and also notifies 2 pairs of described modification informations of modification information processing module to process, and wherein, carries described modification information in described notice; Main being responsible for of modification information processing module 2 unifies to process (comprising: short path is converted to long path, and acquisition time information, resolves change type) to modification information, obtains result; Data-base recording module 3, according to the result of modification information processing module 2 outputs of obtaining, is set up and storage file variation list; File backup module 4, according to the file change list of obtaining from data-base recording module 3, is extracted this time point information before from file change list according to BACKUP TIME point, according to change type, corresponding backup operation is carried out in path.
The incremental backup process flow diagram that Figure 1 shows that the file change list of the embodiment of the present invention 1, is described as follows:
Step 101: catalogue monitoring management module 1 is added backup directory in monitoring to;
Step 102: when file or catalogue variation, catalogue monitoring management module 1 obtains modification information and also notifies 2 pairs of described modification informations of modification information processing module to process, and obtains result;
Step 103: data-base recording module 3, according to the result of modification information processing module 2 outputs of obtaining, is set up and storage file variation list;
Step 104: file backup module 4, according to the file change list and the BACKUP TIME point that obtain from data-base recording module 3, is carried out incremental backup to backup directory.
The incremental backup system construction drawing that Figure 2 shows that the file change list of the embodiment of the present invention 2, comprising: catalogue monitoring management module 1, modification information processing module 2, data-base recording module 3, file backup module 4; Catalogue monitoring management module 1 is connected with data-base recording module 3 by modification information processing module 2; Modification information processing module 2 is connected with file backup module 4 by data-base recording module 3.
Wherein: catalogue monitoring management module 1 is responsible for adding, removing monitored directory, obtain modification information and notify 2 pairs of modification informations of modification information processing module to process; Wherein, in described notice, carry described modification information;
Main being responsible for of modification information processing module 2 unifies to process to described modification information, comprising: short path is converted to long path, and acquisition time information, resolves change type;
Wherein, that described change type comprises is newly-built, modification, rename, does not comprise deletion action information, because deletion action is representing this path, does not exist, and when backup, naturally can not back up, and record deletion operation information is nonsensical for backup procedure.
Wherein, the modification information obtaining is unified to process, in modification information, exist length path to be mingled with, the skimble-scamble situation of change type, modification information processing module 2 need to be converted to short path in long path and change type is unified into preset value.
Data-base recording module 3, according to the result of modification information processing module 2 outputs of obtaining, is set up and storage file variation list; Data-base recording module 3 is storage mediums of file change list, adopts as databases such as ACCESS, SQLite, sets up the table of three fields change information is stored, and three fields are respectively time point, absolute path, change type;
The file change list that file backup module 4 is obtained from data-base recording module 3, according to BACKUP TIME point, from file change list, extract this time point information before, according to change type, corresponding backup operation is carried out in path, after completing backup, notification database logging modle 3 is deleted the file change list information before BACKUP TIME point, causes Backup Data to repeat while avoiding next backup.
Wherein, the mode of backup comprises: as back up to disk, USB flash disk, network drive etc., when backup completes, need notification database logging modle 3 that the file change list information before backup point is removed.
The present invention also provides a kind of incremental backup system, comprising: catalogue monitoring management module 1, modification information processing module 2, data-base recording module 3, file backup module 4; Catalogue monitoring management module 1 is connected with data-base recording module 3 by modification information processing module 2; Modification information processing module 2 is connected with file backup module 4 by data-base recording module 3;
Catalogue monitoring management module 1, adds, removes monitored directory for being responsible for, and obtains modification information and notifies 2 pairs of modification informations of modification information processing module to process;
Modification information processing module 2, unifies to process to described modification information for being responsible for, and comprising: short path is converted to long path, and acquisition time information, resolves change type;
Data-base recording module 3, for according to the result of modification information processing module 2 outputs of obtaining, sets up and storage file variation list;
File backup module 4 for the file change list of obtaining from data-base recording module 3, is extracted this time point information before from file change list according to BACKUP TIME point, according to change type, corresponding backup operation is carried out in path.
Wherein, described data-base recording module 3, also for: by setting up the table of three fields, change information is stored, three fields are respectively time point, absolute path, change type.
The present invention adopts the incremental backup method of file change list, adopt the mode of real time record file change information to carry out record to carrying out the file of incremental backup, when carrying out incremental backup, do not need whole backup directory to travel through, greatly improved the execution efficiency of incremental backup
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (8)
1. an incremental backup method, is characterized in that, comprises the following steps:
Catalogue monitoring management module is added backup directory in monitoring to, and when file or catalogue variation, catalogue monitoring management module obtains modification information;
Modification information processing module is unified to process to described modification information, obtains result;
Data-base recording module, according to the described result of obtaining, is set up file change list;
File backup module, according to BACKUP TIME point, is extracted described BACKUP TIME point information before from file change list, in conjunction with change type, corresponding backup operation is carried out in path.
2. method according to claim 1, it is characterized in that: catalogue monitoring management module is added backup directory in monitoring to, when file or catalogue variation, after catalogue monitoring management module obtains modification information, also comprise: notice modification information processing module is processed described modification information, wherein, in described notice, carry described modification information.
3. method according to claim 2, it is characterized in that: modification information processing module is unified to process to described modification information, the process that obtains result is: modification information processing module is unified to process to described modification information, comprise: short path is converted to long path, acquisition time information, resolve change type, obtain result; Wherein, described change type comprises newly-built, modification, rename.
4. method according to claim 3, it is characterized in that: data-base recording module is according to the described result of obtaining, the process of setting up file change list is: data-base recording module, according to the result of the modification information processing module output of obtaining, is set up and storage file variation list.
5. method according to claim 4, is characterized in that: data-base recording module 3 is stored change information by setting up the table of three fields, and three fields are respectively time point, absolute path, change type.
6. method according to claim 5, is characterized in that: file backup module is according to BACKUP TIME point, extracts the information before described BACKUP TIME point from file change list, and the process of corresponding backup operation being carried out in path in conjunction with change type is:
File backup module, according to the file change list of obtaining from data-base recording module, is extracted this time point information before from file change list according to BACKUP TIME point, in conjunction with change type, corresponding backup operation is carried out in path.
7. an incremental backup system, is characterized in that, comprising: catalogue monitoring management module 1, modification information processing module 2, data-base recording module 3, file backup module 4; Catalogue monitoring management module 1 is connected with data-base recording module 3 by modification information processing module 2; Modification information processing module 2 is connected with file backup module 4 by data-base recording module 3;
Catalogue monitoring management module 1, adds, removes monitored directory for being responsible for, and obtains modification information and notifies 2 pairs of modification informations of modification information processing module to process;
Modification information processing module 2, unifies to process to described modification information for being responsible for, and comprising: short path is converted to long path, and acquisition time information, resolves change type;
Data-base recording module 3, for according to the result of modification information processing module 2 outputs of obtaining, sets up and storage file variation list;
File backup module 4 for the file change list of obtaining from data-base recording module 3, is extracted this time point information before from file change list according to BACKUP TIME point, according to change type, corresponding backup operation is carried out in path.
8. system according to claim 7, is characterized in that: described data-base recording module 3, also for: by setting up the table of three fields, change information is stored, three fields are respectively time point, absolute path, change type.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310680320.1A CN103678041A (en) | 2013-12-11 | 2013-12-11 | Incremental backup method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310680320.1A CN103678041A (en) | 2013-12-11 | 2013-12-11 | Incremental backup method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103678041A true CN103678041A (en) | 2014-03-26 |
Family
ID=50315686
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310680320.1A Pending CN103678041A (en) | 2013-12-11 | 2013-12-11 | Incremental backup method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103678041A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103713972A (en) * | 2014-01-02 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | Incremental backup system and method |
| CN103995757A (en) * | 2014-05-12 | 2014-08-20 | 浪潮电子信息产业股份有限公司 | Fast file backup method based on changed file monitoring |
| CN108647317A (en) * | 2018-05-10 | 2018-10-12 | 东软集团股份有限公司 | Generation method, device and the storage medium and electronic equipment of delta file |
| CN115543695A (en) * | 2022-11-29 | 2022-12-30 | 苏州浪潮智能科技有限公司 | Data backup method and device, electronic equipment and storage medium |
| CN116610501A (en) * | 2023-07-20 | 2023-08-18 | 深圳市科力锐科技有限公司 | NAS data reduction method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6088694A (en) * | 1998-03-31 | 2000-07-11 | International Business Machines Corporation | Continuous availability and efficient backup for externally referenced objects |
| CN101477486A (en) * | 2009-01-22 | 2009-07-08 | 中国人民解放军国防科学技术大学 | File backup recovery method based on sector recombination |
| CN101833489A (en) * | 2010-05-06 | 2010-09-15 | 北京邮电大学 | Method for file real-time monitoring and intelligent backup |
-
2013
- 2013-12-11 CN CN201310680320.1A patent/CN103678041A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6088694A (en) * | 1998-03-31 | 2000-07-11 | International Business Machines Corporation | Continuous availability and efficient backup for externally referenced objects |
| CN101477486A (en) * | 2009-01-22 | 2009-07-08 | 中国人民解放军国防科学技术大学 | File backup recovery method based on sector recombination |
| CN101833489A (en) * | 2010-05-06 | 2010-09-15 | 北京邮电大学 | Method for file real-time monitoring and intelligent backup |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103713972A (en) * | 2014-01-02 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | Incremental backup system and method |
| CN103713972B (en) * | 2014-01-02 | 2017-03-08 | 浪潮(北京)电子信息产业有限公司 | A kind of incremental backup system and method |
| CN103995757A (en) * | 2014-05-12 | 2014-08-20 | 浪潮电子信息产业股份有限公司 | Fast file backup method based on changed file monitoring |
| CN108647317A (en) * | 2018-05-10 | 2018-10-12 | 东软集团股份有限公司 | Generation method, device and the storage medium and electronic equipment of delta file |
| CN115543695A (en) * | 2022-11-29 | 2022-12-30 | 苏州浪潮智能科技有限公司 | Data backup method and device, electronic equipment and storage medium |
| CN115543695B (en) * | 2022-11-29 | 2023-08-15 | 苏州浪潮智能科技有限公司 | Data backup method and device, electronic equipment and storage medium |
| CN116610501A (en) * | 2023-07-20 | 2023-08-18 | 深圳市科力锐科技有限公司 | NAS data reduction method, device, equipment and storage medium |
| CN116610501B (en) * | 2023-07-20 | 2024-05-14 | 深圳市科力锐科技有限公司 | NAS data reduction method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109034993B (en) | Account checking method, account checking equipment, account checking system and computer readable storage medium | |
| CN106339274B (en) | A kind of method and system that data snapshot obtains | |
| CN102693305B (en) | A kind of fileinfo method for previewing and system | |
| CN103678041A (en) | Incremental backup method and system | |
| CN105049260B (en) | Blog management method and device | |
| CN104239443B (en) | A kind of storage method of serialized data operation log | |
| CN103761165B (en) | Log backup method and device | |
| CN101430691A (en) | System and method for exporting data directly from deduplication storage to non-deduplication storage | |
| US20130227237A1 (en) | Data management system and data management method | |
| CN104090889A (en) | Method and system for data processing | |
| CN103713972B (en) | A kind of incremental backup system and method | |
| US20140156603A1 (en) | Method and an apparatus for splitting and recovering data in a power system | |
| CN102609462A (en) | Method for compressed storage of massive SQL (structured query language) by means of extracting SQL models | |
| CN108228664B (en) | Unstructured data processing method and device | |
| US8838615B2 (en) | Computer implemented method for automatically managing stored checkpoint data | |
| CN103744875A (en) | Data rapid transferring method and system based on file system | |
| CN107273449B (en) | Breakpoint processing method and system based on memory database | |
| CN109902070B (en) | WiFi log data-oriented analysis storage search method | |
| Murugesan et al. | Audit log management in MongoDB | |
| CN104778252A (en) | Index storage method and index storage device | |
| CN104915376A (en) | Cloud storage file archiving and compressing method | |
| WO2018019310A1 (en) | Big data system data backup and recovery methods and devices, and computer storage medium | |
| CN104615948A (en) | Method for automatically recognizing file completeness and restoring | |
| CN102684928B (en) | The method and apparatus of a kind of service backup and recovery | |
| CN106919574B (en) | Method for processing remote synchronous file in real time |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140326 |
|
| WD01 | Invention patent application deemed withdrawn after publication |