CN103713972A - Incremental backup system and method - Google Patents
Incremental backup system and method Download PDFInfo
- Publication number
- CN103713972A CN103713972A CN201410001140.0A CN201410001140A CN103713972A CN 103713972 A CN103713972 A CN 103713972A CN 201410001140 A CN201410001140 A CN 201410001140A CN 103713972 A CN103713972 A CN 103713972A
- Authority
- CN
- China
- Prior art keywords
- list
- change
- information
- backup
- variation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Provided are an incremental backup system and method. The method comprises the following steps of monitoring a backup path, and sending a change notice when the fact that contents of files or contents of catalogs are changed is monitored; recording the change information of the changed files or the changed catalogs, and generating a change list according to the change information, wherein the change list at least comprises one change item and the change item comprises corresponding change information; carrying out processing on information in the change list to enable the information in the change list to form a unified type, and carrying out corresponding backup and storage according to the processed change list. According to the technical scheme, backup efficiency can be improved.
Description
Technical field
The present invention relates to incremental backup technology, in particular to a kind of incremental backup system and method.
Background technology
According to IDC statistics, show, the U.S. occurred between 10 years in the company of data disaster before 2000, had 55% to close down at that time, and in remaining 45%, because loss of data has again 29% also to close down within 2 years, what survive only accounts for 16%.The company that has effective backup method and backup policy can drop to loss minimum.Therefore, the backup of data is brought into schedule.
Data backup for magnanimity, if all adopt the mode of full backup, not only can waste a large amount of space resources and also backup efficiency also very under, so what often adopt at present is the mode that full backup adds incremental backup, the efficiency of incremental backup directly has influence on whole standby system operational efficiency.
Traditional file level incremental backup need to carry out traversing operation for each file, and when data volume reaches millions, such backup efficiency is very low.
Summary of the invention
Await this, the technical matters that the embodiment of the present invention will solve is to provide a kind of incremental backup systems approach, to improve the efficiency of incremental backup.
In order to address the above problem, the embodiment of the present invention adopts following technical scheme:
An incremental backup system, this system, based on changing list, comprising: processor and storer, wherein, described processor comprises monitoring module, changes list generation module, changes list processing module and backup module, wherein:
Described monitoring module is arranged to: monitoring backup path, when monitoring the content alteration of file or catalogue, sends described in message informing and change the modification information that list generation module records change file or catalogue;
Described variation list generation and processing module are arranged to: record the modification information of change file or catalogue, and generate and change list according to modification information; Or in the variation list having generated, increase new change entry; Wherein, described variation list at least comprises a change entry, and this change entry comprises corresponding modification information;
Described variation list information processing module is arranged to: the information changing in list is processed, so that the information changing in list forms unified form;
Described backup module is arranged to: according to the variation list after described variation list processing module is processed, back up accordingly;
Described storer is arranged to: backup information and variation list are stored.
Alternatively, described backup module is also arranged to: after backup completes, notify described variation list generation and processing module that the respective change list information before BACKUP TIME point is deleted, while avoiding back up next time, cause Backup Data to repeat.
Alternatively, described modification information at least comprises alternative routing, temporal information and change type.
Alternatively, described variation list processing module is arranged in the following manner the information changing in list be processed:
The filename that changes the short path form in list is all converted to the filename of long path form;
All convert the temporal information that does not meet predetermined form in variation list to default time form; And/or
By changing change type in list, convert default change type form to.
Alternatively, described backup module is arranged to according to the variation list after described variation list processing module is processed, back up accordingly in the following manner:
According to temporal information, from described variation list, extract this time point information before, according to change type, alternative routing is carried out to corresponding backup operation.
An incremental backup method, the method, based on changing list, comprises the steps:
Monitoring backup path, when monitoring the content alteration of file or catalogue, sends Notification of Changes;
Record the modification information of change file or catalogue, and generate and change list according to modification information; Described variation list at least comprises a change entry, and this change entry comprises corresponding modification information;
The information changing in list is processed, so that the information changing in list forms unified form;
According to variation list after treatment, back up accordingly and store.
Alternatively, the method also comprises: after backup completes, the respective change list information before BACKUP TIME point is deleted, while avoiding back up next time, caused Backup Data to repeat.
Alternatively, the method also comprises: generate and change after list, if while monitoring the content alteration of new file or catalogue, record the modification information of change file or catalogue, and according to modification information, in the variation list generating, increase corresponding change entry.
Alternatively, described modification information at least comprises alternative routing, temporal information and change type.
Alternatively, the step of the information changing in list being processed comprises:
The filename that changes the short path form in list is all converted to the filename of long path form;
All convert the temporal information that does not meet predetermined form in variation list to default time form; And/or
By changing change type in list, convert default change type form to.
Alternatively, according to variation list after treatment, carrying out the corresponding step backing up comprises:
According to temporal information, from change list, extract this time point information before, according to change type, alternative routing is carried out to corresponding backup operation.
Technique scheme adopts the incremental backup method of file change list, adopt the mode of real time record file change information to carry out record to carrying out the file of incremental backup, when carrying out incremental backup, do not need whole backup directory to travel through, greatly improved the execution efficiency of incremental backup.
Accompanying drawing explanation
Fig. 1 is the incremental backup process flow diagram based on changing list of the embodiment of the present invention;
Fig. 2 is the incremental backup system construction drawing based on changing list of the embodiment of the present invention.
Embodiment
Below in conjunction with drawings and Examples, technical scheme of the present invention is described in detail.
It should be noted that, if do not conflicted, each feature in the embodiment of the present invention and embodiment can mutually combine, all within protection scope of the present invention.In addition, although there is shown logical order in flow process, in some cases, can carry out shown or described step with the order being different from herein.
A kind of incremental backup method based on changing list of the embodiment of the present invention, as shown in Figure 1, comprises the steps:
Alternatively, the method also comprises: after backup completes, the respective change list information before BACKUP TIME point is deleted, while avoiding back up next time, caused Backup Data to repeat.
Alternatively, the method also comprises: generate and change after list, if while monitoring the content alteration of new file or catalogue, record the modification information of change file or catalogue, and according to modification information, in the variation list generating, increase corresponding change entry.
Alternatively, modification information at least comprises alternative routing, temporal information and change type.
Alternatively, that described change type comprises is newly-built, modification, rename etc., does not comprise deletion action information, because deletion action representing this path and do not existing, when backup, naturally can not back up, record deletion operation information is nonsensical for backup procedure.
Alternatively, described variation list at least comprises a change entry, and this change entry comprises corresponding modification information.
Alternatively, the step of the information changing in list being processed comprises:
The filename that changes the short path form in list is all converted to the filename of long path form;
All convert the temporal information that does not meet predetermined form in variation list to default time form; And/or
By changing change type in list, convert default change type form to.
Alternatively, according to variation list after treatment, carrying out the corresponding step backing up comprises:
According to temporal information, from change list, extract this time point information before, according to change type, alternative routing is carried out to corresponding backup operation.
Practice shows, when such scheme is used for large-data documents incremental backup, can significantly improve backup efficiency, saves BACKUP TIME.
The incremental backup system based on changing list of the embodiment of the present invention, as shown in Figure 2, comprising: processor 21 and storer 22, wherein, processor 21 comprises monitoring module 211, changes list generation module 212, changes list processing module 213 and backup module 214, wherein:
Monitoring module 211 is arranged to: monitoring backup path, when monitoring the content alteration of file or catalogue, sends message informing and change the modification information that list generation module 212 records change file or catalogue.
Changing list generation and processing module 212 is arranged to: record the modification information of change file or catalogue, and generate and change list according to modification information; Or in the variation list having generated, increase new change entry.
Changing list information processing module 213 is arranged to: the information changing in list is processed, so that the information changing in list forms unified form.
Backup module 214 is arranged to: according to backing up accordingly through the variation list changing after list processing module 213 is processed, and after backup completes, notify variation list generation and processing module 212 that the respective change list information before BACKUP TIME point is deleted, while avoiding back up next time, cause Backup Data repetition.
Described storer 22 is arranged to: backup information and variation list are stored.
Alternatively, modification information at least comprises alternative routing, temporal information and change type.
Alternatively, that described change type comprises is newly-built, modification, rename etc., does not comprise deletion action information, because deletion action representing this path and do not existing, when backup, naturally can not back up, record deletion operation information is nonsensical for backup procedure.
Alternatively, described variation list at least comprises a change entry, and this change entry comprises corresponding modification information.
Alternatively, changing list processing module 213 is arranged in the following manner the information changing in list be processed:
The filename that changes the short path form in list is all converted to the filename of long path form;
All convert the temporal information that does not meet predetermined form in variation list to default time form; And/or
By changing change type in list, convert default change type form to.
Alternatively, described backup module 214 is arranged in the following manner according to backing up accordingly through the variation list changing after list processing module 213 is processed:
According to temporal information, from change list, extract this time point information before, according to change type, alternative routing is carried out to corresponding backup operation.
One of ordinary skill in the art will appreciate that all or part of step in said method can come instruction related hardware to complete by program, described program can be stored in computer-readable recording medium, as ROM (read-only memory), disk or CD etc.Alternatively, all or part of step of above-described embodiment also can realize with one or more integrated circuit.Correspondingly, each the module/unit in above-described embodiment can adopt the form of hardware to realize, and also can adopt the form of software function module to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
Certainly; the present invention also can have other various embodiments; in the situation that not deviating from spirit of the present invention and essence thereof; those of ordinary skill in the art are when making according to the present invention various corresponding changes and distortion, but these corresponding changes and distortion all should belong to the protection domain of claim of the present invention.
Claims (11)
1. an incremental backup system, is characterized in that, this system, based on changing list, comprising: processor and storer, and wherein, described processor comprises monitoring module, changes list generation module, changes list processing module and backup module, wherein:
Described monitoring module is arranged to: monitoring backup path, when monitoring the content alteration of file or catalogue, sends described in message informing and change the modification information that list generation module records change file or catalogue;
Described variation list generation and processing module are arranged to: record the modification information of change file or catalogue, and generate and change list according to modification information; Or in the variation list having generated, increase new change entry; Wherein, described variation list at least comprises a change entry, and this change entry comprises corresponding modification information;
Described variation list information processing module is arranged to: the information changing in list is processed, so that the information changing in list forms unified form;
Described backup module is arranged to: according to the variation list after described variation list processing module is processed, back up accordingly;
Described storer is arranged to: backup information and variation list are stored.
2. the system as claimed in claim 1, it is characterized in that, described backup module is also arranged to: after backup completes, notify described variation list generation and processing module that the respective change list information before BACKUP TIME point is deleted, while avoiding back up next time, cause Backup Data to repeat.
3. system as claimed in claim 1 or 2, is characterized in that, described modification information at least comprises alternative routing, temporal information and change type.
4. system as claimed in claim 3, is characterized in that, described variation list processing module is arranged in the following manner the information changing in list be processed:
The filename that changes the short path form in list is all converted to the filename of long path form;
All convert the temporal information that does not meet predetermined form in variation list to default time form; And/or
By changing change type in list, convert default change type form to.
5. system as claimed in claim 3, is characterized in that, described backup module is arranged to according to the variation list after described variation list processing module is processed, back up accordingly in the following manner:
According to temporal information, from described variation list, extract this time point information before, according to change type, alternative routing is carried out to corresponding backup operation.
6. an incremental backup method, is characterized in that, the method, based on changing list, comprises the steps:
Monitoring backup path, when monitoring the content alteration of file or catalogue, sends Notification of Changes;
Record the modification information of change file or catalogue, and generate and change list according to modification information; Described variation list at least comprises a change entry, and this change entry comprises corresponding modification information;
The information changing in list is processed, so that the information changing in list forms unified form;
According to variation list after treatment, back up accordingly and store.
7. method as claimed in claim 6, is characterized in that, the method also comprises: after backup completes, the respective change list information before BACKUP TIME point is deleted, while avoiding back up next time, caused Backup Data to repeat.
8. method as claimed in claim 6, it is characterized in that, the method also comprises: generate and change after list, if while monitoring the content alteration of new file or catalogue, record the modification information of change file or catalogue, and according to modification information, in the variation list generating, increase corresponding change entry.
9. the method as described in any one in claim 6-8, is characterized in that, described modification information at least comprises alternative routing, temporal information and change type.
10. method as claimed in claim 9, is characterized in that, the step that the information changing in list is processed comprises:
The filename that changes the short path form in list is all converted to the filename of long path form;
All convert the temporal information that does not meet predetermined form in variation list to default time form; And/or
By changing change type in list, convert default change type form to.
11. methods as claimed in claim 9, is characterized in that, the step of carrying out corresponding backup according to variation list after treatment comprises:
According to temporal information, from change list, extract this time point information before, according to change type, alternative routing is carried out to corresponding backup operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001140.0A CN103713972B (en) | 2014-01-02 | 2014-01-02 | A kind of incremental backup system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001140.0A CN103713972B (en) | 2014-01-02 | 2014-01-02 | A kind of incremental backup system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103713972A true CN103713972A (en) | 2014-04-09 |
| CN103713972B CN103713972B (en) | 2017-03-08 |
Family
ID=50406973
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410001140.0A Active CN103713972B (en) | 2014-01-02 | 2014-01-02 | A kind of incremental backup system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103713972B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103995757A (en) * | 2014-05-12 | 2014-08-20 | 浪潮电子信息产业股份有限公司 | Rapid file backup method based on changed file monitoring |
| CN105376277A (en) * | 2014-08-25 | 2016-03-02 | Tcl集团股份有限公司 | Data synchronization method and device |
| CN106155841A (en) * | 2016-06-24 | 2016-11-23 | 乐视控股（北京）有限公司 | The method and system of data backup |
| CN106293993A (en) * | 2015-05-13 | 2017-01-04 | 北大方正集团有限公司 | Avoid the method and device repeating to process file |
| CN106874143A (en) * | 2015-12-14 | 2017-06-20 | 财团法人工业技术研究院 | Server backup method and backup system thereof |
| CN110651258A (en) * | 2017-08-29 | 2020-01-03 | 李晧准 | Automatic backup device based on real-time file change detection |
| CN111881095A (en) * | 2020-07-29 | 2020-11-03 | 天津中新智冠信息技术有限公司 | File change processing method and device, storage medium and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6088694A (en) * | 1998-03-31 | 2000-07-11 | International Business Machines Corporation | Continuous availability and efficient backup for externally referenced objects |
| CN101770484A (en) * | 2008-12-31 | 2010-07-07 | 北大方正集团有限公司 | Method and system for network upgrade real-time release |
| CN101833489A (en) * | 2010-05-06 | 2010-09-15 | 北京邮电大学 | Method for file real-time monitoring and intelligent backup |
| CN101968747A (en) * | 2010-09-17 | 2011-02-09 | 中国科学院计算技术研究所 | Cluster application management system and application management method thereof |
| CN103129125A (en) * | 2011-11-30 | 2013-06-05 | 北大方正集团有限公司 | Method and device for catalogue monitoring |
| CN103678041A (en) * | 2013-12-11 | 2014-03-26 | 浪潮(北京)电子信息产业有限公司 | Incremental backup method and system |
-
2014
- 2014-01-02 CN CN201410001140.0A patent/CN103713972B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6088694A (en) * | 1998-03-31 | 2000-07-11 | International Business Machines Corporation | Continuous availability and efficient backup for externally referenced objects |
| CN101770484A (en) * | 2008-12-31 | 2010-07-07 | 北大方正集团有限公司 | Method and system for network upgrade real-time release |
| CN101833489A (en) * | 2010-05-06 | 2010-09-15 | 北京邮电大学 | Method for file real-time monitoring and intelligent backup |
| CN101968747A (en) * | 2010-09-17 | 2011-02-09 | 中国科学院计算技术研究所 | Cluster application management system and application management method thereof |
| CN103129125A (en) * | 2011-11-30 | 2013-06-05 | 北大方正集团有限公司 | Method and device for catalogue monitoring |
| CN103678041A (en) * | 2013-12-11 | 2014-03-26 | 浪潮(北京)电子信息产业有限公司 | Incremental backup method and system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103995757A (en) * | 2014-05-12 | 2014-08-20 | 浪潮电子信息产业股份有限公司 | Rapid file backup method based on changed file monitoring |
| CN105376277A (en) * | 2014-08-25 | 2016-03-02 | Tcl集团股份有限公司 | Data synchronization method and device |
| CN106293993A (en) * | 2015-05-13 | 2017-01-04 | 北大方正集团有限公司 | Avoid the method and device repeating to process file |
| CN106874143A (en) * | 2015-12-14 | 2017-06-20 | 财团法人工业技术研究院 | Server backup method and backup system thereof |
| CN106874143B (en) * | 2015-12-14 | 2020-01-07 | 财团法人工业技术研究院 | Server backup method and backup system thereof |
| CN106155841A (en) * | 2016-06-24 | 2016-11-23 | 乐视控股（北京）有限公司 | The method and system of data backup |
| CN110651258A (en) * | 2017-08-29 | 2020-01-03 | 李晧准 | Automatic backup device based on real-time file change detection |
| CN111881095A (en) * | 2020-07-29 | 2020-11-03 | 天津中新智冠信息技术有限公司 | File change processing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103713972B (en) | 2017-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103713972A (en) | Incremental backup system and method | |
| CN103119550B (en) | Store the digital content with time-varying characteristics | |
| US8418003B2 (en) | Log collecting apparatus, program, method, and system | |
| CN102970158B (en) | Log storage and processing method and log server | |
| CN101577735B (en) | Method, device and system for taking over fault metadata server | |
| CN102902762B (en) | A kind of methods, devices and systems of deleting duplicated data | |
| CN105049260B (en) | Blog management method and device | |
| CN101430691A (en) | System and method for exporting data directly from deduplication storage to non-deduplication storage | |
| CN104679772A (en) | Method, device, equipment and system for deleting files in distributed data warehouse | |
| CN102231137B (en) | Data memory system and method | |
| SG181959A1 (en) | System event logging system | |
| CN104407940A (en) | Method for quickly recovering CDP system | |
| CN107402870A (en) | The processing method and processing device of daily record section in a kind of meta data server | |
| CN102331956A (en) | User data backup method and device | |
| CN103136370A (en) | Restoring method of meta data and device | |
| CN102799503A (en) | Recover method applied to large quantity of small files | |
| CN104965835A (en) | Method and apparatus for reading and writing files of a distributed file system | |
| CN112486918B (en) | File processing method, device, equipment and medium | |
| CN105159820A (en) | Transmission method and device of system log data | |
| CN103678041A (en) | Incremental backup method and system | |
| CN103176867A (en) | Fast file differential backup method | |
| CN103207916B (en) | The method and apparatus of metadata processing | |
| CN103973486A (en) | Log management system based on B/S structure | |
| CN103440204A (en) | Method for updating file system and storage device | |
| CN103714179A (en) | Multi-language supporting method and system for system blog |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |