CN102521075A - Fast and reliable file incremental backup method - Google Patents
Fast and reliable file incremental backup method Download PDFInfo
- Publication number
- CN102521075A CN102521075A CN2011103925208A CN201110392520A CN102521075A CN 102521075 A CN102521075 A CN 102521075A CN 2011103925208 A CN2011103925208 A CN 2011103925208A CN 201110392520 A CN201110392520 A CN 201110392520A CN 102521075 A CN102521075 A CN 102521075A
- Authority
- CN
- China
- Prior art keywords
- file
- incremental backup
- backup
- journal
- remote storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a fast and reliable file incremental backup method. A system comprises a file incremental backup application system, a file filter driving system and a long-distance storage system. The file incremental backup application system is a main carrier for achieving a strategy, is responsible for scheduling and making the file filter driving system and the long-distance storage system coordinate with each other and comprises rule setting and strategy achieving, the file filter driving system is a core achieving module of the method and is responsible for intercepting generation of change information and log files of files in a file system, and the long-distance storage system is responsible for storing log file information of file changes.
Description
Technical field
The present invention relates to a kind of Computer Applied Technology field, specifically a kind of rapid and reliable file incremental backup method.
Background technology
The information-based paces in the whole world are more and more faster, and rapidly the growth of data total amount is so the security of data storage becomes more and more important.When informationization brings service efficiently and manages easily to people, the risk of also bringing numerical information to lose to people, so the status of data backup is outstanding all the more.
The data backup mode mainly contains three kinds of modes: full backup, incremental backup and differential backup.
Backup (full backup) fully, each archives all can be write into the backup shelves and gone.As stated, if between the backup of two time points, data have no change, all Backup Datas all are the same so.This problem comes from standby system can not checked behind Last Backup, and archives have and do not changed; It is just mechanically read each archives, write, no matter whether archives were modified.File and file that backup is all chosen, the deposit attribute that does not rely on file is confirmed which file of backup.
Incremental backup (incremental backups), with backup is different fully, incremental backup can judge earlier before doing data backup, the last modification time of archives whether than time of Last Backup late.If not, that representes that behind Last Backup these archives were not changed, so do not need backup specifically.In other words, if revise date that the date " really " changed than last time late, archives were just changed so, needed backup.
Differential backup (differential backup), the same with incremental backup, all only back up the data of changing., after the last time full backup, once be updated but the former backup is archives of accumulation, when so next doing differential backup, these archives all can be by backup (certainly, up to full backup till) next time at every turn.Archives in this expression differential backup all are after last full backup, once reformed archives.If the recovery total system, you restore last differential backup again and get final product as long as restore backup fully earlier so.Incremental backup is aimed at last backup (no matter being which kind of backup): after the last backup of backup, and the file that all change.
Traditional solution is normally utilized file system layering driving model, realizes that self-defining filter Driver on FSD program tackles the operation of file, simultaneously the information of file change is preserved into journal file, is stored in this locality.In case this method shortcoming is a local log file to be damaged or lose, can not carry out incremental backup to the file of current variation to incremental backup last time.
Summary of the invention
The purpose of this invention is to provide a kind of rapid and reliable file incremental backup method.
The objective of the invention is to realize that by following mode step is following:
1) log information that the increment of file is changed with on once the journal file of incremental backup merge handle after, realize the memory mechanism of dual fail-safe, promptly preserve aly in this locality, on remote storage device, preserve a; Preserve a log information in this locality and can guarantee to realize the rapidity that the file incremental backup is, on remote storage device, preserve the reliability that log information can guarantee the file incremental backup in system;
2) local filter Driver on FSD is after the IO operation of intercepting file; According to preset rule; Compare; The file that needs record in the rule is write local log file with the form of daily record, and the data of this journal file are carried out the security identification sign indicating number that verification generates this journal file, this security identification sign indicating number also is kept in the journal file in the lump;
3) to this journal file of remote storage device transmission, when the file incremental backup, use and at first search journal file in this locality; And journal file discerned, guarantee that journal file is not damaged and loses, if journal file is lost; Then to this journal file of remote storage device request; Obtain the file change record, according to record the file system file is carried out file backup, thereby realized the rapidity and the reliability of file incremental backup.
The invention has the beneficial effects as follows:
Adopting filtration drive mechanism is in the Drive Layer embedding IO of file system interception; Rule according to the upper strata setting; Catch the change events (for example create, revise, deletion etc.) of file system data or metadata; And in time record is carried out in the change of file, and be kept in the local log file, guarantee to reach fast the purpose of instant recording file change;
Employing is preserved journal file to remote storage device, in case local journal file damages or loses, can in time obtain from remote storage device, guarantees the file The Realization of Increment Backup;
Use two kinds of mechanism to guarantee to monitor the variation of file system, guarantee that the file change in the file system can be by reliable record.
Description of drawings
Accompanying drawing 1 is local file filtration drive and application structure synoptic diagram,
Accompanying drawing 2 is a rapid and reliable file incremental backup system architecture synoptic diagram.
Embodiment
Explanation at length below with reference to Figure of description method of the present invention being done.
The architecture of invention mainly comprises: file incremental backup application system, filter Driver on FSD system, remote storage system.
Wherein, file incremental backup application system is the main carrier that this strategy is realized, is responsible for cooperation of filter Driver on FSD system and remote storage system and scheduling, comprises the setting of rule, the realization of strategy.The filter Driver on FSD system is this tactful core realization module, is responsible for the change information of interception file system file and the generation of journal file.Remote storage system is responsible for the journal file information that storage file changes.
The implementation method of rapid and reliable file incremental backup strategy is described below: existing by file incremental backup application system enactment document backup rules, need back up like which file, catalogue, with these regular circular document filtration drive systems; Filter Driver on FSD compares with rule after the IO operation of intercepting file, and regular file is recorded in the journal file.Reaching sometime, file incremental backup application system sends to remote storage system after journal file is carried out safety verification; When file incremental backup application system backup file, at first verify journal file, no abnormal like journal file, then the file of local file system is carried out incremental backup according to journal file information; Occur then obtaining journal file again from remote storage system unusually like journal file, the file to local file system carries out incremental backup again, has guaranteed the fast and reliable of file incremental backup.
Except that the described technical characterictic of instructions, be the known technology of those skilled in the art.
Claims (1)
1. a rapid and reliable file incremental backup method is characterized in that system comprises: file incremental backup application system, filter Driver on FSD system and remote storage system; Wherein, File incremental backup application system is the main carrier that this strategy is realized, is responsible for cooperation of filter Driver on FSD system and remote storage system and scheduling, comprises the setting of rule, the realization of strategy; The filter Driver on FSD system is the core realization module of this method; Be responsible for the change information of interception file system file and the generation of journal file, remote storage system is responsible for the journal file information that storage file changes, and file incremental backup step is following:
1) log information that the increment of file is changed with on once the journal file of incremental backup merge handle after, realize the memory mechanism of dual fail-safe, promptly preserve aly in this locality, on remote storage device, preserve a; Preserve a log information in this locality and can guarantee to realize the rapidity that the file incremental backup is, on remote storage device, preserve the reliability that log information can guarantee the file incremental backup in system;
2) local filter Driver on FSD is after the IO operation of intercepting file; According to preset rule; Compare; The file that needs record in the rule is write local log file with the form of daily record, and the data of this journal file are carried out the security identification sign indicating number that verification generates this journal file, this security identification sign indicating number also is kept in the journal file in the lump;
3) to this journal file of remote storage device transmission, when the file incremental backup, use and at first search journal file in this locality; And journal file discerned, guarantee that journal file is not damaged and loses, if journal file is lost; Then to this journal file of remote storage device request; Obtain the file change record, according to record the file system file is carried out file backup, thereby realized the rapidity and the reliability of file incremental backup.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103925208A CN102521075A (en) | 2011-12-01 | 2011-12-01 | Fast and reliable file incremental backup method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103925208A CN102521075A (en) | 2011-12-01 | 2011-12-01 | Fast and reliable file incremental backup method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102521075A true CN102521075A (en) | 2012-06-27 |
Family
ID=46292009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103925208A Pending CN102521075A (en) | 2011-12-01 | 2011-12-01 | Fast and reliable file incremental backup method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102521075A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103176867A (en) * | 2013-04-02 | 2013-06-26 | 浪潮电子信息产业股份有限公司 | Fast file differential backup method |
| CN103870570A (en) * | 2014-03-14 | 2014-06-18 | 广州携智信息科技有限公司 | HBase (Hadoop database) data usability and durability method based on remote log backup |
| CN104714864A (en) * | 2015-03-20 | 2015-06-17 | 成都云祺科技有限公司 | Intelligent computer data backup method |
| CN105653393A (en) * | 2014-11-11 | 2016-06-08 | 南京壹进制信息技术有限公司 | USN log manner-based mass file backup method |
| CN106776150A (en) * | 2017-01-04 | 2017-05-31 | 上海上讯信息技术股份有限公司 | A kind of method and apparatus for obtaining transaction journal dump file information |
| CN113238891A (en) * | 2021-03-19 | 2021-08-10 | 浪潮云信息技术股份公司 | Backup deletion method and system based on backup chain |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163493A1 (en) * | 2002-02-22 | 2003-08-28 | International Business Machines Corporation | System and method for restoring a file system from backups in the presence of deletions |
| CN101403988A (en) * | 2008-11-05 | 2009-04-08 | 中国科学院计算技术研究所 | File back-up system and method of computer system |
-
2011
- 2011-12-01 CN CN2011103925208A patent/CN102521075A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163493A1 (en) * | 2002-02-22 | 2003-08-28 | International Business Machines Corporation | System and method for restoring a file system from backups in the presence of deletions |
| CN101403988A (en) * | 2008-11-05 | 2009-04-08 | 中国科学院计算技术研究所 | File back-up system and method of computer system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103176867A (en) * | 2013-04-02 | 2013-06-26 | 浪潮电子信息产业股份有限公司 | Fast file differential backup method |
| CN103176867B (en) * | 2013-04-02 | 2017-12-01 | 浪潮电子信息产业股份有限公司 | A kind of fast file differential backup method |
| CN103870570A (en) * | 2014-03-14 | 2014-06-18 | 广州携智信息科技有限公司 | HBase (Hadoop database) data usability and durability method based on remote log backup |
| CN105653393A (en) * | 2014-11-11 | 2016-06-08 | 南京壹进制信息技术有限公司 | USN log manner-based mass file backup method |
| CN105653393B (en) * | 2014-11-11 | 2018-09-21 | 南京壹进制信息技术股份有限公司 | A method of mass file backup is carried out based on USN log modes |
| CN104714864A (en) * | 2015-03-20 | 2015-06-17 | 成都云祺科技有限公司 | Intelligent computer data backup method |
| CN106776150A (en) * | 2017-01-04 | 2017-05-31 | 上海上讯信息技术股份有限公司 | A kind of method and apparatus for obtaining transaction journal dump file information |
| CN113238891A (en) * | 2021-03-19 | 2021-08-10 | 浪潮云信息技术股份公司 | Backup deletion method and system based on backup chain |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102521075A (en) | Fast and reliable file incremental backup method | |
| CN100583050C (en) | Method for protecting and recovering continuous data based on time stamp diary memory | |
| CN102024044B (en) | Distributed file system | |
| JP6178859B2 (en) | Database storage system based on optical disk and method of using the same | |
| CN103530290A (en) | Method and system for data migration among databases | |
| WO2008055237A3 (en) | System for automatically recovering a computer memory using shadowed data and file directory structures | |
| CN102609337A (en) | Rapid data recovery method for memory database | |
| CN102682012A (en) | Method and device for reading and writing data in file system | |
| CN103914359A (en) | Data recovery method and device | |
| CN102136290A (en) | Method for storing embedded real-time video files | |
| CN105144142A (en) | Object storage using multiple dimensions of object information | |
| CN104239444B (en) | The consistent data protection of oracle database and the method for capture coherency state | |
| CN104239438A (en) | File information storage method and file information read-write method based on separate storage | |
| CN103164528B (en) | A kind of index establishing method of audio, video data | |
| CN102347866A (en) | Data configuration system and method in network management | |
| CN102541691A (en) | Log check point recovery method applied to memory data base OLTP (online transaction processing) | |
| US11221983B1 (en) | Multi-level indexing of backup files | |
| CN102750195A (en) | Method for cluster file system data fault tolerance | |
| CN103842954B (en) | Data processing method, device, system and server in storage system | |
| CN102510340A (en) | Method for realizing remote rapid backup by utilizing common Internet network | |
| CN103092849A (en) | File system cluster management method | |
| CN102521256B (en) | High-reliability data protection method of real-time/historical database | |
| CN104636218B (en) | Data reconstruction method and device | |
| CN103019626A (en) | Storage system, method and device for controlling cluster metadata | |
| CN101364163B (en) | System for establishing logical volume and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120627 |