CN109710466A - A kind of data back up method and device - Google Patents
A kind of data back up method and device Download PDFInfo
- Publication number
- CN109710466A CN109710466A CN201910004833.8A CN201910004833A CN109710466A CN 109710466 A CN109710466 A CN 109710466A CN 201910004833 A CN201910004833 A CN 201910004833A CN 109710466 A CN109710466 A CN 109710466A
- Authority
- CN
- China
- Prior art keywords
- backup
- data
- file
- block
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application discloses a kind of data back up method, include: the history backup for scanning source file, this backup mode is determined, if incremental backup mode, the corresponding index file of incremental backup file and content file of source file are then opened, and opens backup file completely；Index network is established according to the corresponding index file of the incremental backup file；The data in each data block of incremental backup file are successively read according to index network；The data read according to index network are compared with the data of source file corresponding position, new index file are generated according to comparison result, as the corresponding index file of this incremental backup.This method only needs to back up changed data after last time backup, and updates corresponding index file, and data backup can be realized, it has ensured the safety of data, and backup data quantity is greatly reduced, saved memory space, BACKUP TIME is shortened, backup efficiency is improved.Disclosed herein as well is a kind of data backup devices.
Description
Technical field
This application involves field of storage, especially a kind of data back up method and device.
Background technique
With the development of information-intensive society, more and more information by digitization, especially along with internet, cloud computing,
The development of the technologies such as Internet of Things, data are in explosive growth.Resulting mass data is to data-centered each big-and-middle
The efficient storage of type enterprise brings new challenge, and in face of the important loss of data in part or other unpredictalbe things occur
Therefore individual, businessman, enterprise or even government bodies need to minimize loss caused by such accident.
People begin to focus on the problem for how ensuring that data are intact as a result,.The prior art proposes a kind of data backup side
Method, i.e., by the data backup of master computer in an at least backup computer.This method requires to carry out between local and long-range
Complete exchange files not only extend data recovery time, while also bringing to produce a large amount of network transmission
Transmit security risk, it is often more important that, the different editions of same file, but the most contents of these different editions are stored repeatedly
Be it is identical, will lead to a large amount of waste of storage space.
Therefore, those skilled in the art is dedicated to developing a kind of data back up method and device, so that guaranteeing magnanimity
While data efficient stores, memory space is utilized as efficiently as possible, guarantees the safety of data.
Summary of the invention
In view of this, this application provides a kind of data back up method, realized by way of incremental backup efficiently
Ground utilizes memory space, and guarantees the safety of data.Accordingly, present invention also provides a kind of data backup devices.
The application first aspect provides a kind of data back up method, which comprises
The history backup for scanning source file, determines this backup mode, and the history is backed up including the last time completely
Back up corresponding complete backup file and all incremental backup files after the complete backup, the incremental backup text
Part is stored in the form of chained list；
If this backup mode is incremental backup mode, the corresponding index of incremental backup file of the source file is opened
File, and the complete backup file is opened, to read；
Index network is established according to the corresponding index file of the incremental backup file；
The data in each data block of incremental backup file are successively read according to the index network；
Will according to it is described index network read data be compared with the data of the source file corresponding position, according to than
Relatively result generates new index file, as the corresponding index file of this incremental backup.
Optionally, described that data packet in each data block of incremental backup file is successively read according to the index network
It includes:
The dependence block of data block is determined according to the index network；
Judge whether the dependence block is match block；
If it is not, then read it is described rely on block data, then execute it is described by according to it is described index network read data with
The step of data of the source file corresponding position are compared.
Optionally, the method also includes:
If so, continuing to trace the dependence block of the data block, until tracing back to non-matching block or the index file
Initial match block；
Read the data of the non-matching block or the initial match block, then execute it is described will be according to the index network
The step of data of reading are compared with the data of the source file corresponding position.
Optionally, described that the data read according to the index network are corresponding with the complete backup of the source file
The data of position are compared, and are generated new index file according to comparison result and are included:
It is described right if the data read according to the index network are different from the data of the source file corresponding position
The data block of position is answered to generate new index file.
Optionally, the method also includes:
Discharge the occupied memory headroom of the data block.
Optionally, the method also includes:
Discharge the occupied memory headroom of the index network.
Optionally, the history backup of the scanning source file, determines that this backup mode includes:
The corresponding BACKUP TIME of the last incremental backup is determined according to the chained list；
If the BACKUP TIME is later than the modification time of the source file, it is determined that this backup mode is incremental backup,
Otherwise, it determines this backup mode is backup completely.
The application second aspect provides a kind of data backup device, and described device includes:
Scanning element, the history for scanning source file back up, and determine this backup mode, the history backup includes institute
It states the last time and backs up corresponding complete backup file and all incremental backup files after the complete backup, institute completely
Incremental backup file is stated to store in the form of chained list；
Opening unit opens the incremental backup of the source file if being incremental backup mode for this backup mode
The corresponding index file of file, and the complete backup file is opened, to read；
Unit is established, for establishing index network according to the corresponding index file of the incremental backup file；
Reading unit, for being successively read the number in each data block of incremental backup file according to the index network
According to；
Processing unit, for will according to it is described index network read data and the source file corresponding position data into
Row compares, and new index file is generated according to comparison result, as the corresponding index file of this incremental backup.
Optionally, the read module is specifically used for:
The dependence block of data block is determined according to the index network；
Judge whether the dependence block is match block；
If it is not, then reading the data for relying on block, being then set forth in again by processing unit execution will be according to institute
State the step of data that index network is read are compared with the data of the source file corresponding position.
Optionally, the read module is also used to:
If so, continuing to trace the dependence block of the data block, until tracing back to non-matching block or the index file
Initial match block；
The data of the non-matching block or the initial match block are read, institute is then executed by the processing unit again
State the step of being compared the data read according to the index network with the data of the source file corresponding position.
Optionally, the processing unit is specifically used for:
It is described right if the data read according to the index network are different from the data of the source file corresponding position
The data block of position is answered to generate new index file.
Optionally, described device further include:
First releasing unit, for discharging the occupied memory headroom of the data block.
Optionally, described device further include:
Second releasing unit, for discharging the occupied memory headroom of the index network.
Optionally, the scanning element is specifically used for:
The corresponding BACKUP TIME of the last incremental backup is determined according to the chained list；
If the BACKUP TIME is later than the modification time of the source file, it is determined that this backup mode is incremental backup,
Otherwise, it determines this backup mode is backup completely.
As can be seen from the above technical solutions, the embodiment of the present application has the advantage that
A kind of data back up method is provided in the embodiment of the present application, in the method, storage server scans source file
History backup, history backup include last time backs up completely corresponding complete backup file and completely back up after
All incremental backup files, wherein incremental backup file is stored in the form of chained list, can determine that this is standby based on history backup
Part mode can then open the corresponding index file of incremental backup file and source document of source file if incremental backup mode
Then the complete backup file of part establishes index network according to the corresponding index file of incremental backup file to read data,
The data in each data block of incremental backup file are successively read based on index network, by the data read according to index network and source
The data of file corresponding position are compared, and it is corresponding as this incremental backup to generate new index file according to comparison result
Index file.
It can be seen that this method only needs to back up changed data after last time backup, and update corresponding
Data backup can be realized in index file, has ensured the safety of data, and backup data quantity is greatly reduced, and saves
Memory space shortens BACKUP TIME, improves backup efficiency.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of invention for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of data back up method in the embodiment of the present application；
Fig. 2 is a kind of flow chart of data back up method in the embodiment of the present application；
Fig. 3 is a kind of flow chart of data back up method in the embodiment of the present application；
Fig. 4 is a kind of structural schematic diagram of data backup device in the embodiment of the present application.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only this
Apply for a part of the embodiment, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art exist
Every other embodiment obtained under the premise of creative work is not made, shall fall in the protection scope of this application.
The description and claims of this application and term " first ", " second ", " third ", " in above-mentioned attached drawing
The (if present)s such as four " are to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should manage
The data that solution uses in this way are interchangeable under appropriate circumstances, so that embodiments herein described herein for example can be to remove
Sequence other than those of illustrating or describe herein is implemented.In addition, term " includes " and " having " and theirs is any
Deformation, it is intended that cover it is non-exclusive include, for example, containing the process, method of a series of steps or units, system, production
Product or equipment those of are not necessarily limited to be clearly listed step or unit, but may include be not clearly listed or for this
A little process, methods, the other step or units of product or equipment inherently.
For in the prior art that the data backup of master computer is local and long-range in an at least backup computer requirement
Between carry out complete exchange files, and then lead to that data recovery time is long, there is transmission security risk and memory space wave
The technical issues of taking, the application provide a kind of data back up method based on the relationship of file and data block, in the method, first
The history backup of source file is scanned, history backup includes the last time backing up corresponding complete backup file completely and complete
All incremental backup files after backup, wherein incremental backup file is stored in the form of chained list, can be with based on history backup
It determines this backup mode, if incremental backup mode, then can open the corresponding index text of incremental backup file of source file
Then the complete backup file of part and source file is established to read data according to the corresponding index file of incremental backup file
Network is indexed, the data in each data block of incremental backup file are successively read based on index network, will be read according to index network
Data be compared with the data of source file corresponding position, new index file is generated as this increment according to comparison result
Back up corresponding index file.
It can be seen that this method only needs to back up changed data after last time backup, and update corresponding
Data backup can be realized in index file, has ensured the safety of data, and backup data quantity is greatly reduced, and saves
Memory space shortens BACKUP TIME, improves backup efficiency.
It is appreciated that data back up method provided by the present application is applied to storage server.Storage server, which is to provide, deposits
The calculating equipment for storing up service, can be individually present, can also exist in the form of cluster, namely can be individual storage service
Device is also possible to the storage cluster of multiple servers formation.In specific implementation, data back up method provided by the present application is to answer
It is stored in storage server with the form of program, storage server realizes the data backup of the application by executing the application program
Method.It should be noted that application program can be independent application program, it is also possible to be integrated in other applications
Application program, including functional module, plug-in unit, small routine etc..
In order to enable the technical solution of the application it is clearer, it can be readily appreciated that below in conjunction with attached drawing, from storage server
Angle data back up method provided by the embodiments of the present application is introduced.
S101: the history backup of source file is scanned, determines this backup mode.If this backup mode is incremental backup side
Formula then executes S102.
Data backup can be generally divided into backup, incremental backup and differential backup completely.The present embodiment is mainly using increasing
Amount backup combines backup completely to realize data backup.Wherein, backup refers to all data of backup completely, and incremental backup refers to backup
From changed data after last time backup.
In the present embodiment, history backup include back up completely the last time corresponding complete backup file and
All incremental backup files after the complete backup, the incremental backup file are stored in the form of chained list.
It is carried out in backup procedure to source file, if only backed up completely at the beginning, history backup includes just
Begin backup file and all incremental backup files completely, and in case of repeatedly backup completely, then history backup includes the last time
Completely backup namely the last corresponding complete backup file is backed up completely and all increments after the complete backup are standby
Part file.
After storage server scans the history backup of source file, it can be backed up based on history and determine this backup mode, if
This backup mode is incremental backup mode, then executes S102.
S102: the corresponding index file of incremental backup file and content file of the source file are opened, and opens institute
Complete backup file is stated, to read.
Wherein, index file refers to the record with index file chain to the reference information between incremental backup, content file
Refer to the data in incremental backup.Based on last backup file and the incremental backup file pair after the complete backup completely
File after the available the last backup of the index file and content file answered, and storage server is also based on
State the file before any incremental backup of file access pattern.
In practical applications, storage server opens the corresponding index file of incremental backup file and content text of source file
Part, and the complete backup file is opened, above-mentioned file is read so as to subsequent, and carry out incremental backup based on result is read.
S103: index network is established according to the corresponding index file of the incremental backup file.
Wherein, index network is the network structure that the index file chain in index file is formed, which being capable of table
Levy the incidence relation between index file.
S104: the data in each data block of incremental backup file are successively read according to the index network.
Specifically, storage server can be successively read incremental backup according to from beginning to the sequence at end according to index network
Above-mentioned data are such as read into memory by the data in each data block of file.
S105: the data read according to the index network are compared with the data of the source file corresponding position,
New index file is generated according to comparison result, as the corresponding index file of this incremental backup.
After reading data according to index network, data and source file pair that storage server will be read according to index network
The data of position are answered to be compared, if not according to the data of the index network reading and the data of the source file corresponding position
Together, then new index file is generated for the data block of corresponding position.
After generating new index file, storage server can discharge the occupied memory headroom of the data block, with
Save storage resource.In specific implementation, storage server it is every read an incremental backup in data block, all with source file
The data of corresponding position are made comparisons, and block-by-block generates the index file of new incremental backup, and generates to wherein unmatched part
Then the content file of completely new incremental backup before reading next data block contents, first discharges shared by this data block
Memory.
Further, after traversing the data block in the incremental backup, storage server can also discharge Web-indexing
The occupied memory headroom of network, to save storage resource.
From the foregoing, it will be observed that the embodiment of the present application provides a kind of data back up method, and in the method, storage server scanning
The history of source file backs up, and history backup includes the last time backing up corresponding complete backup file completely and backing up completely
All incremental backup files later, wherein incremental backup file is stored in the form of chained list, can be determined based on history backup
This backup mode, if incremental backup mode, then can open the corresponding index file of incremental backup file of source file with
And then the complete backup file of source file establishes index according to the corresponding index file of incremental backup file to read data
Network is successively read the data in each data block of incremental backup file based on index network, the number that will be read according to index network
It is compared according to the data of source file corresponding position, new index file is generated as this incremental backup according to comparison result
Corresponding index file.
As it can be seen that this method only needs to back up changed data after last time backup, and update corresponding index
Data backup can be realized in file, has ensured the safety of data, and backup data quantity is greatly reduced, and saves storage
Space shortens BACKUP TIME, improves backup efficiency.
For S101, the embodiment of the present application provides a kind of implementation, for determining this backup mode.Referring to fig. 2
Shown in flow chart comprising following steps:
S1011: the corresponding BACKUP TIME of the last incremental backup is determined according to the chained list.
In specific implementation, storage server can take out a newest incremental backup file from chained list, and according to this
The attribute information of incremental backup file, such as modification time determine the corresponding BACKUP TIME of the last time incremental backup.
S1012: if the BACKUP TIME is later than the modification time of the source file, it is determined that this backup mode is increment
Backup, otherwise, it determines this backup mode is backup completely.
Storage server compares the modification time of BACKUP TIME and source file, if BACKUP TIME is later than the modification of source file
Between, then show after the last incremental backup, source file does not change, and storage server, can in this backup
In a manner of using incremental backup, if BACKUP TIME is not later than the modification time of source file, show after the last time backup,
Source file is modified, and can carry out data backup using complete backup mode.
It should be noted that if source file is not backed up before, then this uses complete backup mode, i.e., directly
Copied files.
In addition, in a distributed system, especially when rate server becomes bottleneck, the application can be backup
Data are sent in more storage servers, are restored using distributed parallel, without additional cost, and can bring performance
It is promoted.
For S104, the embodiment of the present application provides a kind of implementation, for realizing according to the index network successively
Read the data in each data block of incremental backup file.Flow chart shown in Figure 3 comprising following steps:
S1041: the dependence block of data block is determined according to the index network.
Wherein, it relies on block and refers to there is similarity or completely the same data block with data block.In the present embodiment, it takes
Business device can determine the dependence block of data block based on the index chain of index network.
S1042: judge whether the dependence block is match block；If it is not, then executing S1043.
Wherein, match block refers to the dependence block completely the same with data block, and non-matching block refers to and data block incomplete one
The dependence block of cause.Storage server can be completely the same based on judging that the modes such as cryptographic Hash determine whether.Specifically, storage service
Whether device both obtains the cryptographic Hash of data block and relies on the cryptographic Hash of block, and determine cryptographic Hash equal, if so, determining should be according to
Relying block is match block, if not, it is determined that the dependence block is non-matching block.
In the present embodiment, in order to realize incremental backup, it is thus necessary to determine that go out non-matching block, and the data based on non-matching block
Realize incremental backup.That is, relying on block as non-matching block is to execute S1043.
S1043: reading the data for relying on block, then executes described by the data read according to the index network and institute
State the step of data of source file corresponding position are compared.
Specifically, however, it is determined that dependence block is non-matching block, then storage server reads the data of the non-matching block, is such as read
To memory, then executes and be compared according to the data that the index network is read with the data of the source file corresponding position again
The step of.
Certainly, however, it is determined that dependence block is match block, then storage server can continue the dependence block of trace back data block, until
Then the initial match block for tracing back to non-matching block perhaps index file reads the non-matching block or the initial match block
Data, then execute and described compare the data read according to the index network and the data of the source file corresponding position
Compared with the step of.
It should be noted that if the dependence block length read is not up to the demand of data block, storage server can also be
Next data block that dependence block is searched in index file chain continues to read, until the total length read reaches wanting for data block
It asks, so realizes the content read in incremental backup in each data block.
The above are some specific implementations of data back up method provided by the embodiments of the present application, are based on this, the application
Embodiment additionally provides corresponding data backup device.Next, by being mentioned from the angle of function modoularization to the embodiment of the present application
The above-mentioned apparatus of confession is introduced.
The structural schematic diagram of data backup device shown in Figure 4, the device 400 include:
Scanning element 410, the history for scanning source file back up, and determine this backup mode, the history backup packet
Include the last time back up completely corresponding complete backup file and after the complete backup all incremental backups text
Part, the incremental backup file are stored in the form of chained list；
Opening unit 420, if being incremental backup mode for this backup mode, the increment for opening the source file is standby
The corresponding index file of part file, and the complete backup file is opened, to read；
Unit 430 is established, for establishing index network according to the corresponding index file of the incremental backup file；
Reading unit 440, for being successively read in each data block of incremental backup file according to the index network
Data；
Processing unit 450, the number of data and the source file corresponding position for will be read according to the index network
According to being compared, new index file is generated according to comparison result, as the corresponding index file of this incremental backup.
Optionally, the read module 440 is specifically used for:
The dependence block of data block is determined according to the index network；
Judge whether the dependence block is match block；
If it is not, then reading the data for relying on block, being then set forth in again by processing unit execution will be according to institute
State the step of data that index network is read are compared with the data of the source file corresponding position.
Optionally, the read module 440 is also used to:
If so, continuing to trace the dependence block of the data block, until tracing back to non-matching block or the index file
Initial match block；
The data of the non-matching block or the initial match block are read, institute is then executed by the processing unit again
State the step of being compared the data read according to the index network with the data of the source file corresponding position.
Optionally, the processing unit 450 is specifically used for:
It is described right if the data read according to the index network are different from the data of the source file corresponding position
The data block of position is answered to generate new index file.
Optionally, described device 400 further include:
First releasing unit, for discharging the occupied memory headroom of the data block.
Optionally, described device 400 further include:
Second releasing unit, for discharging the occupied memory headroom of the index network.
Optionally, the scanning element 410 is specifically used for:
The corresponding BACKUP TIME of the last incremental backup is determined according to the chained list；
If the BACKUP TIME is later than the modification time of the source file, it is determined that this backup mode is incremental backup,
Otherwise, it determines this backup mode is backup completely.
From the foregoing, it will be observed that the embodiment of the present application provides a kind of data backup device, the history which scans source file is standby
Part, history backup includes backing up corresponding complete backup file and all increments after complete backup the last time completely
Backup file, wherein incremental backup file is stored in the form of chained list, can determine this backup mode based on history backup,
If incremental backup mode, then can open source file the corresponding index file of incremental backup file and source file it is complete
Then backup file establishes index network according to the corresponding index file of incremental backup file, based on index to read data
Network is successively read the data in each data block of incremental backup file, and the data read according to index network are corresponding with source file
The data of position are compared, and generate new index file as the corresponding index text of this incremental backup according to comparison result
Part.
It can be seen that the device only needs to back up changed data after last time backup, and update corresponding
Data backup can be realized in index file, has ensured the safety of data, and backup data quantity is greatly reduced, and saves
Memory space shortens BACKUP TIME, improves backup efficiency.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or
The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit
It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the application
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (full name in English: Read-Only
Memory, english abbreviation: ROM), random access memory (full name in English: Random Access Memory, english abbreviation:
RAM), the various media that can store program code such as magnetic or disk.
It should be appreciated that in this application, " at least one (item) " refers to one or more, and " multiple " refer to two or two
More than a."and/or" indicates may exist three kinds of relationships, for example, " A and/or B " for describing the incidence relation of affiliated partner
It can indicate: only exist A, only exist B and exist simultaneously tri- kinds of situations of A and B, wherein A, B can be odd number or plural number.Word
Symbol "/" typicallys represent the relationship that forward-backward correlation object is a kind of "or"." at least one of following (a) " or its similar expression, refers to
Any combination in these, any combination including individual event (a) or complex item (a).At least one of for example, in a, b or c
(a) can indicate: a, b, c, " a and b ", " a and c ", " b and c ", or " a and b and c ", and wherein a, b, c can be individually, can also
To be multiple.
The above, above embodiments are only to illustrate the technical solution of the application, rather than its limitations；Although referring to before
Embodiment is stated the application is described in detail, those skilled in the art should understand that: it still can be to preceding
Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features；And these
It modifies or replaces, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution.
Claims (10)
1. a kind of data back up method, which is characterized in that the described method includes:
The history backup for scanning source file, determines this backup mode, and the history backup includes the last backup completely
Corresponding complete backup file and all incremental backup files after the complete backup, the incremental backup file with
The form of chained list stores；
If this backup mode is incremental backup mode, the corresponding index file of incremental backup file of the source file is opened
And content file, and the complete backup file is opened, to read；
Index network is established according to the corresponding index file of the incremental backup file；
The data in each data block of incremental backup file are successively read according to the index network；
The data read according to the index network are compared with the data of the source file corresponding position, are tied according to comparing
Fruit generates new index file, as the corresponding index file of this incremental backup.
2. the method according to claim 1, wherein described be successively read the increment according to the index network
Data in each data block of backup file include:
The dependence block of data block is determined according to the index network；
Judge whether the dependence block is match block；
If it is not, then read it is described rely on block data, then execute it is described by according to it is described index network read data with it is described
The step of data of source file corresponding position are compared.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
If so, continuing to trace the dependence block of the data block, until tracing back to non-matching block or the index file most
First match block；
The data of the non-matching block or the initial match block are read, then executes and described will be read according to the index network
Data the step of being compared with the data of the source file corresponding position.
4. according to claim 1 to method described in 3 any one, which is characterized in that it is described by described according to the Web-indexing
The data that network is read are compared with the data of the complete backup corresponding position of the source file, are generated newly according to comparison result
Index file includes:
If the data read according to the index network are different from the data of the source file corresponding position, for the corresponding position
The data block set generates new index file.
5. according to the method described in claim 4, it is characterized in that, the method also includes:
Discharge the occupied memory headroom of the data block.
6. according to the method described in claim 5, it is characterized in that, the method also includes:
Discharge the occupied memory headroom of the index network.
7. according to claim 1 to method described in 3 any one, which is characterized in that the history backup of the scanning source file,
Determine that this backup mode includes:
The corresponding BACKUP TIME of the last incremental backup is determined according to the chained list；
If the BACKUP TIME is later than the modification time of the source file, it is determined that this backup mode is incremental backup, otherwise,
Determine that this backup mode is backup completely.
8. a kind of data backup device, which is characterized in that described device includes:
Scanning element, the history for scanning source file back up, and determine this backup mode, the history backup includes on described
Corresponding complete backup file and all incremental backup files after the complete backup, the increasing are once backed up completely
Amount backup file is stored in the form of chained list；
Opening unit opens the incremental backup file of the source file if being incremental backup mode for this backup mode
Corresponding index file, and the complete backup file is opened, to read；
Unit is established, for establishing index network according to the corresponding index file of the incremental backup file；
Reading unit, for being successively read the data in each data block of incremental backup file according to the index network；
Processing unit, for comparing the data of the data and the source file corresponding position that read according to the index network
Compared with new index file being generated according to comparison result, as the corresponding index file of this incremental backup.
9. device according to claim 8, which is characterized in that the read module is specifically used for:
The dependence block of data block is determined according to the index network；
Judge whether the dependence block is match block；
If it is not, then reading the data for relying on block, being then set forth in again by processing unit execution will be according to the rope
Draw the step of data that network is read are compared with the data of the source file corresponding position.
10. device according to claim 9, which is characterized in that the read module is also used to:
If so, continuing to trace the dependence block of the data block, until tracing back to non-matching block or the index file most
First match block；
The data of the non-matching block or the initial match block are read, described incite somebody to action then is executed by the processing unit again
The step of being compared according to the data that the index network is read with the data of the source file corresponding position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910004833.8A CN109710466A (en) | 2019-01-03 | 2019-01-03 | A kind of data back up method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910004833.8A CN109710466A (en) | 2019-01-03 | 2019-01-03 | A kind of data back up method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109710466A true CN109710466A (en) | 2019-05-03 |
Family
ID=66259849
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910004833.8A Pending CN109710466A (en) | 2019-01-03 | 2019-01-03 | A kind of data back up method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109710466A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825559A (en) * | 2018-08-10 | 2020-02-21 | 华为技术有限公司 | Data processing method and equipment |
| CN111382184A (en) * | 2020-05-25 | 2020-07-07 | 浙江明度智控科技有限公司 | Method for verifying drug document and drug document verification system |
| CN113722152A (en) * | 2021-08-05 | 2021-11-30 | 四川大学 | Data incremental backup method, device, equipment and storage medium |
| CN117435404A (en) * | 2023-12-21 | 2024-01-23 | 成都云祺科技有限公司 | Processing method, system and data recovery method for permanent incremental backup data storage |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477487A (en) * | 2009-01-22 | 2009-07-08 | 上海交通大学 | Multiple incremental files backup and recovery method |
| CN103064760A (en) * | 2012-12-19 | 2013-04-24 | 华为技术有限公司 | Backup method and backup device |
| US20170116188A1 (en) * | 2012-01-02 | 2017-04-27 | International Business Machines Corporation | Method and system for backup and recovery |
| CN108255647A (en) * | 2018-01-18 | 2018-07-06 | 湖南麒麟信安科技有限公司 | A kind of high-speed data backup method under samba server clusters |
| US20180329636A1 (en) * | 2014-11-20 | 2018-11-15 | Commvault Systems, Inc. | Virtual machine change block tracking |
-
2019
- 2019-01-03 CN CN201910004833.8A patent/CN109710466A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101477487A (en) * | 2009-01-22 | 2009-07-08 | 上海交通大学 | Multiple incremental files backup and recovery method |
| US20170116188A1 (en) * | 2012-01-02 | 2017-04-27 | International Business Machines Corporation | Method and system for backup and recovery |
| CN103064760A (en) * | 2012-12-19 | 2013-04-24 | 华为技术有限公司 | Backup method and backup device |
| US20180329636A1 (en) * | 2014-11-20 | 2018-11-15 | Commvault Systems, Inc. | Virtual machine change block tracking |
| CN108255647A (en) * | 2018-01-18 | 2018-07-06 | 湖南麒麟信安科技有限公司 | A kind of high-speed data backup method under samba server clusters |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825559A (en) * | 2018-08-10 | 2020-02-21 | 华为技术有限公司 | Data processing method and equipment |
| CN111382184A (en) * | 2020-05-25 | 2020-07-07 | 浙江明度智控科技有限公司 | Method for verifying drug document and drug document verification system |
| CN113722152A (en) * | 2021-08-05 | 2021-11-30 | 四川大学 | Data incremental backup method, device, equipment and storage medium |
| CN117435404A (en) * | 2023-12-21 | 2024-01-23 | 成都云祺科技有限公司 | Processing method, system and data recovery method for permanent incremental backup data storage |
| CN117435404B (en) * | 2023-12-21 | 2024-05-28 | 成都云祺科技有限公司 | Processing method, system and data recovery method for permanent incremental backup data storage |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109710466A (en) | A kind of data back up method and device | |
| US20210232558A1 (en) | Data isolation in a blockchain network | |
| CN101313495B (en) | Method, system and apparatus for data synchronization | |
| US8504517B2 (en) | Systems and methods for selective data replication | |
| US9135322B2 (en) | Environment classification | |
| US8489612B2 (en) | Identifying similar files in an environment having multiple client computers | |
| CN102142032B (en) | Method and system for reading and writing data of distributed file system | |
| CN110389859B (en) | Method, apparatus and computer program product for copying data blocks | |
| CN104484480A (en) | Deduplication-based remote replication method and device | |
| CN103942292A (en) | Virtual machine mirror image document processing method, device and system | |
| CN103152390A (en) | Method and device and nodes and system for node configuration of distributed storage system | |
| CN105260639A (en) | Face recognition system data update method and device | |
| CN111598575A (en) | Business process control method and device, electronic equipment and readable storage medium | |
| CN105653209A (en) | Object storage data transmitting method and device | |
| CN113760846A (en) | Data processing method and device | |
| CN110704438A (en) | Method and device for generating bloom filter in block chain | |
| CN109977168A (en) | The method for synchronizing data of database and equipment preloaded based on data page | |
| CN106776795A (en) | Method for writing data and device based on Hbase databases | |
| CN108363727B (en) | Data storage method and device based on ZFS file system | |
| CN111708835B (en) | Block chain data storage method and device | |
| CN102523112B (en) | Information processing method and equipment | |
| CN115687276B (en) | File processing method and device, electronic equipment and storage medium | |
| CN108428182B (en) | Development platform device, method for acquiring policy number, and computer-readable storage medium | |
| CN112764897B (en) | Task request processing method, device and system and computer readable storage medium | |
| CN115129781A (en) | Data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190503 |