CN107402838A - A kind of backup method and storage system based on write buffer - Google Patents
A kind of backup method and storage system based on write buffer Download PDFInfo
- Publication number
- CN107402838A CN107402838A CN201610330461.4A CN201610330461A CN107402838A CN 107402838 A CN107402838 A CN 107402838A CN 201610330461 A CN201610330461 A CN 201610330461A CN 107402838 A CN107402838 A CN 107402838A
- Authority
- CN
- China
- Prior art keywords
- data
- write
- moment
- backup
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0893—Caches characterised by their organisation or structure
Abstract
A kind of backup method and storage system based on write buffer, methods described are used for storage system, and the storage system, which includes primary storage medium, caching medium and controller, methods described, to be included：After the controller is received to the write request of the primary storage medium, target data is cached to the caching medium according to write record corresponding to the write request；The controller backs up according to the write record in predetermined time to the target data.It can realize under the premise of the performance of storage system is not reduced, improve the purpose at backup interval.
Description
Technical field
The present invention relates to redundancy technique field, more particularly to a kind of backup method and storage system based on write buffer.
Background technology
Snapshot (English full name：Snapshot) it is usually used in virtualization and field of storage, also commonly referred to as virtual snapshot (English full name：Virtual Copy) or time point logical copy (English full name：Point-in-time Logical Copy).Snapshot is only to the completely available copy for a logic for specifying data acquisition system, and the copy includes source data in the frozen image of copy time point, i.e., the data record of virtual machine or storage volume at a time is got off.It can be backed up or replicated with property performance period by snapshot, data-backoff to past can be specified to the data mode at moment.Back up and divide full backup and incremental backup, snapshot on the basis of full backup, incremental backup refers on the basis of baseline snapshot, and incremental data is backed up.
In current mechanism, when carrying out incremental backup, need first to identify last backup time to the incremental data between this backup time, and ensure that the incremental data of identification will not be changed halfway in backup procedure, typically using snapping technique identification incremental data, snapshot is beaten at the time of backup, it is incremental data to shine the data changed between this snapshot soon from the last time.But current snapping technique can reduce virtual machine or the write performance of storage volume, the amplitude of reduction beats that snapshot frequency is higher 20%~60%, and the amplitude that performance reduces is bigger.Therefore on the premise of the write performance of virtual machine or storage volume is ensured, shorter backup interval can not be reached in actual use based on the backup of snapshot, backup interval is bigger, during failure, loss of data it is more, both can not take into account.
The content of the invention
The invention provides a kind of backup method and storage system based on write buffer, and can solve the problem that can not improve the problem of backup is spaced on the premise of the write performance of storage system is ensured in the prior art.
First aspect provides a kind of backup method based on write buffer, and this method is used for storage system, and the storage system, which includes primary storage medium, caching medium and controller, methods described, to be included：
After the controller is received to the write request of the primary storage medium, target data is cached to the caching medium according to write record corresponding to the write request；
The controller reads the target data of caching from the caching medium, and the target data is write into the primary storage medium；
The controller backs up according to the write record in predetermined time to the target data.
Wherein, the write record includes object field, offset field, length field and data field, the offset field is used to indicate the target location that the target data is write to destination object corresponding to the object field, the length field indicates the target length of the target data, and the data field is the target data for writing the destination object.
In some possible designs, the predetermined time includes the first predetermined time and the second predetermined time, and the controller backs up according to the write record in predetermined time to the target data, including：
The controller performs default backup policy, obtain the write record set between first predetermined time and second predetermined time, obtain the variance data set that the write record set includes, data between each two write record are variance data, and the variance data set are backed up.
Described to be cached target data to the caching medium according to the write request in some possible designs, when the primary storage medium by target data write-in, methods described also includes one of following item：
When the write buffer data in the target data are write into the primary storage medium, if the write buffer data are not backed up, the controller preserves the write buffer data to the increment space in the primary storage medium；
When the write buffer data in the target data are write into the primary storage medium, the controller preserves the write buffer data to the increment space in the primary storage medium；
The write buffer data are incremental data of first predetermined time to second predetermined time.
In some possible designs, the target data includes the first data, the second data and the 3rd data, second data are the variance datas on the basis of first data, 3rd data are the variance datas on the basis of first data and second data, and the write record according to corresponding to the write request caches target data to the caching medium；The controller reads the target data of caching from the caching medium, and the target data is write into the primary storage medium；The controller backs up according to the write record in predetermined time to the target data, including：
The controller by first data buffer storage to the caching medium, was recorded as the first moment at the time of first data buffer storage is completed, first data is backed up at first moment according to the write request；Backup Data using the write record before first moment as first time backup, the Backup Data that the first time is backed up back up；
By second data buffer storage to the caching medium, it was recorded as the second moment at the time of second data buffer storage is completed, second data are backed up at first moment, variance data using the write record between first moment and second moment as second of backup, the variance data of second of backup is backed up, and deletes first moment；
By the 3rd data buffer storage to the caching medium, it was recorded as the 3rd moment at the time of 3rd data buffer storage is completed, the 3rd data are backed up at the 3rd moment, variance data using the write record between second moment and the 3rd moment as third time backup, the variance data that the third time is backed up backs up, and deletes second moment.
Second aspect provides a kind of storage system, and the storage system includes：
Primary storage medium, caching medium and controller；
The controller, after receiving to the write request of the primary storage medium, target data is cached to the caching medium according to write record corresponding to the write request；
The target data of caching is read from the caching medium, the target data is write into the primary storage medium；
And the target data is backed up in predetermined time according to the write record；
The caching medium is used to cache the target data for writing the primary storage medium；
The primary storage medium is used to store the target data.
Wherein, the write record includes object field, offset field, length field and data field, the offset field is used to indicate the target location that the target data is write to destination object corresponding to the object field, the length field indicates the target length of the target data, and the data field is the target data for writing the destination object.
In some possible designs, the predetermined time includes the first predetermined time and the second predetermined time, and the controller is specifically used for including：
Default backup policy is performed, the write record set between first predetermined time and second predetermined time is obtained, obtains the variance data set that the write record set includes, and the variance data set is backed up.
In some possible designs, the controller caches target data to the caching medium according to the write request, when the target data is write into the primary storage medium, is additionally operable to perform one of following item：
When the write buffer data in the target data are write into the primary storage medium, if the write buffer data are not backed up, the write buffer data are preserved to the increment space in the primary storage medium；
When the write buffer data in the target data are write into the primary storage medium, the write buffer data are preserved to the increment space in the primary storage medium；
The write buffer data are incremental data of first predetermined time to second predetermined time.
In some possible designs, the target data includes the first data, the second data and the 3rd data, second data are the variance datas on the basis of first data, 3rd data are the variance datas on the basis of first data and second data, and the write record according to corresponding to the write request caches target data to the caching medium；The controller is specifically used for：
According to the write request by first data buffer storage to the caching medium, it was recorded as the first moment at the time of first data buffer storage is completed, first data is backed up at first moment；Backup Data using the write record before first moment as first time backup, the Backup Data that the first time is backed up back up；
By second data buffer storage to the caching medium, it was recorded as the second moment at the time of second data buffer storage is completed, second data are backed up at first moment, variance data using the write record between first moment and second moment as second of backup, the variance data of second of backup is backed up, and deletes first moment；
By the 3rd data buffer storage to the caching medium, it was recorded as the 3rd moment at the time of 3rd data buffer storage is completed, the 3rd data are backed up at the 3rd moment, variance data using the write record between second moment and the 3rd moment as third time backup, the variance data that the third time is backed up backs up, and deletes second moment.
Compared to prior art, in scheme provided by the invention, the write record for indicating the target data is carried in write request, so that controller caches target data to the caching medium according to the write request, the target data is write into the primary storage medium, and the target data backed up in predetermined time according to the write record.It is implemented without by calculating the variance data between backup point, you can by write record Recognition Different data, under the premise of the performance of storage system is ensured, further shorten backup interval.
Brief description of the drawings
Fig. 1 is a kind of schematic flow sheet of the backup method based on write buffer in the present embodiment；
Fig. 2 is a kind of structural representation of storage system provided herein；
Fig. 3 is another schematic flow sheet of the backup method based on write buffer in the present embodiment；
Fig. 4 is a kind of schematic flow sheet that incremental data is write to increment space in the present embodiment；
Fig. 4-1 is a kind of relation schematic diagram between write record and backup time in the present embodiment；
Fig. 5 is a kind of schematic flow sheet for recovering data in the present embodiment；
Fig. 6 is another structural representation of storage system provided herein.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention; technical scheme in the embodiment of the present invention is clearly and completely described; obviously; described embodiment is only part of the embodiment of the present invention; rather than whole embodiment; based on the embodiment in the present invention, every other embodiment that those skilled in the art are obtained under the premise of creative work is not made belongs to the scope of protection of the invention.
Term " first ", " second " in description and claims of this specification and above-mentioned accompanying drawing etc. are for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that the data so used can exchange in the appropriate case, so that the embodiments described herein can be implemented with the order in addition to the content for illustrating or describing herein.In addition,Term " comprising " and " having " and their any deformation,It is intended to cover non-exclusive include,Such as,Contain the process of series of steps or module,Method,System,Product or equipment are not necessarily limited to those steps clearly listed or module,But may include not list clearly or for these processes,Method,The other steps or module of product or equipment inherently,The division of module appeared in this paper,A kind of only division in logic,There can be other dividing mode when being realized in practical application,Such as multiple modules can be combined into or be integrated in another system,Or some features can be ignored,Or do not perform,In addition,Shown or discussion mutual coupling or direct-coupling or communication connection can be by some interfaces,INDIRECT COUPLING or communication connection between module can be electrical or other similar forms,It is not construed as limiting herein.And, the module or submodule illustrated as separating component can may not be separation physically, can may not be physical module, or it can divide less than partly or entirely module therein in multiple circuit modules, can be selected to realize the purpose of scheme of the embodiment of the present invention according to the actual needs.
The embodiments of the invention provide a kind of backup method and storage system based on write buffer, for redundancy technique field.It is described in detail below.
Through present specification, for each backup, including variance data all between generating the moment at the upper one backup generation moment to current backup, and there is no the data changed between this period, this part is identical with a upper backup without the data changed.According to the different disposal mechanism to new write-in data placement location.
The institutional framework schematic diagram of storage system 20 is as shown in Fig. 2 including controller 202, memory 204, can also include bus 208, communication interface 206.
Wherein, controller 202, memory 204 and communication interface 206 can by bus 208 realize between communication connection, can also by be wirelessly transferred wait other means realize communicate.
Memory 204 can include primary storage medium and caching medium, wherein, caching medium can be high speed storing medium, to improve writing rate；Primary storage medium can be low speed storage medium, such as including volatile memory (English full name：Volatile memory), such as random access memory (English full name：Random-access memory, English abbreviation：RAM)；Memory can also include flash memory (English full name：Flash memory), hard disk (English full name：Hard disk drive, English abbreviation：) or solid state hard disc (English full name HDD：Solid state drive, English abbreviation：SSD)；Memory 204 can also include the combination of the memory of mentioned kind, and the combination of specific primary storage medium and caching medium is not construed as limiting herein.When by software to realize the technical scheme of the application offer, the program code of the backup method based on write buffer provided for realizing the application Fig. 1 preserves in memory 204, and is performed by controller 202.
Storage system 200 passes through communication interface 206 and main-machine communication.
In order to solve the above technical problems, the embodiment of the present invention mainly provides following technical scheme：
1st, in write buffer, write operation is stored in caching medium in a manner of write record.
2nd, write record is isolated with predetermined time, so that controller need not analyze calculating and can rapidly identify incremental data.
Pass through above technical scheme, the variance data between two specified moment can be quickly identified, reduces Backup Data, reduces the performance loss of backup tape, backup efficiency is improved, so as to shorten backup interval and reduce recovery point objectives (the English full name of storage system：RecoveryPointObject, English abbreviation：RPO).
It refer to Fig. 1 and Fig. 3, below from the angle of the controller in storage system, provide a kind of backup method based on write buffer to the present invention and be illustrated, this method is used for storage system, the storage system, which includes primary storage medium, caching medium and controller, methods described, to be included：
101st, after the controller is received to the write request of the primary storage medium, target data is cached to the caching medium according to write record corresponding to the write request.
Wherein, after controller receives write request, write request is converted to the write record of write buffer form, so as to which target data is cached to caching medium, then it is that multiple write records are write into caching medium because target data writes several times, therefore for the target data, the number of i.e. described write record is at least one, and particular number is not construed as limiting.
102nd, the controller reads the target data of caching from the caching medium, and the target data is write into the primary storage medium；
103rd, the controller backs up according to the write record in predetermined time to the target data.
Wherein, the write record includes object field, offset field, length field and data field, the offset field is used to indicate the target location that the target data is write to destination object corresponding to the object field, the length field indicates the target length of the target data, and the data field is the target data for writing the destination object.The form of write record is as shown in table 1 below：
| Object | Skew | Length | Data |
| obj1 | 0x0000100 | 4K | XXXXXXXXXXXXXX |
| obj1 | 0x0001010 | 32K | XXXXXXXXXXXXXX |
| … | … | … | … |
Table 1
Wherein, object field represents that object can be the virtual disk or LUN or storage volume of virtual machine to some object progress write operation, offset field and length field show how many data that where are written with to the object, and data field is then the data really write.For the write record of same object, a continuous spatial cache is cached to, is easy to the write back operations in later stage, improves write-back performance.
In the embodiment of the present invention, the write record for indicating the target data is carried in write request, so that controller caches target data to the caching medium according to the write request, the target data is write into the primary storage medium, and the target data backed up in predetermined time according to the write record.It is implemented without by calculating the variance data between backup point, you can by write record Recognition Different data, under the premise of the performance of storage system is ensured, further improve backup interval.
Optionally, in some inventive embodiments, in data procedures are write, by running backup software, it can realize and be backed up at the time of pre-setting, be determined by the performance of storage system, user's request at the time of the interval specifically backed up, backup, be specifically not construed as limiting herein.Controller can be backed up in this predetermined time, then obtain last predetermined time to all write records between this predetermined time, you can obtain the variance data between the two predetermined times, be embodied as：The predetermined time includes the first predetermined time and the second predetermined time, and the controller backs up according to the write record in predetermined time to the target data, including：
The controller performs default backup policy, obtains the write record set between first predetermined time and second predetermined time, obtains the variance data set that the write record set includes, and the variance data set is backed up.It is appreciated that, data between each two write record are variance data, such as in Fig. 4-1, first predetermined time is moment A, and when the second predetermined time is B, write record 3, write record 4 and write record 5 are written between moment A and moment B, wherein write record 4 compared to write record 3 for, variance data between the two is the data included by write record 4, and follow-up the rest may be inferred, does not repeat.
It is understood that the first predetermined time, the second predetermined time can be any predetermined time points for entirely writing data procedures backup, specifically it is not construed as limiting.
Optionally, in some inventive embodiments, because caching medium is mainly used in the data (write record) of caching write-in primary storage medium, to improve the write performance that upper layer application arrives, typically by write record from caching medium brush enter primary storage medium after, just this write record is emptied to discharge the spatial cache of caching medium, so that follow-up write operation uses.But when the write record of write buffer is written back into low speed storage medium, if backup has not been completed in this Partial Incremental data, if deleting these write records, controller just None- identified incremental data, incremental backup can not be done, can be in write back operations to solve the problem, this Partial Incremental data is preserved in advance, such as these incremental datas can be preserved to the increment space into primary storage medium.It is specific as follows：
Target data is being cached according to the write request to the caching medium, when the target data is write into the primary storage medium, first preserving one of the write buffer data, for example following item of concrete mode in write-in caching medium：
1st, when the write buffer data in the target data are write into the primary storage medium, if the write buffer data are not backed up, the controller preserves the write buffer data to the increment space in the primary storage medium.Caching backup only is carried out to the write buffer data not backed up.
2nd, when the write buffer data in the target data are write into the primary storage medium, the controller preserves the write buffer data to the increment space in the primary storage medium.Write buffer data each time are all backed up.
The write buffer data are incremental data of first predetermined time to second predetermined time.
By for write buffer data backup, incremental data is also write into increment space simultaneously, so that even if having had partial data in write-back, the incremental data in write-in increment space is then read from increment space, and the incremental data for not writing increment space is then read from caching medium.Accordingly even when backup failure, the incremental data that increment space can also be used to preserve is backed up again, improves the stability of data.
As shown in Figure 4, one piece of continuous memory space is divided in primary storage medium as increment space, for preserving incremental data, when write record is written back to the virtual disk of virtual machine by write-back module, if write record is located at behind backup time, then show that it is the data not backed up also to rewrite record, therefore increment space is write while the write record is written into virtual disk, while using these write records as incremental data.If the data of write-back have backed up, i.e., before this backup time, then write record need not be write increment space.
Optionally, in some inventive embodiments, the target data includes the first data, the second data and the 3rd data, second data are the variance datas on the basis of first data, 3rd data are the variance datas on the basis of first data and second data, and the process of whole write operation and backup is specific as follows：
The controller by first data buffer storage to the caching medium, was recorded as the first moment at the time of first data buffer storage is completed, first data is backed up at first moment according to the write request；Backup Data using the write record before first moment as first time backup, the Backup Data that the first time is backed up back up；
By second data buffer storage to the caching medium, it was recorded as the second moment at the time of second data buffer storage is completed, second data are backed up at first moment, variance data using the write record between first moment and second moment as second of backup, the variance data of second of backup is backed up, and deletes first moment；
By the 3rd data buffer storage to the caching medium, it was recorded as the 3rd moment at the time of 3rd data buffer storage is completed, the 3rd data are backed up at the 3rd moment, variance data using the write record between second moment and the 3rd moment as third time backup, the variance data that the third time is backed up backs up, and deletes second moment.
It is appreciated that, above-mentioned first moment, the second moment, the 3rd moment are only a kind of citing, backup for the second moment and the 3rd moment then refers to the backup at the second moment and the 3rd moment, not repeated for the back mechanism to move in circles, the backup of following instant.In addition, the quantity at moment, the selection at moment are unrestricted herein, user's request or size of data during with specific reference to practical application etc. determine, are not construed as limiting herein.
For example, as shown in Fig. 4-1, moment A is the backup point of recent i.e. last time, and moment B is the backup point of this backup, write record 3-5 between moment A and moment B is the incremental data that this moment B needs to back up, as long as this incremental backup backup write record 3-5.In addition, the write record 7 after this backup starts will not can be backed up by mistake by moment B to separating by this incremental backup.Due to distinguishing incremental data by constantly, then to write operation each time, overhead will not be increased, you can effectively to avoid because performance caused by overhead reduces.
Optionally, in some inventive embodiments, the data mode of any backup time can be retreated to back and forth by the write record of backup, or recover the data of failure, illustrated individually below：
1st, the data mode by write record by data-backoff to any backup time.
User is by operating backup software, obtain the target write record set of the target data, using a write record in the target write record set as target write record, then the variance data of target write record instruction is obtained from network backup storage, write request is sent to controller, the state of the Backup Data included to the target write record so that controller target write record according to corresponding to the write request retracts the target data being stored in the primary storage medium, you can at the time of realization return back to any backup.
2nd, by write record by the data recovery of failure.
User is by operating backup software, obtain the target write record set of the target data, the write record of fault data will be corresponded in the target write record set as target write record, then the variance data of target write record instruction is obtained from network backup storage, write request is sent to controller, so that controller target write record according to corresponding to the write request recovers the fault data, such as fault data can be replaced with to the variance data that the target write record includes.Fault recovery function can be realized by this programme.
For example, after backup software takes out variance data from production inventory, variance data is backuped to above by network by backup storage, when corrupted data in storage system, backup software again from backup storage the data recovery of backup into storage system.
As shown in figure 5,00:A full backup is carried out when 00,08:It is directed to when 00 from 00:Variable quantity after 00 carries out an incremental backup, 09:It is directed to when 00 from 08:Variable quantity after 00 carries out an incremental backup, 10:It is directed to when 00 from 09:Variable quantity after 00 carries out an incremental backup.
In the corrupted data of production inventory, production inventory can be returned to the past a certain moment by backing up the Backup Data in storing, if for example, 11:00 occurs disaster accident, causes the corrupted data of production inventory, and 10:An incremental backup has been carried out when 00, then can be the data recovery of production inventory to 10:The data backed up when 00, recover to need full backup (00:00), incremental backup (08:00), incremental backup (09:00), incremental backup (10:00) data are merged into production inventory, generally there is two kinds of ways：Merge in advance in backup storage end, directly returned to production inventory what is merged when recovery；Or respectively by full backup (00:00), incremental backup (08:00), incremental backup (09:00), incremental backup (10:00) then data transfer remerges to production inventory end.
A kind of backup method based on write buffer in the present invention is illustrated above, the storage system for performing the above-mentioned backup method based on write buffer is described below.Storage system herein includes：Controller, primary storage medium and caching medium.Wherein, controller is mainly used in caching, write back operations；Primary storage medium is used for the data for storing upper layer application or virtual machine write-in, and storage incremental data (backup is used)；Caching medium is mainly used in the data for caching upper layer application or virtual machine write-in.
Reference picture 6, storage system 60 is illustrated, storage system 60 includes：
Primary storage medium 601, caching medium 602 and controller 603；
The controller 603, after receiving to the write request of the primary storage medium 601, target data is cached to the caching medium 602 according to write record corresponding to the write request；
The target data of caching is read from the caching medium 602, the target data is write into the primary storage medium 601；
And the target data is backed up in predetermined time according to the write record；
The caching medium 602 is used to cache the target data for writing the primary storage medium 601；
The primary storage medium 601 is used to store the target data.
Wherein, the write record includes object field, offset field, length field and data field, the offset field is used to indicate the target location that the target data is write to destination object corresponding to the object field, the length field indicates the target length of the target data, and the data field is the target data for writing the destination object.
In the embodiment of the present invention, due to carrying the write record for indicating the target data in write request, so that controller 603 caches target data to the caching medium 602 according to the write request, and the target data is write into the primary storage medium 601, and the target data is backed up in predetermined time according to the write record.Realize not by calculating the variance data between backup point, you can by write record Recognition Different data, under the premise of the performance of storage system is ensured, further shorten backup interval.
Optionally, the predetermined time includes the first predetermined time and the second predetermined time, and the controller 603 is specifically used for including：
Default backup policy is performed, the write record set between first predetermined time and second predetermined time is obtained, obtains the variance data set that the write record set includes, and the variance data set is backed up.
Optionally, the controller 603 caches target data to the caching medium 602 according to the write request, when the target data is write into the primary storage medium 601, is additionally operable to perform one of following item：
When the write buffer data in the target data are write into the primary storage medium 601, if the write buffer data are not backed up, the write buffer data are preserved to the increment space in the primary storage medium 601；
When the write buffer data in the target data are write into the primary storage medium 601, the write buffer data are preserved to the increment space in the primary storage medium 601；
The write buffer data are incremental data of first predetermined time to second predetermined time.
Optionally, the target data includes the first data, the second data and the 3rd data, second data are the variance datas on the basis of first data, 3rd data are the variance datas on the basis of first data and second data, and the write record according to corresponding to the write request caches target data to the caching medium；
The controller 603 is specifically used for：
First data buffer storage was recorded as the first moment at the time of first data buffer storage is completed, first data are backed up at first moment to the caching medium 602 according to the write request；Backup Data using the write record before first moment as first time backup, the Backup Data that the first time is backed up back up；
By second data buffer storage to the caching medium 602, it was recorded as the second moment at the time of second data buffer storage is completed, second data are backed up at first moment, variance data using the write record between first moment and second moment as second of backup, the variance data of second of backup is backed up, and deletes first moment；
By the 3rd data buffer storage to the caching medium 602, it was recorded as the 3rd moment at the time of 3rd data buffer storage is completed, the 3rd data are backed up at the 3rd moment, variance data using the write record between second moment and the 3rd moment as third time backup, the variance data that the third time is backed up backs up, and deletes second moment.
The present invention also provides a kind of computer-readable storage medium, and the media storage has program, including some or all of step in the above-mentioned backup method based on write buffer when the program performs.
The present invention also provides a kind of computer-readable storage medium, and the media storage has program, and the program performs some or all of step in the above-mentioned backup method based on write buffer including above-mentioned storage system 60 when performing.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not have the part being described in detail in some embodiment, may refer to the associated description of other embodiment.
It is apparent to those skilled in the art that for convenience and simplicity of description, the specific work process of the system, apparatus, and unit of foregoing description, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method, can realize by another way.Such as, device embodiment described above is only schematical, such as, the division of the unit, only a kind of division of logic function, there can be other dividing mode when actually realizing, such as multiple units or component can combine or be desirably integrated into another system, or some features can be ignored, or do not perform.Another, shown or discussed mutual coupling or direct-coupling or communication connection can be by some interfaces, the INDIRECT COUPLING or communication connection of device or unit, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, can be as the part that unit is shown or may not be physical location, you can with positioned at a place, or can also be distributed on multiple NEs.Some or all of unit therein can be selected to realize the purpose of this embodiment scheme according to the actual needs.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit or unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated unit can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and as independent production marketing or in use, can be stored in a computer read/write memory medium.Based on such understanding, the part or all or part of the technical scheme that technical scheme substantially contributes to prior art in other words can be embodied in the form of software product, the computer software product is stored in a storage medium, including some instructions make it that a computer equipment (can be personal computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the present invention.And foregoing storage medium includes：USB flash disk, mobile hard disk, read only memory ROM, random access memory ram, magnetic disc or CD etc. are various can be with the medium of store program codes.
Technical scheme provided by the present invention is described in detail above, specific case used herein is set forth to the principle and embodiment of the present invention, and the explanation of above example is only intended to help to understand method and its core concept of the invention；Meanwhile for those of ordinary skill in the art, according to the thought of the present invention, there will be changes in specific embodiments and applications, to sum up institute s state, this specification content should not be construed as limiting the invention.
Claims (10)
1. a kind of backup method based on write buffer, it is characterised in that methods described is used for storage system, and the storage system, which includes primary storage medium, caching medium and controller, methods described, to be included：
After the controller is received to the write request of the primary storage medium, target data is cached to the caching medium according to write record corresponding to the write request；
The controller backs up according to the write record in predetermined time to the target data.
2. according to the method for claim 1, it is characterized in that, the write record includes object field, offset field, length field and data field, the offset field is used to indicate the target location that the target data is write to destination object corresponding to the object field, the length field indicates the target length of the target data, and the data field is the target data for writing the destination object.
3. according to the method for claim 2, it is characterised in that the predetermined time includes the first predetermined time and the second predetermined time, and the controller backs up according to the write record in predetermined time to the target data, including：
The controller performs default backup policy, obtains the write record set between first predetermined time and second predetermined time, obtains the variance data set that the write record set includes；
And the variance data set is backed up.
4. according to the method for claim 3, it is characterised in that described to be cached target data to the caching medium according to the write request, when the primary storage medium by target data write-in, methods described also includes one of following item：
When the write buffer data in the target data are write into the primary storage medium, if the write buffer data are not backed up, the controller preserves the write buffer data to the increment space in the primary storage medium；
When the write buffer data in the target data are write into the primary storage medium, the controller preserves the write buffer data to the increment space in the primary storage medium；
The write buffer data are incremental data of first predetermined time to second predetermined time.
5. method according to claim 1 or 2, it is characterized in that, the target data includes the first data, the second data and the 3rd data, second data are the variance datas on the basis of first data, 3rd data are the variance datas on the basis of first data and second data, and the write record according to corresponding to the write request caches target data to the caching medium；The controller reads the target data of caching from the caching medium, and the target data is write into the primary storage medium；The controller backs up according to the write record in predetermined time to the target data, including：
The controller is according to the write request by first data buffer storage to the caching medium, it was recorded as the first moment at the time of first data buffer storage is completed, first data are backed up at first moment, Backup Data using the write record before first moment as first time backup, the Backup Data that the first time is backed up back up；
By second data buffer storage to the caching medium, it was recorded as the second moment at the time of second data buffer storage is completed, second data are backed up at second moment, variance data using the write record between first moment and second moment as second of backup, the variance data of second of backup is backed up, and deletes first moment；
By the 3rd data buffer storage to the caching medium, it was recorded as the 3rd moment at the time of 3rd data buffer storage is completed, the 3rd data are backed up at the 3rd moment, variance data using the write record between second moment and the 3rd moment as third time backup, the variance data that the third time is backed up backs up, and deletes second moment.
6. a kind of storage system, it is characterised in that the storage system includes：
Primary storage medium, caching medium and controller；
The controller, after receiving to the write request of the primary storage medium, target data is cached to the caching medium according to write record corresponding to the write request；
And the target data is backed up in predetermined time according to the write record；
The caching medium is used to cache the target data for writing the primary storage medium；
The primary storage medium is used to store the target data.
7. storage system according to claim 6, it is characterized in that, the write record includes object field, offset field, length field and data field, the offset field is used to indicate the target location that the target data is write to destination object corresponding to the object field, the length field indicates the target length of the target data, and the data field is the target data for writing the destination object.
8. storage system according to claim 7, it is characterised in that the predetermined time includes the first predetermined time and the second predetermined time, and the controller is specifically used for including：
Default backup policy is performed, the write record set between first predetermined time and second predetermined time is obtained, obtains the variance data set that the write record set includes, and the variance data set is backed up.
9. storage system according to claim 8, it is characterised in that the controller caches target data to the caching medium according to the write request, when the target data is write into the primary storage medium, is additionally operable to perform one of following item：
When the write buffer data in the target data are write into the primary storage medium, if the write buffer data are not backed up, the write buffer data are preserved to the increment space in the primary storage medium；
When the write buffer data in the target data are write into the primary storage medium, the write buffer data are preserved to the increment space in the primary storage medium；
The write buffer data are incremental data of first predetermined time to second predetermined time.
10. the storage system according to claim 6 or 7, it is characterized in that, the target data includes the first data, the second data and the 3rd data, second data are the variance datas on the basis of first data, 3rd data are the variance datas on the basis of first data and second data, and the write record according to corresponding to the write request caches target data to the caching medium；The controller is specifically used for：
According to the write request by first data buffer storage to the caching medium, it was recorded as the first moment at the time of first data buffer storage is completed, first data is backed up at first moment；Backup Data using the write record before first moment as first time backup, the Backup Data that the first time is backed up back up；
By second data buffer storage to the caching medium, it was recorded as the second moment at the time of second data buffer storage is completed, second data are backed up at first moment, variance data using the write record between first moment and second moment as second of backup, the variance data of second of backup is backed up, and deletes first moment；
By the 3rd data buffer storage to the caching medium, it was recorded as the 3rd moment at the time of 3rd data buffer storage is completed, the 3rd data are backed up at the 3rd moment, variance data using the write record between second moment and the 3rd moment as third time backup, the variance data that the third time is backed up backs up, and deletes second moment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610330461.4A CN107402838A (en) | 2016-05-18 | 2016-05-18 | A kind of backup method and storage system based on write buffer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610330461.4A CN107402838A (en) | 2016-05-18 | 2016-05-18 | A kind of backup method and storage system based on write buffer |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107402838A true CN107402838A (en) | 2017-11-28 |
Family
ID=60394220
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610330461.4A Pending CN107402838A (en) | 2016-05-18 | 2016-05-18 | A kind of backup method and storage system based on write buffer |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107402838A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108829613A (en) * | 2018-05-24 | 2018-11-16 | 中山市江波龙电子有限公司 | Date storage method and storage equipment |
| CN109542683A (en) * | 2018-11-19 | 2019-03-29 | 郑州云海信息技术有限公司 | A kind of data transmission method based on period asynchronous replication, apparatus and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1849577A (en) * | 2003-08-14 | 2006-10-18 | 克姆佩棱特科技公司 | Virtual disk drive system and method |
| CN101295276A (en) * | 2008-06-20 | 2008-10-29 | 中国科学院计算技术研究所 | Magnetic disk data backup system and method |
| CN103049353A (en) * | 2012-12-21 | 2013-04-17 | 华为技术有限公司 | Data backup method and related device |
| US20130111262A1 (en) * | 2010-05-03 | 2013-05-02 | Panzura, Inc. | Providing disaster recovery for a distributed filesystem |
| CN103543958A (en) * | 2013-09-30 | 2014-01-29 | 华为技术有限公司 | Method and device for copying incremental data |
| CN105022678A (en) * | 2015-07-02 | 2015-11-04 | 深圳市深信服电子科技有限公司 | Data backup method and apparatus for virtual machine |
-
2016
- 2016-05-18 CN CN201610330461.4A patent/CN107402838A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1849577A (en) * | 2003-08-14 | 2006-10-18 | 克姆佩棱特科技公司 | Virtual disk drive system and method |
| CN101295276A (en) * | 2008-06-20 | 2008-10-29 | 中国科学院计算技术研究所 | Magnetic disk data backup system and method |
| US20130111262A1 (en) * | 2010-05-03 | 2013-05-02 | Panzura, Inc. | Providing disaster recovery for a distributed filesystem |
| CN103049353A (en) * | 2012-12-21 | 2013-04-17 | 华为技术有限公司 | Data backup method and related device |
| CN103543958A (en) * | 2013-09-30 | 2014-01-29 | 华为技术有限公司 | Method and device for copying incremental data |
| CN105022678A (en) * | 2015-07-02 | 2015-11-04 | 深圳市深信服电子科技有限公司 | Data backup method and apparatus for virtual machine |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108829613A (en) * | 2018-05-24 | 2018-11-16 | 中山市江波龙电子有限公司 | Date storage method and storage equipment |
| CN108829613B (en) * | 2018-05-24 | 2020-12-29 | 中山市江波龙电子有限公司 | Data storage method and storage device |
| CN109542683A (en) * | 2018-11-19 | 2019-03-29 | 郑州云海信息技术有限公司 | A kind of data transmission method based on period asynchronous replication, apparatus and system |
| CN109542683B (en) * | 2018-11-19 | 2021-10-29 | 郑州云海信息技术有限公司 | Data transmission method, device and system based on periodic asynchronous replication |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6009095B2 (en) | Storage system and storage control method | |
| JP5346536B2 (en) | Information backup / restore processing device and information backup / restore processing system | |
| CN102681794B (en) | Method and system for realizing redundant array protection of a disk based on double controllers | |
| US6513093B1 (en) | High reliability, high performance disk array storage system | |
| US20160335164A1 (en) | Recovering a volume table and data sets | |
| US8055846B2 (en) | Data vaulting in emergency shutdown | |
| CN104035830B (en) | A kind of data reconstruction method and device | |
| US10467044B2 (en) | Transaction processing method and apparatus, and computer system | |
| EP2905706B1 (en) | Data processing device and data processing method | |
| CN104461390A (en) | Method and device for writing data into imbricate magnetic recording SMR hard disk | |
| WO2018098972A1 (en) | Log recovery method, storage device and storage node | |
| CN104407933A (en) | Data backup method and device | |
| CN1645335A (en) | Method, system, and article of manufacture for consistent copying of storage volumes | |
| CN101567211A (en) | Method for improving usability of disk and disk array controller | |
| US20190034103A1 (en) | Remote direct memory access | |
| CN103221925A (en) | Data processing method and storage equipment | |
| US9292213B2 (en) | Maintaining at least one journal and/or at least one data structure by circuitry | |
| CN104281538A (en) | Storage device capacity expanding and snapping method and storage devices | |
| CN104461773A (en) | Backup deduplication method of virtual machine | |
| CN108733326B (en) | Disk processing method and device | |
| CN101937378B (en) | Method for carrying out back-up protection on data of storage equipment and computer system | |
| CN108874574A (en) | A kind of garbage reclamation processing method and relevant apparatus | |
| CN107402838A (en) | A kind of backup method and storage system based on write buffer | |
| TWI774388B (en) | Method of data synchronization | |
| US20140372672A1 (en) | System and method for providing improved system performance by moving pinned data to open nand flash interface working group modules while the system is in a running state |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171128 |