CN107391302A - Bitmap data management method and device - Google Patents

Bitmap data management method and device Download PDF

Info

Publication number
CN107391302A
CN107391302A CN201710454245.5A CN201710454245A CN107391302A CN 107391302 A CN107391302 A CN 107391302A CN 201710454245 A CN201710454245 A CN 201710454245A CN 107391302 A CN107391302 A CN 107391302A
Authority
CN
China
Prior art keywords
event
write
bitmap data
writes
disk mirroring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710454245.5A
Other languages
Chinese (zh)
Inventor
赵泉彬
罗明皓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sangfor Technologies Co Ltd
Original Assignee
Sangfor Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sangfor Technologies Co Ltd filed Critical Sangfor Technologies Co Ltd
Priority to CN201710454245.5A priority Critical patent/CN107391302A/en
Publication of CN107391302A publication Critical patent/CN107391302A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/815Virtual

Abstract

The invention discloses a kind of bitmap data management method, including:Monitoring currently writes event with the presence or absence of the IO of virtual machine backup;When the IO that there is currently virtual machine backup writes event and writes IO in the write-in disk mirroring file of the Backup Data corresponding to event, IO is write to the bitmap data corresponding to event and is synchronously saved in the disk mirroring file.The invention also discloses a kind of bitmap data managing device.The bitmap data that the present invention is avoided that under virtual machine abnormality is lost, and then ensure that stability when virtual machine backs up, while also accordingly improves virtual machine backup efficiency.

Description

Bitmap data management method and device
Technical field
The present invention relates to virtual machine redundancy technique field, more particularly to bitmap data management method and device.
Background technology
Virtual machine backup is a critical function of virtual platform, and it is used to back up the data of virtual machine.At present Common virtual-machine data backup method is realized by snapshot difference come synchronous variance data.Needed in backup procedure IO Copy on writes are carried out to variance data, while to ensure on the page data and disk transmitted during IO Copy on writes Unanimously, thus using a bitmap data Bitmap containing dirty pages face being modified during page transmission is indicated.
In existing back mechanism, bitmap data preserve in the buffer, if main frame power-off, virtual machine shutdown (restarting) or Person's backup process such as terminates at the analogue, then bitmap data will be lost, and then need when causing to back up next time to carry out magnetic The full backup of disk data, if data in magnetic disk capacity is larger, the full backup time is also longer, and then will be serious in backup procedure Influence the performance of virtual machine.
The content of the invention
It is a primary object of the present invention to provide a kind of bitmap data management method and device, it is intended to solve in the prior art The technical problem that bitmap data is easily lost when virtual machine backs up.
To achieve the above object, the present invention provides a kind of bitmap data management method, institute's bit-map data management method bag Include:
Monitoring currently writes event with the presence or absence of the IO of virtual machine backup;
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirror During as in file, IO is write to the bitmap data corresponding to event and is synchronously saved in the disk mirroring file.
Preferably, it is described to write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event When writing in disk mirroring file, IO is write to the bitmap data corresponding to event be synchronously saved in the disk mirroring file and wrap Include:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirror During as in file, judge that this IO writes whether bitmap data corresponding to event in previous IO writes event has occurred set;
If in previous IO writes event set does not occur for the bitmap data that this IO writes corresponding to event, this IO is judged Write whether the bitmap data corresponding to event in previous IO writes event has occurred set;
If in previous IO writes event set does not occur for the bitmap data that this IO writes corresponding to event, by this IO The bitmap data corresponding to event is write synchronously to be saved in the disk mirroring file.
Preferably, whether the bitmap data for judging that this IO is write corresponding to event has occurred in previous IO writes event Also include after set:
If set occurred in previous IO writes event for the bitmap data that this IO is write corresponding to event, it is asynchronous this IO writes bitmap data corresponding to event into the disk mirroring file and returned;Or,
If set occurred in previous IO writes event for the bitmap data that this IO is write corresponding to event, asynchronous Secondary IO writes bitmap data corresponding to event into the disk mirroring file and returned.
Preferably, institute's bit-map data management method also includes:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirror During as in file, this IO is write to the bitmap data corresponding to event and is cached in preset level cache, for next IO Write the bitmap data corresponding to event and carry out set judgement;And the bitmap data write this IO corresponding to event be cached to it is pre- In the L2 cache put, set judgement is carried out for writing the bitmap data corresponding to event with next IO.
Preferably, the disk mirroring file is Qcow2 disk mirroring files, wherein, by Qcow2 disk mirrorings text The data head of part is extended and Qcow2 disk mirroring file dilatations, and the bitmap data corresponding to event is write for storage IO.
Further, to achieve the above object, the present invention also provides a kind of bitmap data managing device, institute's bit-map data Managing device includes:
Monitoring modular, event is write for monitoring the current IO with the presence or absence of virtual machine backup;
Management module, for writing event in the IO that there is currently virtual machine backup and IO being write to the backup number corresponding to event During according in write-in disk mirroring file, IO is write to the bitmap data corresponding to event and is synchronously saved in the disk mirroring file In.
Preferably, the management module is specifically used for:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirror During as in file, judge that this IO writes whether bitmap data corresponding to event in previous IO writes event has occurred set;
When set does not occur during the bitmap data that this IO is write corresponding to event writes event in previous IO, this IO is judged Write whether the bitmap data corresponding to event in previous IO writes event has occurred set;When this IO is write corresponding to event This IO is write the bitmap data corresponding to event and synchronously preserved by bitmap data when set does not occur during previous IO writes event Into the disk mirroring file.
Preferably, the management module is specifically additionally operable to:
When set has occurred during the bitmap data that this IO is write corresponding to event writes event in previous IO, it is asynchronous this IO writes bitmap data corresponding to event into the disk mirroring file and returned;Or,
When set has occurred during the bitmap data that this IO is write corresponding to event writes event in previous IO, asynchronous Secondary IO writes bitmap data corresponding to event into the disk mirroring file and returned.
Preferably, the management module is specifically additionally operable to:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirror During as in file, this IO is write to the bitmap data corresponding to event and is cached in preset level cache, for next IO Write the bitmap data corresponding to event and carry out set judgement;And the bitmap data write this IO corresponding to event be cached to it is pre- In the L2 cache put, set judgement is carried out for writing the bitmap data corresponding to event with next IO.
Preferably, the disk mirroring file is Qcow2 disk mirroring files, wherein, by Qcow2 disk mirrorings text The data head of part is extended and Qcow2 disk mirroring file dilatations, and the bitmap data corresponding to event is write for storage IO.
In the present invention, when the IO that there is currently virtual machine backup writes event, IO is write to the Backup Data corresponding to event Write in disk mirroring file, meanwhile, IO is write to the bitmap data corresponding to event and is synchronously saved in the disk mirroring file And it is non-caching in, so as to ensure that stability during virtual machine backup, while also accordingly improve virtual machine backup efficiency.
Brief description of the drawings
Fig. 1 is the schematic flow sheet of the embodiment of bitmap data management method one of the present invention;
Fig. 2 is the data structure signal of the embodiment of Qcow2 disk mirrorings file one in bitmap data management method of the present invention Figure;
Fig. 3 is the refinement schematic flow sheet of step S20 in Fig. 1;
Fig. 4 is the schematic flow sheet of the embodiment of synchronization bit pattern data one in bitmap data management method of the present invention;
Fig. 5 is the high-level schematic functional block diagram of the embodiment of bitmap data managing device one of the present invention.
The realization, functional characteristics and advantage of the object of the invention will be described further referring to the drawings in conjunction with the embodiments.
Embodiment
It should be appreciated that specific embodiment described herein is not intended to limit the present invention only to explain the present invention.
Reference picture 1, Fig. 1 are the schematic flow sheet of the embodiment of bitmap data management method one of the present invention.In the present embodiment, position Diagram data management method includes:
Step S10, monitoring currently write event with the presence or absence of the IO of virtual machine backup;
Step S20, write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write When entering in disk mirroring file, IO is write to the bitmap data corresponding to event and is synchronously saved in disk mirroring file.
In the present embodiment, IO writes event and refers specifically to deposit the variance data write-in purpose that virtual machine backs up by I/O write operation The event of storage area.It is unlimited that the mode of event is write in the present embodiment for monitoring IO, is configured with specific reference to being actually needed.
In the present embodiment, when the IO that virtual machine backup be present writes event, then the IO is write to the backup number corresponding to event According in write-in disk mirroring file.Meanwhile to ensure that bitmap data is not lost, while also allow for managing, therefore, IO is being write into thing When in the Backup Data write-in disk mirroring file corresponding to part, IO is write to the bitmap data corresponding to event and is synchronously saved in together In one disk mirroring file.
Optionally, in one embodiment, disk mirroring file is preferably Qcow2 disk mirroring files, wherein, by right The data head of Qcow2 disk mirroring files is extended and Qcow2 disk mirroring file dilatations, so that storage IO writes event institute Corresponding bitmap data, as shown in Figure 2.
For example, bitmap data is stored in disk mirroring file, VS is offline, bitmap data file is lost etc. can be prevented The generation of abnormal conditions.Such as the storage bitmap data in Qcow2 disk mirroring files, corrupted data occurs in bitmap data When can by the verifications of Qcow2 in itself come make ensure;And after I/O write operation failure, it can also be retried by IO to ensure bitmap Data are written efficiently into, and then can effectively handle the caused exception of situations such as VS is offline, bitmap data file is lost.
In addition, as shown in Fig. 2 in Qcow2 disk mirroring files, Qcow2Head extension information, Jin Erke are stated The data structure that effective compatibility is increased income, meanwhile, further state the Bitmap bitmaps corresponding to Qcow2Head extension information The data structure of data storage head, and bitmap data is stored in Qcow2 disk mirroring files, especially by interface pair Storage bitmap data are carried out in Cluster dynamically distributes section in Qcow2 disk mirroring files, while further accomplish to Qcow2 The dilatation of disk mirroring file, the bitmap data corresponding to event is write for storage IO.In addition, it is necessary to further illustrate, In the prior art, bitmap data is generally held in two bitmap data files, and one of them is used to store real-time bitmap number According to, and in the present embodiment, all bitmap datas are only stored in a bitmap data file and the bitmap data file is protected Exist in Qcow2 disk mirroring files, consequently facilitating managing and tackling various unusual conditions, ensure that the stabilization of data storage Property.
In the present embodiment, when the IO that there is currently virtual machine backup writes event, IO is write to the backup number corresponding to event According to write-in disk mirroring file in, meanwhile, IO is write to the bitmap data corresponding to event and is synchronously saved in the disk mirroring file In and it is non-caching in, so as to ensure that stability during virtual machine backup, while also accordingly improve virtual machine backup efficiency.
Reference picture 3, Fig. 3 are the refinement schematic flow sheet of step S20 in Fig. 1.Based on above-described embodiment, in the present embodiment, Above-mentioned steps S20 further comprises:
Step S201, write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write When entering in disk mirroring file, judge whether the bitmap data that this IO is write corresponding to event has occurred in previous IO writes event Set;
Step S202, if in previous IO writes event set does not occur for the bitmap data that this IO writes corresponding to event, Judge that this IO writes whether bitmap data corresponding to event in previous IO writes event has occurred set;
Step S203, if in previous IO writes event set does not occur for the bitmap data that this IO writes corresponding to event, This IO is then write to the bitmap data corresponding to event to be synchronously saved in disk mirroring file.
In the present embodiment, to ensure that bitmap data is not lost, therefore bitmap data is recorded in Qcow2 disk mirroring files In, and by bitmap data real-time synchronization into bitmap data file, then mean that each disk write I/O operation can all produce two Individual IO:One IO is used for synchronous real-time bitmap data, and another IO is used for virtual machine Backup Data write-in disk, thus this will Virtual machine performance is caused to decline to a great extent.Therefore, in the present embodiment, handled by judgement to reduce the frequency of real-time synchronization bitmap data Rate, and then the corresponding performance for lifting virtual machine.
In the present embodiment, write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event When writing in disk mirroring file, first judge this IO write bitmap data corresponding to event whether in previous IO writes event Generation set, wherein, the data that bitmap data set is used to indicate the data area that IO writes the corresponding operation of event have been repaiied Change, while also illustrate that the bitmap data corresponding to the data area has carried out record preservation.Therefore, if this IO writes event institute In previous IO writes event set does not occur for corresponding bitmap data, then needs to write this IO into the bitmap data corresponding to event Synchronously it is saved in disk mirroring file.
In addition, further to reduce the synchronizing frequency during bitmap data preserves, accordingly, it is considered to write data to user When, write that the probability of duplicate data is very big, namely previous IO write the corresponding operation of event data area and previous identical it is general Rate is very big, therefore determines whether the bitmap data that this IO is write corresponding to event has occurred in previous IO writes event Set, and if set does not occur in previous IO writes event for bitmap data that this IO is write corresponding to event, by this IO Write the bitmap data corresponding to event to be synchronously saved in disk mirroring file, so as to reduce further the synchronization of bitmap data Frequency.
It is further alternative, in one embodiment, if the bitmap data that this IO writes corresponding to event writes thing in previous IO Set occurs in part, then this asynchronous IO writes bitmap data corresponding to event into disk mirroring file and returned;Or, If set has occurred in previous IO writes event for the bitmap data that this IO writes corresponding to event, this asynchronous IO writes thing Bitmap data corresponding to part into disk mirroring file and returns, as shown in Figure 4.
It is further alternative, in one embodiment, write event in the IO that there is currently virtual machine backup and IO is write into event When in corresponding Backup Data write-in disk mirroring file, this IO is write the bitmap data corresponding to event be cached to it is preset Level cache in, carry out set judgement for writing bitmap data corresponding to event with next IO;And this IO is write into thing Bitmap data corresponding to part is cached in preset L2 cache, for writing the bitmap data corresponding to event with next IO Carry out set judgement.
In the present embodiment, it is stored in due to IO to be write to the bitmap data corresponding to event in disk mirroring file, therefore, i.e., Make in the case of virtual machine is in abnormal state (such as power down, process exception etc.), bitmap data will not also be lost.Meanwhile this Embodiment can also further be realized in synchronization bit pattern data before backup and after backup virtual machine performance it is basically identical and without decline, While so as to stability when ensure that virtual machine backup, the backup efficiency and performance of virtual machine are also accordingly improved.
Reference picture 5, Fig. 5 are the high-level schematic functional block diagram of the embodiment of bitmap data managing device one of the present invention.The present embodiment In, bitmap data managing device includes:
Monitoring modular 10, event is write for monitoring the current IO with the presence or absence of virtual machine backup;
Management module 20, for writing event in the IO that there is currently virtual machine backup and IO being write to the backup corresponding to event When in data write-in disk mirroring file, IO is write to the bitmap data corresponding to event and is synchronously saved in disk mirroring file.
In the present embodiment, IO writes event and refers specifically to deposit the variance data write-in purpose that virtual machine backs up by I/O write operation The event of storage area.In the present embodiment for monitoring modular 10 monitor IO write event mode it is unlimited, with specific reference to be actually needed into Row is set.
In the present embodiment, when the IO that the monitoring of monitoring modular 10 has virtual machine backup writes event, management module 20 should IO is write in the Backup Data write-in disk mirroring file corresponding to event.Meanwhile to ensure that bitmap data is not lost, while also just In management, management module 20 is when writing IO in the write-in disk mirroring file of the Backup Data corresponding to event, management module 20 IO is also further write to the bitmap data corresponding to event to be synchronously saved in same disk mirroring file.
Optionally, in one embodiment, disk mirroring file is preferably Qcow2 disk mirroring files, wherein, by right The data head of Qcow2 disk mirroring files is extended and Qcow2 disk mirroring file dilatations, so that storage IO writes event institute Corresponding bitmap data, as shown in Figure 2.
For example, bitmap data is stored in disk mirroring file, VS is offline, bitmap data file is lost etc. can be prevented The generation of abnormal conditions.Such as the storage bitmap data in Qcow2 disk mirroring files, corrupted data occurs in bitmap data When can by the verifications of Qcow2 in itself come make ensure;And after I/O write operation failure, it can also be retried by IO to ensure bitmap Data are written efficiently into, and then can effectively handle the caused exception of situations such as VS is offline, bitmap data file is lost.
In addition, as shown in Fig. 2 in Qcow2 disk mirroring files, Qcow2Head extension information, Jin Erke are stated The data structure that effective compatibility is increased income, meanwhile, further state the Bitmap bitmaps corresponding to Qcow2Head extension information The data structure of data storage head, and bitmap data is stored in Qcow2 disk mirroring files, especially by interface pair Storage bitmap data are carried out in Cluster dynamically distributes section in Qcow2 disk mirroring files, while further accomplish to Qcow2 The dilatation of disk mirroring file, the bitmap data corresponding to event is write for storage IO.In addition, it is necessary to further illustrate, In the prior art, bitmap data is generally held in two bitmap data files, and one of them is used to store real-time bitmap number According to, and in the present embodiment, all bitmap datas are only stored in a bitmap data file and the bitmap data file is protected Exist in Qcow2 disk mirroring files, consequently facilitating managing and tackling various unusual conditions, ensure that the stabilization of data storage Property.
In the present embodiment, when monitoring modular 10 monitors that the IO that there is currently virtual machine backup writes event, management module 20 by IO write corresponding to event Backup Datas write-in disk mirroring file in, meanwhile, management module 20 by IO write event institute it is right The bitmap data answered synchronously be saved in the disk mirroring file and it is non-caching in, so as to ensure that virtual machine backup when stabilization Property, while also accordingly improve virtual machine backup efficiency.
It is further alternative, based on above-described embodiment, in another embodiment of bitmap data managing device of the present invention, management Module 20 is specifically used for:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirror During as in file, judge that this IO writes whether bitmap data corresponding to event in previous IO writes event has occurred set;
When set does not occur during the bitmap data that this IO is write corresponding to event writes event in previous IO, this IO is judged Write whether the bitmap data corresponding to event in previous IO writes event has occurred set;When this IO is write corresponding to event This IO is write the bitmap data corresponding to event and synchronously preserved by bitmap data when set does not occur during previous IO writes event Into disk mirroring file.
In the present embodiment, to ensure that bitmap data is not lost, therefore bitmap data is recorded in Qcow2 magnetic by management module 20 In disk mirroring file, and by bitmap data real-time synchronization into bitmap data file, then mean each disk write I/O operation Two IO will be produced:One IO is used for synchronous real-time bitmap data, and another IO is used for virtual machine Backup Data write-in magnetic Disk, thus this will cause virtual machine performance to decline to a great extent.Therefore, in the present embodiment, management module 20 is handled by judgement to drop The frequency of low real-time synchronization bitmap data, and then the corresponding performance for lifting virtual machine.
In the present embodiment, write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event When writing in disk mirroring file, management module 20 first judges that whether this IO writes bitmap data corresponding to event in previous IO Write and set has occurred in event, wherein, bitmap data set is used for the number for indicating the data area that IO writes the corresponding operation of event According to having changed, while also illustrate that the bitmap data corresponding to the data area has carried out record preservation.Therefore, if this In previous IO writes event set does not occur for the bitmap data that IO writes corresponding to event, then this IO is write event by management module 20 Corresponding bitmap data is synchronously saved in disk mirroring file.
In addition, further to reduce the synchronizing frequency during bitmap data preserves, accordingly, it is considered to write data to user When, write that the probability of duplicate data is very big, namely previous IO write the corresponding operation of event data area and previous identical it is general Rate is very big, therefore management module 20 determines whether that this IO writes whether bitmap data corresponding to event in previous IO writes thing Set has occurred in part, and if set does not occur in previous IO writes event for bitmap data that this IO is write corresponding to event, The bitmap data that then management module 20 is write this IO corresponding to event is synchronously saved in disk mirroring file, so as to further Reduce the synchronizing frequency of bitmap data.
Further alternative, in one embodiment, management module 20 is additionally operable to:When this IO writes the bitmap corresponding to event For data when set has occurred during previous IO writes event, this asynchronous IO writes bitmap data corresponding to event to disk mirroring In file and return;Or, when set has occurred during this IO bitmap datas write corresponding to event write event in previous IO, This asynchronous IO writes bitmap data corresponding to event into disk mirroring file and returned, as shown in Figure 4.
It is further alternative, in one embodiment, write event in the IO that there is currently virtual machine backup and IO is write into event When in corresponding Backup Data write-in disk mirroring file, management module 20 writes this IO the bitmap data corresponding to event It is cached in preset level cache, set judgement is carried out for writing the bitmap data corresponding to event with next IO;And pipe The bitmap data that reason module 20 is write this IO corresponding to event is cached in preset L2 cache, for being write with next IO Bitmap data corresponding to event carries out set judgement.
In the present embodiment, it is stored in due to IO to be write to the bitmap data corresponding to event in disk mirroring file, therefore, i.e., Make in the case of virtual machine is in abnormal state (such as power down, process exception etc.), bitmap data will not also be lost.Meanwhile this Embodiment can also further be realized in synchronization bit pattern data before backup and after backup virtual machine performance it is basically identical and without decline, While so as to stability when ensure that virtual machine backup, the backup efficiency and performance of virtual machine are also accordingly improved.
The preferred embodiments of the present invention are these are only, are not intended to limit the scope of the invention, it is every to utilize this hair The equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills Art field, is included within the scope of the present invention.

Claims (10)

1. a kind of bitmap data management method, it is characterised in that institute's bit-map data management method includes:
Monitoring currently writes event with the presence or absence of the IO of virtual machine backup;
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirroring text When in part, IO is write to the bitmap data corresponding to event and is synchronously saved in the disk mirroring file.
2. bitmap data management method as claimed in claim 1, it is characterised in that described to there is currently virtual machine backup When IO writes event and IO write in the Backup Data write-in disk mirroring file corresponding to event, IO is write to the position corresponding to event Diagram data, which is synchronously saved in the disk mirroring file, to be included:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirroring text When in part, judge that this IO writes whether bitmap data corresponding to event in previous IO writes event has occurred set;
If in previous IO writes event set does not occur for the bitmap data that this IO writes corresponding to event, judge that this IO writes thing Whether bitmap data corresponding to part in previous IO writes event has occurred set;
If in previous IO writes event set does not occur for the bitmap data that this IO writes corresponding to event, this IO is write into thing Bitmap data corresponding to part is synchronously saved in the disk mirroring file.
3. bitmap data management method as claimed in claim 2, it is characterised in that described this IO of judgement is write corresponding to event Bitmap data whether occurred also to include after set in previous IO writes event:
If set has occurred in previous IO writes event for the bitmap data that this IO writes corresponding to event, this asynchronous IO writes Bitmap data corresponding to event into the disk mirroring file and returns;Or,
If set, this asynchronous IO have occurred in previous IO writes event for the bitmap data that this IO writes corresponding to event The bitmap data corresponding to event is write into the disk mirroring file and is returned.
4. bitmap data management method as claimed in claim 2, it is characterised in that institute's bit-map data management method is also wrapped Include:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirroring text When in part, this IO is write to the bitmap data corresponding to event and is cached in preset level cache, for writing thing with next IO Bitmap data corresponding to part carries out set judgement;And the bitmap data write this IO corresponding to event be cached to it is preset In L2 cache, set judgement is carried out for writing the bitmap data corresponding to event with next IO.
5. the bitmap data management method as any one of Claims 1-4, it is characterised in that the disk mirroring text Part is Qcow2 disk mirroring files, wherein, by being extended to the data head of Qcow2 disk mirroring files and Qcow2 magnetic Disk mirroring file dilatation, the bitmap data corresponding to event is write for storage IO.
6. a kind of bitmap data managing device, it is characterised in that institute's bit-map data managing device includes:
Monitoring modular, event is write for monitoring the current IO with the presence or absence of virtual machine backup;
Management module, write for writing event in the IO that there is currently virtual machine backup and IO being write to the Backup Data corresponding to event When entering in disk mirroring file, IO is write to the bitmap data corresponding to event and is synchronously saved in the disk mirroring file.
7. bitmap data managing device as claimed in claim 6, it is characterised in that the management module is specifically used for:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirroring text When in part, judge that this IO writes whether bitmap data corresponding to event in previous IO writes event has occurred set;
When set does not occur during the bitmap data that this IO is write corresponding to event writes event in previous IO, judge that this IO writes thing Whether bitmap data corresponding to part in previous IO writes event has occurred set;When this IO writes the bitmap corresponding to event This IO is write the bitmap data corresponding to event and is synchronously saved in institute by data when set does not occur during previous IO writes event State in disk mirroring file.
8. bitmap data managing device as claimed in claim 7, it is characterised in that the management module is specifically additionally operable to:
When set has occurred during the bitmap data that this IO is write corresponding to event writes event in previous IO, this asynchronous IO writes Bitmap data corresponding to event into the disk mirroring file and returns;Or,
When set has occurred during the bitmap data that this IO is write corresponding to event writes event in previous IO, this asynchronous IO The bitmap data corresponding to event is write into the disk mirroring file and is returned.
9. bitmap data managing device as claimed in claim 7, it is characterised in that the management module is specifically additionally operable to:
Write event in the IO that there is currently virtual machine backup and IO is write to the Backup Data corresponding to event and write disk mirroring text When in part, this IO is write to the bitmap data corresponding to event and is cached in preset level cache, for writing thing with next IO Bitmap data corresponding to part carries out set judgement;And the bitmap data write this IO corresponding to event be cached to it is preset In L2 cache, set judgement is carried out for writing the bitmap data corresponding to event with next IO.
10. the bitmap data managing device as any one of claim 6 to 9, it is characterised in that the disk mirroring text Part is Qcow2 disk mirroring files, wherein, by being extended to the data head of Qcow2 disk mirroring files and Qcow2 magnetic Disk mirroring file dilatation, the bitmap data corresponding to event is write for storage IO.
CN201710454245.5A 2017-06-14 2017-06-14 Bitmap data management method and device Pending CN107391302A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710454245.5A CN107391302A (en) 2017-06-14 2017-06-14 Bitmap data management method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710454245.5A CN107391302A (en) 2017-06-14 2017-06-14 Bitmap data management method and device

Publications (1)

Publication Number Publication Date
CN107391302A true CN107391302A (en) 2017-11-24

Family

ID=60333216

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710454245.5A Pending CN107391302A (en) 2017-06-14 2017-06-14 Bitmap data management method and device

Country Status (1)

Country Link
CN (1) CN107391302A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109165118A (en) * 2018-07-25 2019-01-08 深信服科技股份有限公司 A kind of method and its device, equipment, storage medium of virtual machine backup
CN109445909A (en) * 2018-10-31 2019-03-08 深信服科技股份有限公司 Backup method, system, terminal and the storage medium of virtual-machine data
CN110825497A (en) * 2019-11-22 2020-02-21 北京浪潮数据技术有限公司 Virtual machine startup and shutdown method, device, equipment and medium
CN110837441A (en) * 2019-11-14 2020-02-25 北京京航计算通讯研究所 KVM virtual machine backup method based on dirty data bitmap and network block equipment
CN110837442A (en) * 2019-11-14 2020-02-25 北京京航计算通讯研究所 KVM virtual machine backup system based on dirty data bitmap and network block equipment
CN110955560A (en) * 2019-11-15 2020-04-03 北京浪潮数据技术有限公司 Virtual machine snapshot generation method and system, electronic device and storage medium
WO2020088533A1 (en) * 2018-11-02 2020-05-07 深信服科技股份有限公司 Disaster recovery method and apparatus for virtualization platform

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101685412A (en) * 2008-09-22 2010-03-31 联想(北京)有限公司 Hard disk data backup and restore method, system and computer
CN104253842A (en) * 2013-06-28 2014-12-31 华为技术有限公司 Method and device for synchronizing terminal mirrors, terminal and server
CN105893184A (en) * 2016-03-30 2016-08-24 杭州华三通信技术有限公司 Incremental backup method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101685412A (en) * 2008-09-22 2010-03-31 联想(北京)有限公司 Hard disk data backup and restore method, system and computer
CN104253842A (en) * 2013-06-28 2014-12-31 华为技术有限公司 Method and device for synchronizing terminal mirrors, terminal and server
CN105893184A (en) * 2016-03-30 2016-08-24 杭州华三通信技术有限公司 Incremental backup method and device

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109165118A (en) * 2018-07-25 2019-01-08 深信服科技股份有限公司 A kind of method and its device, equipment, storage medium of virtual machine backup
CN109445909A (en) * 2018-10-31 2019-03-08 深信服科技股份有限公司 Backup method, system, terminal and the storage medium of virtual-machine data
WO2020088533A1 (en) * 2018-11-02 2020-05-07 深信服科技股份有限公司 Disaster recovery method and apparatus for virtualization platform
CN110837441A (en) * 2019-11-14 2020-02-25 北京京航计算通讯研究所 KVM virtual machine backup method based on dirty data bitmap and network block equipment
CN110837442A (en) * 2019-11-14 2020-02-25 北京京航计算通讯研究所 KVM virtual machine backup system based on dirty data bitmap and network block equipment
CN110955560A (en) * 2019-11-15 2020-04-03 北京浪潮数据技术有限公司 Virtual machine snapshot generation method and system, electronic device and storage medium
CN110825497A (en) * 2019-11-22 2020-02-21 北京浪潮数据技术有限公司 Virtual machine startup and shutdown method, device, equipment and medium
CN110825497B (en) * 2019-11-22 2022-04-22 北京浪潮数据技术有限公司 Virtual machine startup and shutdown method, device, equipment and medium

Similar Documents

Publication Publication Date Title
CN107391302A (en) Bitmap data management method and device
US5832518A (en) Log file optimization in a client/server computering system
CN102955720B (en) A kind of method improving ext file system stability
CN103262054B (en) For automatically submitting device, the system and method for storer to
US7827369B2 (en) Data processing system having a plurality of storage systems
CN104077380B (en) A kind of data de-duplication method, apparatus and system
CN102792276B (en) Buffer disk in flashcopy cascade
US6766491B2 (en) Parity mirroring between controllers in an active-active controller pair
US20050120058A1 (en) File management apparatus, storage management system, storage management method, program, and recording medium
EP2948849B1 (en) System and method for replicating data
CN104598168B (en) A kind of data reconstruction method and object storage device
CN106227731B (en) A kind of data processing method, device and distributed file system
CN101453489A (en) Network additive storage device, data backup and data restoration method thereof
CN106339276B (en) A kind of data reconstruction method and system based on data backup status
CN103019623B (en) Memory disc disposal route and device
US20070101188A1 (en) Method for establishing stable storage mechanism
CN110196818A (en) Data cached method, buffer memory device and storage system
CN109167690A (en) A kind of restoration methods, device and the relevant device of the service of distributed system interior joint
CN105183868A (en) Storage method and device for logs of file system
CN103176867A (en) Fast file differential backup method
CN103207916B (en) The method and apparatus of metadata processing
CN103544081A (en) Management method and device for double metadata servers
CN105068760B (en) Date storage method, data storage device and storage device
CN100492323C (en) Method and apparatus for protecting caching content and caching controller thereof
CN103902227B (en) It is a kind of to support the additional document storage mode write and share and read

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20171124