CN106919472A - The snap backup method and device of data - Google Patents
The snap backup method and device of data Download PDFInfo
- Publication number
- CN106919472A CN106919472A CN201510998473.XA CN201510998473A CN106919472A CN 106919472 A CN106919472 A CN 106919472A CN 201510998473 A CN201510998473 A CN 201510998473A CN 106919472 A CN106919472 A CN 106919472A
- Authority
- CN
- China
- Prior art keywords
- data
- virtual machine
- snapshot
- cloud platform
- basic data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1479—Generic software techniques for error detection or fault masking
- G06F11/1482—Generic software techniques for error detection or fault masking by means of middleware or OS functionality
- G06F11/1484—Generic software techniques for error detection or fault masking by means of middleware or OS functionality involving virtual machines
Abstract
The embodiment of the invention discloses a kind of snap backup method of data, including:Determine the classification of respective basic data in the data of multiple virtual machines in cloud platform;The unification of the basic data in the data of the virtual machine corresponding to same foundation data category will be belonged to carries out a snapshot, and respective variance data individually carries out snapshot in belonging to the data of the virtual machine corresponding to same foundation data category.The embodiment of the present invention also discloses a kind of snapshot device of data simultaneously.
Description
Technical field
The present invention relates to the redundancy technique of data, more particularly to a kind of data snap backup method and device.
Background technology
Fig. 1 is the structural representation of the data storage of virtual machine, as shown in figure 1, for each virtual machine
For, data storage is constituted by basic data part and variance data part;Wherein, basic data part is
The mirror image data chosen during virtual machine creating, variance data part is the actual data of itself of virtual machine;It is based on
Multiple virtual machines of cloud platform are created using same mirror image and can then share same basic data part, and institute is not
Same is that variance data part is each to safeguard the data of oneself.
Current cloud platform is in the data storage of snapshot virtual machine using the side of full dose snapshot
Formula, Fig. 2 is the operation chart that full dose snapshot mode is used to the data storage of virtual machine, such as Fig. 2
Shown, current cloud platform has three virtual machines, respectively virtual machine A, virtual machine B, virtual machine C;
The data storage of virtual machine A is made up of basic data A and variance data A1, the storage number of virtual machine B
Constituted according to by basic data B and variance data B1, the data storage of virtual machine C by basic data C and
Variance data C1 is constituted;All it is to each virtual machine for full dose snapshot each time
Basic data part and variance data part carry out whole snapshots, finally, enter for virtual machine A
Data A and variance data An based on result after row snapshot, carries out snapshot standby for virtual machine B
Data B and variance data Bn based on result after part, the knot after snapshot is carried out for virtual machine C
Data C and variance data Cn based on fruit;Cloud platform when batch full dose snapshot is carried out, often
The data of redundancy will be produced, and data volume can be caused to increase sharply, disk read-write pressure is excessive, reduce snapshot
The efficiency of backup.
The content of the invention
In view of this, the embodiment of the present invention is expected to provide a kind of snap backup method and device of data, to subtract
The data volume of few snapshot and the read-write pressure of disk, the effective efficiency for improving snapshot.
To reach above-mentioned purpose, the technical proposal of the invention is realized in this way:
The present invention provides a kind of snap backup method of data, and methods described includes:
Determine the classification of respective basic data in the data of multiple virtual machines in cloud platform;
The unification of the basic data in the data of the virtual machine corresponding to same foundation data category will be belonged to carries out one
Secondary snapshot, will belong to respective difference number in the data of the virtual machine corresponding to same foundation data category
According to individually carrying out snapshot.
In the above method, respective class of basic data in the data of multiple virtual machines in the determination cloud platform
Before not, methods described also includes:
Obtain the information of respective basic data in the data of multiple virtual machines in the cloud platform.
In the above method, the classification of respective basic data in the data for determining multiple virtual machines in cloud platform,
Including:
According in the data of multiple virtual machines in the cloud platform, each the information of basic data determines that the cloud is put down
Respective classification of basic data in the data of multiple virtual machines in platform.
In the above method, respective class of basic data in the data of multiple virtual machines in the determination cloud platform
After not, the basic data in the data of the corresponding virtual machine that will belong to same foundation data category
Before unification carries out a snapshot, methods described also includes:
By each the classification of basic data is classified in the data of multiple virtual machines in the cloud platform, obtain
Belong to the virtual machine corresponding to same foundation data category.
In the above method, in the data that the virtual machine corresponding to same foundation data category will be belonged to each
Variance data individually carry out snapshot, including:
Respective variance data is individually entered during the data of the virtual machine corresponding to same foundation data category will be belonged to
Row incremental snapshot is backed up.
The present invention also provides a kind of snapshot device of data, and described device includes:
Determining module, for the classification of respective basic data in the data for determining multiple virtual machines in cloud platform;
Backup module, for the basis in the data that will belong to the virtual machine corresponding to same foundation data category
Data unification carries out a snapshot, will belong to the data of the virtual machine corresponding to same foundation data category
In respective variance data individually carry out snapshot.
In said apparatus, described device also includes:
Acquisition module, for the letter of respective basic data in the data for obtaining multiple virtual machines in the cloud platform
Breath.
In said apparatus, the determining module, specifically for the number according to multiple virtual machines in the cloud platform
The information of respective basic data determines in the cloud platform in the data of multiple virtual machines each basic data in
Classification.
In said apparatus, described device also includes:
Sort module, for by respective classification of basic data in the data of multiple virtual machine in the cloud platform
Classified, obtain belonging to the virtual machine corresponding to same foundation data category.
In said apparatus, the backup module, specifically for will belong to corresponding to same foundation data category
Respective variance data individually carries out incremental snapshot backup in the data of virtual machine.
The snap backup method and device of data provided in an embodiment of the present invention, it is first determined multiple in cloud platform
The classification of respective basic data, then will belong to corresponding to same foundation data category in the data of virtual machine
Basic data unification in the data of virtual machine carries out a snapshot, will belong to same foundation data category
Respective variance data individually carries out snapshot in the data of corresponding virtual machine;Realizing will belong to same
The public data division of one virtual machine of basic data classification only does a snapshot, greatly reduces
The number of times of basic data snapshot when virtual machine snapshot is backed up, reduces snapshot on the whole
The read-write pressure of data volume and disk, effectively raises the efficiency of snapshot.
Brief description of the drawings
Fig. 1 is the structural representation of the data storage of virtual machine;
Fig. 2 is the operation chart that full dose snapshot mode is used to the data storage of virtual machine;
Fig. 3 is the flow chart of the snap backup method embodiment of data of the present invention;
Fig. 4 is the operation chart of the snap backup method embodiment of data of the present invention;
Fig. 5 is the structural representation of the snapshot device embodiment of data of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly
Chu, it is fully described by.
Fig. 3 is the flow chart of the snap backup method embodiment of data of the present invention, as shown in figure 3, this method
May include steps of:
Step 101, obtain in the data of multiple virtual machines in cloud platform each information of basic data.
Cloud platform (Cloud platforms) provide based on " cloud " service, for developer create using when adopt
With, it may not be necessary to build the basis of oneself, can be created by cloud platform completely new software service should
With;In embodiments of the present invention, this method can be applied in OpenStack cloud computing management platforms.
The snapshot device of data can obtain in cloud platform in the data of multiple virtual machines respective basic data
Information, the information of respective basic data represents the classification belonging to respective basic data;For example, Fig. 4 is
The operation chart of the snap backup method embodiment of data of the present invention, as shown in figure 4, the snapshot of data is standby
Part device obtain in cloud platform 6 virtual machines (virtual machine A, virtual machine B, virtual machine C, virtual machine D,
Virtual machine E, virtual machine F) data in each basic data (basic data A, basic data B, basis
Data C, basic data D, basic data E, basic data F) information.
Explanation is needed exist for, the snapshot device of data obtains the how many numbers of virtual machine in cloud platform
Amount can be configured according to the actual requirements, not be limited herein.
Step 102, determine in the cloud platform in the data of multiple virtual machines each classification of basic data.
The snapshot device of data is according to each basic in the data of multiple virtual machines in the cloud platform for getting
The information of data determines in cloud platform in the data of multiple virtual machines each classification of basic data, for each
Individual virtual machine, it is determined that each classification of basic data;For example, as shown in Figure 4, it is determined that virtual machine A's
It is data category one based on the basic data B of data category one, virtual machine B based on basic data A, empty
Data category one based on the basic data C of plan machine C, it is determined that the basic data D of virtual machine D is base
Data category two, the basic number of virtual machine F based on plinth data category two, the basic data E of virtual machine E
According to data category based on F two.
Step 103, by each the classification of basic data is carried out in the data of multiple virtual machine in the cloud platform
Classification, obtains belonging to the virtual machine corresponding to same foundation data category.
The snapshot device of data is by respective classification of basic data in the data of multiple virtual machine in cloud platform
Classified, obtain belonging to the virtual machine corresponding to same foundation data category;For example, as shown in figure 4,
The virtual machine A of basic data classification one, virtual machine B, virtual machine C will be belonged to and be formulated for same class, will belonged to
Virtual machine D, virtual machine E in basic data classification two, virtual machine F are formulated for an other class.
Step 104, the basic data that will belong in the data of the virtual machine corresponding to same foundation data category
Unification carries out a snapshot, will belong to each in the data of the virtual machine corresponding to same foundation data category
From variance data individually carry out snapshot.
The snapshot device of data will belong in the data of the virtual machine corresponding to same foundation data category
Basic data unification carries out a snapshot, will belong to virtual machine corresponding to same foundation data category
Respective variance data individually carries out snapshot in data, wherein, same foundation data category institute will be belonged to
Respective variance data individually carries out incremental snapshot backup in the data of corresponding virtual machine;
For example, as shown in figure 4, due to the basic data A of virtual machine A, the basic data B of virtual machine B,
The basic data C of virtual machine C belong to same foundation data category one, i.e. basic data A, basic data B,
Basic data C is same basic data, and the virtual machine of all categories shares this basic data, so
Only need to carry out a snapshot to basic data A, basic data B, basic data C unifications, then
The variance data Bn of variance data An, virtual machine B for virtual machine A, the variance data of virtual machine C
Cn individually carries out incremental snapshot backup;Each virtual machine is all using the difference of the virtual machine when recovering data
Different data division and the shared basic data part of the affiliated category merge treatment, obtain complete number
According to.
Similarly, due to the basic data D of virtual machine D, the basic data E of virtual machine E, virtual machine F
Basic data F belongs to same foundation data category two, i.e. basic data D, basic data E, basic data
F is same basic data, and the virtual machine of all categories shares this basic data, thus only need to it is right
Basic data D, basic data E, basic data F unifications carry out a snapshot, then for virtual
The variance data Dn of machine D, the variance data En of virtual machine E, virtual machine F variance data Fn it is independent
Carry out incremental snapshot backup;Each virtual machine is all using the variance data of the virtual machine when recovering data
The basic data part that part and the affiliated category are shared merges treatment, obtains complete data.
It can be seen that for basic data classification one and the different classes of virtual machine of the fraction of basic data classification two
When, it is necessary to carry out classification treatment in respective classification, this is done so that a public affairs for the virtual machine of classification
Common data division only does a snapshot, greatly reduces basic data when virtual machine snapshot is backed up
The number of times of snapshot, reduces the data volume of snapshot and the read-write pressure of disk on the whole, has
The efficiency that improve snapshot of effect.
The snap backup method of data provided in an embodiment of the present invention, it is first determined multiple virtual machines in cloud platform
Data in each basic data classification, then will belong to the virtual machine corresponding to same foundation data category
Data in basic data unification carry out a snapshot, will belong to corresponding to same foundation data category
Virtual machine data in respective variance data individually carry out snapshot;Realizing will belong to same base
The public data division of the virtual machine of plinth data category only does a snapshot, greatly reduces virtual
The number of times of basic data snapshot during machine snapshot, reduces the data volume of snapshot on the whole
And the read-write pressure of disk, effectively raise the efficiency of snapshot.
Fig. 5 is the structural representation of the snapshot device embodiment of data of the present invention, as shown in figure 5, should
The snapshot device 05 of data can include:Determining module 51, backup module 52;Wherein,
The determining module 51, for respective basic data in the data for determining multiple virtual machines in cloud platform
Classification;
The backup module 52, in the data that will belong to the virtual machine corresponding to same foundation data category
Basic data unification carry out a snapshot, the virtual machine corresponding to same foundation data category will be belonged to
Data in respective variance data individually carry out snapshot.
Further, described device also includes:Acquisition module 53;Wherein,
The acquisition module 53, for respective basis number in the data for obtaining multiple virtual machines in the cloud platform
According to information.
Further, the determining module 51, specifically for the number according to multiple virtual machines in the cloud platform
The information of respective basic data determines in the cloud platform in the data of multiple virtual machines each basic data in
Classification.
Further, described device also includes:Sort module 54;Wherein,
The sort module 54, for by respective basic data in the data of multiple virtual machine in the cloud platform
Classification classified, obtain belonging to the virtual machine corresponding to same foundation data category.
Further, the backup module 52, specifically for will belong to corresponding to same foundation data category
Respective variance data individually carries out incremental snapshot backup in the data of virtual machine.
The device of the present embodiment, can be used for performing the technical scheme of above-mentioned shown embodiment of the method, its realization
Principle is similar with technique effect, and here is omitted.
In actual applications, the determining module 51, backup module 52, acquisition module 53, sort module
54 can be by the central processing unit (CPU) on device, microprocessor (MPU), digital signal processor
Or the device such as field programmable gate array (FPGA) is realized (DSP).
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or meter
Calculation machine program product.Therefore, the present invention can using hardware embodiment, software implementation or combine software and
The form of the embodiment of hardware aspect.And, the present invention can be used and wherein include calculating at one or more
Computer-usable storage medium (the including but not limited to magnetic disk storage and optical storage of machine usable program code
Device etc.) on implement computer program product form.
The present invention is with reference to method according to embodiments of the present invention, equipment (system) and computer program product
Flow chart and/or block diagram describe.It should be understood that flow chart and/or side can be realized by computer program instructions
The knot of flow in each flow and/or square frame and flow chart and/or block diagram and/or square frame in block diagram
Close.Can provide these computer program instructions to all-purpose computer, special-purpose computer, Embedded Processor or
The processor of other programmable data processing devices is producing a machine so that by computer or other can
The instruction of the computing device of programming data processing equipment is produced for realizing in one flow of flow chart or multiple
The device of the function of being specified in one square frame of flow and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in can guide computer or other programmable data processing devices
In the computer-readable memory for working in a specific way so that storage is in the computer-readable memory
Instruction is produced includes the manufacture of command device, and the command device is realized in one flow of flow chart or multiple streams
The function of being specified in one square frame of journey and/or block diagram or multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices, made
Obtain and series of operation steps is performed on computer or other programmable devices to produce computer implemented place
Reason, so as to the instruction performed on computer or other programmable devices is provided for realizing in flow chart one
The step of function of being specified in flow or multiple one square frame of flow and/or block diagram or multiple square frames.
The above, only presently preferred embodiments of the present invention is not intended to limit protection model of the invention
Enclose.
Claims (10)
1. a kind of snap backup method of data, it is characterised in that methods described includes:
Determine the classification of respective basic data in the data of multiple virtual machines in cloud platform;
The unification of the basic data in the data of the virtual machine corresponding to same foundation data category will be belonged to carries out one
Secondary snapshot, will belong to respective difference number in the data of the virtual machine corresponding to same foundation data category
According to individually carrying out snapshot.
2. method according to claim 1, it is characterised in that multiple empty in the determination cloud platform
In the data of plan machine before the classification of respective basic data, methods described also includes:
Obtain the information of respective basic data in the data of multiple virtual machines in the cloud platform.
3. method according to claim 2, it is characterised in that multiple virtual in the determination cloud platform
The classification of respective basic data in the data of machine, including:
According in the data of multiple virtual machines in the cloud platform, each the information of basic data determines that the cloud is put down
Respective classification of basic data in the data of multiple virtual machines in platform.
4. according to claim 1,2 or 3 methods describeds, it is characterised in that in the determination cloud platform
In the data of multiple virtual machines after the classification of respective basic data, same foundation data class will be belonged to described
Before basic data unification in the data of other corresponding virtual machine carries out a snapshot, methods described
Also include:
By each the classification of basic data is classified in the data of multiple virtual machines in the cloud platform, obtain
Belong to the virtual machine corresponding to same foundation data category.
5. method according to claim 4, it is characterised in that described to belong to same foundation data class
Respective variance data individually carries out snapshot in the data of not corresponding virtual machine, including:
Respective variance data is individually entered during the data of the virtual machine corresponding to same foundation data category will be belonged to
Row incremental snapshot is backed up.
6. the snapshot device of a kind of data, it is characterised in that described device includes:
Determining module, for the classification of respective basic data in the data for determining multiple virtual machines in cloud platform;
Backup module, for the basis in the data that will belong to the virtual machine corresponding to same foundation data category
Data unification carries out a snapshot, will belong to the data of the virtual machine corresponding to same foundation data category
In respective variance data individually carry out snapshot.
7. device according to claim 6, it is characterised in that described device also includes:
Acquisition module, for the letter of respective basic data in the data for obtaining multiple virtual machines in the cloud platform
Breath.
8. device according to claim 7, it is characterised in that the determining module, specifically for root
According in the data of multiple virtual machine in the cloud platform each the information of basic data determine it is many in the cloud platform
The classification of respective basic data in the data of individual virtual machine.
9. according to claim 6,7 or 8 described devices, it is characterised in that described device also includes:
Sort module, for by respective classification of basic data in the data of multiple virtual machine in the cloud platform
Classified, obtain belonging to the virtual machine corresponding to same foundation data category.
10. method according to claim 9, it is characterised in that the backup module, specifically for
Respective variance data is individually increased during the data of the virtual machine corresponding to same foundation data category will be belonged to
Amount snapshot.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510998473.XA CN106919472B (en) | 2015-12-28 | 2015-12-28 | Method and device for snapshot backup of data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510998473.XA CN106919472B (en) | 2015-12-28 | 2015-12-28 | Method and device for snapshot backup of data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106919472A true CN106919472A (en) | 2017-07-04 |
CN106919472B CN106919472B (en) | 2020-05-12 |
Family
ID=59456364
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510998473.XA Active CN106919472B (en) | 2015-12-28 | 2015-12-28 | Method and device for snapshot backup of data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106919472B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102629224A (en) * | 2012-04-26 | 2012-08-08 | 广东电子工业研究院有限公司 | Method and device of integrated data disaster recovery based on cloud platform |
CN103593262A (en) * | 2013-11-15 | 2014-02-19 | 上海爱数软件有限公司 | Virtual machine backup method based on classification |
CN103593256A (en) * | 2012-08-15 | 2014-02-19 | 阿里巴巴集团控股有限公司 | Method and system for virtual machine snapshot backup on basis of multilayer duplicate deletion |
CN104981784A (en) * | 2012-11-16 | 2015-10-14 | 跨网数据管理有限公司 | Software deployment and control method and system |
-
2015
- 2015-12-28 CN CN201510998473.XA patent/CN106919472B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102629224A (en) * | 2012-04-26 | 2012-08-08 | 广东电子工业研究院有限公司 | Method and device of integrated data disaster recovery based on cloud platform |
CN103593256A (en) * | 2012-08-15 | 2014-02-19 | 阿里巴巴集团控股有限公司 | Method and system for virtual machine snapshot backup on basis of multilayer duplicate deletion |
CN104981784A (en) * | 2012-11-16 | 2015-10-14 | 跨网数据管理有限公司 | Software deployment and control method and system |
CN103593262A (en) * | 2013-11-15 | 2014-02-19 | 上海爱数软件有限公司 | Virtual machine backup method based on classification |
Also Published As
Publication number | Publication date |
---|---|
CN106919472B (en) | 2020-05-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI709049B (en) | Random walk, cluster-based random walk method, device and equipment | |
WO2020168756A1 (en) | Cluster log feature extraction method, and apparatus, device and storage medium | |
CN104346419A (en) | Database analysis apparatus and method | |
CN107577697A (en) | A kind of data processing method, device and equipment | |
CN110347407A (en) | A kind of method, apparatus, computer equipment and medium obtaining EMS memory occupation amount | |
CN106886535A (en) | A kind of data pick-up method and apparatus for being adapted to multiple data sources | |
CN105574032A (en) | Rule matching operation method and device | |
CN106843820A (en) | Code process method and apparatus | |
CN109934712A (en) | Account checking method, account checking apparatus and electronic equipment applied to distributed system | |
CN110058756A (en) | A kind of mask method and device of image pattern | |
CN106648839A (en) | Method and device for processing data | |
CN110134646B (en) | Knowledge platform service data storage and integration method and system | |
CN106156170A (en) | The analysis of public opinion method and device | |
CN109656575A (en) | Big data platform quick deployment method, storage medium, electronic equipment and system | |
CN109766167A (en) | Method, apparatus, system and the equipment of timed task distribution | |
CN104506636A (en) | Method and device for synchronizing data | |
CN106919472A (en) | The snap backup method and device of data | |
CN106776275A (en) | A kind of testing process automatic generation method based on Packet Multiplexing | |
TWI680467B (en) | Random walk, cluster-based random walk method, device and equipment | |
CN107885527A (en) | A kind of code revision method and device of test system | |
CN104484404B (en) | One kind improves geographical raster data document handling method in distributed file system | |
CN114598731B (en) | Cluster log acquisition method, device, equipment and storage medium | |
CN104424285B (en) | For the method and apparatus for the impact analysis for change request | |
TWI662486B (en) | Method and device for checking completeness of distributed business processing | |
CN107704362A (en) | A kind of method and device based on Ambari monitoring big data components |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |