CN106919472A - The snap backup method and device of data - Google Patents

The snap backup method and device of data Download PDF

Info

Publication number
CN106919472A
CN106919472A CN201510998473.XA CN201510998473A CN106919472A CN 106919472 A CN106919472 A CN 106919472A CN 201510998473 A CN201510998473 A CN 201510998473A CN 106919472 A CN106919472 A CN 106919472A
Authority
CN
China
Prior art keywords
data
virtual machine
snapshot
cloud platform
basic data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510998473.XA
Other languages
Chinese (zh)
Other versions
CN106919472B (en
Inventor
刘勇
张晓光
郁志强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201510998473.XA priority Critical patent/CN106919472B/en
Publication of CN106919472A publication Critical patent/CN106919472A/en
Application granted granted Critical
Publication of CN106919472B publication Critical patent/CN106919472B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1451Management of the data involved in backup or backup restore by selection of backup contents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1479Generic software techniques for error detection or fault masking
    • G06F11/1482Generic software techniques for error detection or fault masking by means of middleware or OS functionality
    • G06F11/1484Generic software techniques for error detection or fault masking by means of middleware or OS functionality involving virtual machines

Abstract

The embodiment of the invention discloses a kind of snap backup method of data, including:Determine the classification of respective basic data in the data of multiple virtual machines in cloud platform;The unification of the basic data in the data of the virtual machine corresponding to same foundation data category will be belonged to carries out a snapshot, and respective variance data individually carries out snapshot in belonging to the data of the virtual machine corresponding to same foundation data category.The embodiment of the present invention also discloses a kind of snapshot device of data simultaneously.

Description

The snap backup method and device of data
Technical field
The present invention relates to the redundancy technique of data, more particularly to a kind of data snap backup method and device.
Background technology
Fig. 1 is the structural representation of the data storage of virtual machine, as shown in figure 1, for each virtual machine For, data storage is constituted by basic data part and variance data part;Wherein, basic data part is The mirror image data chosen during virtual machine creating, variance data part is the actual data of itself of virtual machine;It is based on Multiple virtual machines of cloud platform are created using same mirror image and can then share same basic data part, and institute is not Same is that variance data part is each to safeguard the data of oneself.
Current cloud platform is in the data storage of snapshot virtual machine using the side of full dose snapshot Formula, Fig. 2 is the operation chart that full dose snapshot mode is used to the data storage of virtual machine, such as Fig. 2 Shown, current cloud platform has three virtual machines, respectively virtual machine A, virtual machine B, virtual machine C; The data storage of virtual machine A is made up of basic data A and variance data A1, the storage number of virtual machine B Constituted according to by basic data B and variance data B1, the data storage of virtual machine C by basic data C and Variance data C1 is constituted;All it is to each virtual machine for full dose snapshot each time Basic data part and variance data part carry out whole snapshots, finally, enter for virtual machine A Data A and variance data An based on result after row snapshot, carries out snapshot standby for virtual machine B Data B and variance data Bn based on result after part, the knot after snapshot is carried out for virtual machine C Data C and variance data Cn based on fruit;Cloud platform when batch full dose snapshot is carried out, often The data of redundancy will be produced, and data volume can be caused to increase sharply, disk read-write pressure is excessive, reduce snapshot The efficiency of backup.
The content of the invention
In view of this, the embodiment of the present invention is expected to provide a kind of snap backup method and device of data, to subtract The data volume of few snapshot and the read-write pressure of disk, the effective efficiency for improving snapshot.
To reach above-mentioned purpose, the technical proposal of the invention is realized in this way:
The present invention provides a kind of snap backup method of data, and methods described includes:
Determine the classification of respective basic data in the data of multiple virtual machines in cloud platform;
The unification of the basic data in the data of the virtual machine corresponding to same foundation data category will be belonged to carries out one Secondary snapshot, will belong to respective difference number in the data of the virtual machine corresponding to same foundation data category According to individually carrying out snapshot.
In the above method, respective class of basic data in the data of multiple virtual machines in the determination cloud platform Before not, methods described also includes:
Obtain the information of respective basic data in the data of multiple virtual machines in the cloud platform.
In the above method, the classification of respective basic data in the data for determining multiple virtual machines in cloud platform, Including:
According in the data of multiple virtual machines in the cloud platform, each the information of basic data determines that the cloud is put down Respective classification of basic data in the data of multiple virtual machines in platform.
In the above method, respective class of basic data in the data of multiple virtual machines in the determination cloud platform After not, the basic data in the data of the corresponding virtual machine that will belong to same foundation data category Before unification carries out a snapshot, methods described also includes:
By each the classification of basic data is classified in the data of multiple virtual machines in the cloud platform, obtain Belong to the virtual machine corresponding to same foundation data category.
In the above method, in the data that the virtual machine corresponding to same foundation data category will be belonged to each Variance data individually carry out snapshot, including:
Respective variance data is individually entered during the data of the virtual machine corresponding to same foundation data category will be belonged to Row incremental snapshot is backed up.
The present invention also provides a kind of snapshot device of data, and described device includes:
Determining module, for the classification of respective basic data in the data for determining multiple virtual machines in cloud platform;
Backup module, for the basis in the data that will belong to the virtual machine corresponding to same foundation data category Data unification carries out a snapshot, will belong to the data of the virtual machine corresponding to same foundation data category In respective variance data individually carry out snapshot.
In said apparatus, described device also includes:
Acquisition module, for the letter of respective basic data in the data for obtaining multiple virtual machines in the cloud platform Breath.
In said apparatus, the determining module, specifically for the number according to multiple virtual machines in the cloud platform The information of respective basic data determines in the cloud platform in the data of multiple virtual machines each basic data in Classification.
In said apparatus, described device also includes:
Sort module, for by respective classification of basic data in the data of multiple virtual machine in the cloud platform Classified, obtain belonging to the virtual machine corresponding to same foundation data category.
In said apparatus, the backup module, specifically for will belong to corresponding to same foundation data category Respective variance data individually carries out incremental snapshot backup in the data of virtual machine.
The snap backup method and device of data provided in an embodiment of the present invention, it is first determined multiple in cloud platform The classification of respective basic data, then will belong to corresponding to same foundation data category in the data of virtual machine Basic data unification in the data of virtual machine carries out a snapshot, will belong to same foundation data category Respective variance data individually carries out snapshot in the data of corresponding virtual machine;Realizing will belong to same The public data division of one virtual machine of basic data classification only does a snapshot, greatly reduces The number of times of basic data snapshot when virtual machine snapshot is backed up, reduces snapshot on the whole The read-write pressure of data volume and disk, effectively raises the efficiency of snapshot.
Brief description of the drawings
Fig. 1 is the structural representation of the data storage of virtual machine;
Fig. 2 is the operation chart that full dose snapshot mode is used to the data storage of virtual machine;
Fig. 3 is the flow chart of the snap backup method embodiment of data of the present invention;
Fig. 4 is the operation chart of the snap backup method embodiment of data of the present invention;
Fig. 5 is the structural representation of the snapshot device embodiment of data of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly Chu, it is fully described by.
Fig. 3 is the flow chart of the snap backup method embodiment of data of the present invention, as shown in figure 3, this method May include steps of:
Step 101, obtain in the data of multiple virtual machines in cloud platform each information of basic data.
Cloud platform (Cloud platforms) provide based on " cloud " service, for developer create using when adopt With, it may not be necessary to build the basis of oneself, can be created by cloud platform completely new software service should With;In embodiments of the present invention, this method can be applied in OpenStack cloud computing management platforms.
The snapshot device of data can obtain in cloud platform in the data of multiple virtual machines respective basic data Information, the information of respective basic data represents the classification belonging to respective basic data;For example, Fig. 4 is The operation chart of the snap backup method embodiment of data of the present invention, as shown in figure 4, the snapshot of data is standby Part device obtain in cloud platform 6 virtual machines (virtual machine A, virtual machine B, virtual machine C, virtual machine D, Virtual machine E, virtual machine F) data in each basic data (basic data A, basic data B, basis Data C, basic data D, basic data E, basic data F) information.
Explanation is needed exist for, the snapshot device of data obtains the how many numbers of virtual machine in cloud platform Amount can be configured according to the actual requirements, not be limited herein.
Step 102, determine in the cloud platform in the data of multiple virtual machines each classification of basic data.
The snapshot device of data is according to each basic in the data of multiple virtual machines in the cloud platform for getting The information of data determines in cloud platform in the data of multiple virtual machines each classification of basic data, for each Individual virtual machine, it is determined that each classification of basic data;For example, as shown in Figure 4, it is determined that virtual machine A's It is data category one based on the basic data B of data category one, virtual machine B based on basic data A, empty Data category one based on the basic data C of plan machine C, it is determined that the basic data D of virtual machine D is base Data category two, the basic number of virtual machine F based on plinth data category two, the basic data E of virtual machine E According to data category based on F two.
Step 103, by each the classification of basic data is carried out in the data of multiple virtual machine in the cloud platform Classification, obtains belonging to the virtual machine corresponding to same foundation data category.
The snapshot device of data is by respective classification of basic data in the data of multiple virtual machine in cloud platform Classified, obtain belonging to the virtual machine corresponding to same foundation data category;For example, as shown in figure 4, The virtual machine A of basic data classification one, virtual machine B, virtual machine C will be belonged to and be formulated for same class, will belonged to Virtual machine D, virtual machine E in basic data classification two, virtual machine F are formulated for an other class.
Step 104, the basic data that will belong in the data of the virtual machine corresponding to same foundation data category Unification carries out a snapshot, will belong to each in the data of the virtual machine corresponding to same foundation data category From variance data individually carry out snapshot.
The snapshot device of data will belong in the data of the virtual machine corresponding to same foundation data category Basic data unification carries out a snapshot, will belong to virtual machine corresponding to same foundation data category Respective variance data individually carries out snapshot in data, wherein, same foundation data category institute will be belonged to Respective variance data individually carries out incremental snapshot backup in the data of corresponding virtual machine;
For example, as shown in figure 4, due to the basic data A of virtual machine A, the basic data B of virtual machine B, The basic data C of virtual machine C belong to same foundation data category one, i.e. basic data A, basic data B, Basic data C is same basic data, and the virtual machine of all categories shares this basic data, so Only need to carry out a snapshot to basic data A, basic data B, basic data C unifications, then The variance data Bn of variance data An, virtual machine B for virtual machine A, the variance data of virtual machine C Cn individually carries out incremental snapshot backup;Each virtual machine is all using the difference of the virtual machine when recovering data Different data division and the shared basic data part of the affiliated category merge treatment, obtain complete number According to.
Similarly, due to the basic data D of virtual machine D, the basic data E of virtual machine E, virtual machine F Basic data F belongs to same foundation data category two, i.e. basic data D, basic data E, basic data F is same basic data, and the virtual machine of all categories shares this basic data, thus only need to it is right Basic data D, basic data E, basic data F unifications carry out a snapshot, then for virtual The variance data Dn of machine D, the variance data En of virtual machine E, virtual machine F variance data Fn it is independent Carry out incremental snapshot backup;Each virtual machine is all using the variance data of the virtual machine when recovering data The basic data part that part and the affiliated category are shared merges treatment, obtains complete data.
It can be seen that for basic data classification one and the different classes of virtual machine of the fraction of basic data classification two When, it is necessary to carry out classification treatment in respective classification, this is done so that a public affairs for the virtual machine of classification Common data division only does a snapshot, greatly reduces basic data when virtual machine snapshot is backed up The number of times of snapshot, reduces the data volume of snapshot and the read-write pressure of disk on the whole, has The efficiency that improve snapshot of effect.
The snap backup method of data provided in an embodiment of the present invention, it is first determined multiple virtual machines in cloud platform Data in each basic data classification, then will belong to the virtual machine corresponding to same foundation data category Data in basic data unification carry out a snapshot, will belong to corresponding to same foundation data category Virtual machine data in respective variance data individually carry out snapshot;Realizing will belong to same base The public data division of the virtual machine of plinth data category only does a snapshot, greatly reduces virtual The number of times of basic data snapshot during machine snapshot, reduces the data volume of snapshot on the whole And the read-write pressure of disk, effectively raise the efficiency of snapshot.
Fig. 5 is the structural representation of the snapshot device embodiment of data of the present invention, as shown in figure 5, should The snapshot device 05 of data can include:Determining module 51, backup module 52;Wherein,
The determining module 51, for respective basic data in the data for determining multiple virtual machines in cloud platform Classification;
The backup module 52, in the data that will belong to the virtual machine corresponding to same foundation data category Basic data unification carry out a snapshot, the virtual machine corresponding to same foundation data category will be belonged to Data in respective variance data individually carry out snapshot.
Further, described device also includes:Acquisition module 53;Wherein,
The acquisition module 53, for respective basis number in the data for obtaining multiple virtual machines in the cloud platform According to information.
Further, the determining module 51, specifically for the number according to multiple virtual machines in the cloud platform The information of respective basic data determines in the cloud platform in the data of multiple virtual machines each basic data in Classification.
Further, described device also includes:Sort module 54;Wherein,
The sort module 54, for by respective basic data in the data of multiple virtual machine in the cloud platform Classification classified, obtain belonging to the virtual machine corresponding to same foundation data category.
Further, the backup module 52, specifically for will belong to corresponding to same foundation data category Respective variance data individually carries out incremental snapshot backup in the data of virtual machine.
The device of the present embodiment, can be used for performing the technical scheme of above-mentioned shown embodiment of the method, its realization Principle is similar with technique effect, and here is omitted.
In actual applications, the determining module 51, backup module 52, acquisition module 53, sort module 54 can be by the central processing unit (CPU) on device, microprocessor (MPU), digital signal processor Or the device such as field programmable gate array (FPGA) is realized (DSP).
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or meter Calculation machine program product.Therefore, the present invention can using hardware embodiment, software implementation or combine software and The form of the embodiment of hardware aspect.And, the present invention can be used and wherein include calculating at one or more Computer-usable storage medium (the including but not limited to magnetic disk storage and optical storage of machine usable program code Device etc.) on implement computer program product form.
The present invention is with reference to method according to embodiments of the present invention, equipment (system) and computer program product Flow chart and/or block diagram describe.It should be understood that flow chart and/or side can be realized by computer program instructions The knot of flow in each flow and/or square frame and flow chart and/or block diagram and/or square frame in block diagram Close.Can provide these computer program instructions to all-purpose computer, special-purpose computer, Embedded Processor or The processor of other programmable data processing devices is producing a machine so that by computer or other can The instruction of the computing device of programming data processing equipment is produced for realizing in one flow of flow chart or multiple The device of the function of being specified in one square frame of flow and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in can guide computer or other programmable data processing devices In the computer-readable memory for working in a specific way so that storage is in the computer-readable memory Instruction is produced includes the manufacture of command device, and the command device is realized in one flow of flow chart or multiple streams The function of being specified in one square frame of journey and/or block diagram or multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices, made Obtain and series of operation steps is performed on computer or other programmable devices to produce computer implemented place Reason, so as to the instruction performed on computer or other programmable devices is provided for realizing in flow chart one The step of function of being specified in flow or multiple one square frame of flow and/or block diagram or multiple square frames.
The above, only presently preferred embodiments of the present invention is not intended to limit protection model of the invention Enclose.

Claims (10)

1. a kind of snap backup method of data, it is characterised in that methods described includes:
Determine the classification of respective basic data in the data of multiple virtual machines in cloud platform;
The unification of the basic data in the data of the virtual machine corresponding to same foundation data category will be belonged to carries out one Secondary snapshot, will belong to respective difference number in the data of the virtual machine corresponding to same foundation data category According to individually carrying out snapshot.
2. method according to claim 1, it is characterised in that multiple empty in the determination cloud platform In the data of plan machine before the classification of respective basic data, methods described also includes:
Obtain the information of respective basic data in the data of multiple virtual machines in the cloud platform.
3. method according to claim 2, it is characterised in that multiple virtual in the determination cloud platform The classification of respective basic data in the data of machine, including:
According in the data of multiple virtual machines in the cloud platform, each the information of basic data determines that the cloud is put down Respective classification of basic data in the data of multiple virtual machines in platform.
4. according to claim 1,2 or 3 methods describeds, it is characterised in that in the determination cloud platform In the data of multiple virtual machines after the classification of respective basic data, same foundation data class will be belonged to described Before basic data unification in the data of other corresponding virtual machine carries out a snapshot, methods described Also include:
By each the classification of basic data is classified in the data of multiple virtual machines in the cloud platform, obtain Belong to the virtual machine corresponding to same foundation data category.
5. method according to claim 4, it is characterised in that described to belong to same foundation data class Respective variance data individually carries out snapshot in the data of not corresponding virtual machine, including:
Respective variance data is individually entered during the data of the virtual machine corresponding to same foundation data category will be belonged to Row incremental snapshot is backed up.
6. the snapshot device of a kind of data, it is characterised in that described device includes:
Determining module, for the classification of respective basic data in the data for determining multiple virtual machines in cloud platform;
Backup module, for the basis in the data that will belong to the virtual machine corresponding to same foundation data category Data unification carries out a snapshot, will belong to the data of the virtual machine corresponding to same foundation data category In respective variance data individually carry out snapshot.
7. device according to claim 6, it is characterised in that described device also includes:
Acquisition module, for the letter of respective basic data in the data for obtaining multiple virtual machines in the cloud platform Breath.
8. device according to claim 7, it is characterised in that the determining module, specifically for root According in the data of multiple virtual machine in the cloud platform each the information of basic data determine it is many in the cloud platform The classification of respective basic data in the data of individual virtual machine.
9. according to claim 6,7 or 8 described devices, it is characterised in that described device also includes:
Sort module, for by respective classification of basic data in the data of multiple virtual machine in the cloud platform Classified, obtain belonging to the virtual machine corresponding to same foundation data category.
10. method according to claim 9, it is characterised in that the backup module, specifically for Respective variance data is individually increased during the data of the virtual machine corresponding to same foundation data category will be belonged to Amount snapshot.
CN201510998473.XA 2015-12-28 2015-12-28 Method and device for snapshot backup of data Active CN106919472B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510998473.XA CN106919472B (en) 2015-12-28 2015-12-28 Method and device for snapshot backup of data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510998473.XA CN106919472B (en) 2015-12-28 2015-12-28 Method and device for snapshot backup of data

Publications (2)

Publication Number Publication Date
CN106919472A true CN106919472A (en) 2017-07-04
CN106919472B CN106919472B (en) 2020-05-12

Family

ID=59456364

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510998473.XA Active CN106919472B (en) 2015-12-28 2015-12-28 Method and device for snapshot backup of data

Country Status (1)

Country Link
CN (1) CN106919472B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102629224A (en) * 2012-04-26 2012-08-08 广东电子工业研究院有限公司 Method and device of integrated data disaster recovery based on cloud platform
CN103593262A (en) * 2013-11-15 2014-02-19 上海爱数软件有限公司 Virtual machine backup method based on classification
CN103593256A (en) * 2012-08-15 2014-02-19 阿里巴巴集团控股有限公司 Method and system for virtual machine snapshot backup on basis of multilayer duplicate deletion
CN104981784A (en) * 2012-11-16 2015-10-14 跨网数据管理有限公司 Software deployment and control method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102629224A (en) * 2012-04-26 2012-08-08 广东电子工业研究院有限公司 Method and device of integrated data disaster recovery based on cloud platform
CN103593256A (en) * 2012-08-15 2014-02-19 阿里巴巴集团控股有限公司 Method and system for virtual machine snapshot backup on basis of multilayer duplicate deletion
CN104981784A (en) * 2012-11-16 2015-10-14 跨网数据管理有限公司 Software deployment and control method and system
CN103593262A (en) * 2013-11-15 2014-02-19 上海爱数软件有限公司 Virtual machine backup method based on classification

Also Published As

Publication number Publication date
CN106919472B (en) 2020-05-12

Similar Documents

Publication Publication Date Title
TWI709049B (en) Random walk, cluster-based random walk method, device and equipment
WO2020168756A1 (en) Cluster log feature extraction method, and apparatus, device and storage medium
CN104346419A (en) Database analysis apparatus and method
CN107577697A (en) A kind of data processing method, device and equipment
CN110347407A (en) A kind of method, apparatus, computer equipment and medium obtaining EMS memory occupation amount
CN106886535A (en) A kind of data pick-up method and apparatus for being adapted to multiple data sources
CN105574032A (en) Rule matching operation method and device
CN106843820A (en) Code process method and apparatus
CN109934712A (en) Account checking method, account checking apparatus and electronic equipment applied to distributed system
CN110058756A (en) A kind of mask method and device of image pattern
CN106648839A (en) Method and device for processing data
CN110134646B (en) Knowledge platform service data storage and integration method and system
CN106156170A (en) The analysis of public opinion method and device
CN109656575A (en) Big data platform quick deployment method, storage medium, electronic equipment and system
CN109766167A (en) Method, apparatus, system and the equipment of timed task distribution
CN104506636A (en) Method and device for synchronizing data
CN106919472A (en) The snap backup method and device of data
CN106776275A (en) A kind of testing process automatic generation method based on Packet Multiplexing
TWI680467B (en) Random walk, cluster-based random walk method, device and equipment
CN107885527A (en) A kind of code revision method and device of test system
CN104484404B (en) One kind improves geographical raster data document handling method in distributed file system
CN114598731B (en) Cluster log acquisition method, device, equipment and storage medium
CN104424285B (en) For the method and apparatus for the impact analysis for change request
TWI662486B (en) Method and device for checking completeness of distributed business processing
CN107704362A (en) A kind of method and device based on Ambari monitoring big data components

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant