CN105677516B - A kind of back-up restoring method calculating the high efficient and reliable in storage cloud platform - Google Patents
A kind of back-up restoring method calculating the high efficient and reliable in storage cloud platform Download PDFInfo
- Publication number
- CN105677516B CN105677516B CN201610012607.0A CN201610012607A CN105677516B CN 105677516 B CN105677516 B CN 105677516B CN 201610012607 A CN201610012607 A CN 201610012607A CN 105677516 B CN105677516 B CN 105677516B
- Authority
- CN
- China
- Prior art keywords
- virtual machine
- server
- backup
- snapshot
- cloud platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1479—Generic software techniques for error detection or fault masking
- G06F11/1482—Generic software techniques for error detection or fault masking by means of middleware or OS functionality
- G06F11/1484—Generic software techniques for error detection or fault masking by means of middleware or OS functionality involving virtual machines
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Hardware Redundancy (AREA)
Abstract
The invention discloses a kind of back-up restoring methods for calculating the high efficient and reliable in storage cloud platform.It solves the problems, such as to calculate reduced performance, data reliability, system high-available caused by data backup restoration in storage cloud platform.The present invention is combined using backing up in realtime with snapshot, the method for local backup and cross-server backup combination, is locally doing difference snapshot, the resynchronisation of active/standby server resource space idle shines backup server fastly；The virtual machine high for requirement of real-time then passes through monitoring virtual machine file variation, is backuped in local with file mode, certain time or active and standby resource space idle are synchronized to backup server.Operation and backup consumption are not only reduced in this way, but also no matter virtual machine, master backup server exception can quickly recover to current or specified time point, avoid system crash even data caused by distributed file system is collapsed and lose problem completely.Cloud platform overall performance and high reliability are greatly improved, reaches and really calculates close to storage purpose.
Description
Technical field
The present invention relates to a kind of back-up restoring methods for calculating the high efficient and reliable in storage cloud platform.
Background technique
With the development of internet and mobile Internet, the cloud computing technology based on the technologies such as virtualization has goed deep into respectively
Each industry of row, the characteristics of distributing according to need by its resource polymerization, just gradually replace existing IT architecture, in cloud platform system performance and
High Availabitity, data safety and it is highly reliable be concern emphasis index.
Data storage is generally done using high-end SAN and distributed file system to ensure that data are highly reliable, it is main to save
Virtual machine associated documents, the former price, high reliablity, dynamic scalability are poor, are just gradually replaced by the latter.The latter flows now
Capable Server SAN or vSAN, main method are that the distributed file system of open source is superimposed on the basis of local file system
Virtual machine file is put into distributed file system by (such as Ceph, GlusterFS), and server is as distributed file system
Client access ensures that data are highly reliable using the copy mechanism of distributed file system, and server delay machine can be from other
Server starts the virtual machine on delay machine server, to ensure virtual machine High Availabitity.In addition being the largest property of IO in cloud platform
Energy bottleneck makes virtual machine operate in the server where its data as far as possible to reduce IO loss, that is, calculates close store.But point
Cloth filesystem manner can not perfection reach this purpose because itself be determined according to memory space data store position
It sets, calculates and storage resource is difficult completely the same, especially distributed file system is that balanced storage uses fragment memory mechanism,
Virtual-machine data is big file, can be sliced different server preservation.This mode increases intermediate link, performance loss
Be it is more serious, especially IO performance than really calculate close to storage can be greatly reduced.The reason is that between calculating and storage
It is spaced distributed file system, client will first pass through distributed file system server in the access of distributed file system
It finds document location (memory node), then by storage node accesses data, data may have multiple nodes, these nodes
Not necessarily with client in same server, if needing to access by network in this way, the delay of IO, network I/O undoubtedly will increase
Performance is than local poor an order of magnitude.In addition to ensure High Availabitity, data variation will be backuped in copy, regardless of Current resource
How occupy all can constantly back up, and especially copy the hard disk of other server will be written by network, and after receiving response
Next I/O operation can be just carried out, centre delay can be bigger, and when especially encountering obstruction, this can influence virtual machine response speed very much
Degree, occupying high, the demanding application of user experience to this kind of I/O resource of virtual desktop is mortal wound.
In addition, the reliability of distributed file system is opposite, once distributed file system collapse can not restore
It will lead to Servers-all data all to lose, this will be catastrophic consequence；And virtual-machine data loss (as accidentally deleted,
Attack) its copy also loses in real time, and copy is unreliable instead.
Summary of the invention
For above situation, there is provided herein in a kind of cloud platform based on the virtual machine file backup method of difference snapshot,
Combining in real time with difference snapshot, local backup and cross-server backup are combined, first locally doing difference
Snapshot, the resynchronisation of active/standby server resource space idle shine backup server fastly, compare distributed file system mode basic
Under the premise of not reducing system high-available, system performance and data reliability are effectively improved.
To achieve the goals above, The technical solution adopted by the invention is as follows:
A kind of back-up restoring method calculating the high efficient and reliable in storage cloud platform, including virtual machine backup, step is such as
Under:
(1) virtual machine file establishes virtual machine and host, backup to other servers in the database in distributing server
The belonging relation of server, principal and subordinate are one-to-one or one-to-many；
(2) incremental snapshot is carried out to virtual machine, forms read-only and read-write snapshot document, the former arrives for restoring virtual machine
Specified time, the latter is for storing current more new content；
(3) snapshot is synchronized to the corresponding backup server of virtual machine；
(4) timing merges snapshot, and snapshot and virtual machine file are merged.
Further, further include that virtual machine restores, operate as follows: when backup server detects host delay machine, then existing
Virtual machine on locally initiating backup delay machine server.
Still further, further including the switching of virtual machine master slave mode, operate as follows:
When server damage, when data can not be restored, host is set by backup virtual machine, is then done in other servers
Backup；
Add server when newly, partial virtual machine is needed to move to wherein, and when primary server as the virtual machine, it is right
Utilize static migrating that virtual machine (vm) migration to new demand servicing device, is then changed master-slave relationship in the virtual machine of not running；For operation
In virtual machine, need to back up in realtime to new demand servicing device, virtual machine closed on legacy server after completing backup, in new demand servicing device
Restart virtual machine.
Further, step (3) synchronizing process are as follows: Timing Synchronization snapshot document to backup server, or in real time
Synchronisation snapshot file is to backup server.
In addition, needing to detect active/standby server resource occupation amount is when real-time synchronization snapshot document is to backup server
The no free time, when idle, then synchronisation snapshot file is into backup server.
In addition, needing to monitor the readable written document of virtual machine automatically when real-time synchronization snapshot document is to backup server and becoming
Change, once it updates, using difference form file synchronization to backup server.
Compared with prior art, the present invention have the following advantages that and the utility model has the advantages that
Present invention reduces system cost, virtual machine performance and virtual desktop user experience are improved, has ensured that data can
By with system High Availabitity.Main backup operation limitation is completed during idle time, is backed up in realtime and is also limited resource consumption.Virtual machine operation
Distributed file system special secondary school is all needed not move through with backup, each more new capital is not needed yet and is deposited by network by backup server
Shelves and confirmation, it is thus only necessary to which snapshot confirmation once with confirmation of backing up in realtime, greatly reduces the resource consumptions such as IO.
Virtual machine file presses server resource and occupies dispersion backup, and there is no distributed file system collapses to cause entirely
System can not work even data all lose it is great hidden.Encounter delay machine can on other servers all void of quick start
Quasi- machine causes data that can not restore that backup can also be dispersed again on other servers even if encountering server and damaging completely.
And can be both restored to currently by backing up in realtime, it can also be restored to certain time point by snapshot, meet different requirements.
Detailed description of the invention
Fig. 1 is virtual machine backup flow diagram of the present invention.
Fig. 2 is that virtual machine of the present invention restores flow diagram.
Fig. 3 is virtual machine master slave mode switching flow schematic diagram of the present invention.
Specific embodiment
Present invention will be further explained below with reference to the attached drawings and examples, and embodiments of the present invention include but is not limited to
The following example.
Embodiment
As shown in Figure 1, a kind of back-up restoring method for calculating the high efficient and reliable in storage cloud platform, including virtual machine are standby
Part, steps are as follows:
(1) virtual machine file establishes virtual machine and host, backup to other servers in the database in distributing server
The belonging relation of server；
(2) incremental snapshot is carried out to virtual machine；As 10 minutes or 30 minutes snapshots it is primary, specifically can dynamically set as needed
It sets.The catenulate file combination of virtual-machine data shape, each snapshot generate a new file for saving real-time update after snapshot
Data, the file of front are read-only status, form multiple read-only files and a readable written document after such multiple snapshots.
(3) snapshot is synchronized to the corresponding backup server of virtual machine；
(4) timing merges snapshot, and snapshot and virtual machine file are merged, and reduces snapshot number, to reduce memory space and mention
High virtual machine performance.
Specifically, step (3) synchronizing process are as follows: Timing Synchronization snapshot document to backup server or real-time synchronization snapshot
File is to backup server；When real-time synchronization snapshot document is to backup server, need to detect synchronous priority and active and standby clothes
Whether device resource occupation amount of being engaged in is idle, and synchronisation snapshot file is into backup server when idle under normal circumstances, if real-time
It is required that high then real-time synchronization is preferential.
In addition, the virtual machine that needs are backed up in realtime is needed to monitor the read-write file change of virtual machine automatically, once more
Newly, using difference form file synchronization to backup server
As shown in Fig. 2, being operated as follows the invention also includes virtual machine recovery:
The server where the virtual machine is normal, when being only virtual-machine fail by back up in realtime file or fastly impinge upon the machine from
It moves or resumes operation manually.
The server delay machine where virtual machine, can be restored according to the automatic or manual reforestation practices of configuration.For
Automatic mode, whether backup server detects host delay machine automatically true, determine it is true after in locally initiating backup delay machine service
Virtual machine on device, manual mode are then completed by administrator, no matter manually or can first forbid on other servers automatically
Start virtual machine.Delay machine server to run virtual machine thereon need to detect virtual machine operating status after resuming operation, in stopping
Machine state could be run.
As shown in figure 3, being operated as follows the invention also includes the switching of virtual machine master slave mode:
When server damage, when data can not be restored, need backup virtual machine to be set as host, and in other servers
It backups；Specifically can first artificial judgment server data whether lose, master-slave swap is set if losing, is opened after setting
Dynamic automated back-up, virtual machine are distributed to different server backup.
Add server when newly, partial virtual machine is needed to move to wherein, and when primary server as the virtual machine, it is right
Utilize static migrating that virtual machine (vm) migration to new demand servicing device, is then changed master-slave relationship in the virtual machine of not running；For operation
In virtual machine, need to back up in realtime to new demand servicing device, virtual machine closed on legacy server after completing backup, in new demand servicing device
Restart virtual machine.
According to above-described embodiment, the present invention can be realized well.It is worth noting that before based on said structure design
It puts, to solve same technical problem, even if that makes in the present invention is some without substantive change or polishing, is used
Technical solution essence still as the present invention, therefore it should also be as within the scope of the present invention.
Claims (5)
1. a kind of back-up restoring method for calculating the high efficient and reliable in storage cloud platform, which is characterized in that standby including virtual machine
Part, steps are as follows:
(1) virtual machine file establishes virtual machine and host, backup services to other servers in the database in distributing server
The belonging relation of device, principal and subordinate are one-to-one or one-to-many；
(2) incremental snapshot is carried out to virtual machine, forms read-only and read-write snapshot document, the former is for restoring virtual machine to specifying
Time, the latter is for storing current more new content；
(3) snapshot is synchronized to the corresponding backup server of virtual machine；
(4) timing merges snapshot, and snapshot and virtual machine file are merged；
Wherein, step (3) synchronizing process are as follows: Timing Synchronization snapshot document to backup server or real-time synchronization snapshot text
Part is to backup server；
When real-time synchronization snapshot document is to backup server, synchronous priority and active/standby server resource occupation are detected before synchronizing
Whether amount is idle.
2. a kind of back-up restoring method for calculating the high efficient and reliable in storage cloud platform according to claim 1, special
Sign is, further includes that virtual machine restores, operates as follows: when backup server detects host delay machine, then locally initiating standby
Virtual machine on part delay machine server.
3. a kind of back-up restoring method for calculating the high efficient and reliable in storage cloud platform according to claim 1, special
Sign is, further includes the switching of virtual machine master slave mode, operates as follows:
When server damage, when data can not be restored, host is set by backup virtual machine, is then done in other servers standby
Part；
Add server when newly, partial virtual machine is needed to move to wherein, and when primary server as the virtual machine, for not
The virtual machine of operation utilizes static migrating that virtual machine (vm) migration to new demand servicing device, is then changed master-slave relationship；For running
Virtual machine needs to back up in realtime to new demand servicing device, closes virtual machine on legacy server after completing backup, think highly of newly in new demand servicing
Start virtual machine.
4. a kind of back-up restoring method for calculating the high efficient and reliable in storage cloud platform according to claim 1, special
Sign is, whether when real-time synchronization snapshot document is to backup server, it is idle to need to detect active/standby server resource occupation amount,
When idle, then synchronisation snapshot file is into backup server.
5. a kind of back-up restoring method for calculating the high efficient and reliable in storage cloud platform according to claim 4, special
Sign is, when real-time synchronization snapshot document is to backup server, needs to monitor the read-write file change of virtual machine automatically, once
It updates, using difference form file synchronization to backup server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610012607.0A CN105677516B (en) | 2016-01-07 | 2016-01-07 | A kind of back-up restoring method calculating the high efficient and reliable in storage cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610012607.0A CN105677516B (en) | 2016-01-07 | 2016-01-07 | A kind of back-up restoring method calculating the high efficient and reliable in storage cloud platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105677516A CN105677516A (en) | 2016-06-15 |
| CN105677516B true CN105677516B (en) | 2019-11-05 |
Family
ID=56299625
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610012607.0A Active CN105677516B (en) | 2016-01-07 | 2016-01-07 | A kind of back-up restoring method calculating the high efficient and reliable in storage cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105677516B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106371763A (en) * | 2016-08-23 | 2017-02-01 | 浪潮(北京)电子信息产业有限公司 | Snapshot storage method and apparatus, disk and computer |
| CN106445741B (en) * | 2016-09-28 | 2019-08-02 | 郑州云海信息技术有限公司 | One kind realizing oracle database disaster-tolerant backup method based on ceph |
| US10346062B2 (en) | 2016-11-16 | 2019-07-09 | International Business Machines Corporation | Point-in-time backups via a storage controller to an object storage cloud |
| CN107705387B (en) * | 2017-01-12 | 2020-11-10 | 西安艾润物联网技术服务有限责任公司 | Vehicle entering and exiting data processing method and parking lot controller |
| CN107705553B (en) * | 2017-01-13 | 2022-01-28 | 西安艾润物联网技术服务有限责任公司 | Vehicle entering and exiting data processing method and parking lot controller |
| CN108540518A (en) * | 2017-09-13 | 2018-09-14 | 韩宁康 | A kind of learning System and method |
| CN107957920A (en) * | 2017-10-31 | 2018-04-24 | 清远恒成智道信息科技有限公司 | Database backup system |
| CN108241743B (en) * | 2018-01-04 | 2020-05-12 | 杭州复杂美科技有限公司 | Block chain snapshot method |
| CN108243253B (en) * | 2018-01-11 | 2020-05-12 | 杭州复杂美科技有限公司 | Block chain link point synchronization method |
| CN108958883B (en) * | 2018-06-15 | 2021-04-09 | 北京奇艺世纪科技有限公司 | Recovery method and system for virtual machine in cloud computing cluster |
| CN108874590A (en) * | 2018-06-16 | 2018-11-23 | 武汉商启网络信息有限公司 | A kind of system of cloud host automated back-up and recovery |
| CN110069220B (en) * | 2019-04-25 | 2022-02-22 | 深信服科技股份有限公司 | Distributed scheduling method, device, equipment and computer readable storage medium |
| CN110209534B (en) * | 2019-06-14 | 2022-09-16 | 四川长虹电器股份有限公司 | System and method for automatically backing up mysql database |
| CN110855494B (en) * | 2019-11-18 | 2022-10-04 | 上海新炬网络信息技术股份有限公司 | Method for realizing high availability of agent based on distributed monitoring system |
| CN111800476A (en) * | 2020-06-14 | 2020-10-20 | 洪江川 | Data processing method based on big data and cloud computing and cloud big data server |
| CN112286729B (en) * | 2020-11-03 | 2023-02-21 | 浪潮云信息技术股份公司 | Method for restoring specified time |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5586310A (en) * | 1992-12-04 | 1996-12-17 | International Business Machines Corporation | System for distributed database replicated read with exclusive central server transfer of primary copies |
| CN102346779A (en) * | 2011-10-18 | 2012-02-08 | 中国联合网络通信集团有限公司 | Distributed file system and master control node backup method |
| CN102523257A (en) * | 2011-11-30 | 2012-06-27 | 广东电子工业研究院有限公司 | Infrastructure as a service (IAAS)-cloud-platform-based virtual machine fault-tolerance method |
| CN102521083A (en) * | 2011-12-13 | 2012-06-27 | 广州杰赛科技股份有限公司 | Backup method and system of virtual machine in cloud computing system |
| CN102662751A (en) * | 2012-03-30 | 2012-09-12 | 浪潮电子信息产业股份有限公司 | Method for improving availability of virtual machine system based on thermomigration |
| CN103593263A (en) * | 2013-11-20 | 2014-02-19 | 上海爱数软件有限公司 | Hyper-v virtual machine backup method based on backup knowledge base and file attributes |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104572354A (en) * | 2015-01-22 | 2015-04-29 | 上海迈微软件科技有限公司 | Backup and restoration method for operating system based on restoration service and equipment thereof |
-
2016
- 2016-01-07 CN CN201610012607.0A patent/CN105677516B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5586310A (en) * | 1992-12-04 | 1996-12-17 | International Business Machines Corporation | System for distributed database replicated read with exclusive central server transfer of primary copies |
| CN102346779A (en) * | 2011-10-18 | 2012-02-08 | 中国联合网络通信集团有限公司 | Distributed file system and master control node backup method |
| CN102523257A (en) * | 2011-11-30 | 2012-06-27 | 广东电子工业研究院有限公司 | Infrastructure as a service (IAAS)-cloud-platform-based virtual machine fault-tolerance method |
| CN102521083A (en) * | 2011-12-13 | 2012-06-27 | 广州杰赛科技股份有限公司 | Backup method and system of virtual machine in cloud computing system |
| CN102662751A (en) * | 2012-03-30 | 2012-09-12 | 浪潮电子信息产业股份有限公司 | Method for improving availability of virtual machine system based on thermomigration |
| CN103593263A (en) * | 2013-11-20 | 2014-02-19 | 上海爱数软件有限公司 | Hyper-v virtual machine backup method based on backup knowledge base and file attributes |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105677516A (en) | 2016-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105677516B (en) | A kind of back-up restoring method calculating the high efficient and reliable in storage cloud platform | |
| US9280430B2 (en) | Deferred replication of recovery information at site switchover | |
| US10565071B2 (en) | Smart data replication recoverer | |
| CN102521083B (en) | Backup method and system of virtual machine in cloud computing system | |
| US20140082167A1 (en) | Provision of backup functionalities in cloud computing systems | |
| CN105389230A (en) | Continuous data protection system and method combining with snapshot technology | |
| CN103345470A (en) | Database disaster tolerance method, database disaster tolerance system and server | |
| CN109189860A (en) | A kind of active and standby increment synchronization method of MySQL based on Kubernetes system | |
| CN102012947A (en) | Method and system for online backup of database | |
| CN103336728A (en) | Disk data recovery method | |
| CN102495774B (en) | Method and system for realizing system recovery of computer | |
| CN104486131B (en) | A kind of fault detect of DB2 database based on Itanium platform and switching method | |
| CN103488721B (en) | Database bisynchronous method and system for master and slave boards | |
| US9367409B2 (en) | Method and system for handling failures by tracking status of switchover or switchback | |
| CN103973725A (en) | Distributed collaboration method and collaboration device | |
| CN104660386A (en) | Method for improving DB2 disaster recovery high availability based on Itanium platform | |
| CN112380062A (en) | Method and system for rapidly recovering system for multiple times based on system backup point | |
| CN107025149A (en) | Virtual machine backup/restoration system and method | |
| CN102193813A (en) | Embedded type virtualized quick start method and system | |
| CN115878384A (en) | Distributed cluster based on backup disaster recovery system and construction method | |
| CN106325768B (en) | A kind of two-shipper storage system and method | |
| CN111666266A (en) | Data migration method and related equipment | |
| CN107402839B (en) | Method and system for backing up data | |
| CN105389231A (en) | Database dual-computer backup method and system | |
| CN112153134A (en) | Disaster tolerance drilling method, device, equipment and storage medium of disaster tolerance cloud host |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |