CN110543385A

CN110543385A - Virtual backup method and virtual backup restoration method

Info

Publication number: CN110543385A
Application number: CN201910846815.4A
Authority: CN
Inventors: 徐力恒; 何琪深; 朱世明; 张东红; 李斯佳; 孙桂发
Original assignee: Guangzhou Zhujiang Digital Group Ltd By Share Ltd
Current assignee: Guangzhou Zhujiang Digital Group Ltd By Share Ltd
Priority date: 2019-09-06
Filing date: 2019-09-06
Publication date: 2019-12-06

Abstract

the invention discloses a virtualization backup method and a virtualization backup restoration method. According to the invention, the Veeam virtualization backup software is deployed on the virtualization system, so that the virtualization system is automatically and regularly called to complete data backup, the workload of operation and maintenance management is reduced, backup data is stored through a distributed storage technology, and the reliability of data storage is improved. Meanwhile, the validity of the backup data is further ensured by verifying the success of the data backup, namely verifying the recovery node of the backup data to check whether the backup data can be recovered. The invention can also restore the backup data based on the virtualization system, thereby realizing one-stop completion of data backup restoration and improving the response speed of data backup restoration.

Description

virtual backup method and virtual backup restoration method

Technical Field

The present invention relates to the field of data backup technologies, and in particular, to a virtualization backup method and a virtualization backup restoration method.

Background

In recent years, virtualization technology has become more widely used. Virtualization technology is technology in which a plurality of application servers are collectively operated on one virtualized physical server in the form of Virtual Machines (VMs). Virtualization technology can improve resource utilization rate, realize centralized management, but also increase data security risk. Once data in the physical storage device is lost, service interruptions for multiple virtual machines can result.

In the prior art, data backup has undergone multiple stages, from manual backup to automatic script backup, and then to a backup all-in-one machine for unified management and control. The backup all-in-one machine is used as an extra server, independent storage can be guaranteed, service is not affected, but each system needing backup needs to open a specific port and a link to be connected with the backup all-in-one machine, network confusion is easily caused, the deployment speed is reduced, and extra monitoring and maintenance are needed for hardware of the backup all-in-one machine. In addition, the backup data is difficult to be automatically verified quickly only by the backup all-in-one machine, and once the backup data has problems, backup is meaningless.

how to directly backup data on a virtualization system and how to automatically verify the backup data are all problems to be solved in the technical field of data backup at present.

disclosure of Invention

the technical problem to be solved by the present invention is to provide a virtualization backup method and a virtualization backup restoration method, which can reduce the workload of operation and maintenance management and implement automatic verification of backup data.

In order to solve the above technical problem, the present invention provides a virtualization backup method, including:

Responding to a received data backup request, creating a data backup task, and distributing a backup agent and a backup storage library for the data backup task;

Starting a Veeam data mover; wherein the Veeam data movers comprise a source data mover in the backup agent and a target data mover in the backup repository;

extracting VM and virtualized host information; wherein the virtualization host information comprises a vCenter server and an ESXI host;

Driving the vCenter server or the ESXI host to respond to a VM snapshot creating request and create a VM snapshot;

Driving the source data mover to read VM data from a disk of the VM, and transmitting the VM data to the target data mover according to a preset data transmission rule;

And after the VM data reading is finished, reporting the VM snapshot to the vCenter server or the ESXI host.

Further, the virtualized backup method further includes: storing all the VM data through a distributed storage technology.

further, the virtualized backup method further includes: and verifying the recovery node of the VM data.

Further, the creating a data backup task in response to the received data backup request, and allocating a backup agent and a backup repository for the data backup task, includes:

driving a Veeam backup manager to read task configuration from a configuration database according to the data backup request, and creating the data backup task according to the task configuration;

connecting the Veeam backup service with the Veeam backup manager to enable the Veeam backup service to allocate the backup agent and the backup repository.

further, the starting Veeam data mover includes:

Connecting the Veeam transmission service with the backup agent and the backup repository to enable the Veeam transmission service to respectively start the source data mover and the target mover.

Further, the VM and virtualized host information is queried from the Veeam Broker service to drive the Veeam backup manager.

Further, the preset data transmission rule includes a network traffic throttling rule.

Further, the storing all the VM data by the distributed storage technology includes:

Storing the VM data in an N + M: b mode; wherein, N is the number of data objects, M is the number of check objects, and b is the number of nodes allowed to fail.

Further, the verifying the restore node of the VM data includes: and verifying the recovery node of the VM data through SureBackup or SureRepli.

The embodiment of the invention has the following beneficial effects:

According to the embodiment of the invention, the Veeam virtualization backup software is deployed on the virtualization system, so that the virtualization system is automatically and regularly called to complete data backup, the workload of operation and maintenance management is reduced, backup data is stored through a distributed storage technology, and the reliability of data storage is improved. Meanwhile, the validity of the backup data is further ensured by verifying the success of the data backup, namely verifying the recovery node of the backup data to check whether the backup data can be recovered.

The invention also provides a virtual backup restoration method, which comprises the following steps:

Responding to a received data replication request, creating a data replication task, and distributing a backup agent and a backup storage library for the data replication task;

Driving the source data mover to read and copy VM data from a disk of the VM, and transmitting the VM data to the target data mover according to a preset data transmission rule;

Driving the target data mover to store the VM data to a raw storage path of the VM data;

The embodiment of the invention has the following beneficial effects:

according to the embodiment of the invention, the Veeam virtualization backup software is deployed on the virtualization system, so that the virtualization system can be automatically and regularly transferred to complete data backup, and backup data can be restored based on the virtualization system, so that one-stop data backup and restoration are realized, and the response speed of data backup and restoration is improved.

Drawings

fig. 1 is a flowchart illustrating a virtualization backup method according to a first embodiment of the present invention;

FIG. 2 is a system configuration diagram of a virtualization system according to a first embodiment of the present invention;

Fig. 3 is a flowchart illustrating a method for running a virtualized backup according to a first embodiment of the present invention;

FIG. 4 is a schematic flow chart of a first embodiment of the present invention;

FIG. 5 is a schematic flow chart of a preferred embodiment of the first embodiment of the present invention;

FIG. 6 is a schematic flow chart of another preferred embodiment of the first embodiment of the present invention;

fig. 7 is a flowchart illustrating a virtualized backup-restore method according to a second embodiment of the present invention;

fig. 8 is a flowchart illustrating a method for running a virtualized backup and restore according to a second embodiment of the present invention.

Detailed Description

the technical solutions in the present invention will be described clearly and completely with reference to the accompanying drawings, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that, the step numbers in the text are only for convenience of explanation of the specific embodiments, and do not serve to limit the execution sequence of the steps. The method provided by the embodiment can be executed by the relevant server, and the server is taken as an example for explanation below.

In a first embodiment, please refer to FIGS. 1-6.

as shown in fig. 1, a first embodiment provides a virtualized backup method, including steps S1-1 to S1-6:

s1-1, responding to the received data backup request, creating a data backup task, and allocating a backup agent and a backup repository for the data backup task.

S1-2, starting a Veeam data mover; wherein the Veeam data movers include source data movers in the backup agent and target data movers in the backup repository.

s1-3, extracting VM and virtualization host information; wherein the virtualization host information comprises a vCenter server and an ESXI host.

And S1-4, driving the vCenter server or the ESXI host to respond to the VM snapshot creation request and create the VM snapshot.

And S1-5, driving the source data mover to read VM data from the disk of the VM, and transmitting the VM data to the target data mover according to a preset data transmission rule.

S1-6, after the VM data reading is finished, reporting the VM snapshot to the vCenter server or the ESXI host.

When receiving the data backup request, Veeam virtualization backup software starts a backup server, enables the backup server to respond to the data backup request, thereby creating a data backup task, and allocates a backup agent and a backup repository for the data backup task. In particular, for each virtual machine disk added to the data backup task, Veeam backup and replication will create a new task.

while the data backup tasks are running, the Veeam data mover is started for each data backup task, namely, the source data mover in the backup agent and the target data mover in the backup repository are started, so as to establish a data transmission path between the backup agent and the backup repository.

According to the extracted VM and virtualization host information, if application-aware image processing is enabled for the data backup task, Veeam backups and copies built-in guest operating systems that are connected to the VM, deploys a process for calculating running time on the operating systems of the VM, and displays the running data backup task.

And responding a VM snapshot creating request by driving the vCenter server or the ESXI host to create a VM snapshot. A VM snapshot may be considered a cohesive point-in-time copy of the VM, including its configuration, operating system, applications, associated data, system state, and the like. After the VM snapshot is created, the disks of the VM are in a read-only state, and each disk of the VM receives an incremental file. During the operation of the data backup task, changes made to the VM by a user are written to a delta file.

And the source data mover reads VM data from a disk of the VM, and transmits the VM data to the target data mover according to a preset data transmission rule. Specifically, if the data backup task is an incremental backup task, that is, during the running of the incremental backup task, the source data mover uses CBT to retrieve only data blocks that have changed since the last data backup task was run, or alternately moves the source data mover and the target mover to obtain backup metadata and uses the metadata to detect data blocks that have changed since the last data backup task was run.

when the VM data is transmitted, the source data mover executes additional processes, namely, zero data block filtering, file block exchanging and excluded operating system file blocks built in the VM, so that the backup data can be prevented from occupying the whole network bandwidth. The source data mover further compresses the VM data and transmits the compressed VM data to the target data mover.

after the source data mover finishes reading the VM data, Veeam backup and copy requests the vCenter server or the ESXI host to submit the VM snapshot, and the VM snapshot is reported to the vCenter server or the ESXI host.

As shown in fig. 4, in a specific embodiment, the virtualized backup method further includes step S1-7:

S1-7, storing all the VM data through a distributed storage technology.

It is understood that the distributed storage technology is based on a distributed storage system that stores data in a distributed manner on a plurality of independent devices. In a traditional network storage system, a centralized storage server is adopted to store all data, and the storage server becomes the key of system performance, is also the focus of reliability and safety, and cannot meet the requirement of large-scale storage application. The distributed network storage system adopts an expandable system structure, utilizes a plurality of storage servers to share the storage load, and utilizes the position server to position the storage information, thereby not only improving the reliability, the availability and the access efficiency of the system, but also being easy to expand.

as shown in fig. 5, in a preferred embodiment, the virtualized backup method further includes step S1-8:

and S1-8, verifying the recovery node of the VM data.

It can be understood that, by verifying the restore node of the VM data (i.e., the backup data), which is equivalent to checking whether the backup data can be restored, the backup data that cannot be restored can be detected, so that the situation that the backed-up data cannot be restored is avoided, and the validity of the backup data is further ensured.

In another preferred embodiment, as shown in FIG. 6, the step S1-1 includes steps S1-11-S1-12:

and S1-11, driving the Veeam backup manager to read task configuration from a configuration database according to the data backup request, and creating the data backup task according to the task configuration.

S1-12, connecting the Veeam backup service with the Veeam backup manager, and enabling the Veeam backup service to distribute the backup agent and the backup repository.

It should be noted that the Veeam backup service includes a resource scheduling component for managing all tasks and resources in the backup infrastructure. A resource scheduler checks for available backup infrastructure resources and allocates the backup agents and the backup repositories to cause the backup agents and the backup repositories to process the data backup tasks.

In a specific embodiment, the step S1-2 includes: connecting the Veeam transmission service with the backup agent and the backup repository to enable the Veeam transmission service to respectively start the source data mover and the target mover.

it will be appreciated that providing the Veeam transfer service in connection with the backup agent and the backup repository, having the Veeam backup manager connected to the Veeam transfer service, causes the Veeam transfer service to initiate Veeam data movers.

In a specific embodiment, the VM and virtualized host information is queried from the Veeam Broker service to drive the Veeam backup manager.

In a specific embodiment, the preset data transmission rule includes a network traffic throttling rule.

It can be understood that, the VM data is transmitted according to the data transmission rule preset by the Veeam backup manager, for example, the network traffic throttling rule, so that the normal operation of the key application can be ensured, and the virtual network paralysis caused by the overload operation of the backup server can be avoided.

in a specific embodiment, the step S1-7 includes: storing the VM data in an N + M: b mode; wherein, N is the number of data objects, M is the number of check objects, and b is the number of nodes allowed to fail.

It is understood that the VM data is stored in an N + M: b manner, and the eosin P200 distributed storage system may be selected to store all the VM data, for example, in an 8+2:1 manner.

In a specific embodiment, the step S1-8 includes: and verifying the recovery node of the VM data through SureBackup or SureRepli.

The SureBackup is a Veeam technique that allows testing of the VM data (i.e., backup data) and checking if data can be restored therefrom, i.e., any one restore node of the VM data can be verified. During the SureBackup job, the backup agent and the backup repository will perform "real-time" validation: scanning for backup malware data, starting the VM from backup in an isolated environment (i.e., a sandbox), running tests for the VM, shutting down the VM and creating a recovery verification result report.

if the SureBackup job is configured to perform a malware scan, the backup agent and the backup repository will scan the VM data from the application suite and verified by antivirus software, Veeam backup and replication scans the VM data using antivirus software.

Veeam publishes VMs from application suites and validated VMs in an isolated environment (virtual lab, or sandbox). The virtual machine starts directly from the compressed backup files and the deleted backup files residing in the backup repository. Thus, Veeam utilizes the NFS service of Veeam vPower.

veeam performed many tests on the VM in the application suite and verified the VM: heartbeat testing, ping testing, and application testing.

If the SureBackup job is configured to validate a backup file, Veeam will perform a CRC check on the validated backup file of the VM and the backup files of the VMs in the application suite. After all verification tests are completed, backup file verification will be performed.

After the recovery verification process is over, Veeam backup and replication will unpublish the VM and create a report on its status. The report is sent to the backup administrator via e-mail.

To ensure data recoverability, the suream SureRepli supplements the SureBackup recovery verification technique. Sureplayback is similar in many respects to SureBackup recovery verification. It allows the DR environment to be verified without affecting the production infrastructure, i.e. the restore node for each of the VM data can be automatically verified and the functionality of the restore node is guaranteed to be as expected.

The embodiment of the invention has the following beneficial effects:

A second embodiment. Please refer to fig. 7-8.

As shown in fig. 7, the second embodiment proposes a method for virtualized backup restoration, which includes steps S2-1 to S2-7:

s2-1, responding to the received data replication request, creating a data replication task, and allocating a backup agent and a backup repository for the data replication task;

s2-2, starting a Veeam data mover; wherein the Veeam data movers comprise a source data mover in the backup agent and a target data mover in the backup repository;

S2-3, extracting VM and virtualization host information; wherein the virtualization host information comprises a vCenter server and an ESXI host;

S2-4, driving the vCenter server or the ESXI host to respond to the VM snapshot creating request and creating a VM snapshot;

S2-5, driving the source data mover to read and copy VM data from a disk of the VM, and transmitting the VM data to the target data mover according to a preset data transmission rule;

s2-6, driving the target data mover to store the VM data to an original storage path of the VM data;

S2-7, after the VM data reading is finished, reporting the VM snapshot to the vCenter server or the ESXI host.

it will be appreciated that Veeam backup and replication is built for a virtual environment. It runs in the virtualization layer and uses an image-based approach for VM replication. Veeam backup and replication does not install proxy software in the operating system built into the VM to retrieve the VM data. The copying of the VM data utilizes the snapshot function of VMware vSphere. When the data replication task is operated, namely the VM data is replicated, the Veeam backups and the replication request VMware vSphere to create the VM snapshot.

generally, data replication works in a similar manner to incremental backups. In the first replication cycle, Veeam backup and replication will replicate the data of the original VM running on the source host and create a full copy thereof on the target host. Unlike backup files, duplicate virtual disks are decompressed for storage in native format. All subsequent replication cycles are incremental. Veeam backup and copy only data blocks that have changed since the last data copy task was run. To track changed data blocks, Veeam backup and replication use different methods.

In Veeam backup and replication, replication is a task-driven process. If the copy is to be performed, task configuration is required. The data replication task is a configuration unit of replication activity for defining the time, content, manner and place of replication. Thus, one data replication task may be used to process one or more of the VMs, either to instruct the Veeam backup and replication to run the data replication task automatically on schedule, or to manually initiate the running data replication task.

When receiving the data replication request, Veeam virtualization backup software starts a backup server, enables the backup server to respond to the data replication request, thereby creating a data replication task, and allocates a backup agent and a backup repository for the data replication task. In particular, for each virtual machine disk added to the data replication task, Veeam backup and replication will create a new task.

while the data replication tasks are running, the Veeam data mover, that is, the source data mover in the backup agent and the target data mover in the backup repository are started for each data replication task to establish a data transmission path between the backup agent and the backup repository.

According to the extracted VM and virtualization host information, if application-aware image processing is enabled for the data backup task, Veeam backup and copy are connected to a built-in guest operating system of the VM, a process for calculating running time is deployed on the operating system of the VM, and the running data copy task is displayed.

and responding a VM snapshot creating request by driving the vCenter server or the ESXI host to create a VM snapshot. A VM snapshot may be considered a cohesive point-in-time copy of the VM, including its configuration, operating system, applications, associated data, system state, and the like. Veeam backup and replication uses this point-in-time copy as the data source for replication. After the VM snapshot is created, the disks of the VM are in a read-only state, and each disk of the VM receives an incremental file. During the operation of the data replication task, changes made to the VM by a user are written to a delta file.

And the source data mover reads and copies VM data from a disk of the VM, and transmits the VM data to the target data mover according to a preset data transmission rule. Specifically, if the data backup task is an incremental backup task, i.e., during the running of the incremental backup task, the source data mover uses CBT to retrieve only data blocks that have changed since the last data copy task was run, or to interactively move the source data mover and the target mover to obtain copy metadata and use the metadata to detect data blocks that have changed since the last data copy task was run.

When the VM data is transmitted, the source data mover executes additional processes, namely, filtering zero data blocks, exchanging file blocks and excluded operating system file blocks built in the VM, so that the situation that the copied data occupies the whole network bandwidth is prevented. The source data mover further compresses the VM data and transmits the compressed VM data to the target data mover.

And the target data mover stores the VM data to an original storage path of the VM data, namely, the VM data is decompressed and then restored.

In a specific embodiment, the method for virtualized backup and restore further includes: storing all the VM data through a distributed storage technology.

In a specific embodiment, the method for virtualized backup and restore further includes: and verifying the recovery node of the VM data.

it can be understood that, by verifying the restore node of the VM data (i.e., the backup data), which is equivalent to checking whether the backup data can be restored, the backup data that cannot be restored can be detected, so that only the backup data that can be restored is backed up and restored, and the processing efficiency of data backup and restoration is further improved.

In a specific embodiment, the step S2-1 includes: driving a Veeam backup manager to read task configuration from a configuration database according to the data backup request, and creating the data backup task according to the task configuration; connecting the Veeam backup service with the Veeam backup manager to enable the Veeam backup service to allocate the backup agent and the backup repository.

In a specific embodiment, the step S2-2 includes: connecting the Veeam transmission service with the backup agent and the backup repository to enable the Veeam transmission service to respectively start the source data mover and the target mover.

In a specific embodiment, the storing all the VM data by a distributed storage technique includes: storing the VM data in an N + M: b mode; wherein, N is the number of data objects, M is the number of check objects, and b is the number of nodes allowed to fail.

in a specific embodiment, the verifying the restore node of the VM data includes: and verifying the recovery node of the VM data through SureBackup or SureRepli.

The embodiment of the invention has the following beneficial effects:

While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

Claims

1. A virtualized backup method, comprising:

2. the virtualized backup method of claim 1, further comprising: storing all the VM data through a distributed storage technology.

3. The virtualized backup method of claim 1, further comprising: and verifying the recovery node of the VM data.

4. the virtualized backup method of claim 1, wherein creating a data backup task in response to a received data backup request and assigning a backup agent and a backup repository for the data backup task comprises:

5. The virtualized backup method of claim 1 wherein the initiating the Veeam data mover comprises:

6. The virtualized backup method of claim 4 wherein the VM and virtualized host information is queried from a Veeam Broker service to drive the Veeam backup manager.

7. The virtualized backup method according to claim 1, wherein the preset data transmission rules comprise network traffic throttling rules.

8. The virtualized backup method of claim 2 wherein storing all of the VM data via distributed storage technology comprises:

9. the virtualized backup method of claim 3 wherein said validating the restore node of the VM data comprises: and verifying the recovery node of the VM data through SureBackup or SureRepli.

10. A method for virtualized backup restore, comprising: