CN114328020A - Data backup method and related device for cluster file system - Google Patents
Data backup method and related device for cluster file system Download PDFInfo
- Publication number
- CN114328020A CN114328020A CN202111632284.2A CN202111632284A CN114328020A CN 114328020 A CN114328020 A CN 114328020A CN 202111632284 A CN202111632284 A CN 202111632284A CN 114328020 A CN114328020 A CN 114328020A
- Authority
- CN
- China
- Prior art keywords
- data
- virtual disk
- cluster
- snapshot
- incremental
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000004590 computer program Methods 0.000 claims description 10
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 8
- 238000013500 data storage Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000011084 recovery Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a data backup method of a cluster file system, which comprises the following steps: performing snapshot processing on a virtual disk to be backed up to obtain snapshot data; performing cluster locking processing on files of a virtual disk to be backed up through a virtual node; when the cluster lock is successfully processed, comparing the metadata of the snapshot data with the metadata of the previous snapshot data to obtain incremental metadata description information; and reading the incremental data from the virtual disk based on the incremental metadata description information, and saving the incremental data to the backup storage system. The method realizes the LAN-free data backup, is convenient to be applied to the backup of a third party under the condition of ensuring the data consistency, enhances the expansibility of a shared storage pool in the super-fusion system, and can effectively improve the competitiveness of the super-fusion system. The application also discloses a data backup method, a data backup device, a server and a computer readable storage medium of the cluster file system, which have the beneficial effects.
Description
Technical Field
The present application relates to the field of data storage technologies, and in particular, to a data backup method, a data backup apparatus, a server, and a computer-readable storage medium for a cluster file system.
Background
In the field of hyper-convergence, Linux is often selected as a system kernel for constructing a hyper-convergence system. The virtual file system layer of Linux can well support various file systems. The storage pool constructed based on the file system can fully utilize the characteristics of the file system to realize the virtualization system services such as snapshot, data backup, capacity expansion and the like; the shared storage pool constructed based on the cluster file system can realize high-level characteristics of HA (high availability cluster), virtual machine resource dynamic scheduling, disaster tolerance and the like, and forms the core capability of a virtualization and super-fusion system.
In the prior art, the LAN-free backup scheme is suitable for data backup of block devices, but in a virtualization and super-fusion scene, virtual disk files and the like are often placed in a file system, and the advantages of a cluster file system can be fully utilized. However, due to the coupling of the file system to various mechanisms of the operating system, it is difficult to perform LAN-free backup of virtual disk files within the cluster file system. The data backup function cannot be provided for the super-fusion system, the consistency of data storage is reduced, and the reliability of the cluster file system is reduced.
Therefore, how to backup the cluster file system in the super-fusion scenario is a key issue that those skilled in the art pay attention to.
Disclosure of Invention
The present application aims to provide a data backup method, a data backup device, a server and a computer readable storage medium for a cluster file system, so as to realize data backup of the cluster file system and improve consistency of data storage.
In order to solve the above technical problem, the present application provides a data backup method for a cluster file system, including:
performing snapshot processing on a virtual disk to be backed up to obtain snapshot data;
performing cluster locking processing on the file of the virtual disk to be backed up through a virtual node;
when the cluster lock is successfully processed, comparing the metadata of the snapshot data with the metadata of the previous snapshot data to obtain incremental metadata description information;
and reading incremental data from the virtual disk based on the incremental metadata description information, and saving the incremental data to a backup storage system.
Optionally, the snapshot processing is performed on the virtual disk to be backed up to obtain snapshot data, and the snapshot processing includes:
and carrying out snapshot processing on the virtual disk to be backed up through a snapshot interface to obtain snapshot data.
Optionally, the method further includes:
when the incremental data backup is completed, releasing the cluster lock;
and deleting the snapshot data.
Optionally, performing cluster lock processing on the file of the virtual disk to be backed up by using the virtual node, including:
adding backup application into a cluster file system in a virtual node form to obtain a virtual node;
and performing cluster locking processing on the file of the virtual disk to be backed up through the virtual node.
Optionally, the method further includes:
creating virtual disk files to be restored in the same size in a cluster file system based on metadata description of data to be restored;
performing cluster locking processing on the virtual disk file to be recovered through a virtual node;
when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered;
and carrying out data synchronization based on the virtual disk file to be recovered to obtain recovered data.
Optionally, when the cluster lock processing is successful, writing the data to be restored into the virtual disk file to be restored includes:
and when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered through a virtual disk access interface.
Optionally, performing data synchronization based on the virtual disk file to be restored to obtain restored data, including:
and carrying out data synchronization on the virtual disk file to be recovered through a data synchronization interface of the cluster file system to obtain recovered data.
The present application further provides a data backup device of a cluster file system, including:
the data snapshot module is used for performing snapshot processing on the virtual disk to be backed up to obtain snapshot data;
the file locking module is used for performing cluster locking processing on the files of the virtual disk to be backed up through the virtual node;
the incremental metadata acquisition module is used for comparing the metadata of the snapshot data with the metadata of the previous snapshot data to obtain incremental metadata description information when the cluster lock is successfully processed;
and the incremental data backup module is used for reading incremental data from the virtual disk based on the incremental metadata description information and storing the incremental data to a backup storage system.
The present application further provides a server, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the data backup method as described above when executing the computer program.
The present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the data backup method as described above.
The application provides a data backup method of a cluster file system, which comprises the following steps: performing snapshot processing on a virtual disk to be backed up to obtain snapshot data; performing cluster locking processing on the file of the virtual disk to be backed up through a virtual node; when the cluster lock is successfully processed, comparing the metadata of the snapshot data with the metadata of the previous snapshot data to obtain incremental metadata description information; and reading incremental data from the virtual disk based on the incremental metadata description information, and saving the incremental data to a backup storage system.
The corresponding incremental metadata description information is determined by comparing the metadata of the snapshot data, then the incremental data is read from the virtual disk based on the incremental metadata description information, and the incremental data is backed up, so that LAN-free data backup is realized, a third party can be conveniently applied to backup under the condition of ensuring data consistency, the expansibility of a shared storage pool in a super-fusion system is enhanced, and the competitiveness of the super-fusion system can be effectively improved.
The application also provides a data backup method, a data backup device, a server and a computer readable storage medium of the cluster file system, which have the above beneficial effects and are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a data backup method for a cluster file system according to an embodiment of the present disclosure;
fig. 2 is a schematic data flow diagram of a data backup method for a cluster file system according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data backup device of a cluster file system according to an embodiment of the present disclosure.
Detailed Description
The core of the application is to provide a data backup method, a data backup device, a server and a computer readable storage medium for a cluster file system, so as to realize the backup of the data of the cluster file system and improve the consistency of data storage.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the prior art, the LAN-free backup scheme is suitable for data backup of block devices, but in a virtualization and super-fusion scene, virtual disk files and the like are often placed in a file system, and the advantages of a cluster file system can be fully utilized. However, due to the coupling of the file system to various mechanisms of the operating system, it is difficult to perform LAN-free backup of virtual disk files within the cluster file system. The data backup function cannot be provided for the super-fusion system, the consistency of data storage is reduced, and the reliability of the cluster file system is reduced.
The LAN-Free backup mainly refers to copying data from a fast random access storage device (disk array or server hard disk) to a backup storage device (tape library or tape drive).
Therefore, the data backup method of the cluster file system provided by the application determines corresponding incremental metadata description information by comparing the metadata of the snapshot data, reads the incremental data from the virtual disk based on the incremental metadata description information, backs up the incremental data, realizes LAN-free data backup, facilitates the connection of third-party backup application under the condition of ensuring data consistency, enhances the expansibility of a shared storage pool in a super-fusion system, and can effectively improve the competitiveness of the super-fusion system.
The following describes a data backup method of a cluster file system according to an embodiment.
Referring to fig. 1, fig. 1 is a flowchart illustrating a data backup method of a cluster file system according to an embodiment of the present disclosure.
In this embodiment, the method may include:
s101, performing snapshot processing on a virtual disk to be backed up to obtain snapshot data;
the method comprises the steps of carrying out snapshot processing on a virtual disk to be backed up to obtain snapshot data. That is, the snapshot interface provided by virtualization/hyper-fusion is used for making a snapshot of the virtual disk to be backed up.
Further, the step may include:
and carrying out snapshot processing on the virtual disk to be backed up through a snapshot interface to obtain snapshot data.
It can be seen that the present alternative scheme mainly illustrates how snapshot processing is performed. In this alternative, the snapshot processing is performed on the virtual disk to be backed up through the snapshot interface, so as to obtain snapshot data.
S102, performing cluster locking processing on files of a virtual disk to be backed up through a virtual node;
on the basis of S101, this step is intended to perform cluster locking processing on files of the virtual disk to be backed up through the virtual node.
That is, the third party application is added to the cluster file system in a virtual node form by a method of bypassing the cluster file system, and the virtual disk file is subjected to cluster locking. Therefore, the situation that other applications concurrently access the snapshot file at the virtualization/hyper-convergence host side to cause data inconsistency is prevented.
Further, the step may include:
step 1, adding backup application into a cluster file system in a virtual node form to obtain a virtual node;
and 2, performing cluster locking processing on the file of the virtual disk to be backed up through the virtual node.
It can be seen that the present alternative scheme is mainly directed to explaining how to perform the locking process. In the alternative, the backup application is added to the cluster file system in the form of a virtual node to obtain the virtual node, and the virtual node performs cluster locking processing on the file of the virtual disk to be backed up.
S103, when the cluster lock is successfully processed, comparing the metadata of the snapshot data with the metadata of the snapshot data at the previous time to obtain incremental metadata description information;
on the basis of S102, this step is intended to compare the metadata of the snapshot data with the metadata of the previous snapshot data to obtain the incremental metadata description information when the cluster lock processing is successful.
That is, the metadata information of the snapshot data is taken through the metadata access interface of the virtual disk and compared with the metadata information of the snapshot data of the previous time, so as to obtain the incremental data.
And S104, reading the incremental data from the virtual disk based on the incremental metadata description information, and saving the incremental data to a backup storage system.
On the basis of S103, this step is intended to read incremental data from the virtual disk based on the incremental metadata description information and save the incremental data to the backup storage system.
The backup storage system can be used for third-party backup application, namely LAN-free backup operation is realized.
In addition, the present embodiment may further include:
step 1, when the incremental data backup is completed, releasing the cluster lock;
and 2, deleting the snapshot data.
It can be seen that the present alternative scheme is mainly used to illustrate how the memory release is performed. In this alternative, when the backup of the incremental data is completed, the cluster lock is released, and the snapshot data is deleted.
In addition, the present embodiment may further include:
step 1, creating virtual disk files to be restored in the same size in a cluster file system based on metadata description of data to be restored;
step 2, performing cluster locking processing on the virtual disk file to be recovered through the virtual node;
step 3, when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered;
and 4, carrying out data synchronization based on the virtual disk file to be recovered to obtain recovered data.
It can be seen that the present alternative scheme is mainly illustrative of how data recovery is performed. In the alternative, virtual disk files to be restored with the same size are created in a cluster file system based on metadata description of data to be restored, cluster locking processing is performed on the virtual disk files to be restored through virtual nodes, when the cluster locking processing is successful, the data to be restored are written into the virtual disk files to be restored, and data synchronization is performed based on the virtual disk files to be restored to obtain the restored data.
Firstly, taking the metadata description of the actual data segment to be restored as an entry parameter, calling a virtualization/hyper-fusion interface to create a virtual disk file to be restored, and reserving a space for the data to be restored at the moment; secondly, clustering the virtual disk files in a virtual node mode to prevent a process at a virtualization/super-fusion host from accessing the virtual disk files; thirdly, calling a virtual disk access interface, directly writing the data to be recovered into the virtual disk file, and recovering the data; and finally, calling a data synchronization interface of the virtualization/super-fusion end, so that the host end obtains the latest data recovered in the LAN-free mode, and releasing the cluster lock.
Further, step 3 in the last alternative may include:
and when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered through the virtual disk access interface.
It can be seen that the present alternative mainly illustrates how data is written.
Further, step 4 in the last alternative may include:
and carrying out data synchronization on the virtual disk file to be recovered through a data synchronization interface of the cluster file system to obtain recovered data.
It can be seen that the present alternative is primarily illustrative of data synchronization.
In summary, in the embodiment, the corresponding incremental metadata description information is determined by comparing the metadata of the snapshot data, then the incremental data is read from the virtual disk based on the incremental metadata description information, and the incremental data is backed up, so that LAN-free data backup is realized, a third party backup application is facilitated under the condition of ensuring data consistency, the extensibility of a shared storage pool in the super-fusion system is enhanced, and the competitiveness of the super-fusion system can be effectively improved.
The following further describes a data backup method of a cluster file system provided in the present application by a specific embodiment.
In this embodiment, a third-party high-speed backup interface supporting the LAN-free of the file system is implemented based on the data access scheme of the bypass cluster file system, and can support a third-party application to interface with a virtualization or conflict fusion system to implement a third-party virtual machine backup.
Wherein, the backup process may include: firstly, taking a snapshot of a virtual disk to be backed up through a snapshot interface provided by virtualization/hyper-fusion; secondly, enabling a third party application to be added into the cluster file system in a virtual node form by a method of bypassing the cluster file system, and performing cluster locking on the virtual disk file; then, the metadata information is taken through a virtual disk metadata access interface, and the incremental data is compared with the incremental data in the previous time; and finally, according to the description of the incremental metadata, reading the incremental data from the disk directly through the virtual disk access interface and saving the incremental data to a third-party storage. After the backup is finished, the virtual disk access cluster lock can be released, and the snapshot file is deleted;
wherein the recovery procedure may include: firstly, taking the metadata description of an actual data segment to be restored as an entry parameter, calling a virtualization/hyper-fusion interface to create a virtual disk file to be restored, and reserving a space for the data to be restored at the moment; secondly, clustering the virtual disk files in a virtual node mode to prevent a process at a virtualization/super-fusion host from accessing the virtual disk files; thirdly, calling a virtual disk access interface, directly writing the data to be recovered into the virtual disk file, and recovering the data; and finally, calling a data synchronization interface of the virtualization/super-fusion end, so that the host end obtains the latest data recovered in the LAN-free mode, and releasing the cluster lock.
Referring to fig. 2, fig. 2 is a data flow diagram illustrating a data backup method for a cluster file system according to an embodiment of the present disclosure.
In fig. 2, active represents a virtual disk accessed when a virtual machine operates, Tn represents different backup times, Sn represents snapshot data at different backup times, Delta represents incremental metadata description, and Inc represents incremental data. The data access scheme of the bypass cluster file system proposed before is introduced into the LAN-free scheme, and the specific implementation process is as follows:
referring to fig. 2, the virtual disk backup process is implemented as follows:
firstly, taking a snapshot of a virtual disk to be backed up through a snapshot interface provided by virtualization/hyper-fusion, such as S0, S1, and S2 in fig. 2;
secondly, enabling a third party application to be added into the cluster file system in a virtual node form by a method of bypassing the cluster file system, and performing cluster locking on the virtual disk file. So as to prevent the virtualization/hyper-convergence host side from having other applications to concurrently access the snapshot file, which causes data inconsistency;
then, the metadata information is taken through the virtual disk metadata access interface and compared with the previous metadata (img _ get _ diff), so as to obtain incremental metadata descriptions, such as Delta1_0 and Delta2_1 in fig. 2;
finally, the incremental data (Inc0, Inc1_0, Inc2_1) is read from the disk directly through the virtual disk access interface (img _ read) and saved to a third party storage, as described by the incremental metadata. And after the backup is finished, the virtual disk access cluster lock can be released, and the snapshot file is deleted.
For the first backup, the data obtained is full, namely, Inc0 of fig. 2, which is equivalent to S0.
The virtual disk recovery process is implemented as follows:
firstly, taking the metadata description of an actual data segment to be restored as an entry parameter, calling a virtualization/hyper-fusion interface to create a virtual disk file to be restored, and reserving a space for the data to be restored at the moment; note that this step is critical, and space must be reserved, otherwise space allocation will be attempted when the virtual disk access interface writes (img _ write), and since the virtual disk access interface itself bypasses the file system, a concurrency problem will be caused to the file system metadata access, resulting in metadata corruption. This latter file is not problematic because space is allocated and there is cluster lock protection.
Secondly, cluster locking is carried out on the virtual disk files in a virtual node form so as to prevent a process at a virtualization/super-fusion host end from accessing the virtual disk files;
thirdly, calling a virtual disk access interface (img _ write), and directly writing the data to be restored into the virtual disk file to restore the data, wherein the restoration processes are d0, d1 and d 2;
and finally, calling a data synchronization interface of the virtualization/super-fusion end, so that the host end obtains the latest data recovered in the LAN-free mode, and releasing the cluster lock.
Obviously, the embodiment provides a third-party high-speed backup interface implementation scheme supporting the file system LAN-free, and has the characteristics of low coupling with the super-converged system and data security. The scheme can enable the super-fusion system to fully utilize the characteristics of the cluster file system and also increase the LAN-free data backup support for the super-fusion system. The scheme can be conveniently butted with a third party for backup application under the condition of ensuring the data consistency, enhances the expansibility of a shared storage pool in the super-fusion system, and can effectively improve the competitiveness of the super-fusion system.
It can be seen that, in the embodiment, the corresponding incremental metadata description information is determined by comparing the metadata of the snapshot data, then the incremental data is read from the virtual disk based on the incremental metadata description information, and the incremental data is backed up, so that LAN-free data backup is realized, a third party backup application is facilitated under the condition of ensuring data consistency, the expansibility of a shared storage pool in a super-fusion system is enhanced, and the competitiveness of the super-fusion system can be effectively improved.
In the following, the data backup device of the cluster file system provided in the embodiment of the present application is introduced, and the data backup device of the cluster file system described below and the data backup method of the cluster file system described above may be referred to correspondingly.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a data backup device of a cluster file system according to an embodiment of the present disclosure.
In this embodiment, the apparatus may include:
the data snapshot module 100 is configured to perform snapshot processing on a virtual disk to be backed up to obtain snapshot data;
the file locking module 200 is configured to perform cluster locking processing on files of the virtual disk to be backed up through the virtual node;
an incremental metadata obtaining module 300, configured to, when the cluster lock is successfully processed, compare metadata of the snapshot data with metadata of a previous snapshot data to obtain incremental metadata description information;
and the incremental data backup module 400 is configured to read incremental data from the virtual disk based on the incremental metadata description information, and store the incremental data to the backup storage system.
Optionally, the data snapshot module 100 is specifically configured to perform snapshot processing on the virtual disk to be backed up through a snapshot interface to obtain snapshot data.
Optionally, the apparatus may further include:
the data release module is used for releasing the cluster lock when the incremental data backup is completed; and deleting the snapshot data.
Optionally, the file locking module 200 is specifically configured to add a backup application to the cluster file system in the form of a virtual node to obtain the virtual node; and performing cluster locking processing on the file of the virtual disk to be backed up through the virtual node.
Optionally, the apparatus may further include:
the data recovery module is used for creating virtual disk files to be recovered in the same size in the cluster file system based on the metadata description of the data to be recovered; performing cluster locking processing on the virtual disk file to be recovered through a virtual node; when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered; and carrying out data synchronization based on the virtual disk file to be recovered to obtain recovered data.
Optionally, the writing the to-be-restored data into the to-be-restored virtual disk file when the cluster lock processing is successful may include:
and when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered through a virtual disk access interface.
Optionally, the "performing data synchronization based on the virtual disk file to be restored to obtain restored data" may include:
and carrying out data synchronization on the virtual disk file to be recovered through a data synchronization interface of the cluster file system to obtain recovered data.
An embodiment of the present application further provides a server, including:
a memory for storing a computer program;
a processor for implementing the steps of the data backup method as described in the above embodiments when executing the computer program.
Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the data backup method according to the above embodiments are implemented.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The data backup method, the data backup device, the server and the computer readable storage medium of the cluster file system provided by the present application are described in detail above. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
Claims (10)
1. A data backup method of a cluster file system is characterized by comprising the following steps:
performing snapshot processing on a virtual disk to be backed up to obtain snapshot data;
performing cluster locking processing on the file of the virtual disk to be backed up through a virtual node;
when the cluster lock is successfully processed, comparing the metadata of the snapshot data with the metadata of the previous snapshot data to obtain incremental metadata description information;
and reading incremental data from the virtual disk based on the incremental metadata description information, and saving the incremental data to a backup storage system.
2. The data backup method according to claim 1, wherein performing snapshot processing on the virtual disk to be backed up to obtain snapshot data comprises:
and carrying out snapshot processing on the virtual disk to be backed up through a snapshot interface to obtain snapshot data.
3. The data backup method according to claim 1, further comprising:
when the incremental data backup is completed, releasing the cluster lock;
and deleting the snapshot data.
4. The data backup method according to claim 1, wherein performing cluster lock processing on the file of the virtual disk to be backed up by the virtual node comprises:
adding backup application into a cluster file system in a virtual node form to obtain a virtual node;
and performing cluster locking processing on the file of the virtual disk to be backed up through the virtual node.
5. The data backup method according to any one of claims 1 to 4, characterized by further comprising:
creating virtual disk files to be restored in the same size in a cluster file system based on metadata description of data to be restored;
performing cluster locking processing on the virtual disk file to be recovered through a virtual node;
when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered;
and carrying out data synchronization based on the virtual disk file to be recovered to obtain recovered data.
6. The data backup method according to claim 5, wherein when the cluster lock processing is successful, writing the data to be restored into the virtual disk file to be restored comprises:
and when the cluster lock processing is successful, writing the data to be recovered into the virtual disk file to be recovered through a virtual disk access interface.
7. The data backup method according to claim 5, wherein performing data synchronization based on the virtual disk file to be restored to obtain restored data comprises:
and carrying out data synchronization on the virtual disk file to be recovered through a data synchronization interface of the cluster file system to obtain recovered data.
8. A data backup apparatus of a cluster file system, comprising:
the data snapshot module is used for performing snapshot processing on the virtual disk to be backed up to obtain snapshot data;
the file locking module is used for performing cluster locking processing on the files of the virtual disk to be backed up through the virtual node;
the incremental metadata acquisition module is used for comparing the metadata of the snapshot data with the metadata of the previous snapshot data to obtain incremental metadata description information when the cluster lock is successfully processed;
and the incremental data backup module is used for reading incremental data from the virtual disk based on the incremental metadata description information and storing the incremental data to a backup storage system.
9. A server, comprising:
a memory for storing a computer program;
processor for implementing the steps of the data backup method according to any of claims 1 to 7 when executing said computer program.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the data backup method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111632284.2A CN114328020A (en) | 2021-12-28 | 2021-12-28 | Data backup method and related device for cluster file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111632284.2A CN114328020A (en) | 2021-12-28 | 2021-12-28 | Data backup method and related device for cluster file system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114328020A true CN114328020A (en) | 2022-04-12 |
Family
ID=81015679
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111632284.2A Withdrawn CN114328020A (en) | 2021-12-28 | 2021-12-28 | Data backup method and related device for cluster file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114328020A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117370080A (en) * | 2023-12-04 | 2024-01-09 | 深圳市木浪云科技有限公司 | Data backup and data recovery method, system, equipment and medium for Hive |
-
2021
- 2021-12-28 CN CN202111632284.2A patent/CN114328020A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117370080A (en) * | 2023-12-04 | 2024-01-09 | 深圳市木浪云科技有限公司 | Data backup and data recovery method, system, equipment and medium for Hive |
| CN117370080B (en) * | 2023-12-04 | 2024-04-09 | 深圳市木浪云科技有限公司 | Data backup and data recovery method, system, equipment and medium for Hive |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6247024B1 (en) | Method and system for performing deferred file removal in a file system | |
| US7725440B2 (en) | Restoring a database using fuzzy snapshot techniques | |
| US8464018B2 (en) | Resource management for data storage services | |
| CN106357703B (en) | Cluster switching method and device | |
| CN113626256B (en) | Virtual machine disk data backup method, device, terminal and storage medium | |
| CN115098299B (en) | Backup method, disaster recovery method, device and equipment of virtual machine | |
| CN111338844A (en) | Database backup management method and electronic equipment | |
| CN111666046B (en) | Data storage method, device and equipment | |
| CN115408411A (en) | Data writing method and device, electronic equipment and storage medium | |
| CN114328020A (en) | Data backup method and related device for cluster file system | |
| CN112269679B (en) | Database persistence method, system, equipment and storage medium of cloud platform | |
| CN116737466B (en) | Backup processing method, device, system, electronic equipment and readable storage medium | |
| JP4289028B2 (en) | Hard disk backup recovery system and information processing apparatus | |
| CN114756355B (en) | Method and device for automatically and quickly recovering process of computer operating system | |
| WO2011060635A1 (en) | Method and device for saving data | |
| CN111104256A (en) | Data reading method, device, equipment and storage medium | |
| CN110941591A (en) | File deletion method, device and equipment and readable storage medium | |
| CN112764973B (en) | Data disaster tolerance method and device, electronic equipment and readable storage medium | |
| CN111176886A (en) | Database mode switching method and device and electronic equipment | |
| CN115344423B (en) | Backup method, mount recovery method, server, and computer-readable storage medium | |
| CN114443363A (en) | Data processing method, device, equipment and medium | |
| CN112667358A (en) | Management method of virtual machine snapshot, electronic device and computer readable medium | |
| CN112764972A (en) | Cross-platform file attribute backup and recovery method and device | |
| CN116501545A (en) | Data backup method, recovery method, device, equipment and readable storage medium | |
| CN115794487A (en) | Service recovery method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20220412 |
|
| WW01 | Invention patent application withdrawn after publication |