WO2021238267A1 - 基于集群文件系统的数据备份方法、装置及可读存储介质 - Google Patents

基于集群文件系统的数据备份方法、装置及可读存储介质 Download PDF

Info

Publication number
WO2021238267A1
WO2021238267A1 PCT/CN2021/073477 CN2021073477W WO2021238267A1 WO 2021238267 A1 WO2021238267 A1 WO 2021238267A1 CN 2021073477 W CN2021073477 W CN 2021073477W WO 2021238267 A1 WO2021238267 A1 WO 2021238267A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
backup
backed
storage
file system
Prior art date
Application number
PCT/CN2021/073477
Other languages
English (en)
French (fr)
Inventor
颜秉珩
方浩
Original Assignee
浪潮电子信息产业股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 浪潮电子信息产业股份有限公司 filed Critical 浪潮电子信息产业股份有限公司
Priority to US17/927,719 priority Critical patent/US20230138736A1/en
Publication of WO2021238267A1 publication Critical patent/WO2021238267A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1451Management of the data involved in backup or backup restore by selection of backup contents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1464Management of the backup or restore process for networked environments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/116Details of conversion of file system types or formats
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • G06F16/1824Distributed file systems implemented using Network-attached Storage [NAS] architecture
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/1858Parallel file systems, i.e. file systems supporting multiple processors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45579I/O management, e.g. providing access to device drivers or storage
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45595Network integration; Enabling network access in virtual machine instances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/815Virtual
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84Using snapshots, i.e. a logical point-in-time copy of the data

Definitions

  • This application relates to the technical field of virtual machine data resource backup, and in particular to a data backup method, device and computer-readable storage medium based on a cluster file system.
  • Data backup is the basis of disaster recovery. By copying all or part of the data set from the hard disk or array of the application host to other storage media, it can effectively prevent system operation errors or system failures from causing data loss and ensure data security. With the rapid development of cloud technology, the virtual machine data of the cloud platform also needs to be backed up.
  • LAN backup is to deploy a backup agent and a set of backup servers in the production system.
  • the data generated in the production system is transmitted to the backup server through the backup agent.
  • This solution takes up a lot of computing resources, storage and network resources of the production system. , Not suitable for large data volume data backup.
  • the LAN-Free solution is to directly use the data network to back up from the data disk to the backup server. It does not need to occupy the network resources of the service but needs to occupy the computing resources. Occupying production server resources for data backup not only requires higher hardware requirements for the production server, but may even affect the normal operation of the production server.
  • This application provides a data backup method, device, and computer-readable storage medium based on a cluster file system, which realizes the backup of virtual machine data without occupying production server resources.
  • One aspect of the embodiments of the present invention provides a data backup method based on a cluster file system, including:
  • the production server is formatted into a cluster file system according to the storage disk LUN provided by the storage system or disk array to provide virtual storage resources for the cloud platform virtual machine;
  • the data to be backed up is taken for backup; the data backup types include incremental data backup and full data backup.
  • the storage location of the data to be backed up on the LUN is determined according to the metadata information, the type of data backup, the SCSI identification number of the LUN where the virtual machine to be backed up is located, and the file name, and the Backing up the data to be backed up read from the storage location includes:
  • the data backup type is incremental data backup
  • the difference data read from the storage location is backed up.
  • the data storage format is a Qcow2 format, including a header, an L1 table, an L2 table, and multiple clusters; the data of the virtual machine to be backed up is indexed to the difference through the L1 table and the L2 table The target cluster where the data is stored is used to read corresponding data from the target cluster according to the starting position and the data length.
  • the storage location of the data to be backed up on the LUN is determined according to the metadata information, the type of data backup, the SCSI identification number of the LUN where the virtual machine to be backed up is located, and the file name, and the Backing up the data to be backed up read from the storage location includes:
  • the data backup type is full data backup
  • the metadata in the metadata information and the data to be backed up read from the storage location are backed up.
  • the method further includes:
  • target difference data includes the starting position, data length, and data content of the changed data
  • the data analysis and reading tool is used to analyze the storage content of the file system on the LUN and assist the backup server to read the stored data.
  • Another aspect of the embodiments of the present invention provides a data backup device based on a cluster file system, including:
  • the system deployment module is used to pre-deploy the production server and the backup server in the same storage area network;
  • the production server is formatted into a cluster file system according to the storage disk LUN provided by the storage system or disk array for providing cloud platform virtual machines Virtual storage resources;
  • the metadata information reading module is configured to read the metadata information of the virtual machine to be backed up from the cluster file system based on the file name of the virtual disk corresponding to the virtual machine to be backed up and the data storage format of the virtual disk;
  • the data backup module is used to determine the storage location of the data to be backed up on the LUN according to the metadata information, the type of data backup, the SCSI identification number of the LUN where the virtual machine to be backed up is located, and the file name, and to retrieve the data from The data to be backed up read from the storage location is backed up; the data backup types include incremental data backup and full data backup.
  • the data backup module includes:
  • a backup type determining submodule configured to, if the virtual machine to be backed up is not the first data backup, then the data backup type is incremental data backup;
  • a differential address obtaining submodule configured to compare the metadata information with the metadata stored in the backup server to determine the differential data and obtain the differential address of the differential data;
  • the storage data location information determining sub-module is configured to determine the starting position and the data length of the differential address in the virtual disk according to the data distribution mode of the data storage format;
  • a storage location locating submodule configured to locate the storage location of the difference data on the LUN according to the SCSI identification number, the file name, the starting location, and the data length;
  • the virtual data backup sub-module is used to back up the differential data read from the storage location.
  • the data recovery module includes:
  • the data recovery work preparation sub-module is used to send to the production server an instruction to suspend or shut down the carrying virtual machine when a data recovery request is received;
  • the change data determination sub-module is configured to obtain corresponding target difference data information according to the time point to be recovered carried in the data recovery request, where the target difference data includes the starting position, data length, and data content of the changed data;
  • the data analysis and reading tool is used to analyze the storage content of the file system on the LUN and assist the backup server to read the stored data;
  • the data writing submodule is used to call a pre-installed data analysis and reading tool, and overwrite the target data stored in the backup platform to the LUN according to the file name and the target difference data information.
  • An embodiment of the present invention also provides a data backup device based on a cluster file system, including a processor, configured to execute the computer program stored in the memory to implement the data backup method based on the cluster file system as described in any preceding item A step of.
  • the embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a data backup program based on a cluster file system, and when the data backup program based on a cluster file system is executed by a processor Implement the steps of the data backup method based on the cluster file system as described in any of the preceding items.
  • the advantage of the technical solution provided by this application is that the production server and the backup server share the same storage area network, there is no need to establish a local area network to communicate with each other, and the two do not need to perform direct data interaction, and do not occupy the resources of the production server;
  • the cloud platform virtual machine Data is stored in the cluster file system formatted by the production server based on LUNs provided by the storage system or disk array, without occupying storage resources.
  • the backup server reads data from the cluster file system and then performs backups. The entire process does not depend on the production system. Computing resources and storage resources realize the backup of virtual machine data without occupying the resources of the production server, and at the same time, there is no need to extend the relevant SCSI instructions to complete the data backup.
  • the embodiment of the present invention also provides a corresponding implementation device and computer-readable storage medium for a data backup method based on a cluster file system, which further makes the method more practical.
  • the device and the computer-readable storage medium have corresponding The advantages.
  • FIG. 1 is a schematic flowchart of a data backup method based on a cluster file system according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of the deployment of a backup server and a production server according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a data storage format of a cluster file system provided by an embodiment of the present invention.
  • FIG. 4 is a structural diagram of a specific implementation manner of a data backup device based on a cluster file system provided by an embodiment of the present invention
  • FIG. 5 is a structural diagram of another specific implementation manner of a data backup device based on a cluster file system provided by an embodiment of the present invention.
  • FIG. 6 is a structural diagram of another specific implementation manner of a data backup device based on a cluster file system provided by an embodiment of the present invention.
  • FIG. 1 is a schematic flowchart of a data backup method based on a cluster file system provided by an embodiment of the present invention.
  • the embodiment of the present invention may include the following contents:
  • S101 Deploy the same storage area network for the production server and the backup server in advance; the production server is formatted into a cluster file system according to the LUN provided by the storage system or disk array to provide virtual storage resources for the cloud platform virtual machine.
  • the technical solution of this application is applied to data backup of cloud platform systems based on cluster file systems, for example, it can be applied to cloud platform systems of OCFS2 file systems, such as data backup of Incloud Sphere and Incloud Rail platforms.
  • the cloud platform system includes a backup server and a production server, and the virtual machine data in the cloud platform system is backed up on the backup server. Before the cloud platform system can run normally, the cloud management platform needs to be deployed and networked. Because cloud platforms such as InCloud Sphere and Incloud Rail platforms use cluster file systems and rely on the IP-SAN or FC-SAN networking environment, the backup data platform is installed for the backup server after the cloud management platform deployment and networking are completed.
  • the cloud platform networking environment can include:
  • the production server and the backup server share the same storage area network (Storage Area Network, SAN).
  • the storage area network network can be FC-SAN (Fibre Channel-Storage Area Network) or IP-SAN (Internet Protocol-Storage Area Network), This application does not make any restrictions on this.
  • the backup server and the production server do not need to establish a local area network (LAN) interconnection network.
  • the production server is formatted as an OCFS2 cluster file system according to the storage disk LUN (Logical Unit Number) provided by the storage system or disk array to provide virtual storage resources for the cloud platform.
  • LUN Logical Unit Number
  • LUN Logical Unit Number
  • the backup server also needs to be pre-installed with a data analysis and reading tool for analyzing the storage content of the file system on the LUN and assisting the backup server to read the stored data.
  • the data analysis and reading tool may be Storage, for example.
  • Agent package is a combination of commands used to parse the storage content of the file system on the LUN and assist the backup server to read the stored data without interacting with the production server.
  • S102 Read metadata information of the virtual machine to be backed up from the cluster file system based on the file name of the virtual disk corresponding to the virtual machine to be backed up and the data storage format of the virtual disk.
  • the cloud platform system After the cloud platform system is deployed, it will be in normal working state.
  • the virtual disk corresponding to the virtual machine to be backed up can be obtained from the backup server, its occupied space capacity value, and the data storage format of the virtual disk.
  • the SCSI identification number of the LUN where the virtual machine to be backed up is located.
  • the virtual machine to be backed up is the virtual machine that needs to perform data backup in the backup request.
  • the SCSI identification number is used as the unique identification of the storage disk, and the LUN can be addressably located based on the SCSI identification number of the LUN where the virtual machine to be backed up is located.
  • a file system is created based on the storage disk LUN provided by the storage array, and the files provided by the file system are used to provide storage resources for virtual machines on the cloud platform.
  • a file is usually called a virtual disk.
  • the data storage format of the virtual disk is, for example, the Qcow2 format.
  • the virtual disk stores data resources based on the Qcow2 format, and of course it can also be in the RAW format.
  • the RAW format is raw data without storage format and can be read directly. Different data storage formats correspond to different storage data distributions.
  • the virtual disk of the cluster file system includes metadata and data when storing data, and the metadata records the update information and storage address of the stored data.
  • S103 Determine the storage location of the data to be backed up on the LUN according to the metadata information, the data backup type, the SCSI identification number and file name of the LUN where the virtual machine to be backed up is located, and back up the data to be backed up read from the storage location.
  • the changed data can be determined by comparing the metadata information stored in the backup server.
  • Data backup types include incremental data backup and full data backup. Incremental data backup means backing up the data that has changed during two consecutive backups, while full data backup means that all data is backed up for each backup. The user can follow Choose according to actual needs. Optionally, when the virtual machine backs up data for the first time, you can choose a full data backup, and when you back up data for the nth time, you can choose an incremental data backup.
  • the LUN can be located based on the SCSI identification number of the LUN where the virtual machine to be backed up is located, the virtual disk on the LUN can be determined based on the file name, the corresponding data can be read from the virtual disk based on the metadata information and the data backup type, and the backup server can be called
  • the Storage Agent package reads and analyzes the data on the LUN, and then backs up the read data on the backup server.
  • the production server and the backup server share the same storage area network, and there is no need to establish a local area network to communicate with each other, and the two do not need to perform direct data interaction, and do not occupy the resources of the production server; the cloud platform virtual machine
  • the data is stored in the cluster file system of the production server based on the LUN formatted by the storage system or disk array, without occupying the storage resources of the production server.
  • the backup server reads the data from the cluster file system and then performs backups. The whole process does not depend on Based on the computing resources and storage resources of the production system, the backup of virtual machine data is realized without occupying the resources of the production server, and at the same time, there is no need to extend the relevant SCSI commands to complete the data backup.
  • step S103 there is no limitation on how to perform step S103.
  • an implementation manner is given, which may include the following steps:
  • the data backup type is incremental data backup.
  • A2 Compare the metadata information with the metadata stored in the backup server to determine the difference data and obtain the difference address of the difference data.
  • the difference data is the data changed during two consecutive backups, and the difference address is the storage address of the changed data.
  • A3 Determine the starting position and data length of the differential address in the virtual disk according to the data distribution method of the data storage format.
  • A4 According to the SCSI identification number, file name, starting position and data length, locate the storage location of the difference data on the LUN.
  • A5 Back up the difference data read from the storage location.
  • S103 may include:
  • the data backup type is full data backup.
  • B2 Determine the storage location of the data to be backed up on the LUN according to the SCSI identification number and file name.
  • the entire metadata needs to be backed up on the backup server. If the data backup type is full data backup, you do not need to pay attention to differential data, and all virtual machine data at the current backup time are read, processed, and backed up in the backup server.
  • the embodiment of the present invention determines the corresponding data backup type for the number of backups of the virtual machine. In the subsequent backup process, only the incremental data is backed up, which improves the backup efficiency and the storage space utilization of the backup server is higher.
  • the data recovery process can include:
  • the target difference data includes the starting position, data length, and data content of the changed data. Among them, the target difference data is the data whose time point to be restored is changed compared with the current time point.
  • C3 Call the pre-installed data analysis and reading tool, and overwrite the target data stored in the backup platform to the LUN based on the file name and target difference data information.
  • the data analysis and reading tool is used to analyze the storage content of the file system on the LUN and assist the backup server to read the stored data.
  • the Storage Agent tool is called, and the data stored in the backup platform is overwritten and written to the LUN at the corresponding location according to the name, starting location, and length of the virtual disk file.
  • the virtual disk of the virtual machine can obtain the original data recorded by the backup platform at the point in time to be restored.
  • the data recovery process of the embodiment of the present invention also does not occupy the calculation and network resources of the LAN and the production server.
  • this application also provides an OCFS2 cluster file system in which the data storage format of the virtual disk is Qcow2 format as an example to describe the entire data backup process, including the following content:
  • a single virtual disk that is, a file in a file system, is composed of metadata and data.
  • the data in the file is retrieved from the file system.
  • the Qcow2 format is a fixed data format that uses a secondary index table to store and retrieve data. Including header, L1 table, L2 table and multiple clusters.
  • the actual storage content of the data area is in the Qcow2 format
  • the Qcow2 format is composed of basic data structures such as Header, L1 and L2 tables, and Cluster.
  • the L1 and L2 tables it can be indexed to the Cluster (data Storage location) stored content.
  • the content stored in the virtual machine is actually stored in the Cluster.
  • the data of the virtual machine to be backed up is indexed to the target cluster where the differential data is stored through the L1 table and L2 table, so as to read from the target cluster according to the starting position and data length Get the corresponding data.
  • the file organization of the file system from the LUN can be directly passed through the file name, that is, the content in the virtual machine can be retrieved in the Qcow2 format, so as to achieve the purpose of backing up the data in the virtual machine.
  • the backup platform On the backup platform, according to the virtual machine to be backed up, obtain the virtual disk corresponding to the virtual machine, the capacity size, and the virtual disk format. At the same time, obtain the SCSI ID of the LUN where the virtual machine is located.
  • Compare the difference information of the two metadata During the first backup, store the metadata area in the backup server. During the second backup, compare the metadata stored last time and check the difference addresses of the two Qcow2 metadata compared to the last time.
  • Invoke the Storage Agent command pass in the file name of the virtual disk, retrieve the storage location on the LUN according to the starting position and data length of the file, and use the basic file read-write interface at the corresponding storage location to read the corresponding content. And store the difference data on the backup server.
  • the embodiment of the present invention also provides a corresponding device for the data backup method based on the cluster file system, which further makes the method more practical.
  • the device can be described separately from the perspective of functional modules and the perspective of hardware.
  • the following describes the data backup device based on the cluster file system provided by the embodiment of the present invention.
  • the data backup device based on the cluster file system described below and the data backup method based on the cluster file system described above can be referred to each other.
  • FIG. 4 is a structural diagram of a data backup device based on a cluster file system provided by an embodiment of the present invention in a specific implementation manner.
  • the device may include:
  • the system deployment module 401 is used to deploy the production server and the backup server in the same storage area network in advance; the production server is formatted into a cluster file system according to the LUN provided by the storage system or disk array to provide virtual storage resources for the cloud platform virtual machine .
  • the metadata information reading module 402 is configured to read the metadata information of the virtual machine to be backed up from the cluster file system based on the file name of the virtual disk corresponding to the virtual machine to be backed up and the data storage format of the virtual disk.
  • the data backup module 403 is used to determine the storage location of the data to be backed up on the LUN according to the metadata information, data backup type, SCSI identification number and file name of the LUN where the virtual machine to be backed up is located, and to read the data to be backed up from the storage location.
  • Back up data for backup; data backup types include incremental data backup and full data backup.
  • the data backup module 403 may include:
  • the backup type determination sub-module is used for if the virtual machine to be backed up is not the first data backup, then the data backup type is incremental data backup;
  • the differential address obtaining submodule is used to compare the metadata information with the metadata stored in the backup server to determine the differential data and obtain the differential address of the differential data;
  • the storage data location information determining sub-module is used to determine the starting position and data length of the differential address in the virtual disk according to the data distribution mode of the data storage format;
  • the storage location positioning sub-module is used to locate the storage location of the difference data on the LUN according to the SCSI identification number, file name, starting position and data length;
  • the virtual data backup sub-module is used to back up the differential data read from the storage location.
  • the data backup module 403 may further include:
  • the second backup type determining sub-module is used for if the virtual machine to be backed up is the first data backup, the data backup type is full data backup;
  • the storage location determination sub-module is used to determine the storage location of the data to be backed up on the LUN according to the SCSI identification number and file name;
  • the backup sub-module is used to back up the metadata in the metadata information and the data to be backed up read from the storage location.
  • the device may further include a data recovery module 404, for example, and the data recovery module 404 may include:
  • the data recovery work preparation sub-module is used to send instructions to the production server to suspend or shut down the carrying virtual machine when a data recovery request is received;
  • the change data determination sub-module is used to obtain the corresponding target difference data information according to the time point to be recovered carried in the data recovery request.
  • the target difference data includes the starting position, data length and data content of the changed data; it is used for data analysis and reading tools To analyze the storage content of the file system on the LUN and assist the backup server to read the stored data;
  • the data writing sub-module is used to call the pre-installed data analysis and reading tool, and overwrite the target data stored in the backup platform to the LUN according to the file name and target difference data information.
  • each functional module of the data backup device based on the cluster file system described in the embodiment of the present invention can be specifically implemented according to the method in the above method embodiment.
  • Fig. 6 is a structural diagram of another data backup device based on a cluster file system provided by an embodiment of the application. As shown in Figure 6, the device may include a memory 60 for storing computer programs;
  • the processor 61 is configured to implement the steps of the data backup method based on the cluster file system as mentioned in any of the above embodiments when the computer program is executed.
  • the processor 61 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on.
  • the processor 61 can adopt at least one hardware form among DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), PLA (Programmable Logic Array, Programmable Logic Array). accomplish.
  • the processor 61 may also include a main processor and a coprocessor.
  • the main processor is a processor used to process data in the awake state, also called a CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor used to process data in the standby state.
  • the processor 61 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing content that needs to be displayed on the display screen.
  • the processor 61 may also include an AI (Artificial Intelligence) processor, and the AI processor is used to process computing operations related to machine learning.
  • AI Artificial Intelligence
  • the memory 60 may include one or more computer-readable storage media, which may be non-transitory.
  • the memory 60 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices.
  • the memory 60 is used to store at least the following computer program 601. After the computer program is loaded and executed by the processor 61, the relevant steps of the data backup method based on the cluster file system disclosed in any of the foregoing embodiments can be implemented.
  • the resources stored in the memory 60 may also include an operating system 602 and data 603, etc., and the storage mode may be short-term storage or permanent storage.
  • the operating system 602 may include Windows, Unix, Linux, and so on.
  • the data 603 may include, but is not limited to, corresponding data during the data backup process based on the cluster file system.
  • the data backup device based on the cluster file system may further include a display screen 62, an input/output interface 63, a communication interface 64, a power supply 65, and a communication bus 66.
  • FIG. 6 does not constitute a limitation on the data backup device based on the cluster file system, and may include more or fewer components than shown, for example, a sensor 67 may also be included.
  • each functional module of the data backup device based on the cluster file system described in the embodiment of the present invention can be specifically implemented according to the method in the above method embodiment.
  • the data backup method based on the cluster file system in the above embodiment is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium Execute all or part of the steps of the method in each embodiment of this application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), electrically erasable programmable ROM, registers, hard disks, Various media that can store program codes, such as removable disks, CD-ROMs, magnetic disks, or optical disks.
  • an embodiment of the present invention also provides a computer-readable storage medium that stores a data backup program based on a cluster file system, and the data backup program based on a cluster file system is executed by a processor as in any of the above embodiments. Describes the steps of the data backup method based on the cluster file system.
  • each functional module of the computer-readable storage medium in the embodiment of the present invention can be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process can refer to the relevant description of the foregoing method embodiment, and will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种基于集群文件系统的数据备份方法、装置及计算机可读存储介质。其中,方法包括预先为生产服务器和备份服务器部署同一存储区域网络;生产服务器根据存储系统或磁盘阵列提供的LUN格式化为集群文件系统,以用于为云平台虚拟机提供虚拟存储资源;基于待备份虚拟机对应的虚拟磁盘的文件名称和虚拟磁盘的数据存储格式从集群文件系统中读取待备份虚拟机的元数据信息;根据元数据信息、数据备份类型、待备份虚拟机所在LUN的SCSI标识号和虚拟磁盘的文件名称确定待备份数据在LUN上的存储位置,并将从存储位置中读取的待备份数据进行备份,从而实现了在不占用生产服务器资源的基础上进行虚拟机数据的备份。

Description

基于集群文件系统的数据备份方法、装置及可读存储介质
本申请要求于2020年05月29日提交中国专利局、申请号为202010471506.6、发明名称为“基于集群文件系统的数据备份方法、装置及可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及虚拟机数据资源备份技术领域,特别是涉及一种基于集群文件系统的数据备份方法、装置及计算机可读存储介质。
背景技术
数据备份为容灾的基础,通过将全部或部分数据集合从应用主机的硬盘或阵列复制到其它的存储介质可以有效防止系统出现操作失误或系统故障导致数据丢失,保障数据安全性。随着云技术的快速发展,云平台的虚拟机数据也需要进行备份。
相关技术通常采用LAN备份或LAN-Free备份进行虚拟机数据备份。其中,LAN备份是在生产系统中部署备份代理和一套备份服务器,生产系统中产生的数据通过备份代理将数据传输到备份服务器,该方案对生产系统的计算资源、存储和网络资源占用较大,不适用于大数据量数据备份。而LAN-Free方案是直接通过数据网络,从数据盘上备份到备份服务器,不需要占用服务的网络资源但是需要占用计算资源。占用生产服务器资源进行数据备份,不仅对生产服务器硬件要求较高,甚至可能会影响生产服务器的正常运行。
鉴于此,如何在数据备份过程中实现备份数据不经过生产服务器的计算资源和网络资源,是所属领域技术人员需要解决的技术问题。
发明内容
本申请提供了一种基于集群文件系统的数据备份方法、装置及计算机可读存储介质,实现了在不占用生产服务器资源的基础上进行虚拟机数据 的备份。
为解决上述技术问题,本发明实施例提供以下技术方案:
本发明实施例一方面提供了一种基于集群文件系统的数据备份方法,包括:
预先为生产服务器和备份服务器部署同一存储区域网络;所述生产服务器根据存储系统或磁盘阵列提供的存储磁盘LUN格式化为集群文件系统,以用于为云平台虚拟机提供虚拟存储资源;
基于待备份虚拟机对应的虚拟磁盘的文件名称和所述虚拟磁盘的数据存储格式从所述集群文件系统中读取所述待备份虚拟机的元数据信息;
根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份;所述数据备份类型包括增量数据备份和全量数据备份。
可选的,所述根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份包括:
若所述待备份虚拟机不为第一次数据备份,则所述数据备份类型为增量数据备份;
比对所述元数据信息和所述备份服务器中存储的元数据以确定差异数据并得到所述差异数据的差异地址;
根据所述数据存储格式的数据分布方式确定所述差异地址在所述虚拟磁盘中的起始位置和数据长度;
根据所述SCSI标识号、所述文件名称、所述起始位置和所述数据长度定位所述差异数据在所述LUN上的存储位置;
将从所述存储位置中读取的差异数据进行备份。
可选的,所述数据存储格式为Qcow2格式,包括题头、L1表、L2表和多个集群;所述待备份虚拟机的数据通过所述L1表和所述L2表索引到所述差异数据存储所在的目标集群,以用于根据所述起始位置和数据长度 从所述目标集群中读取相应数据。
可选的,所述根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份包括:
若所述待备份虚拟机为第一次数据备份,则所述数据备份类型为全量数据备份;
根据所述SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置;
将所述元数据信息中的元数据和从所述存储位置中读取的所述待备份数据进行备份。
可选的,所述将从所述存储位置中读取的差异数据进行备份之后,还包括:
当接收到数据恢复请求,向所述生产服务器发送将搭载虚拟机进行暂停工作或关机的指令;
根据所述数据恢复请求中携带的待恢复时间点获取相应的目标差异数据信息,所述目标差异数据包括变更数据的起始位置、数据长度和数据内容;
调用预先安装的数据解析读取工具,根据所述文件名称和所述目标差异数据信息将备份平台中存储的目标数据覆盖写至LUN上;
其中,所述数据解析读取工具用于对LUN上文件系统存储内容进行解析并协助所述备份服务器读取存储的数据。
本发明实施例另一方面提供了一种基于集群文件系统的数据备份装置,包括:
系统部署模块,用于预先将生产服务器和备份服务器部署同一存储区域网络;所述生产服务器根据存储系统或磁盘阵列提供的存储磁盘LUN格式化为集群文件系统,以用于为云平台虚拟机提供虚拟存储资源;
元数据信息读取模块,用于基于待备份虚拟机对应的虚拟磁盘的文件名称和所述虚拟磁盘的数据存储格式从所述集群文件系统中读取所述待备 份虚拟机的元数据信息;
数据备份模块,用于根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份;所述数据备份类型包括增量数据备份和全量数据备份。
可选的,所述数据备份模块包括:
备份类型确定子模块,用于若所述待备份虚拟机不为第一次数据备份,则所述数据备份类型为增量数据备份;
差异地址获取子模块,用于比对所述元数据信息和所述备份服务器中存储的元数据以确定差异数据并得到所述差异数据的差异地址;
存储数据定位信息确定子模块,用于根据所述数据存储格式的数据分布方式确定所述差异地址在所述虚拟磁盘中的起始位置和数据长度;
存储位置定位子模块,用于根据所述SCSI标识号、所述文件名称、所述起始位置和所述数据长度定位所述差异数据在所述LUN上的存储位置;
虚拟数据备份子模块,用于将从所述存储位置中读取的差异数据进行备份。
可选的,还包括数据恢复模块,所述数据恢复模块包括:
数据恢复工作准备子模块,用于当接收到数据恢复请求,向所述生产服务器发送将搭载虚拟机进行暂停工作或关机的指令;
变更数据确定子模块,用于根据所述数据恢复请求中携带的待恢复时间点获取相应的目标差异数据信息,所述目标差异数据包括变更数据的起始位置、数据长度和数据内容;所述数据解析读取工具用于对LUN上文件系统存储内容进行解析并协助所述备份服务器读取存储的数据;
写数据子模块,用于调用预先安装的数据解析读取工具,根据所述文件名称和所述目标差异数据信息将备份平台中存储的目标数据覆盖写至LUN上。
本发明实施例还提供了一种基于集群文件系统的数据备份装置,包括处理器,所述处理器用于执行存储器中存储的计算机程序时实现如前任一 项所述基于集群文件系统的数据备份方法的步骤。
本发明实施例最后还提供了一种计算机可读存储介质,所述计算机可读存储介质上存储有基于集群文件系统的数据备份程序,所述基于集群文件系统的数据备份程序被处理器执行时实现如前任一项所述基于集群文件系统的数据备份方法的步骤。
本申请提供的技术方案的优点在于,生产服务器和备份服务器共享同一存储区域网络,无需建立局域网进行互通网络,二者不需要进行直接数据交互,不占用生产服务器的资源;将云平台虚拟机的数据存储在生产服务器基于存储系统或磁盘阵列提供的LUN格式化的集群文件系统中,无需占用存储资源,备份服务器通过从集群文件系统中读取数据然后进行备份,整个过程不依赖于生产系统的计算资源和存储资源,实现了在不占用生产服务器资源的基础上进行虚拟机数据的备份,同时还无须扩展相关SCSI指令完成对数据的备份。
此外,本发明实施例还针对基于集群文件系统的数据备份方法提供了相应的实现装置及计算机可读存储介质,进一步使得所述方法更具有实用性,所述装置及计算机可读存储介质具有相应的优点。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性的,并不能限制本公开。
附图说明
为了更清楚的说明本发明实施例或相关技术的技术方案,下面将对实施例或相关技术描述中所需要使用的附图作简单的介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本发明实施例提供的一种基于集群文件系统的数据备份方法的流程示意图;
图2为本发明实施例提供的备份服务器和生产服务器部署示意图;
图3为本发明实施例提供的集群文件系统的数据存储格式示意图;
图4为本发明实施例提供的基于集群文件系统的数据备份装置的一种 具体实施方式结构图;
图5为本发明实施例提供的基于集群文件系统的数据备份装置的另一种具体实施方式结构图;
图6为本发明实施例提供的基于集群文件系统的数据备份装置的再一种具体实施方式结构图。
具体实施方式
为了使本技术领域的人员更好地理解本发明方案,下面结合附图和具体实施方式对本发明作进一步的详细说明。显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”“第四”等是用于区别不同的对象,而不是用于描述特定的顺序。此外术语“包括”和“具有”以及他们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可包括没有列出的步骤或单元。
在介绍了本发明实施例的技术方案后,下面详细的说明本申请的各种非限制性实施方式。
首先参见图1,图1为本发明实施例提供的一种基于集群文件系统的数据备份方法的流程示意图,本发明实施例可包括以下内容:
S101:预先为生产服务器和备份服务器部署同一存储区域网络;生产服务器根据存储系统或磁盘阵列提供的LUN格式化为集群文件系统,以用于为云平台虚拟机提供虚拟存储资源。
本申请技术方案应用于基于集群文件系统的云平台系统的数据备份,例如可应用于OCFS2文件系统的云平台系统,如Incloud Sphere和Incloud Rail平台的数据备份。云平台系统包括备份服务器和生产服务器,将云平台系统中的虚拟机数据在备份服务器中进行备份。在云平台系统正常运行 之前,需要先进行云管理平台部署和组网。由于例如InCloud Sphere和Incloud Rail平台的云平台采用集群文件系统依赖于IP-SAN或FC-SAN组网环境,在云管理平台部署和组网完成后为备份服务器安装备份数据平台。如图2所示,云平台组网环境可包括:
生产服务器和备份服务器共用同一个存储区域网络(Storage Area Network,SAN),存储区域网络组网可以是FC-SAN(Fibre Channel-Storage Area Network)或IP-SAN(Internet Protocol-Storage Area Network),本申请对此均不做任何限定。备份服务器和生产服务器不需要建立局域网(Local Area Network,LAN)互通网络。其中,生产服务器根据存储系统或磁盘阵列提供的存储磁盘LUN(Logical Unit Number)格式化为OCFS2集群文件系统,为云平台提供虚拟存储资源。在存储区域网络中,LUN为存储系统中最小的存储单元,可称为存储磁盘。
此外,为了实现数据备份功能,备份服务器还需要预先安装用于对LUN上文件系统存储内容进行解析并协助备份服务器读取存储的数据的数据解析读取工具,数据解析读取工具例如可为Storage Agent包。Storage Agent包为一组命令组合,用以对LUN上文件系统存储内容进行解析,协助备份服务器读取存储的数据,不需要和生产服务器进行交互。
S102:基于待备份虚拟机对应的虚拟磁盘的文件名称和虚拟磁盘的数据存储格式从集群文件系统中读取待备份虚拟机的元数据信息。
当云平台系统部署完后进行正常工作状态,当接收到虚拟机数据备份请求后,可实现从备份服务器中获取待备份虚拟机对应的虚拟磁盘及其占用空间容量值、虚拟磁盘的数据存储格式和待备份虚拟机所在LUN的SCSI标识号。其中,待备份虚拟机即为备份请求中需要进行数据备份的虚拟机。SCSI标识号作为存储磁盘的唯一标识,基于待备份虚拟机所在LUN的SCSI标识号可寻址定位LUN。在生产服务器中,基于存储阵列提供的存储磁盘LUN创建文件系统,同时利用文件系统提供的文件,为云平台的虚拟机提供存储资源。文件通常又被称虚拟磁盘,虚拟磁盘的数据存储格式例如为Qcow2格式,虚拟磁盘即基于Qcow2格式存储数据资源,当然还可为RAW格式。RAW格式为裸数据,无存储格式,可以直接读取。不同 数据存储格式对应的存储数据分布情况不同。集群文件系统的虚拟磁盘存储数据时包括元数据和数据,元数据记录存储数据的更新信息、存储地址等。
S103:根据元数据信息、数据备份类型、待备份虚拟机所在LUN的SCSI标识号和文件名称确定待备份数据在LUN上的存储位置,并将从存储位置中读取的待备份数据进行备份。
在S103读取元数据信息后,可通过对比备份服务器中存储的元数据信息来确定变更数据,当然,对于备份服务器中不存在元数据,表明该虚拟机为第一次备份。数据备份类型包括增量数据备份和全量数据备份,增量数据备份为备份相邻两次备份过程中发生变更的数据,而全量数据备份为每次备份均将所有数据均进行备份,用户可根据实际需求进行选择。可选的,在虚拟机第一次备份数据时,可选择全量数据备份,在第n次备份数据时,可选择增量数据备份。基于待备份虚拟机所在LUN的SCSI标识号可定位LUN,基于文件名称可确定LUN上的虚拟磁盘,基于元数据信息和数据备份类型可从虚拟磁盘中读取相应的数据,可调用备份服务器的Storage Agent包读取并解析LUN上的数据,然后将读取的数据备份在备份服务器中。
在本发明实施例提供的技术方案中,生产服务器和备份服务器共享同一存储区域网络,无需建立局域网进行互通网络,二者不需要进行直接数据交互,不占用生产服务器的资源;将云平台虚拟机的数据存储在生产服务器基于存储系统或磁盘阵列提供的LUN格式化的集群文件系统中,无需占用生产服务器的存储资源,备份服务器通过从集群文件系统中读取数据然后进行备份,整个过程不依赖于生产系统的计算资源和存储资源,实现了在不占用生产服务器资源的基础上进行虚拟机数据的备份,同时还无须扩展相关SCSI指令完成对数据的备份。
需要说明的是,本申请中各步骤之间没有严格的先后执行顺序,只要符合逻辑上的顺序,则这些步骤可以同时执行,也可按照某种预设顺序执行,图1只是一种示意方式,并不代表只能是这样的执行顺序。
在上述实施例中,对于如何执行步骤S103并不做限定,本实施例中给出一种实施方式,可包括如下步骤:
A1:若待备份虚拟机不为第一次数据备份,则数据备份类型为增量数据备份。
A2:比对元数据信息和备份服务器中存储的元数据以确定差异数据并得到差异数据的差异地址。差异数据即为相邻两次备份过程中变更的数据,差异地址即为变更数据存储地址。
A3:根据数据存储格式的数据分布方式确定差异地址在虚拟磁盘中的起始位置和数据长度。
A4:根据SCSI标识号、文件名称、起始位置和数据长度定位差异数据在LUN上的存储位置。
A5:将从存储位置中读取的差异数据进行备份。
本申请还提供了另一种实施方式,与上述方式并列,因此,可作为另一种可选的实施方式,S103可包括:
B1:若待备份虚拟机为第一次数据备份,则数据备份类型为全量数据备份。
B2:根据SCSI标识号和文件名称确定待备份数据在LUN上的存储位置。
B3:将元数据信息中的元数据和从存储位置中读取的待备份数据进行备份。
若虚拟机为第一次数据备份,则需要将元数据整体备份在备份服务器中。若数据备份类型为全量数据备份,则不需要关注差异数据,将当前备份时刻的所有虚拟机数据均读取处理备份在备份服务器中。
由上可知,本发明实施例针对虚拟机的备份次数确定相应的数据备份类型,在后续备份过程中,仅仅备份增量数据,提高备份效率,备份服务器的存储空间利用率更高。
可以理解的是,虚拟机基于运行任务需要回滚到某一时刻,相应的这一时刻的数据需要进行恢复,也就是说,将虚拟机重置在目标时刻,这时 就需要基于备份服务器进行数据恢复,数据恢复过程可包括:
C1:当接收到数据恢复请求,向生产服务器发送将搭载虚拟机进行暂停工作或关机的指令。为了保证数据的一致性,需要生产服务器中的虚拟机暂停或关机才能做数据恢复。
C2:根据数据恢复请求中携带的待恢复时间点获取相应的目标差异数据信息,目标差异数据包括变更数据的起始位置、数据长度和数据内容。其中,目标差异数据为待恢复时间点与当前时刻时间点相比发生变更的数据。
C3:调用预先安装的数据解析读取工具,根据文件名称和目标差异数据信息将备份平台中存储的目标数据覆盖写至LUN上。其中,数据解析读取工具用于对LUN上文件系统存储内容进行解析并协助备份服务器读取存储的数据。如调用Storage Agent工具,根据虚拟磁盘文件的名称,及起始位置,长度,在相应的位置,将备份平台中存储的数据,覆盖写到LUN上。
C4:虚拟机的虚拟磁盘即可获得备份平台记录的待恢复时间点的原有数据。
由上可知,本发明实施例的数据恢复过程同样不占用LAN和生产服务器计算和网络资源。
为了使所属领域技术人员更加清楚明白本申请技术方案,本申请还提供以虚拟磁盘的数据存储格式为Qcow2格式的OCFS2集群文件系统为例,阐述整个数据备份过程,包括下述内容:
采用Qcow2格式存储数据资源的虚拟磁盘的整体数据存储布局格式请参阅图3所示,单个虚拟磁盘,即文件系统的文件是由元数据和数据两部分组成,从文件系统中检索文件中的数据,首先需要根据文件的名称,查询到元数据信息,根据元数据信息检索到数据存储位置及数据长度,最后从LUN上的存储位置和长度即可得到相应的数据。Qcow2格式为一个固定的数据格式,采用二级索引表的方式存储和检索数据。包括题头、L1表、L2表和多个集群。也就是说,结合图3,数据区域实际存储内容的是 Qcow2格式的,而Qcow2格式是由Header,L1和L2表及Cluster等基础数据结构组成,通过L1和L2表,可以索引到Cluster(数据存储位置)存储的内容。虚拟机内存储的内容实际上是存储在Cluster中的,待备份虚拟机的数据通过L1表和L2表索引到差异数据存储所在的目标集群,从而根据起始位置和数据长度从目标集群中读取相应数据。通过上述基本原理,直接通过文件名可以从LUN上通过文件系统的文件组织,即Qcow2格式可以检索到虚拟机中的内容,从而达到备份虚拟机中数据的目的。
整个备份流程是建立在上述内容上,流程如下:
在备份平台根据需要备份的虚拟机,获取虚拟机对应的虚拟磁盘,容量大小,虚拟磁盘格式同时获得该虚拟机所在LUN的SCSI ID。
调用备份服务器上安装的Storage Agent工具提供的命令,根据传入的文件名称,根据与数据存储格式相应的检索方法,读取到虚拟磁盘的数据内容,仅读取Qcow2的元数据区域内容,以获取虚拟磁盘文件的元数据信息。
对比两次元数据的差异信息:第一次备份时,将元数据区域存储在备份服务器中。第二次备份时,对比上次存储的元数据,检查出较上次两个Qcow2元数据的差异地址。
调用Storage Agent命令,传入虚拟磁盘的文件名称,根据文件的起始位置和数据长度,检索出在LUN上的存储位置,在相应的存储位置用基础的文件读写接口,读取相应内容,并在备份服务器存储差异数据。
由上可知,本发明实施例实现了在不占用生产服务器资源的基础上进行虚拟机数据的备份。
本发明实施例还针对基于集群文件系统的数据备份方法提供了相应的装置,进一步使得所述方法更具有实用性。其中,装置可从功能模块的角度和硬件的角度分别说明。下面对本发明实施例提供的基于集群文件系统的数据备份装置进行介绍,下文描述的基于集群文件系统的数据备份装置与上文描述的基于集群文件系统的数据备份方法可相互对应参照。
基于功能模块的角度,参见图4,图4为本发明实施例提供的基于集 群文件系统的数据备份装置在一种具体实施方式下的结构图,该装置可包括:
系统部署模块401,用于预先将生产服务器和备份服务器部署同一存储区域网络;生产服务器根据存储系统或磁盘阵列提供的LUN格式化为集群文件系统,以用于为云平台虚拟机提供虚拟存储资源。
元数据信息读取模块402,用于基于待备份虚拟机对应的虚拟磁盘的文件名称和虚拟磁盘的数据存储格式从集群文件系统中读取待备份虚拟机的元数据信息。
数据备份模块403,用于根据元数据信息、数据备份类型、待备份虚拟机所在LUN的SCSI标识号和文件名称确定待备份数据在LUN上的存储位置,并将从存储位置中读取的待备份数据进行备份;数据备份类型包括增量数据备份和全量数据备份。
可选的,在本实施例的一些实施方式中,所述数据备份模块403可包括:
备份类型确定子模块,用于若待备份虚拟机不为第一次数据备份,则数据备份类型为增量数据备份;
差异地址获取子模块,用于比对元数据信息和备份服务器中存储的元数据以确定差异数据并得到差异数据的差异地址;
存储数据定位信息确定子模块,用于根据数据存储格式的数据分布方式确定差异地址在虚拟磁盘中的起始位置和数据长度;
存储位置定位子模块,用于根据SCSI标识号、文件名称、起始位置和数据长度定位差异数据在LUN上的存储位置;
虚拟数据备份子模块,用于将从存储位置中读取的差异数据进行备份。
在本实施例的另外一些实施方式中,所述数据备份模块403还可包括:
第二备份类型确定子模块,用于若待备份虚拟机为第一次数据备份,则数据备份类型为全量数据备份;
存储位置确定子模块,用于根据SCSI标识号和文件名称确定待备份数据在LUN上的存储位置;
备份子模块,用于将元数据信息中的元数据和从存储位置中读取的待备份数据进行备份。
可选的,在本实施例的另一些实施方式中,请参阅图5,所述装置例如还可以包括数据恢复模块404,所述数据恢复模块404可包括:
数据恢复工作准备子模块,用于当接收到数据恢复请求,向生产服务器发送将搭载虚拟机进行暂停工作或关机的指令;
变更数据确定子模块,用于根据数据恢复请求中携带的待恢复时间点获取相应的目标差异数据信息,目标差异数据包括变更数据的起始位置、数据长度和数据内容;数据解析读取工具用于对LUN上文件系统存储内容进行解析并协助备份服务器读取存储的数据;
写数据子模块,用于调用预先安装的数据解析读取工具,根据文件名称和目标差异数据信息将备份平台中存储的目标数据覆盖写至LUN上。
本发明实施例所述基于集群文件系统的数据备份装置的各功能模块的功能可根据上述方法实施例中的方法具体实现,其具体实现过程可以参照上述方法实施例的相关描述,此处不再赘述。
由上可知,本发明实施例实现了在不占用生产服务器资源的基础上进行虚拟机数据的备份。
上文中提到的基于集群文件系统的数据备份装置是从功能模块的角度描述,进一步的,本申请还提供一种基于集群文件系统的数据备份装置,是从硬件角度描述。图6为本申请实施例提供的另一种基于集群文件系统的数据备份装置的结构图。如图6所示,该装置可包括存储器60,用于存储计算机程序;
处理器61,用于执行计算机程序时实现如上述任一实施例提到的基于集群文件系统的数据备份方法的步骤。
其中,处理器61可以包括一个或多个处理核心,比如4核心处理器、8核心处理器等。处理器61可以采用DSP(Digital Signal Processing,数字信号处理)、FPGA(Field-Programmable Gate Array,现场可编程门阵列)、 PLA(Programmable Logic Array,可编程逻辑阵列)中的至少一种硬件形式来实现。处理器61也可以包括主处理器和协处理器,主处理器是用于对在唤醒状态下的数据进行处理的处理器,也称CPU(Central Processing Unit,中央处理器);协处理器是用于对在待机状态下的数据进行处理的低功耗处理器。在一些实施例中,处理器61可以在集成有GPU(Graphics Processing Unit,图像处理器),GPU用于负责显示屏所需要显示的内容的渲染和绘制。一些实施例中,处理器61还可以包括AI(Artificial Intelligence,人工智能)处理器,该AI处理器用于处理有关机器学习的计算操作。
存储器60可以包括一个或多个计算机可读存储介质,该计算机可读存储介质可以是非暂态的。存储器60还可包括高速随机存取存储器,以及非易失性存储器,比如一个或多个磁盘存储设备、闪存存储设备。本实施例中,存储器60至少用于存储以下计算机程序601,其中,该计算机程序被处理器61加载并执行之后,能够实现前述任一实施例公开的基于集群文件系统的数据备份方法的相关步骤。另外,存储器60所存储的资源还可以包括操作系统602和数据603等,存储方式可以是短暂存储或者永久存储。其中,操作系统602可以包括Windows、Unix、Linux等。数据603可以包括但不限于基于集群文件系统的数据备份过程中对应的数据等。
在一些实施例中,基于集群文件系统的数据备份装置还可包括有显示屏62、输入输出接口63、通信接口64、电源65以及通信总线66。
本领域技术人员可以理解,图6中示出的结构并不构成对基于集群文件系统的数据备份装置的限定,可以包括比图示更多或更少的组件,例如还可包括传感器67。
本发明实施例所述基于集群文件系统的数据备份装置的各功能模块的功能可根据上述方法实施例中的方法具体实现,其具体实现过程可以参照上述方法实施例的相关描述,此处不再赘述。
由上可知,本发明实施例实现了在不占用生产服务器资源的基础上进行虚拟机数据的备份。
可以理解的是,如果上述实施例中的基于集群文件系统的数据备份方 法以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、磁碟或者光盘等各种可以存储程序代码的介质。
基于此,本发明实施例还提供了一种计算机可读存储介质,存储有基于集群文件系统的数据备份程序,所述基于集群文件系统的数据备份程序被处理器执行时如上任意一实施例所述基于集群文件系统的数据备份方法的步骤。
本发明实施例所述计算机可读存储介质的各功能模块的功能可根据上述方法实施例中的方法具体实现,其具体实现过程可以参照上述方法实施例的相关描述,此处不再赘述。
由上可知,本发明实施例实现了在不占用生产服务器资源的基础上进行虚拟机数据的备份。
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其它实施例的不同之处,各个实施例之间相同或相似部分互相参见即可。对于实施例公开的装置而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。
专业人员还可以进一步意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现 不应认为超出本发明的范围。
以上对本申请所提供的一种基于集群文件系统的数据备份方法、装置及计算机可读存储介质进行了详细介绍。本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想。应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以对本申请进行若干改进和修饰,这些改进和修饰也落入本申请权利要求的保护范围内。

Claims (10)

  1. 一种基于集群文件系统的数据备份方法,其特征在于,包括:
    预先为生产服务器和备份服务器部署同一存储区域网络;所述生产服务器根据存储系统或磁盘阵列提供的存储磁盘LUN格式化为集群文件系统,以用于为云平台虚拟机提供虚拟存储资源;
    基于待备份虚拟机对应的虚拟磁盘的文件名称和所述虚拟磁盘的数据存储格式从所述集群文件系统中读取所述待备份虚拟机的元数据信息;
    根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份;所述数据备份类型包括增量数据备份和全量数据备份。
  2. 根据权利要求1所述的基于集群文件系统的数据备份方法,其特征在于,所述根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份包括:
    若所述待备份虚拟机不为第一次数据备份,则所述数据备份类型为增量数据备份;
    比对所述元数据信息和所述备份服务器中存储的元数据以确定差异数据并得到所述差异数据的差异地址;
    根据所述数据存储格式的数据分布方式确定所述差异地址在所述虚拟磁盘中的起始位置和数据长度;
    根据所述SCSI标识号、所述文件名称、所述起始位置和所述数据长度定位所述差异数据在所述LUN上的存储位置;
    将从所述存储位置中读取的差异数据进行备份。
  3. 根据权利要求2所述的基于集群文件系统的数据备份方法,其特征在于,所述数据存储格式为Qcow2格式,包括题头、L1表、L2表和多个集群;所述待备份虚拟机的数据通过所述L1表和所述L2表索引到所述差异数据存储所在的目标集群,以用于根据所述起始位置和数据长度从所述目标集群中读取相应数据。
  4. 根据权利要求1所述的基于集群文件系统的数据备份方法,其特征在于,所述根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份包括:
    若所述待备份虚拟机为第一次数据备份,则所述数据备份类型为全量数据备份;
    根据所述SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置;
    将所述元数据信息中的元数据和从所述存储位置中读取的所述待备份数据进行备份。
  5. 根据权利要求1至4任意一项所述的基于集群文件系统的数据备份方法,其特征在于,所述将从所述存储位置中读取的差异数据进行备份之后,还包括:
    当接收到数据恢复请求,向所述生产服务器发送将搭载虚拟机进行暂停工作或关机的指令;
    根据所述数据恢复请求中携带的待恢复时间点获取相应的目标差异数据信息,所述目标差异数据包括变更数据的起始位置、数据长度和数据内容;
    调用预先安装的数据解析读取工具,根据所述文件名称和所述目标差异数据信息将备份平台中存储的目标数据覆盖写至LUN上;
    其中,所述数据解析读取工具用于对LUN上文件系统存储内容进行解析并协助所述备份服务器读取存储的数据。
  6. 一种基于集群文件系统的数据备份装置,其特征在于,包括:
    系统部署模块,用于预先将生产服务器和备份服务器部署同一存储区域网络;所述生产服务器根据存储系统或磁盘阵列提供的存储磁盘LUN格式化为集群文件系统,以用于为云平台虚拟机提供虚拟存储资源;
    元数据信息读取模块,用于基于待备份虚拟机对应的虚拟磁盘的文件名称和所述虚拟磁盘的数据存储格式从所述集群文件系统中读取所述待备份虚拟机的元数据信息;
    数据备份模块,用于根据所述元数据信息、数据备份类型、所述待备份虚拟机所在LUN的SCSI标识号和所述文件名称确定待备份数据在所述LUN上的存储位置,并将从所述存储位置中读取的所述待备份数据进行备份;所述数据备份类型包括增量数据备份和全量数据备份。
  7. 根据权利要求6所述的基于集群文件系统的数据备份装置,其特征在于,所述数据备份模块包括:
    备份类型确定子模块,用于若所述待备份虚拟机不为第一次数据备份,则所述数据备份类型为增量数据备份;
    差异地址获取子模块,用于比对所述元数据信息和所述备份服务器中存储的元数据以确定差异数据并得到所述差异数据的差异地址;
    存储数据定位信息确定子模块,用于根据所述数据存储格式的数据分布方式确定所述差异地址在所述虚拟磁盘中的起始位置和数据长度;
    存储位置定位子模块,用于根据所述SCSI标识号、所述文件名称、所述起始位置和所述数据长度定位所述差异数据在所述LUN上的存储位置;
    虚拟数据备份子模块,用于将从所述存储位置中读取的差异数据进行备份。
  8. 根据权利要求6或7所述的基于集群文件系统的数据备份装置,其特征在于,还包括数据恢复模块,所述数据恢复模块包括:
    数据恢复工作准备子模块,用于当接收到数据恢复请求,向所述生产服务器发送将搭载虚拟机进行暂停工作或关机的指令;
    变更数据确定子模块,用于根据所述数据恢复请求中携带的待恢复时间点获取相应的目标差异数据信息,所述目标差异数据包括变更数据的起始位置、数据长度和数据内容;所述数据解析读取工具用于对LUN上文件系统存储内容进行解析并协助所述备份服务器读取存储的数据;
    写数据子模块,用于调用预先安装的数据解析读取工具,根据所述文件名称和所述目标差异数据信息将备份平台中存储的目标数据覆盖写至LUN上。
  9. 一种基于集群文件系统的数据备份装置,其特征在于,包括处理器, 所述处理器用于执行存储器中存储的计算机程序时实现如权利要求1至5任一项所述基于集群文件系统的数据备份方法的步骤。
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有基于集群文件系统的数据备份程序,所述基于集群文件系统的数据备份程序被处理器执行时实现如权利要求1至5任一项所述基于集群文件系统的数据备份方法的步骤。
PCT/CN2021/073477 2020-05-29 2021-01-25 基于集群文件系统的数据备份方法、装置及可读存储介质 WO2021238267A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/927,719 US20230138736A1 (en) 2020-05-29 2021-01-25 Cluster file system-based data backup method and apparatus, and readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010471506.6 2020-05-29
CN202010471506.6A CN111625401B (zh) 2020-05-29 2020-05-29 基于集群文件系统的数据备份方法、装置及可读存储介质

Publications (1)

Publication Number Publication Date
WO2021238267A1 true WO2021238267A1 (zh) 2021-12-02

Family

ID=72258068

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/073477 WO2021238267A1 (zh) 2020-05-29 2021-01-25 基于集群文件系统的数据备份方法、装置及可读存储介质

Country Status (3)

Country Link
US (1) US20230138736A1 (zh)
CN (1) CN111625401B (zh)
WO (1) WO2021238267A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114328031A (zh) * 2022-03-03 2022-04-12 成都云祺科技有限公司 元数据组织方法、系统、存储介质及备份方法、检索方法
CN115237679A (zh) * 2022-09-21 2022-10-25 南京拓界信息技术有限公司 一种基于主机系统的数据恢复系统
CN115357433A (zh) * 2022-10-19 2022-11-18 江苏博云科技股份有限公司 容器环境下的数据库备份方法、装置、设备及存储介质
CN116521450A (zh) * 2023-05-15 2023-08-01 无锡宇宁智能科技有限公司 设备参数逻辑备份与格式化下载方法、装置、设备及介质

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111625401B (zh) * 2020-05-29 2023-03-21 浪潮电子信息产业股份有限公司 基于集群文件系统的数据备份方法、装置及可读存储介质
CN112181722A (zh) * 2020-09-16 2021-01-05 济南浪潮数据技术有限公司 一种数据备份及恢复方法、装置、设备及可读存储介质
CN112269543B (zh) * 2020-10-22 2023-01-10 苏州浪潮智能科技有限公司 一种存储逻辑卷管理方法、装置及相关组件
CN112612651B (zh) * 2021-01-06 2023-11-28 新华三技术有限公司 一种数据保护方法、装置、电子设备及存储介质
CN113419897B (zh) * 2021-01-19 2023-12-22 阿里巴巴集团控股有限公司 一种文件处理方法、装置、电子设备及其存储介质
CN112988460B (zh) * 2021-02-05 2022-05-27 新华三大数据技术有限公司 一种虚拟机的数据备份方法及装置
US11861012B2 (en) * 2021-07-01 2024-01-02 Macronix International Co., Ltd. Memory device having safety boot capability
CN113722157B (zh) * 2021-11-03 2022-03-08 苏州浪潮智能科技有限公司 一种虚拟机数据管理方法、装置、设备及介质
CN114296649B (zh) * 2021-12-27 2024-01-02 天翼云科技有限公司 云间业务迁移系统
CN114138566B (zh) * 2022-02-07 2022-04-29 苏州浪潮智能科技有限公司 虚拟机的数据存储方法、装置、虚拟机及存储介质
CN114416431B (zh) * 2022-03-28 2022-06-07 成都云祺科技有限公司 基于kvm的无代理持续性数据保护方法、系统及存储介质
CN115098299B (zh) * 2022-06-28 2024-02-06 江苏安超云软件有限公司 一种虚拟机的备份方法、容灾方法、装置及设备
CN115344428A (zh) * 2022-08-12 2022-11-15 广州鼎甲计算机科技有限公司 数据处理方法、装置、计算机设备、存储介质和程序产品
CN115509824B (zh) * 2022-11-23 2023-03-14 深圳市科力锐科技有限公司 数据备份方法、装置、设备及存储介质
CN116501552B (zh) * 2023-06-21 2023-09-08 苏州浪潮智能科技有限公司 数据备份的方法、装置、系统及存储介质
CN116610498B (zh) * 2023-07-14 2024-04-09 深圳市木浪云科技有限公司 基于对象存储的数据备份恢复方法、系统、设备及介质
CN117076337B (zh) * 2023-10-17 2024-02-02 北京开源芯片研究院 一种数据传输方法、装置、电子设备及可读存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6845387B1 (en) * 2000-04-07 2005-01-18 Advanced Digital Information Corporation Creating virtual private connections between end points across a SAN
CN103503414A (zh) * 2012-12-31 2014-01-08 华为技术有限公司 一种计算存储融合的集群系统
CN104270409A (zh) * 2014-09-04 2015-01-07 国云科技股份有限公司 一种云平台中高效利用集中存储的方法
CN105446831A (zh) * 2015-11-09 2016-03-30 上海爱数信息技术股份有限公司 一种结合SAN的Server-Free备份方法
US9471245B1 (en) * 2012-10-31 2016-10-18 Emc Corporation Method and apparatus for transferring modified data efficiently
CN108241555A (zh) * 2016-12-26 2018-07-03 阿里巴巴集团控股有限公司 一种分布式数据库的备份、恢复方法、装置和服务器
CN108259569A (zh) * 2017-12-25 2018-07-06 南京壹进制信息技术股份有限公司 一种基于ipsan共享存储的无代理连续数据保护方法
CN111625401A (zh) * 2020-05-29 2020-09-04 浪潮电子信息产业股份有限公司 基于集群文件系统的数据备份方法、装置及可读存储介质

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9547562B1 (en) * 2010-08-11 2017-01-17 Dell Software Inc. Boot restore system for rapidly restoring virtual machine backups
CN102143215B (zh) * 2011-01-20 2013-04-10 中国人民解放军理工大学 一种基于网络的pb级云存储系统及其处理方法
CN103699459A (zh) * 2013-12-31 2014-04-02 汉柏科技有限公司 基于qcow2快照的虚拟机数据增量备份方法及系统
US9720778B2 (en) * 2014-02-14 2017-08-01 Actifio, Inc. Local area network free data movement
US20160019317A1 (en) * 2014-07-16 2016-01-21 Commvault Systems, Inc. Volume or virtual machine level backup and generating placeholders for virtual machine files
CN104679579B (zh) * 2015-03-19 2018-10-09 新华三技术有限公司 一种集群系统中的虚拟机迁移方法和装置
US10802928B2 (en) * 2015-09-10 2020-10-13 International Business Machines Corporation Backup and restoration of file system
US10061660B1 (en) * 2015-10-27 2018-08-28 EMC IP Holding Company LLC Cross-platform instant granular recovery for virtual machine backups
CN106126370A (zh) * 2016-06-15 2016-11-16 上海爱数信息技术股份有限公司 基于存储快照之间增量位图的Server‑free备份方法及系统
US9971655B1 (en) * 2016-06-29 2018-05-15 EMC IP Holding Company LLC Primed application recovery
CN106445735A (zh) * 2016-08-31 2017-02-22 上海爱数信息技术股份有限公司 VMware虚拟机的数据恢复方法、系统
CN106407356B (zh) * 2016-09-07 2020-01-14 网易(杭州)网络有限公司 一种数据备份方法及装置
US11182076B2 (en) * 2016-09-08 2021-11-23 International Business Machines Corporation Managing unequal network shared disks (NSD) in a computer network
CN107025149A (zh) * 2017-03-04 2017-08-08 郑州云海信息技术有限公司 虚拟机备份恢复系统及方法
CN107544871B (zh) * 2017-07-21 2020-10-02 新华三云计算技术有限公司 一种虚拟机磁盘备份方法及装置
CN109144947A (zh) * 2018-09-04 2019-01-04 郑州云海信息技术有限公司 一种虚拟化系统的集群文件系统的控制方法和装置
CN109471699B (zh) * 2018-10-29 2021-06-18 北京京航计算通讯研究所 基于Qcow2镜像文件的差异位图特性的虚拟机增量备份系统
CN109558215B (zh) * 2018-12-10 2021-09-07 深圳市木浪云数据有限公司 虚拟机的备份方法、恢复方法、装置及备份服务器集群
US10725866B1 (en) * 2019-04-11 2020-07-28 Netapp, Inc. Methods and systems for protecting databases of a database availability group
US10942820B2 (en) * 2019-06-27 2021-03-09 EMC IP Holding Company LLC Stream level uninterrupted restore operation using an interrupt service routine approach
US11513922B2 (en) * 2019-08-14 2022-11-29 Commvault Systems, Inc. Systems and methods for change block tracking for backing up changed data

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6845387B1 (en) * 2000-04-07 2005-01-18 Advanced Digital Information Corporation Creating virtual private connections between end points across a SAN
US9471245B1 (en) * 2012-10-31 2016-10-18 Emc Corporation Method and apparatus for transferring modified data efficiently
CN103503414A (zh) * 2012-12-31 2014-01-08 华为技术有限公司 一种计算存储融合的集群系统
CN104270409A (zh) * 2014-09-04 2015-01-07 国云科技股份有限公司 一种云平台中高效利用集中存储的方法
CN105446831A (zh) * 2015-11-09 2016-03-30 上海爱数信息技术股份有限公司 一种结合SAN的Server-Free备份方法
CN108241555A (zh) * 2016-12-26 2018-07-03 阿里巴巴集团控股有限公司 一种分布式数据库的备份、恢复方法、装置和服务器
CN108259569A (zh) * 2017-12-25 2018-07-06 南京壹进制信息技术股份有限公司 一种基于ipsan共享存储的无代理连续数据保护方法
CN111625401A (zh) * 2020-05-29 2020-09-04 浪潮电子信息产业股份有限公司 基于集群文件系统的数据备份方法、装置及可读存储介质

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114328031A (zh) * 2022-03-03 2022-04-12 成都云祺科技有限公司 元数据组织方法、系统、存储介质及备份方法、检索方法
CN114328031B (zh) * 2022-03-03 2022-06-07 成都云祺科技有限公司 元数据组织方法、系统、存储介质及备份方法、检索方法
CN115237679A (zh) * 2022-09-21 2022-10-25 南京拓界信息技术有限公司 一种基于主机系统的数据恢复系统
CN115357433A (zh) * 2022-10-19 2022-11-18 江苏博云科技股份有限公司 容器环境下的数据库备份方法、装置、设备及存储介质
CN116521450A (zh) * 2023-05-15 2023-08-01 无锡宇宁智能科技有限公司 设备参数逻辑备份与格式化下载方法、装置、设备及介质

Also Published As

Publication number Publication date
CN111625401A (zh) 2020-09-04
US20230138736A1 (en) 2023-05-04
CN111625401B (zh) 2023-03-21

Similar Documents

Publication Publication Date Title
WO2021238267A1 (zh) 基于集群文件系统的数据备份方法、装置及可读存储介质
CN106062742B (zh) 用于改进快照性能的系统和方法
US9514004B2 (en) Restore in cascaded copy environment
JP4143611B2 (ja) バックアップ生成装置、リカバリ処理装置、バックアップ生成方法、リカバリ処理方法、及びプログラム
US8015157B2 (en) File sharing system, file server, and method for managing files
CN102576322B (zh) Nas设备上虚拟磁盘镜像文件的代理备份
US8495317B2 (en) System and method for improving performance of data container backups
EP2558949B1 (en) Express-full backup of a cluster shared virtual machine
EP2494456B1 (en) Backup using metadata virtual hard drive and differential virtual hard drive
US8868858B2 (en) Method and apparatus of continuous data backup and access using virtual machines
CN102713856B (zh) 用于恢复在计算机系统内的文件系统的方法和系统
CN111356996B (zh) 用于版本验证的系统和计算机实现的方法
CN100359479C (zh) 存储服务与系统
CN101398770A (zh) 迁移一个或多个虚拟机的系统和方法
CN103699372A (zh) 从中央存储装置引导计算机系统
US8732427B2 (en) Systems and methods for collapsing a derivative version of a primary storage volume
US20100094811A1 (en) Apparatus, System, and Method for Virtual Storage Access Method Volume Data Set Recovery
JP6241178B2 (ja) ストレージ制御装置,ストレージ制御方法及びストレージ制御プログラム
JP2021515304A (ja) システムにおける時系列ログ構造のキーバリュー・ストア内のチェックポイントを使用した障害後のリカバリのための方法、コンピュータ・プログラム、および装置
US11210024B2 (en) Optimizing read-modify-write operations to a storage device by writing a copy of the write data to a shadow block
US9612914B1 (en) Techniques for virtualization of file based content
US8583852B1 (en) Adaptive tap for full virtual machine protection
WO2019155308A1 (en) Data migration in a hierarchical storage management system
US11188235B2 (en) Reducing data replications among storage locations
US11445017B2 (en) Maintaining user data and metadata consistency in an asynchronous replication environment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21813678

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21813678

Country of ref document: EP

Kind code of ref document: A1