WO2017049828A1

WO2017049828A1 - Method, device and system for data processing based on linux

Info

Publication number: WO2017049828A1
Application number: PCT/CN2016/073068
Authority: WO
Inventors: 欧阳茂春
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-09-25
Filing date: 2016-02-01
Publication date: 2017-03-30
Also published as: CN106557384B; CN106557384A

Abstract

Disclosed is a method for data processing based on Linux, comprising: detecting, after receiving a data backup instruction, whether the current system environment satisfies the conditions for data backup while the system continues operation; when the current system environment satisfies the conditions for data backup while the system continues operation, packaging all data to be backed up and generating an image file. Further disclosed are a device and a system for data processing based on Linux. This realizes data backup while the Linux system continues operation.

Description

Linux-based data processing method, device and system

Technical field

The present application relates to the field of information security technologies, for example, to a Linux-based data processing method, apparatus, and system.

Background technique

In the environment of rapid development of computer hardware and computer networks, disks, as the main data storage medium of computer systems, store useful data accumulated by users for a long time. However, disk hardware failures, user misuse, hacking and other factors directly threaten the data security on the disk. Data backup and recovery technology ensures data security. Data backup and recovery technology uses storage media and certain security policies to back up system data and business data, and restore data as soon as possible when data is abnormal, in order to minimize user losses.

Linux-based data backup and recovery technology, such as tar, cpio, dump and other tools to achieve data backup or recovery. However, when performing system data backup on a Linux system, it is often necessary to restart the system to perform data backup, so that the user has to stop the current application of the system and wait for the system to restart before performing data backup.

Summary of the invention

The embodiment of the invention provides a data processing method, device and system based on Linux, which can solve the problem that data backup can be performed by restarting the system when performing system data backup on a Linux system.

An embodiment of the present invention provides a data processing method based on Linux, including:

After receiving the data backup instruction, detecting whether the current system environment satisfies the condition for performing data backup while the system continues to run;

When the current system environment satisfies the conditions for data backup while the system continues to run, all the data to be backed up is packaged and an image file is generated.

When the current system environment satisfies the conditions for data backup while the system continues to operate, Packaging all the data to be backed up and generating the image file can include:

Obtaining a skippable file list, and storing the skippable file list and all system metadata to be backed up in a preset first directory;

Obtaining file system mount information of the current system, and mounting the corresponding file system to the first directory according to the mount information;

The file to be backed up is packaged into the first directory and an image file of a preset name is generated.

The Linux-based data processing method may further include:

After receiving the data recovery instruction, acquiring an image file according to the data recovery instruction;

Decompressing the image file to obtain system metadata, file system mount information, a skippable file list, and a file to be restored;

Obtaining the decompressed system metadata, and restoring the system metadata to a current system to be restored;

Obtaining the extracted file system mount information, and mounting the related file system to a preset second directory according to the file system mount information;

Obtaining the extracted list of skippable files, and restoring the unrecovered files that are not extracted in the skippable file list to the second directory according to the skippable file list.

The obtaining the decompressed system metadata and restoring the system metadata to the current system to be restored may include:

Recovering the MBR according to the acquired system metadata;

When the image file is not obtained locally from the current system to be restored, the disk partition ratio of the current system to be restored is calculated according to the partition table information in the system metadata and the disk information of the current system to be restored;

According to the disk partition ratio, the disk of the current system to be restored is partitioned;

After the disk partition is completed, the LVM and file system are restored according to the system metadata.

Obtaining the decompressed list of the skippable files, and recovering the extracted files to be recovered in the skippable file list to the second directory according to the skippable file list The Linux-based data processing method may further include:

Switching the root file directory of the current system to be restored to the second directory;

When the boot partition is not mounted, mount the boot partition and parse the initrd file;

Obtaining hardware driver information that has been loaded by the current system to be restored, and packaging the hardware driver information and the parsed predetermined file in the initrd file to generate a new initrd file;

Replace the initrd file of the current system to be restored with the newly generated initrd file, and restart the current system to be restored.

The embodiment of the invention further provides a data processing device based on Linux, comprising:

a receiving module configured to receive a data backup instruction;

a detection module configured to detect whether a current system environment satisfies a condition for performing data backup while the system continues to operate;

The backup module is configured to package all the data to be backed up and generate an image file when the current system environment satisfies the conditions for data backup while the system continues to run.

The backup module can include:

An obtaining unit configured to obtain a list of skippable files;

a backup unit configured to store the skippable file list and all system metadata to be backed up to a preset first directory;

The obtaining unit is further configured to acquire file system mounting information of the current system;

The backup unit is further configured to mount the corresponding file system to the first directory according to the mounting information;

The packaging unit is configured to package the file to be backed up into the first directory and generate an image file of a preset name.

The Linux-based data processing apparatus may further include:

The receiving module is further configured to receive a data recovery instruction;

An obtaining module configured to acquire an image file according to the data recovery instruction;

a processing module configured to decompress the image file to obtain system metadata, file system mount information, a skippable file list, and a file to be restored;

The obtaining module is further configured to obtain the decompressed system metadata;

a recovery module configured to restore the system metadata to a current system to be restored;

The obtaining module is further configured to obtain the decompressed file system mounting information;

The recovery module is further configured to mount the related file system to a preset second directory according to the file system mounting information;

The obtaining module is further configured to obtain the decompressed list of the skippable files;

The recovery module is further configured to restore the extracted files to be recovered that are not in the skippable file list to the second directory according to the skippable file list.

The recovery module can include:

a recovery unit configured to recover the MBR according to the acquired system metadata;

The calculating unit is configured to calculate a disk partition of the current system to be restored according to the partition table information in the system metadata and the disk information of the current system to be restored when the image file is not obtained locally from the current system to be restored. proportion;

a partition unit configured to partition a disk of the current system to be restored according to the disk partition ratio;

The recovery unit is further configured to restore the LVM and the file system according to the system metadata after the disk partition is completed.

The Linux-based data processing apparatus may further include:

The processing module is further configured to switch the root file directory of the current system to be restored to the second directory;

The initrd production module is configured to mount the boot partition and parse the initrd file when the boot partition is not mounted;

The obtaining module is further configured to acquire hardware driver information that has been loaded by the current system to be restored;

The initrd production module is further configured to package the hardware driver information and the parsed predetermined file in the initrd file to generate a new initrd file;

The processing module is further configured to replace the initrd file of the current system to be restored with the newly generated initrd file;

The module is restarted and configured to restart the current system to be restored.

The embodiment of the invention also provides a Linux-based data processing system. The Linux based number The processing system includes an image file storage medium, a backup and recovery server. The backup and recovery server includes the above-described Linux-based data processing device; the Linux-based data processing device on the backup and recovery server is configured to back up data on the backup and recovery server as an image file, and The image file is stored locally or on the image file storage medium, and the image file is decompressed and the data is restored to the backup and recovery server when the data needs to be restored.

The image file storage medium may include a USB flash drive, an optical disk, and a network server. The Linux-based data processing device supports any of the image file storage media storage in addition to the manner of supporting the local storage image file for backup or recovery. The manner in which the image file is backed up or restored.

The method, device and system for processing data based on Linux according to the embodiment of the present invention, when analyzing data of the current system environment during data backup, when the current system environment satisfies the condition of data backup while the system continues to operate, Data backup of the data to be backed up without restarting the system breaks through the traditional system data backup method that requires the system to be restarted to back up data.

BRIEF abstract

1 is a schematic flowchart of a first embodiment of a data processing method based on Linux according to the present invention;

2 is a schematic diagram of a refinement process of packing all the data to be backed up and generating an image file in the second embodiment of the data processing method based on Linux according to the present invention;

3 is a schematic flowchart of data recovery in a third embodiment of a data processing method based on Linux according to the present invention;

4 is a schematic diagram of a refinement process of restoring system metadata to a system to be restored in a fourth embodiment of a Linux-based data processing method;

5 is a schematic diagram of a refinement process of creating an initrd file in a fifth embodiment of a data processing method based on Linux;

6 is a schematic diagram of functional modules of a first embodiment of a data processing apparatus based on Linux;

7 is a schematic diagram of a refinement function module of a backup module in a second embodiment of a Linux-based data processing device;

8 is a schematic diagram of functional modules of a third embodiment of a Linux-based data processing apparatus;

9 is a schematic diagram of a refinement function module of a recovery module in a fourth embodiment of a data processing apparatus based on Linux;

10 is a schematic diagram of functional modules of a fifth embodiment of a Linux-based data processing apparatus;

11 is a schematic structural diagram of a first embodiment of a Linux-based data processing system.

The implementation, functional features, and advantages of the present invention will be described with reference to the accompanying drawings.

Embodiments of the invention

It is understood that the embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The embodiment of the present invention provides a data processing method based on Linux. As shown in FIG. 1 , a schematic flowchart of a first embodiment of a data processing method based on Linux according to the present invention is shown, including:

S10. After receiving the data backup instruction, detecting whether the current system environment satisfies the condition for performing data backup while the system continues to run;

During normal operation, when the user triggers the startup data backup through the command line or interface operation, the server will detect whether the current system environment meets the data backup while the system continues to run. conditions of. Check whether the current system environment meets the conditions for data backup while the system continues to run, that is, whether the current system affects data backup occurs. In this embodiment, it can be determined whether the current system satisfies the condition for performing data backup while the system continues to run by detecting whether the current system has other memory processes that are reading or writing memory data or having a hard disk error. When any of the above situations occur, the server does not start the data backup program and gives a related prompt message; when none of the above occurs, the server starts the data backup program to perform data backup.

S20. When the current system environment satisfies the conditions for data backup while the system continues to run, all the data to be backed up is packaged and an image file is generated.

After the data backup program is started, while the data backup operation is being performed, the server detects in real time whether the current system environment satisfies the conditions for data backup while the system continues to run, and detects the current condition. The system environment does not meet the conditions for data backup while the system continues to run, suspending the data backup operation, and continuing the previously suspended operation when it detects that the current system environment satisfies the conditions for data backup while the system continues to run.

The data to be backed up may be system data, or may be system data and file system data, and is determined according to a user's selection. Take the backup of system data and file system data as an example. In the Linux system, parameter analysis is performed to obtain parameter information such as the backup directory specified by the user and the name of the generated image file. Then, after scanning the disk to find the boot partition, use the dd command. Back up the first 512 bytes of the boot disk to file 1, that is, back up the MBR (Master Boot Record) information to the file 1; use the fdisk tool to back up the system partition table information to the file 2; obtain the LVM of the system (Logical Volume Manager, logical volume management) related information (including physical volume information, volume group information, logical volume information), and back up the logical volume information to file 3; collection system file system information (including file system type, file system) Label Label, Universal Unique Identification Number (UUID), and back up the collected information to file 4; read /proc/mounts, get the file system mount information of the system, and mount all the disks according to the file system mount information. a file system is mounted to the backup directory; after that, the backup directory is packaged and a mirror of the user-specified name is generated file. The files 1 to 4 are all backed up in the backup directory.

The Linux-based data processing method provided by the embodiment of the present invention determines whether the current system environment meets the conditions for data backup while the system is running, and when the current system environment meets the conditions, the backup is performed without restarting the system. The data to be backed up in the system breaks through the traditional system data backup mode that needs to restart the system to back up data.

A second embodiment of the Linux-based data processing method of the present invention is proposed based on the first embodiment. In this embodiment, as shown in FIG. 2, the foregoing step S20 includes:

S21: Obtain a skippable file list, and store the skippable file list and all system metadata to be backed up into a preset first directory;

After the data backup program is started, when the user selects the data to be backed up, it will select the system file that can be skipped when the system is restored according to the prompt, that is, the system file that can be recovered. After the user selects the skippable system file, the server can obtain a list of skippable files according to the user's selection. In this embodiment, the skippable file may be an IP configuration file, a hostname configuration file, or the like.

The system metadata includes an MBR information file, a partition table information file, an LVM information file, and a file system information file. The preset first directory is a backup directory created or designated by a user. Used to store all data to be backed up under the first directory.

S22. Obtain file system mount information of the current system, and mount the corresponding file system to the first directory according to the mount information.

S23. Package the file to be backed up into the first directory and generate an image file with a preset name.

The Linux-based data processing method provided by the embodiment of the present invention can specify a system file that can be skipped during data recovery when the data is backed up, and provides early support for different systems having different system configurations when the system is installed or restored in batches.

A third embodiment of the Linux-based data processing method of the present invention is proposed based on the second embodiment. In this embodiment, as shown in FIG. 3, the Linux-based data processing method further includes:

S30. After receiving the data recovery instruction, acquire an image file according to the data recovery instruction.

When the user installs or restores the system using the image file, it enters the auxiliary system for data backup and recovery. The auxiliary system is composed of a kernel, a command set, a dynamic library, a driver module, a backup and recovery module, a boot support module, a build module, a root file system, and the like. The kernel is the core of the auxiliary system, which can implement basic operating system functions and provide service primitives upwards; the command set adopts dynamic compilation; the command in the command set needs dynamic library support during execution; the driver module can Ensure that the auxiliary system supports different hardware environments to achieve consistency of the boot process under different hardware configurations; the backup and recovery module can start a data backup program or a data recovery program according to the user's selection; the startup support module cooperates with the kernel to complete The process of powering on the system; the building module is a description of the way the data backup and recovery process is built; the root file system mainly provides the mount directory of the proc file system, the devpts file system, and the .sysfs file system, basic command sets and dynamics. The directory where the library is located, the directory where the kernel modules and hardware driver sets are located, the directory where the specific configuration required for the secondary system is started, and so on. In this embodiment, the kernel adopts the Linux 2.6.3 version, and based on this, the vmlinuz kernel image and the current mainstream hardware driver set files are built.

There are various startup modes of the auxiliary system, such as U disk boot, CD boot, disk boot, network boot, and the like. The same auxiliary system can be accessed in different startup modes. When the startup mode of the auxiliary system is the network startup, the client sends a DHCP (Dynamic Host Configuration Protocol) broadcast to the network through a network card supporting the PXE (Preboot Execute Environment). After receiving the request, the DHCP server provides the client with information such as an IP address, and then the client requests to download the kernel image file of the auxiliary system according to the IP address information and starts loading the auxiliary system after the download is completed.

After the auxiliary system is started, the running file and the system with the system recovery function are loaded, and the running parameters are checked and parsed. The operating parameter includes a startup mode of the auxiliary system and a storage path of the image file in the startup mode. When the auxiliary system is started on the server to be restored, the vmlinuz kernel of the auxiliary system is loaded according to a bootloader corresponding to different startup modes, and the initrd (initial RAM disk) of the auxiliary system is decompressed by the vmlinuz kernel. Scanning the hardware of the server to be restored, triggering the device manager udev event, and loading the hardware driver corresponding to the hardware of the server to be restored according to the udev event. After the startup of the auxiliary system is completed, the user selects to start the data recovery program. After receiving the data recovery instruction, the to-be-recovered server acquires the system startup parameter of the auxiliary system, according to the startup mode of the auxiliary system obtained by the parsing and the storage path of the image file in the startup mode, from the The storage path gets the image file.

The method of obtaining an image file can be obtained by local disk, U disk acquisition, CD acquisition, and network server acquisition. The network server provides network related services, such as a DHCP service, a UDP (User Datagram Protocol) service, an FTP (File Transfer Protocol) service, an NFS (Network File System) service, and the like. . When the boot mode of the auxiliary system is the booting of the disk, the file system of the local disk is mounted to the preset second directory according to the path of the parsed image file on the local disk, and the second file is Obtaining an image file in the directory; when the boot mode of the auxiliary system is the booting of the USB disk, mounting the USB disk to the second according to the storage path of the parsed image file on the USB disk a directory, and obtaining an image file from the second directory; when the parsed boot mode of the auxiliary system is booting from a disc, mounting the disc according to a storage path of the parsed image file on the optical disc to The second directory obtains an image file from the second directory; when the parsed startup mode of the auxiliary system is network startup, the udpcast is transmitted according to the storage path of the parsed image file on the UDP server. The file (the input parameter includes the storage path of the image file on the UDP server); when the parsed startup mode of the auxiliary system is the network startup, according to the parsed mirror image In the storage path on the FTP server, use wget to transfer files (the input parameters include the storage path of the image file on the FTP server); when the resolved startup mode of the auxiliary system is network startup, according to the parsed image file in NFS A storage path on the server, mounting NFS to the second directory, and obtaining an image file from the second directory.

S40. Decompress the image file to obtain system metadata, file system mount information, a skippable file list, and a file to be restored.

S50: Obtain the decompressed system metadata, and restore the system metadata to the current system to be restored;

S60. Acquire the decompressed file system mount information, and mount the related file system to a preset second directory according to the file system mount information.

The preset second directory is a directory created and specified by the data recovery program for storing data decompressed by the image file.

S70. Obtain the decompressed list of the skippable files, and restore the extracted files to be recovered that are not in the skippable file list to the second directory according to the skippable file list.

When the image file is decompressed, it is sequentially determined according to the skippable file list whether the decompressed file is a skippable file; when the decompressed file is a skippable file, the recovery operation of the file is skipped. And continue to determine whether the next file is a skippable file; when the extracted file is not a skippable file, restore the file to the second directory, and then continue to determine whether the next file is a skippable file.

The image processing method of the embodiment of the present invention is based on the image file generated in the second embodiment, and the image file is restored according to the image file when the image file is restored to the server to be restored. The decompressed list of skippable files selectively recovers data, and can override the user-specified system configuration file, so that different servers have different configurations when the system is installed or restored in batches.

A fourth embodiment of the data processing method based on Linux of the present invention is proposed based on the third embodiment. In this embodiment, as shown in FIG. 4, the foregoing step S50 includes:

S51. Restore the MBR according to the obtained system metadata.

According to the MBR information in the acquired system metadata, the dd command is used to restore the MBR to the current system to be restored.

S52: When the image file is not obtained locally from the current system to be restored, calculate a disk partition ratio of the current system to be restored according to the partition table information in the system metadata and the disk information of the current system to be restored;

When the auxiliary system includes boot_disk in the kernel boot parameter, it is determined that the image file is obtained from a local backup of the current system to be restored, that is, the partition table information and the file system information in the image file are currently waiting for The information in the recovery system is completely consistent. At this time, the data is recovered. The program skips operations related to restoring partitions and file systems.

Obtaining the partition table information in the system metadata when the image file is not obtained locally from the current system to be restored, and obtaining the number of the required partitions according to the partition table information and the disk information of the current system to be restored, Information such as the type and partition size of each partition. The number of the obtained partitions is the same as the number of partitions in the partition table information of the image file; the obtained types of the partitions are the same as the types of the partitions in the partition table information of the image file; The size of the obtained partitions in the disk of the server to be restored is the same as the size of each partition in the backup server disk in the partition table information of the image file, for example, the disk size of the backup server is 100G, and the partition is 1 is 20G, and the disk size of the server to be restored at recovery is 200G, and the restored partition 1 is 40G.

S53. Partition the disk of the current system to be restored according to the disk partition ratio.

The fdisk tool can be used to partition the disk of the current system to be restored.

S54. After the disk partition is completed, recover the LVM and the file system according to the system metadata.

When restoring LVM, use the pvcreate command to recreate pv based on the LVM information in the system metadata, recreate vg using the vgcreate command, and recreate lv using the lvcreate command. When the file system is restored, the file system is recreated using the corresponding file system formatting tool according to the file system information in the system metadata, and the UUID and Label of the file system are specified when formatting.

The Linux-based data processing method according to the embodiment of the present invention, according to the size proportion of each partition in the decompressed partition table information on the backup server disk, the server disk of the system to be restored is proportionally partitioned, and the disk of the server to be restored can be When the size of the backup server's disk is smaller, avoid the partition is not enough, or avoid the waste of space when the disk size of the server to be restored is larger than the disk size of the backup server.

The fifth embodiment of the data processing method of the present invention is based on the third or fourth embodiment. In this embodiment, as shown in FIG. 5, after the step S70, the Linux-based data processing method further includes:

S80. Switch the root file directory of the current system to be restored to the second directory.

Use the chroot command to switch the root file directory of the current system to be restored to the second directory.

S90. When the boot partition is not mounted, mount the boot partition and parse the initrd file.

After the root file directory switch is completed, check if the boot partition is mounted. When it is checked that the boot partition is not mounted, the boot partition is mounted to obtain an initrd file stored in the boot partition.

S100: Obtain hardware driver information that has been loaded by the current system to be restored, and package the hardware driver information and the parsed predetermined file in the initrd file to generate a new initrd file.

The predetermined file refers to a basic command file, a dynamic library file, a configuration file, a driver file, and the like obtained by parsing from the initrd file.

S110: Replace the initrd file of the current system to be restored with the newly generated initrd file, and restart the current system to be restored.

The Linux-based data processing method provided by the embodiment of the present invention can dynamically generate an initrd file containing hardware driver information of the current system to be restored when the system is restored, so that the generated image file can be backed up on one machine. For restoring machines of other different types of hardware.

The embodiment of the present invention further provides a data processing apparatus based on Linux. As shown in FIG. 6, a functional module diagram of a first embodiment of a data processing apparatus based on Linux according to the present invention is shown, including:

The receiving module 110 is configured to receive a data backup instruction;

During the normal operation of the server, when the user triggers the startup data backup through a command line or interface operation, the receiving module 110 of the server receives an instruction to trigger the data backup.

The detecting module 120 is configured to detect whether the current system environment satisfies a condition for performing data backup while the system continues to operate;

After receiving the trigger data backup, the receiving module 110 of the server will detect whether the current system environment satisfies the condition for data backup while the system continues to run. Check whether the current system environment meets the conditions for data backup while the system continues to run, that is, whether the current system affects data backup occurs. In this embodiment, the detecting module 120 can determine whether the current system satisfies the condition for performing data backup while the system continues to run by detecting whether the current system is in the process of reading or writing memory data or having a hard disk error. When any of the above situations occur, the server does not start the data backup program and gives a related prompt message; when none of the above occurs, the server starts the data backup program to perform data backup.

The backup module 130 is configured to package all the data to be backed up and generate an image file when the current system environment satisfies the condition of data backup while the system continues to run.

After the data backup program is started, the backup module 130 detects the mode while performing the data backup operation. The block 120 detects in real time whether the current system environment satisfies the condition for data backup while the system continues to run. When detecting that the current system environment does not satisfy the condition for data backup while the system continues to run, the backup module 130 suspends the data backup operation. And when it is detected that the current system environment satisfies the condition of data backup while the system continues to run, the backup module 130 continues the previously suspended operation.

The data to be backed up may be system data, or may be system data and file system data, and is determined according to a user's selection. Taking the backup of the system data and the file system data as an example, in the Linux system, the backup module 130 performs parameter parsing, obtains parameter information such as the backup directory specified by the user and the name of the generated image file; and then, after scanning the disk to find the boot partition, Use the dd command to back up the first 512 bytes of the boot disk to file 1, that is, back up the MBR information to the file 1; use the fdisk tool to back up the system partition table information to the file 2; obtain the LVM related information of the system (including the physical volume information, Volume group information, logical volume information), and back up the logical volume information to file 3; collect the file system information of the system (including file system type, Label, UUID), and back up the collected information to file 4; read Take /proc/mounts, obtain the file system mount information of the system, and mount the file system of all disks to the backup directory according to the file system mount information; after that, package the backup directory and generate a user An image file with the specified name. The files 1 to 4 are all backed up in the backup directory.

The Linux-based data processing apparatus according to the embodiment of the present invention determines whether the current system environment meets the conditions for data backup while the system is running, and when the current system environment meets the conditions, the backup is performed without restarting the system. The data to be backed up in the system breaks through the traditional system data backup mode that needs to restart the system to back up data.

Referring to FIG. 7, a second embodiment of the Linux-based data processing apparatus of the present invention is proposed based on the first embodiment. Based on the embodiment shown in FIG. 6, the backup module 130 includes:

The obtaining unit 131 is configured to obtain a skippable file list;

The backup unit 132 is configured to store the skippable file list and all system metadata to be backed up to a preset first directory;

The system metadata includes an MBR information file, a partition table information file, and an LVM information file. File system information file. The preset first directory is a backup directory created or designated by the user, and is used to store all the data to be backed up under the first directory.

The obtaining unit 131 is further configured to acquire file system mount information of the current system;

The backup unit 132 is further configured to mount the corresponding file system to the first directory according to the mounting information;

The packaging unit 133 is configured to package the file to be backed up into the first directory and generate an image file of a preset name.

The Linux-based data processing apparatus provided by the embodiment of the present invention can specify a system file that can be skipped during data recovery when the data is backed up, and provides preliminary support for different systems having different system configurations when the system is installed or restored in batches.

Referring to FIG. 8, a third embodiment of the Linux-based data processing apparatus of the present invention is proposed based on the second embodiment. Based on the embodiment shown in FIG. 6, the Linux-based data processing apparatus further includes:

The receiving module 110 is further configured to receive a data recovery instruction;

There are various startup modes of the auxiliary system, such as U disk boot, CD boot, disk boot, network boot, and the like. The same auxiliary system can be accessed in different startup modes. When the startup mode of the auxiliary system is network startup, the client sends a request DHCP to the network through a network card supporting PXE. Broadcasting, after receiving the request, the DHCP server provides the client with information such as an IP address, and then the client requests to download the kernel image file of the auxiliary system according to the IP address information and initiate loading after the download is completed. auxiliary system.

After the auxiliary system is started, the running file and the system with the system recovery function are loaded, and the running parameters are checked and parsed. The operating parameter includes a startup mode of the auxiliary system and a storage path of the image file in the startup mode. When the auxiliary system is started on the server to be restored, the vmlinuz kernel of the auxiliary system is loaded according to a bootloader corresponding to different startup modes, and the initrd file of the auxiliary system is decompressed by the vmlinuz kernel; and the server to be restored is scanned. The hardware triggers the udev event, and loads the hardware driver corresponding to the hardware of the server to be restored according to the udev event. After the startup of the auxiliary system is completed, the user selects to start the data recovery program. At this time, the receiving module 110 will receive the data recovery instruction.

The obtaining module 140 is configured to acquire an image file according to the data recovery instruction;

After receiving the data recovery instruction, the acquiring module 110 of the to-be-recovered server acquires the system startup parameter of the auxiliary system, and according to the initialization mode of the auxiliary system obtained by the parsing and the image file in the startup mode. The storage path from which the image file is obtained.

The method of obtaining an image file can be obtained by local disk, U disk acquisition, CD acquisition, and network server acquisition. The network server provides network related services, such as a DHCP service, a UDP service, an FTP service, an NFS service, and the like. When the startup mode of the auxiliary system is the disk startup, the obtaining module 140 mounts the file system of the local disk to the preset second directory according to the path of the parsed image file on the local disk, and Obtaining an image file in the second directory; when the boot mode of the auxiliary system is the booting of the USB disk, the obtaining module 140 mounts the U according to the storage path of the parsed image file on the USB disk. Disk to the second directory, and obtaining an image file from the second directory; when the parsing mode of the auxiliary system is the booting of the CD, the obtaining module 140 is configured on the optical disk according to the parsed image file. The storage path is configured to mount the optical disc to the second directory, and obtain an image file from the second directory; when the parsed startup mode of the auxiliary system is network startup, the obtaining module 140 is configured according to the parsed image. File storage path on the UDP server, using udpcast to transfer files (input parameters include the storage path of the image file on the UDP server); in the parsing of the auxiliary system When the network mode is started, the obtaining module 140 uses the wget to transfer the file according to the storage path of the parsed image file on the FTP server (the input parameter includes the storage path of the image file on the FTP server); and the auxiliary system is parsed The startup method is network startup The acquiring module 140 mounts the NFS to the second directory according to the storage path of the parsed image file on the NFS server, and obtains the image file from the second directory.

The processing module 150 is configured to decompress the image file, thereby obtaining system metadata, file system mount information, a skippable file list, and a file to be restored;

The obtaining module 140 is further configured to obtain the decompressed system metadata;

The recovery module 160 is configured to restore the system metadata to the current system to be restored;

The obtaining module 140 is further configured to obtain the decompressed file system mount information.

The recovery module 160 is further configured to mount the related file system to the preset second directory according to the file system mounting information;

The obtaining module 140 is further configured to obtain the decompressed list of the skippable files;

The recovery module 160 is further configured to restore the decompressed files to be recovered that are not in the skippable file list to the second directory according to the skippable file list.

When decompressing the image file, the recovery module 160 sequentially determines, according to the skippable file list, whether the decompressed file is a skippable file; when the decompressed file is a skippable file, the recovery module 160 skips the pair The recovery operation of the file continues to determine whether the next file is a skippable file; when the extracted file is not a skippable file, the recovery module 160 restores the file to the second directory, and then continues to judge Whether a file is a skippable file.

The image processing apparatus of the embodiment of the present invention is based on the image file generated in the second embodiment, and the image file is restored according to the image file when the image file is restored to the server to be restored. The decompressed list of skippable files selectively recovers data, and can override the user-specified system configuration file, so that different servers have different configurations when the system is installed or restored in batches.

Referring to FIG. 9, a fourth embodiment of the Linux-based data processing apparatus of the present invention is proposed based on the third embodiment. Based on the embodiment shown in FIG. 8, the recovery module 160 includes:

The recovery unit 161 is configured to restore the MBR according to the acquired system metadata;

Based on the MBR information in the obtained system metadata, the recovery unit 161 recovers using the dd command. MBR to the current system to be restored.

The calculating unit 162 is configured to calculate a disk of the current system to be restored according to the partition table information in the system metadata and the disk information of the current system to be restored when the image file is not acquired locally from the current system to be restored. Partition ratio

When the auxiliary system includes boot_disk in the kernel boot parameter, it is determined that the image file is obtained from a local backup of the current system to be restored, that is, the partition table information and the file system information in the image file are currently waiting for The information in the recovery system is completely consistent. At this time, the data recovery program skips the operations related to the recovery partition and the file system.

When the image file is not obtained locally from the current system to be restored, the calculating unit 162 acquires the partition table information in the system metadata, and obtains the desired partition according to the partition table information and the disk information of the current system to be restored. Information such as the number, type of each partition, and partition size. The number of the obtained partitions is the same as the number of partitions in the partition table information of the image file; the obtained types of the partitions are the same as the types of the partitions in the partition table information of the image file; The size of the obtained partitions in the disk of the server to be restored is the same as the size of each partition in the backup server disk in the partition table information of the image file, for example, the disk size of the backup server is 100G, and the partition is 1 is 20G, and the disk size of the server to be restored at recovery is 200G, and the restored partition 1 is 40G.

The partitioning unit 163 is configured to partition the disk of the current system to be restored according to the disk partition ratio;

The partition unit 163 can use the fdisk tool to partition the disk of the current system to be restored.

The recovery unit 161 is further configured to restore the LVM and the file system according to the system metadata after the disk partition is completed.

When recovering the LVM, the recovery unit 161 recreates the pv using the pvcreate command according to the LVM information in the system metadata, recreates the vg using the vgcreate command, and recreates the lv using the lvcreate command. When restoring the file system, the recovery unit 161 recreates the file system using the corresponding file system formatting tool according to the file system information in the system metadata, and specifies the UUID and Label of the file system when formatting.

The Linux-based data processing apparatus according to the embodiment of the present invention performs the server disk of the system to be restored according to the size proportion of each partition in the decompressed partition table information on the backup server disk. Proportional partitioning avoids space shortage when the disk size of the server to be restored is smaller than that of the backup server, or when the disk size of the server to be restored is larger than that of the backup server.

Referring to FIG. 10, a fifth embodiment of the Linux-based data processing apparatus of the present invention is proposed based on the third or fourth embodiment. Based on the embodiment shown in FIG. 8, the Linux-based data processing apparatus further includes:

The processing module 150 is further configured to switch the root file directory of the current system to be restored to the second directory;

The processing module 150 can use the chroot command to switch the root file directory of the current system to be restored to the second directory.

The initrd production module 170 is configured to mount the boot partition and parse the initrd file when the boot partition is not mounted;

After the root file directory switch is completed, the initrd creation module 170 checks if the boot partition is mounted. When it is checked that the boot partition is not mounted, the initrd making module 170 mounts the boot partition to obtain an initrd file stored in the boot partition.

The obtaining module 140 is further configured to acquire hardware driver information that has been loaded by the current system to be restored;

The initrd making module 170 is further configured to package the hardware driver information and the parsed predetermined file in the initrd file to generate a new initrd file;

The processing module 150 is further configured to replace the initrd file of the current system to be restored with the newly generated initrd file;

The restart module 180 is configured to restart the current system to be restored.

The Linux-based data processing apparatus provided by the embodiment of the present invention can dynamically generate an initrd file containing the hardware driver information of the current system to be restored when the system is restored, so that the generated image file can be backed up on one machine. For restoring machines of other different types of hardware.

The embodiment of the present invention further provides a Linux-based data processing system, as shown in FIG. A schematic diagram of a structure of a first embodiment of a Linux-based data processing system, including an image file storage medium 100 and a backup and recovery server 200, wherein the backup and recovery server 200 includes any of the above embodiments. a Linux-based data processing apparatus; the Linux-based data processing apparatus on the backup and recovery server 200 is configured to back up data on the backup and recovery server 200 as an image file and store the image file On the local or the image file storage medium 100, the image file is decompressed and the data is restored to the backup and recovery server 200 when the data needs to be restored.

The backup and recovery server 200 may be a server configured to back up data and configured to restore the backup data to a local server, or a server cluster including a backup server and one or more recovery servers. The image file storage medium 100 may be a USB flash drive, an optical disk, a web server, or the like.

The Linux-based data processing system proposed by the embodiment of the present invention supports backing up data to be backed up without restarting the system, and can selectively process system configuration data, and considers that the image file generated by the same backup system is to be used. The application of different hardware machines has been compatible with the differences in disk size and hardware drivers, which is convenient for users to perform one-click recovery and batch deployment systems, greatly improving the flexibility of engineering applications.

A second embodiment of the Linux-based data processing system of the present invention is provided based on the first embodiment. In this embodiment, the image file storage medium includes a USB flash drive, an optical disk, and a network server, and the Linux-based data processing device supports In addition to the manner in which the image file is stored or backed up, the mirror file storage medium is also supported to store the image file for backup or recovery.

The Linux-based data processing system proposed by the embodiment of the present invention supports data recovery of multiple image file storage modes at the same time. When data needs to be restored, an appropriate recovery mode can be flexibly adopted according to actual needs.

The above are only the embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Industrial applicability

The Linux-based data processing method disclosed in the present application includes: after receiving a data backup instruction, Check whether the current system environment meets the conditions for data backup while the system continues to run; when the current system environment satisfies the conditions for data backup while the system continues to run, all the data to be backed up is packaged and an image file is generated. The present application also discloses a Linux-based data processing apparatus and system. This application implements data backup while the Linux system continues to run.

Claims

A Linux-based data processing method, including:

After receiving the data backup instruction, detecting whether the current system environment satisfies the condition for performing data backup while the system continues to run;

When the current system environment satisfies the conditions for data backup while the system continues to run, all the data to be backed up is packaged and an image file is generated.
The method of claim 1, wherein when the current system environment satisfies the condition for data backup while the system continues to run, packaging all the data to be backed up and generating the image file includes:

Obtaining a skippable file list, and storing the skippable file list and all system metadata to be backed up in a preset first directory;

Obtaining file system mount information of the current system, and mounting the corresponding file system to the first directory according to the mount information;

The file to be backed up is packaged into the first directory and an image file of a preset name is generated.
The method of claim 2, wherein the Linux-based data processing method further comprises:

After receiving the data recovery instruction, acquiring an image file according to the data recovery instruction;

Decompressing the image file to obtain system metadata, file system mount information, a skippable file list, and a file to be restored;

Obtaining the decompressed system metadata, and restoring the system metadata to a current system to be restored;

Obtaining the extracted file system mount information, and mounting the related file system to a preset second directory according to the file system mount information;

Obtaining the extracted list of skippable files, and restoring the unrecovered files that are not extracted in the skippable file list to the second directory according to the skippable file list.
The method of claim 3, wherein the obtaining the decompressed system metadata and restoring the system metadata to the current system to be restored comprises:

Recovering the MBR according to the acquired system metadata;

When the image file is not obtained locally from the current system to be restored, the disk partition ratio of the current system to be restored is calculated according to the partition table information in the system metadata and the disk information of the current system to be restored;

According to the disk partition ratio, the disk of the current system to be restored is partitioned;

After the disk partition is completed, the LVM and file system are restored according to the system metadata.
The method of claim 3 or 4, wherein the obtaining the decompressed list of skippable files and decompressing according to the list of skippable files is not in the list of skippable files After the step of restoring the restored file to the second directory, the Linux-based data processing method further includes:

Switching the root file directory of the current system to be restored to the second directory;

When the boot partition is not mounted, mount the boot partition and parse the initrd file;

Obtaining hardware driver information that has been loaded by the current system to be restored, and packaging the hardware driver information and the parsed predetermined file in the initrd file to generate a new initrd file;

Replace the initrd file of the current system to be restored with the newly generated initrd file, and restart the current system to be restored.
A Linux-based data processing device comprising:

a receiving module configured to receive a data backup instruction;

a detection module configured to detect whether a current system environment satisfies a condition for performing data backup while the system continues to operate;

The backup module is configured to package all the data to be backed up and generate an image file when the current system environment satisfies the conditions for data backup while the system continues to run.
The apparatus of claim 6 wherein said backup module comprises:

An obtaining unit configured to obtain a list of skippable files;

a backup unit configured to store the skippable file list and all system metadata to be backed up to a preset first directory;

The obtaining unit is further configured to acquire file system mounting information of the current system;

The backup unit is further configured to mount the corresponding file system to the first directory according to the mounting information;

The packaging unit is configured to package the file to be backed up into the first directory and generate an image file of a preset name.
The apparatus of claim 7, wherein the Linux-based data processing apparatus further comprises:

The receiving module is further configured to receive a data recovery instruction;

An obtaining module configured to acquire an image file according to the data recovery instruction;

a processing module configured to decompress the image file to obtain system metadata and a file system Mount information, skippable file list, and files to be restored;

The obtaining module is further configured to obtain the decompressed system metadata;

a recovery module configured to restore the system metadata to a current system to be restored;

The obtaining module is further configured to obtain the decompressed file system mounting information;

The recovery module is further configured to mount the related file system to a preset second directory according to the file system mounting information;

The obtaining module is further configured to obtain the decompressed list of the skippable files;

The recovery module is further configured to restore the extracted files to be recovered that are not in the skippable file list to the second directory according to the skippable file list.
The apparatus of claim 8 wherein said recovery module comprises:

a recovery unit configured to recover the MBR according to the acquired system metadata;

The calculating unit is configured to calculate a disk partition of the current system to be restored according to the partition table information in the system metadata and the disk information of the current system to be restored when the image file is not obtained locally from the current system to be restored. proportion;

a partition unit configured to partition a disk of the current system to be restored according to the disk partition ratio;

The recovery unit is further configured to restore the LVM and the file system according to the system metadata after the disk partition is completed.
The apparatus of claim 8 or 9, wherein the Linux-based data processing apparatus further comprises:

The processing module is further configured to switch the root file directory of the current system to be restored to the second directory;

The initrd production module is configured to mount the boot partition and parse the initrd file when the boot partition is not mounted;

The obtaining module is further configured to acquire hardware driver information that has been loaded by the current system to be restored;

The initrd production module is further configured to package the hardware driver information and the parsed predetermined file in the initrd file to generate a new initrd file;

The processing module is further configured to replace the initrd file of the current system to be restored with the newly generated initrd file;

The module is restarted and configured to restart the current system to be restored.
A Linux-based data processing system that includes image file storage media, backup and recovery a server; the backup and recovery server comprising the Linux-based data processing device of any of claims 6-10; the Linux-based data processing device on the backup and recovery server configured to The data on the backup and recovery server is backed up as an image file, and the image file is stored locally or on the image file storage medium, and the image file is decompressed and the data is restored to the backup when the data needs to be restored. And restore the server.
The system of claim 11, wherein the image file storage medium comprises a USB flash drive, an optical disk, a web server; the Linux-based data processing device is configured to support a local storage image file for backup or recovery. At the same time, it also supports the manner in which any of the image file storage media stores the image file for backup or recovery.