WO2013123703A1

WO2013123703A1 - Data backup method and device, and data recovery method and device of network management system

Info

Publication number: WO2013123703A1
Application number: PCT/CN2012/074018
Authority: WO
Inventors: 吴雁峰
Original assignee: 中兴通讯股份有限公司
Priority date: 2012-02-22
Filing date: 2012-04-13
Publication date: 2013-08-29
Also published as: CN102624545A

Abstract

Provided are a data backup method and device, and a data recovery method and device of a network management system. The data backup method of the network management system comprises: reading a data table needing to be backed up from a database (S102); and writing, in a binary format, data in the data table into a pre-assigned text file (S104). The methods and devices solve the problem of time-consuming data backup and recovery, thereby achieving the effect of rapid data backup and recovery.

Description

The present invention relates to the field of communications, and in particular to a data backup method, apparatus, and recovery method and apparatus for a network management system. BACKGROUND OF THE INVENTION In the related art code division multiple access (CDMA) network management system, a method for backing up and restoring important data is provided. In the method, the database structure is first accessed during backup. The database structure writes a Structured Query Language (SQL) statement, and uses the SQL statement to generate an executable sequence file that is first emptied and then inserted one by one. At the time of recovery, the database engine can be used to directly run the executable sequence file to recover all the backed up data. This backup recovery method conforms to the programmer's programming habits. At the same time, it also realizes online backup and recovery. It does not need to restart the server, so that users can monitor and maintain the entire network in real time. However, the backup and recovery schemes of the related technologies have the following disadvantages: With the improvement of the network management capability of the network management system, the number of base stations that can be managed by one network management system can reach 1500. As the number of management base stations increases, backup and recovery are required. The data is also increased in geometry, and data is backed up and restored in the past. A large LAN data backup takes 10 minutes and data recovery takes 50 minutes. Such a slow backup and recovery speed obviously does not meet the user's requirements. Currently, the backup and recovery mode of the network management system uses the SQL script sequence. The SQL script sequence can be used to intuitively understand the data configured in the current system, but the user can modify the data in the script sequence. For commercial systems, use SQL script sequences for backup and recovery have great security risks. Because the user cannot perform other operations during the backup and recovery process, for a LAN with a large amount of data, if the network management system cannot maintain the system for a long time, the user satisfaction will be poor. In the actual use process, users often reflect the traditional backup and recovery methods due to the long time, resulting in communication disconnection between the client and the server or other problems. In view of the problem that the data backup and recovery in the related art takes a long time, an effective solution has not been proposed yet. SUMMARY OF THE INVENTION The present invention provides a data backup method, apparatus, and recovery method and apparatus for a network management system to at least solve the problem that data backup and recovery in a related art takes a long time. According to an aspect of the present invention, a data backup method of a network management system is provided, including: reading a data table in a database that needs to be backed up; and writing data in the data table into a pre-designated text file in a binary format. Preferably, reading the data table that needs to be backed up in the database comprises: obtaining a list of table names of the data tables that need to be backed up in the database; and reading the data table corresponding to each data table name in the table name list in the database. Preferably, reading the data table corresponding to each data table name in the table name list in the database comprises: reading the data table corresponding to each data table name in the order of the table name list. Preferably, writing the data in the data table in a binary format to the pre-designated text file comprises: writing the data in each data table in a binary format to a separate text file specified in advance. Preferably, after the data in the data table is written into the pre-designated text file in a binary format, the method further comprises: encrypting the text file. Preferably, after encrypting the text file, the method further includes: compressing the encrypted text file; and storing the compressed text file in the designated area. According to another aspect of the present invention, a data recovery method of a network management system is provided, comprising: reading a backup file stored in a binary format in advance from a specified area; and importing the backup file into a database. Preferably, reading the backup file stored in the binary format in advance from the specified area comprises: reading the table name from the table name list of the data table pre-generated by the system; reading each data in the specified area and the table name list The backup file corresponding to the table name stored in binary format. Preferably, importing the backup file into the database comprises: respectively importing the backup file stored in the binary format in advance into the data table corresponding to the table name in the database. Preferably, before reading the table name from the list of table names of the data table pre-generated by the system, the method further includes: checking whether the data of the binary text is modified; in the case that the data is not modified, the table name from the system Read the table name in the list. According to still another aspect of the present invention, a data backup device for a network management system is provided, comprising: a reading module configured to read a data table in a database that needs to be backed up; and a writing module configured to binary the data in the data table The format is written to a pre-specified text file. According to still another aspect of the present invention, a data recovery device for a network management system is provided, comprising: a reading module configured to read a backup file stored in a binary format in advance from a designated area; importing a module, setting the backup to be performed The file is imported into the database. Through the invention, the data is backed up and restored in a binary format, which at least solves the problem that the data backup and recovery in the related technology takes a long time, thereby achieving the effect of quickly backing up and restoring the data. BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are set to illustrate,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 1 is a flowchart of a data backup method of a network management system according to an embodiment of the present invention; FIG. 2 is a flowchart of a data backup method of a network management system according to a preferred embodiment of the present invention; FIG. 4 is a flowchart of a data recovery method in a network management system according to a preferred embodiment of the present invention; FIG. 5 is a data backup device of a network management system according to an embodiment of the present invention; Figure 6 is a block diagram showing the structure of a data backup device of a network management system according to a preferred embodiment of the present invention; Figure 7 is a block diagram showing the structure of a data backup device of a network management system according to a preferred embodiment of the present invention; FIG. 9 is a structural block diagram of a data recovery device of a network management system according to an embodiment of the present invention; FIG. 10 is a block diagram of a data recovery device of a network management system according to an embodiment of the present invention; FIG. 11 is a block diagram of a data recovery device of a network management system according to a preferred embodiment of the present invention; FIG. Two block diagram; FIG. 12 is a block diagram showing recovery means third data network management system according to a preferred embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. In order to solve the problem that the data backup and recovery in the related art takes a long time, the following technical solutions are adopted in the embodiment of the present invention. First, a list of table names for storing all the data tables in the database that need to be backed up and restored is obtained from the system. When the user performs the backup operation, the corresponding data table name is retrieved from the table name list file in order, and according to the data table name, the packaged Bulk Copy (BCP) tool is used to find the specified database. This data table, and all the data in this data table is written in a binary format to a pre-designated text file, and then a data table name is removed from the list file, and the above operation is repeated, and all the tables in the database are All are converted into binary text files, and then the binary text file is encrypted by Cyclic Redundancy Check (CRC). Finally, the encrypted text file is compressed and stored in the specified directory of the system. . It should be noted that, by using the BCP tool, data can be imported and read into the data table. In the embodiment of the present invention, data is written and read by pre-packaging the BCP tool in the system. Based on the above, the embodiment of the present invention provides a data backup method of the network management system. FIG. 1 is a flowchart of a data backup method of the network management system according to an embodiment of the present invention, which includes the following steps S102 to S104. Step S102, reading a data table in the database that needs to be backed up. Step S104, the data in the data table is written in a binary format into a pre-designated text file. In the related art, when the data is backed up, an executable sequence file generated according to the data table to be backed up is directly backed up, and the backup process takes a long time. In the embodiment of the present invention, the data in the data table to be backed up is backed up in a binary format. Reduces the time it takes to back up and improves the user experience. There are multiple implementation manners for reading the data table that needs to be backed up in step S102. Preferably, the table name list of the data table to be backed up in the database may be obtained first, and then each data table name in the database and the table name list is read. Corresponding data table. First generate a list and then back up one by one, you can avoid missing the data table to be backed up. At the same time, when the backup process is interrupted, you can know which data has been backed up and which data tables have not been backed up by the list, so that it is backed up. Continue to complete the remaining backups, improving the efficiency of the backup. Since there is a one-to-one correspondence between the table name in the table name list and the data table, in order not to additionally store a correspondence between the table name and the data table, each data table name may be read in the order of the table name list. The data Table. Compared with reading the first letter of the table name, reading according to the file size of the data table, or reading according to the modification time of the data table, it is more convenient to read the data table directly in the order of the list, and at the same time The step of storing the correspondence between the table name and the data table saves backup time and storage space. In the step S104 of the embodiment of the present invention, the data in each data table can be separately written into a pre-designated independent text file in a binary format. In the related art, when the backup is performed, the backup to be backed up is performed. The data table is all loaded into the memory for processing. Since the file is large, it occupies a large amount of memory and CPU resources. With this embodiment, the system only needs to load data of one data table at a time, which greatly reduces the memory and CPU usage, and makes the system Run a more process. After the data in the data table is written in a binary format to a pre-designated text file, the text file can also be encrypted in order to prevent the backup data from being modified. In order to save the storage space, the encrypted text file can also be compressed, and then the compressed text file is stored in the designated area. In this embodiment, since the format of the backup data is binary, the storage space of the data is greatly The compression, the original large-capacity data requires tens of M of storage space, the current data only needs 1M space, thus saving storage space. The implementation process of the embodiment of the present invention will be described in detail below with reference to examples. 2 is a flowchart of a data backup method of a network management system according to a preferred embodiment of the present invention. As shown in FIG. 2, in the network management software system in the preferred embodiment of the present invention, data backup is to be specified in a database that needs to be backed up in advance. The data table or the view name list is processed in a single table by the batch command in the BCP tool, and the data in the table is stored in a binary format and stored in a binary file, and the following steps S202 to S216 are included. Step S202, starting a backup operation. Step S204, reading the library table sequence from the file or the database. In step S206, the data table name or the view name is read in the order of indicating the list, so that all fields in the table or view to be backed up are read. Store all data table or view name information read into container 1. Step S208, sequentially extracting a table name from the container 1 into the variable "dbtablename", and then using this variable

The "dbtablename" executes the encapsulated BCP tool for the input parameters. In this embodiment, a command that the database engine can recognize is automatically constructed. The format of the command in this embodiment is as follows: Bcp {dbtablename} { out } filename -c -k -t & -a65535 -S database IP, port number -U username -P password This command can take various parameters,

"-c" means that the data in the exported table is stored in character type, "-k" means that the record in the exported table will automatically retain the null value if the value of a field is empty, "-t" means to The terminator of the field is used as the termination of each field value. Here, "&" is used as the termination. "-a" indicates the maximum packet size of the text file that can be exported. Here, 65536 is used to make it large enough to support large data volume. "-S" indicates the name or IP of the database server to be exported, "-U" indicates the user name of this database, and "-P" indicates the database password corresponding to this database. After calling the database engine to execute this command, the system will store all the data in the data table in the database with the variable "dbtablename" as the table name in binary format to the file under the specified file path, where the file name convention is: The fixed file name prefix "_dbtablename.txt" ensures that each data table generates a unique binary text file. Since the data is read in this embodiment, it is not necessary to distinguish the type of each field in each table, nor the information of each field in the table is stored, and the file is written in a compact binary byte stream sequence. Into the text, so it is very efficient to back up the database data in this way, and the data in the binary format file is 01 data, the compression efficiency is the highest. Step S210, determining whether the data table in the table name list has been read, if yes, executing step S212; if not, reading the next table name in the container 1, repeating the operation of step S208 until the container 1 is All the data tables have done the above. Step S212, performing encryption processing on the data stored in the file in the binary file format in the specified file path, and generating a string of encrypted characters stored in the specified text file CRC.txt, the encrypted characters being used for verifying data recovery Whether the backed up data has been modified. Step S214, compressing and packaging all the generated binary files and the CRC.txt file, storing the files in a customized .dat format, and placing them in a user-specified directory. In step S216, the backup operation is completed, and the backup ends. The embodiment of the invention further provides a data recovery method of the network management system, which can be used in conjunction with the data backup method described above. FIG. 3 is a flowchart of a data recovery method of a network management system according to an embodiment of the present invention, which includes the following steps S302 to S304. Step S302, reading a backup file stored in a binary format in advance from the designated area. Step S304, importing the backup file into the database. In the related art, a pre-generated executable sequence file is directly restored when data is restored, and the recovery process takes a long time. By using the embodiment of the present invention, the data table backed up in a binary format is restored, which shortens the time used for recovery. Improve the user experience. When reading the backup file, the table name may be read from the table name list of the data table pre-generated by the system, and then the backup stored in the binary format corresponding to each data table name in the table name list in the specified area is read. The files are restored one by one according to the table name list of the data table, and the data table to be restored can be avoided. At the same time, when the recovery process is interrupted, the list can know which data has been recovered, which data tables have not been recovered, and thus On the basis of recovery, the remaining recovery is continued, which improves the efficiency of recovery. In step S304 of the embodiment of the present invention, the backup file stored in the binary format in advance may be separately imported into the data table corresponding to the table name in the database. In the related art, when the recovery is performed, all the data tables to be backed up are loaded into the memory for processing. Since the file is large, the memory and the CPU resources are occupied very much. In this embodiment, the system only needs to load data of one data table at a time. Greatly reduce the memory and CPU usage, and make the system run more smoothly. In order to prevent the backup data from being modified, it is possible to check whether the data of the binary text is modified before reading the table name from the list of table names of the data table pre-generated by the system, and the data is not modified from the system. The table name is read in the list of table names. For example, a CRC check is added in this embodiment to prevent the user from changing any data and avoiding an incalculable loss to the operator. It can be found from the above embodiment that when the user performs the recovery operation, the CRC check is performed first, and the restored data is checked whether the data has not been modified, and only the data that has not been tampered with can be resumed. In this case, the data existing in the database is cleared first. Then, the data to be restored is decompressed, decompressed into text files, and the table name is taken out from the list of table names in order according to the list of table names obtained from the system, and then the BCP tool encapsulated in this embodiment is used. , the data in the binary text is all imported into the corresponding table of the database, the table name in the table name list file is sequentially manipulated, until all the data of the text file has been imported into the database table, and the recovery is completed. The implementation process of the embodiment of the present invention will be described in detail below with reference to examples. 4 is a flowchart of a data recovery method in a network management system according to a preferred embodiment of the present invention. As shown in FIG. 4, in the actual application process, data backup and recovery occur in the same database management software. The list of table names to be backed up specified in the data backup process is also one-to-one corresponding to the data recovery process. A list of recovered table names. The recovery data is an inverse process of the backup data, and the specific steps include the following steps S402 to S414. In step S402, a recovery operation is started. Step S404, performing a decompression algorithm process on the file specified by the user in the .dat format. Step S406, performing decryption processing on the decompressed binary file, and also generating a string of encrypted character strings, and comparing the string encrypted string with the encrypted string stored in the CRC.txt file, if the two strings are not Similarly, if the backed up data has been modified, it is not allowed to be restored to the system. If the two strings are the same, it means that the data has not been modified since the backup, then the operation of step S408 is performed; if two strings are If not, proceed to step S414. Step S408, reading the table name or the view name in the database table name list file specified in advance, storing all the read table or view name information into a container 2, and comparing whether the number of table names in the container is It is equal to the number of binary files, and data recovery is performed when they are equal. Step S410, sequentially extracting a table name "dbtablename" from the container 2, and then executing the packaged BCP tool, the program automatically constructs a command of the BCP tool that the database engine can recognize: bcp {dbtablename} { in } filename-c -k -t & -a65535 -S Database IP, Port Number - U Username -P Password Here, it is necessary to specify how the parameters specified during backup are defined. In the case of recovery, you also need to specify the same parameter definition to avoid the database. When the engine parses, the binary file is incorrectly split, resulting in data misalignment. After calling the database engine to execute this command, the database engine will read the file under the specified file path, read it in binary format, and write the data into the database table "dbtablename" in turn to form a database record. In this embodiment, the data in the text file is imported into the database table in a batch format by a specified interval, and is written in the form of a pure binary stream. Therefore, the recovery of the database data in this embodiment is very efficient, and the recovery time is only relevant. One tenth of technology. In addition, compared with the prior art, this embodiment divides all the table data in the database into a single text file, which reduces the system memory consumption during recovery and reduces the risk of memory overflow of the system running. When restoring data, the entire recovery file needs to be loaded into the memory for processing. Since the file is large, the memory and CPU resources are very consumed. With this embodiment, the system only loads data in one file at a time, which greatly reduces the memory and CPU consumption makes the system run more smoothly. Step S412, determining whether there is still a binary file to be imported, if yes, taking the next table name in the container 2, repeating the operation of step S408 until the above operations are performed on all the data tables in the container 2, and the recovery is completed; If no, the process proceeds to step S414. In step S414, the recovery operation is completed, and the recovery ends. It can be seen from the above examples that the solution for backing up and restoring important data provided by the embodiments of the present invention inherits the advantages of high flexibility, simple operation, online backup and recovery, and overcomes the related art. Capacity data execution is inefficient, poor security, and large storage space. It better satisfies the requirements of communication and related industries, and provides safe, fast, flexible and convenient backup and recovery operations for important configuration data. It has achieved very satisfactory results and has been transplanted to other products of the company. It should be noted that the steps shown in the flowchart of the accompanying drawings may be performed in a computer system such as a set of computer executable instructions, and, although the logical order is shown in the flowchart, in some cases, The steps shown or described may be performed in an order different than that herein. The embodiment of the invention provides a data backup device of the network management system, and the device can be configured to implement the data backup method of the network management system. FIG. 5 is a structural block diagram of a data backup device of a network management system according to an embodiment of the present invention. As shown in FIG. 5, a read module 52 and a write module 54 are included. The structure is described in detail below. The reading module 52 is configured to read a data table in the database that needs to be backed up; the writing module 54, connected to the reading module 52, is configured to write the data in the data table into a pre-designated text file in a binary format. 6 is a structural block diagram of a data backup device of a network management system according to a preferred embodiment of the present invention. As shown in FIG. 6, the reading module 52 includes: an obtaining submodule 522, configured to acquire a table of data tables in the database that need to be backed up. Name list. The read sub-module 524 is connected to the acquisition sub-module 522 and configured to read the data table corresponding to each data table name in the table name list in the database. Preferably, the reading sub-module 524 reads the data tables corresponding to the respective data table names in the order of the table name list. FIG. 7 is a block diagram showing the structure of a data backup device of a network management system according to a preferred embodiment of the present invention. As shown in FIG. 7, the write module 54 includes: a write submodule 542 configured to set data in each data table. The binary format is written to a separate text file specified in advance. FIG. 8 is a structural block diagram 3 of a data backup apparatus of a network management system according to a preferred embodiment of the present invention. As shown in FIG. 8, the apparatus further includes: an encryption apparatus 56 configured to encrypt a text file. The compression module 58, coupled to the encryption device 56, is configured to compress the encrypted text file. The storage module 510 is coupled to the compression module 58 and configured to store the compressed text file to a designated area. The embodiment of the invention provides a data recovery device of the network management system, and the device can be configured to implement a data recovery method of the network management system. FIG. 9 is a structural block diagram of a data recovery device of a network management system according to an embodiment of the present invention. As shown in FIG. 5, a read module 92 and an import module 94 are included. The structure is described in detail below. The reading module 92 is configured to read a backup file previously stored in a binary format from the designated area. The import module 94, connected to the read module 92, is arranged to import the backup file into the database. FIG. 10 is a structural block diagram of a data recovery apparatus of a network management system according to a preferred embodiment of the present invention. As shown in FIG. 10, the reading module 92 includes: a first reading submodule 922, which is set as a data table pre-generated from the system. The table name is read in the table name list; the second reading sub-module 924 is connected to the first reading sub-module 922, and is set to read the binary format in the specified area corresponding to each data table name in the table name list. Stored backup files. 11 is a block diagram showing the structure of a data recovery device of a network management system according to a preferred embodiment of the present invention, as shown in FIG.

As shown in Fig. 11, the import module 94 includes: an import submodule 942, which is configured to respectively import a backup file stored in a binary format in advance into a data table corresponding to the table name in the database. 12 is a structural block diagram 3 of a data recovery apparatus of a network management system according to a preferred embodiment of the present invention. As shown in FIG. 12, the apparatus further includes: a verification module 96, configured to check whether data of the binary text is modified. It should be noted that the data backup device of the network management system and the data recovery device of the network management system described in the device embodiment correspond to the foregoing method embodiments, and the specific implementation process has been described in detail in the method embodiment. No longer. Industrial Applicability The present invention uses a binary format to back up and restore data, shortens the time taken for backup, and has industrial applicability. Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device, or they may be separately fabricated into individual integrated circuit modules, or they may be Multiple modules or steps are made into a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software. The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

Claim

A data backup method for a network management system, comprising:

Read the data table in the database that needs to be backed up;

The data in the data table is written in a binary format into a pre-designated text file.

2. The method according to claim 1, wherein the reading the data table in the database that needs to be backed up comprises: obtaining a list of table names of the data tables in the database that need to be backed up;

The data table corresponding to each data table name in the table name list in the database is read.

3. The method according to claim 2, wherein reading the data table corresponding to each data table name in the table name list in the database comprises: reading each in the order of the table name list The data table corresponding to the data table name.

4. The method according to claim 1, wherein writing data in the data table in a binary format to a pre-designated text file comprises: writing data in each data table in a binary format Go to a separate text file specified in advance.

5. The method according to claim 1, wherein, after the data in the data table is written in a binary format into a pre-designated text file, the method further comprises: encrypting the text file.

The method according to claim 5, after the encrypting the text file, further comprising: compressing the encrypted text file;

The compressed text file is stored in a specified area.

7. A data recovery method for a network management system, comprising:

Reading a backup file previously stored in binary format from the specified area;

Import the backup file into the database.

8. The method according to claim 7, wherein reading the backup file previously stored in a binary format from the specified area comprises:

Reading the table name from the list of table names of the data table pre-generated by the system; A backup file stored in a binary format corresponding to each data table name in the table name list in the specified area is read.

9. The method according to claim 8, wherein the importing the backup file into the database comprises: respectively importing a backup file stored in a binary format in advance into a data table corresponding to the table name in the database.

10. The method according to claim 8, wherein before the table name is read from the list of table names of the data table pre-generated by the system, the method further includes:

Verifying whether the data of the binary text is modified;

In the case where the data has not been modified, the table name is read from the list of table names in the system.

11. A data backup device for a network management system, comprising:

Reading module, set to read the data table in the database that needs to be backed up;

A write module, configured to write data in the data table into a pre-specified text file in a binary format.

12. A data recovery device for a network management system, comprising:

The reading module is configured to read a backup file stored in a binary format in advance from the specified area; the import module is configured to import the backup file into the database.