WO2021027126A1

WO2021027126A1 - Database monitoring method, apparatus, device and computer-readable storage medium

Info

Publication number: WO2021027126A1
Application number: PCT/CN2019/117021
Authority: WO
Inventors: 胡鹏强
Original assignee: 平安科技（深圳）有限公司
Priority date: 2019-08-14
Filing date: 2019-11-11
Publication date: 2021-02-18
Also published as: CN110647415A; CN110647415B

Abstract

A database monitoring method, generating a class object library according to a remote server operation request, and storing same in a memory cell of an operation platform, then, on the basis of the remote operation request, selecting from the class object library every type of corresponding operation code implementing data of a database of the remote server to perform operation verification, performing format verification of read data, generating a log file, and saving the log file to the operation platform. A database monitoring apparatus, a device and a computer-readable storage medium, implementing an operation for a remote server on the basis of operation code configured on an operation platform, and storing an operation result at a locale of the operation, thereby enabling a user to view in real time a data storage result of a database on the remote server without having to view via remote operation means, greatly improving efficiency of repair and maintenance of a database.

Description

Database detection method, device, equipment and computer readable storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on August 14, 2019, the application number is 201910749124.2, and the invention title is "database detection methods, devices, equipment and computer-readable storage media". The reference is incorporated in the application.

Technical field

This application relates to the field of big data processing technology, and in particular to a database detection method, device, device, and non-volatile computer-readable storage medium.

Background technique

Server database is a large-scale storage system that is currently used more. It has relatively high requirements for service availability, data reliability, performance, security, and scalability. When using server database as a data storage tool, it is to ensure The integrity of the data or the stability of the system requires constant maintenance. In addition to the maintenance of the hardware of the device itself, this maintenance also includes the maintenance of the data. The maintenance of the data requires the staff to work according to the data. Logs are checked one by one. The generation of these work logs requires the database itself to record and realize, and remote control cannot be realized. This must be done locally in the database for maintenance and troubleshooting, which leads to the difficulty of maintenance.

And, under the premise that there are multiple databases at the same time, the staff need to check and read the work log one by one, and the database maintenance of this kind of system is more difficult. Especially when there are multiple databases, because the format of the stored data is various, the data format may not always be converted to the same data format according to the standard. This makes the staff in the process of maintaining the database The inspection of the format has been increased, greatly increasing the difficulty of maintenance.

Summary of the invention

The main purpose of this application is to provide a database detection method, device, equipment, and computer-readable storage medium, which aims to solve the maintenance operations caused by the fact that the existing server maintenance platform does not support the storage of detection log files on remote servers Overly complex technical issues.

In order to achieve the above objective, this application provides a database detection method, which is applied to data detection in a remote database, and the method includes the following steps:

The class object library is generated according to the operation request of the remote server, and the class object library is stored in the storage unit on the operating platform, wherein the class object library is used to control the remote operation of the remote server by the operating platform , The class object library contains remote server operation code, remote database operation code and file download code;

Receive a remote operation request, determine the type of remote server to be accessed in the remote operation request, and retrieve the remote server operation code corresponding to the type of the remote server from the class object library through the operation platform, Establishing a communication link between the operating platform and the remote server based on the remote server operating code;

According to the type of the remote server and the communication protocol corresponding to the communication link, the corresponding remote database operation code is obtained from the class object library, and based on the remote database operation code, the database on the remote server Access to read the data in the database;

Compare the data of each database read from the remote server according to preset inspection rules to filter out abnormal data in the database, and generate a comparison result in log format according to the abnormal data File, wherein the preset inspection rule includes the storage format of the data in the database and the sensitive words in the data;

The file download code corresponding to the type of the remote server is retrieved to download the comparison result file from the remote server and save it on the operating platform through the file download code.

Optionally, the step of generating a class object library according to an operation request of a remote server, and storing the class object library in a storage unit on an operating platform includes:

Determine the attribute information of each database in the remote server according to the remote database requested to be operated in the operation request, the attribute information including the access mode, operation mode and database type of the database;

According to the access mode, the access interface of the database corresponding to the access mode and the preset access execution code are called, and the parameters in the preset access execution code are modified according to the access interface to generate The remote server operation code;

Generating the remote database operation code for operating and accessing the remote database according to the operation mode, the database type, and the preset database access code;

The remote server operation code and the remote database operation code are stored in the class object library.

Optionally, after the communication link is established, the corresponding remote database operation code is obtained from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link, and based on The step of the remote database operation code accessing each database on the remote server to read data in the database includes:

Access the database according to the remote database operation code stored on the operation platform, and read the data stored in the database;

Determining a data map type for analyzing data according to the type of the remote server, and extracting data format conversion rules based on the data map type;

The data is converted according to the conversion rule and stored in the data map respectively.

Optionally, the data of each database read from the remote server is compared according to preset inspection rules to filter out abnormal data in the database, and generate data based on the abnormal data The steps of comparing result files in log format include:

According to the storage format, the data in the unified converted data map is compared and verified to obtain a first comparison result, and the first comparison result is that data is selected from the data based on the comparison verification Data whose format is inconsistent with the storage format;

Compare the screened data according to the sensitive words, identify the sensitive words in the data and mark the abnormality, to obtain the second comparison result;

A log file is generated according to the first comparison result and the second comparison result.

Optionally, after receiving the remote operation request and determining the type of the remote server to be accessed in the remote operation request, the type of the remote server is retrieved from the class object library through the operation platform The corresponding remote server operation code, after the step of establishing a communication link between the operation platform and the remote server based on the remote server operation code, further includes:

Receiving a maintenance request initiated by a remote server on the operating platform, where the maintenance request includes the remote server to be maintained and corresponding database information;

According to the maintenance request, all the operation codes corresponding to the remote server in the class object library are integrated and compiled to obtain a maintenance small program code of remote server data, and the maintenance small program code is used to obtain the remote server Compare and analyze the data in the database;

The maintenance applet code is uploaded to the remote server through the communication link and executed.

Optionally, the calling the file download code corresponding to the type of the remote server to download the comparison result file from the remote server through the file download code and save it to the operation The steps on the platform include:

After receiving the response message that the maintenance applet code execution is complete, call the file download code according to the type of the remote server, download the comparison result file from the remote server, and compare the The result file is stored in the local storage of the operating platform.

Optionally, the database detection method further includes:

According to the maintenance request and the attribute information of the database, a table file for storing data of the database is generated, and the table file is embedded in the maintenance applet code and uploaded to the remote server, wherein the table The data storage format of the file is consistent with the data storage format of the database.

In addition, in order to achieve the above purpose, the present application also provides a database detection device, which is applied to data detection in a remote server database, and the database detection device includes:

The object generation module is used to generate a class object library according to the operation request of the remote server, and store the class object library in a storage unit on the operating platform, where the class object library is used to control the operating platform to The remote operation of the remote server, the class object library contains remote server operation code, remote database operation code and file download code;

The communication module is used to receive the remote operation request and determine the type of the remote server to be accessed in the remote operation request, and retrieve the type corresponding to the remote server from the class object library through the operation platform Remote server operation code, based on the remote server operation code to establish a communication link between the operation platform and the remote server;

The data reading module is used to obtain the corresponding remote database operation code from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link, and to perform data processing based on the remote database operation code Each database on the remote server is accessed to read the data in the database;

The detection module is used to compare the data of each database read from the remote server according to preset inspection rules to filter out abnormal data in the database, and generate a log based on the abnormal data Format comparison result file, wherein the preset inspection rules include the storage format of the data in the database and the sensitive words in the data;

The download module is configured to retrieve the file download code corresponding to the type of the remote server to download the comparison result file from the remote server and save it to the operating platform through the file download code on.

In addition, in order to achieve the above-mentioned object, the present application also provides a database detection device. The database detection device includes a memory, a processor, and a database detection program stored in the memory and running on the processor. When the database detection program is executed by the processor, the steps of the database detection method described in any one of the above are implemented.

In addition, in order to achieve the above-mentioned object, the present application also has a computer-readable storage medium with a database detection program stored on the computer-readable storage medium, and when the database detection program is executed by a processor, the above-mentioned Steps of database detection method.

This application realizes the access to the remote server and the detection of the corresponding remote database by setting up a class object library on the operating platform, and downloads the comparison result file obtained from the detection of the data in the remote database through the file download code On the operating platform, since the detection results of the remote database have been stored on the operating platform, when users need to maintain and check the data of the remote database, they can directly read the comparison result file on the operating platform for reference. For remote database inspection, it is no longer necessary to directly operate the remote database, which greatly improves the efficiency of database maintenance; at the same time, because the object library for controlling remote server access and remote database detection is stored on the operating platform Therefore, this application is equivalent to providing a unified control platform to manage multiple remote servers and remote databases. Compared with the prior art, there is no need to access and maintain one by one, which improves the efficiency of maintenance and simplifies The operation process of maintenance is improved, and the investment of human resources is reduced.

Description of the drawings

FIG. 1 is a schematic flowchart of a first embodiment of a database detection method provided by this application;

2 is a schematic flowchart of a second embodiment of the database detection method provided by this application;

3 is a schematic diagram of functional modules of an embodiment of a database detection device provided by this application;

FIG. 4 is a schematic diagram of the structure of the operation platform involved in the solution of the embodiment of the application.

The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

detailed description

It should be understood that the specific embodiments described herein are only used to explain the application, and not used to limit the application.

Referring to FIG. 1, FIG. 1 is a flowchart of a database detection method provided by an embodiment of the application. In this embodiment, the database detection method specifically includes the following steps:

Step S110, generating a class object library according to the operation request of the remote server, and storing the class object library in a storage unit on the operating platform;

In this step, the class object library is used to control the remote operation of the remote server by the operating platform, and the class object library contains remote server operation code, remote database operation code and file download code.

In this embodiment, the class object library refers to a remote access code library containing the type of remote server, the correspondence between the communication interface and the control code. Wherein, the operation code is used to implement remote access and operation to the remote server, and it may be an access control code or a mapping file.

For the implementation using control code, it can be a small program code specifically developed based on the corresponding remote server that integrates access and operation control. When the database of the remote server needs to be detected, the small program code is directly called on the platform The above execution can operate and read data on the database on the remote server.

When using a mapping file to achieve, specifically by first generating a remote operation class object channelExec on the server where the platform is located, using this object to establish a connection with the remote server that needs to be operated, and then calling the object of the established connection exeCommand method to execute the command of the remote server.

The operation code set in this step, whether it is implemented by control code or mapping file, the effect of its execution is equivalent to executing the command on the remote server. After the command is executed, the result obtained by the execution will be a string The form is returned to the platform. The remotely operated objects and methods are part of the platform, so the platform encapsulates the method code.

Step S120: Receive a remote operation request, determine the type of remote server to be accessed in the remote operation request, and retrieve a remote server corresponding to the type of the remote server from the class object library through the operation platform Operation code, based on the remote server operation code to establish a communication link between the operation platform and the remote server;

In this step, the communication connection may be a wireless connection or a wired connection, which may be determined according to the actual connection relationship between the platform and the remote server.

In this case, it can also be realized by generating link connection code, remote control code and access code according to the operation code, that is to say, the connection established here is not only to realize the communication between the two, but also to realize The operation of the operating platform on the remote server, but the operation here is realized by means of code control.

Step S130: Obtain the corresponding remote database operation code from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link, and perform an operation on the remote server based on the remote database operation code. To access each database of, and the data in the database has been read;

In this step, the database in the remote server is accessed through the access code formed according to the remote database operation code, and the data stored in the database is read. For data reading, you can select part of the data for reading by sampling , It can also be read all, preferably, select partial read here.

Further, after the data is read, it also includes the conversion of the read data, that is, the same conversion is performed on the data read in each database to form a data map, each of which is All data have the same format.

In practical applications, the conversion of data can be based on a data conversion rule, but when the normal data is converted according to the conversion rule, the final result obtained is in compliance with the inspection rule; and the data itself appears When an exception is detected, after the data conversion rules are converted, the final data obtained cannot pass the inspection rules, but the unified conversion here can ensure the unity of the data. Here, in the process of comparison, it can be improved. Accuracy.

Step S140: Compare the data of each database read from the remote server according to preset inspection rules to filter out abnormal data in the database, and generate a log format based on the abnormal data Comparison result file;

In this step, the preset inspection rule includes the storage format of the data in the database and the sensitive words in the data.

In this embodiment, the realization of the comparison is to compare each data read from each database, and the comparison verification here is specifically the verification of the data format. If the data format is inconsistent, then It is considered abnormal data. If the data format is consistent, the data is considered normal.

In practical applications, the comparison process includes comparing the data obtained in the database with the preset data storage format. If the storage format is different, it is considered invalid data or malicious in nature. The data is recorded in a log format file, and data abnormalities are also marked;

Further, for data with different storage formats, it is necessary to detect whether there are sensitive words in the data, and if they exist, mark them in the log file; the sensitive words here refer to those that cause dangerous attacks on the remote server. Entries or code languages that cause server data loss, malicious attacks on the server's operating system, etc.

Further, the comparison process can also be a comparison between a database and a database. For example, a backup database and an execution database exist in the remote server, and the data in the execution database is backed up in the backup database. In this case, the execution database The data stored in the database can be compared and verified through the data in the backup database. After the mutual comparison, select and verify the rules for comparison, and finally generate a log file from the result of the comparison.

In this case, if the data read in each database is converted into a data map, then the comparison is the data map, and the comparison based on the data map is to compare each data in the data map with the preset inspection The rules are compared and verified, but each data in the data map has been converted accordingly.

In step S150, the file download code corresponding to the type of the remote server is retrieved to download the comparison result file from the remote server and save it on the operating platform through the file download code.

In practical applications, after downloading the comparison results in the remote server through the file download code, when maintenance is required, the corresponding results can be directly read from the operating platform to achieve simultaneous maintenance of the remote database; Further, after receiving the maintenance instruction, the operating platform may extract the abnormally marked data from the log file through the automatic maintenance program for safe processing.

In this case, for step S140, if after comparing and verifying each data, if it does not meet the rules, extract the data separately. After knowing that all the data in the database is compared, the abnormal The data forms an abnormal data set, which is stored in a log file and stored on a remote server. When storing to a log file, each database is stored separately, but it is also stored in a log file, of course, it can also be Multiple log files are formed.

Further, it is also possible to form a large abnormal data set from all abnormal data in the database and store it in a log file.

In this embodiment, when generating the class object library according to the operation request in step S110, it also needs to be generated according to the attribute information of the database, which can be specifically implemented in the following ways:

Determining attribute information of each database in the remote server according to the remote database requested to be operated in the operation request, the attribute information including the access mode, operation mode, and database type of the database;

Retrieve the access interface of the database and the preset access execution code according to the access mode, and modify the parameters in the preset access execution code according to the access interface to generate the remote server operation code;

Generating the remote database operation code for operating and accessing the remote database according to the operation mode, the database type, and a preset database access code;

In this embodiment, in the process of generating the remote server operation code, it is mainly for the communication connection between the remote server and the operation platform. For further database access connections, it is based on the communication connection. The code to operate the remote database is implemented.

That is to say, the communication connection between the operating platform and the remote server is realized through the remote server operation code, and how to access each database after the connection is realized by operating the remote database operation code. For this operation, the remote database operation code can be It is understood as a code collection, which includes multiple sub-codes, each sub-code corresponding to a database, through these sub-codes to try individual access to the database and operation control; of course, the code for operating a remote database can also be understood as It is a script code that can control the access and operation of multiple databases at the same time, such as a script code developed through the commonality of all databases.

Further, it can also be a control code used to control the database access function in the remote server. In this case, when the control code is executed on the operating platform based on the link of the communication connection, it is equivalent to the database access function in the remote server. Control, control the execution of the database access function, so as to achieve indirect access to the remote server database, and the data read at this time can be controlled by some download file codes to control the operating platform to download from the remote server and save to the operation On the platform, the operating platform then proceeds to steps S120-S150.

For example, the databases on the remote server are: oracle database, mysql database, hbase database, hive database, among which oracle database and mysql database are relational databases, and they are used in similar ways, while hbase database is distributed and column-oriented Open source database, hive database is a data warehouse tool based on Hadoop, which can map structured data files into a database table. The operation methods of these databases are different, and the result form of the data collection returned after the operation is also different. In daily applications, these several databases will be used to store different data. The operating platform realizes remote detection and control through the above code, and uniformly converts the data content of these databases into a map for storage, so that these different data can be uniformly compared.

In practical applications, the generated class object library can specifically store the operating code according to the type of the database. It can be stored in the class object library and stored on the operating platform, or it can be the object through the class object library. To obtain the operation code of the object, the actual operation code is stored in the storage unit of the operation platform, and the corresponding relationship between the remote server, the database and the operation code is stored in the class object library, that is, step S130 includes :

The operation code for operating a remote database can also be developed in two ways, one is access control code, and the other is a mapping file.

The access control code refers to the startup script of the database access program on the remote server, and the script is used to control the execution of the program code in the remote server and does not have the function of directly controlling the database, that is to say This script is a tool for indirect control of the database.

In the same way, for the mapping file, it is by mapping different databases to the access interface on the remote server, and then by establishing the corresponding relationship between the access interface and the communication interface of the operating platform, and finally forming a mapping relationship table; and When detecting the database, you can directly access the corresponding database by querying the mapping relationship table. At the same time, you can also obtain the database access code through the corresponding relationship, and control the execution of the access code to achieve the Database access.

In this embodiment, while storing the data, the data map can also classify and store the data. That is to say, in the process of converting the data to storage in the data map, it also includes The received data is classified according to the category in the data map, and then converted on the basis of the classification to store the value in the corresponding category in the data map.

In this case, the conversion of the data map includes the conversion of data in each database into a data map, and the unified conversion of all the acquired database data into a data map; for the conversion into a data map, according to the database For conversion, the data of each database is converted as a data type. Of course, during the conversion process, preliminary conversion inspections can be performed on the data of each database, and the data that is successfully converted normally is stored, and the data that is not converted is performed. Abnormal mark.

Further, after the acquired database data is converted and stored in the data map, the implementation of step S140 can be specifically implemented in the following ways:

Perform comparison verification on the data in the unified converted data map according to the storage format to obtain a first comparison result, and the first comparison result is based on the comparison verification to select a data format from the data Data inconsistent with the storage format;

Compare the filtered data according to the sensitive words, identify the sensitive words in the data, and mark the abnormality to obtain the second comparison result;

In actual applications, when comparing data maps, it is specifically to compare the data elements and rules in the data map. Preferably, it can be the comparison of the data format, or it can be verified through some calculation algorithms. For example, hash algorithms, etc., use algorithms to calculate verification values to verify data.

The database data with abnormal comparisons (not in compliance with the rules in time) is extracted from the data map and saved separately. At the end, the abnormal data will be generated into a log file, and the database detection situation will be recorded through the log file to facilitate subsequent maintenance Maintenance and evaluation of the database by personnel.

In practical applications, whether to start the above detection process to process the data of the database on the remote server, after the communication link between the two is established, it is also necessary to control the execution according to the user's maintenance trigger on the operating platform The next step is to check and download the log file, specifically after the communication link is established,

Receiving a user's maintenance request of a remote server on the operating platform, the maintenance request including the remote server to be maintained and corresponding database information;

The maintenance applet code is uploaded to the remote server through the communication link for execution.

At this time, after the operation platform controls the remote server to complete the detection operation, the remote server will want the operation platform to return a response message, and the operation platform controls to perform the next data comparison and download operation according to the response message, and in step S150 , The specific implementation is: after receiving the response message that the maintenance applet code execution is completed, call the file download code according to the type of the remote server, download the comparison result file from the remote server, and Stored in the local storage of the operating platform.

In this embodiment, the comparison result file is also called a log file. After the operation platform accesses and reads the database of the remote server, after obtaining the data, it can be placed on the remote server. The comparison processing on the above, and the processing can be the comparison processing by the server automatically executing the detection program of the server itself, or the comparison processing through the rules developed by the operating platform.

In this embodiment, the database detection method further includes:

According to the maintenance request and the attribute information of the database, a table file for storing the data of the database is generated and embedded in the maintenance applet code and uploaded to the remote server. The data storage format of the table file is It is consistent with the storage format of the data in the database.

In practical applications, while the data in the database in the remote server is being stored, the maintenance applet code will be executed periodically to back up the data in the database to the table file, and return it to the operating platform for storage.

In this case, in addition to generating the maintenance applet code, the operating platform can also upload some other test codes to the remote server through the file upload code, and realize some other functions through the test code, without requiring everybody To regenerate the code program, the test script file here is some existing test code, specifically the script code corresponding to the test process developed by the user according to actual needs, which is different from the test process of the remote server itself, for example, test database storage The bad sectors of the volume may be detected in the database to meet the requirements of the stored data format. The detection and maintenance of the database can be some preset detection processes, but these detection steps require the user to control the execution, and in the existing detection control, the operation is generally performed directly on the remote server. It is not the operation on the operating platform, but the method of this proposal not only realizes the detection of its own database by controlling the remote server locally on the operating platform, but also realizes the download and save of the log file generated by the detection in the local operating platform. In this way, local viewing of the test results is realized, and manual maintenance operations and back and forth inspections of the database are greatly saved.

Further, for some special inspections, users can develop inspection scripts with special requirements according to actual needs, and these scripts are not on the remote server. Through the above method, upload these inspection scripts to the server. When using, The script uploaded to the server is controlled remotely by the execution code saved in the operating platform, so as to realize the development of special detection, and the detection log file formed by the script execution can be downloaded to the operating platform by downloading the file code. In order to provide users to view, so as to realize the maintenance and inspection of the database at the same time on the local platform, as well as the realization of special customized inspection requirements.

As shown in FIG. 2, a specific implementation flow chart of the database detection method based on the linux execution system in this embodiment of the application, the method specifically includes the following steps:

Step S210: Extract an operating platform in the system that supports connection, login, and operation of a remote server, and execute code control through the operating platform to execute system commands on the remote server;

The specific implementation method of this step is to encapsulate the code used to realize the remote operation of the server on the operating platform, and the code is developed in the Linux system language, of course, it can also be obtained by calling the remote server on the Linux system. The access code is used to modify the corresponding access interface and access protocol to obtain the operation code corresponding to the remote server.

Step S220, enter the relevant server on the remote server;

In this step, the remote control server accesses its corresponding database, such as hbase, hive, etc., through the operating code on the operating platform. The specific access is realized: the code for linking and operating the remote database is encapsulated on the platform.

Step S230: Support batch comparison of oracle data, Mysql database and data in hbase and hive databases on the remote server;

For the implementation of this step: first query the data in each database, save it as a map, and then compare each map one by one, and store the elements in the map that do not meet the rules separately.

Step S240: Support uploading document files and script files (python, shell, js, jmeter, etc.) to the remote server, and execute the script on the remote service or use the document file;

For the implementation of this step: the code for uploading files is encapsulated on the platform.

Step S250: After the database data comparison is completed, the data that does not meet the rules is integrated and returned to the local, and saved as a log file;

For the implementation of this step: the code of the download file is encapsulated on the platform.

Step S260: Download and save the log file to the operating platform, so as to implement maintenance and viewing of the log file locally on the operating platform.

In this step, specifically, the non-compliant elements saved in step S230 are first saved as a log file on the server, and then the download file code method is called to download the file locally.

In this embodiment, through the above scheme, a scheme of automatically detecting non-compliant data in the database on the scanning server and saving the detection result locally for reference is realized. This automated process greatly saves manual manpower.

In order to solve the above-mentioned problems, this application also provides a database detection device, which can be used to implement the database detection method provided in the embodiments of this application, and its physical implementation exists in the form of a local PC. The specific hardware of the PC The realization is shown in Figure 3.

Referring to FIG. 3, the mobile device includes: a processor 301, such as a CPU, a communication bus 302, a user interface 303, a network interface 304, and a memory 305. Among them, the communication bus 302 is used to implement connection and communication between these components. The user interface 303 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the network interface 304 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 305 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as a magnetic disk memory. Optionally, the memory 305 may also be a storage device independent of the aforementioned processor 301.

As shown in FIG. 3, the memory 305 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a database-based detection program. Among them, the operating system is a program for managing and data analysis devices and software resources, the database checking program and the operation of other software and/or programs.

In the hardware structure of the PC operating platform shown in FIG. 3, the network interface 104 is mainly used to access the network; the user interface 103 is mainly used to communicate with the external Internet or with a remote server that provides enterprise data, and access to the remote server The data stored in all the databases in the database are analyzed and processed to obtain the corresponding abnormal data structure, and the processor 301 can be used to call the database detection program stored in the memory 305 and execute the implementation of the following database detection methods Example of operation.

In this embodiment of the Ming Dynasty, the implementation of FIG. 3 can also be a mobile terminal capable of touch operation such as a mobile phone. The processor of the mobile terminal can implement the database detection method by reading the data stored in the buffer or storage unit. The program code is used to perform remote operations on the database on the remote server, and the log file generated after the operation is generated and fed back to the operating platform for local storage.

In order to solve the above-mentioned problem, an embodiment of the present application also provides a database detection device. Referring to FIG. 4, FIG. 4 is a schematic diagram of the functional modules of the database detection device provided by the embodiment of the application. In this embodiment, the device includes:

The object generation module 41 is configured to generate a class object library according to the operation request of the remote server, and store the class object library in a storage unit on the operating platform, wherein the class object library is used to control the operating platform pair For the remote operation of the remote server, the class object library contains remote server operation code, remote database operation code, and file download code;

The communication module 42 is configured to receive a remote operation request and determine the type of the remote server to be accessed in the remote operation request, and retrieve the type corresponding to the remote server from the class object library through the operation platform The remote server operation code is based on the remote server operation code to establish a communication link between the operation platform and the remote server;

The data reading module 43 is configured to obtain the corresponding remote database operation code from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link after the communication link is established, and Access to each database on the remote server based on the remote database operation code, and read data in the database;

The detection module 44 is configured to compare the data of each database read from the remote server according to preset inspection rules, filter out abnormal data in the database, and generate a log based on the abnormal data Format comparison result file, wherein the preset inspection rules include the storage format of the data in the database and the sensitive words in the data;

The download module 45 is configured to retrieve the file download code corresponding to the type of the remote server, download the comparison result file from the remote server and save it on the operating platform.

Based on the description of the embodiment that is the same as the above-mentioned database detection method of the embodiment of the present application, the content of the embodiment of the database detection device is not described in detail in this embodiment.

In this embodiment, the operation code of the remote server is set on the operating platform to realize the operation of the database on the remote server and the reading of data, and then the format of the read data is checked, a log file is generated, and the log file is Save to the operating platform, so that users can implement and view the results of the data storage of the database in the remote server, no longer need to view through the remote operation mode, greatly improve the maintenance efficiency of the database, thereby solving The existing server maintenance platform does not support the storage of detection log files on the remote server, which leads to the technical problem of overly complex maintenance operations, which greatly improves the maintenance efficiency of the remote server database.

The application also provides a computer-readable storage medium.

In this embodiment, a database detection program is stored on the computer-readable storage medium, and when the database detection program is executed by a processor, the steps of the database detection method described in any of the above embodiments are implemented, and the specific steps are as follows:

In this embodiment, the database detection program is executed by the processor to realize the steps of generating a class object library according to an operation request of a remote server and storing the class object library in a storage unit on an operating platform. , Including the following steps:

According to the access mode, call the access interface of the database corresponding to the access mode and the preset access execution code, and modify the parameters in the preset access execution code according to the access interface to generate The remote server operation code;

In this embodiment, the database detection program is executed by the processor to obtain the corresponding remote database from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link Operating code, and accessing each database on the remote server based on the remote database operating code to read the data in the database includes the following steps:

In this embodiment, the database detection program is executed by the processor to implement the comparison of the data of each database read from the remote server according to a preset inspection rule to filter out the The steps of generating abnormal data in the database and generating a comparison result file in log format according to the abnormal data include:

In this embodiment, the following steps are further implemented when the database detection program is executed by the processor:

In this embodiment, the database detection program is executed by the processor to realize the retrieval of the file download code corresponding to the type of the remote server, so as to use the file download code to compare the comparison result When the file is downloaded from the remote server and saved on the operating platform, the steps include the following steps:

Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM/RAM), including Several instructions are used to make a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) execute the method described in each embodiment of the present application.

Claims

A database detection method is applied to the detection of data in a remote database. The method includes the following steps:

The class object library is generated according to the operation request of the remote server, and the class object library is stored in the storage unit on the operating platform, wherein the class object library is used to control the remote operation of the remote server by the operating platform , The class object library contains remote server operation code, remote database operation code and file download code;

Receive a remote operation request, determine the type of remote server to be accessed in the remote operation request, and retrieve the remote server operation code corresponding to the type of the remote server from the class object library through the operation platform, Establishing a communication link between the operating platform and the remote server based on the remote server operating code;

According to the type of the remote server and the communication protocol corresponding to the communication link, the corresponding remote database operation code is obtained from the class object library, and based on the remote database operation code, the database on the remote server Access to read the data in the database;

Compare the data of each database read from the remote server according to preset inspection rules to filter out abnormal data in the database, and generate a comparison result in log format according to the abnormal data File, wherein the preset inspection rule includes the storage format of the data in the database and the sensitive words in the data;

The file download code corresponding to the type of the remote server is retrieved to download the comparison result file from the remote server and save it on the operating platform through the file download code.
The database detection method according to claim 1, wherein the step of generating a class object library according to an operation request of a remote server, and storing the class object library in a storage unit on an operating platform comprises:

Determine the attribute information of each database in the remote server according to the remote database requested to be operated in the operation request, the attribute information including the access mode, operation mode and database type of the database;

According to the access mode, call the access interface of the database corresponding to the access mode and the preset access execution code, and modify the parameters in the preset access execution code according to the access interface to generate The remote server operation code;

Generating the remote database operation code for operating and accessing the remote database according to the operation mode, the database type, and the preset database access code;

The remote server operation code and the remote database operation code are stored in the class object library.
The database detection method according to claim 2, wherein the corresponding remote database operation code is obtained from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link, and based on the The steps of the remote database operation code accessing each database on the remote server to read the data in the database include:

Access the database according to the remote database operation code stored on the operation platform, and read the data stored in the database;

Determining a data map type for analyzing data according to the type of the remote server, and extracting data format conversion rules based on the data map type;

The data is converted according to the conversion rule and stored in the data map respectively.
The database detection method according to claim 3, wherein the data of each database read from the remote server is compared according to a preset inspection rule to screen out abnormal data in the database, and The step of generating a comparison result file in log format according to the abnormal data includes:

According to the storage format, the data in the unified converted data map is compared and verified to obtain a first comparison result, and the first comparison result is that data is selected from the data based on the comparison verification Data whose format is inconsistent with the storage format;

Compare the screened data according to the sensitive words, identify the sensitive words in the data and mark the abnormality, to obtain the second comparison result;

A log file is generated according to the first comparison result and the second comparison result.
The database detection method according to claim 4, after receiving the remote operation request, determining the type of the remote server to be accessed in the remote operation request, and calling from the class object library through the operation platform The remote server operation code corresponding to the type of the remote server, after the step of establishing a communication link between the operation platform and the remote server based on the remote server operation code, further includes:

Receiving a maintenance request initiated by a remote server on the operating platform, where the maintenance request includes the remote server to be maintained and corresponding database information;

According to the maintenance request, all the operation codes corresponding to the remote server in the class object library are integrated and compiled to obtain a maintenance small program code of remote server data, and the maintenance small program code is used to obtain the remote server Compare and analyze the data in the database;

The maintenance applet code is uploaded to the remote server through the communication link and executed.
The database detection method according to claim 5, wherein the file download code corresponding to the type of the remote server is retrieved, so as to use the file download code to transfer the comparison result file from the remote server The steps to download and save to the operating platform include:

After receiving the response message that the maintenance applet code execution is complete, call the file download code according to the type of the remote server, download the comparison result file from the remote server, and compare the The result file is stored in the local storage of the operating platform.
8. The database detection method according to claim 6, the database detection method further comprising:

According to the maintenance request and the attribute information of the database, a table file for storing data of the database is generated, and the table file is embedded in the maintenance applet code and uploaded to the remote server, wherein the table The data storage format of the file is consistent with the data storage format of the database.
A database detecting device, which is applied to detecting data in a remote server database, the database detecting device includes:

The object generation module is used to generate a class object library according to the operation request of the remote server, and store the class object library in a storage unit on the operating platform, where the class object library is used to control the operating platform to The remote operation of the remote server, the class object library contains remote server operation code, remote database operation code and file download code;

The communication module is used to receive the remote operation request and determine the type of the remote server to be accessed in the remote operation request, and retrieve the type corresponding to the remote server from the class object library through the operation platform Remote server operation code, based on the remote server operation code to establish a communication link between the operation platform and the remote server;

The data reading module is used to obtain the corresponding remote database operation code from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link, and to perform data processing based on the remote database operation code Each database on the remote server is accessed to read the data in the database;

The detection module is used to compare the data of each database read from the remote server according to preset inspection rules to filter out abnormal data in the database, and generate a log based on the abnormal data Format comparison result file, wherein the preset inspection rules include the storage format of the data in the database and the sensitive words in the data;

The download module is configured to retrieve the file download code corresponding to the type of the remote server to download the comparison result file from the remote server and save it to the operating platform through the file download code on.
The database detection device according to claim 8, wherein the object generation module is configured to determine the attribute information of each database in the remote server according to the remote database requested to be operated in the operation request, the attribute information including the database Access mode, operation mode and database type; according to the access mode, the access interface of the database corresponding to the access mode and the preset access execution code are called, and the preset access execution code is checked according to the access interface Modify the parameters in the access execution code to generate the remote server operation code; according to the operation mode, the database type, and the preset database access code, generate the remote database for operation and access to the remote database Operation code; storing the remote server operation code and the remote database operation code in the class object library.
The database detection device according to claim 9, wherein the data reading module is used to access the database according to the remote database operation code stored on the operation platform, and read the data stored in the database; The type of the remote server determines the data map type used to analyze the data, and extracts the conversion rule of the data format based on the data map type; converts the data according to the conversion rule and stores them in the data map respectively.
The database detection device according to claim 10, wherein the detection module is configured to compare and verify the data in the unified converted data map according to the storage format to obtain a first comparison result, and the first comparison The result of the comparison is that based on the comparison and verification, the data whose data format is inconsistent with the storage format is selected from the data; the selected data is compared according to the sensitive words, and the sensitive words in the data are identified and combined Mark the abnormality to obtain the second comparison result; generate a log file according to the first comparison result and the second comparison result.
The database detection device according to claim 11, said database detection device further comprising a maintenance module for receiving a maintenance request initiated by a remote server on said operating platform via said communication link, said maintenance request including a maintenance request The remote server and the corresponding database information; according to the maintenance request, all the operation codes corresponding to the remote server in the class object library are integrated and compiled to obtain a maintenance applet code for the remote server data. The maintenance applet The program code is used to obtain the data of the database in the remote server for comparison and analysis; upload the maintenance applet code to the remote server and execute it.
The database detection device according to claim 12, wherein the detection module is configured to retrieve the file download code according to the type of the remote server after receiving the response message that the maintenance applet code execution is completed, and from The remote server downloads the comparison result file, and stores the comparison result file in the local storage of the operating platform.
A database detection device, the database detection device comprising: a memory, a processor, and a database detection program that is stored on the memory and can run on the processor, and when the database detection program is executed by the processor The steps to implement the database detection method described below:

The class object library is generated according to the operation request of the remote server, and the class object library is stored in the storage unit on the operating platform, wherein the class object library is used to control the remote operation of the remote server by the operating platform , The class object library contains remote server operation code, remote database operation code and file download code;

Receive a remote operation request, determine the type of remote server to be accessed in the remote operation request, and retrieve the remote server operation code corresponding to the type of the remote server from the class object library through the operation platform, Establishing a communication link between the operating platform and the remote server based on the remote server operating code;

According to the type of the remote server and the communication protocol corresponding to the communication link, the corresponding remote database operation code is obtained from the class object library, and based on the remote database operation code, the database on the remote server Access to read the data in the database;

Compare the data of each database read from the remote server according to preset inspection rules to filter out abnormal data in the database, and generate a comparison result in log format according to the abnormal data File, wherein the preset inspection rule includes the storage format of the data in the database and the sensitive words in the data;

The file download code corresponding to the type of the remote server is retrieved to download the comparison result file from the remote server and save it on the operating platform through the file download code.
The database detection device according to claim 14, the database detection program is executed by the processor to realize the generation of the class object library according to the operation request of the remote server, and the storage of the class object library on the operating platform The steps in the unit include the following steps:

Determine the attribute information of each database in the remote server according to the remote database requested to be operated in the operation request, the attribute information including the access mode, operation mode and database type of the database;

According to the access mode, call the access interface of the database corresponding to the access mode and the preset access execution code, and modify the parameters in the preset access execution code according to the access interface to generate The remote server operation code;

Generating the remote database operation code for operating and accessing the remote database according to the operation mode, the database type, and the preset database access code;

The remote server operation code and the remote database operation code are stored in the class object library.
The database detection device according to claim 15, wherein the database detection program is executed by the processor to implement the communication protocol from the class object library according to the type of the remote server and the communication protocol corresponding to the communication link The step of obtaining the corresponding remote database operation code and accessing each database on the remote server based on the remote database operation code to read the data in the database includes the following steps:

Access the database according to the remote database operation code stored on the operation platform, and read the data stored in the database;

Determining a data map type for analyzing data according to the type of the remote server, and extracting data format conversion rules based on the data map type;

The data is converted according to the conversion rule and stored in the data map respectively.
15. The database detection device according to claim 16, wherein the database detection program is executed by the processor to implement the comparison of the data of each database read from the remote server according to a preset inspection rule, The steps of filtering out abnormal data in the database and generating a comparison result file in a log format according to the abnormal data include:

According to the storage format, the data in the unified converted data map is compared and verified to obtain a first comparison result, and the first comparison result is that data is selected from the data based on the comparison verification Data whose format is inconsistent with the storage format;

Compare the screened data according to the sensitive words, identify the sensitive words in the data and mark the abnormality, to obtain the second comparison result;

A log file is generated according to the first comparison result and the second comparison result.
17. The database detection device according to claim 17, wherein the database detection program further implements the following steps when being executed by the processor:

Receiving a maintenance request initiated by a remote server on the operating platform, where the maintenance request includes the remote server to be maintained and corresponding database information;

According to the maintenance request, all the operation codes corresponding to the remote server in the class object library are integrated and compiled to obtain a maintenance small program code of remote server data, and the maintenance small program code is used to obtain the remote server Compare and analyze the data in the database;

The maintenance applet code is uploaded to the remote server through the communication link and executed.
The database detection device according to claim 18, wherein the database detection program is executed by the processor to realize the retrieval of the file download code corresponding to the type of the remote server, so as to use the file download code to download The step of downloading the comparison result file from the remote server and saving it to the operating platform includes the following steps:

After receiving the response message that the maintenance applet code execution is complete, call the file download code according to the type of the remote server, download the comparison result file from the remote server, and compare the The result file is stored in the local storage of the operating platform.
A non-volatile computer-readable storage medium having a database detection program stored on the computer-readable storage medium, and when the database detection program is executed by a processor, the steps of the following database detection method are implemented:

The class object library is generated according to the operation request of the remote server, and the class object library is stored in the storage unit on the operating platform, wherein the class object library is used to control the remote operation of the remote server by the operating platform , The class object library contains remote server operation code, remote database operation code and file download code;

Receive a remote operation request, determine the type of remote server to be accessed in the remote operation request, and retrieve the remote server operation code corresponding to the type of the remote server from the class object library through the operation platform, Establishing a communication link between the operating platform and the remote server based on the remote server operation code;

According to the type of the remote server and the communication protocol corresponding to the communication link, the corresponding remote database operation code is obtained from the class object library, and based on the remote database operation code, the database on the remote server Access to read the data in the database;

Compare the data of each database read from the remote server according to preset inspection rules to filter out abnormal data in the database, and generate a comparison result in log format according to the abnormal data File, wherein the preset inspection rule includes the storage format of the data in the database and the sensitive words in the data;

The file download code corresponding to the type of the remote server is retrieved to download the comparison result file from the remote server and save it on the operating platform through the file download code.