CN110517010B - Data processing method, system and storage medium - Google Patents

Data processing method, system and storage medium Download PDF

Info

Publication number
CN110517010B
CN110517010B CN201910699125.0A CN201910699125A CN110517010B CN 110517010 B CN110517010 B CN 110517010B CN 201910699125 A CN201910699125 A CN 201910699125A CN 110517010 B CN110517010 B CN 110517010B
Authority
CN
China
Prior art keywords
data
actual execution
approval
execution data
approval data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910699125.0A
Other languages
Chinese (zh)
Other versions
CN110517010A (en
Inventor
杨振燕
李博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Priority to CN201910699125.0A priority Critical patent/CN110517010B/en
Priority to PCT/CN2019/117415 priority patent/WO2021017281A1/en
Publication of CN110517010A publication Critical patent/CN110517010A/en
Application granted granted Critical
Publication of CN110517010B publication Critical patent/CN110517010B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention relates to a data comparison method and a system, wherein the method comprises the following steps: obtaining approval data from a problem management system, obtaining actual execution data from a database audit platform, comparing the approval data with the actual execution data, and judging whether the approval data is consistent with the actual execution data; if the approval data are consistent with the actual execution data, sending a message with consistent comparison results to the database audit platform, wherein the message with consistent comparison results is used for indicating the database audit platform to execute the SQL script contained in the actual execution data; if the approval data is inconsistent with the actual execution data, sending a message with inconsistent comparison results to the database audit platform, wherein the message with inconsistent comparison results is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data. By comparing the approval data before and after the audit with the actual execution data, the compliance of the audit is ensured, and the accuracy of the database data is ensured.

Description

Data processing method, system and storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data processing method, a system, and a storage medium.
Background
Along with the wide application of computer technology, electronic office work is becoming popular, in the process of electronic office work, staff often need to modify data in a data management system, and in the aspect of auditing of staff modification data, the auditing is mainly finished manually, and an uncontrollable compliance problem exists in a manual auditing result, so that the accuracy of a database is not ensured.
Disclosure of Invention
The invention provides a data processing method, a system and a storage medium, which are used for solving the problem that the prior art has uncontrollable compliance in manual auditing after a data management system modifies data, and the accuracy of a database cannot be guaranteed.
In a first aspect, the present invention provides a data processing method, the method comprising:
obtaining approval data from a problem management system and obtaining actual execution data from a database audit platform, wherein the approval data is related operation data of data to be modified submitted by a user; the actual execution data is related operation data of the modification operation to be actually executed, which is determined after the auditing user audits the approval data;
comparing the approval data with the actual execution data, and judging whether the approval data is consistent with the actual execution data or not;
if the approval data are consistent with the actual execution data, sending a message with consistent comparison results to the database audit platform, wherein the message with consistent comparison results is used for indicating the database audit platform to execute SQL scripts contained in the actual execution data; and if the approval data is inconsistent with the actual execution data, sending a message of inconsistent comparison results to a database audit platform, wherein the message of inconsistent comparison is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data.
Optionally, each set of approval data and the actual execution data includes an SQL script for performing a specific data modification operation, where the SQL script includes unique identification information.
Optionally, the comparing the approval data with the actual execution data includes:
acquiring the unique identification information contained in the approval data, and determining actual execution data which has the same unique identification information as the approval data according to the unique identification information;
and comparing the approval data with actual execution data which has the same unique identification information as the approval data.
Optionally, the problem management system and the database audit platform include data calling interfaces, where the data calling interfaces are used to obtain the approval data and the actual execution data from the problem management system and the database audit platform at regular time respectively.
Optionally, the obtaining approval data from the problem management system and obtaining actual execution data from the database audit platform includes:
receiving a notification message sent by the database audit platform, wherein the notification message is generated by the database audit platform after the database audit platform completes audit on a group of approval data, and the notification message is used for indicating the approval data to be compared;
and acquiring actual execution data corresponding to the approval data from the database audit platform based on the notification message, and acquiring the approval data from the problem management system.
Optionally, before comparing the obtained approval data with the actual execution data, the method further includes: and denoising the approval data and the actual execution data.
Optionally, the comparing the obtained approval data with the actual execution data includes:
carrying out Hash processing on the approval data and the actual execution data to obtain two groups of corresponding Hash values;
calculating the character string similarity of the two groups of corresponding Hash values through a character string similarity algorithm;
if the calculated character string similarity is greater than or equal to a preset similarity, judging that the approval data is consistent with the actual execution data; if the calculated character string similarity is smaller than the preset similarity, judging that the approval data is inconsistent with the actual execution data.
In a second aspect, the present invention provides a data processing system, the system comprising:
the data acquisition module is used for acquiring approval data from the problem management system and acquiring actual execution data from the database audit platform, wherein the approval data is related operation data of data to be modified submitted by a user; the actual execution data is related operation data of the modification operation to be actually executed, which is determined after the auditing user audits the approval data;
the data comparison module is used for comparing the approval data with the actual execution data and judging whether the approval data is consistent with the actual execution data or not;
the execution module is used for sending a message with consistent comparison results to the database audit platform if the approval data are consistent with the actual execution data, wherein the message with consistent comparison results is used for indicating the database audit platform to execute the SQL script contained in the actual execution data; and if the approval data is inconsistent with the actual execution data, sending a message of inconsistent comparison results to a database audit platform, wherein the message of inconsistent comparison is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data.
Optionally, the system further comprises: and the denoising module is used for denoising the approval data and the actual execution data before comparing the approval data with the actual execution data.
In a third aspect, the present invention provides a readable storage medium having stored thereon a computer program, characterized in that the computer program, when executed by a processor, implements the steps of the data processing method according to the first aspect.
According to the embodiment of the invention, the approval data is obtained from the problem management system, and the actual execution data is obtained from the database audit platform, so that the approval data and the actual execution data can be compared, and whether the approval data is consistent with the actual execution data or not is judged; if the approval data are consistent with the actual execution data, sending a message with consistent comparison results to the database audit platform, wherein the message with consistent comparison results is used for indicating the database audit platform to execute the SQL script contained in the actual execution data; if the approval data is inconsistent with the actual execution data, sending a message with inconsistent comparison results to the database audit platform, wherein the message with inconsistent comparison results is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data. Therefore, by comparing the approval data before and after the audit with the actual execution data, the non-compliance modification and the audit operation can be avoided, the compliance of the audit can be ensured, and the accuracy of the database data is ensured.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings can be obtained from these drawings without inventive faculty for a person skilled in the art.
FIG. 1 is a flow chart of a data processing method according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of a data comparison process according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a data processing system according to an embodiment of the present application;
FIG. 4 is a schematic diagram of another exemplary architecture of a data processing system according to an embodiment of the present application.
Detailed Description
In order to make the objects, features and advantages of the present invention more comprehensible, the technical solutions in the embodiments of the present invention will be clearly described in conjunction with the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
For a better understanding of the technical solution of the present invention, please refer to fig. 1, which is a schematic flow chart of a data processing method in an embodiment of the present application, including:
step 101, obtaining approval data from a problem management system, and obtaining actual execution data from a database audit platform, wherein the approval data is related operation data of data to be modified submitted by a user; the actual execution data is related operation data of the modification operation to be actually executed, which is determined after the auditing user audits the approval data;
in an embodiment of the present application, a user submits relevant operation data of a modification application at a problem management system, where the relevant operation data includes, but is not limited to: the operation pointed to by the operation content can be executed on the account and the operation table of the operation by executing the SQL script. The data processing system acquires the relevant operation data to be modified from the problem management system as approval data to be compared. The auditing user audits the related data to be modified at a database auditing platform, and generates related operation data to be actually executed after the auditing, wherein the related operation data comprises but is not limited to: operation time, source IP address, account name and corresponding SQL script. And the data processing system acquires the relevant operation data to be actually executed from the database audit platform and takes the relevant operation data as actual execution data to be compared.
102, comparing the approval data with the actual execution data, and judging whether the approval data is consistent with the actual execution data or not;
in the embodiment of the present application, a specific comparison method for comparing approval data obtained from a problem management system and actual execution data obtained from a database audit platform by a data processing system will be described in detail in the following embodiments, which are not described in detail herein.
Step 103, if the approval data is consistent with the actual execution data, sending a message with consistent comparison to the database audit platform, wherein the message with consistent comparison is used for indicating the database audit platform to execute the SQL script contained in the actual execution data; if the approval data is inconsistent with the actual execution data, sending a message of inconsistent comparison to the database audit platform, wherein the message of inconsistent comparison is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data.
In the embodiment of the application, when the comparison result is that the approval data is consistent with the actual operation data, the comparison result is output, the database audit platform is informed that the application and the audit process are compliant, and the SQL script generated after the audit can be executed to realize the maintenance of the database data; when the comparison result is inconsistent with the actual execution data, the condition that the application operation and the auditing process are not compliant is indicated, the comparison result is output, and the database auditing platform is informed of the SQL script generated after the auditing is not executed.
The embodiment of the invention performs the application and the audit operation of the compliance by comparing the data before and after the audit, avoids the application and the audit work of the non-compliance, and ensures the compliance of the audit data, thereby ensuring the safety of the database data.
Based on the above embodiment, before comparing the approval data obtained from the problem management system with the actual execution data obtained after the auditing user obtained from the database auditing platform audits the approval data, in order to ensure the accuracy of the comparison data, the approval data and the corresponding actual execution data need to be associated, the association is mainly based on unique identification information, and it can be understood that each group of approval data and actual execution data includes an SQL script for executing a specific data modification operation, and the unique identification information is located in the SQL script. The specific mode is as follows:
and acquiring the unique identification information contained in the approval data, and determining actual execution data with the same unique identification information as the approval data according to the unique identification information.
In the embodiment of the application, after a user submits operation data to be modified by a problem management system, the problem management system inserts unique identification information into an SQL script of the operation data, and after an auditing user of a database auditing platform audits the operation data containing the unique identification information, the operation data of the actually executed modification operation containing the same unique identification information in the SQL script is obtained.
When the data processing system executes the data processing task, operation data containing unique identification information is obtained from the problem management system as approval data, and the unique identification information in the SQL script is obtained from the approval data. Similarly, the data processing system acquires actual operation data containing unique identification information from the database audit platform as actual execution data, and acquires the unique identification information in the SQL script from the actual execution data. And (3) associating and comparing the two sets of unique identification information, when the two sets of unique identification information are the same, comparing the set of approval data with the actual execution data, otherwise, not comparing.
According to the method and the device for verifying the SQL script, the unique identification information is inserted into the SQL script of the approval data, so that the data to be compared are associated according to the unique identification information, the data irrelevant before and after the audit are prevented from being compared, the accuracy of the comparison result is improved, and the safety of a database is guaranteed.
It can be appreciated that there are various methods for obtaining approval data and actual execution data from the problem management system and the database audit platform, and the following two methods are provided for reference in the embodiments of the present application. It should be noted that these two acquiring methods are not limiting examples of the present application, and based on the examples of the present invention, other data acquiring methods obtained by a person skilled in the art without making any creative effort are all within the scope of protection of the present application.
The method 1 comprises the steps that a data calling interface is included in the problem management system and the database audit platform, the data processing system is in data interaction with the problem management system and the database audit platform through the data calling interface, and the method is particularly used for respectively acquiring approval data and actual execution data from the problem management system and the database audit platform at regular time.
The method comprises the steps of 2, receiving notification messages sent by a database audit platform, wherein the notification messages are automatically generated after the database audit platform completes audit on a group of approval data, and the notification messages point to a group of actual execution data of the database audit platform; and acquiring actual execution data pointed by the notification message from the database audit platform, and acquiring approval data corresponding to the actual execution data pointed by the notification message from the problem management system.
In the embodiment of the application, the method 1 builds a data call interface for a data processing system in a problem management system and a database audit platform, and the interface can be, but is not limited to: an open database connection interface; through the interface, the data processing system can periodically acquire corresponding approval data and corresponding actual execution data from the problem management system and the database audit platform.
The data processing system is provided with two file storage spaces, one is a file space for storing approval data in the problem management system, and the other is a file space for storing actual execution data generated by the database audit platform. The data obtained regularly are stored in the above file storage space for comparison regularly.
It will be appreciated that the data processing system is not limited to the acquired sequence relationship when acquiring the approval data and the actual execution data, for example, the approval data may be acquired from the problem management system, the actual execution data may be acquired from the database audit platform, and the associated approval data and the actual execution data may be determined based on the acquired approval data and the unique identification information included in the actual execution data, so as to perform comparison. Or, the actual execution data may be obtained from the database audit first, and the approval data with the same unique identification information may be obtained from the problem management system based on the unique identification information included in the actual execution data, so as to obtain approval data and actual execution data that are associated based on the unique identification information, so as to perform comparison. Or, the approval data can be obtained from the problem management system, the unique identification information contained in the approval data is determined, the actual execution data with the same unique identification information is obtained from the database audit platform, and the correlation between the approval data and the actual execution data based on the unique identification information is realized so as to perform comparison. For the approval data of the obtained but not determined associated actual execution data, the unique identification information of the approval data can be used for obtaining the actual execution data with the same unique identification information again, and if the actual execution data with the same unique identification information is not obtained after the operation is repeatedly performed for N times, a relevant reminding message is sent to an auditor of the database audit platform so as to remind the auditor of auditing.
In the method 2, a first data transmission channel is arranged between the data processing system and the problem management system, a second data transmission channel is also arranged between the data processing system and the database auditing platform, when an auditing user triggers an auditing instruction, the database auditing platform sends notification information to the data processing system through the second data transmission channel, the data processing system acquires actual execution data pointed by the notification information from the database auditing platform by utilizing the second data transmission channel after receiving the notification information, and the first data transmission channel is utilized to acquire approval data corresponding to the actual execution data from the problem management system.
By comparing the approval data with the actual execution data, the error maintenance of the database caused by the non-compliance operation of inconsistent approval data and actual execution data is avoided, and the safety of the database data is improved.
Based on the embodiment of fig. 1, the embodiment of the present application further optimizes the approval data and the corresponding actual execution data before comparing them, specifically:
and denoising the approval data and the actual execution data.
In the embodiment of the application, a database can generate a large number of self-triggering sentences during the execution operation, and line feed or blank space can appear, so that the comparison result is affected. Therefore, before comparison, denoising treatment is carried out on the data to be compared, and redundant line feed, blank space and the like are deleted, so that a more accurate comparison result is obtained.
The method for denoising the approval data and the actual execution data ensures that the comparison result is more accurate by deleting the interference data and the information, and further ensures the safety of the database.
Further, referring to fig. 2, based on the embodiment of fig. 1, a flowchart of a data comparison process includes;
step 201, carrying out Hash processing on approval data and actual execution data to obtain two groups of corresponding Hash values;
in the embodiment of the application, the data processing system performs Hash processing on the actual execution data and the approval data to be compared before comparing, so as to obtain two groups of corresponding Hash values. For example: and acquiring a Hash value of the data to be compared by adopting the SM3 cryptographic key.
Step 202, calculating the character string similarity of two groups of corresponding Hash values through a character string similarity algorithm;
in the embodiment of the application, the data processing system compares the obtained two corresponding sets of Hash values through a character string similarity rate calculation algorithm. The algorithm for calculating the string similarity rate includes, but is not limited to: the edit distance calculates the string similarity.
The edit distance is to record whether each character string is the same or not by using a two-dimensional array, if the same character string is recorded as 0, the different character strings are recorded as 1, and the same numbers in each row and each column are accumulated, the last number of the array is the total number of the different character strings, so that the similarity of the two characters is judged, and if the similarity is greater than or equal to the preset similarity, the actual execution data and the approval data can be considered to be consistent.
Step 203, if the calculated similarity of the character strings is greater than or equal to the preset similarity, determining that the approval data is consistent with the actual execution data; if the calculated character string similarity is smaller than the preset similarity, the judged approval data is inconsistent with the actual execution data.
In the embodiment of the application, the approval data and the actual execution data are compared by the method of Hash processing and calculating the character string similarity of the corresponding Hash value, so that the data comparison efficiency is improved, the timeliness of database data maintenance is ensured, and the safety of database data is improved.
Referring to FIG. 3, a schematic diagram of a data processing system according to an embodiment of the present invention includes:
the data acquisition module 301 is configured to acquire approval data from the problem management system, and acquire actual execution data from the database audit platform, where the approval data is related operation data of data to be modified submitted by a user; the actual execution data is related operation data of the modification operation to be actually executed, which is determined after the auditing user audits the approval data;
in the embodiment of the present application, the method for acquiring data by the module is the same as that in step 101, and will not be described here again. In addition, the data acquisition module mounts two file storage spaces, one is a file space for storing approval data in the problem management system, and the other is a file space for storing actual execution data generated by the database audit platform. The data acquired in step 101 are stored in the two spaces for comparison by the data comparison module.
The data comparison module 302 is configured to compare the approval data with the actual execution data, and determine whether the approval data is consistent with the actual execution data;
the execution module 303 is configured to send an audit passing message to the database audit platform if the approval data is consistent with the actual execution data, where the audit passing message is used to instruct the database audit platform to execute the SQL script included in the actual execution data; if the approval data is inconsistent with the actual execution data, sending a message of inconsistent comparison results to the problem management system and the database audit platform, wherein the message of inconsistent comparison is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data.
It can be understood that, the content described in the above embodiment is similar to the content described in the comparison method in the embodiments of step 102 and step 103, and specific reference may be made to the content described in the embodiments shown in steps 102 and 103, which are not repeated herein.
The data processing system provided by the embodiment of the invention compares the approval data before and after approval with the actual execution data, avoids the error maintenance of the database data by the non-compliance operation, and ensures the safety of the database data.
Referring to fig. 4, referring to the data processing system in the embodiment of fig. 3, in another system embodiment of the present application, the system includes a data acquisition module 301, a data comparison module 302, and an execution module 303, where the functions of the data acquisition module 301, the data comparison module 302, and the execution module 303 are the same as those of the data acquisition module 301, the data comparison module 302, and the execution module 303 in the embodiment of fig. 3, and are not described herein again.
The system further comprises: the denoising module 401 is configured to denoise the approval data and the actual execution data before comparing the approval data with the actual execution data.
In this embodiment, specific functions of the denoising module of the data processing system are described in detail in the above method embodiment, and are not described herein.
In the embodiment of the application, before comparing the approval data obtained from the problem management system with the actual execution data obtained after the approval data is audited by an audit user obtained from the database audit platform, in order to ensure the accuracy of the comparison data, the approval data and the corresponding actual execution data need to be associated, wherein the association is mainly based on unique identification information, and it can be understood that each group of approval data and the actual execution data comprises an SQL script for executing specific data modification operation, and the unique identification information is positioned in the SQL script.
The denoising module 401 deletes the interference data and information, so that the comparison result is more accurate, and the safety of the database is further ensured.
The task execution program detection device may further include the following structure based on the embodiment of fig. 3:
the data acquisition module 301 includes:
the first data acquisition module is used for respectively acquiring approval data and actual execution data from the problem management system and the database audit platform at regular time through the data calling interface;
the information receiving module is used for receiving the notification message sent by the database auditing platform;
the second data acquisition module is used for acquiring actual execution data corresponding to the notification message from the database audit platform based on the notification message sent by the database audit platform and acquiring approval data corresponding to the notification message from the problem management system.
The data comparison module 302 includes:
the Hash processing module is used for carrying out Hash processing on the approval data and the actual execution data to obtain two groups of corresponding Hash values;
the character string similarity calculation module is used for calculating the character string similarity of two groups of corresponding Hash values through a character string similarity algorithm;
the judging module is used for judging whether the approval data is consistent with the actual execution data if the calculated character string similarity is greater than or equal to the preset similarity; if the calculated character string similarity is smaller than the preset similarity, the judged approval data is inconsistent with the actual execution data.
It will be appreciated that the content described in the above embodiment is similar to that described in the data processing method in the embodiment shown in fig. 1 and 2, and specific reference may be made to the content in the method described in the embodiment shown in fig. 1 and 2, which is not repeated here.
The data processing system provided by the embodiment of the invention compares the approval data before and after approval with the actual execution data, avoids the error maintenance of the database data by the non-compliance operation, and ensures the safety of the database data.
The present invention also provides a storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the data processing method provided by the method embodiments.
According to the embodiment of the invention, the approval data is obtained from the problem management system, and the actual execution data is obtained from the database audit platform, so that the approval data and the actual execution data can be compared, and whether the approval data is consistent with the actual execution data or not is judged; if the approval data are consistent with the actual execution data, sending a message with consistent comparison results to the database audit platform, wherein the message with consistent comparison results is used for indicating the database audit platform to execute the SQL script contained in the actual execution data; if the approval data is inconsistent with the actual execution data, sending a message with inconsistent comparison results to the database audit platform, wherein the message with inconsistent comparison results is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data. Therefore, by comparing the approval data before and after the audit with the actual execution data, the non-compliance modification and the audit operation can be avoided, the compliance of the audit can be ensured, and the accuracy of the database data is ensured.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.
The foregoing is a description of the embodiments of the present invention, and is not to be construed as limiting the invention, since modifications in the detailed description and the application scope will become apparent to those skilled in the art upon consideration of the teaching of the embodiments of the present invention.

Claims (10)

1. A data processing method applied to a computer device, the method comprising:
obtaining approval data from a problem management system, and obtaining actual execution data from a database audit platform, wherein the approval data is related operation data of data to be modified submitted by a user, and the actual execution data is related operation data of the determined modification operation to be actually executed after the approval data is audited by an audit user;
comparing the approval data with the actual execution data, and judging whether the approval data is consistent with the actual operation data or not;
if the approval data are consistent with the actual execution data, sending a message with consistent comparison results to the database audit platform, wherein the message with consistent comparison results is used for indicating the database audit platform to execute SQL scripts contained in the actual execution data; if the approval data is inconsistent with the actual execution data, sending a message of inconsistent comparison results to the database audit platform, wherein the message of inconsistent comparison is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data.
2. The data processing method according to claim 1, wherein each set of the approval data and the actual execution data includes an SQL script for performing a specific data modification operation, and the SQL script includes unique identification information.
3. The data processing method according to claim 2, wherein the comparing the approval data with the actual execution data includes:
acquiring the unique identification information contained in the approval data, and determining actual execution data which has the same unique identification information as the approval data according to the unique identification information;
and comparing the approval data with actual execution data which has the same unique identification information as the approval data.
4. A data processing method according to claim 3, wherein the problem management system and the database audit platform include data calling interfaces, and the data calling interfaces are configured to obtain the approval data and the actual execution data from the problem management system and the database audit platform at regular time, respectively.
5. A data processing method according to claim 3, wherein the obtaining approval data from the problem management system and obtaining actual execution data from the database audit platform comprises:
receiving a notification message sent by the database audit platform, wherein the notification message is generated by the database audit platform after the database audit platform completes audit on a group of approval data, and the notification message is used for indicating the approval data to be compared;
and acquiring actual execution data corresponding to the approval data from the database audit platform based on the notification message, and acquiring the approval data from the problem management system.
6. The data processing method according to any one of claims 1 to 5, characterized by further comprising, before comparing the acquired approval data with the actual execution data: and denoising the approval data and the actual execution data.
7. The data processing method according to claim 6, wherein the comparing the acquired approval data with the actual execution data includes:
carrying out Hash processing on the approval data and the actual execution data to obtain two groups of corresponding Hash values;
calculating the character string similarity of the two groups of corresponding Hash values through a character string similarity algorithm;
if the calculated character string similarity is greater than or equal to a preset similarity, judging that the approval data is consistent with the actual execution data; if the calculated character string similarity is smaller than the preset similarity, judging that the approval data is inconsistent with the actual execution data.
8. A data processing system, the system comprising:
the data acquisition module is used for acquiring approval data from the problem management system, and acquiring actual execution data from the database audit platform, wherein the approval data is related operation data of data to be modified submitted by a user, and the actual execution data is related operation data of the determined modification operation to be actually executed after the approval data is audited by an audit user;
the data comparison module is used for comparing the approval data with the actual execution data and judging whether the approval data is consistent with the actual execution data or not;
the execution module is used for sending an audit passing message to the database audit platform if the approval data is consistent with the actual execution data, wherein the audit passing message is used for indicating the database audit platform to execute the SQL script contained in the actual execution data; and if the approval data is inconsistent with the actual execution data, sending a message of inconsistent comparison results to a database audit platform, wherein the message of inconsistent comparison is used for indicating that the database audit platform does not execute the SQL script contained in the actual execution data.
9. The data processing system of claim 8, wherein the system further comprises:
and the denoising module is used for denoising the approval data and the actual execution data before comparing the approval data with the actual execution data.
10. A readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the data processing method according to any one of claims 1 to 7.
CN201910699125.0A 2019-07-31 2019-07-31 Data processing method, system and storage medium Active CN110517010B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910699125.0A CN110517010B (en) 2019-07-31 2019-07-31 Data processing method, system and storage medium
PCT/CN2019/117415 WO2021017281A1 (en) 2019-07-31 2019-11-12 Data processing method and system, computer device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910699125.0A CN110517010B (en) 2019-07-31 2019-07-31 Data processing method, system and storage medium

Publications (2)

Publication Number Publication Date
CN110517010A CN110517010A (en) 2019-11-29
CN110517010B true CN110517010B (en) 2023-07-11

Family

ID=68624049

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910699125.0A Active CN110517010B (en) 2019-07-31 2019-07-31 Data processing method, system and storage medium

Country Status (2)

Country Link
CN (1) CN110517010B (en)
WO (1) WO2021017281A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112256672B (en) * 2020-10-22 2023-05-30 中国联合网络通信集团有限公司 Database change approval method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104391995A (en) * 2014-12-15 2015-03-04 北京趣拿软件科技有限公司 SQL (Structured Query Language) statement auditing method, and database operation and maintenance method and system
CN107908651A (en) * 2017-10-12 2018-04-13 北京人大金仓信息技术股份有限公司 A kind of auditing method of distributed type assemblies
CN109710518A (en) * 2018-12-13 2019-05-03 中国联合网络通信集团有限公司 Script checking method and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8799225B2 (en) * 2003-11-05 2014-08-05 Lumigent Technologies, Inc. Process and system for auditing database activity
CN101853289B (en) * 2010-05-26 2012-10-17 杭州华三通信技术有限公司 Database auditing method and equipment
CN109271315A (en) * 2018-08-23 2019-01-25 中国平安财产保险股份有限公司 Scripted code detection method, device, computer equipment and storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104391995A (en) * 2014-12-15 2015-03-04 北京趣拿软件科技有限公司 SQL (Structured Query Language) statement auditing method, and database operation and maintenance method and system
CN107908651A (en) * 2017-10-12 2018-04-13 北京人大金仓信息技术股份有限公司 A kind of auditing method of distributed type assemblies
CN109710518A (en) * 2018-12-13 2019-05-03 中国联合网络通信集团有限公司 Script checking method and device

Also Published As

Publication number Publication date
WO2021017281A1 (en) 2021-02-04
CN110517010A (en) 2019-11-29

Similar Documents

Publication Publication Date Title
CN110908997B (en) Data blood relationship construction method and device, server and readable storage medium
CN107341098B (en) Software performance testing method, platform, equipment and storage medium
AU2017101864A4 (en) Method, device, server and storage apparatus of reviewing SQL
CN107633016B (en) Data processing method and device and electronic equipment
US8904352B2 (en) Systems and methods for processing source code during debugging operations
CN106293891B (en) Multidimensional investment index monitoring method
WO2018120965A1 (en) Automatic test method and device, and computer-readable storage medium
US20160019266A1 (en) Query generating method and query generating device
CN113076104A (en) Page generation method, device, equipment and storage medium
CN108255967B (en) Method and device for calling storage process, storage medium and terminal
CN110830500B (en) Network attack tracking method and device, electronic equipment and readable storage medium
US10241957B2 (en) Workload patterns for realistic load recreation in performance testing
CN110362630B (en) Data management method, device, equipment and computer readable storage medium
CN109284331B (en) Certificate making information acquisition method based on service data resources, terminal equipment and medium
CN110517010B (en) Data processing method, system and storage medium
CN108650123B (en) Fault information recording method, device, equipment and storage medium
WO2019062020A1 (en) Asynchronous task unified processing method and apparatus, and storage medium
CN109389271B (en) Application performance management method and system
CN107273293B (en) Big data system performance test method and device and electronic equipment
CN112988776B (en) Method, device and equipment for updating text parsing rule and readable storage medium
CN115687050A (en) Performance analysis method and device of SQL (structured query language) statement
CN110807037B (en) Data modification method and device, electronic equipment and storage medium
CN115455059A (en) Method, device and related medium for analyzing user behavior based on underlying data
CN114968725A (en) Task dependency relationship correction method and device, computer equipment and storage medium
US8321844B2 (en) Providing registration of a communication

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant