CN110659297A - Data processing method, data processing device, computer equipment and storage medium - Google Patents
Data processing method, data processing device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110659297A CN110659297A CN201910744652.9A CN201910744652A CN110659297A CN 110659297 A CN110659297 A CN 110659297A CN 201910744652 A CN201910744652 A CN 201910744652A CN 110659297 A CN110659297 A CN 110659297A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- change
- data change
- change request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
Abstract
The application relates to the field of research and development management, and relates to a data processing method and device, computer equipment and a storage medium. The method comprises the following steps: intercepting a data change request and extracting data change information carried by the data change request; acquiring historical data information, and backing up the historical data information; the historical data information is data information stored in a database; performing data change operation on the historical data information according to the data change information to obtain current data information; comparing the backed-up historical data information with the current data information to obtain difference data; acquiring target historical data information and target current data information corresponding to each piece of difference data, and acquiring data change information according to the target historical data information and the target current data information corresponding to the difference data; and storing the data change information into a pre-established change record table. The method can effectively trace the change of the service data.
Description
Technical Field
The present application relates to the field of software development technologies, and in particular, to a data processing method and apparatus, a computer device, and a storage medium.
Background
In the conventional technology, all records of business data are based on the condition that current data are recorded at the latest time of the existing time, and each time the business data are changed, the database can only retain the business data at the current time or after the business data are modified for the last time, so that the change of the business data cannot be effectively traced.
Disclosure of Invention
In view of the above, it is necessary to provide a method, an apparatus, a computer device, and a storage medium capable of effectively tracing a change of business data in view of the above technical problems.
A method of data processing, the method comprising: intercepting a data change request and extracting data change information carried by the data change request; acquiring historical data information and backing up the historical data information; the historical data information is data information stored in a database; performing data change operation on the historical data information according to the data change information to obtain current data information; comparing the backed-up historical data information with the current data information to obtain difference data; acquiring target historical data information and target current data information corresponding to each piece of difference data, and acquiring data change information according to the target historical data information and the target current data information corresponding to the difference data; and storing the data change information into a pre-established change record table.
In one embodiment, the intercepting a data change request includes: acquiring a section interception proxy frame, and acquiring a plurality of interceptors corresponding to the data change request in the section interception proxy frame; forming an interception chain corresponding to the data change request by utilizing the plurality of interceptors; invoking the interception chain to intercept the data change request.
In one embodiment, the intercepting a data change request includes: receiving a data change request, and determining a mapping object corresponding to the data change request according to a preset mapping relation table; and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
In one embodiment, the data modification request further carries data association information corresponding to the data modification information, and the extracting the data modification information carried by the data modification request includes: extracting data change information and the data association information carried by the data change request; the storing the data change information into a pre-established change record table includes: and storing the data change information and the data association information in a pre-established change record table in a correlated manner.
In one embodiment, the method further includes: receiving a change inquiry request, wherein the change inquiry request carries change field information; and inquiring data change information corresponding to the change field information in the change record table.
A data processing apparatus, the apparatus comprising: the data interception module is used for intercepting a data change request and extracting data change information carried by the data change request; the data backup module is used for acquiring historical data information and backing up the historical data information; the historical data information is data information stored in a database; the data change module is used for carrying out data change operation on the historical data information according to the data change information to obtain current data information; the data comparison module is used for comparing the backed-up historical data information with the current data information to obtain difference data; the change information acquisition module is used for acquiring target historical data information and target current data information corresponding to each piece of difference data and acquiring data change information according to the target historical data information and the target current data information corresponding to the difference data; and the data storage module is used for storing the data change information into a pre-established change record table.
In one embodiment, the intercepting module is further configured to obtain a tangent plane intercepting proxy frame, and obtain a plurality of interceptors corresponding to the data change request in the tangent plane intercepting proxy frame; forming an interception chain corresponding to the data change request by utilizing the plurality of interceptors; invoking the interception chain to intercept the data change request.
In one embodiment, the intercepting module is further configured to receive a data change request, and determine a mapping object corresponding to the data change request according to a preset mapping relationship table; and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the data processing method when executing the computer program.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the data processing method described above.
According to the data processing method, the data processing device, the computer equipment and the storage medium, since the historical data information is backed up, after the historical data information is changed to obtain the current data information, the current data information can be compared with the backed-up historical data information to obtain the difference data, the target historical data information and the target current data information corresponding to the difference data can be further obtained to obtain the data change information, and the data change information is stored in the change record table, and the change of the data can be effectively traced due to the storage of the data change information.
Drawings
FIG. 1 is a diagram of an exemplary implementation of a data processing method;
FIG. 2 is a flow diagram illustrating a data processing method according to one embodiment;
FIG. 3 is a flow chart illustrating a data processing method according to another embodiment;
FIG. 4 is a block diagram showing the structure of a data processing apparatus according to an embodiment;
FIG. 5 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The data processing method provided by the application can be applied to the application environment shown in fig. 1. Wherein the terminal 102 communicates with the server 104 via a network. After receiving the data change request sent by the terminal 102, the server 104 extracts the data change information carried by the data change request, backs up the stored historical data information in the database, performs data change operation on the historical data information according to the data change information to obtain the current data information, compares the current data information with the backed-up historical data information to obtain difference data, finally obtains data change information according to the target historical data information and the target current data information corresponding to the difference data, stores the data change information in a change record table, and can trace back the change of the service data through the change record table. The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 104 may be implemented by an independent server or a server cluster formed by a plurality of servers.
In one embodiment, as shown in fig. 2, a data processing method is provided, which is described by taking the application of the method to the server in fig. 1 as an example, and includes the following steps:
step S202, intercepting the data change request and extracting the data change information carried by the data change request.
The data modification request refers to a request for performing corresponding modification operation on the service data in the database, the data modification information refers to information used for performing modification operation on the data information in the database, and if the credit value of Zhang III in the database is modified from 1000 to 10000, 10000 is the data modification information. It is understood that a plurality of data change information may be included in the data change request at the same time, so as to change a plurality of data in the database at the same time, and to ensure that the correct change can be performed subsequently, each piece of data change information in the data change request is subjected to a corresponding location identifier, which may be, for example, a combination of a primary key of a row and a field name of a column of the piece of data change information.
Specifically, when the terminal sends a data change request to the server, the server intercepts the data change request, extracts data change information carried by the data change request from the data change request, and caches the data change information. When the server intercepts the data change request, a tangent plane interception technology (AOP) can be adopted, and each service item of a service class (the service class includes a constructor and a service method, and the service method includes a static method and a dynamic method) is intercepted by using the tangent plane interception technology. The tangent plane interception technology intercepts a data change request through an AOP proxy class (i.e., interceptor) automatically created in an AOP framework, and the AOP proxy class can be divided into two major classes, namely a static proxy and a dynamic proxy.
In one embodiment, after the server intercepts the data change request through the interceptor, the server may further perform permission check on the data change request, and when the permission check fails, the server may store request parameters and user information corresponding to the data change request, and send notification information to the administrator terminal, and the administrator determines whether to allow the data change request to pass. And the server sends the data change request to a corresponding destination address only after the data change request is allowed to pass by the administrator terminal, otherwise, the server returns notification information of request failure to the terminal. By performing authority verification on the data change request, the data in the database can be prevented from being changed at will.
Step S204, historical data information is acquired, and backup is carried out on the historical data information.
And step S206, carrying out data change operation on the historical data information according to the data change information to obtain the current data information.
The historical data information refers to data information stored in the database when a data change request is received. The data change operation refers to a change operation performed on the historical data information by the server according to the data change information in the data change request, and it can be understood that the change operation includes operations of modifying, deleting, adding and the like performed on the data information in the database.
Specifically, the server may obtain the historical data information from the database and back up the historical data information. In one embodiment, the server stores the historical data information in a temporary data table for backup, and after the server backs up the historical data information, the server performs data change operation on the historical data information in the database according to the data change information to obtain current data information, wherein the current data information refers to the data information obtained after the server performs data change operation on the historical data information.
And step S208, comparing the backed-up historical data information with the current data information to obtain difference data.
Wherein, the difference data refers to data of which the historical data information and the current data information are different from each other for the same field in the same data record in the database. The difference data may be data in the history data information that is different from the current data information; or the data in the current data information which is different from the historical data information; it is also possible to include both data in the history data information that is not the same as the current data information and data in the current data information that is not the same as the history data information.
In one embodiment, the server performs data comparison to map the backed-up historical data information and the current data information into word vectors, determines difference vectors of the word vectors corresponding to the backed-up historical data information and the word vectors corresponding to the current data information, and obtains difference data based on the difference vectors.
In another embodiment, the server may compare the data table corresponding to the backed-up historical data information with the data table corresponding to the current data information directly by executing an SQL statement, and obtain difference data between the two data tables according to the comparison result, where SQL statements corresponding to different types of databases are not the same, and SQL statements corresponding to different versions of the same type of database are also not the same, for example, in SQL SERVER 2000, it may be: SELECT FROM b WHERE NOT EXISTS (SELECT FROM a WHERE a.id. b.id), in versions above SQL SERVER 2005, may be: SELECT FROM b find SELECT a.
It is understood that the process of the server performing data comparison between the historical data information and the current data information is not limited to the above method.
Step S210, obtaining target history data information and target current data information corresponding to each piece of difference data, and obtaining data change information according to the target history data information and the target current data information corresponding to the difference data.
In step S212, the data change information is stored in a change log table established in advance.
And the target historical data information corresponding to the difference data is data before the change operation, and the target current data information corresponding to the difference data is data after the change operation. The data change information is used for representing the change record of a certain field value in the database, and comprises the data before the change and the data after the change corresponding to the data change operation,
specifically, the server combines the target historical data information and the target current data information corresponding to each piece of difference data according to a preset rule to obtain data change information, and adds the data change information to a pre-established change record table. The preset rule can be preset according to the requirement.
In one embodiment, the change from "target historical data information" to "target current data information" may be performed according to the following rule, for example, if the loan amount of Zhang III is changed from 1000 to 10000, the corresponding data change information is "1000 to 10000".
In the data processing method, since the historical data information is backed up, after the historical data information is changed to obtain the current data information, the current data information can be compared with the backed-up historical data information to obtain the difference data, the target historical data information and the target current data information corresponding to the difference data can be further obtained to obtain the data change information, and the data change information is added into the change record table, and the change of the data can be effectively traced due to the fact that the data change information is recorded.
In one embodiment, intercepting a data change request includes: acquiring a section interception proxy frame, and acquiring a plurality of interceptors corresponding to the data change request in the section interception proxy frame; forming an interception chain corresponding to the data change request according to the plurality of interceptors; an intercept chain is invoked to intercept a data change request.
The section interception proxy frame is a proxy frame used for performing AOP (automatic optical plane processing), can be realized in AOP frames such as Spring and the like, and acquires an interceptor corresponding to the data change request in the section interception proxy frame, wherein the interceptor is an object called by the dynamic interception action. It provides a mechanism to define code that executes before and after an action is executed, and to prevent execution before an action is executed, and also provides a way to extract reusable parts of an action. In AOP an interceptor is used to intercept a method or field before it is accessed and then to join some operations before or after it. In this embodiment, a plurality of interceptors may be configured for the data change request, an interception chain is formed by using the plurality of interceptors, the data change request is intercepted according to the interception chain, and by intercepting the data change request, the data change request may be subjected to a related operation according to a preset interceptor configuration, so that the change operation on the data maximally satisfies a service requirement.
In one embodiment, the interceptors may include at least a first interceptor for verifying a user right corresponding to the data change request and a second interceptor for extracting data change information from the data change request, and the server forms an interception chain corresponding to the data change request according to the first interceptor and the second interceptor.
In one embodiment, intercepting a data change request includes: receiving a data change request, and determining a mapping object corresponding to the data change request according to a preset mapping relation table; and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
Because the data information in the database is more, the influence of some data changes on the service is less, and the change history does not need to be recorded in the change record table when the part of service data is changed, the server does not need to intercept all data change requests in the implementation process in order to save the running resources of the server, and the interceptor is required to selectively intercept the data change requests. Specifically, a mapping relationship between a table and an object in a database may be predefined to obtain a mapping relationship table, when a server receives a data change request, a data table in which data change information corresponding to the data change request is located is first determined, the mapping relationship table is queried according to the data table to obtain a mapping object corresponding to the data change request, further, the server determines whether the mapping object is the same as a target object corresponding to an interceptor, and if so, intercepts the data change request. The target object corresponding to the interceptor can be configured and modified according to business needs.
In one embodiment, the data modification request further carries data association information corresponding to the data modification information, and extracting the data modification information carried by the data modification request includes: extracting data change information and data association information carried by the data change request; storing data change information into a pre-established change record table, comprising: and storing the data change information and the data association information in a pre-established change record table in a correlated mode.
In this embodiment, the data modification request further carries data associated information corresponding to the data modification information, where the data associated information refers to associated information corresponding to the data modification request, and the data associated information may be a reason for performing data modification, a special meaning for performing data modification, and the like. After obtaining the data change information, the server may store the data change information and the data related information in association with each other in the change log table, where the association storage refers to storing the data change information and the corresponding data related information in the same row of the change log table. By storing the data change information and the data related information in a related manner, a user can be helped to better know the service data change history and the change reason.
In one embodiment, the server may perform tagging processing on the data related information to obtain a data related tag, and store the data related tag and the data change information in a change log table in an associated manner. It can be understood that the data association tag is used for identifying some special meanings of the modification, and the special meanings of the modification are identified by additionally adding the modification tag, so that a user can be helped to analyze and locate the reason of the problem in real time.
In one embodiment, the server may extract keywords from the associated information, and determine the extracted keywords as tags of the associated information. Specifically, the text corresponding to the associated information may be segmented, and the keywords may be extracted from the segmentation result.
When performing word segmentation, the server may first divide the text into a complete sentence according to the punctuation marks, and then perform word segmentation on each segmented sentence, for example, may perform word segmentation on each segmented sentence by using a word segmentation method for string matching, for example, a forward maximum matching method, and segment a string in one segmented sentence from left to right; or, the reverse maximum matching method, which divides the character string in a segmented sentence from right to left; or, the shortest path word segmentation method, the number of words required to be cut out in a character string in a segmented sentence is minimum; or, the bidirectional maximum matching method carries out word segmentation matching in forward and reverse directions simultaneously. The word segmentation processing can be carried out on each segmented sentence by utilizing a word meaning word segmentation method, wherein the word meaning word segmentation method is a word segmentation method for machine voice judgment, and words are segmented by utilizing syntactic information and semantic information to process an ambiguity phenomenon.
In one embodiment, when the server extracts the keywords from the word segmentation result, the server may calculate the feature weights of the words in the word segmentation result, and extract the keywords according to the calculated feature weights. The characteristic weight is used for representing the importance degree of a certain word relative to the text of the word, and the larger the characteristic weight is, the more important the characteristic word is. In one embodiment, calculating feature weights for individual words in the word result may employ a term frequency-inverse document frequency (TF-IDF) algorithm.
In one embodiment, after the server calculates the feature weight, the server may sort the words according to the feature weight, and select the keyword according to the sorting result. For example, the words may be sorted in descending order according to the feature weight, and a preset number of words ranked at the top are selected to be determined as the keywords.
In another embodiment, after the server calculates the feature weight, a word with the feature weight greater than a preset threshold value may be selected, and the selected word is determined as a keyword.
In one embodiment, the method further comprises: receiving a change inquiry request, wherein the change inquiry request carries change field information; the change log table is searched for data change information corresponding to the change field information.
The change inquiry request is a request which is sent by a terminal to a server and is used for performing historical change inquiry on data information, the change inquiry request carries change field information, and data change information corresponding to the change field information is inquired in a change record table.
In this embodiment, the server receives a change query request, where the change query request carries change field information, queries data change information corresponding to the change field information in a change record table, and discovers the life cycle of related service data by analyzing historical modification data.
In one embodiment, as shown in fig. 3, there is provided a data processing method comprising the steps of:
step S302, receiving a data change request, and extracting data change information carried by the data change request and data association information corresponding to the data change information;
step S304, a section intercepting proxy frame is obtained, a plurality of interceptors corresponding to the data change request are obtained in the section intercepting proxy frame, and an intercepting chain corresponding to the data change request is formed by utilizing the plurality of interceptors;
step S306, determining a mapping object corresponding to the data change request according to a preset mapping relation table;
step S308, when the mapping object is the same as the target object corresponding to each interceptor in the interception chain, calling the interception chain to intercept the data change request;
step S310, acquiring historical data information and backing up the historical data information; the historical data information is data information stored in a database;
step S312, performing data change operation on the historical data information according to the data change information to obtain current data information;
step S314, comparing the backed-up historical data information with the current data information to obtain difference data;
step S316, acquiring target historical data information and target current data information corresponding to each piece of difference data, and obtaining data change information according to the target historical data information and the target current data information corresponding to the difference data;
in step S318, the data change information and the data related information are stored in association with each other in a change log table established in advance.
In the embodiment, the interceptors are formed by arranging the plurality of interceptors, the data change request is intercepted according to the interception chain, the data change request is intercepted, the data change request can be subjected to related operations according to the preset interceptor configuration, so that the data change operation can maximally meet the service requirement, the change information is obtained through the data acquisition request, and the change information and the related information are stored in the change information table in an associated manner, so that the change of the data can be effectively traced, and a user can be helped to better know the service data change history and the change reason.
It should be understood that although the various steps in the flow charts of fig. 2-3 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-3 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 4, there is provided a data processing apparatus 400 comprising:
a data interception module 402, configured to intercept a data change request and extract data change information carried in the data change request;
a data backup module 404, configured to obtain historical data information and backup the historical data information; the historical data information is data information stored in a database;
the data change module 406 is configured to perform data change operation on the historical data information according to the data change information to obtain current data information;
the data comparison module 408 is configured to perform data comparison on the backed-up historical data information and the current data information to obtain difference data;
a change information obtaining module 410, configured to obtain target history data information and target current data information corresponding to each piece of difference data, and obtain data change information according to the target history data information and the target current data information corresponding to the difference data;
and a data storage module 412, configured to store the data change information in a pre-established change record table.
In the data processing device, since the historical data information is backed up, after the historical data information is changed to obtain the current data information, the current data information can be compared with the backed-up historical data information to obtain the difference data, the target historical data information and the target current data information corresponding to the difference data can be further obtained to obtain the data change information, and the data change information is stored in the change record table.
In one embodiment, the intercepting module 402 is further configured to obtain a tangent plane intercepting proxy frame, and obtain a plurality of interceptors corresponding to the data change request in the tangent plane intercepting proxy frame; forming an interception chain corresponding to the data change request by utilizing a plurality of interceptors; an intercept chain is invoked to intercept a data change request.
In one embodiment, the intercepting module 402 is further configured to receive a data modification request, and determine a mapping object corresponding to the data modification request according to a preset mapping relationship table; and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
In one embodiment, the data change request further carries data associated information corresponding to the data change information, and the data interception module is further configured to extract the data change information and the data associated information carried by the data change request; the data storage module is also used for storing the data change information and the data association information into a pre-established change record table in an associated mode.
In one embodiment, the above apparatus further comprises: the query module is used for receiving a change query request, and the change query request carries change field information; the change log table is searched for data change information corresponding to the change field information.
For specific limitations of the data processing apparatus, reference may be made to the above limitations of the data processing method, which are not described herein again. The various modules in the data processing apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 5. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing data service data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a data processing method.
Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, there is provided a computer device comprising a memory storing a computer program and a processor implementing the following steps when the processor executes the computer program: intercepting a data change request and extracting data change information carried by the data change request; acquiring historical data information, and backing up the historical data information; the historical data information is data information stored in a database; performing data change operation on the historical data information according to the data change information to obtain current data information; comparing the backed-up historical data information with the current data information to obtain difference data; acquiring target historical data information and target current data information corresponding to each piece of difference data, and acquiring data change information according to the target historical data information and the target current data information corresponding to the difference data; and storing the data change information into a pre-established change record table.
In one embodiment, intercepting a data change request includes: acquiring a section interception proxy frame, and acquiring a plurality of interceptors corresponding to the data change request in the section interception proxy frame; forming an interception chain corresponding to the data change request by utilizing a plurality of interceptors; an intercept chain is invoked to intercept a data change request.
In one embodiment, intercepting a data change request includes: receiving a data change request, and determining a mapping object corresponding to the data change request according to a preset mapping relation table; and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
In one embodiment, the data modification request further carries data association information corresponding to the data modification information, and extracting the data modification information carried by the data modification request includes: extracting data change information and data association information carried by the data change request; storing data change information into a pre-established change record table, comprising: and storing the data change information and the data association information in a pre-established change record table in a correlated mode.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving a change inquiry request, wherein the change inquiry request carries change field information; the change log table is searched for data change information corresponding to the change field information.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: intercepting a data change request and extracting data change information carried by the data change request; acquiring historical data information, and backing up the historical data information; the historical data information is data information stored in a database; performing data change operation on the historical data information according to the data change information to obtain current data information; comparing the backed-up historical data information with the current data information to obtain difference data; acquiring target historical data information and target current data information corresponding to each piece of difference data, and acquiring data change information according to the target historical data information and the target current data information corresponding to the difference data; and storing the data change information into a pre-established change record table.
In one embodiment, intercepting a data change request includes: acquiring a section interception proxy frame, and acquiring a plurality of interceptors corresponding to the data change request in the section interception proxy frame; forming an interception chain corresponding to the data change request by utilizing a plurality of interceptors; an intercept chain is invoked to intercept a data change request.
In one embodiment, intercepting a data change request includes: receiving a data change request, and determining a mapping object corresponding to the data change request according to a preset mapping relation table; and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
In one embodiment, the data modification request further carries data association information corresponding to the data modification information, and extracting the data modification information carried by the data modification request includes: extracting data change information and data association information carried by the data change request; storing data change information into a pre-established change record table, comprising: and storing the data change information and the data association information in a pre-established change record table in a correlated mode. In one embodiment, the computer program when executed by the processor further performs the steps of: receiving a change inquiry request, wherein the change inquiry request carries change field information; the change log table is searched for data change information corresponding to the change field information.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method of data processing, the method comprising:
intercepting a data change request and extracting data change information carried by the data change request;
acquiring historical data information and backing up the historical data information; the historical data information is data information stored in a database;
performing data change operation on the historical data information according to the data change information to obtain current data information;
comparing the backed-up historical data information with the current data information to obtain difference data;
acquiring target historical data information and target current data information corresponding to each piece of difference data, and acquiring data change information according to the target historical data information and the target current data information corresponding to the difference data;
and storing the data change information into a pre-established change record table.
2. The method of claim 1, wherein intercepting a data change request comprises:
acquiring a section interception proxy frame, and acquiring a plurality of interceptors corresponding to the data change request in the section interception proxy frame;
forming an interception chain corresponding to the data change request by utilizing the plurality of interceptors;
invoking the interception chain to intercept the data change request.
3. The method of claim 1, wherein intercepting a data change request comprises:
receiving a data change request, and determining a mapping object corresponding to the data change request according to a preset mapping relation table;
and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
4. The method of claim 1, wherein the data change request further carries data association information corresponding to the data change information, and the extracting the data change information carried by the data change request comprises:
extracting data change information and the data association information carried by the data change request;
the storing the data change information into a pre-established change record table includes:
and storing the data change information and the data association information in a pre-established change record table in a correlated manner.
5. The method of claims 1 to 4, further comprising:
receiving a change inquiry request, wherein the change inquiry request carries change field information;
and inquiring data change information corresponding to the change field information in the change record table.
6. A data processing apparatus, characterized in that the apparatus comprises:
the data interception module is used for intercepting a data change request and extracting data change information carried by the data change request;
the data backup module is used for acquiring historical data information and backing up the historical data information; the historical data information is data information stored in a database;
the data change module is used for carrying out data change operation on the historical data information according to the data change information to obtain current data information;
the data comparison module is used for comparing the backed-up historical data information with the current data information to obtain difference data;
the change information acquisition module is used for acquiring target historical data information and target current data information corresponding to each piece of difference data and acquiring data change information according to the target historical data information and the target current data information corresponding to the difference data;
and the data storage module is used for storing the data change information into a pre-established change record table.
7. The data processing apparatus according to claim 6, wherein the intercepting module is further configured to obtain a tangent plane intercepting proxy frame, in which a plurality of interceptors corresponding to the data change request are obtained; forming an interception chain corresponding to the data change request by utilizing the plurality of interceptors; invoking the interception chain to intercept the data change request.
8. The data processing apparatus according to claim 6, wherein the intercepting module is further configured to receive a data change request, and determine a mapping object corresponding to the data change request according to a preset mapping relationship table; and intercepting the data change request when the mapping object is the same as the target object corresponding to the interceptor.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 5 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910744652.9A CN110659297A (en) | 2019-08-13 | 2019-08-13 | Data processing method, data processing device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910744652.9A CN110659297A (en) | 2019-08-13 | 2019-08-13 | Data processing method, data processing device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110659297A true CN110659297A (en) | 2020-01-07 |
Family
ID=69037626
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910744652.9A Pending CN110659297A (en) | 2019-08-13 | 2019-08-13 | Data processing method, data processing device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110659297A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111309733A (en) * | 2020-02-20 | 2020-06-19 | 深圳震有科技股份有限公司 | Incremental data extraction processing method and device, computer equipment and medium |
| CN111301317A (en) * | 2020-02-28 | 2020-06-19 | 深圳市元征科技股份有限公司 | Event generation method, event generation device and vehicle-mounted equipment |
| CN112182309A (en) * | 2020-10-06 | 2021-01-05 | 广州云莫凡信息科技有限公司 | Building decoration basic layer industrialized data processing method and system based on building engineering and big data |
| CN115357590A (en) * | 2022-08-10 | 2022-11-18 | 中信建投证券股份有限公司 | Recording method and device for data change, electronic device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101673374A (en) * | 2009-09-16 | 2010-03-17 | 金蝶软件（中国）有限公司 | Bill processing method and device |
| CN102479205A (en) * | 2010-11-26 | 2012-05-30 | 金蝶软件（中国）有限公司 | Generation method and system of change order |
| CN103150155A (en) * | 2011-12-07 | 2013-06-12 | 金蝶软件（中国）有限公司 | Data interception method and device |
| JP2016162245A (en) * | 2015-03-02 | 2016-09-05 | 富士通株式会社 | Storage control device, storage control method, and storage control program |
| CN108200219A (en) * | 2018-03-13 | 2018-06-22 | 广东欧珀移动通信有限公司 | Method of data synchronization, device, server and storage medium |
-
2019
- 2019-08-13 CN CN201910744652.9A patent/CN110659297A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101673374A (en) * | 2009-09-16 | 2010-03-17 | 金蝶软件（中国）有限公司 | Bill processing method and device |
| CN102479205A (en) * | 2010-11-26 | 2012-05-30 | 金蝶软件（中国）有限公司 | Generation method and system of change order |
| CN103150155A (en) * | 2011-12-07 | 2013-06-12 | 金蝶软件（中国）有限公司 | Data interception method and device |
| JP2016162245A (en) * | 2015-03-02 | 2016-09-05 | 富士通株式会社 | Storage control device, storage control method, and storage control program |
| CN108200219A (en) * | 2018-03-13 | 2018-06-22 | 广东欧珀移动通信有限公司 | Method of data synchronization, device, server and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111309733A (en) * | 2020-02-20 | 2020-06-19 | 深圳震有科技股份有限公司 | Incremental data extraction processing method and device, computer equipment and medium |
| CN111301317A (en) * | 2020-02-28 | 2020-06-19 | 深圳市元征科技股份有限公司 | Event generation method, event generation device and vehicle-mounted equipment |
| CN112182309A (en) * | 2020-10-06 | 2021-01-05 | 广州云莫凡信息科技有限公司 | Building decoration basic layer industrialized data processing method and system based on building engineering and big data |
| CN112182309B (en) * | 2020-10-06 | 2021-11-19 | 甄义伟 | Building decoration basic layer industrialized data processing method and system based on building engineering and big data |
| CN115357590A (en) * | 2022-08-10 | 2022-11-18 | 中信建投证券股份有限公司 | Recording method and device for data change, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020186786A1 (en) | File processing method and apparatus, computer device and storage medium | |
| CN110290212B (en) | Service call recording method, device, computer equipment and storage medium | |
| CN110765275B (en) | Search method, search device, computer equipment and storage medium | |
| CN110659297A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN108563734B (en) | System information query method, device, computer equipment and storage medium | |
| JP7073576B2 (en) | Association recommendation method, equipment, computer equipment and storage media | |
| CN110209650B (en) | Data normalization and migration method and device, computer equipment and storage medium | |
| CN110990400A (en) | Database query method and device, computer equipment and storage medium | |
| CN108197306B (en) | SQL statement processing method and device, computer equipment and storage medium | |
| CN110598380B (en) | User right management method, device, computer equipment and storage medium | |
| WO2019148712A1 (en) | Phishing website detection method, device, computer equipment and storage medium | |
| CN109783457B (en) | CGI interface management method, device, computer equipment and storage medium | |
| CN110647329A (en) | Code obfuscation method, apparatus, computer device and storage medium | |
| CN112883030A (en) | Data collection method and device, computer equipment and storage medium | |
| CN109325042B (en) | Processing template acquisition method, form processing method, device, equipment and medium | |
| WO2021120628A1 (en) | Blockchain-based sensitive word detection method and apparatus, computer device and computer-readable storage medium | |
| CN112559526A (en) | Data table export method and device, computer equipment and storage medium | |
| CN111083054B (en) | Route configuration processing method and device, computer equipment and storage medium | |
| CN111324375A (en) | Code management method and device, computer equipment and storage medium | |
| CN109656947B (en) | Data query method and device, computer equipment and storage medium | |
| CN111597422A (en) | Buried point mapping method and device, computer equipment and storage medium | |
| CN114327374A (en) | Business process generation method and device and computer equipment | |
| CN111125748A (en) | Judgment method and device for unauthorized query, computer equipment and storage medium | |
| CN110674383B (en) | Public opinion query method, device and equipment | |
| CN110597782B (en) | Database dynamic switching method and device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200131 Address after: 200120 floor 15, 1333 Lujiazui Ring Road, free trade Experimental Zone, Pudong New Area, Shanghai Applicant after: Weikun (Shanghai) Technology Service Co.,Ltd. Address before: 13th Floor, 1333 Lujiazui Ring Road, Shanghai Free Trade Pilot Area, 200120 Applicant before: SHANGHAI LUJIAZUI INTERNATIONAL FINANCIAL ASSETS TRANSACTION MARKET CO.,LTD. |
|
| TA01 | Transfer of patent application right | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200107 |
|
| WD01 | Invention patent application deemed withdrawn after publication |