CN109471851A - Data processing method, device, server and storage medium - Google Patents

Data processing method, device, server and storage medium Download PDF

Info

Publication number
CN109471851A
CN109471851A CN201811208366.2A CN201811208366A CN109471851A CN 109471851 A CN109471851 A CN 109471851A CN 201811208366 A CN201811208366 A CN 201811208366A CN 109471851 A CN109471851 A CN 109471851A
Authority
CN
China
Prior art keywords
data
version information
tables
target journaling
log
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811208366.2A
Other languages
Chinese (zh)
Other versions
CN109471851B (en
Inventor
王攀
郭琰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Dameng Database Co Ltd
Original Assignee
Shanghai Dameng Database Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Dameng Database Co Ltd filed Critical Shanghai Dameng Database Co Ltd
Priority to CN201811208366.2A priority Critical patent/CN109471851B/en
Publication of CN109471851A publication Critical patent/CN109471851A/en
Application granted granted Critical
Publication of CN109471851B publication Critical patent/CN109471851B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The embodiment of the invention discloses a kind of data processing method, device, server and storage mediums, this method comprises: the target journaling prestored in log set is read, target journaling generation when user applies carrying out object run to tables of data;Obtain the initial version information and current version information of tables of data associated by the target journaling;If the initial version information is identical as the current version information, the object run executed to the tables of data is triggered.The embodiment of the present invention can guarantee the accuracy of data processing, avoid tables of data and be destroyed, and improve the efficiency of data processing.

Description

Data processing method, device, server and storage medium
Technical field
The present embodiments relate to database technical field more particularly to a kind of data processing method, device, server and Storage medium.
Background technique
In the database, some operations carried out to tables of data record are not veritably to execute operation at once, but prolong It executes afterwards.Such as delete operation is recorded rollback when user executes and deletes tables of data record operation by data base management system Log, and deletion label is stamped on the tables of data of deletion record, after the user's business for executing delete operation is submitted, by independence Data scrubbing thread recorded according to the rewind journal of system and carry out data scrubbing, that is, real data and delete.
Assuming that an affairs perform the data delete operation an of tables of data and submit, phase is carried out in data scrubbing thread Before closing cleaning operation, if system performs database schema definition statement (the Data Definition of modification data structure Language, DDL), this quasi-sentence usually will cause table structure in the aggregat ion pheromones reconstruction of tables of data and the data dictionary of system Modification, in this way when data scrubbing thread according to the rewind journal of affairs carry out cleaning operation when, due to the rewind journal of parsing It is mismatched with current table structure, the data that cleaning operation may cause tables of data are destroyed, and cause serious consequence.
A kind of existing solution is to force to carry out clearly data before the DDL sentence for executing modification data list structure Reason, but the execution that will lead to DDL sentence in this way to wait data scrubbing it is this it is " slow " operate after just can be carried out, reduce and be Efficiency of uniting and user experience.
Summary of the invention
The embodiment of the invention provides a kind of data processing method, device, server and storage mediums, can solve existing In technology the problem of low efficiency.
In a first aspect, the embodiment of the invention provides a kind of data processing methods, comprising:
The target journaling prestored in log set is read, the target journaling is applied carrying out target behaviour to tables of data in user Make Shi Shengcheng;
Obtain the initial version information and current version information of tables of data associated by the target journaling;
If the initial version information is identical as the current version information, the mesh executed to the tables of data is triggered Mark operation.
Second aspect, the embodiment of the invention also provides a kind of data processing equipment, which includes:
Read module, for reading the target journaling prestored in log set, the target journaling applies for logarithm in user According to generation when table progress object run;
Version module, for obtaining the initial version information and current version letter of tables of data associated by the target journaling Breath;
Operation module triggers execution pair if identical as the current version information for the initial version information The object run of the tables of data.
The third aspect, the embodiment of the invention also provides a kind of server, the server includes:
One or more processors;
Storage device, for storing one or more programs;
When one or more of programs are executed by one or more of processors, so that one or more of processing Device realizes data processing method as described above.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer Program, the program realize data processing method as described above when being executed by processor.
The embodiment of the present invention obtains tables of data associated by target journaling by reading the target journaling prestored in log set Initial version information and current version information, if initial version information is identical as current version information, trigger execution pair The object run of tables of data.Technical solution provided in an embodiment of the present invention is that tables of data is added to version information, the version information Change with the modification of tables of data, allows and identify the tables of data modified without behaviour when tables of data is executed and operated Make, guarantees the accuracy of data processing, avoid tables of data and be destroyed, improve the efficiency of data processing.
Detailed description of the invention
Fig. 1 is the flow chart for the data processing method that the embodiment of the present invention one provides;
Fig. 2 is the flow chart of data processing method provided by Embodiment 2 of the present invention;
Fig. 3 is the preferable example for the data processing method that the embodiment of the present invention three provides;
Fig. 4 is the structural schematic diagram for the data processing equipment that the embodiment of the present invention four provides;
Fig. 5 is the structural schematic diagram for the server that the embodiment of the present invention five provides.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
Embodiment one
Fig. 1 is the flow chart for the data processing method that the embodiment of the present invention one provides, and the present embodiment is applicable to database The case where middle data processing, this method can be executed by data processing equipment, which can use the side of software and/or hardware Formula is realized, for example, the device is configured in server.This method can specifically include:
S110, reading prestore the target journaling in log set, and target journaling is applied carrying out target to tables of data in user It is generated when operation.
Wherein, the set that log set is target journaling in database is prestored, can be the log of an entity, it can also be with It is the virtual set of target journaling in an entity log.Target journaling is when user's application carries out object run to tables of data It generates, object run is not need to be immediately performed the operation for needing to delay execution, the concrete type sheet of object run in database In embodiment without limitation, such as object run can be deletion or logic analysis.It is corresponding, if user's present application logarithm When carrying out object run according to table, corresponding target journaling is generated, in the target journaling and non-memory user is complete to tables of data At operation, but store the operation that will carry out to tables of data of user.When the type of object run is not construed as limiting, target day The type of will is also not construed as limiting, but corresponding with object run.It is carried out so that object run is delete operation as an example in the present embodiment Explanation.
Optionally, it reads and prestores target journaling in log set, comprising: with setting time interval from prestoring log set The a collection of target journaling of middle acquisition is simultaneously handled one by one.Wherein, setting time interval, which can according to need, is configured.If data When there is the target journaling for needing to enforce in library, then the setting time interval can also be not provided with.
S120, the initial version information and current version information for obtaining tables of data associated by target journaling.
In the present embodiment, the attribute of each tables of data in database can increase the attribute of a version information, the category In the data dictionary that property is recorded in database together with other metadata informations of tables of data.Each tables of data in data dictionary Version information can be generated in database update, user can also carry out Shen for the first time to each tables of data after database update It please be generated when object run.When execution database schema definition statement (Data Definition Language, DDL) is to data When table structure is modified, the corresponding version information of the tables of data is changed, such as plus one.
Obtain the current version information of tables of data associated by target journaling, comprising: the ID based on tables of data, from database The second edition information of tables of data is obtained in data dictionary, and is denoted as current version information.
Wherein, in the present embodiment by the way of a newly-increased version log, then the type of target journaling may include behaviour Make log and version log, operation log and the version log generation when user applies carrying out object run to tables of data respectively, Correspondingly, before the initial version information and current version information of tables of data associated by acquisition target journaling, further includes: judge mesh Whether the type for marking log is operation log, if the type of target journaling is operation log, executes acquisition target journaling and is closed Join the initial version information and current version information of tables of data.
Operation log is used to execute the object run of tables of data, and version log is a kind of log class increased newly in the present embodiment Type, for storing the version information of the tables of data, the record content format of such log are as follows: Log Types, tables of data ID and The version information of tables of data.When user's application carries out object run to tables of data, generates operation log and may determine that data Version information in the data dictionary in library with the presence or absence of the tables of data then registers the version information of the tables of data if it does not exist, and It is stored in the data dictionary of database and build version log;If it exists, then the version information of the tables of data is read, version is generated This log.Illustratively, when object run is to delete, operation log, that is, rewind journal is generated, rewind journal can be used for counting According to cleaning and data rewind, according to the version information build version log of the tables of data.Increase a kind of log class in the present embodiment newly Type with storage version information, allow data processing when it is backward compatible, compatibility is stronger.
It is read one by one due to reading target journaling, when having increased version log newly, needs to identify target journaling Type, can specifically pass through and read the value of field corresponding to version information in Log Types and realize.If the type of target journaling For operation log, then the initial version information and current version information for obtaining tables of data associated by target journaling are executed;If target The type of log is version log, then does nothing.
Optionally, the initial version information of tables of data associated by target journaling is obtained, comprising: the ID based on tables of data is obtained The third version information in version log is taken, and third version information is denoted as initial version information.
If S130, initial version information are identical as current version information, the object run executed to tables of data is triggered.
Specifically, if initial version information is identical as current version information, then it represents that do not modify tables of data, triggering Execute the object run to tables of data;If initial version information is different from current version information, then it represents that user applies for logarithm Carry out thering is DDL to carry out table structure modification to the tables of data after object run according to table, since table structure is modified and being incited somebody to action The aggregat ion pheromones of tables of data are rebuild, and are not needed to carry out object run to tables of data again, are returned to the reading of performance objective log Operation.
The technical solution of the present embodiment obtains target journaling and is closed by reading the target journaling prestored in log set The initial version information and current version information for joining tables of data are touched if initial version information is identical as current version information Hair executes the object run to tables of data.Technical solution provided in this embodiment increases the new version log of one kind for storing Version information, and it is added to version information for tables of data, which changes with the modification of tables of data, so that logarithm Executed according to table when operating can according in version log version information and current version information identify the tables of data modified, into And without operation, guarantee the accuracy of data processing, avoiding tables of data is destroyed, and improves the efficiency of data processing.
Embodiment two
Fig. 2 is the flow chart of data processing method provided by Embodiment 2 of the present invention.The present embodiment is in above-described embodiment On the basis of, advanced optimize above-mentioned data processing method.Correspondingly, the method for the present embodiment specifically includes:
S210, reading prestore the target journaling in log set, and target journaling is applied carrying out target to tables of data in user It is generated when operation.
Optionally, it reads and prestores target journaling in log set, comprising: with setting time interval from prestoring log set The a collection of target journaling of middle acquisition is simultaneously handled one by one.
First version information in S220, extraction target journaling, and first version information is denoted as initial version information.
In the present embodiment, new contents attribute, i.e. version information, mesh are increased in the record content in the target journaling The type of mark log is only the log that user applies for carrying out tables of data generation when object run, does not include that other in database are grasped The log of work.The attribute of each tables of data in database increases its of the attribute of a version information, the attribute and tables of data He is recorded in the data dictionary of database metadata information together.The version information of each tables of data can be in data dictionary It is generated when database update, it can also generation when each tables of data generates target journaling for the first time after database update.Work as execution When database schema definition statement (Data Definition Language, DDL) modifies to data list structure, the data The corresponding version information of table is changed, such as plus one.
When user's application carries out object run to tables of data, judge in the data dictionary of database with the presence or absence of the data The version information of table then registers the version information of the tables of data if it does not exist, and is stored in the data dictionary of database and gives birth to At the target journaling including version information;If it exists, then the version information of the tables of data is read, and generating includes version information Target journaling.
First version information is the version information in target journaling, extracts the first version information, and is denoted as initial Version information.
S230, the ID based on tables of data, obtain the second edition information of tables of data from the data dictionary of database, and remember For current version information.
If S240, initial version information are identical as current version information, the object run executed to tables of data is triggered.
Specifically, if initial version information is identical as current version information, then it represents that do not modify tables of data, triggering Execute the object run to tables of data.
If S250, initial version information are different from current version information, the reading for executing next target journaling is returned Extract operation.
If initial version information is different from current version information, then it represents that user's application carries out object run to tables of data There is DDL to carry out table structure modification to the tables of data later, it can be by the aggregat ion pheromones of tables of data due to modifying to table structure It is rebuild, is not needed to carry out object run to tables of data again, return to the read operation of performance objective log.
The technical solution of the present embodiment obtains target journaling and is closed by reading the target journaling prestored in log set The initial version information and current version information for joining tables of data are touched if initial version information is identical as current version information Hair executes the object run to tables of data.Technical solution provided in this embodiment increases in version information in target journaling Hold, and be added to version information for tables of data, which changes with the modification of tables of data, so that holding to tables of data When row operation can according in target journaling version information and current version information identify the tables of data modified, and then not into Row operation, guarantees the accuracy of data processing, avoids tables of data and be destroyed, improve the efficiency of data processing.
Embodiment three
Fig. 3 is the preferable example for the data processing method that the embodiment of the present invention three provides.The present embodiment above-mentioned can be implemented Based on example, data processing method is illustratively described so that object run is delete operation as an example.
In the present embodiment, tables of data version information array, Ke Yi can be increased in the internal storage structure of db transaction The version information of the tables of data operated in the affairs is stored in version information array.The transaction internal memory structure of database is database The internal storage structure created when an affairs start, when in order to have version information in tables of data version information array, no It needs to be obtained from database data dictionary, improve efficiency.Each affairs have its corresponding log buffer area, for interim The corresponding log of each operation executed in store transaction.
According to the mode of a newly-increased version log, target journaling includes rewind journal and version log.When in affairs When executing delete operation, the version of the existing tables of data is first searched whether in the tables of data version information array of Current transaction Information, if it does not exist, then the ID based on the tables of data obtains the version information of the tables of data in data dictionary, and generates a version This log storage is stored in tables of data version information array to the log buffer area of affairs, and by table id and version information;If In the presence of then illustrating the existing version log in log buffer area of affairs, the generation without version log.This is regenerated later to delete Except the corresponding rewind journal of operation.When a transaction commits, the rewind journal and version log in the corresponding log buffer area of the affairs It can be written in the roll-back segment (prestoring log set) of system.
According to the mode for increasing version information content newly in target journaling, target journaling is only rewind journal.Then data It does not need to increase tables of data version information array in the internal storage structure of library affairs.
Specifically, Fig. 3 is the flow chart that the data in the embodiment of the present invention three are deleted, using a newly-increased version referring to Fig. 3 The mode of this log, data are deleted process and are specifically included:
S301, data scrubbing thread are started to work.
After the user's business for executing delete operation is submitted, by independent data scrubbing thread according to prestoring log set Target journaling carry out data scrubbing, that is, real data and delete.
S302, a data scrubbing internal storage structure is generated.
Data scrubbing thread can be obtained sequentially and affairs pair are each completed in roll-back segment when executing data scrubbing work The target journaling answered is handled, and generates a data scrubbing internal storage structure to assist carrying out cleaning work, and a data are clear Reason internal storage structure corresponds to multiple data scrubbing work that affairs are completed.
S303, whether all target journalings that affairs are completed are processed finishes.If so, executing S304;If it is not, then holding Row S305.
S304, end.
S305, sequence obtain the target journaling that affairs are completed.Wherein, target journaling includes rewind journal and version Log two types.
Whether S306, target journaling are version log.If so, executing S311;If it is not, then executing S307.
S307, the initial version information and current version information for obtaining tables of data.
It, should according to what is stored in the ID of tables of data acquisition data scrubbing internal storage structure when the target journaling is rewind journal The version information of tables of data is denoted as initial version information, and the version information of the tables of data in the data dictionary of database is current Version information.
Whether S308, initial version information and current version information are identical.If it is different, then executing S309;If they are the same, then it holds Row S310.
S309, rewind journal is skipped;
S310, the delete operation for executing rewind journal.
If target journaling is version log, does not need to carry out object run, but need to data scrubbing memory knot Version information in structure is replaced, and detailed process includes:
Whether the version information of the tables of data is registered in S311, data scrubbing internal storage structure.
When data scrubbing thread process is to version log, the ID based on tables of data judge be in data scrubbing internal storage structure The version information of the tables of data is preserved before no, if so, S312 is executed, if it is not, then executing S314.
Whether S312, the version information and the version information in version log are consistent.If so, executing S303;If it is not, then Execute S313.
S313, the version information being revised as the version information in version log.
If the version information in version information and version log in data scrubbing internal storage structure is inconsistent, before busy Business executed delete operation to the tables of data, and had DDL to carry out table structure modification to the tables of data later, then was based on tables of data ID the version information in data scrubbing internal storage structure is revised as to the version information in version log.
S314, the version information in data scrubbing internal storage structure in registration version log.
If not preserving the version information of the tables of data in data scrubbing internal storage structure also, by the version in version log The ID of information and tables of data is registered in data scrubbing internal storage structure, then executes S303.
It is understood that it is to execute one that data deletion constructs to put down that data scrubbing internal storage structure, which is in the present embodiment, Platform, the platform can not also be constructed when data deletion by, which carrying out in database, is directly deleted.
The technical solution of the present embodiment carries out data processing method so that object run is delete operation as an example illustrative Description further illustrates and is judged by the initial version information of tables of data and the consistency of current version information, so that logarithm It can identify that the tables of data modified without operation, guarantees the accuracy of data processing, avoids number when executing and operate according to table It is destroyed according to table, improves the efficiency of data processing.
Example IV
Fig. 4 is the structural schematic diagram for the data processing equipment that the embodiment of the present invention four provides, and the present embodiment is applicable to count According in library the case where data processing.Any embodiment of that present invention institute can be performed in data processing equipment provided by the embodiment of the present invention The data processing method of offer has the corresponding functional module of execution method and beneficial effect.The device specifically includes reading mould Block 410, Version module 420 and operation module 430, in which:
Read module 410, for reading the target journaling prestored in log set, target journaling is applied in user to data Table carries out generation when object run;
Version module 420, for obtaining the initial version information and current version information of tables of data associated by target journaling;
Operation module 430 triggers execution to tables of data if identical as current version information for initial version information Object run.
The technical solution of the present embodiment obtains target journaling and is closed by reading the target journaling prestored in log set The initial version information and current version information for joining tables of data are touched if initial version information is identical as current version information Hair executes the object run to tables of data.Technical solution provided in an embodiment of the present invention is that tables of data is added to version information, should Version information changes with the modification of tables of data, and the tables of data modified is identified when allowing to tables of data execution operation not It is operated, guarantees the accuracy of data processing, avoided tables of data and be destroyed, improve the efficiency of data processing.
Optionally, the device further include:
If return module returns to performance objective log different from current version information for initial version information Read operation.
It optionally, include the version information of associated tables of data in target journaling;Correspondingly, Version module includes:
Initial version unit is denoted as just for extracting the first version information in target journaling, and by first version information Beginning version information;
Current version unit obtains the second of tables of data for the ID based on tables of data from the data dictionary of database Version information, and it is denoted as current version information.
Optionally, the type of target journaling includes operation log and version log, and operation log and version log exist respectively Generation when user's application is to tables of data progress object run, correspondingly, the device further include:
Judgment module, for obtain tables of data associated by target journaling initial version information and current version information it Before, judge whether the type of target journaling is operation log, if the type of target journaling is operation log, executes acquisition target The initial version information and current version information of tables of data associated by log.
It optionally, include the version information of tables of data in version log, correspondingly, Version module is used for: being based on tables of data ID, obtain the third version information in version log, and third version information be denoted as initial version information.
Data processing equipment provided by the embodiment of the present invention can be performed at data provided by any embodiment of the invention Reason method has the corresponding functional module of execution method and beneficial effect.
Embodiment five
Fig. 5 is the structural schematic diagram for the server that the embodiment of the present invention five provides.Fig. 5, which is shown, to be suitable for being used to realizing this hair The block diagram of the exemplary servers 512 of bright embodiment.The server 512 that Fig. 5 is shown is only an example, should not be to this hair The function and use scope of bright embodiment bring any restrictions.
As shown in figure 5, server 512 is showed in the form of generic server.The component of server 512 may include but not Be limited to: one or more processor 516, storage device 528 connect different system components (including storage device 528 and processing Device 516) bus 518.
Bus 518 indicates one of a few class bus structures or a variety of, including storage device bus or storage device control Device processed, peripheral bus, graphics acceleration port, processor or total using the local of any bus structures in a variety of bus structures Line.For example, these architectures include but is not limited to industry standard architecture (Industry Subversive Alliance, ISA) bus, microchannel architecture (Micro Channel Architecture, MAC) bus is enhanced Isa bus, Video Electronics Standards Association (Video Electronics Standards Association, VESA) local are total Line and peripheral component interconnection (Peripheral Component Interconnect, PCI) bus.
Server 512 typically comprises a variety of computer system readable media.These media can be it is any being capable of bedding and clothing The usable medium that business device 512 accesses, including volatile and non-volatile media, moveable and immovable medium.
Storage device 528 may include the computer system readable media of form of volatile memory, such as arbitrary access Memory (Random Access Memory, RAM) 530 and/or cache memory 532.Server 512 can be further Including other removable/nonremovable, volatile/non-volatile computer system storage mediums.Only as an example, storage system System 534 can be used for reading and writing immovable, non-volatile magnetic media (Fig. 5 do not show, commonly referred to as " hard disk drive ").To the greatest extent It is not shown in pipe Fig. 5, the disc driver for reading and writing to removable non-volatile magnetic disk (such as " floppy disk ") can be provided, with And to removable anonvolatile optical disk, such as CD-ROM (Compact Disc Read-Only Memory, CD-ROM), number Word optic disk (Digital Video Disc-Read Only Memory, DVD-ROM) or other optical mediums) read-write CD Driver.In these cases, each driver can be connected by one or more data media interfaces with bus 518. Storage device 528 may include at least one program product, which has one group of (for example, at least one) program module, These program modules are configured to perform the function of various embodiments of the present invention.
Program/utility 540 with one group of (at least one) program module 542 can store in such as storage dress It sets in 528, such program module 542 includes but is not limited to operating system, one or more application program, other program moulds It may include the realization of network environment in block and program data, each of these examples or certain combination.Program module 542 usually execute function and/or method in embodiment described in the invention.
Server 512 can also be with one or more external equipments 514 (such as keyboard, direction terminal, display 524 etc.) Communication, can also be enabled a user to one or more terminal interact with the server 512 communicate, and/or with make the clothes Any terminal (such as network interface card, modem etc.) that business device 512 can be communicated with one or more of the other computing terminal Communication.This communication can be carried out by input/output (I/O) interface 522.Also, server 512 can also be suitable by network Orchestration 520 and one or more network (such as local area network (Local Area Network, LAN), wide area network (Wide Area Network, WAN) and/or public network, such as internet) communication.As shown in figure 5, network adapter 520 passes through bus 518 It is communicated with other modules of server 512.It should be understood that although not shown in the drawings, can be used in conjunction with server 512 other hard Part and/or software module, including but not limited to: microcode, terminal driver, redundant processor, external disk drive array, magnetic Disk array (Redundant Arrays of Independent Disks, RAID) system, tape drive and data backup Storage system etc..
The program that processor 516 is stored in storage device 528 by operation, thereby executing various function application and number According to processing, such as realize data processing method provided by the embodiment of the present invention, this method comprises:
The target journaling prestored in log set is read, target journaling is when user applies carrying out object run to tables of data It generates;
Obtain the initial version information and current version information of tables of data associated by target journaling;
If initial version information is identical as current version information, the object run executed to tables of data is triggered.
Embodiment six
The embodiment of the present invention six additionally provides a kind of computer readable storage medium, is stored thereon with computer program, should The data processing method as provided by the embodiment of the present invention is realized when program is executed by processor, this method comprises:
The target journaling prestored in log set is read, target journaling is when user applies carrying out object run to tables of data It generates;
Obtain the initial version information and current version information of tables of data associated by target journaling;
If initial version information is identical as current version information, the object run executed to tables of data is triggered.
The computer storage medium of the embodiment of the present invention, can be using any of one or more computer-readable media Combination.Computer-readable medium can be computer-readable signal media or computer readable storage medium.It is computer-readable Storage medium for example may be-but not limited to-the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device or Device, or any above combination.The more specific example (non exhaustive list) of computer readable storage medium includes: tool There are electrical connection, the portable computer diskette, hard disk, random access memory (RAM), read-only memory of one or more conducting wires (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD- ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer-readable storage Medium can be any tangible medium for including or store program, which can be commanded execution system, device or device Using or it is in connection.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for By the use of instruction execution system, device or device or program in connection.
The program code for including on computer-readable medium can transmit with any suitable medium, including --- but it is unlimited In wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
The computer for executing operation of the present invention can be write with one or more programming languages or combinations thereof Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++, It further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion Divide and partially executes or executed on remote computer or terminal completely on the remote computer on the user computer.It is relating to And in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or extensively Domain net (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as provided using Internet service Quotient is connected by internet).
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation, It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.

Claims (10)

1. a kind of data processing method characterized by comprising
The target journaling prestored in log set is read, the target journaling is when user applies carrying out object run to tables of data It generates;
Obtain the initial version information and current version information of tables of data associated by the target journaling;
If the initial version information is identical as the current version information, triggers to execute and the target of the tables of data is grasped Make.
2. the method according to claim 1, wherein obtaining the initial version of tables of data associated by the target journaling After this information and current version information, further includes:
If the initial version information is different from the current version information, the reading for executing next target journaling is returned Operation.
3. the method according to claim 1, wherein including the version of associated tables of data in the target journaling Information;
Correspondingly, obtaining the initial version information and current version information of tables of data associated by the target journaling, comprising:
The first version information in the target journaling is extracted, and the first version information is denoted as initial version information;
The ID of table based on the data, obtains the second edition information of the tables of data from the data dictionary of database, and remembers For current version information.
4. the method according to claim 1, wherein the type of the target journaling includes operation log and version The generation when user applies carrying out object run to tables of data respectively of log, the operation log and the version log,
Correspondingly, also being wrapped before the initial version information and current version information that obtain tables of data associated by the target journaling It includes:
Whether the type for judging the target journaling is the operation log, if the type of the target journaling is the operation day Will then executes the initial version information and current version information for obtaining tables of data associated by the target journaling.
5. according to the method described in claim 4, it is characterized in that, the version in the version log including the tables of data is believed Breath,
Correspondingly, obtaining the initial version information of tables of data associated by the target journaling, comprising:
The ID of table based on the data, obtains the third version information in the version log, and by the third version information It is denoted as initial version information.
6. a kind of data processing equipment characterized by comprising
Read module, for reading the target journaling prestored in log set, the target journaling is applied in user to tables of data Carry out generation when object run;
Version module, for obtaining the initial version information and current version information of tables of data associated by the target journaling;
Operation module triggers execution to described if identical as the current version information for the initial version information The object run of tables of data.
7. device according to claim 6, which is characterized in that further include:
Return module returns to performance objective day if different from the current version information for the initial version information The read operation of will.
8. device according to claim 6, which is characterized in that include the version of associated tables of data in the target journaling Information;Correspondingly, Version module includes:
Initial version unit is remembered for extracting the first version information in the target journaling, and by the first version information For initial version information;
Current version unit obtains the tables of data for the ID of table based on the data from the data dictionary of database Second edition information, and it is denoted as current version information.
9. a kind of server, which is characterized in that the server includes:
One or more processors;
Storage device, for storing one or more programs;
When one or more of programs are executed by one or more of processors, so that one or more of processors are real Now such as data processing method as claimed in any one of claims 1 to 5.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor Such as data processing method as claimed in any one of claims 1 to 5 is realized when execution.
CN201811208366.2A 2018-10-17 2018-10-17 Data processing method, device, server and storage medium Active CN109471851B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811208366.2A CN109471851B (en) 2018-10-17 2018-10-17 Data processing method, device, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811208366.2A CN109471851B (en) 2018-10-17 2018-10-17 Data processing method, device, server and storage medium

Publications (2)

Publication Number Publication Date
CN109471851A true CN109471851A (en) 2019-03-15
CN109471851B CN109471851B (en) 2021-05-28

Family

ID=65664698

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811208366.2A Active CN109471851B (en) 2018-10-17 2018-10-17 Data processing method, device, server and storage medium

Country Status (1)

Country Link
CN (1) CN109471851B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110059096A (en) * 2019-03-16 2019-07-26 平安城市建设科技(深圳)有限公司 Data version management method, apparatus, equipment and storage medium
CN110955539A (en) * 2019-11-26 2020-04-03 杭州迪普信息技术有限公司 Process quitting method and device, electronic equipment and machine-readable storage medium
CN111090663A (en) * 2019-12-25 2020-05-01 上海金仕达软件科技有限公司 Transaction concurrency control method, device, terminal equipment and medium
CN111666166A (en) * 2020-06-03 2020-09-15 中国建设银行股份有限公司 Service providing method, device, equipment and storage medium
CN113111071A (en) * 2021-05-11 2021-07-13 星辰天合(北京)数据科技有限公司 Object processing method, device, nonvolatile storage medium and processor
CN114253944A (en) * 2021-12-16 2022-03-29 深圳壹账通科技服务有限公司 Database bidirectional synchronization method and device and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102651024A (en) * 2012-04-01 2012-08-29 华为技术有限公司 Method and device for data conversion
CN104217174A (en) * 2014-09-05 2014-12-17 四川长虹电器股份有限公司 Safety storage system and safety storage method for distributed files
CN104301360A (en) * 2013-07-19 2015-01-21 阿里巴巴集团控股有限公司 Method, log server and system for recording log data
CN106528557A (en) * 2015-09-10 2017-03-22 北京国双科技有限公司 Method and device for detecting data rows deleted from data table
CN106708427A (en) * 2016-11-17 2017-05-24 华中科技大学 Storage method suitable for key value pair data
CN107766354A (en) * 2016-08-17 2018-03-06 阿里巴巴集团控股有限公司 A kind of method and apparatus for being used to ensure data correctness

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102651024A (en) * 2012-04-01 2012-08-29 华为技术有限公司 Method and device for data conversion
CN104301360A (en) * 2013-07-19 2015-01-21 阿里巴巴集团控股有限公司 Method, log server and system for recording log data
CN104217174A (en) * 2014-09-05 2014-12-17 四川长虹电器股份有限公司 Safety storage system and safety storage method for distributed files
CN106528557A (en) * 2015-09-10 2017-03-22 北京国双科技有限公司 Method and device for detecting data rows deleted from data table
CN107766354A (en) * 2016-08-17 2018-03-06 阿里巴巴集团控股有限公司 A kind of method and apparatus for being used to ensure data correctness
CN106708427A (en) * 2016-11-17 2017-05-24 华中科技大学 Storage method suitable for key value pair data

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110059096A (en) * 2019-03-16 2019-07-26 平安城市建设科技(深圳)有限公司 Data version management method, apparatus, equipment and storage medium
CN110955539A (en) * 2019-11-26 2020-04-03 杭州迪普信息技术有限公司 Process quitting method and device, electronic equipment and machine-readable storage medium
CN111090663A (en) * 2019-12-25 2020-05-01 上海金仕达软件科技有限公司 Transaction concurrency control method, device, terminal equipment and medium
CN111090663B (en) * 2019-12-25 2023-07-07 上海金仕达软件科技股份有限公司 Transaction concurrency control method, device, terminal equipment and medium
CN111666166A (en) * 2020-06-03 2020-09-15 中国建设银行股份有限公司 Service providing method, device, equipment and storage medium
CN111666166B (en) * 2020-06-03 2023-10-31 中国建设银行股份有限公司 Service providing method, device, equipment and storage medium
CN113111071A (en) * 2021-05-11 2021-07-13 星辰天合(北京)数据科技有限公司 Object processing method, device, nonvolatile storage medium and processor
CN114253944A (en) * 2021-12-16 2022-03-29 深圳壹账通科技服务有限公司 Database bidirectional synchronization method and device and electronic equipment

Also Published As

Publication number Publication date
CN109471851B (en) 2021-05-28

Similar Documents

Publication Publication Date Title
CN109471851A (en) Data processing method, device, server and storage medium
CN108427728A (en) Management method, equipment and the computer-readable medium of metadata
CN108664359A (en) A kind of database restoring method, device, equipment and storage medium
WO2020119099A1 (en) Service rule processing method, server, and computer readable storage medium
WO2019161645A1 (en) Shell-based data table extraction method, terminal, device, and storage medium
JP2020017272A (en) Method, apparatus, server, and storage medium for picture retrieval
CN107832448A (en) Database operation method, device and equipment
CN109815147A (en) Test cases generation method, device, server and medium
CN112231407B (en) DDL synchronization method, device, equipment and medium of PostgreSQL database
CN110443690A (en) A kind of method, apparatus, server and the storage medium of variance data reconciliation
CN108334491B (en) Text analysis method and device, computing equipment and storage medium
CN113962597A (en) Data analysis method and device, electronic equipment and storage medium
US11017015B2 (en) System for creating interactive media and method of operating the same
CN109561212A (en) A kind of merging method of release information, device, equipment and storage medium
CN109086110A (en) A kind of display methods of business information, device, terminal and storage medium
US9898282B2 (en) Automatic comment creation for computer files
US8826253B2 (en) Delayed insertion of safepoint-related code
CN112970011A (en) Recording pedigrees in query optimization
CN110443062A (en) Operating method, device and the computer equipment of multi-tenant database
US8898625B2 (en) Optimized storage of function variables
US9201937B2 (en) Rapid provisioning of information for business analytics
US20220335070A1 (en) Method and apparatus for querying writing material, and storage medium
CN105760456A (en) Method and device for maintaining data consistency
CN116360735A (en) Form generation method, device, equipment and medium
CN109241164A (en) A kind of data processing method, device, server and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant