CN104615759A - Data synchronization method for different business system platforms - Google Patents
Data synchronization method for different business system platforms Download PDFInfo
- Publication number
- CN104615759A CN104615759A CN201510078748.8A CN201510078748A CN104615759A CN 104615759 A CN104615759 A CN 104615759A CN 201510078748 A CN201510078748 A CN 201510078748A CN 104615759 A CN104615759 A CN 104615759A
- Authority
- CN
- China
- Prior art keywords
- data
- synchronous
- record
- operation system
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The invention provides a data synchronization method for different business system platforms. The method includes: establishing an intermediate synchronization database which is used for defining and storing data formats, data contents, synchronous abnormal data records and synchronous working timestamps needing to be synchronized for different business systems; when synchronizing the data, a synchronization service program reading the data from the business systems to write in the intermediate synchronization database, or reading the data from the intermediate synchronization database to write in the respective business systems, and during synchronization, the synchronization service program providing regular operation and data synchronization error correction according to the synchronous working timestamp. By establishment of the intermediate synchronization database with the timestamps and regulation of definition of the synchronous data, interfaces are determined, and application range is free from limitation of interface explanations.
Description
Technical field
The present invention relates to a kind of method of data synchronization, the method for data synchronization particularly between a kind of different business systems platform.
Background technology
Along with the development of modern information technologies, enterprise is also improving constantly, in the Process of Information of enterprise the degree of recognition realizing information system management, according to the demand of self, introduce corresponding information system application platform, improve enterprise information management degree, enterprise management level.There is certain correlativity in the direct data of these systems, partial service data may need synchronously to share in multiple system, and these data storage organization in different system is not necessarily identical, there is data structure and the expression way of isomery.How ensureing that the data between different system accomplish data consistency, the real-time of data syn-chronization, reduce the coupling of mathematical logic between different system, is the difficult point of data syn-chronization.
Traditional synchronous method is by setting up interactive interface between different system, such as: the modes such as restApi, dynamic base interface, database access interface.But the problems such as which existence and system, coupled degree height, are unfavorable for developer's concurrent working simultaneously of the different isomerization system developed, different team.
Disclosed in 2011-07-20, publication number is that the Chinese invention of 102129478A discloses a kind of database synchronization method, the method comprises: catch in real time the change information of data in source database and affairs corresponding to this data variation, and be saved in target database by the change information captured and affairs; Determine to need synchronous target database according to the change information preserved in source database; Described change information is converted to the target data of corresponding described target database; All target datas of same for correspondence affairs are updated in described target database simultaneously.It can realize the data syn-chronization between dissimilar database and heterogeneous data table, reduces synchronizing process to the consumption of system resource, ensures the reliability of synchronizing process.But what this invention adopted is generate in synchronous side to want synchronous sql statement to perform to the system of the other side, need the interface specification understanding the other side, both sides' synchronizing process needs to transform respective system database, coupling is high, and be not suitable between many cover systems simultaneously synchronous, because which limit its range of application.
Summary of the invention
The technical problem to be solved in the present invention, be to provide the method for data synchronization between a kind of operation system platform and system, carry out synchronously to the business datum between different system, by setting up intermediate database, and bring timestamp, the rule of synchrodata is known in definition simultaneously, is equivalent to specify that interface, range of application not by the restriction of interface specification, and can adapt to for data syn-chronization between many cover systems.
Method of data synchronization between different business systems platform of the present invention is achieved in that setting up synchronous intermediate database needs synchronous data layout, data content, synchronous abnormality data record, synchronous working timestamp in order to definition, preservation different business systems both sides; During synchrodata, synchronous service program reads data from operation system and writes synchronous intermediate database, or read data from synchronous mid-ambles database and write respective operation system, and in synchronizing process, synchronous service program also provides timing operation and data syn-chronization correction process according to synchronous working timestamp.
Further, described data layout and data content are represented by base data table and business datum table, and described synchronous abnormality data record is represented by failure record table, and described synchronous working timestamp is represented by running time table; This base data table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of basic data recorded information form; This business datum table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of business datum recorded information form; Described failure record table is by failure operation id, and Service Database id, Sql statement, the failure execution time, performs these fields of number of times composition; Described running time table is by timestamp Record ID, and Service Database ID, the last operation time, these fields of synchronous scanning interval form.
Further, described synchronizing process is as follows: first initialization operation timetable, be initialized as the initial time, setting synchronous scanning interval, guarantee the data synchronously covering needs, synchronous service program is according to the synchronous scanning interval in running time table in corresponding record, and time opening synchronous operation, then carries out reading data from operation system and write the process of synchronous intermediate database and synchronous service program reads from synchronous intermediate database the process that data write respective operation system.
Further, describedly read from operation system the process that data write synchronous intermediate database and comprise:
Step 11, last operation time according to the Service Database record in operation system corresponding in synchrodata record, scannedly in this Service Database leach vicissitudinous basic data and business datum after this timestamp, record this timestamp value;
Step 12, according to business successively logical relation, take out wherein each data set, carry out synchronous operation;
Step 13, take out record one by one in data centralization, judge this record be newly-increased record, retouching operation, deletion action any:
If newly-increased record, then " the operation system data id " of this record, modification time and concrete data record are inserted in the table of synchronous intermediate database, and " data markers " is masked as newly-increased mark;
If retouching operation, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", this record is made an amendment, amendment " modification time " field information, and " data markers " is masked as amendment mark;
If deletion action, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", amendment " modification time " field information, and " data markers " is masked as delete flag;
Step 14, repetition step 11 ~ 13, carry out synchronous operation by the business datum in the basic data in base data table, business datum table one by one, thus data syn-chronization operation system upgraded is to synchronous intermediate database.
Further, the process that described synchronous service program writes respective operation system from synchronous intermediate database reading data comprises:
Step 21, last operation time according to the Service Database record in operation system corresponding in synchrodata record, in time range to the timestamp that current time generates, scannedly in this synchronous intermediate database leach this time period vicissitudinous basic data and business datum, record this timestamp value;
Step 22, according to business successively logical relation, take out wherein each data set, take out data record one by one in data centralization, according to record operation " data markers ", carry out respective synchronization operation:
If newly-increased operation, then the modification time of this record and concrete data record are taken out, be inserted in the table of corresponding service database, and upgrade " operation system data id " field information of the table of synchronous intermediate database.
If retouching operation, according to " operation system data id " value, the value of respective record is revised in operation system, if operation system data id does not exist, then be used as newly-increased, in operation system, increase this record, and return the value of " the operation system data id " of the table revising synchronous intermediate database;
If deletion action, according to " operation system data id " value, in corresponding service system, delete corresponding record value;
Step 23, repetition step 21 ~ 22, carry out synchronous operation, until synchronously complete by basic data, business datum one by one.
Further, described newly-increased record, retouching operation, deletion action all adopt the mode generating corresponding sql statement to pass to other one end (if operation system is synchronized to middle database, then one end refers to intermediate database in addition, if instead be that middle database data are to operation system, then the other end refers to operation system database) perform, if operation failure, then the sql' statement of corresponding operating is stored in described failure record table, system detects the operation of execute exception operation failure by timing in independent thread, and timing re-executes.
Further, the method is used for carrying out between multiple operation system synchronous, time synchronous, needs synchronous data to write in synchronous intermediate database by arriving first in each operation system to read, then from synchronous intermediate database, reads data write in each operation system.
Further, in long-range synchronous operation system, increase webservice service at operation system end, this webservice service encapsulates database manipulation service interface of local service system, is then supplied to synchronous service routine call.
Data synchronous system between different business systems platform of the present invention is achieved in that the data synchronous system between this different business systems platform comprises: synchronous intermediate database, synchronous data layout, data content is needed, synchronous abnormality data record, synchronous working timestamp in order to definition, preservation different business systems both sides; Synchronous service program, during synchrodata, read data from operation system and write synchronous intermediate database, or read data from synchronous mid-ambles database and write respective operation system, and in synchronizing process, synchronous service program also provides timing operation and data syn-chronization correction process according to synchronous working timestamp.
Further, described data layout and data content are represented by base data table and business datum table, and described synchronous abnormality data record is represented by failure record table, and described synchronous working timestamp is represented by running time table; This base data table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of basic data recorded information form; This business datum table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of business datum recorded information form; Described failure record table is by failure operation id, and Service Database id, Sql statement, the failure execution time, performs these fields of number of times composition; Described running time table is by timestamp Record ID, and Service Database ID, the last operation time, these fields of synchronous scanning interval form.
Further, described synchronizing process is as follows: first initialization operation timetable, be initialized as the initial time, setting synchronous scanning interval, guarantee the data synchronously covering needs, synchronous service program is according to the synchronous scanning interval in running time table in corresponding record, and time opening synchronous operation, then carries out reading data from operation system and write the process of synchronous intermediate database and synchronous service program reads from synchronous intermediate database the process that data write respective operation system.
Further, describedly read from operation system the process that data write synchronous intermediate database and comprise:
Step 11, last operation time according to the Service Database record in operation system corresponding in synchrodata record, scannedly in this Service Database leach vicissitudinous basic data and business datum after this timestamp, record this timestamp value;
Step 12, according to business successively logical relation, take out wherein each data set, carry out synchronous operation;
Step 13, take out record one by one in data centralization, judge this record be newly-increased record, retouching operation, deletion action any:
If newly-increased record, then " the operation system data id " of this record, modification time and concrete data record are inserted in the table of synchronous intermediate database, and " data markers " is masked as newly-increased mark;
If retouching operation, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", this record is made an amendment, amendment " modification time " field information, and " data markers " is masked as amendment mark;
If deletion action, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", amendment " modification time " field information, and " data markers " is masked as delete flag;
Step 14, repetition step 11 ~ 13, carry out synchronous operation by the business datum in the basic data in base data table, business datum table one by one, thus data syn-chronization operation system upgraded is to synchronous intermediate database.
Further, the process that described synchronous service program writes respective operation system from synchronous intermediate database reading data comprises:
Step 21, last operation time according to the Service Database record in operation system corresponding in synchrodata record, in time range to the timestamp that current time generates, scannedly in this synchronous intermediate database leach this time period vicissitudinous basic data and business datum, record this timestamp value;
Step 22, according to business successively logical relation, take out wherein each data set, take out data record one by one in data centralization, according to record operation " data markers ", carry out respective synchronization operation:
If newly-increased operation, then the modification time of this record and concrete data record are taken out, be inserted in the table of corresponding service database, and upgrade " operation system data id " field information of the table of synchronous intermediate database.
If retouching operation, according to " operation system data id " value, the value of respective record is revised in operation system, if operation system data id does not exist, then be used as newly-increased, in operation system, increase this record, and return the value of " the operation system data id " of the table revising synchronous intermediate database;
If deletion action, according to " operation system data id " value, in corresponding service system, delete corresponding record value;
Step 23, repetition step 21 ~ 22, carry out synchronous operation, until synchronously complete by basic data, business datum one by one.
Further, described newly-increased record, retouching operation, deletion action all adopt the mode generating corresponding sql statement to pass to other one end (if operation system is synchronized to middle database, then one end refers to intermediate database in addition, if instead be that middle database data are to operation system, then the other end refers to operation system database) perform, if operation failure, then the sql' statement of corresponding operating is stored in described failure record table, system detects the operation of execute exception operation failure by timing in independent thread, and timing re-executes.
Further, this synchro system is used for carrying out between multiple operation system synchronous, time synchronous, needs synchronous data to write in synchronous intermediate database by arriving first in each operation system to read, then from synchronous intermediate database, reads data write in each operation system
Further, in long-range synchronous operation system, increase webservice service at operation system end, this webservice service encapsulates database manipulation service interface of local service system, is then supplied to synchronous service routine call.
Tool of the present invention has the following advantages: the method for data synchronization between operation system platform of the present invention, carry out synchronously to the business datum between different system, by setting up synchronous intermediate database, synchronous intermediate database preserves base data table, business datum table, failure record table and table of described running time, use synchronous working timestamp, open synchronous operation, then carry out reading data from operation system and write the process of synchronous intermediate database and synchronous service program reads from synchronous intermediate database the process that data write respective operation system, finally realize synchronize data transactions.Due to timestamp on band of the present invention, the rule of synchrodata is known in definition simultaneously, is equivalent to specify that interface, makes range of application not by the restriction of interface specification.On the other hand, the present invention also changes definition according to the additions and deletions of rule definition, takes data away and processes, and therefore can reach and close the synchronous of many cover different business systems.
Embodiment
Method of data synchronization between different business systems platform of the present invention is: setting up synchronous intermediate database needs synchronous data layout, data content, synchronous abnormality data record, synchronous working timestamp in order to definition, preservation different business systems both sides; During synchrodata, synchronous service program reads data from operation system and writes synchronous intermediate database, or read data from synchronous mid-ambles database and write respective operation system, and in synchronizing process, synchronous service program also provides timing operation and data syn-chronization correction process according to synchronous working timestamp.Wherein, synchronous intermediate database and synchronous service program form the data synchronous system between different business systems platform of the present invention.
In method of data synchronization of the present invention or data synchronous system:
Described synchronous service program is for mutual with the data module of synchronous intermediate database and operation system, provides timing operation, carries out the work for the treatment of such as data synchronization process, data syn-chronization error correction.The data module of operation system is provided by each operation system, can be the module synchronization of two operation systems, also can be that plural multiple operation system module is synchronous together.
Described data layout and data content adopt JSON data layout, and represented by base data table and business datum table, described synchronous abnormality data record is represented by failure record table, and described synchronous working timestamp is represented by running time table;
As shown in table 1, this base data table by synchrodata record id, the data record id of each operation system, modification time, the data markers increasing newly, revise, delete, these fields of basic data recorded information form, wherein, this base data table can arrange multiple as required;
Table 1
As shown in table 2, this business datum table by synchrodata record id, the data record id of each operation system, modification time, the data markers increasing newly, revise, delete, these fields of business datum recorded information form, wherein, according to the complexity of business, this business datum table can arrange multiple;
Table 2
As shown in table 3, described failure record table is by failure operation id, and Service Database id, Sql statement, the failure execution time, performs these fields of number of times composition;
Table 3
As shown in table 4, described running time table is by timestamp Record ID, and Service Database ID, the last operation time, these fields of synchronous scanning interval form.
Table 4
According to synchronous operation system number, " operation system data record id " needs corresponding record id.The entities field of concrete basic data and business datum content can expanded definition according to specific needs.When needing synchronous, system starts synchronous service program, according to the DataBase combining of configuration file synchronous service program with the data module of each operation system, while and synchronous intermediate database connect.According to the operation system number wanting synchrodata, can the multiple synchronous service program of startup optimization, since certainly want synchrodata, at least will at two operation system mid-ambles, therefore at least two synchronous service programs, for the data syn-chronization between the operation system that two covers are different.When this system is used for carrying out synchronous between multiple operation system, need synchronous data to write in synchronous intermediate database by arriving first in each operation system to read, then from synchronous intermediate database, read data write in each operation system.
Synchronizing process is as follows:
First initialization operation timetable, is initialized as the initial time, and setting synchronous scanning interval, guarantees the data synchronously covering needs.Synchronous service program utilizes the WEBSERVICE/SOAP communication technology based on http protocol, according to the synchronous scanning interval in corresponding record in running time table, time opening synchronous operation, then carries out reading data from operation system and writes the process of synchronous intermediate database and synchronous service program reads from synchronous intermediate database the process that data write respective operation system;
Wherein, describedly read from operation system the process that data write synchronous intermediate database and comprise:
Step 11, last operation time according to the Service Database record in operation system corresponding in synchrodata record, scannedly in this Service Database leach vicissitudinous basic data and business datum after this timestamp, record this timestamp value;
Step 12, according to business successively logical relation, take out wherein each data set, carry out synchronous operation;
Step 13, take out record one by one in data centralization, judge this record be newly-increased record, retouching operation, deletion action any:
If newly-increased record, then " the operation system data id " of this record, modification time and concrete data record are inserted in the table of synchronous intermediate database, and " data markers " is masked as newly-increased mark, as being labeled as " 1 ";
If retouching operation, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", this record is made an amendment, amendment " modification time " field information, and " data markers " is masked as amendment mark, as being labeled as " 2 ";
If deletion action, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", amendment " modification time " field information, and " data markers " is masked as delete flag, as being labeled as " 3 ";
Step 14, repetition step 11 ~ 13, carry out synchronous operation by the business datum in the basic data in base data table, business datum table one by one, thus data syn-chronization operation system upgraded is to synchronous intermediate database.
The process that described synchronous service program writes respective operation system from synchronous intermediate database reading data comprises:
Step 21, last operation time according to the Service Database record in operation system corresponding in synchrodata record, trace back in the time range till the timestamp of this subsynchronous original records, scannedly in this synchronous intermediate database leach this time period vicissitudinous basic data and business datum, record this timestamp value;
Step 22, according to business successively logical relation, take out wherein each data set, take out data record one by one in data centralization, according to record operation " data markers ", carry out respective synchronization operation:
If newly-increased operation, when being namely labeled as " 1 ", then the modification time of this record and concrete data record being taken out, be inserted in the table of corresponding service database, and upgrade " operation system data id " field information of the table of synchronous intermediate database.
If retouching operation, when being namely labeled as " 2 ", according to " operation system data id " value, the value of respective record is revised in operation system, if operation system data id does not exist, then be used as newly-increased, in operation system, increase this record, and return the value of " the operation system data id " of the table revising synchronous intermediate database;
If deletion action, when being namely labeled as " 3 ", according to " operation system data id " value, in corresponding service system, delete corresponding record value;
Step 23, repetition step 21 ~ 22, carry out synchronous operation, until synchronously complete by basic data, business datum one by one.
Wherein, described newly-increased record, retouching operation, deletion action all adopt the mode generating corresponding sql statement to pass to other one end (if operation system is synchronized to middle database, then one end refers to intermediate database in addition, if instead be that middle database data are to operation system, then the other end refers to operation system database) perform, if operation failure, then the sql' statement of corresponding operating is stored in described failure record table, system detects the operation of execute exception operation failure by timing in independent thread, and timing re-executes.
For in long-range synchronous operation system, increase webservice service at operation system end, this webservice service encapsulates database manipulation service interface of local service system, is then supplied to synchronous service routine call.
The present invention realizes a kind of in isomorphism or synchronous synchronous method and the system sharing data of heterogeneous system.Solve data syn-chronization in many cover systems and share the problem being realized the complicacy reading write operation interaction data by the definition of traditional api interface, particularly when the above operation system of 3 cover needs synchronous.The present invention can make to want mutual straightforward the presenting with the form of database table of data-interface, and many cover systems present with identical interface, and interface describes and is simple and easy to understand.In the application of reality, in different development teams, different operation systems, by a side, the data-interface needing synchronisation can be proposed, supplement perfect by other a few side, final separately toward wherein filling in data and readback data separately, the application process division of labor is clear and definite, and realization is responsible for respective service logic separately, independently realizes.Finally want mutual data also can directly be presented in intermediate database table intuitively, convenient debugging, be also conducive to data exception simultaneously and recover re-synchronization, and do not affect other people operation system.Such as, basic demographic data in the sale management system disappeared soon, product data, trading statement forms data needs and erp system, to carry out data sharing in oa system synchronous, these three systems need synchronous shared data mutually, synchronous intermediate database is defined by a side, then realized the interaction logic of synchronous service program by the exploitation side of each system, reach the object of shared synchrodata.
Although the foregoing describe the specific embodiment of the present invention; but be familiar with those skilled in the art to be to be understood that; specific embodiment described by us is illustrative; instead of for the restriction to scope of the present invention; those of ordinary skill in the art, in the modification of the equivalence done according to spirit of the present invention and change, should be encompassed in scope that claim of the present invention protects.
Claims (16)
1. the method for data synchronization between a different business systems platform, it is characterized in that: setting up synchronous intermediate database needs synchronous data layout, data content, synchronous abnormality data record, synchronous working timestamp in order to definition, preservation different business systems both sides; During synchrodata, synchronous service program reads data from operation system and writes synchronous intermediate database, or read data from synchronous mid-ambles database and write respective operation system, and in synchronizing process, synchronous service program also provides timing operation and data syn-chronization correction process according to synchronous working timestamp.
2. the method for data synchronization between a kind of different business systems platform according to claim 1, it is characterized in that: described data layout and data content are represented by base data table and business datum table, described synchronous abnormality data record is represented by failure record table, and described synchronous working timestamp is represented by running time table;
This base data table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of basic data recorded information form;
This business datum table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of business datum recorded information form;
Described failure record table is by failure operation id, and Service Database id, Sql statement, the failure execution time, performs these fields of number of times composition;
Described running time table is by timestamp Record ID, and Service Database ID, the last operation time, these fields of synchronous scanning interval form.
3. the method for data synchronization between a kind of different business systems platform according to claim 2, is characterized in that: described synchronizing process is as follows:
First initialization operation timetable, be initialized as the initial time, setting synchronous scanning interval, guarantee the data synchronously covering needs, synchronous service program is according to the synchronous scanning interval in corresponding record in running time table, time opening synchronous operation, then carries out reading data from operation system and writes the process of synchronous intermediate database and synchronous service program reads from synchronous intermediate database the process that data write respective operation system.
4. the method for data synchronization between a kind of different business systems platform according to claim 3, is characterized in that: describedly read from operation system the process that data write synchronous intermediate database and comprise:
Step 11, last operation time according to the Service Database record in operation system corresponding in synchrodata record, scannedly in this Service Database leach vicissitudinous basic data and business datum after this timestamp, record this timestamp value;
Step 12, according to business successively logical relation, take out wherein each data set, carry out synchronous operation;
Step 13, take out record one by one in data centralization, judge this record be newly-increased record, retouching operation, deletion action any:
If newly-increased record, then " the operation system data id " of this record, modification time and concrete data record are inserted in the table of synchronous intermediate database, and " data markers " is masked as newly-increased mark;
If retouching operation, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", this record is made an amendment, amendment " modification time " field information, and " data markers " is masked as amendment mark;
If deletion action, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", amendment " modification time " field information, and " data markers " is masked as delete flag;
Step 14, repetition step 11 ~ 13, carry out synchronous operation by the business datum in the basic data in base data table, business datum table one by one, thus data syn-chronization operation system upgraded is to synchronous intermediate database.
5. the method for data synchronization between a kind of different business systems platform according to claim 4, is characterized in that: the process that described synchronous service program writes respective operation system from synchronous intermediate database reading data comprises:
Step 21, last operation time according to the Service Database record in operation system corresponding in synchrodata record, in time range to the timestamp that current time generates, scannedly in this synchronous intermediate database leach this time period vicissitudinous basic data and business datum, record this timestamp value;
Step 22, according to business successively logical relation, take out wherein each data set, take out data record one by one in data centralization, according to record operation " data markers ", carry out respective synchronization operation:
If newly-increased operation, then the modification time of this record and concrete data record are taken out, be inserted in the table of corresponding service database, and upgrade " operation system data id " field information of the table of synchronous intermediate database;
If retouching operation, according to " operation system data id " value, the value of respective record is revised in operation system, if operation system data id does not exist, then be used as newly-increased, in operation system, increase this record, and return the value of " the operation system data id " of the table revising synchronous intermediate database;
If deletion action, according to " operation system data id " value, in corresponding service system, delete corresponding record value;
Step 23, repetition step 21 ~ 22, carry out synchronous operation, until synchronously complete by basic data, business datum one by one.
6. the method for data synchronization between a kind of different business systems platform according to claim 4 or 5, it is characterized in that: described newly-increased record, retouching operation, deletion action all adopt the mode generating corresponding sql statement to pass to an other client database and perform, if operation failure, then the sql' statement of corresponding operating is stored in described failure record table, system detects the operation of execute exception operation failure by timing in independent thread, and timing re-executes.
7. the method for data synchronization between a kind of different business systems platform according to claim 6, it is characterized in that: the method is used for carrying out synchronously between multiple operation system, time synchronous, need synchronous data to write in synchronous intermediate database by arriving first in each operation system to read, then from synchronous intermediate database, read data write in each operation system.
8. the method for data synchronization between a kind of different business systems platform according to claim 1 or 7, it is characterized in that: in long-range synchronous operation system, webservice service is increased at operation system end, this webservice service encapsulates database manipulation service interface of local service system, is then supplied to synchronous service routine call.
9. the data synchronous system between different business systems platform, is characterized in that: comprising:
Synchronous intermediate database, needs synchronous data layout, data content, synchronous abnormality data record, synchronous working timestamp in order to definition, preservation different business systems both sides;
Synchronous service program, during synchrodata, read data from operation system and write synchronous intermediate database, or read data from synchronous intermediate database and write respective operation system, and in synchronizing process, synchronous service program also provides timing operation and data syn-chronization correction process according to synchronous working timestamp.
10. the data synchronous system between a kind of different business systems platform according to claim 9, it is characterized in that: described data layout and data content are represented by base data table and business datum table, described synchronous abnormality data record is represented by failure record table, and described synchronous working timestamp is represented by running time table;
This base data table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of basic data recorded information form;
This business datum table by synchrodata record id, the data record id of each operation system, modification time, newly-increased, amendment, the data markers of deleting, these fields of business datum recorded information form;
Described failure record table is by failure operation id, and Service Database id, Sql statement, the failure execution time, performs these fields of number of times composition;
Described running time table is by timestamp Record ID, and Service Database ID, the last operation time, these fields of synchronous scanning interval form.
Data synchronous system between 11. a kind of different business systems platforms according to claim 10, is characterized in that: described synchronizing process is as follows:
First initialization operation timetable, be initialized as the initial time, setting synchronous scanning interval, guarantee the data synchronously covering needs, synchronous service program is according to the synchronous scanning interval in corresponding record in running time table, time opening synchronous operation, then carries out reading data from operation system and writes the process of synchronous intermediate database and synchronous service program reads from synchronous intermediate database the process that data write respective operation system.
Data synchronous system between 12. a kind of different business systems platforms according to claim 11, is characterized in that: describedly read from operation system the process that data write synchronous intermediate database and comprise:
Step 11, last operation time according to the Service Database record in operation system corresponding in synchrodata record, scannedly in this Service Database leach vicissitudinous basic data and business datum after this timestamp, record this timestamp value;
Step 12, according to business successively logical relation, take out wherein each data set, carry out synchronous operation;
Step 13, take out record one by one in data centralization, judge this record be newly-increased record, retouching operation, deletion action any:
If newly-increased record, then " the operation system data id " of this record, modification time and concrete data record are inserted in the table of synchronous intermediate database, and " data markers " is masked as newly-increased mark;
If retouching operation, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", this record is made an amendment, amendment " modification time " field information, and " data markers " is masked as amendment mark;
If deletion action, then in the table of synchronous intermediate database, find out corresponding record according to " operation system data id ", amendment " modification time " field information, and " data markers " is masked as delete flag;
Step 14, repetition step 11 ~ 13, carry out synchronous operation by the business datum in the basic data in base data table, business datum table one by one, thus data syn-chronization operation system upgraded is to synchronous intermediate database.
Data synchronous system between 13. a kind of different business systems platforms according to claim 11, is characterized in that: the process that described synchronous service program writes respective operation system from synchronous intermediate database reading data comprises:
Step 21, last operation time according to the Service Database record in operation system corresponding in synchrodata record, in time range to the timestamp that current time generates, scannedly in this synchronous intermediate database leach this time period vicissitudinous basic data and business datum, record this timestamp value;
Step 22, according to business successively logical relation, take out wherein each data set, take out data record one by one in data centralization, according to record operation " data markers ", carry out respective synchronization operation:
If newly-increased operation, then the modification time of this record and concrete data record are taken out, be inserted in the table of corresponding service database, and upgrade " operation system data id " field information of the table of synchronous intermediate database;
If retouching operation, according to " operation system data id " value, the value of respective record is revised in operation system, if operation system data id does not exist, then be used as newly-increased, in operation system, increase this record, and return the value of " the operation system data id " of the table revising synchronous intermediate database;
If deletion action, according to " operation system data id " value, in corresponding service system, delete corresponding record value;
Step 23, repetition step 21 ~ 22, carry out synchronous operation, until synchronously complete by basic data, business datum one by one.
Data synchronous system between 14. a kind of different business systems platforms according to claim 12 or 13, it is characterized in that: described newly-increased record, retouching operation, deletion action all adopt the mode generating corresponding sql statement to pass to an other client database and perform, if operation failure, then the sql' statement of corresponding operating is stored in described failure record table, system detects the operation of execute exception operation failure by timing in independent thread, and timing re-executes.
Data synchronous system between 15. a kind of different business systems platforms according to claim 14, it is characterized in that: this data synchronous system is used for carrying out synchronously between multiple operation system, time synchronous, need synchronous data to write in synchronous intermediate database by arriving first in each operation system to read, then from synchronous intermediate database, read data write in each operation system.
Data synchronous system between 16. a kind of different business systems platforms according to claim 9 or 15, it is characterized in that: in long-range synchronous operation system, webservice service is increased at operation system end, this webservice service encapsulates database manipulation service interface of local service system, is then supplied to synchronous service routine call.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510078748.8A CN104615759A (en) | 2015-02-13 | 2015-02-13 | Data synchronization method for different business system platforms |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510078748.8A CN104615759A (en) | 2015-02-13 | 2015-02-13 | Data synchronization method for different business system platforms |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104615759A true CN104615759A (en) | 2015-05-13 |
Family
ID=53150201
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510078748.8A Pending CN104615759A (en) | 2015-02-13 | 2015-02-13 | Data synchronization method for different business system platforms |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104615759A (en) |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105096189A (en) * | 2015-08-26 | 2015-11-25 | 北京京东尚科信息技术有限公司 | Method and apparatus for obtaining business voucher qualification information |
| CN106021494A (en) * | 2016-05-19 | 2016-10-12 | 中国银联股份有限公司 | Master data synchronization method and device |
| CN106845092A (en) * | 2017-01-03 | 2017-06-13 | 青岛海信医疗设备股份有限公司 | A kind of system docking method and device |
| CN107038088A (en) * | 2016-09-28 | 2017-08-11 | 阿里巴巴集团控股有限公司 | A kind of data reconstruction method and device |
| CN107203433A (en) * | 2017-06-13 | 2017-09-26 | 微梦创科网络科技（中国）有限公司 | The multiple inter-program data synchronous method and device of a kind of shared drive |
| CN107203642A (en) * | 2017-06-19 | 2017-09-26 | 山东浪潮通软信息科技有限公司 | A kind of method of data synchronization and device |
| CN107302469A (en) * | 2016-04-14 | 2017-10-27 | 北京京东尚科信息技术有限公司 | The real time monitoring apparatus and method updated for Distributed Services cluster system data |
| CN107463555A (en) * | 2016-06-01 | 2017-12-12 | 北京京东尚科信息技术有限公司 | The mthods, systems and devices of layer data among deleting |
| CN107957910A (en) * | 2016-10-18 | 2018-04-24 | 北京京东尚科信息技术有限公司 | Message treatment method and message processing apparatus |
| CN108536752A (en) * | 2018-03-13 | 2018-09-14 | 北京信安世纪科技有限公司 | A kind of method of data synchronization, device and equipment |
| CN108573042A (en) * | 2018-04-10 | 2018-09-25 | 平安科技（深圳）有限公司 | Report synchronous method, electronic equipment and computer readable storage medium |
| CN108900497A (en) * | 2018-06-25 | 2018-11-27 | 江苏欧软信息科技有限公司 | Method of data synchronization and system between a kind of heterogeneous system |
| CN109101514A (en) * | 2017-06-21 | 2018-12-28 | 北京国双科技有限公司 | Data lead-in method and device |
| CN109857749A (en) * | 2018-12-30 | 2019-06-07 | 贝壳技术有限公司 | Method of data synchronization and device based on configuration data change record |
| CN109933596A (en) * | 2019-02-27 | 2019-06-25 | 深圳市轱辘汽车维修技术有限公司 | A kind of method of data synchronization, device and terminal device |
| CN110209534A (en) * | 2019-06-14 | 2019-09-06 | 四川长虹电器股份有限公司 | The system and method for automated back-up mysql database |
| CN110264174A (en) * | 2019-06-19 | 2019-09-20 | 农业部沼气科学研究所 | A kind of interconnection method of enterprise and bank |
| CN110489472A (en) * | 2019-07-29 | 2019-11-22 | 北京恒赢智航科技有限公司 | A kind of method for interchanging data and the unit management system using the exchange method |
| CN110740195A (en) * | 2019-11-20 | 2020-01-31 | 山东鲁能软件技术有限公司 | distributed system data synchronization method and system based on message engine |
| CN111241192A (en) * | 2019-12-31 | 2020-06-05 | 航天信息软件技术有限公司 | Data synchronization method |
| CN111506923A (en) * | 2020-05-11 | 2020-08-07 | 上海卓越睿新数码科技有限公司 | Teaching educational administration information and teaching platform data synchronization method and system |
| CN111737252A (en) * | 2020-05-22 | 2020-10-02 | 广东科学技术职业学院 | Data fusion method and system based on data center |
| CN111858597A (en) * | 2020-07-22 | 2020-10-30 | 安徽华典大数据科技有限公司 | Method for synchronizing data in heterogeneous database |
| CN112181928A (en) * | 2020-09-03 | 2021-01-05 | 北京三快在线科技有限公司 | Method, device and system for executing service |
| CN112347189A (en) * | 2020-11-05 | 2021-02-09 | 江苏电力信息技术有限公司 | Cloud computing-based financial data consistency failure discovery and recovery method |
| CN112463786A (en) * | 2020-12-10 | 2021-03-09 | 上海携宁计算机科技股份有限公司 | Data synchronization method, system, server and storage medium |
| CN112950393A (en) * | 2021-02-09 | 2021-06-11 | 深圳木成林科技有限公司 | Insurance business docking method and device, electronic equipment and readable storage medium |
| CN113190626A (en) * | 2021-05-28 | 2021-07-30 | 广东电网有限责任公司 | Information synchronization method and device, electronic equipment and storage medium |
| US20230051934A1 (en) * | 2021-08-11 | 2023-02-16 | Jpmorgan Chase Bank, N.A. | Method and system for data synchronization |
| CN117527833A (en) * | 2024-01-04 | 2024-02-06 | 深圳市度申科技有限公司 | Data synchronization method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101599081A (en) * | 2009-06-24 | 2009-12-09 | 深圳市迈科龙电子有限公司 | The method and apparatus of collaborative operation of information systems |
| CN102495910A (en) * | 2011-12-28 | 2012-06-13 | 畅捷通信息技术股份有限公司 | Device and method for data timing synchronization of heterogeneous system |
| US20130212067A1 (en) * | 2012-02-15 | 2013-08-15 | Citrix Systems, Inc. | Selective synchronization of remotely stored content |
-
2015
- 2015-02-13 CN CN201510078748.8A patent/CN104615759A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101599081A (en) * | 2009-06-24 | 2009-12-09 | 深圳市迈科龙电子有限公司 | The method and apparatus of collaborative operation of information systems |
| CN102495910A (en) * | 2011-12-28 | 2012-06-13 | 畅捷通信息技术股份有限公司 | Device and method for data timing synchronization of heterogeneous system |
| US20130212067A1 (en) * | 2012-02-15 | 2013-08-15 | Citrix Systems, Inc. | Selective synchronization of remotely stored content |
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105096189A (en) * | 2015-08-26 | 2015-11-25 | 北京京东尚科信息技术有限公司 | Method and apparatus for obtaining business voucher qualification information |
| CN107302469B (en) * | 2016-04-14 | 2020-03-31 | 北京京东尚科信息技术有限公司 | Monitoring device and method for data update of distributed service cluster system |
| CN107302469A (en) * | 2016-04-14 | 2017-10-27 | 北京京东尚科信息技术有限公司 | The real time monitoring apparatus and method updated for Distributed Services cluster system data |
| CN106021494A (en) * | 2016-05-19 | 2016-10-12 | 中国银联股份有限公司 | Master data synchronization method and device |
| CN107463555B (en) * | 2016-06-01 | 2020-09-04 | 北京京东尚科信息技术有限公司 | Method, system and device for deleting intermediate layer data |
| CN107463555A (en) * | 2016-06-01 | 2017-12-12 | 北京京东尚科信息技术有限公司 | The mthods, systems and devices of layer data among deleting |
| CN107038088A (en) * | 2016-09-28 | 2017-08-11 | 阿里巴巴集团控股有限公司 | A kind of data reconstruction method and device |
| CN107957910A (en) * | 2016-10-18 | 2018-04-24 | 北京京东尚科信息技术有限公司 | Message treatment method and message processing apparatus |
| CN106845092A (en) * | 2017-01-03 | 2017-06-13 | 青岛海信医疗设备股份有限公司 | A kind of system docking method and device |
| CN107203433A (en) * | 2017-06-13 | 2017-09-26 | 微梦创科网络科技（中国）有限公司 | The multiple inter-program data synchronous method and device of a kind of shared drive |
| CN107203642A (en) * | 2017-06-19 | 2017-09-26 | 山东浪潮通软信息科技有限公司 | A kind of method of data synchronization and device |
| CN109101514A (en) * | 2017-06-21 | 2018-12-28 | 北京国双科技有限公司 | Data lead-in method and device |
| CN108536752B (en) * | 2018-03-13 | 2021-11-09 | 北京信安世纪科技有限公司 | Data synchronization method, device and equipment |
| CN108536752A (en) * | 2018-03-13 | 2018-09-14 | 北京信安世纪科技有限公司 | A kind of method of data synchronization, device and equipment |
| CN108573042A (en) * | 2018-04-10 | 2018-09-25 | 平安科技（深圳）有限公司 | Report synchronous method, electronic equipment and computer readable storage medium |
| CN108573042B (en) * | 2018-04-10 | 2022-06-10 | 平安科技（深圳）有限公司 | Report synchronization method, electronic equipment and computer readable storage medium |
| CN108900497B (en) * | 2018-06-25 | 2021-11-02 | 江苏欧软信息科技有限公司 | Data synchronization method and system between heterogeneous systems |
| CN108900497A (en) * | 2018-06-25 | 2018-11-27 | 江苏欧软信息科技有限公司 | Method of data synchronization and system between a kind of heterogeneous system |
| CN109857749A (en) * | 2018-12-30 | 2019-06-07 | 贝壳技术有限公司 | Method of data synchronization and device based on configuration data change record |
| CN109933596A (en) * | 2019-02-27 | 2019-06-25 | 深圳市轱辘汽车维修技术有限公司 | A kind of method of data synchronization, device and terminal device |
| CN110209534A (en) * | 2019-06-14 | 2019-09-06 | 四川长虹电器股份有限公司 | The system and method for automated back-up mysql database |
| CN110264174A (en) * | 2019-06-19 | 2019-09-20 | 农业部沼气科学研究所 | A kind of interconnection method of enterprise and bank |
| CN110489472A (en) * | 2019-07-29 | 2019-11-22 | 北京恒赢智航科技有限公司 | A kind of method for interchanging data and the unit management system using the exchange method |
| CN110740195B (en) * | 2019-11-20 | 2022-05-20 | 山东鲁能软件技术有限公司 | Distributed system data synchronization method and system based on message engine |
| CN110740195A (en) * | 2019-11-20 | 2020-01-31 | 山东鲁能软件技术有限公司 | distributed system data synchronization method and system based on message engine |
| CN111241192A (en) * | 2019-12-31 | 2020-06-05 | 航天信息软件技术有限公司 | Data synchronization method |
| CN111506923A (en) * | 2020-05-11 | 2020-08-07 | 上海卓越睿新数码科技有限公司 | Teaching educational administration information and teaching platform data synchronization method and system |
| CN111737252B (en) * | 2020-05-22 | 2023-10-03 | 广东科学技术职业学院 | Data fusion method and system based on data center |
| CN111737252A (en) * | 2020-05-22 | 2020-10-02 | 广东科学技术职业学院 | Data fusion method and system based on data center |
| CN111858597A (en) * | 2020-07-22 | 2020-10-30 | 安徽华典大数据科技有限公司 | Method for synchronizing data in heterogeneous database |
| CN112181928A (en) * | 2020-09-03 | 2021-01-05 | 北京三快在线科技有限公司 | Method, device and system for executing service |
| CN112181928B (en) * | 2020-09-03 | 2024-02-23 | 北京三快在线科技有限公司 | Method, device and system for executing service |
| CN112347189A (en) * | 2020-11-05 | 2021-02-09 | 江苏电力信息技术有限公司 | Cloud computing-based financial data consistency failure discovery and recovery method |
| CN112463786A (en) * | 2020-12-10 | 2021-03-09 | 上海携宁计算机科技股份有限公司 | Data synchronization method, system, server and storage medium |
| CN112950393A (en) * | 2021-02-09 | 2021-06-11 | 深圳木成林科技有限公司 | Insurance business docking method and device, electronic equipment and readable storage medium |
| CN113190626A (en) * | 2021-05-28 | 2021-07-30 | 广东电网有限责任公司 | Information synchronization method and device, electronic equipment and storage medium |
| US20230051934A1 (en) * | 2021-08-11 | 2023-02-16 | Jpmorgan Chase Bank, N.A. | Method and system for data synchronization |
| US11809452B2 (en) * | 2021-08-11 | 2023-11-07 | Jpmorgan Chase Bank, N.A. | Method and system for data synchronization |
| CN117527833A (en) * | 2024-01-04 | 2024-02-06 | 深圳市度申科技有限公司 | Data synchronization method |
| CN117527833B (en) * | 2024-01-04 | 2024-03-29 | 深圳市度申科技有限公司 | Data synchronization method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104615759A (en) | Data synchronization method for different business system platforms | |
| EP2595068B1 (en) | System and method of performing snapshot isolation in distributed databases | |
| US11182404B2 (en) | Data replication technique in database management system | |
| US10268472B2 (en) | Upgrading systems with replicated data | |
| CN104809202B (en) | A kind of method and apparatus of database synchronization | |
| CN102402596B (en) | A kind of reading/writing method of master slave separation database and system | |
| CN103488690B (en) | Data integrated system and data integrating method | |
| CN103617176A (en) | Method for achieving automatic synchronization of multi-source heterogeneous data resources | |
| US8977592B2 (en) | Synchronization framework that restores a node from backup | |
| CN108133007A (en) | A kind of method of data synchronization and system | |
| CN104899295A (en) | Heterogeneous data source data association analysis method | |
| CN104809200A (en) | Database synchronization method and device | |
| WO2015021215A1 (en) | Data bus architecture for inter-database data distribution | |
| US10346150B2 (en) | Computerized system and method for patching an application by separating executables and working data using different images | |
| CN102970373B (en) | A kind of method of data synchronization, Apparatus and system | |
| CN109542529A (en) | Point methods, device, computer equipment and storage medium are buried based on function name | |
| CN102272751A (en) | Data integrity in a database environment through background synchronization | |
| WO2019222399A1 (en) | Conflict resolution in distributed computing | |
| CN102946410A (en) | Method and device for network synchronization | |
| JP2018513492A (en) | Method and apparatus for realizing mutual time domain matching in distributed systems | |
| CN102752294A (en) | Method and system for synchronizing data of multiple terminals on basis of equipment capacity | |
| CN104462342B (en) | database snapshot synchronization processing method and device | |
| CN110489092A (en) | The solution of data latency issues is read under a kind of data base read-write separation architecture | |
| CN102982171A (en) | Database synchronization method | |
| CN109145060A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150513 |
|
| WD01 | Invention patent application deemed withdrawn after publication |