CN110765206A - Data synchronization system, method, device, equipment and storage medium - Google Patents
Data synchronization system, method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN110765206A CN110765206A CN201910999995.XA CN201910999995A CN110765206A CN 110765206 A CN110765206 A CN 110765206A CN 201910999995 A CN201910999995 A CN 201910999995A CN 110765206 A CN110765206 A CN 110765206A
- Authority
- CN
- China
- Prior art keywords
- data
- synchronization
- source
- message queue
- source data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 28
- 230000001360 synchronised effect Effects 0.000 claims description 25
- 238000004590 computer program Methods 0.000 claims description 15
- 230000003993 interaction Effects 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention is applicable to the technical field of computers and provides a data synchronization system, a method, a device, equipment and a storage medium, wherein a synchronization management platform receives a data synchronization task from a source database to a target database, pushes a synchronization task configuration corresponding to the data synchronization task to a data synchronization node, the data synchronization node reads source data needing synchronization from the source database according to the synchronization task configuration and a log of the source database, puts the source data into a message queue server, when detecting the source data subscribed by the subscriber, acquiring the source data from the message queue server, writing the source data into a target database set by the subscriber, therefore, data synchronization among different platform systems is realized through the message queue server, interaction between the message queue server and a target database and interaction between the message queue server and a source database are reduced, and safety of data in the database is guaranteed.
Description
Technical Field
The invention belongs to the technical field of computers, and particularly relates to a data synchronization system, a data synchronization method, a data synchronization device, data synchronization equipment and a storage medium.
Background
Because the version updating iteration of the e-commerce platform is fast, the data volume is large, when the new version and the old version are switched, the associated databases for storing data need to be synchronized, a common data synchronization method needs to directly operate a database table, the data cannot be synchronized into different project databases in real time, the database needs to be frequently interacted during each synchronization, the storage efficiency of the database data is influenced, the computer program codes are executed from top to bottom in the synchronization process, and the whole data synchronization process is influenced if a fault occurs in the middle of the computer program codes.
Disclosure of Invention
The invention aims to provide a data synchronization system, a data synchronization method, a data synchronization device, data synchronization equipment and a data synchronization storage medium, and aims to solve the problem that the existing e-commerce platform is low in synchronization efficiency due to frequent interaction with a database during synchronization.
In one aspect, the present invention provides a data synchronization system, where the system includes a synchronization management platform, a data synchronization node, and a message queue server, where:
the synchronous management platform is used for receiving a data synchronization task from a source database to a target database and pushing a synchronous task configuration corresponding to the data synchronization task to the data synchronization node;
and the data synchronization node is used for reading source data needing synchronization from the source database according to the synchronization task configuration and the log of the source database, putting the source data into the message queue server, acquiring the source data from the message queue server when detecting the source data subscribed by the subscriber, and writing the source data into a target database set by the subscriber.
In another aspect, the present invention provides a data synchronization method based on the data synchronization system, including:
according to the synchronization task configuration and the log of the source database sent by the synchronization management platform, the data synchronization node reads source data needing synchronization from the source database and puts the source data into a message queue server;
when the source data subscribed by the subscriber is detected, the data synchronization node acquires the source data from the message queue server and writes the source data into a target database set by the subscriber.
On the other hand, the invention also provides a data synchronization device based on the data synchronization system, which comprises:
the data publishing unit is used for reading source data needing synchronization from the source database by the data synchronization node according to the synchronization task configuration and the log of the source database sent by the synchronization management platform and putting the source data into the message queue server; and
and the data writing unit is used for acquiring the source data from the message queue server by the data synchronization node and writing the source data into a target database set by the subscriber when the source data subscribed by the subscriber is detected.
In another aspect, the present invention also provides a synchronization device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method as described above when executing the computer program.
In another aspect, the present invention also provides a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of the method as described above.
The data synchronization system provided by the invention comprises a synchronization management platform and a data synchronization node, wherein the synchronization management platform receives a data synchronization task from a source database to a target database, pushes a synchronization task configuration corresponding to the data synchronization task to the data synchronization node, the data synchronization node reads source data needing synchronization from the source database according to the synchronization task configuration and a log of the source database, and puts the source data into a message queue server, when detecting the source data subscribed by the subscriber, acquiring the source data from the message queue server, writing the source data into a target database set by the subscriber, therefore, data synchronization among different platform systems is realized through the message queue server, interaction between the message queue server and a target database and interaction between the message queue server and a source database are reduced, and safety of data in the database is guaranteed.
Drawings
Fig. 1 is a schematic structural diagram of a data synchronization system according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a data synchronization system according to an embodiment of the present invention;
fig. 3 is a flowchart of an implementation of a data synchronization method according to a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of a data synchronization apparatus according to a third embodiment of the present invention; and
fig. 5 is a schematic structural diagram of a synchronization apparatus according to a fourth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The following detailed description of specific implementations of the present invention is provided in conjunction with specific embodiments:
the first embodiment is as follows:
fig. 1 shows a structure of a data synchronization system according to a first embodiment of the present invention, and for convenience of description, only the portions related to the first embodiment of the present invention are shown.
In the embodiment of the present invention, the data synchronization system 1 includes a synchronization management platform 11, a data synchronization node 12, and a message queue server 13, where:
the synchronization management platform 11 is configured to receive a data synchronization task from a source database to a target database, and push a synchronization task configuration corresponding to the data synchronization task to the data synchronization node 12;
the data synchronization node 12 is configured to read source data to be synchronized from a source database according to the synchronization task configuration and the log of the source database, put the source data into the message queue server 13, obtain the source data from the message queue server 13 when detecting the source data subscribed by the subscriber, and write the source data into a target database set by the subscriber.
In the embodiment of the present invention, the user performs unified configuration on each data synchronization through the synchronization management platform 11, and monitors the data synchronization process. After receiving the data synchronization task from the source database to the target database, the synchronization management platform 11 pushes the synchronization task configuration corresponding to the data synchronization task to the data synchronization node 12. The synchronization task can be a data synchronization task such as e-commerce platform commodity price and commodity description, and the synchronization task configuration can be data to be synchronized, time for executing synchronization and the like. The data synchronization node 12 captures and reads source data to be synchronized from the source database according to the synchronization task configuration and the log of the source database, further processes the read source data, standardizes (converts) the source data into a corresponding processable data type, and then places the source data into the message queue server 13. When detecting the source data subscribed by the subscriber, the data synchronization node 12 acquires the source data from the message queue server 13, and writes the source data into a target database set by the subscriber. Before writing the source data into a target database set by a subscriber, data filtering can be performed on the source data through the data synchronization node 12, transaction processing of the database is added, the source data to be synchronized can be converted into a data format supported by the target database through heterogeneous type conversion, the stability and the expandability of the system are remarkably improved, finally, data fields in the source data are mapped into corresponding data tables, and finally, the source data are written into the target database.
Preferably, as shown in fig. 2, the data synchronization system 1 further includes a local cache server 14, configured to, when the data synchronization node 12 puts the source data into the message queue server 13, cache the source data to be put into the message queue server 13 by the data synchronization node 12, and push the cached source data to the message queue server 13, so as to implement fast writing of data from the source database to the message queue server.
Preferably, the data synchronization system 1 further includes an external cache server 15, configured to cache the source data obtained from the message queue server 13 when the data synchronization node writes the source data into a target database set by the subscriber, and write the cached source data into the target database set by the subscriber, so as to implement fast data writing from the message queue server to the target database.
Preferably, the data synchronization node 12 is further configured to detect the transmitted file stream, to monitor whether there is a file to be synchronized in the file stream, and when detecting a synchronized file subscribed by the subscriber, send the synchronized file to the target file. Specifically, during synchronization, the data synchronization node 12 identifies the synchronization files, distinguishes the formats of the files, and transmits a new file stream through file transmission to transmit the files to be synchronized to the target file, thereby implementing file synchronization.
In the embodiment of the invention, the data synchronization among different platform systems is realized through the message queue server, the interaction between the message queue server and the target database and the interaction between the message queue server and the source database are reduced, the safety of the data in the database is ensured, the simultaneous synchronization of a large amount of data can be supported through the external cache server, and in addition, the real-time performance of the process of passing the synchronized data is ensured through the subscription and release mechanism.
In the embodiment of the present invention, each component of the data synchronization system may be implemented by a corresponding hardware or software unit, and each unit may be an independent software or hardware unit, or may be integrated into a software or hardware unit, which is not limited herein.
Example two:
fig. 3 shows an implementation flow of a data synchronization method provided by the second embodiment of the present invention, and for convenience of description, only the relevant parts related to the second embodiment of the present invention are shown, which are detailed as follows:
in step S301, according to the synchronization task configuration and the log of the source database sent by the synchronization management platform, the data synchronization node reads source data to be synchronized from the source database, and puts the source data into the message queue server.
The embodiment of the invention is suitable for the data synchronization system in the first embodiment, and the data synchronization system comprises a synchronization management platform, a data synchronization node and a message queue server. After receiving the data synchronization task from the source database to the target database, the synchronization management platform pushes the synchronization task configuration corresponding to the data synchronization task to the data synchronization node, so that the data synchronization node can read the source data to be synchronized from the source database according to the synchronization task configuration and the log of the source database, and place the source data into the message queue server.
And the user performs unified configuration on each data synchronization through the synchronization management platform to monitor the data synchronization process. And after receiving the data synchronization task from the source database to the target database, the synchronization management platform pushes the synchronization task configuration corresponding to the data synchronization task to the data synchronization node. The synchronization task can be a data synchronization task such as e-commerce platform commodity price and commodity description, and the synchronization task configuration can be data to be synchronized, time for executing synchronization and the like. The data synchronization node captures and reads source data to be synchronized from the source database according to the synchronization task configuration and the log of the source database, further processes the read source data, standardizes the source data (converts the source data into a corresponding processable data type), and then places the source data into the message queue server.
In step S302, when detecting the source data subscribed by the subscriber, the data synchronization node obtains the source data from the message queue server, and writes the source data into a target database set by the subscriber.
In the embodiment of the invention, before writing the source data into the target database set by the subscriber, the data of the source data can be filtered through the data synchronization node, the transaction processing of the database is added, the source data to be synchronized can be converted into the data format supported by the target database through heterogeneous type conversion, the stability and the expandability of the system are obviously improved, and finally, the data fields in the source data are mapped into the corresponding data tables, and the source data are written into the target database.
When the data synchronization system further comprises a local cache server, preferably, when the source data is put into the message queue server, the source data to be put into the message queue server by the data synchronization node is cached into the local cache server, and the cached source data is pushed to the message queue server, so that the data is quickly written from the source database to the message queue server.
When the data synchronization system further comprises an external cache server, preferably, when the source data is written into the target database set by the subscriber, the source data obtained from the message queue server is cached into the external cache server, and the cached source data is written into the target database set by the subscriber, so that the data can be quickly written from the message queue server to the target database.
Further preferably, the data synchronization node detects the transmitted file stream, and when the synchronization file subscribed by the subscriber is detected, the synchronization file is sent to the target file, so as to implement synchronization of the file.
Example three:
fig. 4 shows a structure of a data synchronization apparatus according to a third embodiment of the present invention, and for convenience of description, only the portions related to the third embodiment of the present invention are shown.
The embodiment of the present invention is applicable to the data synchronization system in the first embodiment, and the data synchronization apparatus 4 provided in the embodiment of the present invention includes:
a data publishing unit 41, configured to, according to the synchronization task configuration and the log of the source database sent by the synchronization management platform, read, by the data synchronization node, source data to be synchronized from the source database, and place the source data in the message queue server; and
and a data writing unit 42, configured to, when the source data subscribed by the subscriber is detected, the data synchronization node acquires the source data from the message queue server, and writes the source data in a target database set by the subscriber.
In the embodiment of the present invention, each unit of the data synchronization apparatus may be implemented by a corresponding hardware or software unit, and each unit may be an independent software or hardware unit, or may be integrated into a software or hardware unit, which is not limited herein. The specific implementation manner of each unit may refer to the corresponding description in the first embodiment, and is not described herein again.
Example four:
fig. 5 shows a structure of a synchronization apparatus provided in the fourth embodiment of the present invention, and only a part related to the fourth embodiment of the present invention is shown for convenience of explanation.
The synchronization apparatus 5 of an embodiment of the present invention comprises a processor 50, a memory 51 and a computer program 52 stored in the memory 51 and executable on the processor 50. The processor 50 executes the computer program 52 to implement the steps in the above-mentioned data synchronization method embodiment, such as the steps S301 to S302 shown in fig. 3. Alternatively, the processor 50, when executing the computer program 52, implements the functions of the units in the above-described device embodiments, such as the functions of the units 41 to 42 shown in fig. 4.
In the embodiment of the invention, a synchronization management platform receives a data synchronization task from a source database to a target database, the synchronization task configuration corresponding to the data synchronization task is pushed to a data synchronization node, the data synchronization node reads source data to be synchronized from the source database according to the synchronization task configuration and a log of the source database, the source data is put into a message queue server, when the source data subscribed by a subscriber is detected, the source data is obtained from the message queue server, and the source data is written into the target database set by the subscriber, so that data synchronization among different platform systems is realized through the message queue server, interaction between the target database and the source database is reduced, and the safety of the data in the database is ensured.
The synchronization device of the embodiments of the present invention may be a computing device. The steps implemented when the processor 50 executes the computer program 52 in the synchronization apparatus 5 to implement the data synchronization method can refer to the description of the foregoing method embodiments, and are not described herein again.
Example five:
in an embodiment of the present invention, a computer-readable storage medium is provided, which stores a computer program that, when executed by a processor, implements the steps in the above-described data synchronization method embodiment, for example, steps S301 to S302 shown in fig. 1. Alternatively, the computer program realizes the functions of the units in the above-described device embodiments, such as the functions of the units 41 to 42 shown in fig. 4, when executed by the processor.
In the embodiment of the invention, a synchronization management platform receives a data synchronization task from a source database to a target database, the synchronization task configuration corresponding to the data synchronization task is pushed to a data synchronization node, the data synchronization node reads source data to be synchronized from the source database according to the synchronization task configuration and a log of the source database, the source data is put into a message queue server, when the source data subscribed by a subscriber is detected, the source data is obtained from the message queue server, and the source data is written into the target database set by the subscriber, so that data synchronization among different platform systems is realized through the message queue server, interaction between the target database and the source database is reduced, and the safety of the data in the database is ensured.
The computer readable storage medium of the embodiments of the present invention may include any entity or device capable of carrying computer program code, a recording medium, such as a ROM/RAM, a magnetic disk, an optical disk, a flash memory, or the like.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (11)
1. A data synchronization system, comprising a synchronization management platform, a data synchronization node, and a message queue server, wherein:
the synchronous management platform is used for receiving a data synchronization task from a source database to a target database and pushing a synchronous task configuration corresponding to the data synchronization task to the data synchronization node;
and the data synchronization node is used for reading source data needing synchronization from the source database according to the synchronization task configuration and the log of the source database, putting the source data into the message queue server, acquiring the source data from the message queue server when detecting the source data subscribed by the subscriber, and writing the source data into a target database set by the subscriber.
2. The data synchronization system of claim 1, wherein the system further comprises:
the local cache server is configured to cache the source data to be placed in the message queue server by the data synchronization node when the source data is placed in the message queue server by the data synchronization node, and push the cached source data to the message queue server.
3. The data synchronization system of claim 1, wherein the system further comprises:
and the external cache server is used for caching the source data acquired from the message queue server and writing the cached source data into a target database set by a subscriber when the data synchronization node writes the source data into the target database set by the subscriber.
4. The data synchronization system of claim 1, wherein the data synchronization node is further configured to detect a stream of delivered files, and when a synchronized file subscribed to by a subscriber is detected, to send the synchronized file to a target file.
5. A data synchronization method based on the data synchronization system of claim 1, comprising:
according to the synchronization task configuration and the log of the source database sent by the synchronization management platform, the data synchronization node reads source data needing synchronization from the source database and puts the source data into a message queue server;
when the source data subscribed by the subscriber is detected, the data synchronization node acquires the source data from the message queue server and writes the source data into a target database set by the subscriber.
6. The data synchronization method of claim 5, wherein the data synchronization system further comprises a local cache server, and the step of placing the source data into a message queue server comprises:
caching the source data to be put into the message queue server by the data synchronization node to the local cache server, and pushing the cached source data to the message queue server.
7. The data synchronization method of claim 5, wherein the data synchronization system further comprises an external cache server, and the step of writing the source data to a target database set by a subscriber comprises:
and caching the source data acquired from the message queue server to the external cache server, and writing the cached source data into a target database set by a subscriber.
8. The data synchronization method of claim 5, further comprising:
and the data synchronization node detects the transmitted file stream, and sends the synchronization file to a target file when detecting the synchronization file subscribed by the subscriber.
9. A data synchronization apparatus based on the data synchronization system of claim 1, comprising:
the data publishing unit is used for reading source data needing synchronization from the source database by the data synchronization node according to the synchronization task configuration and the log of the source database sent by the synchronization management platform and putting the source data into the message queue server; and
and the data writing unit is used for acquiring the source data from the message queue server by the data synchronization node and writing the source data into a target database set by the subscriber when the source data subscribed by the subscriber is detected.
10. A synchronization device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 5 to 8 when executing the computer program.
11. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 5 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910999995.XA CN110765206A (en) | 2019-10-21 | 2019-10-21 | Data synchronization system, method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910999995.XA CN110765206A (en) | 2019-10-21 | 2019-10-21 | Data synchronization system, method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110765206A true CN110765206A (en) | 2020-02-07 |
Family
ID=69332528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910999995.XA Pending CN110765206A (en) | 2019-10-21 | 2019-10-21 | Data synchronization system, method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110765206A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111400408A (en) * | 2020-04-13 | 2020-07-10 | 上海东普信息科技有限公司 | Data synchronization method, device, equipment and storage medium |
| CN111581244A (en) * | 2020-05-14 | 2020-08-25 | 厦门中控智慧信息技术有限公司 | Method, system and equipment for orderly synchronizing business transaction data of heterogeneous system |
| CN112380227A (en) * | 2020-11-12 | 2021-02-19 | 平安科技（深圳）有限公司 | Data synchronization method, device and equipment based on message queue and storage medium |
| CN112597123A (en) * | 2020-11-20 | 2021-04-02 | 贝壳技术有限公司 | Data multi-version dynamic switching method and device |
| CN112836236A (en) * | 2021-02-04 | 2021-05-25 | 航天广通科技(深圳)有限公司 | Method and system for subscribing database table resources of data sharing exchange platform |
| CN113377863A (en) * | 2020-03-10 | 2021-09-10 | 阿里巴巴集团控股有限公司 | Data synchronization method and device, electronic equipment and computer readable storage medium |
| CN114143375A (en) * | 2020-08-13 | 2022-03-04 | 支付宝实验室(新加坡)有限公司 | Method and system for distributing data |
| CN115329006A (en) * | 2022-08-31 | 2022-11-11 | 保利和悦生活科技服务有限公司 | Data synchronization method and system for network mall background and third-party interface |
| CN115630124A (en) * | 2022-12-06 | 2023-01-20 | 北京志翔科技股份有限公司 | Data interconnection method, device and equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030037029A1 (en) * | 2001-08-15 | 2003-02-20 | Iti, Inc. | Synchronization of plural databases in a database replication system |
| US20100153351A1 (en) * | 2008-12-16 | 2010-06-17 | Yung Alex P | Techniques for real-time database processing |
| CN105095364A (en) * | 2015-06-26 | 2015-11-25 | 车智互联（北京）科技有限公司 | Data synchronizing system and method |
| CN108256002A (en) * | 2017-12-31 | 2018-07-06 | 广东欧珀移动通信有限公司 | Across computer room method of data synchronization, device, system and server |
| CN109582731A (en) * | 2018-10-18 | 2019-04-05 | 恒峰信息技术有限公司 | A kind of real time data synchronization method and system |
| CN110162571A (en) * | 2019-04-26 | 2019-08-23 | 厦门市美亚柏科信息股份有限公司 | A kind of system, method, storage medium that data among heterogeneous databases synchronize |
-
2019
- 2019-10-21 CN CN201910999995.XA patent/CN110765206A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030037029A1 (en) * | 2001-08-15 | 2003-02-20 | Iti, Inc. | Synchronization of plural databases in a database replication system |
| US20100153351A1 (en) * | 2008-12-16 | 2010-06-17 | Yung Alex P | Techniques for real-time database processing |
| CN105095364A (en) * | 2015-06-26 | 2015-11-25 | 车智互联（北京）科技有限公司 | Data synchronizing system and method |
| CN108256002A (en) * | 2017-12-31 | 2018-07-06 | 广东欧珀移动通信有限公司 | Across computer room method of data synchronization, device, system and server |
| CN109582731A (en) * | 2018-10-18 | 2019-04-05 | 恒峰信息技术有限公司 | A kind of real time data synchronization method and system |
| CN110162571A (en) * | 2019-04-26 | 2019-08-23 | 厦门市美亚柏科信息股份有限公司 | A kind of system, method, storage medium that data among heterogeneous databases synchronize |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113377863A (en) * | 2020-03-10 | 2021-09-10 | 阿里巴巴集团控股有限公司 | Data synchronization method and device, electronic equipment and computer readable storage medium |
| CN113377863B (en) * | 2020-03-10 | 2022-04-29 | 阿里巴巴集团控股有限公司 | Data synchronization method and device, electronic equipment and computer readable storage medium |
| CN111400408A (en) * | 2020-04-13 | 2020-07-10 | 上海东普信息科技有限公司 | Data synchronization method, device, equipment and storage medium |
| CN111400408B (en) * | 2020-04-13 | 2023-06-09 | 上海东普信息科技有限公司 | Data synchronization method, device, equipment and storage medium |
| CN111581244B (en) * | 2020-05-14 | 2023-04-25 | 厦门熵基科技有限公司 | Method, system and equipment for orderly synchronizing service transaction data of heterogeneous system |
| CN111581244A (en) * | 2020-05-14 | 2020-08-25 | 厦门中控智慧信息技术有限公司 | Method, system and equipment for orderly synchronizing business transaction data of heterogeneous system |
| CN114143375A (en) * | 2020-08-13 | 2022-03-04 | 支付宝实验室(新加坡)有限公司 | Method and system for distributing data |
| CN112380227A (en) * | 2020-11-12 | 2021-02-19 | 平安科技（深圳）有限公司 | Data synchronization method, device and equipment based on message queue and storage medium |
| CN112380227B (en) * | 2020-11-12 | 2024-05-07 | 平安科技（深圳）有限公司 | Data synchronization method, device, equipment and storage medium based on message queue |
| CN112597123A (en) * | 2020-11-20 | 2021-04-02 | 贝壳技术有限公司 | Data multi-version dynamic switching method and device |
| CN112597123B (en) * | 2020-11-20 | 2023-01-06 | 贝壳技术有限公司 | Data multi-version dynamic switching method and device |
| CN112836236A (en) * | 2021-02-04 | 2021-05-25 | 航天广通科技(深圳)有限公司 | Method and system for subscribing database table resources of data sharing exchange platform |
| CN115329006A (en) * | 2022-08-31 | 2022-11-11 | 保利和悦生活科技服务有限公司 | Data synchronization method and system for network mall background and third-party interface |
| CN115329006B (en) * | 2022-08-31 | 2023-08-04 | 保利和悦生活科技服务有限公司 | Data synchronization method and system for background and third party interface of network mall |
| CN115630124A (en) * | 2022-12-06 | 2023-01-20 | 北京志翔科技股份有限公司 | Data interconnection method, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110765206A (en) | Data synchronization system, method, device, equipment and storage medium | |
| JP6865219B2 (en) | Event batch processing, output sequencing, and log-based state storage in continuous query processing | |
| US8418003B2 (en) | Log collecting apparatus, program, method, and system | |
| US9715507B2 (en) | Techniques for reconciling metadata and data in a cloud storage system without service interruption | |
| WO2022063284A1 (en) | Data synchronization method and apparatus, device, and computer-readable medium | |
| CN111177161B (en) | Data processing method, device, computing equipment and storage medium | |
| CN110968438B (en) | Asynchronous notification method and device of event message, electronic equipment and storage medium | |
| CN106960007A (en) | A kind of data-updating method, device and electronic equipment | |
| US8683489B2 (en) | Message queue transaction tracking using application activity trace data | |
| EP2779583B1 (en) | Telecommunication method and system | |
| CN111131079B (en) | Policy query method and device | |
| CN110753084B (en) | Uplink data reading method, cache server and computer readable storage medium | |
| JP6987340B2 (en) | Database data change request processing method and equipment | |
| CN110222039B (en) | Data storage and garbage data cleaning method, device, equipment and storage medium | |
| US12001450B2 (en) | Distributed table storage processing method, device and system | |
| CN113792094A (en) | Data synchronization system, method, device and medium | |
| CN111753141B (en) | Data management method and related equipment | |
| CN111338834A (en) | Data storage method and device | |
| CN114676199A (en) | Synchronization method, synchronization system, computer equipment and storage medium | |
| CN114844771A (en) | Monitoring method, device, storage medium and program product for micro-service system | |
| CN105574026A (en) | Method and device for service supporting by using non-relational database | |
| CN116501700B (en) | APP formatted file offline storage method, device, equipment and storage medium | |
| CN110309206B (en) | Order information acquisition method and system | |
| CN115168440A (en) | Data read-write method, distributed storage system, device, equipment and storage medium | |
| CN112632211A (en) | Semantic information processing method and equipment for mobile robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200207 |
|
| RJ01 | Rejection of invention patent application after publication |