CN112910971A - Multi-station data synchronization method, device and system - Google Patents
Multi-station data synchronization method, device and system Download PDFInfo
- Publication number
- CN112910971A CN112910971A CN202110081386.3A CN202110081386A CN112910971A CN 112910971 A CN112910971 A CN 112910971A CN 202110081386 A CN202110081386 A CN 202110081386A CN 112910971 A CN112910971 A CN 112910971A
- Authority
- CN
- China
- Prior art keywords
- site
- city
- message middleware
- same
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0663—Performing the actions predefined by failover planning, e.g. switching to standby network elements
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Hardware Redundancy (AREA)
Abstract
The invention provides a multi-site data synchronization method, device and system, which can be used in the financial field or other fields. The method comprises the following steps: receiving main site application data sent by a main site interceptor in a synchronous writing mode through first message middleware, and sending the main site application data to same city site message middleware in a synchronous writing mode through the first message middleware; and receiving the application data of the same city site sent by the same city site interceptor in a synchronous writing mode through a second message middleware, and sending the application data of the same city site to a main site message middleware in a synchronous writing mode through the second message middleware. The invention optimizes the data transmission architecture, solves the problem of data synchronization efficiency of the same city site, improves the RTO of the same city site, and can quickly take over the service and improve the continuity level of the service in the scene of main site failure.
Description
Technical Field
The present invention relates to the field of disaster recovery technology, and in particular, to a method, an apparatus, and a system for synchronizing multi-site data.
Background
With the popularization of internet technology, enterprise business activities implement informatization and digitization. In order to resist the loss of enterprise operation information caused by non-resistance factors (such as earthquake, tsunami, fire, terrorist attack and the like), the data center construction of an enterprise usually adopts a two-place two-center or multi-place multi-center architecture to realize high availability at a site level, and when a production site encounters a site-level disaster, the enterprise recovers the customer service through a remote site, thereby reducing the influence of the disaster on enterprise operation activities to the minimum extent and improving the business continuity level of the enterprise. Due to the influence of the distance between the remote disaster recovery system and the main site, the data transmission between the main site and the remote site is performed in a synchronous transmission mode, which results in a long transmission time, affects the transaction performance of the main site, and reduces the concurrent processing capacity of the main site, so the data synchronization between the two sites is generally realized in an asynchronous transmission mode. Data synchronization can have a certain delay, and in the case of a site-level disaster, since delayed data is not transmitted to a disaster recovery site, a remote disaster recovery site generally loses service data for tens of seconds to several minutes, which affects the continuity level of the service, and thus a scheme capable of reducing data transmission delay is required to ensure the integrity of data of the remote disaster recovery site.
In addition, when the main site fails, the enterprise emergency strategy generally optimizes and considers starting the same city site to take over, and only when the main site and the same city site fail simultaneously, the remote site is considered to be started. Data of the same-city site is asynchronously transmitted from the main site, and it takes a certain Time to completely transmit the data of the main site to the same-city site, thereby affecting RTO (Recovery Time Objective) of the same-city site taking over the service of the main site. It is therefore necessary to consider how quickly the data of the primary site is transmitted to the same city site.
Disclosure of Invention
Aiming at the problems in the prior art, embodiments of the present invention mainly aim to provide a method, an apparatus, and a system for synchronizing multi-site data, so as to implement quick service taking over of a main site by a co-located site, ensure the integrity of co-located service data, and improve the RTO level of disaster recovery.
In order to achieve the above object, an embodiment of the present invention provides a method for synchronizing data of multiple sites, where the method includes:
receiving main site application data sent by a main site interceptor in a synchronous writing mode through first message middleware, and sending the main site application data to same city site message middleware in a synchronous writing mode through the first message middleware;
and receiving the application data of the same city site sent by the same city site interceptor in a synchronous writing mode through a second message middleware, and sending the application data of the same city site to a main site message middleware in a synchronous writing mode through the second message middleware.
Optionally, in an embodiment of the present invention, the method further includes: and copying the application data of the main site to a third message middleware of the remote disaster recovery site through the first message middleware by using an asynchronous transmission mode.
Optionally, in an embodiment of the present invention, the method further includes: and copying the application data of the same city site to a fourth message middleware of a remote disaster recovery site through the second message middleware in an asynchronous transmission mode.
The embodiment of the invention also provides a multi-site data synchronization device, which comprises:
the system comprises a first data synchronization module, a second data synchronization module and a third data synchronization module, wherein the first data synchronization module is used for receiving main site application data sent by a main site interceptor in a synchronous writing mode through first message middleware and sending the main site application data to same city site message middleware in a synchronous writing mode through the first message middleware;
and the second data synchronization module is used for receiving the same-city site application data sent by the same-city site interceptor in a synchronous writing mode through second message middleware, and sending the same-city site application data to the main site message middleware in a synchronous writing mode through the second message middleware.
Optionally, in an embodiment of the present invention, the first data synchronization module is further configured to transmit the primary site application data to the remote disaster recovery site through the first message middleware in an asynchronous transmission manner.
Optionally, in an embodiment of the present invention, the second data synchronization module is further configured to transmit the application data of the same-city site to the remote disaster recovery site through the second message middleware in an asynchronous transmission manner.
The embodiment of the invention also provides a multi-site data synchronization system, which comprises: main website, near city disaster recovery center and with the city website, near city disaster recovery center with the main website reaches with city website communication connection, wherein:
the main site synchronously writes the application data of the main site into first message middleware in the city-adjacent disaster recovery center by using a main site interceptor; the first message middleware synchronously writes the main site application data into the same city site message middleware;
the same-city station synchronously writes the application data of the same-city station into a second message middleware in the city-near disaster recovery center by using a same-city station interceptor; and the second message middleware synchronously writes the same-city site application data into the main site message middleware.
Optionally, in an embodiment of the present invention, the primary site further includes a primary site reconciliation platform, configured to obtain application data of the co-city site in the primary site message middleware, and perform automatic reconciliation on an application system of the primary site.
Optionally, in an embodiment of the present invention, the city site further includes a city site reconciliation platform, which obtains main site application data in the city site message middleware, and performs automatic reconciliation on an application system of the city site.
Optionally, in an embodiment of the present invention, the system further includes a remote disaster recovery site, and the remote disaster recovery site is in communication connection with the near-city disaster recovery center.
Optionally, in an embodiment of the present invention, the first message middleware is further configured to transmit the primary site application data to a third message middleware of the remote disaster recovery site in an asynchronous transmission manner.
Optionally, in an embodiment of the present invention, the second message middleware is further configured to transmit the application data of the same-city site to a fourth message middleware of a remote disaster recovery site in an asynchronous transmission manner.
Optionally, in an embodiment of the present invention, the remote disaster recovery site further includes a remote disaster recovery site reconciliation platform, configured to obtain main site application data in a third message middleware and co-located site application data in a fourth message middleware of the remote disaster recovery site, and perform automatic reconciliation on an application system of the remote disaster recovery site.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method when executing the program.
The present invention also provides a computer-readable storage medium storing a computer program for executing the above method.
The invention optimizes the data transmission architecture, solves the problem of data synchronization efficiency of the same city site, improves the RTO of the same city site, and can quickly take over the service and improve the continuity level of the service in the scene of main site failure.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is a diagram of a data synchronization system of a disaster recovery site in the prior art;
FIG. 2 is a flowchart of a multi-site data synchronization method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a system architecture for implementing a multi-site data synchronization method according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a multi-site data synchronization system according to an embodiment of the present invention;
FIG. 5 is a block diagram of a multi-site data synchronization system according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a multi-site data synchronization apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a multi-site data synchronization method, device and system, which can be used in the financial field or other fields.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Taking two places and three centers as an IT architecture as an example, by constructing a near-city disaster backup site near two sites in the same city (less than 100 kilometers), transmitting transactions generated by a main site to the near-city disaster backup site in a synchronous mode, and transmitting the transactions to a different-place site and the same-city site in an asynchronous mode, data loss of the different-place site and the same-city site is avoided, and the problem of data loss of the different-place site is solved.
First, a structure diagram (shown in fig. 1) of a data synchronization system of a disaster recovery site in the prior art is briefly described. The system in fig. 1 adopts a two-place-three-center architecture, two sites in the same city A, B are production double-live sites, and a remote site C is a disaster recovery site. The application system writes the application data into message middleware (such as kafka) through the interceptor, and then transmits the application data to the same city site and the different place site through the message middleware. Taking the same-city site a as the main site as an example, in the prior art, data of the same-city site a is written into a local message middleware first, and then is asynchronously transmitted to the same-city site and a different-place site through a data transmission function of the message middleware, the writing operation of the interceptor is unequal and complete in data transmission, and the whole process is an asynchronous mechanism, so that the data of the same-city site B and the different-place site C has a certain delay, and generally service data of tens of seconds to several minutes is lost. The same-city site A and the same-city site B serve as double-living sites, symmetrical deployment is implemented, data of the same-city site A are copied to the same-city site A and the different-place site C at the same time, and data of the same-city site B are copied to the same-city site A and the different-place site C at the same time, so that the same-city site A, B and the different-place site C both have full application data (data of sites outside a main site have certain delay), and therefore the same-city different-place multiple backup of multiple data center sites is achieved. When a sudden site-level disaster (total site data loss) occurs at the same time with the city A, B site, the data of the offsite site C is lost to some extent.
In the actual operation and maintenance process, the general emergency step is that when the main site breaks down, the same-city site is started to take over; and when the main site and the same-city site simultaneously break down, starting the different-place site to take over. In order to integrally solve the problem of data synchronization between a same-city site and a different-place site, promote an RTO (Recovery Point Objective) index and an RPO (Recovery Point Objective) index of the same-city site, and promote a different-place disaster Recovery RPO index, as shown in fig. 2, a flowchart of a multi-site data synchronization method according to an embodiment of the present invention is shown, where the method shown in the diagram includes:
step S1, receiving, by the first message middleware, primary site application data sent by the primary site interceptor in a synchronous write-in manner, and sending, by the first message middleware, the primary site application data to the same city site message middleware in a synchronous write-in manner.
Fig. 3 is a schematic diagram of a system structure applying the multi-site data synchronization method, and the multi-site data synchronization method of the present invention is described below with reference to fig. 3. The executing main body of the multi-site data synchronization method of the present invention can be the city-near disaster recovery center in fig. 3. In fig. 3, the city A, B site is a dual-active site, functions are symmetrically deployed, and online data of the city site a is completely backed up in the city disaster recovery center, the city site B and the remote site C at the same time; the online data of the city-near site B is completely backed up in the city-near disaster recovery center, the city-near site A and the remote site C. The city site A and the city site B realize mutual backup, and complete transaction data of the other site is obtained in real time, so that the city site can be quickly taken over.
Specifically, in fig. 3, of the two sites in the same city A, B, the site a in the same city is taken as an example of a main site, and near the two sites A, B in the same city, a near-city disaster recovery center is constructed. The city-near disaster recovery center only serves as a data backup flow transfer station and does not serve as a backup for a job station, so that the construction cost is very low.
The main site A and the city-sharing site B have the same internal structure and are provided with message middleware, an application system and an account repairing platform, and the city-near disaster preparation center is provided with the message middleware. The interceptor of the primary site a adjusts the operation originally written into the local message middleware into synchronous writing into the primary node of the first message middleware in the temporary disaster recovery center, and the primary node of the first message middleware synchronously writes the application data of the primary site into the backup node of the first message middleware in the same city site (i.e. the message middleware of the same city site). By synchronous writing, the application data of the main site can be ensured to be completely written into the city-near disaster recovery center and the city-sharing site B.
Two sets of message middleware are deployed in the city-near disaster recovery center, the first message middleware is responsible for data transmission of a same city site A (main site), and the second message middleware is responsible for data transmission of a same city site B. The first and second message middleware adopt a main-standby architecture mode, the main node is deployed in the city-adjacent disaster center, the standby node is deployed in the main site and the city-adjacent site B, and the main and standby nodes adopt a synchronous replication mode, namely, when the main and standby nodes are successfully written at the same time, the operation of writing the message middleware is successful.
Step S2, receiving, by the second message middleware, the application data of the same city site sent by the same city site interceptor in a synchronous write-in manner, and sending, by the second message middleware, the application data of the same city site to the message middleware of the primary site in a synchronous write-in manner.
Wherein, each message middleware plays a role of data transfer, and the data received by the message middleware comes from the data written by the interceptor or the data transmitted by the upstream message middleware. And the data written by the interceptor is transmitted to the downstream message middleware after being transferred in the message middleware, and the data transmitted by the upstream message middleware is transmitted to the corresponding reimbursement platform after being transferred in the message middleware.
Similar to the transmission process of the application data of the main site, the same-city site synchronously writes the application data of the same-city site into a main node of a second message middleware in the near-city disaster recovery center by using an interceptor in an application system of the same-city site. The second message middleware master node synchronously writes the application data of the same city site into a second message middleware standby node (namely, master site message middleware) in the master site. By synchronous writing, the application data of the same city site B can be completely written into the city-near disaster recovery center and the main site.
As shown in fig. 3, the reconciliation platform in the primary site obtains the application data in the second message middleware standby node, and performs automatic reconciliation on the application system in the primary site.
The main site is provided with an account compensation platform, and the account compensation platform in the main site can realize quick compensation of disaster recovery data by using an automatic account compensation mechanism.
As shown in fig. 3, the reconciliation platform in the same city site obtains the application data in the first message middleware standby node, and performs automatic reconciliation on the application system in the same city site.
The account repairing platform in the same city site utilizes an automatic account repairing mechanism, and can realize quick back-repairing of disaster recovery data.
As an embodiment of the invention, the method further comprises: and transmitting the application data of the main site to a third message middleware of the remote disaster recovery site through the first message middleware in an asynchronous transmission mode.
In this embodiment, the method further includes: and transmitting the application data of the same city site to a fourth message middleware of the remote disaster recovery site through the second message middleware in an asynchronous transmission mode.
The system applying the multi-site data synchronization method shown in fig. 3 further includes a remote disaster recovery site (remote site C), where the remote site C deploys two sets of message middleware, namely a third message middleware and a fourth message middleware, establishes an asynchronous replication relationship with the first message middleware host node and the second message middleware host node of the temporary disaster recovery center, and transmits data of the two sets of message middleware of the temporary disaster recovery center to the remote site C in an asynchronous manner.
In this embodiment, the reconciliation platform in the remote disaster recovery site obtains application data in the third message middleware and the fourth message middleware of the remote disaster recovery site, and performs automatic reconciliation on the application system of the remote disaster recovery site.
The remote disaster recovery backup station is provided with an account compensation platform, and the account compensation platform can realize quick compensation of disaster recovery backup data by using an automatic account compensation mechanism.
According to the invention, the city disaster recovery center is built to serve as data transfer, the transaction data generated by the main site is synchronously transmitted to the city disaster recovery center and the same-city site and is asynchronously transmitted to the different-place site, zero loss of backup data of the same-city site and the different-place site is realized, and the business continuity level of enterprise disaster recovery is improved. The realization effect is as follows:
1) when the main site fails, the same-city site has complete backup data, so that service data complementation is realized through the disaster recovery backup process, the service of the main site can be quickly taken over, zero loss of service data is realized, the integrity of the same-city service data is ensured, and the RPO and RTO levels of disaster recovery backup are improved.
2) When the main site and the same-city site simultaneously have faults, the remote disaster recovery backup site obtains complete business backup data through the near-city disaster recovery center, zero loss of business data is achieved, integrity of the business data of the remote disaster recovery backup site is guaranteed, and RPO level of disaster recovery is improved.
Fig. 4 is a schematic structural diagram of a multi-site data synchronization system according to an embodiment of the present invention, where the system shown in the diagram includes: main website 10, near city disaster recovery center 20 and with city website 30, near city disaster recovery center with the main website reaches with city website communication connection, wherein:
the main site synchronously writes the application data of the main site into first message middleware in the city-adjacent disaster recovery center by using a main site interceptor; the first message middleware synchronously writes the main site application data into the same city site message middleware;
the same-city station synchronously writes the application data of the same-city station into a second message middleware in the city-near disaster recovery center by using a same-city station interceptor; and the second message middleware synchronously writes the same-city site application data into the main site message middleware.
As an embodiment of the present invention, the primary site further includes a primary site reconciliation platform, configured to obtain application data of the co-city site in the primary site message middleware, and perform automatic reconciliation on an application system of the primary site.
As an embodiment of the present invention, the same-city site further includes a same-city site reconciliation platform, configured to acquire main site application data in the same-city site message middleware, and perform automatic reconciliation on an application system of the same-city site.
As an embodiment of the present invention, as shown in fig. 5, the system further includes a remote disaster recovery site 40, and the remote disaster recovery site is in communication connection with the near-city disaster recovery center.
In this embodiment, the first message middleware is further configured to transmit the primary site application data to a third message middleware of the remote disaster recovery site in an asynchronous transmission manner.
In this embodiment, the second message middleware is further configured to transmit the application data of the same-city site to a fourth message middleware of a disaster recovery site in an asynchronous transmission manner.
In this embodiment, the remote disaster recovery site further includes a remote disaster recovery site reconciliation platform, configured to obtain main site application data in a third message middleware and in-city site application data in a fourth message middleware of the remote disaster recovery site, and perform automatic reconciliation on an application system of the remote disaster recovery site.
Based on the same application concept as the multi-site data synchronization method, the invention also provides the multi-site data synchronization system. Because the principle of solving the problem of the multi-site data synchronization system is similar to that of the multi-site data synchronization method, the implementation of the multi-site data synchronization system can refer to the implementation of the multi-site data synchronization method, and repeated details are omitted.
The city-near disaster recovery center is established near the production site, the architecture of data transmission is optimized, the problem of data synchronization efficiency of the same-city site is solved, the RTO of the same-city site is improved, the same-city site can take over the service quickly in the scene of main site failure, and the continuity level of the service is improved.
Fig. 6 is a schematic structural diagram of a multi-site data synchronization apparatus according to an embodiment of the present invention, where the apparatus includes:
the first data synchronization module 101 is configured to receive, through first message middleware, primary site application data sent by a primary site interceptor in a synchronous write-in manner, and send, through the first message middleware, the primary site application data to a city site message middleware in a synchronous write-in manner;
the second data synchronization module 102 is configured to receive, through second message middleware, the same-city-site application data sent by the same-city-site interceptor in a synchronous write-in manner, and send, through the second message middleware, the same-city-site application data to the primary-site message middleware in a synchronous write-in manner.
As an embodiment of the present invention, the first data synchronization module is further configured to transmit the primary site application data to the remote disaster recovery site through the first message middleware in an asynchronous transmission manner.
As an embodiment of the present invention, the second data synchronization module is further configured to transmit the application data of the same-city site to the remote disaster recovery site through the second message middleware in an asynchronous transmission manner.
Based on the same application concept as the multi-site data synchronization method, the invention also provides the multi-site data synchronization device. Because the principle of solving the problem of the multi-site data synchronization device is similar to that of a multi-site data synchronization method, the implementation of the multi-site data synchronization device can refer to the implementation of the multi-site data synchronization method, and repeated details are omitted.
The city-near disaster recovery center is established near the production site, the architecture of data transmission is optimized, the problem of data synchronization efficiency of the same-city site is solved, the RTO of the same-city site is improved, the same-city site can take over the service quickly in the scene of main site failure, and the continuity level of the service is improved.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method when executing the program.
The present invention also provides a computer-readable storage medium storing a computer program for executing the above method.
As shown in fig. 7, the electronic device 600 may further include: communication module 110, input unit 120, audio processing unit 130, display 160, power supply 170. It is noted that the electronic device 600 does not necessarily include all of the components shown in fig. 7; furthermore, the electronic device 600 may also comprise components not shown in fig. 7, which may be referred to in the prior art.
As shown in fig. 7, the central processor 100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, the central processor 100 receiving input and controlling the operation of the various components of the electronic device 600.
The memory 140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 100 may execute the program stored in the memory 140 to realize information storage or processing, etc.
The input unit 120 provides input to the cpu 100. The input unit 120 is, for example, a key or a touch input device. The power supply 170 is used to provide power to the electronic device 600. The display 160 is used to display an object to be displayed, such as an image or a character. The display may be, for example, an LCD display, but is not limited thereto.
The memory 140 may be a solid state memory such as Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 140 may also be some other type of device. Memory 140 includes buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application/function storage section 142, and the application/function storage section 142 is used to store application programs and function programs or a flow for executing the operation of the electronic device 600 by the central processing unit 100.
The memory 140 may also include a data store 143, the data store 143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by the electronic device. The driver storage portion 144 of the memory 140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging application, address book application, etc.).
The communication module 110 is a transmitter/receiver 110 that transmits and receives signals via an antenna 111. The communication module (transmitter/receiver) 110 is coupled to the central processor 100 to provide an input signal and receive an output signal, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 110 is also coupled to a speaker 131 and a microphone 132 via an audio processor 130 to provide audio output via the speaker 131 and receive audio input from the microphone 132 to implement general telecommunications functions. Audio processor 130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, an audio processor 130 is also coupled to the central processor 100, so that recording on the local can be enabled through a microphone 132, and so that sound stored on the local can be played through a speaker 131.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (15)
1. A multi-site data synchronization method, the method comprising:
receiving main site application data sent by a main site interceptor in a synchronous writing mode through first message middleware, and sending the main site application data to same city site message middleware in a synchronous writing mode through the first message middleware;
and receiving the application data of the same city site sent by the same city site interceptor in a synchronous writing mode through a second message middleware, and sending the application data of the same city site to a main site message middleware in a synchronous writing mode through the second message middleware.
2. The method of claim 1, further comprising: and transmitting the application data of the main site to the remote disaster recovery site through the first message middleware in an asynchronous transmission mode.
3. The method of claim 1, further comprising: and transmitting the application data of the same city site to a remote disaster recovery site through the second message middleware in an asynchronous transmission mode.
4. A multi-site data synchronization apparatus, the apparatus comprising:
the system comprises a first data synchronization module, a second data synchronization module and a third data synchronization module, wherein the first data synchronization module is used for receiving main site application data sent by a main site interceptor in a synchronous writing mode through first message middleware and sending the main site application data to same city site message middleware in a synchronous writing mode through the first message middleware;
and the second data synchronization module is used for receiving the same-city site application data sent by the same-city site interceptor in a synchronous writing mode through second message middleware, and sending the same-city site application data to the main site message middleware in a synchronous writing mode through the second message middleware.
5. The apparatus of claim 4, wherein the first data synchronization module is further configured to transmit the primary site application data to the disaster recovery site through the first message middleware in an asynchronous transmission manner.
6. The apparatus according to claim 4, wherein the second data synchronization module is further configured to transmit the application data of the same-city site to the disaster recovery site through the second message middleware in an asynchronous transmission manner.
7. A multi-site data synchronization system, the system comprising: main website, near city disaster recovery center and with the city website, near city disaster recovery center with the main website reaches with city website communication connection, wherein:
the main site synchronously writes the application data of the main site into first message middleware in the city-adjacent disaster recovery center by using a main site interceptor; the first message middleware synchronously writes the main site application data into the same city site message middleware;
the same-city station synchronously writes the application data of the same-city station into a second message middleware in the city-near disaster recovery center by using a same-city station interceptor; and the second message middleware synchronously writes the same-city site application data into the main site message middleware.
8. The system of claim 7, wherein the primary site further comprises a primary site reimbursement platform configured to obtain data for applications at the same site in the primary site messaging middleware for automated reimbursement of the applications at the primary site.
9. The system of claim 7, wherein the city site further comprises a city site reimbursement platform for obtaining primary site application data in the city site messaging middleware and automatically reimbursement application systems of the city site.
10. The system of claim 7, further comprising an offsite disaster recovery site communicatively coupled to the neighborhood disaster recovery center.
11. The system of claim 10, wherein the first message middleware is further configured to transmit the primary site application data to a third message middleware of a disaster recovery site using asynchronous transmission.
12. The system according to claim 11, wherein the second message middleware is further configured to transmit the data of the co-located site application to a fourth message middleware of the disaster recovery site by using an asynchronous transmission mode.
13. The system according to claim 12, wherein the remote disaster recovery site further comprises a remote disaster recovery site reconciliation platform, configured to obtain host site application data in a third message middleware and co-located site application data in a fourth message middleware of the remote disaster recovery site, and perform automatic reconciliation on the application system of the remote disaster recovery site.
14. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 3 when executing the program.
15. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the method of any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110081386.3A CN112910971B (en) | 2021-01-21 | 2021-01-21 | Multi-station data synchronization method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110081386.3A CN112910971B (en) | 2021-01-21 | 2021-01-21 | Multi-station data synchronization method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112910971A true CN112910971A (en) | 2021-06-04 |
| CN112910971B CN112910971B (en) | 2023-04-07 |
Family
ID=76117935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110081386.3A Active CN112910971B (en) | 2021-01-21 | 2021-01-21 | Multi-station data synchronization method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112910971B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9928125B1 (en) * | 2017-07-13 | 2018-03-27 | International Business Machines Corporation | Message queueing in middleware by a message broker |
| US20180159731A1 (en) * | 2015-01-23 | 2018-06-07 | Ebay Inc. | Processing high volume network data |
| CN108833479A (en) * | 2018-05-18 | 2018-11-16 | 吉林亿联银行股份有限公司 | A kind of method of data synchronization and device |
| CN109885429A (en) * | 2019-02-18 | 2019-06-14 | 国家计算机网络与信息安全管理中心 | Big data disaster recovery method and device |
| CN109901949A (en) * | 2019-02-25 | 2019-06-18 | 中国工商银行股份有限公司 | The application disaster recovery and backup systems and method of dual-active data center |
| CN110502583A (en) * | 2019-08-27 | 2019-11-26 | 深圳前海微众银行股份有限公司 | Distributed Data Synchronization method, apparatus, equipment and readable storage medium storing program for executing |
| US20200059376A1 (en) * | 2018-08-20 | 2020-02-20 | T-Mobile Usa, Inc. | Eventually consistent data replication in queue-based messaging systems |
| CN112181723A (en) * | 2020-09-22 | 2021-01-05 | 中国建设银行股份有限公司 | Financial disaster recovery method and device, storage medium and electronic equipment |
-
2021
- 2021-01-21 CN CN202110081386.3A patent/CN112910971B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180159731A1 (en) * | 2015-01-23 | 2018-06-07 | Ebay Inc. | Processing high volume network data |
| US9928125B1 (en) * | 2017-07-13 | 2018-03-27 | International Business Machines Corporation | Message queueing in middleware by a message broker |
| CN108833479A (en) * | 2018-05-18 | 2018-11-16 | 吉林亿联银行股份有限公司 | A kind of method of data synchronization and device |
| US20200059376A1 (en) * | 2018-08-20 | 2020-02-20 | T-Mobile Usa, Inc. | Eventually consistent data replication in queue-based messaging systems |
| CN109885429A (en) * | 2019-02-18 | 2019-06-14 | 国家计算机网络与信息安全管理中心 | Big data disaster recovery method and device |
| CN109901949A (en) * | 2019-02-25 | 2019-06-18 | 中国工商银行股份有限公司 | The application disaster recovery and backup systems and method of dual-active data center |
| CN110502583A (en) * | 2019-08-27 | 2019-11-26 | 深圳前海微众银行股份有限公司 | Distributed Data Synchronization method, apparatus, equipment and readable storage medium storing program for executing |
| CN112181723A (en) * | 2020-09-22 | 2021-01-05 | 中国建设银行股份有限公司 | Financial disaster recovery method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112910971B (en) | 2023-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111539726B (en) | Block chain consensus system and method | |
| JP7422856B2 (en) | Node data synchronization method and device, system, electronic equipment, storage medium and computer program | |
| CN111897878B (en) | Master-slave data synchronization method and system | |
| CN109525636B (en) | Block chain consensus method based on Raft algorithm | |
| CN109901949A (en) | The application disaster recovery and backup systems and method of dual-active data center | |
| CN112612851B (en) | Multi-center data synchronization method and device | |
| EP4213037A1 (en) | Data storage and reconciliation method and system | |
| JP2017536624A (en) | Snapshot processing methods and associated devices | |
| CN111949614A (en) | Bank system file conversion method and device | |
| CN111222869A (en) | Transaction data processing method, device, computer equipment and medium | |
| CN111427918A (en) | Transaction detail data comparison method and device | |
| CN112181723A (en) | Financial disaster recovery method and device, storage medium and electronic equipment | |
| CN112929438B (en) | Business processing method and device of double-site distributed database | |
| CN112995317B (en) | Block chain consensus method and block chain link points | |
| CN112910971B (en) | Multi-station data synchronization method, device and system | |
| CN112910970B (en) | Remote disaster recovery data synchronization method, device and system | |
| CN111930624A (en) | Test link message data processing method and device | |
| EP3896931A1 (en) | Spark shuffle-based remote direct memory access system and method | |
| CN115292293A (en) | Data migration method and device of distributed cache system | |
| CN115421976A (en) | Remote disaster recovery data processing method and device | |
| CN112732660B (en) | Intervening file transmission method, device and system | |
| CN112650623B (en) | Data processing method and device in service system switching process | |
| CN112785201B (en) | Heterogeneous system quasi-real-time high-reliability interaction system and method | |
| CN115205009A (en) | Account opening business processing method and device based on virtual technology | |
| CN112433887A (en) | Database data synchronization method, system, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |