CN113468267A - Data synchronization method, device and equipment for double machine rooms and storage medium - Google Patents
Data synchronization method, device and equipment for double machine rooms and storage medium Download PDFInfo
- Publication number
- CN113468267A CN113468267A CN202110721469.4A CN202110721469A CN113468267A CN 113468267 A CN113468267 A CN 113468267A CN 202110721469 A CN202110721469 A CN 202110721469A CN 113468267 A CN113468267 A CN 113468267A
- Authority
- CN
- China
- Prior art keywords
- data
- full
- scale
- synchronization
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000001360 synchronised effect Effects 0.000 claims abstract description 51
- 238000001914 filtration Methods 0.000 claims abstract description 30
- 230000009977 dual effect Effects 0.000 claims description 27
- 238000004806 packaging method and process Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 6
- 230000002457 bidirectional effect Effects 0.000 description 5
- 239000000284 extract Substances 0.000 description 5
- 230000002688 persistence Effects 0.000 description 4
- 238000013075 data extraction Methods 0.000 description 2
- 238000006424 Flood reaction Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/275—Synchronous replication
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the field of big data, and discloses a data synchronization method, a device, equipment and a storage medium of double computer rooms, which are used for preventing the problem of data loss and improving the synchronization efficiency of data synchronization. The data synchronization method of the double computer rooms comprises the following steps: receiving a full-scale synchronization instruction and judging whether to start executing the full-scale synchronization instruction; if the full-scale synchronization instruction is started to be executed, reading a directory information set from a distributed application program coordination service cluster of the first machine room, and generating target full-scale data according to the directory information set and preset full-scale data; synchronizing the target full data to a second machine room; receiving an increment synchronous instruction, and judging whether to start executing the increment synchronous instruction or not based on the increment synchronous instruction; if the incremental synchronization instruction is started to be executed, reading historical synchronization offset for data filtering, and generating target incremental data; and synchronizing the target incremental data to the second machine room. In addition, the invention also relates to a block chain technology, and the full-scale synchronization instruction can be stored in the block chain.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method, an apparatus, a device, and a storage medium for data synchronization in dual computer rooms.
Background
zookeeper is an open source distributed coordination service, and distributed applications can implement functions such as data publish/subscribe, naming services, distributed coordination/notification, cluster management, configuration maintenance, distributed locks, etc. based on zookeeper. At present, in order to avoid network faults and fire disasters of a single machine room, even great and irresistible disasters such as earthquakes, floods and the like of the whole city, the system can be ensured to continuously operate uninterruptedly, at least two machine rooms are deployed for application, and then data synchronization of zookeeper in the two machine rooms is required to be realized so as to ensure the consistency of other application data.
In the prior art, the above mentioned manner of one cluster deploying across machine rooms (dual-machine room disaster recovery) is mainly adopted for data synchronization, but if a problem occurs in a host machine room with a large number of hosts in dual machine rooms, the cluster of the whole machine room will have a problem, resulting in a data loss phenomenon.
Disclosure of Invention
The invention provides a data synchronization method, a data synchronization device, data synchronization equipment and a data synchronization storage medium for double computer rooms, which are used for preventing the problem of data loss and improving the synchronization efficiency of data synchronization.
The invention provides a data synchronization method of double computer rooms in a first aspect, which comprises the following steps: receiving a full-scale synchronization instruction and judging whether to start executing the full-scale synchronization instruction; if the full-scale synchronization instruction is started to be executed, reading a directory information set from a distributed application program coordination service cluster of a first machine room, and generating target full-scale data according to the directory information set and preset full-scale data, wherein the target full-scale data comprises a plurality of full-scale sub-data; synchronizing the target full data to a second machine room; receiving an increment synchronous instruction, and judging whether to start executing the increment synchronous instruction based on the increment synchronous instruction; if the incremental synchronization instruction is started to be executed, reading historical synchronization offset and performing data filtering in a first machine room to generate target incremental data; and synchronizing the target incremental data to a second machine room.
Optionally, in a first implementation manner of the first aspect of the present invention, the receiving a full-scale synchronization instruction and determining whether to start executing the full-scale synchronization instruction includes: receiving a full-scale synchronization instruction, and judging whether the server is a main node; if the server is judged to be the main node, judging whether the full-scale synchronization instruction is a starting instruction or not; and if the full-scale synchronous instruction is judged to be a starting instruction, judging to start executing the full-scale synchronous instruction.
Optionally, in a second implementation manner of the first aspect of the present invention, if the full-scale synchronization instruction starts to be executed, reading a directory information set from a distributed application coordination service cluster of a first computer room, and generating target full-scale data according to the directory information set and preset full-scale data, where the target full-scale data includes a plurality of full-scale data: if the full-scale synchronous instruction is started to be executed, randomly selecting a node from a distributed application program coordination service cluster of a first machine room as a target node; reading a directory information set from the target node, and performing data filtering based on the directory information set and preset full data to generate filtered full data, wherein the preset full data comprises a plurality of full event values, and the directory information set comprises a father directory information set and a sub-directory information set; and processing the filtered full data to generate target full data.
Optionally, in a third implementation manner of the first aspect of the present invention, the reading a directory information set from the target node, and performing data filtering based on the directory information set and preset full-volume data to generate filtered full-volume data, where the preset full-volume data includes a plurality of full-volume event values, and the directory information set includes a parent directory information set and a child directory information set, and includes: reading a directory information set from the target node, wherein the directory information set comprises a father directory information set and a sub directory information set; reading a plurality of full-amount directory information sets from preset full-amount data; and when the target full-volume directory information set is matched with the directory information set, reserving the target full-volume event value to obtain filtered full-volume data, wherein the filtered full-volume data comprises a plurality of filtered full-volume subdata.
Optionally, in a fourth implementation manner of the first aspect of the present invention, the processing the filtered full-scale data to generate target full-scale data includes: according to a preset data format, packaging the filtered full-scale data to generate packaged full-scale data; and adding synchronous time to the packaged full data to generate target full data, wherein the target full data comprises a plurality of full sub data.
Optionally, in a fifth implementation manner of the first aspect of the present invention, the synchronizing the target full-size data to the second machine room includes: sequentially sending each full-volume subdata in the target full-volume data to a data bus, wherein the target full-volume data are automatically consumed by a second machine room from the data bus; judging whether the target full-scale subdata is successfully sent to a data bus or not; if the target full-scale subdata is judged to be unsuccessfully sent to a data bus, the target full-scale subdata is sent again; and if the target full-scale subdata is successfully sent to a data bus, sending the next target full-scale subdata until a plurality of full-scale subdata in the target full-scale data are successfully sent.
Optionally, in a sixth implementation manner of the first aspect of the present invention, if the incremental synchronization instruction starts to be executed, reading a historical synchronization offset and performing data filtering in the first machine room, where generating target incremental data includes: if the incremental synchronization instruction is started to be executed, reading historical synchronization offset, and extracting data from a preset event log based on the historical synchronization offset to obtain initial incremental data, wherein the initial incremental data comprises a plurality of incremental event values; reading a directory information set from a distributed application program coordination service cluster of a first machine room; reading a plurality of incremental catalog information sets from the initial incremental data; and reserving the target increment event value matched with the directory information set in the target increment directory information set to obtain target increment data.
A second aspect of the present invention provides a data synchronization apparatus for dual computer rooms, including: the first receiving module is used for receiving a full-scale synchronization instruction and judging whether to start executing the full-scale synchronization instruction; the first generation module is used for reading a directory information set from a distributed application program coordination service cluster of a first machine room and generating target full-scale data according to the directory information set and preset full-scale data if the full-scale synchronization instruction is started to be executed, wherein the target full-scale data comprises a plurality of full-scale sub-data; the first synchronization module is used for synchronizing the target full data to a second machine room; the second receiving module is used for receiving an increment synchronous instruction and judging whether to start executing the increment synchronous instruction based on the increment synchronous instruction; the second generation module is used for reading historical synchronous offset and filtering data in the first machine room to generate target incremental data if the incremental synchronous instruction is started to be executed; and the second synchronization module is used for synchronizing the target incremental data to a second machine room.
Optionally, in a first implementation manner of the second aspect of the present invention, the first receiving module may be further specifically configured to: receiving a full-scale synchronization instruction, and judging whether the server is a main node; if the server is judged to be the main node, judging whether the full-scale synchronization instruction is a starting instruction or not; and if the full-scale synchronous instruction is judged to be a starting instruction, judging to start executing the full-scale synchronous instruction.
Optionally, in a second implementation manner of the second aspect of the present invention, the first generating module includes: the random selection unit is used for randomly selecting a node from the distributed application program coordination service cluster of the first machine room as a target node if the full-scale synchronization instruction is started to be executed; the filtering unit is used for reading a directory information set from the target node, performing data filtering based on the directory information set and preset full data, and generating filtered full data, wherein the preset full data comprises a plurality of full event values, and the directory information set comprises a father directory information set and a sub-directory information set; and the data processing unit is used for processing the filtered full-scale data to generate target full-scale data.
Optionally, in a third implementation manner of the second aspect of the present invention, the filtering unit may further be specifically configured to: reading a directory information set from the target node, wherein the directory information set comprises a father directory information set and a sub directory information set; reading a plurality of full-amount directory information sets from preset full-amount data; and when the target full-volume directory information set is matched with the directory information set, reserving the target full-volume event value to obtain filtered full-volume data, wherein the filtered full-volume data comprises a plurality of filtered full-volume subdata.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the data processing unit may further be specifically configured to: according to a preset data format, packaging the filtered full-scale data to generate packaged full-scale data; and adding synchronous time to the packaged full data to generate target full data, wherein the target full data comprises a plurality of full sub data.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the first synchronization module may be further specifically configured to: sequentially sending each full-volume subdata in the target full-volume data to a data bus, wherein the target full-volume data are automatically consumed by a second machine room from the data bus; judging whether the target full-scale subdata is successfully sent to a data bus or not; if the target full-scale subdata is judged to be unsuccessfully sent to a data bus, the target full-scale subdata is sent again; and if the target full-scale subdata is successfully sent to a data bus, sending the next target full-scale subdata until a plurality of full-scale subdata in the target full-scale data are successfully sent.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the second generating module may be further specifically configured to: if the incremental synchronization instruction is started to be executed, reading historical synchronization offset, and extracting data from a preset event log based on the historical synchronization offset to obtain initial incremental data, wherein the initial incremental data comprises a plurality of incremental event values; reading a directory information set from a distributed application program coordination service cluster of a first machine room; reading a plurality of incremental catalog information sets from the initial incremental data; and reserving the target increment event value matched with the directory information set in the target increment directory information set to obtain target increment data.
A third aspect of the present invention provides a data synchronization apparatus for two computer rooms, including: a memory and at least one processor, the memory having instructions stored therein; the at least one processor calls the instructions in the memory to enable the data synchronization equipment of the double machine rooms to execute the data synchronization method of the double machine rooms.
A fourth aspect of the present invention provides a computer-readable storage medium having stored therein instructions, which, when run on a computer, cause the computer to execute the above-mentioned dual-room data synchronization method.
In the technical scheme provided by the invention, a full-scale synchronization instruction is received, and whether the full-scale synchronization instruction is started to be executed or not is judged; if the full-scale synchronization instruction is started to be executed, reading a directory information set from a distributed application program coordination service cluster of a first machine room, and generating target full-scale data according to the directory information set and preset full-scale data, wherein the target full-scale data comprises a plurality of full-scale sub-data; synchronizing the target full data to a second machine room; receiving an increment synchronous instruction, and judging whether to start executing the increment synchronous instruction based on the increment synchronous instruction; if the incremental synchronization instruction is started to be executed, reading historical synchronization offset and performing data filtering in a first machine room to generate target incremental data; and synchronizing the target incremental data to a second machine room. In the embodiment of the invention, clusters are respectively deployed in the two machine rooms, then the distributed application program coordination service zookeeper cluster is used for filtering and processing the data to be synchronized between the clusters of the two machine rooms and then performing bidirectional synchronization of the two machine rooms, the data are synchronously stored in the clusters of the two machine rooms, and the data consistency of the clusters of the two machine rooms is also ensured, so that the use of the other machine room is not influenced when one zookeeper cluster is in a problem, the data loss is prevented, and the synchronization efficiency is also improved.
Drawings
Fig. 1 is a schematic diagram of an embodiment of a data synchronization method for two computer rooms in the embodiment of the present invention;
fig. 2 is a schematic diagram of another embodiment of a data synchronization method for two computer rooms in the embodiment of the present invention;
fig. 3 is a schematic diagram of an embodiment of a data synchronization device of two computer rooms in the embodiment of the present invention;
fig. 4 is a schematic diagram of another embodiment of a data synchronization device of two computer rooms in the embodiment of the present invention;
fig. 5 is a schematic diagram of an embodiment of a data synchronization device of a dual computer room in an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a data synchronization method, a data synchronization device, data synchronization equipment and a storage medium for double computer rooms, which are used for preventing the problem of data loss and improving the synchronization efficiency of data synchronization.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, a specific flow of the embodiment of the present invention is described below, and referring to fig. 1, an embodiment of a data synchronization method for dual computer rooms in the embodiment of the present invention includes:
101. receiving a full-scale synchronization instruction and judging whether to start executing the full-scale synchronization instruction;
the server receives the full-scale synchronization command and then judges whether to execute the full-scale synchronization command, and it needs to be emphasized that, in order to further ensure the privacy and the security of the full-scale synchronization command, the full-scale synchronization command can also be stored in a node of a block chain.
The method is carried out on the basis of two independent machine rooms, each machine room is provided with a distributed application program coordination service (zookeeper) cluster, each zookeeper cluster comprises a Leader node and a plurality of Follower nodes, an execution main server in the method is a server in the zookeeper cluster, a full synchronization instruction is monitored by the server, and after the full synchronization instruction is sent out through a terminal, the server monitors the full synchronization instruction and receives the full synchronization instruction. After receiving the full-scale synchronization instruction, the server firstly judges whether the node is a Leader node or not, if so, the server starts to execute the full-scale synchronization instruction, and since the zookeeper cluster elects to generate one Leader node, the server firstly judges whether the node receiving the instruction is a Leader node or not after acquiring the full-scale synchronization instruction, and if so, the server starts to execute the full-scale synchronization instruction.
It is to be understood that the execution subject of the present invention may be a data synchronization apparatus of dual computer rooms, and may also be a terminal or a server, which is not limited herein. The embodiment of the present invention is described by taking a server as an execution subject.
102. If the full-scale synchronization instruction is started to be executed, reading a directory information set from a distributed application program coordination service cluster of a first machine room, and generating target full-scale data according to the directory information set and preset full-scale data, wherein the target full-scale data comprises a plurality of full-scale sub-data;
and if the full-volume synchronization instruction is started to be executed, the server reads the directory information set from the distributed application program coordination service cluster of the first machine room, and generates target full-volume data stored in the memory database of the first machine room according to the directory information set and the full-volume data.
If the server is judged to start executing the full-scale synchronization instruction, the server reads the directory information set from the zookeeper cluster of the first computer room, wherein the zookeeper cluster comprises a plurality of nodes, and the server reads the directory information set, namely the path information such as "/hawaii" and "/dubbo". And then generating target full-volume data based on the directory information set and the full-volume data. For example, the server starts executing the full-volume synchronization instruction, the set of directory information read by the server is "/hawaii", and the server extracts the data under the "/hawaii" directory in the full-volume data as the target full-volume data based on "/hawaii".
103. Synchronizing the target full data to a second machine room;
and after obtaining the target full data, the server synchronizes the target full data to the second machine room.
It should be noted that, when the target full-size data is synchronized, because the second machine room has a subscription relationship with the data bus, the second machine room automatically consumes the target full-size data through the data bus, thereby implementing synchronization of the target full-size data to the second machine room.
104. Receiving an increment synchronous instruction, and judging whether to start executing the increment synchronous instruction or not based on the increment synchronous instruction;
the server receives the increment synchronization instruction and then judges whether to execute the increment synchronization instruction.
After receiving the incremental synchronization instruction, the server firstly judges whether the server is a Leader node or not, if the server is the Leader node, the server starts to execute the incremental synchronization instruction, and if the server is not the Leader node, the server ignores the incremental synchronization instruction.
105. If the incremental synchronization instruction is started to be executed, reading historical synchronization offset and filtering data in a first machine room to generate target incremental data;
and if the incremental synchronization instruction is started to be executed, the server reads the historical synchronization offset and filters the historical synchronization offset in the first machine room to obtain target incremental data.
And if the server is judged to start to execute the incremental synchronization instruction, the server reads the historical synchronization offset, reads the directory information set from the zookeeper cluster, extracts data by taking the historical synchronization offset as a starting point, and filters the full data after the historical synchronization offset based on the directory information set in the first machine room to obtain the target incremental data. For example, the server starts to execute the incremental synchronization command, reads the directory information set as "/hawaii", and extracts the data in the "/hawaii" directory as the target incremental data based on "/hawaii" and the historical synchronization offset.
106. And synchronizing the target incremental data to the second machine room.
And the server synchronizes the target incremental data to the second machine room, wherein the specific synchronization process is the same as the process of synchronizing the full data.
In the embodiment of the invention, clusters are respectively deployed in the two machine rooms, and then the zookeeper is used for filtering and processing the data to be synchronized between the clusters of the two machine rooms and then performing bidirectional synchronization of the two machine rooms, so that the data are synchronously stored in the clusters of the two machine rooms, the data consistency of the clusters of the two machine rooms is also ensured, the use of the other machine room is not influenced when the zookeeper cluster of one machine room is in a problem, the data loss is prevented, and the synchronization efficiency is also improved.
Referring to fig. 2, another embodiment of the data synchronization method for dual computer rooms in the embodiment of the present invention includes:
201. receiving a full-scale synchronization instruction and judging whether to start executing the full-scale synchronization instruction;
the server receives the full-scale synchronization command and then judges whether to execute the full-scale synchronization command, and it needs to be emphasized that, in order to further ensure the privacy and the security of the full-scale synchronization command, the full-scale synchronization command can also be stored in a node of a block chain.
The method is carried out on the basis of two independent machine rooms, each machine room is provided with a distributed application program coordination service (zookeeper) cluster, each zookeeper cluster comprises a Leader node and a plurality of Follower nodes, an execution main server in the method is a server in the zookeeper cluster, a full synchronization instruction is monitored by the server, and after the full synchronization instruction is sent out through a terminal, the server monitors the full synchronization instruction and receives the full synchronization instruction. After receiving the full-scale synchronization instruction, the server firstly judges whether the node is a Leader node or not, if so, the server starts to execute the full-scale synchronization instruction, and since the zookeeper cluster elects to generate one Leader node, the server firstly judges whether the node receiving the instruction is a Leader node or not after acquiring the full-scale synchronization instruction, and if so, the server starts to execute the full-scale synchronization instruction.
202. If the execution of the full-scale synchronization instruction is started, randomly selecting a node from the distributed application program coordination service cluster of the first machine room as a target node;
if the server starts to execute the full-scale synchronization instruction, firstly, a node target node is randomly selected from a zookeeper cluster, namely a distributed application program coordination service cluster, of the first computer room.
203. Reading a directory information set from a target node, performing data filtering based on the directory information set and preset full data, and generating filtered full data, wherein the preset full data comprises a plurality of full event values, and the directory information set comprises a father directory information set and a sub-directory information set;
and reading a directory information set from the target node, and circularly traversing preset full data by the server based on the directory information set so as to complete the filtration of the data and obtain the filtered full data, wherein the full data consists of a plurality of full event values.
It should be noted that each node in the zookeeper cluster includes the same target information set, and therefore, one node is randomly selected as a target node to read the directory information set.
For example, a target node is determined to be a target node a corresponding to the server a from the zookeeper cluster, then the server reads a directory information set of "/dbs/persistence/dSideSyncAction, ["/hawaii ","/idgen "])" from the target node a, the server cycles through preset full-volume data based on "/dbs/persistence/dSideSyncAction" to obtain filtered full-volume data, the cycle through process is a process of filtering the preset full-volume data, it can be understood that data matching the directory information of "/dbs/persistence/dSideSyncAction" is reserved until now, and data not matching "/dbs/persistence/dSideSyncAction" is filtered out, so as to obtain filtered full-volume data. In this embodiment, the preset full volume data includes at least a plurality of full volume event values, one of which may be 400229459413, and the filtered full volume data also includes a plurality of full volume event values, wherein the full volume event values are present in the same form as the preset full volume data.
Specifically, the server reads a directory information set from a target node, wherein the directory information set comprises a father directory information set and a sub-directory information set; the service reads a plurality of full-amount directory information sets from preset full-amount data; and when the target full-volume directory information set is matched with the directory information set, the server reserves a target full-volume event value to obtain filtered full-volume data, wherein the filtered full-volume data comprises a plurality of filtered full-volume subdata.
It should be noted that the directory information set includes both a parent directory information set and a child directory information set, the server first reads the parent directory information set and the child directory information set from the distributed application coordination service cluster, and at the same time, the server also reads the full directory information set from the preset full data, then compares the full directory information set with the directory information set to generate a comparison result, and when the comparison result shows that the comparison result matches, determines the target full event value corresponding to the target full directory information set as the target full data, where the target full data includes a plurality of target full event values.
For example, the directory information set is/zookeeper/sync/offset/shbx, wherein a parent directory information set is/zookeeper, and a child directory information set is/sync/offset/shbx, after the server reads the full-scale directory information set, the parent directory information sets of the two parties are firstly compared, if the parent directory information sets are not matched, the corresponding full-scale event value is directly filtered, if the child directory information sets of the two parties are matched, the corresponding full-scale event value is continuously compared, if the child directory information sets are not matched, the corresponding full-scale event value is filtered, if the child directory information sets are matched, the corresponding full-scale event value is determined to be the target full-scale event value, and after all full-scale event values in the preset full-scale data are circularly traversed, the filtered full-scale data are obtained. Assuming that one of the full directory information sets is zookeeper/sync/offset/shbx and the corresponding full event value is 400229459413, the server retains the full event value through comparison, and in another embodiment, assuming that one of the full directory information sets is zookeeper/sync/offset/config and the corresponding full event value is 400229459414, the server filters out the full event value through comparison.
204. Processing the filtered full data to generate target full data;
and after the server obtains the filtered full data, performing other processing on the filtered data to generate target full data.
Specifically, the server encapsulates the filtered full data according to a preset data format to generate encapsulated full data; and the server adds the synchronization time to the packaged full data to generate target full data, wherein the target full data comprises a plurality of full sub data.
The server packages the filtered full-scale data according to a preset data format to generate packaged full-scale data, and then adds synchronization time, namely syncLogTime, on the basis of the packaged full-scale data, wherein the synchronization time is used as a basis for judging whether the full-scale data conflict or not to generate target full-scale data, and the format for adding the synchronization time can be Wed Aug 0110: 49:06CST 2018.
205. Synchronizing the target full data to a second machine room;
and after obtaining the target full data, the server synchronizes the target full data to the second machine room.
It should be noted that, when the target full-size data is synchronized, because the second machine room has a subscription relationship with the data bus, the second machine room automatically consumes the target full-size data through the data bus, thereby implementing synchronization of the target full-size data to the second machine room.
Specifically, the server sequentially sends each full-volume subdata in the target full-volume data to the data bus, wherein the target full-volume data are automatically consumed by the second machine room from the data bus; the server judges whether the target full-scale subdata is successfully sent to the data bus or not; if the target full-scale subdata is judged to be unsuccessfully sent to the data bus, the server resends the target full-scale subdata; and if the target full-scale subdata is successfully sent to the data bus, the server sends the next target full-scale subdata until a plurality of full-scale subdata in the target full-scale data are successfully sent.
The server firstly sends the target full-size data to the data bus, because the second machine room and the data bus have a subscription relationship, the second machine room can consume the target full-size data from the data bus, the server also monitors the sending result when sending the target full-size data to the data bus, if one target full-size data in the target full-size data is successfully sent to the data bus, the next full-size data is synchronized until a plurality of full-size data are successfully synchronized, and the synchronization of the target full-size data is completed. And if the target full-scale sub-data is not successfully sent to the data bus, the target full-scale sub-data is sent again until the target full-scale sub-data is successfully sent.
206. Receiving an increment synchronous instruction, and judging whether to start executing the increment synchronous instruction or not based on the increment synchronous instruction;
the server receives the increment synchronization instruction and then judges whether to execute the increment synchronization instruction.
After receiving the incremental synchronization instruction, the server firstly judges whether the server is a Leader node or not, if the server is the Leader node, the server starts to execute the incremental synchronization instruction, and if the server is not the Leader node, the server ignores the incremental synchronization instruction.
207. If the incremental synchronization instruction is started to be executed, reading historical synchronization offset and filtering data in a first machine room to generate target incremental data;
and if the incremental synchronization instruction is started to be executed, the server reads the historical synchronization offset and filters the historical synchronization offset to obtain target incremental data.
And if the server is judged to start to execute the incremental synchronization instruction, the server reads the historical synchronization offset, reads the directory information set from the zookeeper cluster, extracts data by taking the historical synchronization offset as a starting point, and filters the full data after the historical synchronization offset based on the directory information set, so as to obtain target incremental data. For example, the server starts to execute the incremental synchronization command, reads the directory information set as "/hawaii", and extracts the data in the "/hawaii" directory as the target incremental data based on "/hawaii" and the historical synchronization offset.
Specifically, if the incremental synchronization instruction is started to be executed, the server reads the historical synchronization offset, and performs data extraction based on the historical synchronization offset from a preset event log to obtain initial incremental data, wherein the initial incremental data comprises a plurality of incremental event values; the server reads a directory information set from a distributed application program coordination service cluster of a first machine room; the server reads a plurality of incremental catalog information sets from the initial incremental data; and the server reserves a target increment event value matched with the directory information set in the target increment directory information set to obtain target increment data.
If the server starts to execute an incremental synchronization instruction, reading historical synchronization offset, and then performing preliminary data extraction in an event log based on the historical synchronization offset to obtain initial incremental data comprising a plurality of incremental event values; and then reading a directory information set, such as/zookeeper/sync/offset/shbx, from the distributed application program coordination service cluster of the first computer room, then reading a plurality of incremental directory information sets, such as/zookeeper/sync/offset/shbx,/zookeeper/sync/offset/eagle/config and the like, from the initial incremental data, comparing the plurality of incremental directory information sets with the directory information sets by the server, and if the comparison result shows that the incremental directory information sets are matched with the directory information sets, reserving the corresponding incremental event value, thereby obtaining the target incremental data.
208. And synchronizing the target incremental data to the second machine room.
And the server synchronizes the target incremental data to the second machine room, wherein the specific synchronization process is the same as the process of synchronizing the full data.
In the embodiment of the invention, clusters are respectively deployed in the two machine rooms, and then the zookeeper is used for filtering and processing the data to be synchronized between the clusters of the two machine rooms and then performing bidirectional synchronization of the two machine rooms, so that the data are synchronously stored in the clusters of the two machine rooms, the data consistency of the clusters of the two machine rooms is also ensured, the use of the other machine room is not influenced when the zookeeper cluster of one machine room is in a problem, the data loss is prevented, and the synchronization efficiency is also improved.
In the above description of the data synchronization method of the dual computer rooms in the embodiment of the present invention, referring to fig. 3, a data synchronization apparatus of the dual computer rooms in the embodiment of the present invention is described below, where an embodiment of the data synchronization apparatus of the dual computer rooms in the embodiment of the present invention includes:
a first receiving module 301, configured to receive a full-scale synchronization instruction and determine whether to start executing the full-scale synchronization instruction;
the first generating module 302 is configured to, if the full-scale synchronization instruction starts to be executed, read a directory information set from a distributed application coordination service cluster of a first machine room, and generate target full-scale data according to the directory information set and preset full-scale data, where the target full-scale data includes a plurality of full-scale sub-data;
a first synchronization module 303, configured to synchronize the target full-size data to a second machine room;
a second receiving module 304, configured to receive an incremental synchronization instruction, and determine whether to start executing the incremental synchronization instruction based on the incremental synchronization instruction;
a second generating module 305, configured to read a historical synchronization offset and perform data filtering in the first machine room to generate target incremental data if the incremental synchronization instruction starts to be executed;
a second synchronization module 306, configured to synchronize the target incremental data to a second machine room.
In the embodiment of the invention, clusters are respectively deployed in the two machine rooms, and then the zookeeper is used for filtering and processing the data to be synchronized between the clusters of the two machine rooms and then performing bidirectional synchronization of the two machine rooms, so that the data are synchronously stored in the clusters of the two machine rooms, the data consistency of the clusters of the two machine rooms is also ensured, the use of the other machine room is not influenced when the zookeeper cluster of one machine room is in a problem, the data loss is prevented, and the synchronization efficiency is also improved.
Referring to fig. 4, another embodiment of the data synchronization apparatus for dual rooms in the embodiment of the present invention includes:
a first receiving module 301, configured to receive a full-scale synchronization instruction and determine whether to start executing the full-scale synchronization instruction;
the first generating module 302 is configured to, if the full-scale synchronization instruction starts to be executed, read a directory information set from a distributed application coordination service cluster of a first machine room, and generate target full-scale data according to the directory information set and preset full-scale data, where the target full-scale data includes a plurality of full-scale sub-data;
a first synchronization module 303, configured to synchronize the target full-size data to a second machine room;
a second receiving module 304, configured to receive an incremental synchronization instruction, and determine whether to start executing the incremental synchronization instruction based on the incremental synchronization instruction;
a second generating module 305, configured to read a historical synchronization offset and perform data filtering in the first machine room to generate target incremental data if the incremental synchronization instruction starts to be executed;
a second synchronization module 306, configured to synchronize the target incremental data to a second machine room.
Optionally, the first receiving module 301 may be further specifically configured to:
receiving a full-scale synchronization instruction, and judging whether the server is a main node;
if the server is judged to be the main node, judging whether the full-scale synchronization instruction is a starting instruction or not;
and if the full-scale synchronous instruction is judged to be a starting instruction, judging to start executing the full-scale synchronous instruction.
Optionally, the first generating module 302 includes:
a random selecting unit 3021, configured to randomly select a node from the distributed application coordination service cluster in the first machine room as a target node if the full-scale synchronization instruction starts to be executed;
a filtering unit 3022, configured to read a directory information set from the target node, perform data filtering based on the directory information set and preset full-volume data, and generate filtered full-volume data, where the preset full-volume data includes a plurality of full-volume event values, and the directory information set includes a parent directory information set and a child directory information set;
a data processing unit 3023, configured to process the filtered full-scale data to generate target full-scale data.
Optionally, the filtering unit 3022 may be further specifically configured to:
reading a directory information set from the target node, wherein the directory information set comprises a father directory information set and a sub directory information set;
reading a plurality of full-amount directory information sets from preset full-amount data;
and when the target full-volume directory information set is matched with the directory information set, reserving the target full-volume event value to obtain filtered full-volume data, wherein the filtered full-volume data comprises a plurality of filtered full-volume subdata.
Optionally, the data processing unit 3023 may be further specifically configured to:
according to a preset data format, packaging the filtered full-scale data to generate packaged full-scale data;
and adding synchronous time to the packaged full data to generate target full data, wherein the target full data comprises a plurality of full sub data.
Optionally, the first synchronization module 303 may be further specifically configured to:
sequentially sending each full-volume subdata in the target full-volume data to a data bus, wherein the target full-volume data are automatically consumed by a second machine room from the data bus;
judging whether the target full-scale subdata is successfully sent to a data bus or not;
if the target full-scale subdata is judged to be unsuccessfully sent to a data bus, the target full-scale subdata is sent again;
and if the target full-scale subdata is successfully sent to a data bus, sending the next target full-scale subdata until a plurality of full-scale subdata in the target full-scale data are successfully sent.
Optionally, the second generating module 305 may be further specifically configured to:
if the incremental synchronization instruction is started to be executed, reading historical synchronization offset, and extracting data from a preset event log based on the historical synchronization offset to obtain initial incremental data, wherein the initial incremental data comprises a plurality of incremental event values;
reading a directory information set from a distributed application program coordination service cluster of a first machine room;
reading a plurality of incremental catalog information sets from the initial incremental data;
and reserving the target increment event value matched with the directory information set in the target increment directory information set to obtain target increment data.
In the embodiment of the invention, clusters are respectively deployed in the two machine rooms, and then the zookeeper is used for filtering and processing the data to be synchronized between the clusters of the two machine rooms and then performing bidirectional synchronization of the two machine rooms, so that the data are synchronously stored in the clusters of the two machine rooms, the data consistency of the clusters of the two machine rooms is also ensured, the use of the other machine room is not influenced when the zookeeper cluster of one machine room is in a problem, the data loss is prevented, and the synchronization efficiency is also improved.
Fig. 3 and fig. 4 describe the data synchronization device of the dual computer rooms in the embodiment of the present invention in detail from the perspective of the modular functional entity, and the data synchronization device of the dual computer rooms in the embodiment of the present invention is described in detail from the perspective of hardware processing.
Fig. 5 is a schematic structural diagram of a data synchronization apparatus of a dual room according to an embodiment of the present invention, where the data synchronization apparatus 500 of the dual room may generate relatively large differences due to different configurations or performances, and may include one or more processors (CPUs) 510 (e.g., one or more processors) and a memory 520, and one or more storage media 530 (e.g., one or more mass storage devices) storing applications 533 or data 532. Memory 520 and storage media 530 may be, among other things, transient or persistent storage. The program stored in the storage medium 530 may include one or more modules (not shown), each of which may include a series of instruction operations in the data synchronization apparatus 500 of the dual room. Still further, the processor 510 may be configured to communicate with the storage medium 530, and execute a series of instruction operations in the storage medium 530 on the data synchronization device 500 in the dual-computer room.
The dual-room data synchronization apparatus 500 may also include one or more power supplies 540, one or more wired or wireless network interfaces 550, one or more input-output interfaces 560, and/or one or more operating systems 531, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, etc. Those skilled in the art will appreciate that the data synchronization device structure of the dual room shown in fig. 5 does not constitute a limitation of the data synchronization device of the dual room, and may include more or less components than those shown, or combine some components, or arrange different components.
The invention further provides data synchronization equipment of the double machine rooms, wherein the computer equipment comprises a memory and a processor, and computer readable instructions are stored in the memory and when being executed by the processor, the processor is enabled to execute the steps of the data synchronization method of the double machine rooms in the embodiments.
The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium, and may also be a volatile computer-readable storage medium, having stored therein instructions, which, when run on a computer, cause the computer to perform the steps of the data synchronization method for dual rooms.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A data synchronization method of double machine rooms is characterized by comprising the following steps:
receiving a full-scale synchronization instruction and judging whether to start executing the full-scale synchronization instruction;
if the full-scale synchronization instruction is started to be executed, reading a directory information set from a distributed application program coordination service cluster of a first machine room, and generating target full-scale data according to the directory information set and preset full-scale data, wherein the target full-scale data comprises a plurality of full-scale sub-data;
synchronizing the target full data to a second machine room;
receiving an increment synchronous instruction, and judging whether to start executing the increment synchronous instruction based on the increment synchronous instruction;
if the incremental synchronization instruction is started to be executed, reading historical synchronization offset and performing data filtering in a first machine room to generate target incremental data;
and synchronizing the target incremental data to a second machine room.
2. The data synchronization method of the dual machine rooms according to claim 1, wherein the receiving the full-scale synchronization command and determining whether to start executing the full-scale synchronization command comprises:
receiving a full-scale synchronization instruction, and judging whether the server is a main node;
if the server is judged to be the main node, judging whether the full-scale synchronization instruction is a starting instruction or not;
and if the full-scale synchronous instruction is judged to be a starting instruction, judging to start executing the full-scale synchronous instruction.
3. The method according to claim 1, wherein if the full-scale synchronization instruction starts to be executed, reading a directory information set from a distributed application coordination service cluster of a first machine room, and generating target full-scale data according to the directory information set and preset full-scale data, where the target full-scale data includes a plurality of full-scale data:
if the full-scale synchronous instruction is started to be executed, randomly selecting a node from a distributed application program coordination service cluster of a first machine room as a target node;
reading a directory information set from the target node, and performing data filtering based on the directory information set and preset full data to generate filtered full data, wherein the preset full data comprises a plurality of full event values, and the directory information set comprises a father directory information set and a sub-directory information set;
and processing the filtered full data to generate target full data.
4. The data synchronization method for dual computer rooms according to claim 3, wherein the reading a directory information set from the target node, and performing data filtering based on the directory information set and a preset full volume data to generate a filtered full volume data, the preset full volume data includes a plurality of full volume event values, the directory information set includes a parent directory information set and a child directory information set, and the method includes:
reading a directory information set from the target node, wherein the directory information set comprises a father directory information set and a sub directory information set;
reading a plurality of full-amount directory information sets from preset full-amount data;
and when the target full-volume directory information set is matched with the directory information set, reserving the target full-volume event value to obtain filtered full-volume data, wherein the filtered full-volume data comprises a plurality of filtered full-volume subdata.
5. The data synchronization method of the dual machine rooms according to claim 3, wherein the processing the filtered full-scale data to generate the target full-scale data comprises:
according to a preset data format, packaging the filtered full-scale data to generate packaged full-scale data;
and adding synchronous time to the packaged full data to generate target full data, wherein the target full data comprises a plurality of full sub data.
6. The data synchronization method of dual room as claimed in claim 1, wherein the synchronizing the target full amount of data to a second room comprises:
sequentially sending each full-volume subdata in the target full-volume data to a data bus, wherein the target full-volume data are automatically consumed by a second machine room from the data bus;
judging whether the target full-scale subdata is successfully sent to a data bus or not;
if the target full-scale subdata is judged to be unsuccessfully sent to a data bus, the target full-scale subdata is sent again;
and if the target full-scale subdata is successfully sent to a data bus, sending the next target full-scale subdata until a plurality of full-scale subdata in the target full-scale data are successfully sent.
7. The data synchronization method of the dual machine rooms according to claim 1, wherein if the incremental synchronization instruction starts to be executed, reading a historical synchronization offset and performing data filtering in the first machine room, and generating target incremental data comprises:
if the incremental synchronization instruction is started to be executed, reading historical synchronization offset, and extracting data from a preset event log based on the historical synchronization offset to obtain initial incremental data, wherein the initial incremental data comprises a plurality of incremental event values;
reading a directory information set from a distributed application program coordination service cluster of a first machine room;
reading a plurality of incremental catalog information sets from the initial incremental data;
and reserving the target increment event value matched with the directory information set in the target increment directory information set to obtain target increment data.
8. The data synchronizer of a pair of computer rooms, characterized by that, the data synchronizer of said pair of computer rooms includes:
the first receiving module is used for receiving a full-scale synchronization instruction and judging whether to start executing the full-scale synchronization instruction;
the first generation module is used for reading a directory information set from a distributed application program coordination service cluster of a first machine room and generating target full-scale data according to the directory information set and preset full-scale data if the full-scale synchronization instruction is started to be executed, wherein the target full-scale data comprises a plurality of full-scale sub-data;
the first synchronization module is used for synchronizing the target full data to a second machine room;
the second receiving module is used for receiving an increment synchronous instruction and judging whether to start executing the increment synchronous instruction based on the increment synchronous instruction;
the second generation module is used for reading historical synchronous offset and filtering data in the first machine room to generate target incremental data if the incremental synchronous instruction is started to be executed;
and the second synchronization module is used for synchronizing the target incremental data to a second machine room.
9. The utility model provides a data synchronization equipment of two computer rooms, characterized in that, data synchronization equipment of two computer rooms includes: a memory and at least one processor, the memory having instructions stored therein;
the at least one processor invokes the instructions in the memory to cause the data synchronization device of the dual room to perform the data synchronization method of the dual room according to any one of claims 1 to 7.
10. A computer-readable storage medium having instructions stored thereon, wherein the instructions, when executed by a processor, implement the method for data synchronization of dual rooms according to any one of claims 1-7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110721469.4A CN113468267B (en) | 2021-06-28 | 2021-06-28 | Data synchronization method, device and equipment for double machine rooms and storage medium |
| PCT/CN2022/088891 WO2023273559A1 (en) | 2021-06-28 | 2022-04-25 | Data synchronization method, apparatus, and device for two data centers, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110721469.4A CN113468267B (en) | 2021-06-28 | 2021-06-28 | Data synchronization method, device and equipment for double machine rooms and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113468267A true CN113468267A (en) | 2021-10-01 |
| CN113468267B CN113468267B (en) | 2024-06-18 |
Family
ID=77873386
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110721469.4A Active CN113468267B (en) | 2021-06-28 | 2021-06-28 | Data synchronization method, device and equipment for double machine rooms and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113468267B (en) |
| WO (1) | WO2023273559A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023273559A1 (en) * | 2021-06-28 | 2023-01-05 | 康键信息技术（深圳）有限公司 | Data synchronization method, apparatus, and device for two data centers, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103150394A (en) * | 2013-03-25 | 2013-06-12 | 中国人民解放军国防科学技术大学 | Distributed file system metadata management method facing to high-performance calculation |
| US20170187800A1 (en) * | 2015-12-28 | 2017-06-29 | Le Holdings (Beijing) Co., Ltd. | File synchronization method, electronic device |
| CN108965383A (en) * | 2018-05-31 | 2018-12-07 | 康键信息技术（深圳）有限公司 | File synchronisation method, device, computer equipment and storage medium |
| CN111026810A (en) * | 2019-12-03 | 2020-04-17 | 苏州睿威博科技有限公司 | Data synchronization method, device and storage medium |
| US20200133786A1 (en) * | 2018-10-26 | 2020-04-30 | Dropbox, Inc. | Restoring a directory to a state prior to a past synchronization event |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769212B (en) * | 2018-05-31 | 2023-04-07 | 康键信息技术（深圳）有限公司 | Data synchronization method and device, computer equipment and storage medium |
| CN109412875B (en) * | 2018-12-26 | 2021-06-25 | 杭州云毅网络科技有限公司 | zookeeper cluster automatic maintenance method and device |
| CN113468267B (en) * | 2021-06-28 | 2024-06-18 | 康键信息技术（深圳）有限公司 | Data synchronization method, device and equipment for double machine rooms and storage medium |
-
2021
- 2021-06-28 CN CN202110721469.4A patent/CN113468267B/en active Active
-
2022
- 2022-04-25 WO PCT/CN2022/088891 patent/WO2023273559A1/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103150394A (en) * | 2013-03-25 | 2013-06-12 | 中国人民解放军国防科学技术大学 | Distributed file system metadata management method facing to high-performance calculation |
| US20170187800A1 (en) * | 2015-12-28 | 2017-06-29 | Le Holdings (Beijing) Co., Ltd. | File synchronization method, electronic device |
| CN108965383A (en) * | 2018-05-31 | 2018-12-07 | 康键信息技术（深圳）有限公司 | File synchronisation method, device, computer equipment and storage medium |
| US20200133786A1 (en) * | 2018-10-26 | 2020-04-30 | Dropbox, Inc. | Restoring a directory to a state prior to a past synchronization event |
| CN111026810A (en) * | 2019-12-03 | 2020-04-17 | 苏州睿威博科技有限公司 | Data synchronization method, device and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023273559A1 (en) * | 2021-06-28 | 2023-01-05 | 康键信息技术（深圳）有限公司 | Data synchronization method, apparatus, and device for two data centers, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113468267B (en) | 2024-06-18 |
| WO2023273559A1 (en) | 2023-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3832578A1 (en) | Electronic invoice identifier allocation method, and electronic ticket generating method, device and system | |
| CN109995850B (en) | Block chain system and transaction processing method thereof | |
| CN102664750B (en) | Method, system and device for hot backup of multi-machine | |
| WO2018049983A1 (en) | Data synchronization method and system, and synchronization acquisition method and device | |
| CN110784495B (en) | Block chain-based discovery and configuration information management method for big data cluster system | |
| CN106156318B (en) | System and method for realizing high availability of multi-node database | |
| CN111651275A (en) | MySQL cluster automatic deployment system and method | |
| WO2021051581A1 (en) | Server cluster file synchronization method and apparatus, electronic device, and storage medium | |
| CN109446170A (en) | A kind of profile data synchronous method and equipment | |
| CN102708150A (en) | Method, device and system for asynchronously copying data | |
| CN108345617A (en) | A kind of method of data synchronization, device and electronic equipment | |
| CN109361777B (en) | Synchronization method, synchronization system and related device for distributed cluster node states | |
| CN113468267B (en) | Data synchronization method, device and equipment for double machine rooms and storage medium | |
| CN111597536A (en) | Hadoop cluster kerberos high-availability authentication method | |
| CN111708659B (en) | Method for constructing Yun Yuansheng disaster recovery architecture based on kubernetes | |
| CN111984274A (en) | Method and device for one-key automatic deployment of ETCD (electronic toll collection) cluster | |
| CN113438107A (en) | Cluster node expansion method, device, equipment and storage medium | |
| CN113783953A (en) | Industrial Internet of things network management and control method and system based on cloud edge cooperation | |
| CN112019614B (en) | Method, system and processor for communication and communication synchronization between two systems | |
| Kordafshari et al. | Modified bully election algorithm in distributed systems. | |
| CN114880717A (en) | Data archiving method and device | |
| CN109088937A (en) | A kind of cluster authorization method and device based on unified management | |
| CN113630445B (en) | Data storage method and device based on block chain network | |
| CN112835989B (en) | Deployment method and system for single-application multi-MySQL Set | |
| Fagg et al. | Scalable fault tolerant MPI: extending the recovery algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |