CN111459954A - Distributed data synchronization method, device, equipment and medium - Google Patents
Distributed data synchronization method, device, equipment and medium Download PDFInfo
- Publication number
- CN111459954A CN111459954A CN202010143241.7A CN202010143241A CN111459954A CN 111459954 A CN111459954 A CN 111459954A CN 202010143241 A CN202010143241 A CN 202010143241A CN 111459954 A CN111459954 A CN 111459954A
- Authority
- CN
- China
- Prior art keywords
- leader
- data
- server
- parameters
- data server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a distributed data synchronization method, a device, equipment and a medium, wherein the method comprises the steps of obtaining a preset configuration file when a one-data server in a distributed one-data cluster is powered on, setting initial configuration parameters and recording the initial configuration parameters as execution parameters, regularly sending a registration instruction to a zookeeper server, receiving a first election instruction which is sent by the zookeeper server and contains a leader, changing the one-data server corresponding to the leader from a register to a leader, regularly monitoring log files of source databases of all source servers, obtaining changed data when data change exists, analyzing the changed data through a python script, converting the changed data into SQ L statement texts matched with a target database, sending the text to a kafka cluster, receiving determination information and confirming that the changed data in the source database are successfully synchronized to the target database.
Description
Technical Field
The present invention relates to the field of data synchronization, and in particular, to a distributed data synchronization method and apparatus, a computer device, and a storage medium.
Background
In the current internet era, a plurality of enterprises provide various digital services for a large number of users on the internet, so that the data access demand volume is increased sharply, and the core database of the enterprise often cannot support such large concurrent operation, so that a plurality of cross-regional slave databases are established for enterprises such as internet, finance and the like, a large amount of business data are transferred from the core database to the slave databases of corresponding regions, so that the users can access the slave databases of the corresponding regions according to different demands, so as to reduce the access volume of the core database, in the prior art, due to abnormal interruption or downtime of a synchronization server in the data transfer process, data synchronized from the core database to the slave databases can be lost, and when high concurrent large data are received, due to the fact that the data received by the synchronization server exceeds the receiving capacity of the synchronization server, the operation performance of the synchronization server can be greatly reduced, therefore, the existing synchronization server has the defects of data integrity and timeliness.
Disclosure of Invention
The invention provides a distributed data synchronization method, a distributed data synchronization device, computer equipment and a storage medium, which improve the data synchronization speed, solve the regional limitations of source databases and target databases in different regions, ensure the integrity and timeliness of data synchronization and achieve the effect of real-time synchronization.
A distributed data synchronization method, comprising:
when an one-data server in a distributed one-data cluster is powered on, acquiring a preset configuration file, setting initial configuration parameters of the powered-on one-data server according to the configuration file, and recording the initial configuration parameters as execution parameters;
according to the registration parameters in the execution parameters of the electrified one-data server, regularly sending a registration instruction corresponding to the electrified one-data server to a zookeeper server;
receiving a first election instruction which is sent by the zookeeper server and contains a leader, wherein the first election instruction changes a leader field in the registration parameters of the one-data server corresponding to the leader from a registrar to a leader; the leader is one-data server selected by the zookeeper server according to the received registration instruction sent by each powered-on one-data server in the distributed one-data cluster;
when the leader field in the registration parameters of the powered one-data server is the leader machine, enabling the leader field to be the log file of the source database of the source server, which is monitored by the one-data server of the leader machine at regular time according to the monitoring parameters in the execution parameters and the starting time in the first election instruction;
when monitoring that the log file of the source database has data change, enabling the leader field to acquire changed data in the log file for the one-data server of the leader, analyzing the changed data through a python script, and converting the analyzed changed data into an SQ L statement text matched with a target database corresponding to the source database, wherein one source database corresponds to the target database in one target server;
packaging the SQ L statement text into a subscription message, inserting the subscription message into a sending queue, and sending the subscription message to a kafka cluster through the sending queue;
and after the kafka cluster pushes the SQ L statement text in the subscription message to the target database in a broadcasting mode, and the target database executes the SQ 2 statement in the SQ L statement text according to the SQ L statement text, the determining information is generated.
A distributed data synchronization apparatus, comprising:
the system comprises an acquisition module, a configuration module and a processing module, wherein the acquisition module is used for acquiring a preset configuration file when an one-data server in a distributed one-data cluster is powered on, setting initial configuration parameters of the powered-on one-data server according to the configuration file, and recording the initial configuration parameters as execution parameters;
a sending module, configured to send a registration instruction corresponding to the powered-on one-data server to a zookeeper server at regular time according to a registration parameter in the execution parameters of the powered-on one-data server;
a receiving module, configured to receive a first election instruction including a leader from the zookeeper server, where the first election instruction changes a leader field in the registration parameters of the one-data server corresponding to the leader from a registrar to a leader; the leader is one-data server selected by the zookeeper server according to the received registration instruction sent by each powered-on one-data server in the distributed one-data cluster;
a monitoring module, configured to, when the leader field in the registration parameters of the one-data server that is powered on is the leader machine, enable the leader field to be the one-data server of the leader machine, and periodically monitor a log file of a source database of the source server according to the monitoring parameters in the execution parameters and the start time in the first election instruction;
the analysis module is used for enabling the leader field to acquire changed data in the log file for the one-data server of the leader when monitoring that the log file of the source database has data change, analyzing the changed data through a python script, and converting the analyzed changed data into SQ L statement texts matched with a target database corresponding to the source database, wherein one source database corresponds to the target database in one target server;
the packaging module is used for packaging the SQ L statement text into a subscription message, inserting the subscription message into a sending queue and sending the subscription message to the kafka cluster through the sending queue;
and the synchronization module is used for receiving the confirmed information which is fed back by the kafka cluster and contains the successful push of the SQ L statement text, confirming that the changed data in the source database is successfully synchronized to the target database, and generating the confirmed information after the kafka cluster pushes the SQ L statement text in the subscription message to the target database in a broadcasting mode and the target database executes the SQ L statement in the SQ L statement text according to the SQ L statement text.
A computer device comprising a memory, a processor and a computer program stored in said memory and executable on said processor, said processor implementing the steps of the above-described distributed data synchronization method when executing said computer program.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned distributed data synchronization method.
The distributed data synchronization method, the distributed data synchronization device, the computer equipment and the storage medium provided by the invention have the advantages that the configuration file is obtained when a one-data server in a distributed one-data cluster is powered on, the configuration is carried out according to the configuration file, the registration instruction is sent to a zookeeper server at regular time, the first election instruction which is sent by the zookeeper server and contains a leader is received, the first election instruction changes a field in the one-data server corresponding to the leader into a leader by the registry, the leader field is made to monitor log files of source databases of all source servers at regular time by the one-data server of the leader, when the log files of the source databases are monitored to have data change, changed data in the log files are obtained, the changed data are analyzed by a python script, the analyzed changed data are converted into SQ L text which is matched with a target database corresponding to a distributed data base, the SQ L is packaged into messages which are inserted into the sending data base, the SQ L text database is analyzed, the SQ L is converted into a text sentence which is successfully matched with the target database which is analyzed by the distributed data base and the Kafjoker of the distributed data base, the Kafdata base, the target database, the data base, the data change of the distributed data base, the distributed data synchronization method, the SQ synchronization method, the method.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
FIG. 1 is a schematic diagram of an application environment of a distributed data synchronization method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a distributed data synchronization method in an embodiment of the invention;
FIG. 3 is a flow chart of a distributed data synchronization method in another embodiment of the present invention;
FIG. 4 is a flowchart of step S20 of the distributed data synchronization method according to an embodiment of the present invention;
FIG. 5 is a flowchart of step S50 of the distributed data synchronization method according to an embodiment of the present invention;
FIG. 6 is a flowchart of step S50 of the distributed data synchronization method in another embodiment of the present invention;
FIG. 7 is a functional block diagram of a distributed data synchronization apparatus in an embodiment of the present invention;
FIG. 8 is a functional block diagram of an encapsulation module of the distributed data synchronization apparatus in an embodiment of the present invention;
FIG. 9 is a functional block diagram of a synchronization module of the distributed data synchronization apparatus in an embodiment of the present invention;
FIG. 10 is a schematic diagram of a computer device in an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The distributed data synchronization method provided by the invention can be applied to the application environment shown in fig. 1, wherein a first client, a source server, a zookeeper server, a one-data server, a kafka cluster, a target server and a second client communicate with each other through a network. The first client can obtain data from the source server to perform corresponding business interaction, and the second client can obtain data from the target server to perform corresponding business interaction, wherein the first client and the second client include but are not limited to various personal computers, notebook computers, smart phones, tablet computers, cameras and portable wearable devices. The source server, the zookeeper server, the one-data server and the target server can be realized by independent servers or a server cluster consisting of a plurality of servers. The kafka cluster may be implemented for a server cluster consisting of a single or a plurality of servers.
In an embodiment, as shown in fig. 2, a distributed data synchronization method is provided, which mainly includes the following steps S10-S70:
s10, when a one-data server in the distributed one-data cluster is powered on, acquiring a preset configuration file, setting initial configuration parameters of the powered-on one-data server according to the configuration file, and recording the initial configuration parameters as execution parameters.
Understandably, the distributed one-data cluster is composed of at least two distributed one-data servers placed in different areas, the one-data servers are servers for providing data synchronization, and when the one-data servers in the distributed one-data cluster are powered on, the powering on includes turning on a power supply and restarting in an unpowered state; acquiring a preset configuration file, where the configuration file may be a file stored under a preset storage path shared by the distributed one-data cluster, or a file stored under a storage path of a server preset outside the distributed one-data cluster, where the configuration file may be accessed by all one-data servers in the distributed one-data cluster, the configuration file includes many parameters related to configuration, the parameters in the configuration file may be set according to requirements, and the powered-up one-data server sets initial configuration parameters of the powered-up one-data server according to the parameters in the configuration file, that is, extracts the parameters in the configuration file to set configuration parameters corresponding to the parameters in the configuration file, recording the initial configuration parameters as execution parameters; when the one-data server is restarted in the non-power-off state, the one-data server can be restarted through a restart instruction without manually restarting the server, so that the convenience of remote control is realized.
In this way, the problem of area limitation of the one-data server, namely the problem of cross-area of the one-data server does not need to be considered, is solved through the distributed one-data cluster.
And S20, sending a registration instruction corresponding to the powered-on one-data server to the zookeeper server at regular time according to the registration parameter in the execution parameters of the powered-on one-data server.
The registration parameters include registration period parameters, which may be set according to requirements, where the registration period parameters are parameters of a time period in which the powered-on one-data server sends the registration instruction to the zookeeper server at regular time, the zookeeper server may be implemented by an independent server or a server cluster formed by multiple servers, the zookeeper server is a server used for selecting a leader from multiple one-data servers, the registration instruction includes the registration performance parameters, the registration performance parameters are performance-related parameters acquired after the powered-on one-data server performs performance detection on the server, and the performance-related parameters may be set according to requirements, for example, the performance-related parameters include a running time, and a time period of the one-data server, The number of tasks of the one-data server, the number of transmission queues of the one-data server, and the like.
Understandably, according to a registration parameter in the execution parameters of the powered-on one-data server, sending a registration instruction corresponding to the powered-on one-data server to the zookeeper server at regular time according to the registration period parameter, where one-data server corresponds to one registration instruction.
In an embodiment, as shown in fig. 4, before the step S20, that is, before the step S sends a registration instruction corresponding to the powered-on one-data server to the zookeeper server at regular time according to a registration parameter in the execution parameters of the powered-on one-data server, the method includes:
s201, regularly monitoring whether the configuration file is updated.
Understandably, all the powered-on one-data servers in the distributed one-data cluster regularly monitor whether the configuration file is updated, the configuration file can update configuration parameters at any time according to requirements, and the time of the regular monitoring can be set according to requirements, such as 3 minutes.
S202, when the configuration file is updated, acquiring the updated configuration file, updating the configuration parameters according to the updated configuration file, and recording the updated configuration parameters as execution parameters.
Understandably, when the configuration file is updated, all powered-on one-data servers in the distributed one-data cluster acquire updated configuration parameters in the updated configuration file, update the configuration parameters corresponding to the parameters in the configuration file according to the updated parameters in the configuration file, and record the updated configuration parameters as execution parameters.
Therefore, the configuration file is changed at any time, all the one-data servers operate according to the latest configuration file, and the limitation that the configuration parameters of the one-data servers are updated one by one is solved.
S30, receiving a first election instruction which is sent by the zookeeper server and contains a leader, wherein the first election instruction changes a leader field in the registration parameters of the one-data server corresponding to the leader from a registrar to a leader; the leader is one-data server selected according to each received registration instruction after the zookeeper server sends the registration instruction according to each received powered-on one-data server in the distributed one-data cluster.
Understandably, all powered-on one-data servers in the distributed one-data cluster send the registration instruction to the zookeeper server, after receiving all the registration instructions, the zookeeper server selects an optimal one-data server as a leader (leader) according to all the received registration instructions, where the optimal one-data server may be an one-data server obtained by screening the registration performance parameters in all the registration instructions according to a preset optimal rule, and the optimal rule may be set according to a requirement, for example, a running time of each one-data server, a task number of each one-data server, and a sending queue number of each one-data server may be weighted and averaged to obtain a performance value of each one-data server, taking the one-data server corresponding to the largest performance value among all the performance values as an optimal one-data server, and sending the first election instruction containing a leader to the optimal one-data server by the zookeeper server, wherein the registration parameters further include a leader field, and changing the leader field in the registration parameters of the one-data server corresponding to the leader into a leader by a registrar according to the first election instruction, that is, determining that the one-data server corresponding to the leader is the only leader among all the powered-on one-data servers in the distributed one-cluster.
Therefore, the one-data server with the optimal performance is elected for the distributed one-data cluster through the zookeeper server, so that the performance of the distributed one-data cluster is ensured, the data synchronization speed is increased, and the limitation of the performance bottleneck of the one-data server is solved.
S40, when the leader field in the registration parameters of the one-data server that is powered on is the leader machine, making the leader field be the log file of the source database of the source server that is monitored by the one-data server of the leader machine at regular time according to the monitoring parameters in the execution parameters and the start time in the first election instruction.
The source server is a server storing the source database, the source server may be in communication connection with the one-data server through a network, the source database of the source server may be an enterprise core database, the type of the source database may be mySQ L, Oracle, postgreSQ L, and the like, and preferably, the source database is a postgreSQ L database, the execution parameters further include monitoring parameters, the log files of the source database may be log files such as binlog, WA L, and the like, and preferably, the log files of the source database are WA L log files, the monitoring parameters are parameters monitoring the time period of the log files of the source database of the source server at regular time, the first election instruction includes a start time, the start time is a start time point in the log files of the source database of all the source servers, the log files of the source database of all the source servers may be understood as checking to find whether the log files of the source data of all the source servers have data change, if the start time point in the log files of the source database is a start time point in which the log files of the source database are monitored, the log files of the distributed data of the one-data, the one-data server may be monitored according to the start time parameter of the first leader parameter of the distributed leader log files of the source database, and the start time when the log files of the cluster database, the start time parameter of the log files of the cluster database, the start time point, the cluster database, the cluster data of the cluster database, the cluster server, the cluster database, the cluster data of the cluster server.
S50, when it is monitored that data change exists in the log file of the source database, the leader field is made to acquire changed data in the log file for the one-data server of the leader, the changed data is analyzed through a python script, and the analyzed changed data is converted into an SQ L sentence text matched with a target database corresponding to the source database, wherein one source database corresponds to the target database in one target server.
The method comprises the steps that a target server is a server for storing a target database, the target server can be in communication connection with a one-data server through a network, the target database in the target server can be a cross-regional slave database, the target database can be a plurality of slave databases of the same type, the type of the target database of the target server can be mySQ L, Oracle, Hbase or postgreSQL L and other types, when data change of a log file of a source database is monitored, a leader field is made to be the one-data server of a leader to obtain changed data in the log file, the changed data is analyzed through a python script, the python script is a script file written by using a python voice script, the python script can identify different types of the source database, the changed data can be analyzed in a mode matched with the type of the source database according to the different types of the source database, the changed data can be converted into SQ data segments according to the type of the target database, the SQ is determined according to be included in the analysis of the python script file, the target database, the change data segment, the target database is determined by matching with the target database parsing 395982, and the target database parsing data segment included in the python parsing step of the parsing step of converting the parsing step of parsing step.
Therefore, the changed data in the log file is analyzed through the pythone script, the changed data are converted into SQ L statement texts corresponding to the types of the target database, multiple source database types are compatible, the changed data are converted into SQ L statements matched with the types of the target database, and the compatibility problem is solved.
In an embodiment, as shown in fig. 5, after the step S50, that is, when it is monitored that there is a data change in the log file of the source database, the obtaining of the changed data in the log file, analyzing the changed data through a python script, and converting the analyzed changed data into an SQ L sentence text matching the target database corresponding to the source database includes:
s501, obtaining the change time in the change data, and recording the change time as the latest monitoring time.
Understandably, the changed data includes a change time, the change time is a time when the changed data is generated, and the change time is recorded as the latest listening time, which indicates a latest time when the changed data is generated in all the source databases.
S502, sending leader state information to the zookeeper server at regular time according to the leader parameters in the execution parameters; the leader state information includes the latest listening time.
Understandably, the execution parameters further include a leader parameter, the leader parameter may be set according to a requirement, the leader parameter is a parameter of a time period in which the leader field is a time period in which a one-data server of a leader sends leader state information to the zookeeper server at regular time, the state information includes information of an operating state of the one-data server of the leader field, and the leader state information includes the latest monitoring time.
S503, when the leader status information includes abnormal status information, receiving a switching instruction from the zookeeper server, and changing the leader field of the one-data server whose leader field is the leader into a registrar according to the switching instruction.
Understandably, when the leader state information includes abnormal state information, the abnormal state information may be set according to requirements, for example, the abnormal state information includes that the duration of a processing task occurring by a one-data server with the leader field as a leader exceeds a preset duration threshold, the number of SQ L sentence texts processed by the one-data server with the leader field as a leader exceeds a preset text number threshold, the transmission rate of the one-data server with the leader field as a leader is lower than a preset transmission threshold, and the like, the zookeeper server sends the switching instruction to the one-data server with the leader field as a leader, and the one-data server with the leader field as a leader receives the switching instruction and changes the leader into a registrar according to the switching instruction.
S504, receiving a second election instruction which is sent by the zookeeper server and contains a new leader, and changing a leader field in the registration parameters of the one-data server corresponding to the new leader from a registrar to the leader; the new leader is one-data server reselected according to the received registration instructions sent by the one-data server powered on in the distributed one-data cluster by the zookeeper server; wherein the starting time in the election instruction is the latest listening time.
Understandably, the current leader field is removed from the one-data server of the leader in the second election instruction, namely, the second election instruction does not contain the one-data server with the leader field being the leader currently, the zookeeper server re-elects a new leader according to the received registration instruction sent by each powered-on one-data server in the distributed one-data cluster, and the one-data server corresponding to the new leader receives a second election instruction which is sent by the zookeeper server and contains the new leader, and changes a leader field in registration parameters of the one-data server corresponding to the new leader into a leader by a registrar, wherein the latest listening time is used as the starting time in the election instruction.
Therefore, when the one-data server with the leader field being the leader machine is in an abnormal state, the one-data server can timely feed back the one-data server to the zookeeper server and reselect a new leader (the new leader field being the one-data server of the leader machine), the time for switching processing when the abnormal state occurs is reduced, the seamless switching in advance is realized, and the timeliness of data synchronization is ensured.
In an embodiment, as shown in fig. 6, after step S502, that is, after the step of sending the leader status information to the zookeeper server at regular time according to the leader parameter in the execution parameters, the method includes:
s505, when the zookeeper server receives the leader state information while not being determined, receiving a third election instruction which is sent by the zookeeper server and contains a new leader, and changing a leader field in the registration parameters of the one-data server corresponding to the new leader from a registry to a leader; the new leader is one-data server reselected according to the received registration instructions sent by the one-data server powered on in the distributed one-data cluster by the zookeeper server; wherein the starting time in the election instruction is the latest listening time.
Understandably, when the zookeeper server receives the leader state information when it is not determined, that is, when the one-data server with the leader field being a leader is down or shut down, the zookeeper server re-elects a new leader according to the received registration instructions sent by each powered-on one-data server in the distributed one-data cluster, where the one-data server corresponding to the new leader receives a third election instruction containing a new leader sent from the zookeeper server, and since the current one-data server with the leader field being a leader does not send any instruction at this time, the third election instruction does not contain the one-data server with the leader field being a leader, and the registry changes the field in the registration parameters of the one-data server corresponding to the new leader into the leader, wherein the latest listening time is taken as the starting time in the election instruction.
Therefore, when the one-data server with the leader field serving as the leader is down or shut down, the zookeeper server timely takes corresponding measures to reselect a new leader (the new leader field serving as the one-data server of the leader), so that data loss or non-timeliness caused by non-response of the one-data server is avoided, and the timeliness of data synchronization is effectively guaranteed.
And S60, packaging the SQ L statement text into a subscription message, inserting the subscription message into a sending queue, and sending the subscription message to the kafka cluster through the sending queue.
Understandably, encapsulating the SQ L sentence text into the subscription message, where the subscription message is a message that can be broadcast and sent by the kafka cluster, inserting the subscription message into the sending queue, where the sending queue contains all the subscription messages to be sent to the kafka cluster, all the subscription messages in the sending queue are inserted in a time sequence, and all the subscription messages in the sending queue are sent to the kafka cluster according to topics (Topic) in the subscription messages, where one Topic corresponds to one target database.
In an embodiment, as shown in fig. 3, after the step S60, that is, after the SQ L sentence text is packaged into a subscription message and inserted into a sending queue, and sent to the kafka cluster through the sending queue, the method includes:
and S80, if the determination information containing the success of pushing the SQ L statement text fed back by the kafka cluster is not received within a preset waiting time period, writing error information containing the SQ L statement text into a Nas file.
It should be understood that the waiting time period is a time period taking time as a unit, the waiting time period may be set according to requirements, in the waiting time period, the Nas file may be a file stored in a preset storage path shared by the distributed one-data cluster, or a file stored in a storage path of a server preset outside the distributed one-data cluster, the Nas file may be written and accessed by all one-data servers in the distributed one-data cluster, the determining information that the pushing of the SQ L statement text is successful and fed back by the kafka cluster is not received indicates that the pushing of the kafka cluster is not successful, that is, the change data is a synchronization success, and the Nas file includes the SQ L statement text that is not successfully pushed.
S90, obtaining all the error information in the Nas file regularly according to the leader field as the error correction parameter in the execution parameters of the one-data server of the leader, and repackaging the SQ L statement files in all the error information into a subscription message to be sent to a kafka cluster.
The execution parameters further include error correction parameters, the error correction parameters may be set according to requirements, the error correction parameters are parameters of a time period in which the powered one-data server regularly acquires the Nas file, the Nas file includes error information and an error corrected message, the Nas file encapsulates the SQ L statement file in the error message again into a subscription message, and after the subscription message is successfully sent, the nass file identifies the subscription message as an error corrected message, understandably, all the error messages in the Nas file except the error corrected message are acquired regularly, and the SQ L statement files in all the error messages are encapsulated again into a subscription message, and the subscription message is sent to the kafka cluster.
Therefore, the writing of the SQ L sentence text which is not successfully sent into the unified Nas file is realized, the SQ L sentence text is sent again, the loss in the data synchronization process is avoided, and the integrity of the data synchronization is ensured.
S70, receiving the confirmed information which is fed back by the kafka cluster and contains the SQ L statement text push success, confirming that the changed data in the source database is successfully synchronized to the target database, and generating the confirmed information after the kafka cluster pushes the SQ L statement text in the subscription message to the target database in a broadcasting mode and the target database executes the SQ L statement in the SQ L statement text according to the SQ L statement text.
Understandably, the kafka cluster pushes the SQ L sentence text in the subscription message to the target database in a broadcasting mode, because the broadcasting mode pushing of the kafka cluster is used, the target database can receive the SQ L sentence matched with the database of the target server in different areas, and only the subscription message belonging to the target database is received but not all the subscription messages are received through the topic in the subscription message, after the target database executes the SQ L sentence in the SQ L sentence text according to the SQ L sentence text, the SQ L sentence text push success determination information fed back by the kafka cluster is received, so that the change data in the source database is confirmed to be successfully synchronized to the target database.
The method comprises the steps of obtaining a configuration file when a one-data server in a distributed one-data cluster is powered on, configuring according to the configuration file, regularly sending a registration instruction to a zookeeper server, receiving a first election instruction containing a leader from the zookeeper server, changing a leader field in the one-data server corresponding to the leader into a leader from a register, enabling the leader field to be a log file of a source database of all source servers monitored regularly by the one-data server of the leader, obtaining changed data in the log file when data change of the log file of the source database is monitored, analyzing the changed data through a python script, converting the analyzed changed data into an SQ L text matched with the target database corresponding to the source database, packaging the SQ L text into a subscription message, inserting the subscription message into a sending queue, sending the SQ L text into the sending queue, receiving the SQ L text feedback, and sending the SQ L confirming that the changed sentence information contained in the target database is successfully pushed to the synchronization data of the target database.
Therefore, the method and the device solve the regional limitation of the one-data server through the distributed one-data cluster, select the one-data server with the optimal performance from the distributed one-data cluster through the zookeeper server, ensure the performance of the distributed one-data cluster, analyze the changed data in the log file through the pythone script, convert the changed data into the SQ L statement text corresponding to the type of the target database, realize compatibility with various source database types and convert the changed data into the SQ L statement matched with the type of the target database, solve the compatibility problem, and finally broadcast and push the changed data to the target database through the kafka cluster, solve the regional limitation of the target database, therefore, improve the data synchronization speed, solve the regional limitation of the source database and the target database in different regions, ensure the integrity and timeliness of data synchronization, and achieve the effect of real-time synchronization.
In an embodiment, a distributed data synchronization apparatus is provided, where the distributed data synchronization apparatus corresponds to the distributed data synchronization method in the foregoing embodiment one to one. As shown in fig. 7, the distributed data synchronization apparatus includes an obtaining module 11, a sending module 12, a receiving module 13, a listening module 14, a parsing module 15, an encapsulating module 16, and a synchronization module 17. The functional modules are explained in detail as follows:
the acquiring module 11 is configured to acquire a preset configuration file when a one-data server in a distributed one-data cluster is powered on, set an initial configuration parameter of the powered-on one-data server according to the configuration file, and record the initial configuration parameter as an execution parameter;
a sending module 12, configured to send, to the zookeeper server at regular time, a registration instruction corresponding to the powered-on one-data server according to a registration parameter in the execution parameters of the powered-on one-data server;
a receiving module 13, configured to receive a first election instruction including a leader from the zookeeper server, where the first election instruction changes a leader field in the registration parameters of the one-data server corresponding to the leader from a registrar to a leader; the leader is one-data server selected by the zookeeper server according to the received registration instruction sent by each powered-on one-data server in the distributed one-data cluster;
a monitoring module 14, configured to, when the leader field in the registration parameters of the one-data server that is powered on is the leader machine, enable the leader field to be the log file of the source database of the source server, which is monitored by the one-data server of the leader machine at regular time according to the monitoring parameters in the execution parameters and the start time in the first election instruction;
the analysis module 15 is configured to, when it is monitored that a log file of the source database has data change, enable the leader field to obtain changed data in the log file for the one-data server of the leader, analyze the changed data through a python script, and convert the analyzed changed data into an SQ L statement text matched with a target database corresponding to the source database, where one source database corresponds to the target database in one target server;
the packaging module 16 is configured to package the SQ L statement text into a subscription message, insert the subscription message into a sending queue, and send the subscription message to the kafka cluster through the sending queue;
and the synchronization module 17 is configured to receive the determination information containing the successful push of the SQ L statement text fed back by the kafka cluster, confirm that the changed data in the source database is successfully synchronized with the target database, and generate the determination information after the kafka cluster pushes the SQ L statement text in the subscription message to the target database in a broadcast manner and the target database executes the SQ L statement in the SQ L statement text according to the SQ L statement text.
In one embodiment, the encapsulation module 16 includes:
the writing unit 61 is configured to, in a preset waiting time period, if the determination information containing the success of pushing the SQ L statement text fed back by the kafka cluster is not received, write error information containing the SQ L statement text into a Nas file;
a pushing unit 62, configured to obtain all the error information in the Nas file in a fixed time according to the leader field as an error correction parameter in the execution parameters of the one-data server of the leader, and repackage the SQ L statement files in all the error information into a subscription message to send to a kafka cluster.
In one embodiment, the sending module 12 includes:
the timing monitoring unit is used for monitoring whether the configuration file is updated or not at regular time;
and the acquisition updating unit is used for acquiring the updated configuration file when the configuration file is updated, updating the configuration parameters according to the updated configuration file, and recording the updated configuration parameters as the execution parameters.
In one embodiment, the synchronization module 17 includes:
an obtaining unit 71, configured to obtain a change time in the change data, and record the change time as a latest monitoring time;
a sending unit 72, configured to send leader state information to the zookeeper server at regular time according to a leader parameter in the execution parameters; the leader state information comprises the latest listening time;
a receiving unit 73, configured to receive a switching instruction from the zookeeper server when the leader state information includes abnormal state information, and change the leader field of the one-data server whose leader field is the leader into a registrar according to the switching instruction;
an election unit 74, configured to receive a second election instruction including a new leader sent from the zookeeper server, and change a leader field in the registration parameters of the one-data server corresponding to the new leader from a registrar to a leader; the new leader is one-data server reselected according to the received registration instructions sent by the one-data server powered on in the distributed one-data cluster by the zookeeper server; wherein the starting time in the election instruction is the latest listening time.
In one embodiment, the sending unit 72 includes:
a re-election subunit, configured to receive, when the zookeeper server receives the leader state information while being undetermined, a third election instruction including a new leader and sent by the zookeeper server, and change a leader field in registration parameters of the one-data server corresponding to the new leader from a registrar to a leader; the new leader is one-data server reselected according to the received registration instructions sent by the one-data server powered on in the distributed one-data cluster by the zookeeper server; wherein the starting time in the election instruction is the latest listening time.
In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 10. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a distributed data synchronization method.
In one embodiment, a computer device is provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the distributed data synchronization method in the above embodiments is implemented.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the distributed data synchronization method of the above embodiments.
It will be understood by those of ordinary skill in the art that all or a portion of the processes of the methods of the embodiments described above may be implemented by a computer program that may be stored on a non-volatile computer-readable storage medium, which when executed, may include the processes of the embodiments of the methods described above, wherein any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. A distributed data synchronization method, comprising:
when an one-data server in a distributed one-data cluster is powered on, acquiring a preset configuration file, setting initial configuration parameters of the powered-on one-data server according to the configuration file, and recording the initial configuration parameters as execution parameters;
according to the registration parameters in the execution parameters of the electrified one-data server, regularly sending a registration instruction corresponding to the electrified one-data server to a zookeeper server;
receiving a first election instruction which is sent by the zookeeper server and contains a leader, wherein the first election instruction changes a leader field in the registration parameters of the one-data server corresponding to the leader from a registrar to a leader; the leader is one-data server selected by the zookeeper server according to the received registration instruction sent by each powered-on one-data server in the distributed one-data cluster;
when the leader field in the registration parameters of the powered one-data server is the leader machine, enabling the leader field to be the log file of the source database of the source server, which is monitored by the one-data server of the leader machine at regular time according to the monitoring parameters in the execution parameters and the starting time in the first election instruction;
when monitoring that the log file of the source database has data change, enabling the leader field to acquire changed data in the log file for the one-data server of the leader, analyzing the changed data through a python script, and converting the analyzed changed data into an SQ L statement text matched with a target database corresponding to the source database, wherein one source database corresponds to the target database in one target server;
packaging the SQ L statement text into a subscription message, inserting the subscription message into a sending queue, and sending the subscription message to a kafka cluster through the sending queue;
and after the kafka cluster pushes the SQ L statement text in the subscription message to the target database in a broadcasting mode, and the target database executes the SQ 2 statement in the SQ L statement text according to the SQ L statement text, the determining information is generated.
2. The distributed data synchronization method of claim 1, wherein the step of encapsulating the SQ L statement text into a subscription message and inserting the subscription message into a sending queue, and after the sending to the kafka cluster through the sending queue comprises the following steps:
in a preset waiting time period, if the determination information containing the successful pushing of the SQ L statement text fed back by the kafka cluster is not received, writing error information containing the SQ L statement text into a Nas file;
and regularly acquiring all the error information in the Nas file according to the leader field as an error correction parameter in the execution parameters of the one-data server of the leader, and repackaging the SQ L statement files in all the error information into a subscription message to be sent to a kafka cluster.
3. The distributed data synchronization method according to claim 1, wherein before the step of sending the registration instruction corresponding to the powered-on one-data server to the zookeeper server at regular time according to the registration parameter in the execution parameters of the powered-on one-data server, the method includes:
monitoring whether the configuration file is updated or not at regular time;
and when the configuration file is updated, acquiring the updated configuration file, updating the configuration parameters according to the updated configuration file, and recording the updated configuration parameters as execution parameters.
4. The distributed data synchronization method according to claim 1, wherein after acquiring the changed data in the log file of the source database when it is monitored that there is a data change in the log file, parsing the changed data through a python script, and converting the parsed changed data into SQ L statement text matching a target database corresponding to the source database, the method comprises:
acquiring the change time in the change data, and recording the change time as the latest monitoring time;
sending leader state information to the zookeeper server at regular time according to the leader parameters in the execution parameters; the leader state information comprises the latest listening time;
when the leader state information contains abnormal state information, receiving a switching instruction from the zookeeper server, and changing the leader field of the one-data server with the leader field as the leader into a register according to the switching instruction;
receiving a second election instruction which is sent by the zookeeper server and contains a new leader, and changing a leader field in the registration parameters of the one-data server corresponding to the new leader from a registrar to a leader; the new leader is one-data server reselected according to the received registration instructions sent by the one-data server powered on in the distributed one-data cluster by the zookeeper server; wherein the starting time in the election instruction is the latest listening time.
5. The distributed data synchronization method of claim 4, wherein the timing, according to the leader parameter of the execution parameters, after sending the leader status information to the zookeeper server, comprises:
when the zookeeper server receives the leader state information while not being determined, receiving a third election instruction which is sent by the zookeeper server and contains a new leader, and changing a leader field in the registration parameters of the one-data server corresponding to the new leader from a registry to a leader; the new leader is one-data server reselected according to the received registration instructions sent by the one-data server powered on in the distributed one-data cluster by the zookeeper server; wherein the starting time in the election instruction is the latest listening time.
6. A distributed data synchronization apparatus, comprising:
the system comprises an acquisition module, a configuration module and a processing module, wherein the acquisition module is used for acquiring a preset configuration file when an one-data server in a distributed one-data cluster is powered on, setting initial configuration parameters of the powered-on one-data server according to the configuration file, and recording the initial configuration parameters as execution parameters;
a sending module, configured to send a registration instruction corresponding to the powered-on one-data server to a zookeeper server at regular time according to a registration parameter in the execution parameters of the powered-on one-data server;
a receiving module, configured to receive a first election instruction including a leader from the zookeeper server, where the first election instruction changes a leader field in the registration parameters of the one-data server corresponding to the leader from a registrar to a leader; the leader is one-data server selected by the zookeeper server according to the received registration instruction sent by each powered-on one-data server in the distributed one-data cluster;
a monitoring module, configured to, when the leader field in the registration parameters of the one-data server that is powered on is the leader machine, enable the leader field to be the one-data server of the leader machine, and periodically monitor a log file of a source database of the source server according to the monitoring parameters in the execution parameters and the start time in the first election instruction;
the analysis module is used for enabling the leader field to acquire changed data in the log file for the one-data server of the leader when monitoring that the log file of the source database has data change, analyzing the changed data through a python script, and converting the analyzed changed data into SQ L statement texts matched with a target database corresponding to the source database, wherein one source database corresponds to the target database in one target server;
the packaging module is used for packaging the SQ L statement text into a subscription message, inserting the subscription message into a sending queue and sending the subscription message to the kafka cluster through the sending queue;
and the synchronization module is used for receiving the confirmed information which is fed back by the kafka cluster and contains the successful push of the SQ L statement text, confirming that the changed data in the source database is successfully synchronized to the target database, and generating the confirmed information after the kafka cluster pushes the SQ L statement text in the subscription message to the target database in a broadcasting mode and the target database executes the SQ L statement in the SQ L statement text according to the SQ L statement text.
7. The distributed data synchronization apparatus of claim 6, wherein the encapsulation module comprises:
the writing unit is used for writing error information containing the SQ L statement text into a Nas file if the determination information containing the successful pushing of the SQ L statement text fed back by the kafka cluster is not received within a preset waiting time period;
and the pushing unit is used for acquiring all the error information in the Nas file in a timing manner according to the leader field as an error correction parameter in the execution parameters of the one-data server of the leader, and repackaging the SQ L statement files in all the error information into a subscription message to be sent to the kafka cluster.
8. The distributed data synchronization apparatus of claim 6, wherein the synchronization module comprises:
the acquisition unit is used for acquiring the change time in the change data and recording the change time as the latest monitoring time;
a sending unit, configured to send leader state information to the zookeeper server at regular time according to a leader parameter in the execution parameters; the leader state information comprises the latest listening time;
a receiving unit, configured to receive a switching instruction from the zookeeper server when the leader state information includes abnormal state information, and change the leader field of the one-data server in which the leader field is the leader into a registrar according to the switching instruction;
an election unit, configured to receive a second election instruction including a new leader and sent from the zookeeper server, and change a leader field in the registration parameters of the one-data server corresponding to the new leader from a registrar to a leader; the new leader is one-data server reselected according to the received registration instructions sent by the one-data server powered on in the distributed one-data cluster by the zookeeper server; wherein the starting time in the election instruction is the latest listening time.
9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the distributed data synchronization method of any one of claims 1 to 5 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the distributed data synchronization method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010143241.7A CN111459954A (en) | 2020-03-04 | 2020-03-04 | Distributed data synchronization method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010143241.7A CN111459954A (en) | 2020-03-04 | 2020-03-04 | Distributed data synchronization method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111459954A true CN111459954A (en) | 2020-07-28 |
Family
ID=71680891
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010143241.7A Pending CN111459954A (en) | 2020-03-04 | 2020-03-04 | Distributed data synchronization method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111459954A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112000678A (en) * | 2020-08-20 | 2020-11-27 | 北京达佳互联信息技术有限公司 | Data synchronization method, device, server and storage medium |
| CN112163025A (en) * | 2020-09-18 | 2021-01-01 | 中国建设银行股份有限公司 | Database data exporting method and device, computer equipment and storage medium |
| CN112241416A (en) * | 2020-10-16 | 2021-01-19 | 四川长虹电器股份有限公司 | System and method for constructing complex sql statement by using python syntax semantics |
| CN112328702A (en) * | 2020-12-04 | 2021-02-05 | 中信银行股份有限公司 | Data synchronization method and system |
| CN112532450A (en) * | 2020-11-30 | 2021-03-19 | 安徽中科美络信息技术有限公司 | Dynamic updating method and system for data stream distribution process configuration |
| CN112579568A (en) * | 2020-12-15 | 2021-03-30 | 中国建设银行股份有限公司 | Database version processing method and system |
| CN112632172A (en) * | 2020-12-30 | 2021-04-09 | 杭州贝嘟科技有限公司 | Volume data integration method and device, computer equipment and storage medium |
| CN113032491A (en) * | 2021-04-07 | 2021-06-25 | 工银科技有限公司 | Method, device, electronic equipment and medium for realizing static data synchronization |
| CN113239038A (en) * | 2021-05-10 | 2021-08-10 | 北京沃东天骏信息技术有限公司 | Data processing method and device |
| CN114945026A (en) * | 2022-04-24 | 2022-08-26 | 网易（杭州）网络有限公司 | Data processing method, device and system |
| CN115391463A (en) * | 2022-09-26 | 2022-11-25 | 中国建设银行股份有限公司 | Data synchronization method and device and server cluster |
| CN116405509A (en) * | 2023-06-09 | 2023-07-07 | 深圳前海环融联易信息科技服务有限公司 | Distributed monitoring method, computer equipment and storage medium thereof |
-
2020
- 2020-03-04 CN CN202010143241.7A patent/CN111459954A/en active Pending
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112000678A (en) * | 2020-08-20 | 2020-11-27 | 北京达佳互联信息技术有限公司 | Data synchronization method, device, server and storage medium |
| CN112163025A (en) * | 2020-09-18 | 2021-01-01 | 中国建设银行股份有限公司 | Database data exporting method and device, computer equipment and storage medium |
| CN112241416A (en) * | 2020-10-16 | 2021-01-19 | 四川长虹电器股份有限公司 | System and method for constructing complex sql statement by using python syntax semantics |
| CN112532450A (en) * | 2020-11-30 | 2021-03-19 | 安徽中科美络信息技术有限公司 | Dynamic updating method and system for data stream distribution process configuration |
| CN112532450B (en) * | 2020-11-30 | 2022-08-23 | 中科美络科技股份有限公司 | Dynamic updating method and system for data stream distribution process configuration |
| CN112328702A (en) * | 2020-12-04 | 2021-02-05 | 中信银行股份有限公司 | Data synchronization method and system |
| CN112328702B (en) * | 2020-12-04 | 2024-03-26 | 中信银行股份有限公司 | Data synchronization method and system |
| CN112579568A (en) * | 2020-12-15 | 2021-03-30 | 中国建设银行股份有限公司 | Database version processing method and system |
| CN112632172A (en) * | 2020-12-30 | 2021-04-09 | 杭州贝嘟科技有限公司 | Volume data integration method and device, computer equipment and storage medium |
| CN112632172B (en) * | 2020-12-30 | 2023-05-09 | 杭州贝嘟科技有限公司 | Volume data integration method, apparatus, computer device and storage medium |
| CN113032491B (en) * | 2021-04-07 | 2023-01-06 | 工银科技有限公司 | Method, device, electronic equipment and medium for realizing static data synchronization |
| CN113032491A (en) * | 2021-04-07 | 2021-06-25 | 工银科技有限公司 | Method, device, electronic equipment and medium for realizing static data synchronization |
| CN113239038A (en) * | 2021-05-10 | 2021-08-10 | 北京沃东天骏信息技术有限公司 | Data processing method and device |
| CN114945026A (en) * | 2022-04-24 | 2022-08-26 | 网易（杭州）网络有限公司 | Data processing method, device and system |
| CN115391463A (en) * | 2022-09-26 | 2022-11-25 | 中国建设银行股份有限公司 | Data synchronization method and device and server cluster |
| CN116405509A (en) * | 2023-06-09 | 2023-07-07 | 深圳前海环融联易信息科技服务有限公司 | Distributed monitoring method, computer equipment and storage medium thereof |
| CN116405509B (en) * | 2023-06-09 | 2023-09-01 | 深圳前海环融联易信息科技服务有限公司 | Distributed monitoring method, computer equipment and storage medium thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111459954A (en) | Distributed data synchronization method, device, equipment and medium | |
| WO2021121370A1 (en) | Message loss detection method and apparatus for message queue | |
| CN108566290B (en) | Service configuration management method, system, storage medium and server | |
| CN111090699A (en) | Service data synchronization method and device, storage medium and electronic device | |
| CN112507029B (en) | Data processing system and data real-time processing method | |
| US10069942B2 (en) | Method and apparatus for changing configurations | |
| CN113452774B (en) | Message pushing method, device, equipment and storage medium | |
| US10530726B2 (en) | Email notifications | |
| CN112422684B (en) | Target message processing method and device, storage medium and electronic device | |
| CN110750592B (en) | Data synchronization method, device and terminal equipment | |
| CN110650164B (en) | File uploading method and device, terminal and computer storage medium | |
| CN111865632B (en) | Switching method of distributed data storage cluster and switching instruction sending method and device | |
| CN111064626B (en) | Configuration updating method, device, server and readable storage medium | |
| CN110740145A (en) | Message consumption method, device, storage medium and electronic equipment | |
| EP3031172B1 (en) | Managing data feeds | |
| CN114258053A (en) | Wireless device and method for automatic recovery from failure | |
| US10938773B2 (en) | Method and apparatus for synchronizing contact information and medium | |
| CN108111630B (en) | Zookeeper cluster system and connection method and system thereof | |
| CN111901395A (en) | Multi-cluster switching method and device | |
| CN112019689A (en) | Incoming call show service processing system and method | |
| US10419368B1 (en) | Dynamic scaling of computing message architecture | |
| CN112256454A (en) | Message delay processing method and system | |
| CN110569673A (en) | Data file processing method, device, equipment and storage medium | |
| CN118474064A (en) | Message processing method, system, equipment and storage medium | |
| CN115314559A (en) | Network service system and abnormal response method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |