CN115242701A - Processing method, device and storage medium for airport data platform cluster consumption - Google Patents
Processing method, device and storage medium for airport data platform cluster consumption Download PDFInfo
- Publication number
- CN115242701A CN115242701A CN202210875473.0A CN202210875473A CN115242701A CN 115242701 A CN115242701 A CN 115242701A CN 202210875473 A CN202210875473 A CN 202210875473A CN 115242701 A CN115242701 A CN 115242701A
- Authority
- CN
- China
- Prior art keywords
- processor
- state
- route
- processed
- slave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 36
- 238000003860 storage Methods 0.000 title claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 80
- 238000000034 method Methods 0.000 claims abstract description 45
- 238000009826 distribution Methods 0.000 claims abstract description 43
- 230000008569 process Effects 0.000 claims abstract description 36
- 238000012544 monitoring process Methods 0.000 claims description 32
- 210000004556 brain Anatomy 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 5
- 238000011084 recovery Methods 0.000 abstract description 8
- 238000012546 transfer Methods 0.000 abstract description 7
- 238000004519 manufacturing process Methods 0.000 description 15
- 230000002159 abnormal effect Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000010276 construction Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/26—Route discovery packet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0668—Management of faults, events, alarms or notifications using network fault recovery by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/70—Routing based on monitoring results
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/12—Avoiding congestion; Recovering from congestion
- H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
Abstract
The application provides a processing method, a device and a storage medium for airport data platform cluster consumption, which comprises the following steps: acquiring various types of to-be-processed data messages of an airport data platform to be processed; controlling the master route processor to carry out load balancing distribution on each type of data messages to be processed so as to send each type of data messages to be processed to a corresponding unique slave route processor; in the process of load balancing distribution, each slave route processor monitors whether a main route processor fails, if so, an election instruction is sent to the slave route processors so as to elect a new main route processor from the slave route processors, and the new main route processor replaces the main route processor; and controlling a plurality of slave route processors to forward the received data messages to be processed into corresponding message queues. The automatic load, automatic fault discovery, automatic transfer and automatic recovery of the routing processor are realized, the routing processing efficiency of the data is improved, and the processing safety of the data is guaranteed.
Description
Technical Field
The present application relates to the technical field of airport data processing, and in particular, to a processing method, an apparatus, and a storage medium for airport data platform cluster consumption.
Background
With the gradual development of the aviation industry, passenger flow and flight volume continue to increase, the construction of an airport information system becomes an important component of airport construction. In the present stage, airports have made great progress in the aspects of informatization, digitization and intellectualization, the data exchange requirements of the airports and the outside are also obviously improved, and the airport data platform is increasingly important to build and develop in order to better help the airports to realize data exchange and resource sharing among heterogeneous systems and solve the problem of information isolated island.
Airport business data are typically characterized by multiple data sources, strong orderliness, high timeliness, safety, reliability, and non-repeatability. Aiming at the characteristics of the data, the construction of the airport data platform is formed by adding a plurality of data processing routing units on the basis of message middleware. The airport data platform adopts a scheme of cold standby deployment of key components and consumer terminals in the aspects of strong orderliness, safety reliability and non-repeatability of data, once data routing or receiving is abnormal, the airport data platform cannot automatically recover message routing and receiving and sending functions, manual check processing (restarting or cold standby switching) is required to recover airport data exchange services, data transmission errors and unsafe problems can be caused, and therefore how to improve the efficiency and safety of the airport data platform on data processing becomes a non-trivial technical problem.
Disclosure of Invention
In view of the above, an object of the present application is to provide a processing method, an apparatus and a storage medium for airport data platform cluster consumption, where only one corresponding route processor processes to-be-processed data messages of the same type of data in a cluster, and when a new main route processor joins or exits, the airport data of each type are redistributed by using a load balancing algorithm, so that automatic load, automatic fault discovery, automatic transfer and automatic recovery of the route processor are realized, the route processing efficiency of data is improved, and the processing safety of data is ensured.
The embodiment of the application provides a processing method for airport data platform cluster consumption, which is applied to a route processor cluster in an airport data platform, wherein the airport data platform further comprises a registration center, and the route processor cluster comprises a main route processor and a plurality of secondary route processors; the processing method comprises the following steps:
acquiring various types of to-be-processed data messages of an airport data platform to be processed;
controlling the main route processor to carry out load balancing distribution on each type of the data messages to be processed so as to send each type of the data messages to be processed to a corresponding unique slave route processor;
in the process of controlling the master routing processor to perform load balancing distribution on each type of data messages to be processed, each slave routing processor monitors whether the master routing processor fails, and if so, sends an election instruction to a plurality of slave routing processors so as to elect a new master routing processor from the plurality of slave routing processors, and the new master routing processor replaces the master routing processor;
and controlling a plurality of the slave route processors to forward the received data messages to be processed into corresponding message queues.
In a possible implementation manner, the controlling the master routing processor to perform load balancing distribution on the to-be-processed data messages of each type so as to send each type of the to-be-processed data messages to a corresponding unique slave routing processor includes:
monitoring a status of the cluster of route processors;
if the monitored state of the routing processor cluster is not a split state, controlling the main routing processor to be switched to an operating state from a to-be-operated state;
when the main route processor is in a running state, controlling the main route processor to distribute each type of the data messages to be processed to the corresponding slave route processors in a standby state by using a load balancing algorithm, so that the processing tasks of the corresponding data messages to be processed are added to the working thread pools corresponding to the slave route processors, and each type of the data messages to be processed is sent to the corresponding unique slave route processor.
In a possible implementation, after the monitoring the status of the routing processor cluster, the processing method further includes:
if the monitored state of the route processor cluster is a brain fracture state, monitoring whether the main route processor is still in the brain fracture state in real time in the election process;
and if so, controlling the state of the new main route processor to be a to-be-operated state, and controlling the working state of the new main route processor to be switched from the to-be-operated state to the operating state after confirming that the long connection of the main route processor is disconnected.
In one possible embodiment, it is determined whether the master routing processor has failed by:
monitoring whether the master routing processor is disconnected from a plurality of the slave routing processors;
if yes, determining that the main route processor fails.
In a possible implementation, the airport data platform further includes an application system cluster, and after the controlling the plurality of slave routing processors forwards the received pending data messages to the message queues of the corresponding application systems, the processing method further includes:
monitoring the state of the application system cluster;
if the monitored state of the application system cluster is not the split brain state, controlling a main application system in the application system cluster to be switched to an operation state from a to-be-operated state;
and when the main application system is in a running state, controlling the main application system to distribute each type of message queue to standby slave application systems in the application system cluster by using a load balancing algorithm so as to inform each standby slave application system to submit the processing task of the corresponding message queue to a work thread pool.
The embodiment of the present application further provides a processing apparatus for airport data platform cluster consumption, where the processing apparatus includes:
the acquisition module is used for acquiring various types of to-be-processed data messages of the to-be-processed airport data platform;
the route distribution module is used for controlling the main route processor to carry out load balancing distribution on each type of the data messages to be processed so as to send each type of the data messages to be processed to a corresponding unique slave route processor;
a failure detection module, configured to, in the process of controlling the master routing processor to perform load balancing allocation on each type of the to-be-processed data messages, monitor whether the master routing processor fails, and if so, send an election instruction to the multiple slave routing processors so as to elect a new master routing processor from the multiple slave routing processors, where the new master routing processor replaces the master routing processor;
and the forwarding module is used for controlling the plurality of slave route processors to forward the received data message to be processed to the corresponding message queues.
In a possible implementation manner, when the route distribution module is configured to control the master route processor to perform load balancing distribution on each type of the to-be-processed data message, so as to send each type of the to-be-processed data message to a corresponding slave route processor, the route distribution module is specifically configured to:
monitoring the state of the route processor cluster;
if the monitored state of the routing processor cluster is not a split state, controlling the main routing processor to be switched to an operating state from a to-be-operated state;
when the main route processor is in a running state, controlling the main route processor to distribute each type of the data messages to be processed to the corresponding slave route processors in a standby state by using a load balancing algorithm so as to add the processing tasks of the corresponding data messages to be processed to the working thread pools corresponding to the slave route processors, so that each type of the data messages to be processed is sent to the corresponding only one slave route processor.
In a possible implementation, the processing apparatus further includes a monitoring module configured to:
if the monitored state of the route processor cluster is a brain fracture state, monitoring whether the main route processor is still in the brain fracture state in real time in the election process;
and if so, controlling the state of the new main route processor to be a standby running state, and controlling the working state of the new main route processor to be switched from the standby running state to a running state after confirming that the long connection of the main route processor is disconnected.
An embodiment of the present application further provides an electronic device, including: a processor, a memory and a bus, the memory storing machine readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is running, the machine readable instructions when executed by the processor performing the steps of the processing method for airport data platform cluster consumption as described above.
Embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the processing method for airport data platform cluster consumption as described above.
The processing method, the device and the storage medium are applied to a route processor cluster in an airport data platform, the airport data platform further comprises a registration center, and the route processor cluster comprises a master route processor and a plurality of slave route processors; the processing method comprises the following steps: acquiring various types of to-be-processed data messages of an airport data platform to be processed; controlling the main route processor to carry out load balancing distribution on each type of the data messages to be processed so as to send each type of the data messages to be processed to a corresponding unique slave route processor; in the process of controlling the master routing processor to perform load balancing distribution on each type of data messages to be processed, each slave routing processor monitors whether the master routing processor fails, and if so, sends an election instruction to a plurality of slave routing processors so as to elect a new master routing processor from the plurality of slave routing processors, and the new master routing processor replaces the master routing processor; and controlling a plurality of the slave route processors to forward the received data messages to be processed into corresponding message queues. The cluster only has one corresponding route processor to process the data messages to be processed of the same data type, and when a new main route processor is added or quitted, the load balancing algorithm is utilized to redistribute various airport data, so that automatic load, automatic fault discovery, automatic transfer and automatic recovery of the route processor are realized, the route processing efficiency of the data is improved, and the processing safety of the data is guaranteed.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a flowchart of a processing method for airport data platform cluster consumption according to an embodiment of the present disclosure;
fig. 2 is a second flowchart of a processing method for airport data platform cluster consumption according to an embodiment of the present disclosure;
fig. 3 is a detailed flowchart of a processing method for airport data platform cluster consumption according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a processing apparatus for airport data platform cluster consumption according to an embodiment of the present disclosure;
fig. 5 is a second schematic structural diagram of a processing apparatus for airport data platform cluster consumption according to the embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for illustrative and descriptive purposes only and are not intended to limit the scope of the present application. Additionally, it should be understood that the schematic drawings are not necessarily drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be performed out of order, and that steps without logical context may be performed in reverse order or concurrently. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.
In addition, the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, as generally described and illustrated in the figures herein, could be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
To enable those skilled in the art to use the present disclosure in conjunction with a specific application scenario "processing data in an airport data platform," the following embodiments are presented to enable those skilled in the art to apply the general principles defined herein to other embodiments and application scenarios without departing from the spirit and scope of the present application.
The method, the apparatus, the electronic device, or the computer-readable storage medium described in the embodiments of the present application may be applied to any scenario that requires data processing on an airport data platform, and the embodiments of the present application do not limit a specific application scenario.
First, an application scenario to which the present application is applicable will be described. The method and the device can be applied to the technical field of airport data processing.
Research shows that airport service data are typically characterized by multiple data sources, strong orderliness, high timeliness, safety, reliability and non-repeatability. Aiming at the characteristics of the data, the construction of the current airport data platform is formed by adding a plurality of data processing routing units on the basis of message middleware. The airport data platform adopts a scheme of cold standby deployment of key components and consumer terminals in the aspects of strong orderliness, safe reliability and non-repeatability of data, once data routing or receiving is abnormal, the airport data platform cannot automatically recover routing and receiving and sending functions, manual check processing (restarting or cold standby switching) is required to recover airport data exchange services, data transmission errors and unsafe problems can be caused, and therefore how to improve the efficiency and safety of the airport data platform in data processing becomes a non-trivial technical problem.
Based on this, embodiments of the present application provide a processing method, an apparatus, and a storage medium for airport data platform cluster consumption, where only one corresponding route processor processes to-be-processed data messages of the same type of data in a cluster, and when a new main route processor joins or exits, the airport data of various types are redistributed by using a load balancing algorithm, so that automatic load, automatic fault discovery, automatic transfer, and automatic recovery of the route processor are achieved, the route processing efficiency of data is improved, and the processing safety of data is ensured.
Referring to fig. 1, fig. 1 is a flowchart of a processing method for airport data platform cluster consumption according to an embodiment of the present disclosure. As shown in fig. 1, a processing method provided in an embodiment of the present application includes:
s101: and acquiring various types of to-be-processed data messages of the airport data platform to be processed.
In the step, multiple types of to-be-processed data messages of the airport data platform to be processed are obtained.
Here, the pending data message may include a flight data message, traffic data information, baggage data information, and the like.
Wherein, the message types of the data messages to be processed are different.
S102: and controlling the main route processor to carry out load balancing distribution on the data messages to be processed of each type so as to send the data messages to be processed of each type to a corresponding unique slave route processor.
In the step, the master route processor is controlled to perform load balancing distribution on each type of data messages to be processed, so that each type of data messages to be processed is sent to the corresponding unique slave route processor.
Here, the same type of data message to be processed corresponds to only one slave route processor.
The route processor cluster is realized by adopting a register center monitoring and a raft algorithm between the route processor nodes, and double redundancy design is adopted, so that the condition that only one route processor node receives, processes and forwards the same type of data messages to be processed in the cluster is ensured, and the sequence of the strongly-ordered messages is ensured. If the registry is removed and only the routing processor cluster given to the raft algorithm is left, a plurality of main routing processors can run in parallel, and the condition that the same type of service data is received and processed by a plurality of slave routing processor nodes can occur. For example: the network between the master route processor and the two slave route processors is abnormal, but the network between the master route processor and the production queue is not disconnected, at this time, the two slave route processors can reselect a new master route processor, but the new master route processor can redistribute the data service processing tasks on the old master route processing which is disconnected with the two slave route processors before to other nodes, so that the problem that the same kind of service data is received and processed by the two route processor nodes is caused, and the disorder occurs.
Here, when the route processor cluster is started, the SDK API is called to start the work thread pool, monitor the cluster communication, and prepare other ready messages, and wait for the main route processor to elect and distribute tasks.
The route processor has 5 states (to-be-elected state, standby state, to-be-operated state, operating state and abnormal state), and the to-be-elected state is as follows: starting up all the route processors of the cluster is completed, but the state of the main route processor is not selected yet; standby state: the slave route processor successfully joins the cluster and initializes the state of finishing the work thread pool; a state to be run: the main route processor finishes election, but whether a load balancing algorithm can be started or not is not confirmed, the specific processing nodes of various data types are confirmed, and the auxiliary route processor is informed to process the task (election is finished, but the split brain problem is not eliminated); the operation state is as follows: and the main route processor finishes election, confirms with the registration center to eliminate the split brain problem, enters the running state, loads each service type data processing task and distributes and notifies each node of the task.
The state correspondence between each slave route processor and the master route processor in the route processor cluster is shown in table 1.
Table 1 Cluster node role and state correspondence table
When the master routing process uses load balancing to dispatch data, the load balancing mapping table is shown in table 2.
Table 2 load balancing mapping table
A load balancing algorithm, which divides data according to service types and groups the services according to the busy degree of the services, for example, as shown in table 2, group a includes flightdyn and freightt data types; group B comprises FLIGHT _ BASE and GTC service types; group C contains LUGGAGE traffic types. Corresponding we can see that these types of ordered data are processed at that slave route processor when the cluster has two slave route processors and at that slave route processor when the cluster has three nodes.
In a possible implementation manner, the controlling the master routing processor to perform load balancing distribution on the to-be-processed data messages of each type so as to send each type of the to-be-processed data messages to a corresponding unique slave routing processor includes:
a: monitoring a status of the cluster of route processors.
Here, the registry monitors the status of the cluster of route processors.
B: and if the monitored state of the route processor cluster is not the split brain state, controlling the main route processor to be switched to the running state from the to-be-run state.
And if the monitored state of the routing processor cluster is not in a split state, controlling the main routing processor to be switched from a to-be-operated state to an operated state.
Here, the split brain state is that the network of the master route processor and the other slave route processors in the route processor cluster is abnormally disconnected, so that the other slave route processors take the fault of the master route processor, and a new master route processor is reselected, and at this time, two master route processors in the route processor cluster run simultaneously, so that some data processing is disordered.
C: and when the main route processor is in a running state, controlling the main route processor to distribute each type of the data messages to be processed to the corresponding slave route processors in a standby state by using a load balancing algorithm so as to add the processing tasks of the corresponding data messages to be processed to the working thread pools corresponding to the slave route processors, so that each type of the data messages to be processed is sent to the corresponding unique slave route processor.
And the master routing processor is controlled to distribute each type of data messages to be processed to the corresponding slave routing processors in a standby state by using a load balancing algorithm during the operation, so that the slave routing processors in the standby state are informed to add processing tasks of the corresponding data messages to be processed to the corresponding work thread pools, and the data messages to be processed of each type are sent to the corresponding slave routing processors to carry out routing forwarding on the data messages to be processed of the plurality types.
In a specific embodiment, the cluster deployment of the multiple routing processors is called a routing processor cluster, and the slave routing processor and the master routing processor communicate with each other in real time to inform the service condition and the operation condition of the routing processor of the node. The route processor cluster comprises a main route processor (Leader) and a plurality of auxiliary route processors (followers). All the route processors in the cluster are in an active state (starting and running/starting and standby), after the cluster is started, the main route processor can firstly enter a state to be run, after the brain crack problem is determined, the main route processor enters a running state, a specific load balancing algorithm is adopted, various types of data messages to be processed are pre-distributed to the auxiliary route processors in the standby state and the auxiliary route processors according to the load balancing algorithm, the auxiliary route processors are informed to submit airport data information of the type to working thread pools of the auxiliary route processors, threads are started to receive data of a sending queue and process and route forwarding (such as flight dynamic data), and after the threads are started, the auxiliary route processors inform the main route processors of the starting results of the business processing threads of the main route processors.
In a possible implementation, after the monitoring the status of the routing processor cluster, the processing method further includes:
a: and if the monitored state of the route processor cluster is a brain fracture state, monitoring whether the main route processor is still in the brain fracture state in real time in the election process.
Here, if the monitored state of the route processor cluster is a brain-split state, whether the main route processor still has the brain-split state is monitored in real time in the election process.
b: and if so, controlling the state of the new main route processor to be a to-be-operated state, and controlling the working state of the new main route processor to be switched from the to-be-operated state to the operating state after confirming that the long connection of the main route processor is disconnected. Here, if the split brain state still exists, the state of the new main route processor is controlled to be the standby state, and after the long connection disconnection of the main route processor is confirmed, the operating state of the new main route processor is controlled to be switched from the standby state to the operating state.
Here, if there is no split brain state, the state of the new main route processor is controlled to be the operating state.
In a specific embodiment, a registry concept is introduced for the split brain phenomenon, the registry monitors the connection relationship between the route processor and the production queue at any time and persists the connection relationship to each registry, a new main route processor actively inquires the registry when electing, whether the split brain phenomenon exists or not, whether other route processor nodes are still connected to the production queue or not, if the new main route processor nodes are still connected, the state of the new main route processor is changed into a to-be-run state, an alarm is sent to a platform monitoring page to apply for manual intervention to investigate network problems, and during the period, the new main route processor in the to-be-run state continuously inquires whether the registry can change into the run state and reload the route processor and process data. The ready-to-run state Leader state becomes the run state in the following two cases. Firstly, when the original main route processor is disconnected with the production queue, the state of a new main route processor to be operated is changed into an operation state, the new main route processor performs load balancing and distributes tasks to each slave route processor, and each slave route processor performs processing route work of production service data; second, after the network is restored, the new master route processor in the to-be-run state is greater than the old master route processor because the task number (1 is added to the task number every time the new master route processor elects once) is greater than the old master route processor, so the new master route processor in the to-be-run state can notify the old master route processor to change its state into the slave route processor to rejoin the route processor cluster, and after confirming that the notification from each slave route processor is received and determining that there is no error, the new master route processor in the to-be-run state changes its state from the to-be-run state, and performs load balancing for the route processors and distributes tasks to each slave route processor.
S103: in the process of controlling the master route processor to perform load balancing distribution on each type of data messages to be processed, each slave route processor monitors whether the master route processor fails, and if so, an election instruction is sent to the slave route processors so as to elect a new master route processor from the slave route processors, and the new master route processor replaces the master route processor.
In the step, when the main route processor is monitored to have a fault, a new main route processor is elected from the plurality of slave route processors, and the new main route processor converts the state from a standby state to a to-be-run state; the new main routing processor confirms whether the state to be operated is converted into the operation state or not to the registration center; if yes, the new main route processor executes the working thread pool of the main route processor, and when the main route processor is in failure and normal recovery, the main route processor is added into the route processor cluster to be used as a slave route processor to enter a standby state, and the to-be-processed data messages processed by the loads of the plurality of slave route processors are redistributed.
Here, in addition to monitoring the master routing processor by each slave routing processor, the master routing processor may also detect whether each slave routing processor fails, and if so, the master routing processor may remove the failed slave routing processor from the cluster, and reload the failure from the routing data processing task to the other slave routing processors.
Here, the election process is performed by setting the own node state to a fowlower state, and checking whether the routing processor cluster monitoring service has a heartbeat message from the main routing process within a period of time (timeout, timeout time, e.g. 200 ms), if the heartbeat message from the main routing process is received, it indicates that the routing processor cluster election has succeeded, at this time, the slave routing process changes its own state to a standby state, and waits for the main routing processor to distribute the data processing task; if after timeout, the heartbeat information processed by the master route is still not received, at this time, the slave route processor will add 1 to term and change itself to the candidate master route processor, and the candidate master route processor will become the new master route processor by using a timeout random timer (each candidate master route processor selects a random value within a time interval, for example, 150-300 ms).
The interconnection and intercommunication giving tcp long connection among the routing processors of the routing processor cluster are realized based on the raft consistency algorithm principle among the routing processors of the routing processor cluster. After each route processor is started, the slave route processor in a standby state and the master route processor in a to-be-run state initialize a working thread pool and are mainly responsible for managing the connection of the route processors to a production queue and routing processing tasks. After receiving the processing data processing task, the route processor node can automatically submit the data processing work task to its own work thread pool, and the work thread pool can immediately start the task after receiving the task, so as to provide the processing route work of the production service data. When the main route processor is abnormal and enters an abnormal state, the main route processor can automatically remove the abnormal task from the working thread pool, release the connection between the main route processor and the production queue, report the abnormal information of the registration center, then automatically delete the process (which is equivalent to closing the main route processor), at the moment, the rest of the auxiliary route processors can reselect a new main route processor, the new main route processor enters a to-be-run state, further enters a running state, re-loads the data processing tasks of all service types and distributes and informs the tasks to all nodes.
In an embodiment, when the master route processor fails, the cluster automatically selects a new master route processor from the remaining slave route processors. At this time, the new main route processor will change its own state from standby state to standby state, and confirm to the registry whether it can change into operation state, after confirmation, it will take over the work of former main route processor formally. And after the former main route processor is recovered, the former main route processor automatically joins the cluster as a slave route processor and enters a standby state, and the main route processor redistributes the service data types to be processed of each node according to a load balancing algorithm so as to realize the balanced utilization of resources. That is to say, in any situation, only one route processor node processes data of the same type in the cluster, and when a new node joins or exits, the load balancing algorithm is used to recalculate the positions of various types of service data and reload the data, so that the maximum utilization of resources is achieved, and the high availability and the easy expansibility of the route processor are realized on the premise of ensuring the strong order of the data.
In one possible embodiment, it is determined whether the master routing processor has failed by:
monitoring whether said master routing processor is disconnected from a plurality of said slave routing processors; if yes, determining that the main route processor fails.
Here, when the master routing processor is disconnected from the slave routing processor, it is determined that the master routing processor fails, and here, it is not limited that the master routing processor fails only to do so, and any of the routing processors in the related art may fail.
S104: and controlling a plurality of the slave route processors to forward the received data messages to be processed into corresponding message queues.
In the step, a plurality of slave routing processors are controlled to forward the received data messages to be processed to corresponding message queues.
Here, the same type of data message to be processed corresponds to one message queue.
The processing method for cluster consumption of the airport data platform provided by the embodiment of the application comprises the following steps: acquiring various types of to-be-processed data messages of an airport data platform to be processed; controlling the master route processor to carry out load balancing distribution on each type of data messages to be processed so as to send each type of data messages to be processed to a corresponding unique slave route processor; in the process of load balancing distribution, each slave route processor monitors whether a main route processor fails, if so, a election instruction is sent to a plurality of slave route processors so as to elect a new main route processor from the plurality of slave route processors, and the new main route processor replaces the main route processor; and controlling a plurality of slave route processors to forward the received data messages to be processed into corresponding message queues. Only one route processor is used for processing the data messages to be processed of the same data type in the cluster, and when a new main route processor is added or quitted, all kinds of airport data can be redistributed by using a load balancing algorithm, so that automatic loading, automatic fault discovery, automatic transfer and automatic recovery of the route processor are realized, the route processing efficiency of the data is improved, and the processing safety of the data is guaranteed.
Referring to fig. 2, fig. 2 is a second flowchart of a processing method for airport data platform cluster consumption according to an embodiment of the present disclosure. As shown in fig. 2, a processing method provided in an embodiment of the present application includes:
s201: acquiring various types of to-be-processed data messages of an airport data platform to be processed;
s202: controlling the main route processor to carry out load balancing distribution on each type of the data messages to be processed so as to send each type of the data messages to be processed to a corresponding unique slave route processor;
s203: in the process of controlling the master routing processor to perform load balancing distribution on each type of data messages to be processed, each slave routing processor monitors whether the master routing processor fails, and if so, sends an election instruction to a plurality of slave routing processors so as to elect a new master routing processor from the plurality of slave routing processors, and the new master routing processor replaces the master routing processor;
s204: and controlling a plurality of the slave route processors to forward the received data messages to be processed into corresponding message queues.
The descriptions of S201 to S204 may refer to the descriptions of S101 to S104, and the same technical effects can be achieved, which is not described in detail herein.
S205: and monitoring the state of the application system cluster.
In this step, the state of the application system cluster is monitored.
Here, the application cluster system may include a sichuan aviation application system, and the like.
S206: and if the monitored state of the application system cluster is not the split brain state, controlling a main application system in the application system cluster to be switched to the running state from the to-be-run state.
In the step, if the monitored state of the application system cluster is not the split brain state, the main application system in the application system cluster is controlled to be switched from the to-be-operated state to the operation state.
S207: and when the master application system is in a running state, controlling the master application system to distribute each type of message queue to standby slave application systems in the application system cluster by using a load balancing algorithm so as to inform each standby slave application system to submit the processing task of the corresponding message queue to a work thread pool.
In the step, the master application system is controlled to allocate each message queue to the slave application systems in a standby state in the application system cluster by using a load balancing algorithm during running, and each slave application system in the standby state is informed to submit the processing tasks of the corresponding message queue to the work thread pool.
Here, the slave application system may be an automatic broadcasting system, an automatic baggage system, or the like.
Here, a processing method of the application system cluster and a processing method of the routing processor cluster are not described in detail here.
In another embodiment, each data type is allocated with a distributed lock, each node in the cluster competes for the distributed lock to the redis cluster, and once the distributed lock is competed, the distributed lock is connected to the service type consumption queue, the message is received and processed, and the distributed lock state is continuously refreshed and the distributed lock timeout time is updated, so that the distributed lock is continuously occupied. And once the node which acquires the lock fails before fails and the holding lock is released, other nodes have the condition that only one node can acquire the distributed lock and receive and process the message, the distributed lock state is continuously refreshed and the distributed lock timeout time is updated so as to continuously occupy the distributed lock. And after the fault node rejoins the cluster, the state of continuously acquiring the distributed lock is entered, and the distributed lock is continuously acquired from the redis cluster.
The processing method for airport data platform cluster consumption provided by the embodiment of the application comprises the steps of obtaining various types of to-be-processed data messages of an airport data platform to be processed; controlling the master route processor to carry out load balancing distribution on each type of data messages to be processed so as to send each type of data messages to be processed to a corresponding unique slave route processor; in the process of load balancing distribution, each slave route processor monitors whether a main route processor fails, if so, a election instruction is sent to a plurality of slave route processors so as to elect a new main route processor from the plurality of slave route processors, and the new main route processor replaces the main route processor; and controlling a plurality of slave route processors to forward the received data messages to be processed into corresponding message queues. Monitoring the state of the application system cluster; if the state of the application system cluster is not the split brain state, controlling a main application system in the application system cluster to be switched to an operation state from a to-be-operated state; and controlling the main application system to distribute each type of message queue to standby slave application systems in the application system cluster by using a load balancing algorithm during running, and informing each standby slave application system to submit the processing tasks of the corresponding message queue to the work thread pool. Only one route processor is used for processing the data messages to be processed of the same data type in the cluster, and when a new main route processor is added or quitted, all kinds of airport data can be redistributed by using a load balancing algorithm, so that automatic loading, automatic fault discovery, automatic transfer and automatic recovery of the route processor are realized, the route processing efficiency of the data is improved, and the processing safety of the data is guaranteed.
Further, please refer to fig. 3, where fig. 3 is a detailed flowchart of a processing method for airport data platform cluster consumption according to an embodiment of the present application. As shown in fig. 3, the producer: the upstream service system (data source) is responsible for producing service data and then sends the data to the platform production queue by calling an SDK API (software development kit) of the airport data platform, and in the embodiment, the flight information integration system sends flight dynamic data, flight date data and basic data to the platform production queue; a production queue: the airport data platform message middleware product can be used for receiving data sent by a production service system; routing service: the system mainly comprises a route processor cluster, wherein the route processor cluster is used for collecting data of a production queue, processing the data according to a message routing rule, a filtering rule and a reconstruction rule of a platform, and distributing the data to a consumption queue in a routing way; consumption queue: storing the data distributed by the route processor, and waiting for the consumption of a downstream application system; the consumer: and the downstream business system receives the data of the consumption queue. The flight information integration system is a subsystem under an airport data platform, is responsible for producing service data, and then sends the airport data to a platform production queue by calling an airport data platform SDK API; the production queue sends the received data message to be processed to the main route processor; the main route processor performs load balancing distribution on each type of airport data message processing tasks, so that each type of airport data message is sent to the only corresponding slave route processor for processing; the slave route processor and the master route processor carry out route distribution and send corresponding data messages to be processed to corresponding message queues; and the main application system in the application system cluster performs load balance distribution on each type of airport data message processing tasks, so that each type of airport data message is sent to a unique corresponding slave application system for response business processing.
Referring to fig. 4 and 5, fig. 4 is a first schematic structural diagram of a processing device for airport data platform cluster consumption according to an embodiment of the present disclosure, and fig. 5 is a second schematic structural diagram of a processing device for airport data platform cluster consumption according to an embodiment of the present disclosure. As shown in fig. 4, the processing apparatus 400 for airport data platform cluster consumption comprises:
an obtaining module 410, configured to obtain multiple types of to-be-processed data messages of an airport data platform to be processed;
a route distribution module 420, configured to control the master route processor to perform load sharing distribution on each type of the to-be-processed data message, so as to send each type of the to-be-processed data message to a corresponding unique slave route processor;
a failure detection module 430, configured to, during controlling the master routing processor to perform load balancing distribution on each type of data message to be processed, monitor whether the master routing processor fails, and if so, send an election instruction to the multiple slave routing processors, so as to elect a new master routing processor from the multiple slave routing processors, where the new master routing processor replaces the master routing processor;
a forwarding module 440, configured to control a plurality of the slave route processors to forward the received to-be-processed data message to corresponding message queues.
Further, when the route distribution module 420 is configured to control the master route processor to perform route distribution on each type of the to-be-processed data message, so as to send each type of the to-be-processed data message to a corresponding unique slave route processor, the route distribution module 420 is specifically configured to:
monitoring the state of the route processor cluster;
if the monitored state of the routing processor cluster is not a split state, controlling the main routing processor to be switched to an operating state from a to-be-operated state;
when the main route processor is in a running state, the main route processor is controlled to distribute each type of the data messages to be processed to the corresponding slave route processors in a standby state by using a load balancing algorithm, so that the processing tasks of the corresponding data messages to be processed are added to the working thread pools corresponding to the slave route processors, and each type of the data messages to be processed is sent to the corresponding unique slave route processor.
Further, as shown in fig. 5, the processing apparatus 400 for airport data platform cluster consumption further includes a monitoring module 450, where the monitoring module 450 is configured to:
if the monitored state of the route processor cluster is a brain fracture state, monitoring whether the main route processor is still in the brain fracture state in real time in the election process;
and if so, controlling the state of the new main route processor to be a to-be-operated state, and controlling the working state of the new main route processor to be switched from the to-be-operated state to the operating state after confirming that the long connection of the main route processor is disconnected.
Further, the failure detection module 430 determines whether the primary routing processor fails by:
monitoring whether the master routing processor is disconnected from a plurality of the slave routing processors;
if yes, determining that the main route processor fails.
Further, as shown in fig. 4, the processing apparatus 400 for airport data platform cluster consumption further includes an application distribution module 460, where the application distribution module 460 is configured to:
monitoring the state of the application system cluster;
if the monitored state of the application system cluster is not the split brain state, controlling a main application system in the application system cluster to be switched to an operation state from a to-be-operated state;
and when the main application system is in a running state, controlling the main application system to distribute each type of message queue to standby slave application systems in the application system cluster by using a load balancing algorithm so as to inform each standby slave application system to submit the processing task of the corresponding message queue to a work thread pool.
The processing device for airport data platform cluster consumption, provided by the embodiment of the application, comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring various types of to-be-processed data messages of an airport data platform to be processed; the route distribution module is used for controlling the main route processor to carry out load balancing distribution on each type of the data messages to be processed so as to send each type of the data messages to be processed to a corresponding unique slave route processor; a failure detection module, configured to, in the process of controlling the master routing processor to perform load balancing allocation on each type of the to-be-processed data messages, monitor whether the master routing processor fails, and if so, send an election instruction to the multiple slave routing processors so as to elect a new master routing processor from the multiple slave routing processors, where the new master routing processor replaces the master routing processor; and the forwarding module is used for controlling the plurality of slave route processors to forward the received data message to be processed to the corresponding message queues. Only one route processor is used for processing the data messages to be processed of the same type of data in the cluster, and when a new main route processor is added or withdrawn, various airport data can be redistributed by using a load balancing algorithm, so that automatic loading, automatic fault finding, automatic transfer and automatic recovery of the route processor are realized, the route processing efficiency of the data is improved, and the processing safety of the data is guaranteed.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 6, the electronic device 600 includes a processor 610, a memory 620, and a bus 630.
The memory 620 stores machine-readable instructions executable by the processor 610, when the electronic device 600 runs, the processor 610 communicates with the memory 620 through the bus 630, and when the machine-readable instructions are executed by the processor 610, the steps of the processing method for airport data platform cluster consumption in the method embodiments shown in fig. 1 and fig. 2 may be executed.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program may perform the steps of the processing method for airport data platform cluster consumption in the method embodiments shown in fig. 1 and fig. 2.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the units into only one type of logical function may be implemented in other ways, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in software functional units and sold or used as a stand-alone product, may be stored in a non-transitory computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A processing method for airport data platform cluster consumption is characterized in that the processing method is applied to a routing processor cluster in an airport data platform, the airport data platform further comprises a registration center, and the routing processor cluster comprises a master routing processor and a plurality of slave routing processors; the processing method comprises the following steps:
acquiring various types of to-be-processed data messages of an airport data platform to be processed;
controlling the main route processor to carry out load balancing distribution on each type of the data messages to be processed so as to send each type of the data messages to be processed to a corresponding unique slave route processor;
in the process of controlling the master routing processor to perform load balancing distribution on each type of data messages to be processed, each slave routing processor monitors whether the master routing processor fails, and if so, sends an election instruction to a plurality of slave routing processors so as to elect a new master routing processor from the plurality of slave routing processors, and the new master routing processor replaces the master routing processor;
and controlling a plurality of the slave route processors to forward the received data messages to be processed into corresponding message queues.
2. The processing method according to claim 1, wherein said controlling the master route processor to perform load balancing distribution on each type of the to-be-processed data messages so as to send each type of the to-be-processed data messages to a corresponding unique slave route processor comprises:
monitoring a state of the cluster of route processors;
if the monitored state of the route processor cluster is not a split brain state, controlling the main route processor to be switched to a running state from a to-be-run state;
when the main route processor is in a running state, controlling the main route processor to distribute each type of the data messages to be processed to the corresponding slave route processors in a standby state by using a load balancing algorithm so as to add the processing tasks of the corresponding data messages to be processed to the working thread pools corresponding to the slave route processors, so that each type of the data messages to be processed is sent to the corresponding only one slave route processor.
3. The processing method according to claim 2, wherein after monitoring the status of the cluster of routing processors, the processing method further comprises:
if the monitored state of the route processor cluster is a brain fracture state, monitoring whether the main route processor is still in the brain fracture state in real time in the election process;
and if so, controlling the state of the new main route processor to be a standby running state, and controlling the working state of the new main route processor to be switched from the standby running state to a running state after confirming that the long connection of the main route processor is disconnected.
4. The processing method according to claim 1, wherein it is determined whether the master routing processor fails by:
monitoring whether the master routing processor is disconnected from a plurality of the slave routing processors;
if yes, determining that the main route processor fails.
5. The process of claim 1, wherein said airport data platform further comprises a cluster of application systems, and wherein after said controlling said plurality of said slave route processors to forward received pending data messages to message queues of corresponding application systems, said process further comprises:
monitoring the state of the application system cluster;
if the monitored state of the application system cluster is not a split brain state, controlling a main application system in the application system cluster to be switched to a running state from a to-be-run state;
and when the main application system is in a running state, controlling the main application system to distribute each type of message queue to standby slave application systems in the application system cluster by using a load balancing algorithm so as to inform each standby slave application system to submit the processing task of the corresponding message queue to a work thread pool.
6. A processing apparatus for airport data platform cluster consumption, the processing apparatus comprising:
the acquisition module is used for acquiring various types of to-be-processed data messages of the to-be-processed airport data platform;
the route distribution module is used for controlling the main route processor to carry out load balancing distribution on each type of the data messages to be processed so as to send each type of the data messages to be processed to a corresponding unique slave route processor;
a failure detection module, configured to, during controlling the master routing processor to perform load balancing distribution on each type of data message to be processed, monitor whether the master routing processor fails, and if so, send an election instruction to the multiple slave routing processors, so as to elect a new master routing processor from the multiple slave routing processors, where the new master routing processor replaces the master routing processor;
and the forwarding module is used for controlling the plurality of slave route processors to forward the received data message to be processed to the corresponding message queues.
7. The processing apparatus according to claim 6, wherein the route distribution module, when configured to control the master route processor to perform load balancing distribution on each type of the to-be-processed data message, so as to send each type of the to-be-processed data message to a corresponding unique one of the slave route processors, is specifically configured to:
monitoring the state of the route processor cluster;
if the monitored state of the routing processor cluster is not a split state, controlling the main routing processor to be switched to an operating state from a to-be-operated state;
when the main route processor is in a running state, the main route processor is controlled to distribute each type of the data messages to be processed to the corresponding slave route processors in a standby state by using a load balancing algorithm, so that the processing tasks of the corresponding data messages to be processed are added to the working thread pools corresponding to the slave route processors, and each type of the data messages to be processed is sent to the corresponding unique slave route processor.
8. The processing device of claim 6, further comprising a monitoring module to:
if the monitored state of the route processor cluster is a brain fracture state, monitoring whether the main route processor is still in the brain fracture state in real time in the election process;
and if so, controlling the state of the new main route processor to be a to-be-operated state, and controlling the working state of the new main route processor to be switched from the to-be-operated state to the operating state after confirming that the long connection of the main route processor is disconnected.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is run, the machine-readable instructions when executed by the processor performing the steps of the method of processing airport data platform cluster consumption according to any of claims 1 to 5.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, performs the steps of the method for processing airport data platform cluster consumption according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210875473.0A CN115242701B (en) | 2022-07-25 | 2022-07-25 | Airport data platform cluster consumption processing method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210875473.0A CN115242701B (en) | 2022-07-25 | 2022-07-25 | Airport data platform cluster consumption processing method, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115242701A true CN115242701A (en) | 2022-10-25 |
| CN115242701B CN115242701B (en) | 2024-04-02 |
Family
ID=83675655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210875473.0A Active CN115242701B (en) | 2022-07-25 | 2022-07-25 | Airport data platform cluster consumption processing method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115242701B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103607297A (en) * | 2013-11-07 | 2014-02-26 | 上海爱数软件有限公司 | Fault processing method of computer cluster system |
| CN109672627A (en) * | 2018-09-26 | 2019-04-23 | 深圳壹账通智能科技有限公司 | Method for processing business, platform, equipment and storage medium based on cluster server |
| CN110912780A (en) * | 2019-12-13 | 2020-03-24 | 无锡华云数据技术服务有限公司 | High-availability cluster detection method, system and controlled terminal |
| US20200145344A1 (en) * | 2018-11-01 | 2020-05-07 | International Business Machines Corporation | Operating a message queue cluster having multiple nodes |
-
2022
- 2022-07-25 CN CN202210875473.0A patent/CN115242701B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103607297A (en) * | 2013-11-07 | 2014-02-26 | 上海爱数软件有限公司 | Fault processing method of computer cluster system |
| CN109672627A (en) * | 2018-09-26 | 2019-04-23 | 深圳壹账通智能科技有限公司 | Method for processing business, platform, equipment and storage medium based on cluster server |
| US20200145344A1 (en) * | 2018-11-01 | 2020-05-07 | International Business Machines Corporation | Operating a message queue cluster having multiple nodes |
| CN110912780A (en) * | 2019-12-13 | 2020-03-24 | 无锡华云数据技术服务有限公司 | High-availability cluster detection method, system and controlled terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115242701B (en) | 2024-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113014634A (en) | Cluster election processing method, device, equipment and storage medium | |
| CA3168286A1 (en) | Data flow processing method and system | |
| CN105933407B (en) | method and system for realizing high availability of Redis cluster | |
| CN103019889A (en) | Distributed file system and failure processing method thereof | |
| US10331472B2 (en) | Virtual machine service availability | |
| CN109474465A (en) | A kind of method and system of the high availability that can dynamically circulate based on server cluster | |
| CN108173971A (en) | A kind of MooseFS high availability methods and system based on active-standby switch | |
| US9942107B2 (en) | Computer system including plural computer nodes synchronized with each other | |
| CN110659262A (en) | Master-slave switching method and device for redis node | |
| CN103795572A (en) | Method for switching master server and slave server and monitoring server | |
| CN110971662A (en) | Two-node high-availability implementation method and device based on Ceph | |
| KR20150124642A (en) | Communication failure recover method of parallel-connecte server system | |
| CN105959145B (en) | A kind of method and system for the concurrent management server being applicable in high availability cluster | |
| CN113438111A (en) | Method for restoring RabbitMQ network partition based on Raft distribution and application | |
| JP2009223368A (en) | Cluster control apparatus, control system, control method, and control program | |
| CN115242701A (en) | Processing method, device and storage medium for airport data platform cluster consumption | |
| CN103793296A (en) | Method for assisting in backing-up and copying computer system in cluster | |
| CN111200518B (en) | Decentralized HPC computing cluster management method and system based on paxos algorithm | |
| JP4796086B2 (en) | Cluster system and method for selecting master node in the same system | |
| CN106534758B (en) | Conference backup method and device | |
| WO2019216210A1 (en) | Service continuation system and service continuation method | |
| JP6411790B2 (en) | Communication system and communication method | |
| CN108270831B (en) | Arbiter cluster implementation method and device | |
| CN116436768B (en) | Automatic backup method, system, equipment and medium based on cross heartbeat monitoring | |
| CN107786365B (en) | Cluster capacity expansion method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |