WO2017054512A1

WO2017054512A1 - Method and device for optimizing communication in heterogeneous cluster

Info

Publication number: WO2017054512A1
Application number: PCT/CN2016/085335
Authority: WO
Inventors: 陈前洋
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-09-30
Filing date: 2016-06-08
Publication date: 2017-04-06
Also published as: CN106559458A

Abstract

Provided is a method for optimizing communication in a heterogeneous cluster, comprising: when a cluster is in a communication state, acquiring communication data items of respective nodes in the cluster; determining message redelivery counts in respective communication data items; and if the message redelivery count in one of the communication data items reaches a predetermined count, adjusting a parameter of the node corresponding to said communication data item, wherein the parameter comprises a time for the node to receive a token of the cluster.

Description

Communication optimization method and device for heterogeneous cluster

Technical field

This paper relates to but not limited to the field of communication technology, and relates to a communication optimization method and device for heterogeneous clusters.

Background technique

The core protocol of the cluster communication component is the Totem protocol stack, which mainly includes SRP (The Totem Secure Remote Password Protocol) and RTP (The Totem redundant ring protocol), and passes the SRP protocol. Message passing, that is, passing through a token information in a cluster node, the node obtains a token and then conveys a message sequence sent by the upper layer application, and when the hardware configuration of the cluster node is greatly different, The cluster becomes a heterogeneous cluster.

In a heterogeneous cluster environment, a node can obtain a token before sending a message. The number of messages that different nodes can send varies. For example, there are two messages in the cluster. The first node can send these two messages, and the second. A node can only send one message. For the second node, it can also send two messages. To retransmit the message again, if the second node cannot send two messages all the time, the message will be retransmitted until The second node can send 2 messages to complete the communication process. Obviously, retransmission of multiple messages reduces the efficiency of cluster communication.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiment of the invention provides a communication optimization method and device for heterogeneous clusters, which solves the problem of retransmitting multiple messages between heterogeneous cluster nodes and reducing the technical efficiency of heterogeneous cluster communication.

A communication optimization method for a heterogeneous cluster according to an embodiment of the present invention, where the communication optimization method of the heterogeneous cluster includes:

Obtaining communication data of each node in the heterogeneous cluster in a heterogeneous cluster communication state;

Determine the number of message retransmissions in each communication data;

The parameter of the node corresponding to the communication data is adjusted when the number of retransmissions of the communication data reaches a preset number of times; wherein the parameter includes a time when the node receives the token information of the cluster.

Optionally, the step of acquiring communication data of each node in the heterogeneous cluster in the heterogeneous cluster communication state includes:

In the process of transmitting the message sequence by the node of the heterogeneous cluster, if it is detected that a node does not receive the preset message in the message sequence, according to the preset information that is not received in the message sequence, The identification information of the node updates the number of message retransmissions of the node;

Obtaining communication data of each node, where the communication data of the node includes identification information of the node and a number of message retransmissions corresponding to the node.

Optionally, the step of adjusting parameters of the node corresponding to the communication data when the number of retransmissions of the message having the communication data reaches a preset number of times includes:

When the number of retransmissions of the communication data reaches a preset number of times, determining that the number of retransmissions of the message reaches a node corresponding to the preset number of communication data;

Increasing the time at which the node receives the token information of the cluster.

Optionally, the method further includes: if the step of acquiring the communication data of each node in the heterogeneous cluster in the heterogeneous cluster communication state, detecting that the new node joins the heterogeneous cluster, acquiring the Describe the identification information of the new node, and record the identification information of the new node into the attribute information of the new node;

Broadcasting the current attribute information of each node to all the nodes of the heterogeneous cluster, where the attribute information corresponding to each node in the heterogeneous cluster includes the identification information of all the original nodes;

In the heterogeneous cluster, each node receives the attribute information broadcasted by other nodes, and the received attribute information is consistent with the attribute information corresponding to each node, and enters the heterogeneous cluster communication state.

Optionally, the method further includes: after the step of broadcasting the current attribute information of each node to all the nodes of the heterogeneous cluster, the communication optimization method of the heterogeneous cluster further includes:

When the node does not receive the attribute information broadcast by other nodes in the heterogeneous cluster, the current attribute information of the node is broadcast to other nodes in the heterogeneous cluster.

The embodiment of the invention provides a communication optimization device for a heterogeneous cluster, and the communication optimization device of the heterogeneous cluster includes:

Obtaining a module, configured to acquire communication data of each node in the heterogeneous cluster in a heterogeneous cluster communication state;

Determining a module, set to determine the number of retransmissions of messages in each communication data;

The adjusting module is configured to adjust a parameter of the node corresponding to the communication data when the number of retransmissions of the communication data reaches a preset number of times; wherein the parameter includes a time when the node receives the token information of the cluster.

Optionally, the obtaining module includes:

An update unit, configured to: in the process of transmitting a message sequence in each node of the heterogeneous cluster, if it is detected that a node does not receive the preset message in the message sequence, according to the message sequence not received The identification information of the node of the preset message updates the number of message retransmissions of the node;

The obtaining unit is configured to obtain communication data of each node, where the communication data of the node includes the identification information of the node and the number of message retransmissions corresponding to the node.

Optionally, the adjusting module includes:

a determining unit, configured to determine, when the number of retransmissions of the message having the communication data reaches a preset number of times, determining, by the node corresponding to the communication data that the number of retransmissions of the message reaches a preset number of times;

The adjusting unit is configured to increase a time when the node receives the token information of the cluster.

Optionally, the communication optimization device of the heterogeneous cluster further includes:

a processing module, configured to: if it is detected that a new node joins the heterogeneous cluster, acquire identification information of the new node, and record the identification information of the new node into the attribute information of the new node;

a broadcast module, configured to broadcast, to all the nodes of the heterogeneous cluster, current attribute information of each node, where the attribute information corresponding to each node in the heterogeneous cluster includes identifier information of all the original nodes;

The entry module is configured to enter the heterogeneous cluster communication state when each node in the heterogeneous cluster receives the attribute information broadcasted by other nodes and the received attribute information is consistent with the attribute information corresponding to each node.

Optionally, the broadcast module is further configured to: when the node in the heterogeneous cluster does not receive the attribute information broadcast by the other node, broadcast the current node to the other nodes in the heterogeneous cluster. Attribute information.

The communication optimization method and device for the heterogeneous cluster provided by the embodiment of the present invention determines the number of retransmissions of each communication data in the communication data according to the obtained communication data of each node in the heterogeneous cluster communication state, and has communication When the number of retransmissions of the data reaches a preset number of times, the parameters of the node corresponding to the communication data are adjusted to reduce the number of retransmissions of the node, for example, increasing the time at which the node receives the token information of the cluster. In order to reduce the number of message retransmissions of the node, instead of during the heterogeneous cluster communication process, if a node does not receive the message, the message is retransmitted. The foregoing technical solution reduces the number of message retransmissions in the communication data of the node, and adjusts the parameters of the node when the number of retransmissions of the message reaches a preset number of times, thereby reducing the number of message retransmissions of the node, thereby improving the cluster. Communication efficiency. The embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium stores computer executable instructions, and the computer executable instructions are executed to implement a communication optimization method of a heterogeneous cluster.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

DRAWINGS

1 is a schematic flowchart of a first embodiment of a communication optimization method for a heterogeneous cluster according to Embodiment 1 of the present invention;

2 is a schematic flowchart of acquiring communication data of each node in the heterogeneous cluster according to Embodiment 2 of the present invention;

3 is a schematic flowchart of adjusting parameters of a node corresponding to the communication data according to Embodiment 3 of the present invention;

4 is a schematic flowchart of a communication optimization method for a heterogeneous cluster according to Embodiment 4 of the present invention;

5 is a schematic diagram of functional modules of a communication optimization apparatus for a heterogeneous cluster according to Embodiment 5 of the present invention;

6 is a schematic diagram of a refinement function module of the acquisition module in FIG. 5;

7 is a schematic diagram of a refinement function module of the adjustment module in FIG. 5;

FIG. 8 is a schematic diagram of a refinement function module of a communication optimization apparatus for a heterogeneous cluster according to Embodiment 5 of the present invention.

The object, features, and advantages of the invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

Embodiment 1

Referring to FIG. 1, FIG. 1 is a schematic flowchart diagram of a communication optimization method for a heterogeneous cluster according to Embodiment 1 of the present invention.

The communication optimization method for the heterogeneous cluster proposed in this embodiment includes:

Step S10: Obtain communication data of each node in the heterogeneous cluster in a heterogeneous cluster communication state;

In this embodiment, the heterogeneous cluster includes multiple nodes. In this embodiment, the heterogeneous cluster includes three nodes, which are respectively P1, P2, and P3, and the communication sequence of the cluster is in accordance with P1- The order of P2-P3 is communicated.

The communication process in the heterogeneous cluster communication state is as follows: 1) The upper layer application of the heterogeneous cluster delivers a message sequence, such as M1M2M3, after the node P1 obtains the message sequence, buffers the message sequence, and waits for the token to be obtained. After the information token, the token information is delivered to the next node P2, and at this time, the cluster delivers a message sequence, and at this time, the node P1 receives the complete message sequence, and the node P1 communicates normally; 2) After the node P2 receives the token information, the node P2 can deliver the message sequence. It should be noted that if the node P2 misses the message M3 and the token information has arrived at the node P2, the node P2 records the message M3 that needs to be retransmitted and needs to be retransmitted in the storage list corresponding to the token information. P2, and the token information is further passed to the next node P3; 3) after the node P3 obtains the token information, the storage list of the record token information carries the retransmission requirement information, that is, the node P2 needs to retransmit the message M3. If the node P3 can receive the complete message sequence at this time, the node P3 can be considered to be normal communication, and then the M3 message is broadcast to the cluster, and the token information is continuously transmitted to the node P1; 4) the node P1 After the token information is obtained, the retransmission request information carried in the storage list of the token information is recorded, that is, the message M3 that the node P2 needs to retransmit, and the token information is transmitted to the node P2. Since the node P1 has received the complete message sequence at this time, the node P1 ignores the M3 message broadcast by the node P3; 5) the node P2 acquires the token information, and finds that the token information records itself If the message M3 is not received, then the node P2 acquires the M3 message broadcast by the node P3, so that the received message sequence is complete, and the node P2 clears the message retransmission information in the token information. All nodes in the heterogeneous cluster receive the sequence of messages sent by P1.

In this embodiment, a new retransmission dynamic statistics module is configured to collect communication data of each node in the heterogeneous cluster in a heterogeneous cluster communication state, and the acquiring the heterogeneous cluster The communication data of each node may be obtained by acquiring communication data of each node in the heterogeneous cluster according to a certain time interval, for example, recording communication data of similar nodes, retransmission requirements, etc., and periodically acquiring each node record. The communication data.

Step S20, determining the number of retransmissions of messages in each communication data;

In step S30, when the number of retransmissions of the communication data reaches a preset number of times, the parameters of the node corresponding to the communication data are adjusted; wherein the parameter includes the time when the node receives the token information of the cluster.

In this embodiment, after the communication data of each node is obtained, the data is directly analyzed in the background of each node in the heterogeneous cluster to determine the communication data corresponding to each node, and the embodiment may select each The number of message retransmissions corresponding to each node is set. For example, if the number of times the message is retransmitted within a period of time is less than the preset number of times, if any node has obvious centralized retransmission characteristics, that is, there is communication data. When the number of retransmissions of the message reaches a preset number of times, the parameters of the node are adjusted to reduce the number of message retransmissions of the node.

It can be understood that when the number of retransmissions of the communication data reaches a preset number of times, it indicates that the node corresponding to the communication data has a lower capability of the node message sequence in the current environment, and may be that the communication rate of the message sequence is faster, or When the node just receives the message sequence, the token information has arrived at the node. At this time, the node can only receive a part of the message sequence, causing the message to be missed. Therefore, in this embodiment, the window_size parameter of the node may be reduced, the token buffer length may be expanded, or the token interval period parameter may be expanded, and the like. The node The reduction of the window_size parameter can be understood as reducing the information transmission rate of the node. Since the heterogeneous cluster communication process can only optimize the next operation after each message retransmission, the information transmission rate of the node is reduced. The efficiency of the entire communication process can be reduced so that the node can receive messages in the sequence of messages.

The communication optimization method for the heterogeneous cluster proposed in this embodiment determines the number of retransmissions of each communication data and the message with the communication data according to the obtained communication data of each node in the heterogeneous cluster communication state. When the number of retransmissions reaches a preset number of times, the parameters of the node corresponding to the communication data are adjusted to reduce the number of message retransmissions of the node, such as increasing the time at which the node receives the token information of the cluster, so as to reduce the number of times. The number of message retransmissions of the node, rather than during the heterogeneous cluster communication process, if a node does not receive the message, the message is retransmitted, and the scheme retransmits the number of messages in the communication data of the node, and When the number of retransmissions of the message reaches a preset number of times, the parameters of the node are adjusted to reduce the number of retransmissions of the node, thereby improving the communication efficiency of the cluster.

Embodiment 2

Optionally, in order to improve the communication flexibility of the heterogeneous cluster, the communication optimization method of the heterogeneous cluster according to any of the foregoing embodiments is provided. In this embodiment, referring to FIG. 2, the step S10 includes:

Step S11, in the process of transmitting a message sequence by each node of the heterogeneous cluster, if it is detected that a node does not receive the preset message in the message sequence, according to the pre-received in the message sequence Setting the identifier information of the node of the message to update the number of message retransmissions of the node that does not receive the preset message in the message sequence;

Step S12: Acquire communication data of each node, where the communication data of the node includes identification information of the node and a number of message retransmissions corresponding to the node.

In this embodiment, a communication data table corresponding to each node in the heterogeneous cluster is established, and the communication data table is used to record communication data of each node, and the communication data of each node includes the identification information of the node and the node. The number of corresponding message retransmissions. That is, in the process of transmitting a message sequence by each node of the heterogeneous cluster, the number of message retransmissions corresponding to each node is recorded according to the identification information of each node, and if the node is not received, the message sequence is not received. And the preset message in the message, the number of message retransmissions of the node is updated according to the identifier information of the node that does not receive the preset message in the message sequence, and if the node is not detected, the pre-received in the message sequence is not received. Set the message, then protect The number of retransmissions of the message holding the node is unchanged.

Embodiment 3

Optionally, in order to improve the flexibility of the communication of the heterogeneous cluster, the communication optimization method of the heterogeneous cluster according to any of the foregoing embodiments is provided. In this embodiment, referring to FIG. 3, the S30 includes:

Step S31, when the number of retransmissions of the message having the communication data reaches a preset number of times, determining that the number of retransmissions of the message reaches a node corresponding to the communication data of the preset number of times;

Step S32, adding a time when the node receives the token information of the cluster.

In this embodiment, when the number of retransmissions of the communication data reaches a preset number of times, the node corresponding to the communication data is determined. According to any of the foregoing embodiments, the node performs multiple message retransmissions, which may be The communication sequence of the message sequence is faster, or when the node just receives the message sequence, the token information has arrived at the node, and the node can only receive a part of the message sequence, resulting in a message. The message is missed. Therefore, the embodiment may optionally expand the token interval period parameter, that is, increase the time at which the node receives the token information of the cluster, so as to reduce the number of message retransmissions of the node, that is, the The time for token information transmission in a heterogeneous cluster increases. If the time for transmitting token information in a heterogeneous cluster is 6 seconds, and there are 3 nodes in the heterogeneous cluster, then each node receives the token information. The time is 2 seconds. Now the time that the token information is passed in the heterogeneous cluster is increased to 9 seconds. The time for each node to receive the token information is 3 seconds, which is beneficial to The node receives a complete sequence of messages, thereby reducing the number of message retransmissions for the node. Optionally, after the parameters of the node corresponding to the communication data are adjusted, the number of retransmissions of the node may be cleared, and the heterogeneous cluster is continuously counted in a new round of heterogeneous cluster communication. Communication data of each node during communication.

Embodiment 4

Optionally, in order to improve the flexibility of communication of the heterogeneous cluster, the communication optimization method of the heterogeneous cluster proposed in any of the foregoing embodiments, in this embodiment, referring to FIG. 4, the communication optimization method of the heterogeneous cluster Also includes:

Step S40, in the heterogeneous cluster communication state, acquiring each node in the heterogeneous cluster Before the step of the communication data, if it is detected that the new node joins the heterogeneous cluster, the identification information of the new node is obtained, and the identification information of the new node is recorded in the attribute information of the new node;

In step S50, the current attribute information of each node is broadcasted to all the nodes of the heterogeneous cluster, where the attribute information corresponding to each node in the heterogeneous cluster includes the identification information of all the original nodes;

Step S60: In the heterogeneous cluster, each node receives attribute information broadcasted by other nodes, and when the received attribute information is consistent with the attribute information corresponding to each node, the heterogeneous cluster communication state is entered.

In this embodiment, the clusters of the original nodes P1, P2, and P3 operate normally. If a new node joins the heterogeneous cluster, such as P4, the identification information of the new node is obtained first, and the new node is obtained. The identification information is recorded in the attribute information of the new node, that is, the local node identification information is recorded in the attribute information of the new node, such as my_proc_set; and the current attribute information of each node is broadcast to all nodes of the heterogeneous cluster. For all nodes of the heterogeneous cluster to synchronize their attribute information to new attribute information containing all node identification information.

It is to be noted that the attribute information corresponding to each node in the heterogeneous cluster includes the identification information of each node, that is, the attribute information corresponding to the original nodes P1, P2, and P3 is P1P2P3, which is better. An example is as follows: In the heterogeneous cluster, the new node P4 broadcasts a communication message of a heterogeneous cluster dynamic addition and deletion node, such as a JoinMsg message, and the JoinMsg message includes attribute information of the node P4. When the original three nodes P1, P2, and P3 in the heterogeneous cluster receive the JoinMsg message broadcast by the node P4, enter the gather state, and the nodes P1, P2, and P3 update their own attribute information my_proc_set to The attribute information is all synchronized to new attribute information including all node identification information, that is, the original attribute information P1P2P3 of the nodes P1, P2, P3 is updated to new attribute information P1P2P3P4, and the nodes P1, P2, P3 are also clustered. The JoinMsg message is broadcasted. At this time, the node P4 also updates its attribute information to the new attribute information P1P2P3P4 when receiving the JoinMsg message broadcast by the nodes P1, P2, and P3. It can be understood that, when each node performs the broadcast JoinMsg message, as long as the node receives the JoinMsg message broadcast by other nodes, the node will compare the attribute information of the JoinMsg message with its own attribute information, if comparing the my_pro_set and the message in the message. The content of my own my_proc_set is the same, that is, when the received attribute information is consistent with the attribute information corresponding to each node, the JoinMsg message is sent. The sender_id is set to be consistent, that is, the sending address information corresponding to the attribute information of each node is set to be synchronized, displayed in the consensus list, and finally enters the heterogeneous cluster communication state.

Optionally, the method may further include: after the step S50, when the node does not receive the attribute information broadcast by the other node in the heterogeneous cluster, the node is broadcast to other nodes in the heterogeneous cluster. Current attribute information, .

In a heterogeneous cluster environment, not all nodes' consensus lists can be quickly updated to be consistent. It is possible that node P2 does not receive the JoinMsg message broadcast by node P3, so node P2's consensus[p3]= False, there is no JoinMsg message for receiving P3. At this time, retransmission is triggered, that is, message retransmission is performed. By broadcasting the current attribute information of the node to other nodes, message transmission is performed again for other nodes to feed back other nodes. Corresponding attribute information is sent to the node, and each node has a certain time requirement to enter the consensus state. If the node that has been in the cluster enters the consensus state for a long time and the receiving JoinMsg interval is long, the modification informs the newly added node in JoinMsg to reduce the window_size and expand the token parameter. If it is a new join node entering the consensus state for a long time, then slightly expand the consensus timer duration and so on.

Embodiment 5

Referring to FIG. 5, FIG. 5 is a schematic diagram of functional modules of a communication optimization apparatus for a heterogeneous cluster according to an embodiment of the present invention.

It should be emphasized that, for those skilled in the art, the functional block diagram shown in FIG. 5 is merely an exemplary diagram of an alternative embodiment, and those skilled in the art will surround the heterogeneous cluster communication optimization apparatus shown in FIG. 5. The function module can be easily supplemented by a new function module; the name of each function module is a custom name, which is only used to assist in understanding each program function block of the communication optimization device of the heterogeneous cluster, and is not used to limit the technology of the present application. Solution, the core of the technical solution of the present application is the function to be achieved by each functional module of a custom name.

A communication optimization device for a heterogeneous cluster proposed in this embodiment includes:

Obtaining module 10, configured to acquire each of the heterogeneous clusters in a heterogeneous cluster communication state Communication data of the node;

In this embodiment, the heterogeneous cluster includes multiple nodes. In this embodiment, the heterogeneous cluster includes three nodes, which are respectively P1, P2, and P3, and the communication sequence of the cluster is in accordance with P1. -P2-P3 is in the order of communication, and the communication process in the heterogeneous cluster communication state is as follows: 1) The upper layer application of the heterogeneous cluster delivers a message sequence such as M1M2M3, and the node P1 caches after obtaining the message sequence. The message sequence, after acquiring the token information token, passes the token information to the next node P2, and at this time, the cluster delivers the message sequence, and at this time, the node P1 receives the complete message sequence. Then, the node P1 communicates normally; 2) after the node P2 receives the token information, the node P2 can deliver the message sequence. It should be noted that if the node P2 misses the message M3 and the token information has arrived at the node P2, the node P2 records the message M3 that needs to be retransmitted and needs to be retransmitted in the storage list corresponding to the token information. P2, and the token information is further passed to the next node P3; 3) after the node P3 obtains the token information, the storage list of the record token information carries the retransmission requirement information, that is, the node P2 needs to retransmit the message M3. If the node P3 can receive the complete message sequence at this time, the node P3 can be considered to be normal communication, and then the M3 message is broadcast to the cluster, and the token information is continuously transmitted to the After the node P1 obtains the token information, the node P1 records the retransmission requirement information carried in the storage list of the token information, that is, the message M3 that the node P2 needs to retransmit, and the token is The information is delivered to the node P2. Since the node P1 has received the complete message sequence at this time, the node P1 ignores the M3 message broadcast by the node P3; 5) the node P2 obtains the token information, and finds the location Recorded from the token information The message M3 has not been received, then the node P2 acquires the M3 message broadcast by the node P3 at this time, so that the received message sequence is complete, and the node P2 clears the message retransmission information in the token information. At this point, all nodes in the heterogeneous cluster have received the message sequence sent by P1.

In this embodiment, a new retransmission dynamic statistics module is configured to collect communication data of each node in the heterogeneous cluster in a heterogeneous cluster communication state, and the obtaining module 10 obtains the difference. The communication data of each node in the cluster may be configured to obtain communication data of each node in the heterogeneous cluster at a certain time interval, for example, recording communication data of similar nodes, retransmission requirements, etc., and periodically acquiring each The communication data recorded by the nodes.

The determining module 20 is configured to determine the number of retransmissions of the message in each communication data;

The adjusting module 30 is configured to adjust parameters of the node corresponding to the communication data when the number of retransmissions of the communication data reaches a preset number of times; wherein the parameter includes a time when the node receives the token information of the cluster.

In this embodiment, after the obtaining module 10 obtains the communication data of each node, the determining module 20 directly analyzes data in the background of each node in the heterogeneous cluster to determine communication data corresponding to each node. In this embodiment, the number of retransmissions corresponding to each node may be set first. For example, if the number of retransmissions of the message in a period of time is less than the preset number of times, if any node has obvious centralized retransmission characteristics, That is, when the number of retransmissions of the communication data reaches a preset number of times, the adjustment module 30 adjusts the parameters of the node to reduce the number of retransmissions of the node. It is understood that when there is The number of retransmissions of the communication data reaches a preset number, indicating that the node corresponding to the communication data has a lower capability of the node message sequence in the current environment, and may be that the communication rate of the message sequence is faster, or the node just received the node. When the message sequence message is described, the token information has arrived at the node, and the node can only receive a part of the message sequence, resulting in cancellation. Bobble. Therefore, in this embodiment, the adjustment module 30 may reduce the window_size parameter of the node, expand the token cache length, or expand the token interval period parameter, etc., and reduce the window_size parameter of the node may be understood as The information transmission rate of the node is reduced. Because the heterogeneous cluster communication process can only optimize the next operation after each message retransmission, the information transmission rate of the node is reduced, which can reduce the efficiency of the entire communication process. Thereby the node can receive the message in the sequence of messages.

The communication optimization device of the heterogeneous cluster proposed in this embodiment determines the number of retransmissions of each communication data and the message with the communication data according to the obtained communication data of each node in the heterogeneous cluster communication state. When the number of retransmissions reaches a preset number of times, the parameters of the node corresponding to the communication data are adjusted to reduce the number of message retransmissions of the node, such as increasing the time at which the node receives the token information of the cluster, so as to reduce the number of times. The number of message retransmissions of the node, rather than during the heterogeneous cluster communication process, if a node does not receive the message, the message is retransmitted, and the scheme retransmits the number of messages in the communication data of the node, and When the number of retransmissions of the message reaches a preset number of times, the parameters of the node are adjusted to reduce the number of retransmissions of the node, thereby improving the communication efficiency of the cluster.

Optionally, in order to improve the flexibility of the communication of the heterogeneous cluster, in this embodiment, referring to FIG. 6, the obtaining module 10 includes:

The updating unit 11 is configured to: in the process of transmitting a message sequence in each node of the heterogeneous cluster, if it is detected that a node does not receive the preset message in the message sequence, according to the non-received sequence in the message sequence The identifier information of the node of the preset message updates the number of message retransmissions of the node that does not receive the preset message in the message sequence;

The obtaining unit 13 is configured to acquire communication data of each node, where the communication data of the node includes the identification information of the node and the number of message retransmissions corresponding to the node.

In this embodiment, a communication data table corresponding to each node in the heterogeneous cluster is established, and the communication data table is used to record communication data of each node, and the communication data of each node includes the identification information of the node and the node. The number of corresponding message retransmissions. That is, in the process of transmitting a message sequence by each node of the heterogeneous cluster, the processing unit 12 records the number of message retransmissions corresponding to each node according to the identification information of each node, and if a node is not received, The preset message in the message sequence, the updating unit 11 updates the number of message retransmissions of the node according to the identifier information of the node that does not receive the preset message in the message sequence, if no node is detected yet Receiving the preset message in the message sequence, the number of message retransmissions of the node is kept unchanged.

Optionally, in order to improve the flexibility of the communication of the heterogeneous cluster, in this embodiment, referring to FIG. 7, the adjustment module 30 includes:

The determining unit 31 is configured to: when the number of retransmissions of the message having the communication data reaches a preset number of times, determine that the number of retransmissions of the message reaches a node corresponding to the communication data of the preset number of times;

The adjusting unit 32 is configured to increase the time when the node receives the token information of the cluster.

In this embodiment, when the number of retransmissions of the communication data reaches a preset number of times, the determining unit 31 determines the node corresponding to the communication data. According to any of the foregoing embodiments, the node performs multiple times of the message. Retransmission, it may be that the communication sequence of the message sequence is faster, or when the node just receives the message sequence, the token information has arrived at the node, and the node can only receive the message sequence. The part of the message causes the message to be missed. Therefore, the adjusting unit 32 may optionally expand the token interval period parameter, that is, increase the node receiving station. The time of the token information of the cluster is reduced to reduce the number of message retransmissions of the node, that is, the time for transmitting the token information in the heterogeneous cluster is increased, and the time for transmitting the token information in the heterogeneous cluster is 6 seconds. And the three nodes in the heterogeneous cluster, then each node receives the token information for 2 seconds, and now the time for transmitting the token information in the heterogeneous cluster is increased to 9 seconds, then The time at which each node receives the token information is 3 seconds, which is advantageous for the node to receive a complete message sequence, thereby reducing the number of message retransmissions of the node. Optionally, after the adjusting unit 32 adjusts parameters of the node corresponding to the communication data, the number of retransmissions of the node may be cleared, and statistics are continued in a new round of heterogeneous cluster communication. Communication data of each node in the heterogeneous cluster communication process.

Optionally, in order to improve the flexibility of the communication of the heterogeneous cluster, in this embodiment, referring to FIG. 8, the communication optimization apparatus of the heterogeneous cluster includes:

The processing module 40 is configured to: if it is detected that the new node joins the heterogeneous cluster, acquire the identification information of the new node, and record the new node identifier information into the attribute information of the new node;

The broadcast module 50 is configured to broadcast the current attribute information of each node to all the nodes of the heterogeneous cluster, where the attribute information corresponding to each node in the heterogeneous cluster includes the identification information of all the original nodes;

The entering module 60 is configured to enter the heterogeneous cluster communication state when each node in the heterogeneous cluster receives the attribute information broadcasted by other nodes and the received attribute information is consistent with the attribute information corresponding to each node.

In this embodiment, the clusters of the original nodes P1, P2, and P3 are in normal operation. If a new node, such as P4, joins the heterogeneous cluster, the processing module 40 first obtains the identification information of the new node, and The identification information of the new node is recorded in the attribute information of the new node, that is, the local node identification information is recorded in the attribute information of the new node, such as my_proc_set; meanwhile, the broadcast module 50 is to the heterogeneous cluster. All nodes broadcast the current attribute information of each node, so that all nodes of the heterogeneous cluster synchronize their attribute information into new attribute information including all node identification information.

It is to be noted that the attribute information corresponding to each node in the heterogeneous cluster includes the identification information of each node, that is, the attribute information corresponding to the original nodes P1, P2, and P3 are P1P2P3, for a better understanding of the embodiment, for example: when the new node P4 joins the heterogeneous cluster, the new node P4 broadcasts a communication message of the heterogeneous cluster dynamic addition and deletion node, such as a JoinMsg message, and the JoinMsg message includes the node P4. Attribute information. At this time, when the original three nodes P1, P2, and P3 in the heterogeneous cluster receive the JoinMsg message broadcast by the node P4, the state enters the gather state, and the nodes P1, P2, and P3 update their own. The attribute information my_proc_set is used to synchronize the attribute information to new attribute information including all node identification information, that is, the original attribute information P1P2P3 of the nodes P1, P2, P3 is updated to new attribute information P1P2P3P4, and the nodes P1, P2 are P3 also broadcasts its JoinMsg message to the cluster. At this time, the node P4 also updates its attribute information to the new attribute information P1P2P3P4 when receiving the JoinMsg message broadcast by the nodes P1, P2, and P3. It can be understood that When each node broadcasts a JoinMsg message, as long as the node receives the JoinMsg message broadcast by other nodes, it will attribute the attribute information of the JoinMsg message and its own attribute information. For comparison, if the content of my_pro_set in the comparison message is the same as the content of its own my_proc_set, that is, the received attribute information is consistent with the attribute information corresponding to each node, the sender_id in the JoinMsg message is set to be consistent, that is, The sending address information corresponding to the attribute information of each node sets the synchronization identifier, and is displayed in the consensus list. Finally, the entering module 60 enters the heterogeneous cluster communication state.

Optionally, the broadcast module 50 is further configured to: when the node in the heterogeneous cluster does not receive the attribute information broadcast by the other node, broadcast the current attribute information of the node to other nodes in the heterogeneous cluster. .

In a heterogeneous cluster environment, not all nodes' consensus lists can be quickly updated to be consistent. It is possible that node P2 does not receive the JoinMsg message broadcast by node P3, so node P2's consensus[p3]= False, there is no JoinMsg message for receiving P3. At this time, retransmission is triggered, that is, message retransmission is performed. The broadcast module 50 broadcasts the current attribute information of the node to other nodes, and then transmits the message again for Other nodes feed back the attribute information corresponding to other nodes to the node, and each node has a certain time requirement to enter the consensus state. If the node that has been in the cluster enters the consensus state for a long time and the receiving JoinMsg interval is long, the modification informs the newly added node in JoinMsg to reduce the window_size and expand the token parameter. If it is a new join node entering the consensus state for a long time, then slightly expand the consensus timer duration and so on.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

The embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium stores computer executable instructions, and the computer executable instructions are executed to implement a communication optimization method of a heterogeneous cluster.

One of ordinary skill in the art will appreciate that all or a portion of the above steps may be performed by a program to instruct related hardware, such as a processor, which may be stored in a computer readable storage medium, such as a read only memory, disk or optical disk. Wait. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the above embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, executing a program stored in the memory by a processor. / instruction to achieve its corresponding function. This application is not limited to any specific combination of hardware and software. A person skilled in the art should understand that the technical solutions of the present application can be modified or equivalent, without departing from the spirit and scope of the technical solutions of the present application, and should be included in the scope of the claims of the present application.

Industrial applicability

The above technical solution reduces the number of message retransmissions of the node, thereby improving the communication efficiency of the cluster.

Claims

A communication optimization method for a heterogeneous cluster, wherein the communication optimization method of the heterogeneous cluster includes:

Obtaining communication data of each node in the heterogeneous cluster in a heterogeneous cluster communication state;

Determine the number of message retransmissions in each communication data;

The parameter of the node corresponding to the communication data is adjusted when the number of retransmissions of the communication data reaches a preset number of times; wherein the parameter includes a time when the node receives the token information of the cluster.
The communication optimization method of the heterogeneous cluster according to claim 1, wherein the step of acquiring communication data of each node in the heterogeneous cluster in the heterogeneous cluster communication state comprises:

In the process of transmitting the message sequence by the node of the heterogeneous cluster, if it is detected that a node does not receive the preset message in the message sequence, according to the preset information that is not received in the message sequence, The identification information of the node updates the number of message retransmissions of the node;

Obtaining communication data of each node, where the communication data of the node includes identification information of the node and a number of message retransmissions corresponding to the node.
The communication optimization method of the heterogeneous cluster according to claim 1, wherein the step of adjusting the parameters of the node corresponding to the communication data when the number of retransmissions of the communication data reaches a preset number of times comprises:

When the number of retransmissions of the communication data reaches a preset number of times, determining that the number of retransmissions of the message reaches a node corresponding to the preset number of communication data;

Increasing the time at which the node receives the token information of the cluster.
The method for optimizing communication of a heterogeneous cluster according to any one of claims 1 to 3, further comprising: obtaining, in a heterogeneous cluster communication state, communication data of each node in the heterogeneous cluster If the new node is detected to join the heterogeneous cluster, the identification information of the new node is obtained, and the identification information of the new node is recorded in the attribute information of the new node.

Broadcasting the current attribute information of each node to all the nodes of the heterogeneous cluster, where the attribute information corresponding to each node in the heterogeneous cluster includes the identification information of all the original nodes;

In the heterogeneous cluster, each node receives the attribute information broadcasted by other nodes, and the received attribute information is consistent with the attribute information corresponding to each node, and enters the heterogeneous cluster communication state.
The method for optimizing communication of a heterogeneous cluster according to claim 4, further comprising: after the step of broadcasting current attribute information of each node to all nodes of the heterogeneous cluster, the heterogeneous cluster Communication optimization methods also include:

When the node does not receive the attribute information broadcast by other nodes in the heterogeneous cluster, the current attribute information of the node is broadcast to other nodes in the heterogeneous cluster.
A communication optimization device for a heterogeneous cluster, the communication optimization device of the heterogeneous cluster includes:

Obtaining a module, configured to acquire communication data of each node in the heterogeneous cluster in a heterogeneous cluster communication state;

Determining a module, set to determine the number of retransmissions of messages in each communication data;

The adjusting module is configured to adjust a parameter of the node corresponding to the communication data when the number of retransmissions of the communication data reaches a preset number of times; wherein the parameter includes a time when the node receives the token information of the cluster.
The communication optimization device of the heterogeneous cluster of claim 6, wherein the obtaining module comprises:

An update unit, configured to: in the process of transmitting a message sequence in each node of the heterogeneous cluster, if it is detected that a node does not receive the preset message in the message sequence, according to the message sequence not received The identification information of the node of the preset message updates the number of message retransmissions of the node;

The obtaining unit is configured to obtain communication data of each node, where the communication data of the node includes the identification information of the node and the number of message retransmissions corresponding to the node.
The communication optimization device of the heterogeneous cluster of claim 6, wherein the adjustment module comprises:

a determining unit, configured to determine, when the number of retransmissions of the message having the communication data reaches a preset number of times, determining, by the node corresponding to the communication data that the number of retransmissions of the message reaches a preset number of times;

The adjusting unit is configured to increase a time when the node receives the token information of the cluster.
The communication optimization device of the heterogeneous cluster according to any one of claims 6-8, wherein the communication optimization device of the heterogeneous cluster further comprises:

a processing module, configured to acquire the new node if it detects that a new node joins the heterogeneous cluster Identification information, and recording the identification information of the new node into the attribute information of the new node;

a broadcast module, configured to broadcast, to all the nodes of the heterogeneous cluster, current attribute information of each node, where the attribute information corresponding to each node in the heterogeneous cluster includes identifier information of all the original nodes;

The entry module is configured to enter the heterogeneous cluster communication state when each node in the heterogeneous cluster receives the attribute information broadcasted by other nodes and the received attribute information is consistent with the attribute information corresponding to each node.
The communication optimization device of the heterogeneous cluster according to claim 9, wherein the broadcast module is further configured to: when a node in the heterogeneous cluster does not receive attribute information broadcast by other nodes, to the heterogeneous cluster Other nodes broadcast the current attribute information of the node.