CN105407087A - Message sending method and device - Google Patents

Message sending method and device Download PDF

Info

Publication number
CN105407087A
CN105407087A CN201510714154.1A CN201510714154A CN105407087A CN 105407087 A CN105407087 A CN 105407087A CN 201510714154 A CN201510714154 A CN 201510714154A CN 105407087 A CN105407087 A CN 105407087A
Authority
CN
China
Prior art keywords
node
group message
controlling vertex
host node
leave group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510714154.1A
Other languages
Chinese (zh)
Other versions
CN105407087B (en
Inventor
袁航
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Dt Dream Technology Co Ltd
Original Assignee
Hangzhou Dt Dream Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Dt Dream Technology Co Ltd filed Critical Hangzhou Dt Dream Technology Co Ltd
Priority to CN201811331220.7A priority Critical patent/CN109639640B/en
Priority to CN201510714154.1A priority patent/CN105407087B/en
Publication of CN105407087A publication Critical patent/CN105407087A/en
Application granted granted Critical
Publication of CN105407087B publication Critical patent/CN105407087B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10Architectures or entities
    • H04L65/1013Network architectures, gateways, control or user entities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Computer And Data Communications (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention provides a message sending method and a device, which is applied to a cluster for deploying a centralized management and control model. The message sending method comprises steps: a master node in a resource area monitors that a node leaves; if the network between the master node and a controller node is inaccessible or the master node does not receive a confirmation message of the controller node and the times of sending a node leaving message to the controller node by the master node arrive at a preset threshold, the master node sends the node leaving message to an adjacent non-master node to send the node leaving message to the controller node when the network between the adjacent non-master node and the controller node is accessible. When the network between the master node in the resource area and the controller node is inaccessible, the node leaving message is sent to the controller node as much as possible, the controller node can inform other nodes with idle resources to carry out fault recovery on resources on a left node, and high availability of the cluster can be further improved.

Description

Message method and device
Technical field
The present invention relates to communication technical field, particularly relate to a kind of message method and device.
Background technology
Cluster high availability (HighAvailability; Hereinafter referred to as: HA) refer to the downtime by as far as possible shortening because routine maintaining operations (plan) and the system crash (unplanned) that happens suddenly cause, to improve the availability of system and application.
Cluster HA software application monitoring (corosync) software of current main flow and the combination of resource management (pacemaker) software.Monitoring of software realizes the function of node relationships management and communication service, and resource management software realizes the function of resource management.Dispose the cluster of centralized management model, can be divided into resource-area, network and control (controller) node three parts, in resource-area, each main frame (host) all needs to dispose monitoring and resource management software.Resource management in resource-area selects a node as the host node (master node) of resource-area.If master node monitors a certain node and leaves in resource-area, be then responsible for controller node sending node leave group message by master node.After controller node receives node leave group message, find after other have the main frame of slack resources, the main frame that above-mentioned node leave group message is sent to slack resources is carried out fault recovery.
But, leave when the host node of resource-area monitors some nodes, and network between host node and controller node is unreachable, and when having the main frame of slack resources in resource-area, the resource left on node cannot carry out fault recovery.
Summary of the invention
Object of the present invention is intended to solve one of technical problem in correlation technique at least to a certain extent.
For this reason, first object of the present invention is to propose a kind of message method.The method can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, thus Controlling vertex can notify that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
Second object of the present invention is to propose a kind of message dispensing device.
To achieve these goals, the message method of first aspect present invention embodiment, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, and described method comprises: the host node in described resource-area monitors in described resource-area has node to leave, if the network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and the number of times that described host node sends described node leave group message to described Controlling vertex reaches predetermined threshold value, then described host node is to the adjacent non-master sending node leave group message of described host node, described node leave group message comprises the essential information and the described resource left on node of leaving node, when can reach to make the network of the adjacent non-master of described host node between described Controlling vertex, described node leave group message is sent to described Controlling vertex.
In the message method of the embodiment of the present invention, host node in resource-area monitors in above-mentioned resource-area to be had after node leaves, if the network between host node and Controlling vertex is unreachable, or host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and host node reaches predetermined threshold value to the number of times of Controlling vertex sending node leave group message, then host node is to the adjacent non-master sending node leave group message of above-mentioned host node, when can reach to make the network of the adjacent non-master of above-mentioned host node between Controlling vertex, node leave group message is sent to above-mentioned Controlling vertex, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
To achieve these goals, the message method of second aspect present invention embodiment, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, described method comprises: in described resource-area, the adjacent non-master of host node receives the node leave group message that described host node sends, described node leave group message comprises the essential information and the described resource left on node of leaving node, described node leave group message is that described host node monitors in described resource-area and has node to leave, network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and described host node is to send after the number of times that described Controlling vertex sends described node leave group message reaches predetermined threshold value, if the network between the adjacent non-master of described host node and described Controlling vertex can reach, then described node leave group message is sent to described Controlling vertex by the adjacent non-master of described host node.
In the message method of the embodiment of the present invention, after in resource-area, the adjacent non-master of host node receives the node leave group message of host node transmission, if the network between the adjacent non-master of above-mentioned host node and Controlling vertex can reach, then above-mentioned node leave group message is sent to above-mentioned Controlling vertex by the adjacent non-master of host node, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
To achieve these goals, the message dispensing device of third aspect present invention embodiment, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, in the host node of at least two nodes described in described message dispensing device is arranged at, whether described message dispensing device comprises: monitoring modular, have node to leave for monitoring in described resource-area, sending module, for when having node to leave in described monitoring module monitors to described resource-area, if the network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and the number of times that described host node sends described node leave group message to described Controlling vertex reaches predetermined threshold value, then to the adjacent non-master sending node leave group message of described host node, described node leave group message comprises the essential information and the described resource left on node of leaving node, when can reach to make the network of the adjacent non-master of described host node between described Controlling vertex, described node leave group message is sent to described Controlling vertex.
In above-mentioned message dispensing device, have after node leaves in monitoring module monitors to above-mentioned resource-area, if the network between host node and Controlling vertex is unreachable, or host node does not receive the acknowledge message of Controlling vertex for above-mentioned node leave group message after Controlling vertex sending node leave group message, and the number of times that host node sends above-mentioned node leave group message to above-mentioned Controlling vertex reaches predetermined threshold value, then sending module is to the adjacent non-master sending node leave group message of above-mentioned host node, when can reach to make the network of the adjacent non-master of above-mentioned host node between Controlling vertex, node leave group message is sent to above-mentioned Controlling vertex, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
To achieve these goals, the message dispensing device of fourth aspect present invention embodiment, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, in non-master adjacent with host node at least two nodes described in described message dispensing device is arranged at, described message dispensing device comprises: receiver module, for receiving the node leave group message that described host node sends, described node leave group message comprises the essential information and the described resource left on node of leaving node, described node leave group message is that described host node monitors in described resource-area and has node to leave, network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and described host node is to send after the number of times that described Controlling vertex sends described node leave group message reaches predetermined threshold value, sending module, when can reach for the network between the adjacent non-master and described Controlling vertex of described host node, sends to described Controlling vertex by described node leave group message.
In above-mentioned message dispensing device, after receiver module receives the node leave group message of host node transmission, if the network between the adjacent non-master of above-mentioned host node and Controlling vertex can reach, then above-mentioned node leave group message is sent to above-mentioned Controlling vertex by sending module, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
The aspect that the present invention adds and advantage will part provide in the following description, and part will become obvious from the following description, or be recognized by practice of the present invention.
Accompanying drawing explanation
The present invention above-mentioned and/or additional aspect and advantage will become obvious and easy understand from the following description of the accompanying drawings of embodiments, wherein:
Fig. 1 is the flow chart of a message method of the present invention embodiment;
Fig. 2 is the flow chart of another embodiment of message method of the present invention;
Fig. 3 is the flow chart of another embodiment of message method of the present invention;
Fig. 4 is the Organization Chart that the present invention disposes a cluster embodiment of centralized management model;
Fig. 5 is the structural representation of a message dispensing device of the present invention embodiment;
Fig. 6 is the structural representation of another embodiment of message dispensing device of the present invention.
Embodiment
Be described below in detail embodiments of the invention, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Being exemplary below by the embodiment be described with reference to the drawings, only for explaining the present invention, and can not limitation of the present invention being interpreted as.On the contrary, embodiments of the invention comprise fall into attached claims spirit and intension within the scope of all changes, amendment and equivalent.
Fig. 1 is the flow chart of a message method of the present invention embodiment, above-mentioned message method is applied in the cluster disposing centralized management model, above-mentioned cluster comprises resource-area and Controlling vertex, above-mentioned resource-area comprises at least two nodes, and above-mentioned at least two nodes are connected by network with above-mentioned Controlling vertex.Each node in resource-area all needs to dispose monitoring and resource management software, and the resource management software in resource-area selects a node as the host node (master node) of resource-area.
As shown in Figure 1, this message method can comprise:
Step 101, the host node in resource-area monitors in above-mentioned resource-area has node to leave.
Step 102, if the network between above-mentioned host node and above-mentioned Controlling vertex is unreachable, or above-mentioned host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and the number of times that above-mentioned host node sends above-mentioned node leave group message to above-mentioned Controlling vertex reaches predetermined threshold value, then host node is to the adjacent non-master sending node leave group message of above-mentioned host node, above-mentioned node leave group message comprises the essential information and the above-mentioned resource left on node of leaving node, when can reach to make the network of the adjacent non-master of host node between above-mentioned Controlling vertex, above-mentioned node leave group message is sent to Controlling vertex.
That is, when the host node in resource-area monitor have node to leave in above-mentioned resource-area time, if the network between above-mentioned host node and above-mentioned Controlling vertex is unreachable, at this moment host node cannot to Controlling vertex sending node leave group message; or host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and the number of times that above-mentioned host node sends above-mentioned node leave group message to above-mentioned Controlling vertex reaches predetermined threshold value, under these two kinds of situations, node leave group message can be sent to the adjacent non-master of host node by host node, if the network between the adjacent non-master of host node and above-mentioned Controlling vertex can reach, then above-mentioned node leave group message can be sent to Controlling vertex by the adjacent non-master of host node, if and network between the adjacent non-master of host node and above-mentioned Controlling vertex is also unreachable, then above-mentioned node leave group message can continue to send to next adjacent non-master by the adjacent non-master of host node, by that analogy, until the network received between the non-master of node leave group message and Controlling vertex can reach, the node leave group message received just can be sent to Controlling vertex by the non-master that the network then and between Controlling vertex can reach.
Wherein, when host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, illustrate that above-mentioned node leave group message sends unsuccessfully.Now host node needs again to Controlling vertex sending node leave group message, at this moment, if host node reaches predetermined threshold value to the number of times of Controlling vertex sending node leave group message, above-mentioned node leave group message can be sent to the adjacent non-master of host node by host node.
Above-mentioned predetermined threshold value can when specific implementation, and according to realizing the sets itself such as demand and/or systematic function, the size of the present embodiment to above-mentioned predetermined threshold value is not construed as limiting, and for example, above-mentioned predetermined threshold value can be 5.
When network is the worst, if the network in above-mentioned resource-area between all nodes and Controlling vertex is all unreachable, the above-mentioned node leave group message that above-mentioned host node sends finally is sent back to host node, that is, when network between nodes all in above-mentioned resource-area and Controlling vertex is all unreachable, the node leave group message that host node sends is transferred back to host node again after being sent out a circle.At this moment, after scheduled duration, host node is again to the adjacent non-master sending node leave group message of above-mentioned host node.Particularly, host node can arrange a timer, and after timer then, host node resends node leave group message, when guaranteeing have the network between node and Controlling vertex to reach in resource-area, in time node leave group message can be sent to Controlling vertex.Wherein, the length of above-mentioned scheduled duration can when specific implementation sets itself, the present embodiment is not construed as limiting this, and for example, above-mentioned scheduled duration can be 10 seconds.
Due to the reliable communication service of monitoring process support in resource-area, therefore host node to the adjacent non-master sending node leave group message of above-mentioned host node can be: above-mentioned node leave group message is sent to the monitoring process of above-mentioned host node by the Resource Management process of host node, and above-mentioned node leave group message is sent to the monitoring process of the adjacent non-master of above-mentioned host node by the monitoring process of above-mentioned host node.
In above-mentioned message method, host node in resource-area monitors in above-mentioned resource-area to be had after node leaves, if the network between host node and Controlling vertex is unreachable, or host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and the number of times that host node sends described node leave group message to above-mentioned Controlling vertex reaches predetermined threshold value, then host node is to the adjacent non-master sending node leave group message of above-mentioned host node, when can reach to make the network of the adjacent non-master of above-mentioned host node between Controlling vertex, node leave group message is sent to above-mentioned Controlling vertex, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
Fig. 2 is the flow chart of another embodiment of message method of the present invention, above-mentioned message method is applied in the cluster disposing centralized management model, above-mentioned cluster comprises resource-area and Controlling vertex, above-mentioned resource-area comprises at least two nodes, and above-mentioned at least two nodes are connected by network with above-mentioned Controlling vertex.Each node in resource-area all needs to dispose monitoring and resource management software, and the resource management software in resource-area selects a node as the host node (master node) of resource-area.
As shown in Figure 2, above-mentioned message method can comprise:
Step 201, in above-mentioned resource-area, the adjacent non-master of host node receives the node leave group message that host node sends, above-mentioned node leave group message comprises the essential information and the above-mentioned resource left on node of leaving node, above-mentioned node leave group message is that host node monitors in above-mentioned resource-area and has node to leave, network between above-mentioned host node and Controlling vertex is unreachable, or host node does not receive the acknowledge message of Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and above-mentioned host node is to send after the number of times that above-mentioned Controlling vertex sends above-mentioned node leave group message reaches predetermined threshold value.
Due to the reliable communication service of monitoring process support in resource-area, therefore step 201 can be: the node leave group message that the monitoring process that the monitoring process in the adjacent non-master of host node receives above-mentioned host node sends.
Step 202, if the network between the adjacent non-master of above-mentioned host node and above-mentioned Controlling vertex can reach, then above-mentioned node leave group message is sent to above-mentioned Controlling vertex by the adjacent non-master of above-mentioned host node.
Particularly, above-mentioned node leave group message sends to above-mentioned Controlling vertex to be by the adjacent non-master of above-mentioned host node: above-mentioned node leave group message is sent to the Resource Management process of the adjacent non-master of above-mentioned host node by the monitoring process of the adjacent non-master of above-mentioned host node, and above-mentioned node leave group message is sent to above-mentioned Controlling vertex by the Resource Management process of the adjacent non-master of above-mentioned host node.
Fig. 3 is the flow chart of another embodiment of message method of the present invention, as shown in Figure 3, after step 201, can also comprise:
Step 301, if the network between the adjacent non-master of above-mentioned host node and Controlling vertex is unreachable, then above-mentioned node leave group message is sent to next adjacent non-master by the adjacent non-master of above-mentioned host node, by that analogy, until the network received between the non-master of above-mentioned node leave group message and above-mentioned Controlling vertex can reach, then the above-mentioned node leave group message received is sent to above-mentioned Controlling vertex by the non-master that the network and between above-mentioned Controlling vertex can reach.
Particularly, after the node leave group message that the monitoring process that monitoring process in the adjacent non-master of host node receives above-mentioned host node sends, node leave group message is sent to the Resource Management process in the adjacent non-master of host node, at this moment, because the network between the adjacent non-master of above-mentioned host node and Controlling vertex is unreachable, node leave group message cannot be sent to Controlling vertex by the Resource Management process in the adjacent non-master of therefore host node, node leave group message is sent it back the monitoring process in the adjacent non-master of host node by the Resource Management process in the adjacent non-master of therefore host node, by the monitoring process in the adjacent non-master of host node, node leave group message is sent to the monitoring process of next adjacent non-master.
In above-mentioned message method, after in resource-area, the adjacent non-master of host node receives the node leave group message of host node transmission, if the network between the adjacent non-master of above-mentioned host node and Controlling vertex can reach, then above-mentioned node leave group message is sent to above-mentioned Controlling vertex by the adjacent non-master of host node, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
Fig. 1 of the present invention ~ message method provided embodiment illustrated in fig. 3 is applied in the cluster disposing centralized management model, the Organization Chart of above-mentioned cluster can be as shown in Figure 4, Fig. 4 is the Organization Chart that the present invention disposes a cluster embodiment of centralized management model, see Fig. 4, cluster shown in Fig. 4 comprises resource-area and Controlling vertex, above-mentioned resource-area comprises N number of node, N>=2, the host in Fig. 4 1~ host nbe the N number of node in resource-area, host 1~ host nbe connected by network with above-mentioned Controlling vertex.Host in resource-area 1~ host nall need to dispose monitoring and resource management software, the resource management software in resource-area selects a node as the host node (master node) of resource-area, supposes host here 1as the master node of resource-area, and suppose host 1~ host i-1and the network between Controlling vertex is unreachable, host i~ host nand the network between Controlling vertex can reach, host nit is the main frame having slack resources.If a certain node leaves in master node monitors to resource-area, and network between master node and Controlling vertex is unreachable, then host 1node is to host 2node sending node leave group message.Host 2after node receives node leave group message, host 2network between node and Controlling vertex is also unreachable, then host 2node continues node leave group message to send to host 3node; See the dotted line in Fig. 4 1., the process of transmitting of node leave group message is: host 1node leave group message is sent to host by the Resource Management process of node 1the monitoring process of node, host 1node leave group message is sent to host by the monitoring process of node 2the monitoring process of node, host 2node leave group message is sent to host by the monitoring process of node 2the Resource Management process of node, due to host 2network between node and Controlling vertex is also unreachable, so host 2node leave group message is returned to host by the Resource Management process of node 2the monitoring process of node, by host 2the monitoring process of node continues node leave group message to send to host 3the monitoring process of node.
By that analogy, host is worked as inode receives node leave group message, due to host inetwork between node and Controlling vertex can reach, so host ithe message that the Resource Management process of node leaves to controller node sending node, the process of transmitting of message as dotted line in Fig. 4 1. shown in.After Controlling vertex receives node leave group message, the node finding slack resources and network to reach, sends node leave group message to host nnode, as solid line in Fig. 4 2. shown in.Host nafter node receives node leave group message, fault recovery is carried out to the resource left on node.In Fig. 4, the transmission order of node leave group message is: host 1->host 2->...host i-> Controlling vertex->host n.
In the situation that network is the worst, the network in resource-area between all nodes and Controlling vertex is all unreachable, then host node (host 1) the node leave group message that sends is returned to host node again after being sent out a circle.Now host node can arrange a timer, and after timer then, host node resends node leave group message, when guaranteeing have the network between node and Controlling vertex to reach in resource-area, in time node leave group message can be sent to Controlling vertex.Wherein, the length of the timing length of above-mentioned timer can when specific implementation sets itself, the present embodiment is not construed as limiting this, and for example, the timing length of above-mentioned timer can be 10 seconds.
Fig. 1 of the present invention ~ message method provided embodiment illustrated in fig. 3 transmits node leave group message successively according to the mode of token ring, when not increasing the load of network, most possibly node leave group message can be sent to Controlling vertex, guarantee that the resource left on node is carried out fault recovery, and then the high availability of cluster can be improved.
Fig. 5 is the structural representation of a message dispensing device of the present invention embodiment, above-mentioned message dispensing device is applied in the cluster disposing centralized management model, above-mentioned cluster comprises resource-area and Controlling vertex, above-mentioned resource-area comprises at least two nodes, and above-mentioned at least two nodes are connected by network with above-mentioned Controlling vertex.Each node in resource-area all needs to dispose monitoring and resource management software, and the resource management software in resource-area selects a node as the host node (master node) of resource-area.In the present embodiment, above-mentioned message dispensing device is arranged in the host node of above-mentioned at least two nodes.
As shown in Figure 5, above-mentioned message dispensing device can comprise: monitoring modular 51 and sending module 52;
Whether monitoring modular 51, have node to leave for monitoring in above-mentioned resource-area;
Sending module 52, when having node to leave for monitoring when monitoring modular 51 in above-mentioned resource-area, if the network between host node and Controlling vertex is unreachable, or above-mentioned host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and the number of times that above-mentioned host node sends above-mentioned node leave group message to above-mentioned Controlling vertex reaches predetermined threshold value, then to the adjacent non-master sending node leave group message of above-mentioned host node, above-mentioned node leave group message comprises the essential information and the above-mentioned resource left on node of leaving node, when can reach to make the network of the adjacent non-master of above-mentioned host node between above-mentioned Controlling vertex, above-mentioned node leave group message is sent to above-mentioned Controlling vertex.
That is, when monitoring modular 51 monitor have node to leave in above-mentioned resource-area time, if the network between host node and above-mentioned Controlling vertex is unreachable, then sending module 52 cannot to Controlling vertex sending node leave group message; or host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and the number of times that above-mentioned host node sends above-mentioned node leave group message to above-mentioned Controlling vertex reaches predetermined threshold value, under these two kinds of situations, node leave group message can be sent to the adjacent non-master of host node by sending module 52, if the network between the adjacent non-master of host node and above-mentioned Controlling vertex can reach, then above-mentioned node leave group message can be sent to Controlling vertex by the adjacent non-master of host node, if and network between the adjacent non-master of host node and above-mentioned Controlling vertex is also unreachable, then above-mentioned node leave group message can continue to send to next adjacent non-master by the adjacent non-master of host node, by that analogy, until the network received between the non-master of node leave group message and Controlling vertex can reach, the node leave group message received just can be sent to Controlling vertex by the non-master that the network then and between Controlling vertex can reach.
Wherein, when host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, illustrate that above-mentioned node leave group message sends unsuccessfully.Now host node needs again to Controlling vertex sending node leave group message, at this moment, if host node reaches predetermined threshold value to the number of times of Controlling vertex sending node leave group message, above-mentioned node leave group message can be sent to the adjacent non-master of host node by host node.
Above-mentioned predetermined threshold value can when specific implementation, and according to realizing the sets itself such as demand and/or systematic function, the size of the present embodiment to above-mentioned predetermined threshold value is not construed as limiting, and for example, above-mentioned predetermined threshold value can be 5.
Further, when sending module 52 is also all unreachable for the network between nodes all in above-mentioned resource-area and Controlling vertex, the above-mentioned node leave group message that host node sends finally is sent back to above-mentioned host node, then after scheduled duration, again to the adjacent non-master sending node leave group message of above-mentioned host node.That is, when network is the worst, if the network in above-mentioned resource-area between all nodes and Controlling vertex is all unreachable, the node leave group message that then sending module 52 sends is transferred back to host node again after being sent out a circle, at this moment, after scheduled duration, sending module 52 can again to the adjacent non-master sending node leave group message of above-mentioned host node.Particularly, can arrange a timer, after timer then, sending module 52 resends node leave group message, when guaranteeing have the network between node and Controlling vertex to reach in resource-area, in time node leave group message can be sent to Controlling vertex.Wherein, the length of above-mentioned scheduled duration can when specific implementation sets itself, the present embodiment is not construed as limiting this, and for example, above-mentioned scheduled duration can be 10 seconds.
In the present embodiment, because in resource-area, reliable communication service is supported in monitoring, therefore sending module 52, specifically for the Resource Management process by above-mentioned host node, above-mentioned node leave group message is sent to the monitoring process of above-mentioned host node, then by the monitoring process of above-mentioned host node, above-mentioned node leave group message is sent to the monitoring process of adjacent non-master of above-mentioned host node.
In above-mentioned message dispensing device, monitoring modular 51 monitors in above-mentioned resource-area to be had after node leaves, if the network between host node and Controlling vertex is unreachable, or above-mentioned host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after Controlling vertex sending node leave group message, and the number of times that above-mentioned host node sends above-mentioned node leave group message to above-mentioned Controlling vertex reaches predetermined threshold value, then sending module 52 is to the adjacent non-master sending node leave group message of above-mentioned host node, when can reach to make the network of the adjacent non-master of above-mentioned host node between Controlling vertex, node leave group message is sent to above-mentioned Controlling vertex, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
Fig. 6 is the structural representation of another embodiment of message dispensing device of the present invention, be applied in the cluster disposing centralized management model, above-mentioned cluster comprises resource-area and Controlling vertex, above-mentioned resource-area comprises at least two nodes, and above-mentioned at least two nodes are connected by network with above-mentioned Controlling vertex.Each node in resource-area all needs to dispose monitoring and resource management software, and the resource management software in resource-area selects a node as the host node (master node) of resource-area.Above-mentioned message dispensing device is arranged in non-master adjacent with host node in above-mentioned at least two nodes.
As shown in Figure 6, above-mentioned message dispensing device can comprise: receiver module 61 and sending module 62;
Wherein, receiver module 61, for receiving the node leave group message that above-mentioned host node sends, above-mentioned node leave group message comprises the essential information and the above-mentioned resource left on node of leaving node, above-mentioned node leave group message is that host node monitors in above-mentioned resource-area and has node to leave, network between above-mentioned host node and above-mentioned Controlling vertex is unreachable, or above-mentioned host node does not receive the acknowledge message of above-mentioned Controlling vertex for above-mentioned node leave group message after above-mentioned Controlling vertex sending node leave group message, and above-mentioned host node is to send after the number of times that above-mentioned Controlling vertex sends above-mentioned node leave group message reaches predetermined threshold value, due to the reliable communication service of monitoring process support in resource-area, therefore in the present embodiment, receiver module 61, the node leave group message that the monitoring process specifically for being received above-mentioned host node by the monitoring process in the adjacent non-master of above-mentioned host node is sent.
Sending module 62, when can reach for the network between the adjacent non-master and above-mentioned Controlling vertex of above-mentioned host node, sends to above-mentioned Controlling vertex by above-mentioned node leave group message.In the present embodiment, sending module 62, specifically for the monitoring process of the adjacent non-master by above-mentioned host node, above-mentioned node leave group message is sent to the Resource Management process of the adjacent non-master of above-mentioned host node, then by the Resource Management process of the adjacent non-master of above-mentioned host node, above-mentioned node leave group message is sent to above-mentioned Controlling vertex.
Further, sending module 62, time also unreachable for the network between the adjacent non-master and above-mentioned Controlling vertex of above-mentioned host node, above-mentioned node leave group message is sent to next adjacent non-master, by that analogy, until the network received between the non-master of above-mentioned node leave group message and above-mentioned Controlling vertex can reach, then the node leave group message received is sent to above-mentioned Controlling vertex by the non-master that the network and between above-mentioned Controlling vertex can reach.
Particularly, after the node leave group message that the monitoring process that receiver module 61 receives above-mentioned host node by the monitoring process in the adjacent non-master of host node sends, node leave group message to be sent to the Resource Management process in the adjacent non-master of host node by sending module 62 by monitoring process, at this moment, because the network between the adjacent non-master of above-mentioned host node and Controlling vertex is unreachable, therefore node leave group message cannot be sent to Controlling vertex by the Resource Management process in the adjacent non-master of host node by sending module 62, therefore node leave group message to be sent it back the monitoring process in the adjacent non-master of host node by sending module 62 by the Resource Management process in the adjacent non-master of host node, by the monitoring process in the adjacent non-master of host node, node leave group message is sent to the monitoring process of next adjacent non-master.
In above-mentioned message dispensing device, after receiver module 61 receives the node leave group message of host node transmission, if the network between the adjacent non-master of above-mentioned host node and Controlling vertex can reach, then above-mentioned node leave group message is sent to above-mentioned Controlling vertex by sending module 62, thus can host node in resource-area and the network between Controlling vertex unreachable time, most possibly node leave group message is sent to Controlling vertex, so that Controlling vertex notifies that other have the node of slack resources to carry out fault recovery to the resource left on node, and then the high availability of cluster can be improved.
It should be noted that, in describing the invention, term " first ", " second " etc. only for describing object, and can not be interpreted as instruction or hint relative importance.In addition, in describing the invention, except as otherwise noted, the implication of " multiple " is two or more.
Describe and can be understood in flow chart or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by embodiments of the invention person of ordinary skill in the field.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple step or method can with to store in memory and the software performed by suitable instruction execution system or firmware realize.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: the discrete logic with the logic gates for realizing logic function to data-signal, there is the application-specific integrated circuit (ASIC) of suitable combinational logic gate circuit, programmable gate array (ProgrammableGateArray; Hereinafter referred to as: PGA), field programmable gate array (FieldProgrammableGateArray; Hereinafter referred to as: FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional module in each embodiment of the present invention can be integrated in a processing module, also can be that the independent physics of modules exists, also can two or more module integrations in a module.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
The above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.
In the description of this specification, specific features, structure, material or feature that the description of reference term " embodiment ", " some embodiments ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with this embodiment or example are contained at least one embodiment of the present invention or example.In this manual, identical embodiment or example are not necessarily referred to the schematic representation of above-mentioned term.And the specific features of description, structure, material or feature can combine in an appropriate manner in any one or more embodiment or example.
Although illustrate and describe embodiments of the invention above, be understandable that, above-described embodiment is exemplary, can not be interpreted as limitation of the present invention, and those of ordinary skill in the art can change above-described embodiment within the scope of the invention, revises, replace and modification.

Claims (10)

1. a message method, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, it is characterized in that, described method comprises:
Host node in described resource-area monitors in described resource-area has node to leave;
If the network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and the number of times that described host node sends described node leave group message to described Controlling vertex reaches predetermined threshold value, then described host node is to the adjacent non-master sending node leave group message of described host node, described node leave group message comprises the essential information and the described resource left on node of leaving node, when can reach to make the network of the adjacent non-master of described host node between described Controlling vertex, described node leave group message is sent to described Controlling vertex.
2. method according to claim 1, is characterized in that, also comprises:
If the network in described resource-area between all nodes and described Controlling vertex is all unreachable, the described node leave group message that described host node sends finally is sent back to described host node, then after scheduled duration, described host node is again to the adjacent non-master sending node leave group message of described host node.
3. method according to claim 1 and 2, is characterized in that, described host node comprises to the adjacent non-master sending node leave group message of described host node:
Described node leave group message sends to the monitoring process of described host node, the monitoring process of described host node described node leave group message to be sent to the monitoring process of the adjacent non-master of described host node by the Resource Management process of described host node.
4. a message method, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, it is characterized in that, described method comprises:
In described resource-area, the adjacent non-master of host node receives the node leave group message that described host node sends, described node leave group message comprises the essential information and the described resource left on node of leaving node, described node leave group message is that described host node monitors in described resource-area and has node to leave, network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and described host node is to send after the number of times that described Controlling vertex sends described node leave group message reaches predetermined threshold value,
If the network between the adjacent non-master of described host node and described Controlling vertex can reach, then described node leave group message is sent to described Controlling vertex by the adjacent non-master of described host node.
5. method according to claim 4, is characterized in that, after in described resource-area, the adjacent non-master of host node receives the node leave group message of described host node transmission, also comprises:
If the network between the adjacent non-master of described host node and described Controlling vertex is unreachable, then described node leave group message is sent to next adjacent non-master by the adjacent non-master of described host node, by that analogy, until the network received between the non-master of described node leave group message and described Controlling vertex can reach, then the described node leave group message received is sent to described Controlling vertex by the non-master that the network and between described Controlling vertex can reach.
6. the method according to claim 4 or 5, is characterized in that, in described resource-area the adjacent non-master of host node receive described host node send node leave group message comprise:
The node leave group message that the monitoring process that monitoring process in the adjacent non-master of described host node receives described host node sends;
Described node leave group message sends to described Controlling vertex to comprise by the adjacent non-master of described host node:
Described node leave group message is sent to the Resource Management process of the adjacent non-master of described host node by the monitoring process of the adjacent non-master of described host node, and described node leave group message is sent to described Controlling vertex by the Resource Management process of the adjacent non-master of described host node.
7. a message dispensing device, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, in the host node of at least two nodes described in described message dispensing device is arranged at, it is characterized in that, described message dispensing device comprises:
Whether monitoring modular, have node to leave for monitoring in described resource-area;
Sending module, for when having node to leave in described monitoring module monitors to described resource-area, if the network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and the number of times that described host node sends described node leave group message to described Controlling vertex reaches predetermined threshold value, then to the adjacent non-master sending node leave group message of described host node, described node leave group message comprises the essential information and the described resource left on node of leaving node, when can reach to make the network of the adjacent non-master of described host node between described Controlling vertex, described node leave group message is sent to described Controlling vertex.
8. device according to claim 7, is characterized in that,
Described sending module, time also all unreachable for the network between nodes all in described resource-area and described Controlling vertex, the described node leave group message that described host node sends finally is sent back to described host node, then after scheduled duration, again to the adjacent non-master sending node leave group message of described host node;
Described sending module, specifically for the Resource Management process by described host node, described node leave group message is sent to the monitoring process of described host node, then by the monitoring process of described host node, described node leave group message is sent to the monitoring process of adjacent non-master of described host node.
9. a message dispensing device, be applied in the cluster disposing centralized management model, described cluster comprises resource-area and Controlling vertex, described resource-area comprises at least two nodes, described at least two nodes are connected by network with described Controlling vertex, in non-master adjacent with host node at least two nodes described in described message dispensing device is arranged at, it is characterized in that, described message dispensing device comprises:
Receiver module, for receiving the node leave group message that described host node sends, described node leave group message comprises the essential information and the described resource left on node of leaving node, described node leave group message is that described host node monitors in described resource-area and has node to leave, network between described host node and described Controlling vertex is unreachable, or described host node does not receive the acknowledge message of described Controlling vertex for described node leave group message after described Controlling vertex sending node leave group message, and described host node is to send after the number of times that described Controlling vertex sends described node leave group message reaches predetermined threshold value,
Sending module, when can reach for the network between the adjacent non-master and described Controlling vertex of described host node, sends to described Controlling vertex by described node leave group message.
10. device according to claim 9, is characterized in that,
Described sending module, time also unreachable for the network between the adjacent non-master and described Controlling vertex of described host node, described node leave group message is sent to next adjacent non-master, by that analogy, until the network received between the non-master of described node leave group message and described Controlling vertex can reach, then the described node leave group message received is sent to described Controlling vertex by the non-master that the network and between described Controlling vertex can reach;
Described receiver module, the node leave group message that the monitoring process specifically for being received described host node by the monitoring process in the adjacent non-master of described host node is sent;
Described sending module, specifically for the monitoring process of the adjacent non-master by described host node, described node leave group message is sent to the Resource Management process of the adjacent non-master of described host node, then by the Resource Management process of the adjacent non-master of described host node, described node leave group message is sent to described Controlling vertex.
CN201510714154.1A 2015-10-28 2015-10-28 Message method and device Active CN105407087B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811331220.7A CN109639640B (en) 2015-10-28 2015-10-28 Message sending method and device
CN201510714154.1A CN105407087B (en) 2015-10-28 2015-10-28 Message method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510714154.1A CN105407087B (en) 2015-10-28 2015-10-28 Message method and device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201811331220.7A Division CN109639640B (en) 2015-10-28 2015-10-28 Message sending method and device

Publications (2)

Publication Number Publication Date
CN105407087A true CN105407087A (en) 2016-03-16
CN105407087B CN105407087B (en) 2019-01-01

Family

ID=55472342

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201811331220.7A Active CN109639640B (en) 2015-10-28 2015-10-28 Message sending method and device
CN201510714154.1A Active CN105407087B (en) 2015-10-28 2015-10-28 Message method and device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201811331220.7A Active CN109639640B (en) 2015-10-28 2015-10-28 Message sending method and device

Country Status (1)

Country Link
CN (2) CN109639640B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391236A (en) * 2017-09-15 2017-11-24 郑州云海信息技术有限公司 A kind of cluster block Realization of Storing and device
CN107656847A (en) * 2017-09-19 2018-02-02 郑州云海信息技术有限公司 Node administration method, system, device and storage medium based on distributed type assemblies

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112954133B (en) * 2021-01-20 2023-03-14 浙江大华技术股份有限公司 Method, device, electronic device and storage medium for synchronizing node time

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291337A (en) * 2008-05-30 2008-10-22 同济大学 Grid resource management system and method
CN101505272A (en) * 2009-03-02 2009-08-12 浙江理工大学 Method for searching related node subset on the basis of P2P
CN101534205A (en) * 2008-03-11 2009-09-16 中国网通集团宽带业务应用国家工程实验室有限公司 Application layer multicast service realizing method, terminal and system thereof

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1198407C (en) * 2003-07-08 2005-04-20 大唐移动通信设备有限公司 Device and method for realizing high availability in communication system
CN101640688B (en) * 2009-08-20 2014-03-12 中兴通讯股份有限公司 Content delivery network (CDN)-based switching method for main node controller and spare controller and CDN
CN101859480A (en) * 2010-04-29 2010-10-13 顾翠红 Electric appliance wireless control network
CN102769673B (en) * 2012-07-25 2015-03-25 深圳市中博科创信息技术有限公司 Failure detection method suitable to large-scale storage cluster
CN103118084B (en) * 2013-01-21 2016-08-17 浪潮(北京)电子信息产业有限公司 The electoral machinery of a kind of host node and node
CN104581954B (en) * 2013-10-28 2017-12-19 株式会社理光 Channel scheduling method and Wireless Telecom Equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101534205A (en) * 2008-03-11 2009-09-16 中国网通集团宽带业务应用国家工程实验室有限公司 Application layer multicast service realizing method, terminal and system thereof
CN101291337A (en) * 2008-05-30 2008-10-22 同济大学 Grid resource management system and method
CN101505272A (en) * 2009-03-02 2009-08-12 浙江理工大学 Method for searching related node subset on the basis of P2P

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391236A (en) * 2017-09-15 2017-11-24 郑州云海信息技术有限公司 A kind of cluster block Realization of Storing and device
CN107391236B (en) * 2017-09-15 2020-03-06 郑州云海信息技术有限公司 Cluster block storage implementation method and device
CN107656847A (en) * 2017-09-19 2018-02-02 郑州云海信息技术有限公司 Node administration method, system, device and storage medium based on distributed type assemblies

Also Published As

Publication number Publication date
CN109639640B (en) 2020-07-14
CN105407087B (en) 2019-01-01
CN109639640A (en) 2019-04-16

Similar Documents

Publication Publication Date Title
US10560315B2 (en) Method and device for processing failure in at least one distributed cluster, and system
CN110275680B (en) Double-control double-active storage system
CN103297456A (en) Method for accessing sharing resources in distributed system and distributed system
CN102739453B (en) Main/standby switching method, equipment and system
US20120215876A1 (en) Information processing system
CN102752093B (en) Based on the data processing method of distributed file system, equipment and system
CN101776983A (en) Synchronization method of information of double controllers in disk array and disk array system
WO2020177633A1 (en) Cell handover processing method, apparatus, and device
CN105407087A (en) Message sending method and device
CN106230622B (en) Cluster implementation method and device
CN103944974A (en) Method for processing protocol messages, method for processing faults of controllers and related device
CN104618466A (en) System for balancing load and controlling overload based on message transfer and control method of system
EP3761568A1 (en) Method of controlling communication over a local interconnect network bus
CN104378427A (en) Method for maintaining consistency of key data of clusters
CN105681207A (en) Router and home appliance control system
US20150372895A1 (en) Proactive Change of Communication Models
US9781605B2 (en) Cell activation method and apparatus
US20140143589A1 (en) Method for managing path of osek networks
CN102291303B (en) Single board and method for determining primary and standby states for the same
CN102820992A (en) Processing method and device of data packets
CN110750327A (en) Virtual network function management method and system, agent device, and storage medium
CN101778477A (en) Scheduling resource distributing method and base station
CN110119111B (en) Communication method and device, storage medium, and electronic device
CN103747034A (en) Terminal state-machine state conversion method and device
WO2017129238A1 (en) Consumption reporting for energy-saving mode of access node

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant