CN105187548A - Cluster monitoring information collection method and system - Google Patents
Cluster monitoring information collection method and system Download PDFInfo
- Publication number
- CN105187548A CN105187548A CN201510624368.XA CN201510624368A CN105187548A CN 105187548 A CN105187548 A CN 105187548A CN 201510624368 A CN201510624368 A CN 201510624368A CN 105187548 A CN105187548 A CN 105187548A
- Authority
- CN
- China
- Prior art keywords
- node
- nodes
- host node
- monitor message
- section point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
The invention discloses a cluster monitoring information collection method and system. The cluster monitoring information collection method comprises: selecting a first node and a second node from all nodes of a cluster, setting the first node as a master node, setting the second node as a slave node, setting a broadcast path for other cluster nodes expect the first node and the second node in all nodes, setting a broadcast object of the broadcast path as the master node, commanding the other cluster nodes to collect corresponding monitoring information of the nodes and respectively send the monitoring information to the master node according to the broadcast path, and commanding the master node to synchronize all the monitoring information to the slave node. A manner of division of labor of the master node, the slave node and other nodes is adopted to improve the monitoring information collection efficiency and reduce the disaster consumption of the monitoring information on the premise of guaranteeing complete collection of the monitoring information.
Description
Technical field
The present invention relates to information disaster tolerance field, particularly relate to a kind of cluster monitoring formation gathering method and system.
Background technology
General cluster monitoring information scheme all adopts the monitor message of independent data collection server to each clustered node to collect, and then additionally increases alternate device.Or adopt broadcast mode on each clustered node, collect all monitoring nodes information, then by independent data collection server, monitor message reading is carried out to single node.
The shortage monitor message disaster tolerance that said method has, some methods take larger to system bandwidth consumption.Lack a kind of ensure the prerequisite of monitor message reliability of disaster tolerance under, reduce system bandwidth consume monitor message collection method.
Summary of the invention
In view of this, main purpose of the present invention is to provide a kind of cluster monitoring formation gathering method and system, can ensure that monitor message disaster tolerance is reliable and system bandwidth consumes little.
For achieving the above object, the invention provides a kind of cluster monitoring formation gathering method, comprising:
From all nodes of cluster, select first node and Section Point, described first node is set to host node, described Section Point is set to from node;
For other clustered nodes in described all nodes except described first node and described Section Point arrange broadcast route, the broadcast object of described broadcast route is set to described host node;
Order other clustered nodes described carry out monitor message corresponding to each node and collect, and are sent in described host node by described monitor message respectively according to described broadcast route;
Host node is made all monitor messages to be synchronized to described from node.
Preferably, make host node all monitor messages are synchronized to described from node after also comprise:
When described host node lost efficacy, selecting the 3rd node, described Section Point is set to new host node from other clustered nodes described, is new for node by described 3rd Node configuration.
Preferably, described Section Point being set to new host node, is new also comprising after node by described 3rd Node configuration:
Make described new host node all monitor messages are synchronized to described newly from node.
Preferably, order other clustered nodes described carry out also comprising after monitor message corresponding to each node is collected:
The corresponding monitor message collected is saved to corresponding the machine monitor message database by each node in order other clustered nodes described respectively.
Present invention also offers a kind of cluster monitoring Information Collection System, comprising:
Cluster health monitoring module, for selecting first node and Section Point from all nodes of cluster, being set to host node by described first node, being set to from node by described Section Point;
Monitoring broadcast configuration module, for arranging broadcast route for other clustered nodes in described all nodes except described first node and described Section Point, is set to described host node by the broadcast object of described broadcast route;
Monitor message acquisition module, carries out monitor message corresponding to each node for making other clustered nodes described and collects, and be sent in described host node by described monitor message respectively according to described broadcast route;
First monitoring synchronization module, described from node for making host node all monitor messages be synchronized to.
Preferably, described system also comprises:
Disaster tolerance module, for when described host node lost efficacy, selected the 3rd node, described Section Point was set to new host node from other clustered nodes described, was new for node by described 3rd Node configuration.
Preferably, described system also comprises:
Second monitoring synchronization module, for make described new host node all monitor messages are synchronized to described newly from node.
Preferably, described system also comprises:
Database storage module, is saved to corresponding the machine monitor message database respectively for making each node in other clustered nodes described by the corresponding monitor message collected.
Apply a kind of cluster monitoring formation gathering method provided by the invention and system, first node and Section Point is selected from all nodes of cluster, described first node is set to host node, described Section Point is set to from node, for other clustered nodes in described all nodes except described first node and described Section Point arrange broadcast route, the broadcast object of described broadcast route is set to described host node, order other clustered nodes described carry out monitor message corresponding to each node and collect, and respectively described monitor message is sent in described host node according to described broadcast route, host node is made all monitor messages to be synchronized to described from node, use host node, from the mode that node and other nodes are divided the work, reach under the prerequisite ensureing the complete collection of monitor message, improve monitor message collection efficiency, reduce the object that monitor message disaster tolerance consumes.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only embodiments of the invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to the accompanying drawing provided.
Fig. 1 is the flow chart of a kind of cluster monitoring formation gathering method one of the present invention embodiment;
Fig. 2 is the flow chart of the another embodiment of a kind of cluster monitoring of the present invention formation gathering method;
Fig. 3 is the structural representation of a kind of cluster monitoring Information Collection System one of the present invention embodiment;
Fig. 4 is the structural representation of the another embodiment of a kind of cluster monitoring of the present invention Information Collection System;
Fig. 5 is the principle schematic of a kind of cluster monitoring Information Collection System of the present invention;
Fig. 6 is the another principle schematic of a kind of cluster monitoring of the present invention Information Collection System;
Fig. 7 is the another principle schematic of a kind of cluster monitoring of the present invention Information Collection System;
Fig. 8 is the another principle schematic of a kind of cluster monitoring of the present invention Information Collection System.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
The invention provides a kind of cluster monitoring formation gathering method, Fig. 1 shows the flow chart of a cluster monitoring formation gathering method of the present invention embodiment, comprising:
Step S101: select first node and Section Point from all nodes of cluster, described first node is set to host node, described Section Point is set to from node;
From all nodes of cluster, choose two nodes, be set to respectively host node with from node.
Step S102: for other clustered nodes in described all nodes except described first node and described Section Point arrange broadcast route, the broadcast object of described broadcast route is set to described host node;
Configure the broadcast route of other nodes, broadcast object is set to host node.
Step S103: order other clustered nodes described carry out monitor message corresponding to each node and collect, and are sent in described host node by described monitor message respectively according to described broadcast route;
Other clustered nodes are collected the machine monitor message respectively, then by broadcast mode, monitor message is sent on host node, other clustered nodes carry out also comprising after monitor message corresponding to each node is collected, and the corresponding monitor message collected is saved to corresponding the machine monitor message database by each node in order other clustered nodes described respectively.
Step S104: make host node all monitor messages be synchronized to described from node.
All monitor messages carry out arranging and preserving by host node, then by monitor message database synchronization to from node.
A kind of cluster monitoring formation gathering method that application the present embodiment provides, first node and Section Point is selected from all nodes of cluster, described first node is set to host node, described Section Point is set to from node, for other clustered nodes in described all nodes except described first node and described Section Point arrange broadcast route, the broadcast object of described broadcast route is set to described host node, order other clustered nodes described carry out monitor message corresponding to each node and collect, and respectively described monitor message is sent in described host node according to described broadcast route, host node is made all monitor messages to be synchronized to described from node, use host node, from the mode that node and other nodes are divided the work, reach under the prerequisite ensureing the complete collection of monitor message, improve monitor message collection efficiency, reduce the object that monitor message disaster tolerance consumes.
Fig. 2 shows the structural representation of the another embodiment of cluster monitoring formation gathering method of the present invention, corresponding to Fig. 1, also comprises:
Described 3rd Node configuration is new for node by step S105: when described host node lost efficacy, select the 3rd node, described Section Point is set to new host node from other clustered nodes described;
As when host node delays machine, reselect other nodes and be promoted to new for node, being formerly promoted to new host node from node.
Step S106: make described new host node all monitor messages are synchronized to described newly from node.
Carry out simultaneous operation, new host node, namely former from node all monitor messages are synchronized to new for node.
The collection of monitor message, Disaster Tolerant Scheme are become the pattern of 1+1+N by the present embodiment, while guarantee monitor message safety, can save the consumption of monitor message acquisition time and bandwidth resources.
Present invention also offers a kind of cluster monitoring Information Collection System, Fig. 3 shows an example structure schematic diagram of cluster monitoring Information Collection System of the present invention, comprising:
Cluster health monitoring module 101, for selecting first node and Section Point from all nodes of cluster, being set to host node by described first node, being set to from node by described Section Point;
Monitoring broadcast configuration module 102, for arranging broadcast route for other clustered nodes in described all nodes except described first node and described Section Point, is set to described host node by the broadcast object of described broadcast route;
Monitor message acquisition module 103, carries out monitor message corresponding to each node for making other clustered nodes described and collects, and be sent in described host node by described monitor message respectively according to described broadcast route;
First monitoring synchronization module 104, described from node for making host node all monitor messages be synchronized to.
A kind of cluster monitoring Information Collection System that application the present embodiment provides, first node and Section Point is selected from all nodes of cluster, described first node is set to host node, described Section Point is set to from node, for other clustered nodes in described all nodes except described first node and described Section Point arrange broadcast route, the broadcast object of described broadcast route is set to described host node, order other clustered nodes described carry out monitor message corresponding to each node and collect, and respectively described monitor message is sent in described host node according to described broadcast route, host node is made all monitor messages to be synchronized to described from node, use host node, from the mode that node and other nodes are divided the work, reach under the prerequisite ensureing the complete collection of monitor message, improve monitor message collection efficiency, reduce the object that monitor message disaster tolerance consumes.
Fig. 4 shows the structural representation of the another embodiment of cluster monitoring Information Collection System of the present invention, corresponding to Fig. 3, also comprises:
Disaster tolerance module 105, for when described host node lost efficacy, selected the 3rd node, described Section Point was set to new host node from other clustered nodes described, was new for node by described 3rd Node configuration;
Second monitoring synchronization module 106, for make described new host node all monitor messages are synchronized to described newly from node.
As shown in Fig. 5 ~ Fig. 8, for the principle schematic of the present embodiment, in Fig. 5, clustered node 1 and 2 is set to host node and from node by cluster health detection module respectively, other nodes each collect the monitor message of corresponding the machine respectively, the broadcast route of other nodes of broadcast configuration block configuration is monitored in Fig. 6, broadcast object is set to host node, except host node, other node broadcasts send monitor message to host node, in Fig. 7, monitoring synchronization module by host node monitor message database synchronization to from node, in Fig. 8 after host node delays machine, cluster health detection module reselects other nodes and is promoted to from node, formerly be promoted to host node from node, after prompting user, monitoring synchronization module carries out monitor message database synchronization immediately.
The collection of monitor message, Disaster Tolerant Scheme are become the pattern of 1+1+N by the present embodiment, while guarantee monitor message safety, can save the consumption of monitor message acquisition time and bandwidth resources.
It should be noted that, each embodiment in this specification all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, between each embodiment identical similar part mutually see.For system class embodiment, due to itself and embodiment of the method basic simlarity, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
Finally, also it should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
Be described in detail method and system provided by the present invention above, apply specific case herein and set forth principle of the present invention and execution mode, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (8)
1. a cluster monitoring formation gathering method, is characterized in that, comprising:
From all nodes of cluster, select first node and Section Point, described first node is set to host node, described Section Point is set to from node;
For other clustered nodes in described all nodes except described first node and described Section Point arrange broadcast route, the broadcast object of described broadcast route is set to described host node;
Order other clustered nodes described carry out monitor message corresponding to each node and collect, and are sent in described host node by described monitor message respectively according to described broadcast route;
Host node is made all monitor messages to be synchronized to described from node.
2. method according to claim 1, is characterized in that, make host node all monitor messages are synchronized to described from node after also comprise:
When described host node lost efficacy, selecting the 3rd node, described Section Point is set to new host node from other clustered nodes described, is new for node by described 3rd Node configuration.
3. method according to claim 3, is characterized in that, described Section Point is set to new host node, is new also comprising after node by described 3rd Node configuration:
Make described new host node all monitor messages are synchronized to described newly from node.
4. method according to claim 1, is characterized in that, order other clustered nodes described carry out also comprising after monitor message corresponding to each node is collected:
The corresponding monitor message collected is saved to corresponding the machine monitor message database by each node in order other clustered nodes described respectively.
5. a cluster monitoring Information Collection System, is characterized in that, comprising:
Cluster health monitoring module, for selecting first node and Section Point from all nodes of cluster, being set to host node by described first node, being set to from node by described Section Point;
Monitoring broadcast configuration module, for arranging broadcast route for other clustered nodes in described all nodes except described first node and described Section Point, is set to described host node by the broadcast object of described broadcast route;
Monitor message acquisition module, carries out monitor message corresponding to each node for making other clustered nodes described and collects, and be sent in described host node by described monitor message respectively according to described broadcast route;
First monitoring synchronization module, described from node for making host node all monitor messages be synchronized to.
6. system according to claim 5, is characterized in that, also comprises:
Disaster tolerance module, for when described host node lost efficacy, selected the 3rd node, described Section Point was set to new host node from other clustered nodes described, was new for node by described 3rd Node configuration.
7. system according to claim 6, is characterized in that, also comprises:
Second monitoring synchronization module, for make described new host node all monitor messages are synchronized to described newly from node.
8. system according to claim 5, is characterized in that, also comprises:
Database storage module, is saved to corresponding the machine monitor message database respectively for making each node in other clustered nodes described by the corresponding monitor message collected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510624368.XA CN105187548A (en) | 2015-09-25 | 2015-09-25 | Cluster monitoring information collection method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510624368.XA CN105187548A (en) | 2015-09-25 | 2015-09-25 | Cluster monitoring information collection method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105187548A true CN105187548A (en) | 2015-12-23 |
Family
ID=54909387
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510624368.XA Pending CN105187548A (en) | 2015-09-25 | 2015-09-25 | Cluster monitoring information collection method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105187548A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106383776A (en) * | 2016-08-30 | 2017-02-08 | 北京北信源软件股份有限公司 | Monitoring and self-healing method and apparatus for distributed search cluster system |
| CN106407264A (en) * | 2016-08-25 | 2017-02-15 | 成都索贝数码科技股份有限公司 | High-availability and high-consistency database cluster system and command processing method thereof |
| CN107707413A (en) * | 2017-11-10 | 2018-02-16 | 郑州云海信息技术有限公司 | A kind of cluster disaster recovery method and device |
| CN108093033A (en) * | 2017-12-06 | 2018-05-29 | 北京像素软件科技股份有限公司 | Method of data synchronization and data synchronous system |
| CN109788012A (en) * | 2017-11-14 | 2019-05-21 | 阿里巴巴集团控股有限公司 | A kind of health examination method and device, health examination control method and controller |
| CN109818785A (en) * | 2019-01-15 | 2019-05-28 | 无锡华云数据技术服务有限公司 | A kind of data processing method, server cluster and storage medium |
| CN112398905A (en) * | 2020-09-28 | 2021-02-23 | 联想(北京)有限公司 | Node and information synchronization method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1512376A (en) * | 2002-12-31 | 2004-07-14 | 联想(北京)有限公司 | Central control method for large machine group system |
| US20050138462A1 (en) * | 2003-12-23 | 2005-06-23 | Nokia, Inc. | System and method for managing protocol network failures in a cluster system |
| CN101667034A (en) * | 2009-09-21 | 2010-03-10 | 北京航空航天大学 | Scalable monitoring system supporting hybrid clusters |
| CN103152419A (en) * | 2013-03-08 | 2013-06-12 | 中标软件有限公司 | High availability cluster management method for cloud computing platform |
-
2015
- 2015-09-25 CN CN201510624368.XA patent/CN105187548A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1512376A (en) * | 2002-12-31 | 2004-07-14 | 联想(北京)有限公司 | Central control method for large machine group system |
| US20050138462A1 (en) * | 2003-12-23 | 2005-06-23 | Nokia, Inc. | System and method for managing protocol network failures in a cluster system |
| CN101667034A (en) * | 2009-09-21 | 2010-03-10 | 北京航空航天大学 | Scalable monitoring system supporting hybrid clusters |
| CN103152419A (en) * | 2013-03-08 | 2013-06-12 | 中标软件有限公司 | High availability cluster management method for cloud computing platform |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407264A (en) * | 2016-08-25 | 2017-02-15 | 成都索贝数码科技股份有限公司 | High-availability and high-consistency database cluster system and command processing method thereof |
| CN106383776A (en) * | 2016-08-30 | 2017-02-08 | 北京北信源软件股份有限公司 | Monitoring and self-healing method and apparatus for distributed search cluster system |
| CN107707413A (en) * | 2017-11-10 | 2018-02-16 | 郑州云海信息技术有限公司 | A kind of cluster disaster recovery method and device |
| CN109788012A (en) * | 2017-11-14 | 2019-05-21 | 阿里巴巴集团控股有限公司 | A kind of health examination method and device, health examination control method and controller |
| CN109788012B (en) * | 2017-11-14 | 2022-04-01 | 阿里巴巴集团控股有限公司 | Health examination method and device, health examination control method and controller |
| CN108093033A (en) * | 2017-12-06 | 2018-05-29 | 北京像素软件科技股份有限公司 | Method of data synchronization and data synchronous system |
| CN109818785A (en) * | 2019-01-15 | 2019-05-28 | 无锡华云数据技术服务有限公司 | A kind of data processing method, server cluster and storage medium |
| CN112398905A (en) * | 2020-09-28 | 2021-02-23 | 联想(北京)有限公司 | Node and information synchronization method |
| CN112398905B (en) * | 2020-09-28 | 2022-05-31 | 联想(北京)有限公司 | Node and information synchronization method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105187548A (en) | Cluster monitoring information collection method and system | |
| CN103744809A (en) | Method for dual-computer hot-standby of vehicle information management system on basis of VRRP | |
| CN102752093B (en) | Based on the data processing method of distributed file system, equipment and system | |
| CN103902617A (en) | Distributed database synchronization method and system | |
| CN103699063B (en) | The harvester of off-line data and method in a kind of Manufacturing Executive System MES | |
| GB201306798D0 (en) | Storage management in clustered data processing systems | |
| CN103036719A (en) | Cross-regional service disaster method and device based on main cluster servers | |
| CN109474023B (en) | Intelligent power distribution network section real-time updating method and system, storage medium and terminal | |
| CN105721582A (en) | Multi-node file backup system | |
| Khedr et al. | Mobility-assisted minimum connected cover in a wireless sensor network | |
| CN103856354A (en) | Method for achieving unified management of logs of cluster storage system | |
| CN112631764A (en) | Task scheduling method and device, computer equipment and computer readable medium | |
| CN105527948A (en) | Large scale distributed data acquisition system and method based on industrial process | |
| CN104184687A (en) | Flow control method and hardware accelerator circuit of communication base-band processing | |
| CN105827678A (en) | High-availability framework based communication method and node | |
| Yin et al. | Fault management using cluster-based protocol in wireless sensor networks | |
| CN104753712A (en) | Alarming report method, alarming report node and alarming report system | |
| KR101669726B1 (en) | Data Gathering System | |
| CN111552701B (en) | Method for determining data consistency in distributed cluster and distributed data system | |
| CN109672731A (en) | A kind of distributed node information monitoring method, system and application | |
| CN105630629B (en) | Data backup method and system | |
| CN102387210A (en) | Distribution type file system monitoring method based on rapid synchronization network | |
| CN105282840A (en) | Method for time synchronization between nodes in wireless Ad Hoc network | |
| CN102647297B (en) | Single-board performance warning management method and device | |
| CN103973811A (en) | High-availability cluster management method capable of conducting dynamic migration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20151223 |