CN105007193A - Multi-layer information processing method, system thereof and cluster management node - Google Patents
Multi-layer information processing method, system thereof and cluster management node Download PDFInfo
- Publication number
- CN105007193A CN105007193A CN201510512640.5A CN201510512640A CN105007193A CN 105007193 A CN105007193 A CN 105007193A CN 201510512640 A CN201510512640 A CN 201510512640A CN 105007193 A CN105007193 A CN 105007193A
- Authority
- CN
- China
- Prior art keywords
- node
- clustered node
- cluster management
- clustered
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention provides a multi-layer information processing method, a system thereof and a cluster management node. The method comprises the following steps that each of cluster nodes sends obtained cluster node monitoring information to a main cluster management node for storage, and each cluster node monitoring information is obtained through visiting the main cluster management node. The obtainment of each cluster node monitoring information by a client through the main cluster management node is realized, the data processing speed is raised, the response time is reduced, and the user experience is improved.
Description
Technical field
The invention belongs to field of information processing, particularly relate to a kind of multi-layer information processing method, system and cluster management node.
Background technology
In prior art, cluster system management software often only can obtain cluster self-information, such as clustered node state information, clustered node storage capacity information; The CPU information of other such as clustered node, the memory information of clustered node, other third party's management software is then needed to get on acquisition at extra Server server, wherein, obtaining information order is issued to each clustered node from Server server, then information turns back on Server server by each clustered node again, can cause a large amount of stand-by period like this.
Figure 1 shows that the multi-layer information process flow figure of prior art, comprise client, Server server, the communication server, multiple clustered node (comprise clustered node 1, clustered node 2 ... clustered node n); Wherein, described client is connected with the described communication server by described Server server; Described Server server is connected with described multiple clustered node by the described communication server.
Such scheme Principle of Communication is as follows:
Client sends information acquisition request to described Server server, wherein, carries clustered node name information, clustered node address information in described information acquisition request;
After described Server server receives described information acquisition request, send obtaining information order by the communication server to object set group node;
After described object set group node receives described obtaining information order, to described Server server feedback response message, wherein, in described response message, carry clustered node monitor message.
Described Server server notifies that described client obtains after obtaining clustered node monitor message;
After described client receives described notice, from described Server server, obtain described clustered node monitor message.
In such scheme, obtaining information order is issued to each clustered node from Server server, and then clustered node monitor message turns back on Server server by each clustered node again, can cause a large amount of stand-by period like this, has had a strong impact on Consumer's Experience.
Summary of the invention
The invention provides a kind of multi-layer information processing method, system and cluster management node, to solve the problem.
The invention provides a kind of multi-layer information processing method.Said method comprises the following steps:
The clustered node monitor message of acquisition is sent to main cluster management node and is stored by described main cluster management node by each clustered node respectively;
By accessing main cluster management node, obtain each clustered node monitor message.
Present invention also offers a kind of multi-layer information treatment system, comprise client, the communication server, multiple clustered node, wherein, described client is connected with described multiple clustered node by the described communication server;
Each clustered node, for being sent to main cluster management node by the clustered node monitor message of acquisition respectively and being stored by described main cluster management node; Wherein, described main cluster management node is selected from described multiple clustered node;
Described client accesses described main cluster management node by the communication server, obtains each clustered node monitor message.
Present invention also offers a kind of cluster management node, comprise and act on behalf of collection module, service module, database module; Wherein, described collection module of acting on behalf of is connected with described database module by described service module;
Describedly act on behalf of collection module, for the clustered node monitor message of collection is sent to described service module;
Described service module, for writing described database module by the monitor message of each clustered node obtained;
Described database module, for storing the monitor message of each clustered node.
By following scheme: the clustered node monitor message of acquisition is sent to main cluster management node and is stored by described main cluster management node by each clustered node respectively; By accessing main cluster management node, obtain each clustered node monitor message; Achieve client and obtain each clustered node monitor message by main cluster management node, improve data processing speed, reduce the response time, improve Consumer's Experience.
By following scheme: if two cluster management nodes, then be divided into main cluster management node, backup cluster management node, monitor message in database module is synchronized to and the database module in described backup cluster management node by described main cluster management node in real time or regularly, and communication security and data reliability are strengthened greatly.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, and form a application's part, schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Figure 1 shows that the multi-layer information process flow figure of prior art;
Figure 2 shows that the multi-layer information process flow figure of the embodiment of the present invention 1;
Figure 3 shows that the multi-layer information treatment system structure chart of the embodiment of the present invention 2;
Figure 4 shows that the cluster management node structure figure of the embodiment of the present invention 3.
Embodiment
Hereinafter also describe the present invention in detail with reference to accompanying drawing in conjunction with the embodiments.It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.
Figure 2 shows that the multi-layer information process flow figure of the embodiment of the present invention 1, comprise the following steps:
Step 201: the clustered node monitor message of acquisition is sent to main cluster management node by each clustered node respectively;
Further, the clustered node monitor message of acquisition is sent to main cluster management node by the collection module of acting on behalf of of each clustered node respectively.
Further, the acting on behalf of collection module timing or in real time by broadcast mode, the clustered node monitor message of acquisition be sent to main cluster management node of each clustered node.
Further, described clustered node monitor message comprises file system service state information, clustered node CPU information, the clustered node memory information in clustered node state information, clustered node storage capacity information, clustered node.
Further, clustered node act on behalf of collection module by cluster order, obtain the file system service state information in clustered node state information, clustered node storage capacity information, clustered node; Clustered node act on behalf of collection module by operating system command, obtain clustered node CPU information, clustered node memory information.
Further, arrange in each clustered node in advance and act on behalf of collection module and Agent module and Agent module, service module and Server module, database module are set in multiple cluster management node;
Further, described multiple cluster management node is active and standby each other.Such as: if two cluster management nodes, then main cluster management node, backup cluster management node is divided into.
Further, described multiple cluster management node is selected from each clustered node.
Step 202: the service module in described main cluster management node and Server module are by described clustered node monitor message write into Databasce module.
Further, the monitor message in database module is synchronized to and the database module in described backup cluster management node by described main cluster management node in real time or regularly.
Step 203: by accessing the database module in main cluster management node, obtain each clustered node monitor message.
Further, client accesses the database module in main cluster management node by the communication server, obtains each clustered node monitor message.
Figure 3 shows that the multi-layer information treatment system structure chart of the embodiment of the present invention 2, comprise client, the communication server, multiple clustered node (clustered node 1, clustered node 2 ... clustered node n); Wherein, described client is connected with described multiple clustered node by the described communication server;
Each clustered node, for being sent to main cluster management node by the clustered node monitor message of acquisition respectively and being stored by described main cluster management node; Wherein, described main cluster management node selected (such as: choice set group node 1 is main cluster management node) from described multiple clustered node;
Described client accesses described main cluster management node by the communication server, obtains each clustered node monitor message.
Figure 4 shows that the cluster management node structure figure of the embodiment of the present invention 3, comprise and act on behalf of collection module, service module, database module; Wherein, described collection module of acting on behalf of is connected with described database module by described service module;
Describedly act on behalf of collection module, for the clustered node monitor message of collection is sent to described service module;
Described service module, for writing described database module by the monitor message of each clustered node obtained;
Described database module, for storing the monitor message of each clustered node.
By following scheme: the clustered node monitor message of acquisition is sent to main cluster management node and is stored by described main cluster management node by each clustered node respectively; By accessing main cluster management node, obtain each clustered node monitor message; Achieve client and obtain each clustered node monitor message by main cluster management node, improve data processing speed, reduce the response time, improve Consumer's Experience.
By following scheme: if two cluster management nodes, then be divided into main cluster management node, backup cluster management node, monitor message in database module is synchronized to and the database module in described backup cluster management node by described main cluster management node in real time or regularly, and communication security and data reliability are strengthened greatly.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (9)
1. a multi-layer information processing method, is characterized in that, comprises the following steps:
The clustered node monitor message of acquisition is sent to main cluster management node and is stored by described main cluster management node by each clustered node respectively;
By accessing main cluster management node, obtain each clustered node monitor message.
2. method according to claim 1, is characterized in that, the clustered node monitor message of acquisition is sent to main cluster management node and by before described main cluster management node storage, also comprises by each clustered node respectively:
Arrange in each clustered node in advance and act on behalf of collection module and Agent module and described Agent module, service module and Server module, database module are set in multiple cluster management node.
3. method according to claim 2, is characterized in that, if two cluster management nodes, is then divided into main cluster management node, backup cluster management node; Wherein, described two cluster management nodes are all selected from each clustered node.
4. method according to claim 3, is characterized in that, the acting on behalf of collection module timing or in real time by broadcast mode, the clustered node monitor message of acquisition is sent to main cluster management node of each clustered node;
Service module in described main cluster management node and Server module are by described clustered node monitor message write into Databasce module;
By accessing the database module in main cluster management node, obtain each clustered node monitor message.
5. method according to claim 4, it is characterized in that, described clustered node monitor message comprises file system service state information, clustered node CPU information, clustered node memory information in clustered node state information, clustered node storage capacity information, clustered node.
6. method according to claim 5, is characterized in that, clustered node act on behalf of collection module by cluster order, obtain the file system service state information in clustered node state information, clustered node storage capacity information, clustered node; Clustered node act on behalf of collection module by operating system command, obtain clustered node CPU information, clustered node memory information.
7. method according to claim 3, is characterized in that, the monitor message in database module is synchronized to and the database module in described backup cluster management node by described main cluster management node in real time or regularly.
8. a multi-layer information treatment system, is characterized in that, comprises client, the communication server, multiple clustered node, and wherein, described client is connected with described multiple clustered node by the described communication server;
Each clustered node, for being sent to main cluster management node by the clustered node monitor message of acquisition respectively and being stored by described main cluster management node; Wherein, described main cluster management node is selected from described multiple clustered node;
Described client accesses described main cluster management node by the communication server, obtains each clustered node monitor message.
9. management node, is characterized in that, comprises and acts on behalf of collection module, service module, database module; Wherein, described collection module of acting on behalf of is connected with described database module by described service module;
Describedly act on behalf of collection module, for the clustered node monitor message of collection is sent to described service module;
Described service module, for writing described database module by the monitor message of each clustered node obtained;
Described database module, for storing the monitor message of each clustered node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510512640.5A CN105007193A (en) | 2015-08-19 | 2015-08-19 | Multi-layer information processing method, system thereof and cluster management node |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510512640.5A CN105007193A (en) | 2015-08-19 | 2015-08-19 | Multi-layer information processing method, system thereof and cluster management node |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105007193A true CN105007193A (en) | 2015-10-28 |
Family
ID=54379720
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510512640.5A Pending CN105007193A (en) | 2015-08-19 | 2015-08-19 | Multi-layer information processing method, system thereof and cluster management node |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105007193A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106027623A (en) * | 2016-03-14 | 2016-10-12 | 中国科学院计算技术研究所 | Distributed cluster state management method and system thereof |
| CN106161090A (en) * | 2016-07-12 | 2016-11-23 | 许继集团有限公司 | The monitoring method of a kind of subregion group system and device |
| CN106301895A (en) * | 2016-08-03 | 2017-01-04 | 浪潮(北京)电子信息产业有限公司 | A kind of disaster recovery method obtaining cluster monitoring data and device |
| CN106453377A (en) * | 2016-10-28 | 2017-02-22 | 中金云金融（北京）大数据科技股份有限公司 | Intelligent monitoring system and method for distributed network based on block chain |
| CN106506203A (en) * | 2016-10-25 | 2017-03-15 | 杭州云象网络技术有限公司 | A kind of monitoring nodes system for being applied to block chain |
| CN106790723A (en) * | 2017-03-23 | 2017-05-31 | 泰康保险集团股份有限公司 | The monitoring method of application service, load-balancing device and monitoring device |
| CN107395443A (en) * | 2017-08-31 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of distributed type assemblies management method, apparatus and system |
| CN111130920A (en) * | 2019-11-26 | 2020-05-08 | 网宿科技股份有限公司 | Hardware information acquisition method, device, server and storage medium |
| CN112311596A (en) * | 2020-10-22 | 2021-02-02 | 深圳前海微众银行股份有限公司 | Data management method, device, equipment and computer storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101667034A (en) * | 2009-09-21 | 2010-03-10 | 北京航空航天大学 | Scalable monitoring system supporting hybrid clusters |
| CN103607297A (en) * | 2013-11-07 | 2014-02-26 | 上海爱数软件有限公司 | Fault processing method of computer cluster system |
| CN103701661A (en) * | 2013-12-23 | 2014-04-02 | 浪潮(北京)电子信息产业有限公司 | Method and system for realizing node monitoring |
| US20140164452A1 (en) * | 2012-12-06 | 2014-06-12 | Empire Technology Development Llc | Decentralizing a hadoop cluster |
-
2015
- 2015-08-19 CN CN201510512640.5A patent/CN105007193A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101667034A (en) * | 2009-09-21 | 2010-03-10 | 北京航空航天大学 | Scalable monitoring system supporting hybrid clusters |
| US20140164452A1 (en) * | 2012-12-06 | 2014-06-12 | Empire Technology Development Llc | Decentralizing a hadoop cluster |
| CN103607297A (en) * | 2013-11-07 | 2014-02-26 | 上海爱数软件有限公司 | Fault processing method of computer cluster system |
| CN103701661A (en) * | 2013-12-23 | 2014-04-02 | 浪潮(北京)电子信息产业有限公司 | Method and system for realizing node monitoring |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106027623A (en) * | 2016-03-14 | 2016-10-12 | 中国科学院计算技术研究所 | Distributed cluster state management method and system thereof |
| CN106161090A (en) * | 2016-07-12 | 2016-11-23 | 许继集团有限公司 | The monitoring method of a kind of subregion group system and device |
| CN106301895A (en) * | 2016-08-03 | 2017-01-04 | 浪潮(北京)电子信息产业有限公司 | A kind of disaster recovery method obtaining cluster monitoring data and device |
| CN106506203A (en) * | 2016-10-25 | 2017-03-15 | 杭州云象网络技术有限公司 | A kind of monitoring nodes system for being applied to block chain |
| CN106506203B (en) * | 2016-10-25 | 2019-12-10 | 杭州云象网络技术有限公司 | Node monitoring system applied to block chain |
| CN106453377B (en) * | 2016-10-28 | 2021-03-02 | 中金云金融（北京）大数据科技股份有限公司 | Block chain based distributed network intelligent monitoring system and method |
| CN106453377A (en) * | 2016-10-28 | 2017-02-22 | 中金云金融（北京）大数据科技股份有限公司 | Intelligent monitoring system and method for distributed network based on block chain |
| CN106790723A (en) * | 2017-03-23 | 2017-05-31 | 泰康保险集团股份有限公司 | The monitoring method of application service, load-balancing device and monitoring device |
| CN106790723B (en) * | 2017-03-23 | 2020-03-13 | 泰康保险集团股份有限公司 | Application service monitoring method, load balancing equipment and monitoring equipment |
| CN107395443A (en) * | 2017-08-31 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of distributed type assemblies management method, apparatus and system |
| CN111130920A (en) * | 2019-11-26 | 2020-05-08 | 网宿科技股份有限公司 | Hardware information acquisition method, device, server and storage medium |
| CN112311596A (en) * | 2020-10-22 | 2021-02-02 | 深圳前海微众银行股份有限公司 | Data management method, device, equipment and computer storage medium |
| CN112311596B (en) * | 2020-10-22 | 2023-05-12 | 深圳前海微众银行股份有限公司 | Data management method, device, equipment and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105007193A (en) | Multi-layer information processing method, system thereof and cluster management node | |
| US10719260B2 (en) | Techniques for storing and retrieving data from a computing device | |
| CN103138912B (en) | Method of data synchronization and system | |
| CN104580226A (en) | Session data sharing system and method | |
| CN106790629A (en) | Data synchronization unit and its realize the method for data syn-chronization, client access system | |
| CN102624881B (en) | Mobile-device-oriented service cache system architecture and development method | |
| CN105472002A (en) | Session synchronization method based on instant copying among cluster nodes | |
| CN103078933B (en) | A kind of method and apparatus determining data migration time | |
| CN106487486B (en) | Service processing method and data center system | |
| CN106657314A (en) | Cross-data center data synchronization system and method | |
| CN111176888B (en) | Disaster recovery method, device and system for cloud storage | |
| WO2012145963A1 (en) | Data management system and method | |
| CN106603319B (en) | Fault processing method, management server and logic server | |
| CN105740248B (en) | A kind of method of data synchronization, apparatus and system | |
| CN105338095A (en) | Conversation data processing method and device | |
| CN104967691A (en) | Distributed storage control method and system | |
| CN105095358A (en) | Method and system for acquiring database operation logs | |
| CN110740155B (en) | Request processing method and device in distributed system | |
| CN104954444A (en) | Cached data migration method and device | |
| CN105959420A (en) | Multi-client metadata synchronous update method and device | |
| CN112351068A (en) | Information synchronization method, system, device, computer equipment and storage medium | |
| CN103414762A (en) | Cloud backup method and cloud backup device | |
| CN105407044A (en) | Method for implementing cloud storage gateway system based on network file system (NFS) | |
| CN101344882A (en) | Data query method, insertion method and deletion method | |
| CN103152191A (en) | Processing method and system of service gateway data of internet of things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151028 |
|
| RJ01 | Rejection of invention patent application after publication |