CN103856354A - Method for achieving unified management of logs of cluster storage system - Google Patents
Method for achieving unified management of logs of cluster storage system Download PDFInfo
- Publication number
- CN103856354A CN103856354A CN201410082186.XA CN201410082186A CN103856354A CN 103856354 A CN103856354 A CN 103856354A CN 201410082186 A CN201410082186 A CN 201410082186A CN 103856354 A CN103856354 A CN 103856354A
- Authority
- CN
- China
- Prior art keywords
- daily record
- storage system
- unified management
- cluster storage
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a method for achieving unified management of logs of a cluster storage system, and relates to the field of cluster storage systems. A log unified management server is deployed in the cluster storage system to collect log information of all devices in the system, and a user can log in a web log management interface of the log unified management server to look up the log information of the devices.
Description
technical field
the present invention relates to cluster storage system field, specifically a kind of cluster storage system daily record unified management implementation method.
Background technology
At present, tens at least of large-scale cluster storage system hardware devices, up to a hundred at most, user can not check system equipment one by one.The general whole storage system of mode unified monitoring that all adopts unified monitoring.But after certain equipment goes wrong, which equipment is unified monitoring also can only demonstrate there is problem, specifically any problem unified monitoring cannot show, and must need to collect the log information of each equipment, checks what problem specifically appears in memory device.Daily record unified management is a very important link, is also the requisite link of cluster storage system.
Summary of the invention
The invention provides a kind of cluster storage system daily record unified management implementation method, the problem of solution is to obtain cluster storage system all devices log information by a station server, checks for user is unified.This station server is called daily record unified management server.Carry out the log information of all devices in gathering system by dispose a daily record unified management server in cluster storage system, and these log informations user can be logined to daily record unified management server web log management interface, check device log information.The main part of cluster storage system is server, storage and clustered software.Server log is mainly operating system daily record, and storing daily record is mainly memory device alarm and the daily record that reports an error, and clustered software daily record is mainly the daily record of software running process record.
?a kind of cluster storage system daily record unified management implementation method, this implementation method mainly contains 4 module compositions: daily record unified management module; Server log forwards; Memory device daily record forwarding module; Clustered software daily record forwards;
Daily record unified management module
In cluster storage system, select 1 station server as daily record unified management node, on this node, set up the catalogue of special storage cluster system daily record, the path of checking the daily record of cluster storage system all devices is provided to user; In order better to represent storage system device log specifying information to user, on daily record unified management server, make a cluster storage system daily record web display page, check system all devices log information for user;
Server log forwards
In cluster storage system, have a lot of server nodes, supporting cluster storage system business datum I/O, therefore server node can produce a lot of useful daily records, and these daily records are also the parts that user is concerned about most; The daily record that the timing of cluster storage system server node produces system is synchronized to daily record unified management server end;
Memory device daily record forwarding module
The medium of cluster storage system storage user data is storage array, and the state quality of storage array directly affects function and the performance of cluster storage system; Therefore, the information of storage array need to be sent to daily record unified management server; Because whether storage system is only paid close attention to storage array and is normally worked, so storage array sends alarm and the important log information such as wrong only to daily record unified management server.
Clustered software daily record forwards
Cluster storage system is a kind of cluster, relies on clustered software and realizes storage system clustering functionality; Cluster storage system is in application process, and clustered software can produce log information equally, these journal displaying be clustered software operation information, be very important information, also running software information must be sent on daily record unified management server;
Concrete deployment is as follows:
1), select a node in cluster storage system as unified log management server, to create log management road
Footpath;
2), allocation cluster storage system service device daily record synchronization mechanism, every one hour, a synchronous daily record was arrived
Daily record unified management server;
3), dispose cluster storage system clustered software, be also that a daily record is at set intervals managed to daily record is unified
Reason server;
4), configure storage devices warning information and the message sending function that reports an error, send to daily record unified management server.
In cluster storage system, there is the log information of all devices in special daily record unified management server gathering system.Meanwhile, daily record unified management server also provides all compositions of the system log query web of department interface.
Compared with prior art, the beneficial effect producing is in the present invention:
Be applicable to extensive, distributed cluster storage system.Particularly, storage array how large-scale cluster storage system many at server node, and have unified log management, do not need the each battery limits of login one by one to check log information.Cluster storage system passes through a log collection node of login, convenient, to check efficiently all devices in system daily record.Daily record unified management server not only can be collected the log information of inner each equipment of storage system, and daily record web interface query function is also provided.User can login the daily record web-based management interface of daily record unified management server, the information of checking internal system all devices.
Brief description of the drawings
Accompanying drawing 1 is cluster storage system daily record unified management schematic diagram in the present invention.
Embodiment
the concrete deployment of a kind of cluster storage system daily record unified management implementation method is as follows:
(1) select a node in cluster storage system as unified log management server, to create log management path.
(2) allocation cluster storage system service device daily record synchronization mechanism, every one hour, a synchronous daily record was to daily record unified management server.
(3) disposing cluster storage system clustered software, is also that a daily record is at set intervals to daily record unified management server.
(4) configure storage devices warning information and the message sending function that reports an error, send to daily record unified management server.
Claims (1)
1. a cluster storage system daily record unified management implementation method, is characterized in that this implementation method mainly contains 4 module compositions: daily record unified management module; Server log forwards; Memory device daily record forwarding module; Clustered software daily record forwards;
Daily record unified management module;
In cluster storage system, select 1 station server as daily record unified management node, on this node, set up the catalogue of special storage cluster system daily record, the path of checking the daily record of cluster storage system all devices is provided to user; In order better to represent storage system device log specifying information to user, on daily record unified management server, make a cluster storage system daily record web display page, check system all devices log information for user;
Server log forwards
In cluster storage system, have a lot of server nodes, supporting cluster storage system business datum I/O, therefore server node can produce a lot of useful daily records, and these daily records are also the parts that user is concerned about most; The daily record that the timing of cluster storage system server node produces system is synchronized to daily record unified management server end;
Memory device daily record forwarding module
The medium of cluster storage system storage user data is storage array, and the state quality of storage array directly affects function and the performance of cluster storage system; Therefore, the information of storage array need to be sent to daily record unified management server; Because whether storage system is only paid close attention to storage array and is normally worked, so storage array sends alarm and the important log information such as wrong only to daily record unified management server;
Clustered software daily record forwards
Cluster storage system is a kind of cluster, relies on clustered software and realizes storage system clustering functionality; Cluster storage system is in application process, and clustered software can produce log information equally, these journal displaying be clustered software operation information, be very important information, also running software information must be sent on daily record unified management server;
Concrete deployment is as follows:
1), select a node in cluster storage system as unified log management server, to create log management path;
2), allocation cluster storage system service device daily record synchronization mechanism, every one hour, a synchronous daily record was to daily record unified management server;
3), dispose cluster storage system clustered software, be also that a daily record is at set intervals to daily record unified management server;
4), configure storage devices warning information and the message sending function that reports an error, send to daily record unified management server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410082186.XA CN103856354A (en) | 2014-03-07 | 2014-03-07 | Method for achieving unified management of logs of cluster storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410082186.XA CN103856354A (en) | 2014-03-07 | 2014-03-07 | Method for achieving unified management of logs of cluster storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103856354A true CN103856354A (en) | 2014-06-11 |
Family
ID=50863598
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410082186.XA Pending CN103856354A (en) | 2014-03-07 | 2014-03-07 | Method for achieving unified management of logs of cluster storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103856354A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104917627A (en) * | 2015-01-20 | 2015-09-16 | 杭州安恒信息技术有限公司 | Log cluster scanning and analysis method used for large-scale server cluster |
| CN105160011A (en) * | 2015-09-22 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Log management system and method |
| CN105306261A (en) * | 2015-09-29 | 2016-02-03 | 北京奇艺世纪科技有限公司 | Method, device and system for collecting logs |
| CN105471635A (en) * | 2015-11-18 | 2016-04-06 | 中国建设银行股份有限公司 | Method, device and system for processing system logs |
| CN106909493A (en) * | 2017-02-28 | 2017-06-30 | 郑州云海信息技术有限公司 | A kind of method of the display BMC daily records in real time in the blade server based on WINDOWS platform |
| CN109525645A (en) * | 2018-10-22 | 2019-03-26 | 郑州云海信息技术有限公司 | A kind of method and system for collecting the log of distributed storage cluster |
| CN109818797A (en) * | 2019-02-12 | 2019-05-28 | 山东超越数控电子股份有限公司 | Blog management method and system in a kind of blade server SMC management |
| US11782880B2 (en) | 2019-01-04 | 2023-10-10 | International Business Machines Corporation | Synchronizing log data within a cluster |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101459557A (en) * | 2008-11-29 | 2009-06-17 | 成都市华为赛门铁克科技有限公司 | Secure logging centralized storage method and device |
| CN102622407A (en) * | 2012-01-29 | 2012-08-01 | 广州亦云信息技术有限公司 | Log file operating system and log file management method |
| CN102780726A (en) * | 2011-05-13 | 2012-11-14 | 中兴通讯股份有限公司 | Log analysis method and log analysis system based on WEB platform |
| CN103166785A (en) * | 2011-12-15 | 2013-06-19 | 同程网络科技股份有限公司 | Distributed type log analysis system based on Hadoop |
| CN103338128A (en) * | 2013-02-25 | 2013-10-02 | 中国人民解放军91655部队 | Information security management system with integrated security management and control function |
| CN103377069A (en) * | 2012-04-26 | 2013-10-30 | 东方有线网络有限公司 | Novel method for achieving virtual calculation deployment based on writing of log files into plug-in network attached storage (NAS) |
-
2014
- 2014-03-07 CN CN201410082186.XA patent/CN103856354A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101459557A (en) * | 2008-11-29 | 2009-06-17 | 成都市华为赛门铁克科技有限公司 | Secure logging centralized storage method and device |
| CN102780726A (en) * | 2011-05-13 | 2012-11-14 | 中兴通讯股份有限公司 | Log analysis method and log analysis system based on WEB platform |
| CN103166785A (en) * | 2011-12-15 | 2013-06-19 | 同程网络科技股份有限公司 | Distributed type log analysis system based on Hadoop |
| CN102622407A (en) * | 2012-01-29 | 2012-08-01 | 广州亦云信息技术有限公司 | Log file operating system and log file management method |
| CN103377069A (en) * | 2012-04-26 | 2013-10-30 | 东方有线网络有限公司 | Novel method for achieving virtual calculation deployment based on writing of log files into plug-in network attached storage (NAS) |
| CN103338128A (en) * | 2013-02-25 | 2013-10-02 | 中国人民解放军91655部队 | Information security management system with integrated security management and control function |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104917627A (en) * | 2015-01-20 | 2015-09-16 | 杭州安恒信息技术有限公司 | Log cluster scanning and analysis method used for large-scale server cluster |
| CN104917627B (en) * | 2015-01-20 | 2018-06-19 | 杭州安恒信息技术有限公司 | A kind of log cluster for large server cluster scans and analysis method |
| CN105160011A (en) * | 2015-09-22 | 2015-12-16 | 浪潮(北京)电子信息产业有限公司 | Log management system and method |
| CN105306261A (en) * | 2015-09-29 | 2016-02-03 | 北京奇艺世纪科技有限公司 | Method, device and system for collecting logs |
| CN105471635A (en) * | 2015-11-18 | 2016-04-06 | 中国建设银行股份有限公司 | Method, device and system for processing system logs |
| CN105471635B (en) * | 2015-11-18 | 2019-05-31 | 中国建设银行股份有限公司 | A kind of processing method of system log, device and system |
| CN106909493A (en) * | 2017-02-28 | 2017-06-30 | 郑州云海信息技术有限公司 | A kind of method of the display BMC daily records in real time in the blade server based on WINDOWS platform |
| CN109525645A (en) * | 2018-10-22 | 2019-03-26 | 郑州云海信息技术有限公司 | A kind of method and system for collecting the log of distributed storage cluster |
| US11782880B2 (en) | 2019-01-04 | 2023-10-10 | International Business Machines Corporation | Synchronizing log data within a cluster |
| CN109818797A (en) * | 2019-02-12 | 2019-05-28 | 山东超越数控电子股份有限公司 | Blog management method and system in a kind of blade server SMC management |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10944628B2 (en) | Network operation support system and network device management method | |
| CN103856354A (en) | Method for achieving unified management of logs of cluster storage system | |
| CN105183860B (en) | Method of data synchronization and system | |
| CN102340415B (en) | Server cluster system and monitoring method thereof | |
| US10133622B2 (en) | Enhanced error detection in data synchronization operations | |
| CN101854400B (en) | Database synchronization deployment and monitoring method and device | |
| CN105207826A (en) | Security attack alarm positioning system based on Spark big data platform of Tachyou | |
| CN111209011A (en) | Cross-platform container cloud automatic deployment system | |
| CN104022903A (en) | One-stop automatic operation and maintaining system | |
| CN103412893A (en) | Collecting system and collecting method of logs | |
| CN104092575A (en) | Resource monitoring method and system | |
| CN101854270A (en) | Multisystem running state monitoring method and system | |
| CN104268061A (en) | Storage state monitoring mechanism for virtual machine | |
| CN102594598A (en) | Log management system and implementation method thereof | |
| CN108932184A (en) | monitoring device and method | |
| CN108959445A (en) | Distributed information log processing method and processing device | |
| CN107168847A (en) | The full link application monitoring method and device of a kind of support distribution formula framework | |
| CN104834582A (en) | Monitoring event display method | |
| CN112698915A (en) | Multi-cluster unified monitoring alarm method, system, equipment and storage medium | |
| CN113986649A (en) | System monitoring device and method based on prometheus service | |
| WO2015139565A1 (en) | Heterogeneous logging system management configuration | |
| CN105553691A (en) | Monitoring alarm realization method based on electric power supervision information | |
| CN103297477B (en) | A kind of data acquisition reporting system and data processing method and proxy server | |
| CN104113579A (en) | Service system data acquisition based on UDP and realization thereof | |
| WO2016095329A1 (en) | Log recording system and log recording operating method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140611 |
|
| WD01 | Invention patent application deemed withdrawn after publication |