CN106789284B - Monitoring system and method based on Zabbix and Docker - Google Patents
Monitoring system and method based on Zabbix and Docker Download PDFInfo
- Publication number
- CN106789284B CN106789284B CN201611235318.3A CN201611235318A CN106789284B CN 106789284 B CN106789284 B CN 106789284B CN 201611235318 A CN201611235318 A CN 201611235318A CN 106789284 B CN106789284 B CN 106789284B
- Authority
- CN
- China
- Prior art keywords
- zabbix
- server
- host
- monitor
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 55
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000005516 engineering process Methods 0.000 claims abstract description 19
- 230000002159 abnormal effect Effects 0.000 claims abstract description 9
- 238000012423 maintenance Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 3
- 230000009471 action Effects 0.000 abstract description 2
- 238000010276 construction Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0246—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols
- H04L41/0273—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols using web services for network management, e.g. simple object access protocol [SOAP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/04—Network management architectures or arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a monitoring system and a method based on Zabbix and Docker, which relate to the server monitoring technology, utilize the virtualization technology to adopt Docker contractor to correspond to a Zabbix Host, adopt etcd server to manage the distributed state, register the Zabbix Host dynamically and automatically; the proportion between the Zabbix Host and the monitoring item is configurable; when the Zabbix Host is abnormal, the system can migrate the monitoring items on the Zabbix Host to other healthy Zabbix hosts; changes in the abnormal state are communicated to the system in real time through Zabbix action, rather than being trained in turn by the system. The invention provides an automatic monitoring technology for server management, provides a monitoring service with second extreme time granularity, ensures the usability index of the real-time monitoring user webpage and is convenient for the rapid feedback of the administrator.
Description
Technical Field
The invention relates to a server monitoring technology, in particular to a monitoring system and a monitoring method based on Zabbix and Docker.
Background
The existing internet technology plays a very important role in all fields of society, the application demand of the society on the internet pushes the pace of informatization construction, and a server and related platform hardware are the basis for stably providing services for the internet in the informatization construction. With the development of the internet technology, the cloud computing technology becomes a mainstream technology, and more devices such as servers managed by an administrator in an internet system are provided.
In the IT operation and maintenance work, the monitoring of a large number of server hardware layers and application software layers needs to be carried out in an all-round way. If only the host state monitoring software is used, after the WEB service is abnormal, the service abnormality can not be found in time and faults can not be processed in time, and the collection of monitoring log information lags behind the log of an operating system.
In view of the problems existing in the server node management aspect in the existing internet system, the invention provides a monitoring system and a monitoring method based on Zabbix and Docker. The Zabbix technology provides an open source solution of distributed system monitoring and network monitoring functions based on a WEB interface; zabbix can monitor various network parameters to ensure the safe operation of the server system; and provides a flexible notification mechanism to allow system administrators to quickly locate/resolve various existing problems. Docker is an open source application container engine, so that developers can package their applications and dependency packages into a portable container, and then distribute the container to any popular Linux machine, and also realize virtualization.
Disclosure of Invention
Aiming at the requirements and the defects of the prior art development, the invention provides a monitoring system and a monitoring method based on Zabbix and Docker.
The invention relates to a monitoring system and a monitoring method based on Zabbix and Docker, which solve the technical problems and adopt the following technical scheme: the monitoring system based on Zabbix and Docker adopts a basic framework based on Zabbix and Docker technologies, and mainly comprises a Docker connector, a Zabbix Host, an etcd Server, a Monitor adminin, a Zabbix Server and a Monitor Web, wherein the Docker connector corresponds to one Zabbix Host which is a container virtual device; the etcd server is used for carrying out distributed state management on the Docker Container, is in connection communication with the Monitor Admin and transmits data to the Monitor Admin; the Monitor Admin is used for periodically detecting and analyzing a report request of an etcd Server, the Monitor Admin is in connection communication with the Zabbix Server and reports an alarm record to the Zabbix Server, and the Monitor Web is a WEB monitoring management Server at the front end of the Zabbix Server and is used for classifying alarm information and reporting to operation and maintenance managers.
The monitoring method based on Zabbix and Docker mainly comprises the following steps:
1) a virtualization technology is utilized, a Docker container is adopted to correspond to a Zabbix Host, and each Zabbix Host corresponds to a Zabbix agent server;
2) the Zabbix agent server reports the status of the Docker Container to the etcd server, the etcd server performs distributed status management on the Docker Container, dynamically and autonomously registers the Zabbix Host, and transmits the data to the Monitor Admin;
3) the Monitor Admin is responsible for periodically detecting and analyzing the report request of the etcd Server, storing the data state into a database and reporting the alarm record to the Zabbix Server;
4) and the Zabbix Server receives the alarm information uploaded by the Monitor Admin through the API, uploads the alarm information to the Monitor Web, and the Monitor Web classifies the alarm information and reports the alarm information to the operation and maintenance manager.
Compared with the prior art, the monitoring system and method based on Zabbix and Docker have the beneficial effects that: the invention provides an automatic monitoring technology for server management, so that an administrator can automatically monitor an Internet system and provide monitoring service with second extremely-time granularity, and the defects that service abnormity cannot be found in time and faults cannot be processed in time in the existing server monitoring are overcome; the usability index of the user webpage is monitored in real time, and the administrator can conveniently and quickly feed back the usability index.
Drawings
Fig. 1 is a schematic block diagram of a monitoring system based on Zabbix and Docker.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, a monitoring system and method based on Zabbix and Docker according to the present invention are further described in detail below with reference to specific embodiments.
The invention provides a monitoring system and a method based on Zabbix and Docker, which utilize virtualization technology and adopt Docker container to correspond to a Zabbix Host, wherein the Zabbix Host is a virtual equipment Host; an etcd server is adopted to carry out distributed state management, and Zabbix Host is dynamically and automatically registered; the proportion between the Zabbix Host and the monitoring items can be configured, namely the maximum monitoring quantity carried out on each Zabbix Host can be configured; monitoring automatic transfer, if one Zabbix Host is abnormal, the system can transfer the monitoring item to other healthy Zabbix hosts; changes in the abnormal state are communicated to the system in real time through Zabbix action, rather than being trained in turn by the system.
The invention uses zabbix technology, and is based on the following advantages: the system has the advantages of simple and clear architecture, rich document, detailed code annotation, convenient agent/server deployment, detailed monitoring process, a set of easy-to-use HTTP + JSON interfaces and the like. The invention uses Docker technology, and based on the object considered to be monitored, because the user grows and the user operates, the number of zabbix agents can be programmably and dynamically controlled by using Docker technology.
Example 1:
in the monitoring system based on Zabbix and Docker described in this embodiment, a basic architecture based on Zabbix and Docker technologies is adopted, as shown in fig. 1, the monitoring system mainly includes Docker container, Zabbix Host, etcd Server, Monitor Admin, Zabbix Server and Monitor Web, where the Docker container corresponds to one Zabbix Host, and the Zabbix Host is a container virtual device; the etcd server is used for carrying out distributed state management on the Docker Container, is in connection communication with the Monitor Admin and transmits data to the Monitor Admin; the Monitor Admin is used for periodically detecting and analyzing the report request of the etcd Server, the Monitor Admin is in connection communication with the Zabbix Server and reports the alarm record to the Zabbix Server, and the Monitor Web is a WEB monitoring management Server at the front end of the Zabbix Server and is used for classifying the alarm information and reporting to the operation and maintenance manager.
The Docker connector corresponds to one Zabbix Host, each Zabbix Host corresponds to one Zabbixagent server, and the Zabbix agent server reports the status of the Docker connector to the etcd server.
The etcd server is used for carrying out distributed state management on the Docker Container, dynamically and autonomously registering the Zabbix Host, and transmitting data to the Monitor Admin.
The Monitor Admin is used for periodically detecting and analyzing the report request of the etcd Server, storing the data state into a database and reporting the alarm record to the Zabbix Server.
The Monitor Web is a front-end WEB monitoring management Server of the Zabbix Server, the Zabbix Server receives alarm information uploaded by a Monitor Admin process through an API, and the Monitor Web classifies the alarm information and reports to operation and maintenance managers.
The proportion between the Zabbix Host and the monitoring item can be configured, that is, the maximum monitoring quantity carried out on each Zabbix Host can be configured; if one Zabbix Host is abnormal, the monitoring system may migrate the above monitoring item to other healthy Zabbix hosts.
In this embodiment, the monitoring system based on Zabbix and Docker has the following specific implementation process:
1) a virtualization technology is utilized, a Docker container is adopted to correspond to a Zabbix Host, and each Zabbix Host corresponds to a Zabbix agent server;
2) the Zabbix agent server reports the status of the Docker Container to the etcd server, the etcd server performs distributed status management on the Docker Container, dynamically and autonomously registers the Zabbix Host, and transmits the data to the Monitor Admin;
3) the Monitor Admin is responsible for periodically detecting and analyzing the report request of the etcd Server, storing the data state into a database and reporting the alarm record to the Zabbix Server;
4) and the Zabbix Server receives the alarm information uploaded by the Monitor Admin through the API, uploads the alarm information to the Monitor Web, and the Monitor Web classifies the alarm information and reports the alarm information to the operation and maintenance manager.
When a user creates a continuous monitoring task by using the method, two types of monitoring are carried out aiming at the URL input by the user, including HTTP return codes and PING return time; when some monitored sampling data is abnormal, such as HTTP returns to 500 and PING is overtime, an alarm event is returned on a user interface to remind a user; and when the monitored data is normal, returning to the state of the alarm event.
The above embodiments are only specific examples of the present invention, and the scope of the present invention includes but is not limited to the above embodiments, and any suitable changes or substitutions that are consistent with the claims of the present invention and are made by those skilled in the art should fall within the scope of the present invention.
Claims (2)
1. A monitoring system based on Zabbix and Docker is characterized in that two basic architectures based on Zabbix and Docker are adopted, including Docker container, Zabbix Host, etcd server, Monitor adminin, Zabbix server and Monitor Web, wherein the Docker container corresponds to one Zabbix Host, and the Zabbix Host is a container virtual device; the etcd server is used for carrying out distributed state management on the Docker Container, is in connection communication with the Monitor Admin and transmits data to the Monitor Admin; the Monitor Admin is used for periodically detecting and analyzing an etcd Server reporting request, the Monitor Admin is in connection communication with the Zabbix Server and reports an alarm record to the Zabbix Server, and the Monitor Web is a WEB monitoring management Server at the front end of the Zabbix Server and is used for classifying alarm information and reporting to operation and maintenance managers;
each Zabbix host corresponds to a Zabbix agent server, and the Zabbix agent servers report the state of the Dockerclontainer to the etcd server;
the etcd server dynamically and autonomously registers Zabbix Host;
the Zabbix Server receives alarm information uploaded by a Monitor Admin process through an API;
the proportion between the Zabbix Host and the monitoring item can be configured, and if the Zabbix Host is abnormal, the monitoring item on the Zabbix Host is migrated to other healthy Zabbix hosts.
2. A monitoring method based on Zabbix and Docker is characterized by comprising the following steps:
1) a virtualization technology is utilized, a Docker container is adopted to correspond to a Zabbix Host, and each Zabbix Host corresponds to a Zabbix agent server;
2) the Zabbix agent server reports the status of the Docker Container to the etcd server, and the etcd server performs distributed status management on the Docker Container and transmits the data to the Monitor Admin;
3) the Monitor Admin is responsible for periodically detecting and analyzing the report request of the etcd server and reporting the alarm record to the ZabbixServer server;
4) the Zabbix Server receives the alarm information uploaded by the Monitor Admin through the API, and uploads the alarm information to the Monitor Web, and the Monitor Web classifies the alarm information and reports to the operation and maintenance manager;
the etcd server dynamically and autonomously registers Zabbix Host;
the Monitor Admin stores the data state into a database;
the proportion between the Zabbix Host and the monitoring item can be configured, and if the Zabbix Host is abnormal, the monitoring item on the Zabbix Host is migrated to other healthy Zabbix hosts.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611235318.3A CN106789284B (en) | 2016-12-28 | 2016-12-28 | Monitoring system and method based on Zabbix and Docker |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611235318.3A CN106789284B (en) | 2016-12-28 | 2016-12-28 | Monitoring system and method based on Zabbix and Docker |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106789284A CN106789284A (en) | 2017-05-31 |
| CN106789284B true CN106789284B (en) | 2020-03-27 |
Family
ID=58924674
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611235318.3A Active CN106789284B (en) | 2016-12-28 | 2016-12-28 | Monitoring system and method based on Zabbix and Docker |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106789284B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107846442A (en) * | 2017-08-02 | 2018-03-27 | 上海数烨数据科技有限公司 | It is a kind of to increase the method for customizing passage gathered data based on Zabbix aggressive modes |
| CN107528751B (en) * | 2017-09-30 | 2019-10-29 | 南京卓盛云信息科技有限公司 | A kind of system and its management method of dynamic distribution Zabbix monitoring data |
| CN107864057B (en) * | 2017-11-07 | 2020-12-25 | 杭州安恒信息技术股份有限公司 | Online automatic checking and alarming method based on networking state |
| CN108363653B (en) * | 2018-02-07 | 2020-08-07 | 平安科技（深圳）有限公司 | Deployment method and device of monitoring system, computer equipment and storage medium |
| CN108989385A (en) * | 2018-06-05 | 2018-12-11 | 陈艳 | A kind of implementation method based on Zabbix monitoring collection automatic synchronization CMDB |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104468282A (en) * | 2014-12-23 | 2015-03-25 | 携程计算机技术（上海）有限公司 | Cluster monitoring processing system and method |
| CN104950757A (en) * | 2015-06-12 | 2015-09-30 | 北京奇虎科技有限公司 | Container monitoring method and system |
| CN105429813A (en) * | 2014-09-17 | 2016-03-23 | 北京奇虎科技有限公司 | Monitoring method and client for docker |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016170551A2 (en) * | 2015-04-21 | 2016-10-27 | Grade S.R.L. | Command and control system for optimal risk management |
-
2016
- 2016-12-28 CN CN201611235318.3A patent/CN106789284B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105429813A (en) * | 2014-09-17 | 2016-03-23 | 北京奇虎科技有限公司 | Monitoring method and client for docker |
| CN104468282A (en) * | 2014-12-23 | 2015-03-25 | 携程计算机技术（上海）有限公司 | Cluster monitoring processing system and method |
| CN104950757A (en) * | 2015-06-12 | 2015-09-30 | 北京奇虎科技有限公司 | Container monitoring method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106789284A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106789284B (en) | Monitoring system and method based on Zabbix and Docker | |
| KR101826368B1 (en) | Cloud computing monitoring and management system | |
| US8756335B2 (en) | Estimating load shed data in streaming database applications | |
| US20170316321A1 (en) | Predictive rollup and caching for application performance data | |
| US10419553B2 (en) | Dynamic docker pool recycling | |
| US10158726B2 (en) | Supporting high availability for orchestrated services | |
| US20180123922A1 (en) | Correlating performance outliers and network performance impacting event metric | |
| US20160103750A1 (en) | Application programming interface monitoring tool notification and escalation method and system | |
| US10862780B2 (en) | Automatic web page load detection | |
| US10536505B2 (en) | Intelligent data transmission by network device agent | |
| US10536355B1 (en) | Monitoring and analytics system | |
| Akshaya et al. | A basic introduction to devops tools | |
| EP3704845A1 (en) | Auto discovery of network proxies | |
| US8516110B2 (en) | Automated availability data collection and reporting for system management environments | |
| US20200252262A1 (en) | Event-triggered distributed data collection in a distributed transaction monitoring system | |
| WO2015122872A1 (en) | Client application profiling | |
| WO2018200961A1 (en) | Hyper dynamic java management extension | |
| CN104539449B (en) | A kind of failure information processing method and relevant apparatus | |
| KR20180015027A (en) | Apparatus and Method for Automatic Error Alarm of DDS Applications System | |
| Efimov et al. | Integration data model for continuous service delivery in cloud computing system | |
| US9674060B2 (en) | Dynamic and selective management of integration points using performance metrics | |
| US11652702B2 (en) | Configuring a software as-a-service platform for remotely managing a cloud application | |
| US20230031872A1 (en) | Enhanced platform and processes for scalability | |
| CN112929198B (en) | Local hotspot processing method and device, electronic equipment and storage medium | |
| Komarek et al. | Metric based cloud infrastructure monitoring |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |