CN109412887A - A kind of collection system of the container monitors data based on OpenStack - Google Patents
A kind of collection system of the container monitors data based on OpenStack Download PDFInfo
- Publication number
- CN109412887A CN109412887A CN201811166233.3A CN201811166233A CN109412887A CN 109412887 A CN109412887 A CN 109412887A CN 201811166233 A CN201811166233 A CN 201811166233A CN 109412887 A CN109412887 A CN 109412887A
- Authority
- CN
- China
- Prior art keywords
- data
- container
- node
- monitoring
- openstack
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0246—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/22—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
Abstract
A kind of collection system of container monitors data based on OpenStack proposed by the present invention, is disposed by Kolla-ansible, chooses suitable node as container node；CAdvisor data collector is deployed on each node container；Grafana component is connect with all containers of each node；The monitoring data of cAdvisor collector collection vessel；Client issues to Grafana component and reads request of data；Client shows acquired monitoring data in graphical form.Using the present invention when container resource occupation is tested automatic collection monitoring data, very big convenience is brought to test job, the exhibition method of diversified forms is very clear, while also reducing the time that manpower will be paid close attention in real time.
Description
Technical field
The present invention relates to OpenStack container monitors field, more particularly to a kind of appearance based on OpenStack
The collection system of device monitoring data.
Background technique
OpenStack be one by NASA (US National Aeronautics and Space Administration) Rackspace R & D Cooperation and initiate, with
The free software and open source code project of Apache licensing authorization.OpenStack supports almost all kinds of cloud environment,
It can provide implement it is simple, can extend, enrich on a large scale, the cloud computing management platform that standard is unified.OpenStack passes through each
Kind of the complementary service facility that provides the foundation services the solution of (IaaS), and each service offer API is to be integrated.
OpenStack cloud computing platform helps service provider and enterprises to realize the cloud infrastructure for being similar to Amazon EC2 and S3
Service.OpenStack other than the support energetically of Rackspace and NASA, there are also include Dell, Citrix, Cisco,
The contribution and support of the heavyweights such as Canonical company, development speed is very fast, another substituted leading open source cloud is flat
The situation of platform Eucalyptus.
As cloud computing technology is more and more applied to the every field of information industry, cloud computing environment Cluster
The monitoring of device system and regulatory requirement are also increasing.Under cloud computing environment, number of servers is in exponential increase, in addition net
Network equipment, storage etc. are also many more than traditional IT system, and the monitoring node and monitoring scale for requiring monitoring system in this way are also therewith
Increase very much.It is existing to container resource occupation such as: CPU consumption, the test of memory consumption and disk usage amount, in the test phase
Between manually check whether container or collector are hung, once hang, test data lose, can only retest, waste of manpower,
It cannot achieve the automatic collection to test data, exhibition method is also extremely limited, cannot achieve the monitoring exhibition method of diversification.
Summary of the invention
In view of the above problems, the receipts of the purpose of the present invention is to provide a kind of container monitors data based on OpenStack
Collecting system.
The present invention to achieve the above object, is achieved through the following technical solutions: a kind of container monitors based on OpenStack
The collection system of data, including client and server-side, client and server-side pass through network connection；The client be used for
Server-side, which is sent, obtains monitoring data request, receives and show the information that server-side is sent；The server-side include: container,
Grafana component indicates unit, service unit and data collection module；The container is disposed using Kolla-ansible, and
It is needed to choose container node according to monitoring；The Grafana component is connect with container；The expression unit is for receiving client
The acquisition container monitors request of data of transmission, and service unit is requested into the processing handled to monitoring data is obtained
As a result it is back to client；The service unit is used to handle using corresponding with service node monitoring data request is obtained,
Obtain corresponding processing result；The data collection module includes cAdvisor data collector, cAdvisor data collector
Monitoring data for collection vessel.
Further, the expression unit includes data processing module, and the data processing module is for pressing processing result
Client is back to after being packaged according to default packaged type.
Further, the service unit includes data detection module and info push module；The data detection module is used
When detecting present node container data failure, the request which does not complete processing is sent to info push module；It is described
Info push module is used to the information of nodes break down pushing to client.
Further, the monitoring data of the container includes: the usage amount of CPU, utilization rate, memory usage amount, memory use
Rate, disk I/O time, disk usage amount and disk speed.
Further, described to need the container node chosen to include: monitoring node, control node and calculate section according to monitoring
Point.
Further, the Grafana deployment of components shows monitoring data as UI on monitoring node.
Further, the cAdvisor collector is deployed in control node and calculate node, is used for timing acquiring container
Monitoring data and be sent to data detection module.
Further, the data detection module includes Influxdb database and Pluto management assembly；The Influxdb
Database is deployed on monitoring node, for storing the monitoring data of acquisition；The Pluto management assembly is deployed in monitoring node
On, for being managed to monitoring node and configuring presupposed information.
Further, monitoring data is shown by Grafana component by way of chart, and the chart includes instrument
Disk, histogram, line chart, point diagram, pie chart and table.
Further, the presupposed information includes: frequency acquisition, alarm threshold, notice contact method, alarm display, performance
Data Rest API and timing summarizing resource warning information.
The prior art is compared, the beneficial effects of the invention are that: the present invention provides a kind of, and the container based on OpenStack is supervised
The collection system for controlling data, is disposed by Kolla-ansible, chooses suitable node as container node；Each node holds
CAdvisor data collector is deployed on device；Grafana component is connect with all containers of each node；CAdvisor is collected
The monitoring data of device collection vessel；Client issues to Grafana component and reads request of data；Client is shown in graphical form
Acquired monitoring data.Using the present invention when container resource occupation is tested automatic collection monitoring data, test job is brought
Very big convenience, the exhibition method of diversified forms is very clear, while also reducing the time that manpower will be paid close attention in real time.
The present invention needs artificial see when compensating for single existing monitoring exhibition method and the monitoring test of container resource occupation
The deficiency for examining container state realizes the automatic monitoring displaying side collected with diversification of user's monitoring data in checking monitoring
Formula.The data monitored are shown by the present invention by way of chart, are conveniently checked, chart includes: instrument board, column
Figure, line chart, point diagram, pie chart, table.Also tester can be allowed quickly to know reservoir failure information simultaneously, be checked without specially going
Whether container is faulty, eliminates many time, has the characteristics of high efficiency, flexibility, convenience.
It can be seen that compared with prior art, the present invention clear principle, structure are simple, it is easy to use, be conducive to carry out city
Field is promoted, and has substantive distinguishing features outstanding and significant progress, beneficial effects of its implementation are also obvious.
Detailed description of the invention
Attached drawing 1 is system construction drawing of the invention.
Specific embodiment
It explains with reference to the accompanying drawing to a specific embodiment of the invention.
A kind of collection system of container monitors data based on OpenStack as shown in Figure 1, including client and service
End, client and server-side pass through network connection；Client, which is used to send to server-side, obtains monitoring data request, receives and shows
Show the information that server-side is sent.
The server-side includes: container, Grafana component, indicates unit, service unit and data collection module；It is described
Container is disposed using Kolla-ansible, and needs to choose container node according to monitoring, and container node includes monitoring node, control
Node processed and calculate node.The Grafana component is connect with container；Grafana deployment of components is on monitoring node, as UI
Show monitoring data, monitoring data is shown by Grafana component by way of chart, the chart includes instrument
Disk, histogram, line chart, point diagram, pie chart and table.
The acquisition container monitors request of data for indicating unit and being used to receive client transmission, and by service unit pair
It obtains the processing result that monitoring data request is handled and is back to client；Indicate that unit includes data processing module,
The data processing module is for being back to client after being packaged processing result according to default packaged type.
Service unit is used to handle using corresponding with service node monitoring data request is obtained, and obtains corresponding processing
As a result；Service unit includes data detection module and info push module；The data detection module is for detecting present node
When container data failure, the request which does not complete processing is sent to info push module；The info push module is used
In the information of nodes break down is pushed to client.Data detection module includes Influxdb database and Pluto management
Component；Influxdb database is deployed on monitoring node, for storing the monitoring data of acquisition；The deployment of Pluto management assembly
On monitoring node, for being managed to monitoring node and configuring presupposed information.Presupposed information includes: frequency acquisition, alarm
Threshold value, notice contact method, alarm display, performance data Rest API and timing summarizing resource warning information.
The data collection module includes cAdvisor data collector, and cAdvisor data collector is used for collection vessel
Monitoring data.CAdvisor collector is deployed in control node and calculate node, and the monitoring data of timing acquiring container is simultaneously
It is sent to data detection module.
In addition, the monitoring data of the container includes: the usage amount of CPU, utilization rate, memory usage amount, memory usage,
Disk I/O time, disk usage amount and disk speed.
The collection system for present embodiments providing a kind of container monitors data based on OpenStack, passes through Kolla-
Ansible deployment, chooses suitable node as container node；CAdvisor data collection is deployed on each node container
Device；Grafana component is connect with all containers of each node；The monitoring data of cAdvisor collector collection vessel；Client
It holds to issue to Grafana component and reads request of data；Client shows acquired monitoring data in graphical form.Using the present invention
In the test of container resource occupation, automatic collection monitoring data, very big convenience, the exhibition of diversified forms are brought to test job
Show that mode is very clear, need not manually be checked in test.
With reference to the drawings and specific embodiments, the invention will be further described.It should be understood that these embodiments are merely to illustrate
The present invention rather than limit the scope of the invention.In addition, it should also be understood that, after reading the content taught by the present invention, this field
Technical staff can make various changes or modifications the present invention, and such equivalent forms equally fall within range defined herein.
Claims (10)
1. a kind of collection system of the container monitors data based on OpenStack, which is characterized in that including client and service
End, client and server-side pass through network connection；
The client, which is used to send to server-side, obtains monitoring data request, receives and show the information that server-side is sent；
The server-side includes: container, Grafana component, indicates unit, service unit and data collection module；
The container is disposed using Kolla-ansible, and is needed to choose container node according to monitoring；
The Grafana component is connect with container；
The acquisition container monitors request of data for indicating unit and being used to receive client transmission, and by service unit to acquisition
The processing result that monitoring data request is handled is back to client；
The service unit is used to handle using corresponding with service node monitoring data request is obtained, and obtains corresponding processing
As a result；
The data collection module includes cAdvisor data collector, and cAdvisor data collector is used for the prison of collection vessel
Control data.
2. the collection system of the container monitors data according to claim 1 based on OpenStack, which is characterized in that institute
Stating indicates that unit includes data processing module, and the data processing module is used to carry out processing result according to default packaged type
Client is back to after encapsulation.
3. the collection system of the container monitors data according to claim 1 based on OpenStack, which is characterized in that institute
Stating service unit includes data detection module and info push module；
The data detection module is for when detecting present node container data failure, the request which does not complete processing to be sent out
It send to info push module；The info push module is used to the information of nodes break down pushing to client.
4. the collection system of the container monitors data according to claim 1 based on OpenStack, which is characterized in that institute
The monitoring data for stating container includes: the usage amount of CPU, utilization rate, memory usage amount, memory usage, disk I/O time, disk
Usage amount and disk speed.
5. the collection system of the container monitors data according to claim 3 based on OpenStack, which is characterized in that institute
Stating according to the container node that monitoring needs are chosen includes: monitoring node, control node and calculate node.
6. the collection system of the container monitors data according to claim 5 based on OpenStack, which is characterized in that institute
Grafana deployment of components is stated on monitoring node, shows monitoring data as UI.
7. the collection system of the container monitors data according to claim 5 based on OpenStack, which is characterized in that institute
CAdvisor collector is stated to be deployed in control node and calculate node, for timing acquiring container monitoring data and be sent to
Data detection module.
8. the collection system of the container monitors data according to claim 5 based on OpenStack, which is characterized in that institute
Stating data detection module includes Influxdb database and Pluto management assembly；
The Influxdb database is deployed on monitoring node, for storing the monitoring data of acquisition；
The Pluto management assembly is deployed on monitoring node, for being managed to monitoring node and configuring presupposed information.
9. the collection system of the container monitors data according to claim 6 based on OpenStack, it is characterised in that:
Monitoring data is shown by Grafana component by way of chart, the chart include instrument board, histogram, line chart,
Point diagram, pie chart and table.
10. the collection system of the container monitors data according to claim 8 based on OpenStack, which is characterized in that institute
Stating presupposed information includes: frequency acquisition, alarm threshold, notice contact method, alarm display, performance data Rest API and timing
Summarizing resource warning information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811166233.3A CN109412887A (en) | 2018-10-08 | 2018-10-08 | A kind of collection system of the container monitors data based on OpenStack |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811166233.3A CN109412887A (en) | 2018-10-08 | 2018-10-08 | A kind of collection system of the container monitors data based on OpenStack |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109412887A true CN109412887A (en) | 2019-03-01 |
Family
ID=65466807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811166233.3A Pending CN109412887A (en) | 2018-10-08 | 2018-10-08 | A kind of collection system of the container monitors data based on OpenStack |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109412887A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110018932A (en) * | 2019-03-26 | 2019-07-16 | 中国联合网络通信集团有限公司 | A kind of monitoring method and device of container disk |
| CN110262944A (en) * | 2019-06-21 | 2019-09-20 | 四川长虹电器股份有限公司 | The method that a kind of pair of K8s cluster container resource is monitored and is alerted |
| CN110430084A (en) * | 2019-08-20 | 2019-11-08 | 济南浪潮数据技术有限公司 | Node state monitoring method and device |
| CN111399775A (en) * | 2020-03-12 | 2020-07-10 | 山东汇贸电子口岸有限公司 | Resource cleaning method and system based on OpenStack environment |
| CN113364640A (en) * | 2020-03-04 | 2021-09-07 | 大唐移动通信设备有限公司 | Visualization method and device for operation index |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105227374A (en) * | 2015-10-23 | 2016-01-06 | 浪潮(北京)电子信息产业有限公司 | A kind of fault moving method of cluster application and system |
| CN106610871A (en) * | 2016-12-30 | 2017-05-03 | 郑州云海信息技术有限公司 | Cloud operating system architecture |
| CN106936636A (en) * | 2017-03-15 | 2017-07-07 | 无锡华云数据技术服务有限公司 | A kind of implementation method of the cloud computing test platform of rapid deployment containerization |
| CN107786391A (en) * | 2017-11-03 | 2018-03-09 | 郑州云海信息技术有限公司 | A kind of method for monitoring network to OpenStack based on Grafana |
| CN107832116A (en) * | 2017-11-13 | 2018-03-23 | 郑州云海信息技术有限公司 | A kind of method that virtual machine instance monitoring is realized based on Grafana |
| CN108009428A (en) * | 2017-11-30 | 2018-05-08 | 郑州云海信息技术有限公司 | A kind of security configuration detection method for openstack |
| US10009375B1 (en) * | 2017-12-01 | 2018-06-26 | KnowBe4, Inc. | Systems and methods for artificial model building techniques |
| CN108512719A (en) * | 2018-03-02 | 2018-09-07 | 南京易捷思达软件科技有限公司 | A kind of Integrative resource monitoring system based on cloud platform of increasing income |
| CN108986893A (en) * | 2018-08-23 | 2018-12-11 | 郑州云海信息技术有限公司 | A kind of community endowment living system based on artificial intelligence |
-
2018
- 2018-10-08 CN CN201811166233.3A patent/CN109412887A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105227374A (en) * | 2015-10-23 | 2016-01-06 | 浪潮(北京)电子信息产业有限公司 | A kind of fault moving method of cluster application and system |
| CN106610871A (en) * | 2016-12-30 | 2017-05-03 | 郑州云海信息技术有限公司 | Cloud operating system architecture |
| CN106936636A (en) * | 2017-03-15 | 2017-07-07 | 无锡华云数据技术服务有限公司 | A kind of implementation method of the cloud computing test platform of rapid deployment containerization |
| CN107786391A (en) * | 2017-11-03 | 2018-03-09 | 郑州云海信息技术有限公司 | A kind of method for monitoring network to OpenStack based on Grafana |
| CN107832116A (en) * | 2017-11-13 | 2018-03-23 | 郑州云海信息技术有限公司 | A kind of method that virtual machine instance monitoring is realized based on Grafana |
| CN108009428A (en) * | 2017-11-30 | 2018-05-08 | 郑州云海信息技术有限公司 | A kind of security configuration detection method for openstack |
| US10009375B1 (en) * | 2017-12-01 | 2018-06-26 | KnowBe4, Inc. | Systems and methods for artificial model building techniques |
| CN108512719A (en) * | 2018-03-02 | 2018-09-07 | 南京易捷思达软件科技有限公司 | A kind of Integrative resource monitoring system based on cloud platform of increasing income |
| CN108986893A (en) * | 2018-08-23 | 2018-12-11 | 郑州云海信息技术有限公司 | A kind of community endowment living system based on artificial intelligence |
Non-Patent Citations (1)
| Title |
|---|
| 张硕，: ""面向Docker容错的性能监控和自适应预复制检查点技术研究"", 《中国优秀硕士学位论文全文数据库-信息科技辑》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110018932A (en) * | 2019-03-26 | 2019-07-16 | 中国联合网络通信集团有限公司 | A kind of monitoring method and device of container disk |
| CN110018932B (en) * | 2019-03-26 | 2023-12-01 | 中国联合网络通信集团有限公司 | Method and device for monitoring container magnetic disk |
| CN110262944A (en) * | 2019-06-21 | 2019-09-20 | 四川长虹电器股份有限公司 | The method that a kind of pair of K8s cluster container resource is monitored and is alerted |
| CN110430084A (en) * | 2019-08-20 | 2019-11-08 | 济南浪潮数据技术有限公司 | Node state monitoring method and device |
| CN113364640A (en) * | 2020-03-04 | 2021-09-07 | 大唐移动通信设备有限公司 | Visualization method and device for operation index |
| CN111399775A (en) * | 2020-03-12 | 2020-07-10 | 山东汇贸电子口岸有限公司 | Resource cleaning method and system based on OpenStack environment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109412887A (en) | A kind of collection system of the container monitors data based on OpenStack | |
| CN108512719B (en) | Integrated resource monitoring system based on open-source cloud platform | |
| CN103188112B (en) | Network flow detection method and device | |
| CN103338135B (en) | A kind of method for real-time monitoring of cluster storage capacity | |
| CN109582471A (en) | Information processing method, device and system | |
| CN103607424B (en) | Server connection method and server system | |
| CN109359031A (en) | More appliance applications test methods, device, server and storage medium | |
| CN103778050A (en) | Database server high-availability performance detecting system | |
| CN111381983A (en) | Lightweight message middleware system and method of virtual test target range verification system | |
| CN111666197A (en) | Pressure testing method and device, electronic equipment and computer readable medium | |
| CN111221591A (en) | Method, system and medium for detecting availability of micro-service deployed based on Kubernetes | |
| CN109117341A (en) | A kind of monitoring method of virtual machine, device, equipment and medium | |
| del Castillo et al. | Openstack federation in experimentation multi-cloud testbeds | |
| CN108196787A (en) | The quota management method and cluster storage system of cluster storage system | |
| CN103856337A (en) | Resource occupation rate acquiring method, providing method, system and server thereof | |
| US10225375B2 (en) | Networked device management data collection | |
| CN105471938B (en) | Server load management method and device | |
| CN105245369A (en) | Component issuing container method supporting multiple transport protocols | |
| CN105187514B (en) | The management method and its system of cloud application program | |
| CN104967667B (en) | A kind of software stability test remote monitoring system based on cloud service | |
| CN106210101B (en) | Message management system and information management method | |
| CN104170343B (en) | A kind of method for managing resource and management server | |
| CN106161339B (en) | Obtain the method and device of IP access relations | |
| CN106484583A (en) | A kind of UPI protocol model link layer module checking system based on UVM verification platform | |
| CN109344032A (en) | A kind of monitoring method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190301 |
|
| RJ01 | Rejection of invention patent application after publication |