CN112187543A

CN112187543A - Cloud platform event monitoring system and method and electronic equipment

Info

Publication number: CN112187543A
Application number: CN202011053226.XA
Authority: CN
Inventors: 逄立业
Original assignee: Suzhou Inspur Intelligent Technology Co Ltd
Current assignee: Suzhou Inspur Intelligent Technology Co Ltd
Priority date: 2020-09-29
Filing date: 2020-09-29
Publication date: 2021-01-05

Abstract

The invention provides a cloud platform event monitoring system, a cloud platform event monitoring method and electronic equipment, belongs to the technical field of cloud platform monitoring, and solves the technical problems that the existing monitoring system needs to collect the resource data, and the collected deployment and configuration are complex and cannot go deep into the resource. The system comprises an event monitoring system, at least one functional module and an event monitoring client which is deployed on the same host with the functional module; the function module is connected with the event monitoring system through the event monitoring client. The method can go deep into the module to obtain information, effectively avoids the complexity of deployment, improves the stability of the system, is convenient to operate and maintain, effectively improves the user experience, can be used for large-scale monitoring of the cloud platform, can be used for public cloud or private cloud products, improves the stability and the user experience of the cloud platform, and greatly improves the stability of cloud products.

Description

Cloud platform event monitoring system and method and electronic equipment

Technical Field

The invention relates to the technical field of cloud platform monitoring, in particular to a cloud platform event monitoring system and method and electronic equipment.

Background

With the growing maturity of cloud platforms and the continuous expansion of services thereon, the platform scale also rises from the first few, tens of platforms to hundreds or even thousands of platforms. The type and the amount of the monitoring data are larger and larger, and the monitoring data acquisition mode is more and more complicated.

Taking a cloud platform built by OpenStack as an example, OpenStack is a project managed by the cloud platform, and is formed by combining a plurality of main components (nova, cider, netron, keystone and the like) to complete some specific work, and meanwhile, the platform can also utilize the functions of some general tools (docker, maridb, rabbitmq, haproxy and the like). The fault of any component of the cloud platform may cause an accident of the whole platform, so that for monitoring a large-scale OpenStack cluster, not only the performance and the state of a host, the health degree of a process and the state of a virtual resource need to be monitored, but also the states of each component and each tool need to be monitored. In the existing monitoring scheme of the cloud platform, for example, a ceilometer of an OpenStack, zabbix of a third party, promemeus, and the like, the resource data must be acquired, and the deployment and configuration of the acquisition are extremely complex and cannot go deep into the resource.

In large-scale cloud platform monitoring, tools such as zabbix, prometheus, ceilometer and the like are mostly used, and the tools are complex to deploy or adopt an active acquisition mode and cannot go deep into the interior of a module for monitoring; or the collected message queue is used as a middleware and is not stable enough in a large-scale scene.

Disclosure of Invention

The invention aims to provide a cloud platform event monitoring system, a cloud platform event monitoring method and electronic equipment, and aims to solve the technical problems that the existing monitoring system needs to collect the resource data, and the collected deployment and configuration are complicated and cannot go deep into the resource.

In a first aspect, the present invention provides a cloud platform event monitoring system, including: the system comprises an event monitoring system, at least one functional module and an event monitoring client which is deployed on the same host with the functional module; the function module is connected with the event monitoring system through the event monitoring client.

And the functional module is used for generating an event and sending an event monitoring request to the event monitoring client.

And the event monitoring client is used for converting the event monitoring request into a corresponding REST API request and sending the REST API request to the event monitoring system.

And the event monitoring system is used for processing the event based on the REST API request and storing the processed event into a time sequence database.

Further, the processing includes normalization processing; the event monitoring system is further configured to invoke event metadata, and perform normalization processing on the event based on the event metadata to obtain the processed event.

Further, the event monitoring system is further configured to determine whether an attribute of the processed event is an alarm, and if so, send a corresponding alarm notification to the event whose attribute is an alarm, and separate the event whose attribute is an alarm.

Further, the event monitoring system is further configured to determine whether the event with the alarm attribute is an unnecessary alarm event; and if so, performing alarm suppression on the unnecessary alarm event.

Further, the event monitoring system is further configured to display the event.

Further, the event monitoring system is further configured to query feature information of the event; wherein the characteristic information comprises one or more of event occurrence time, affiliated function module, event type and event level.

Further, the time sequence database is an LSM Tree storage structure.

In a second aspect, the present invention further provides a cloud platform event monitoring method, applied to an event monitoring client, including:

and after the functional module deployed on the same host computer with the event monitoring client generates an event, receiving an event monitoring request sent by the functional module.

And converting the event monitoring request into a corresponding REST API request, and sending the REST API request to an event monitoring system so that the event monitoring system processes the event based on the REST API request.

In a third aspect, the present invention further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program operable on the processor, and the processor implements the steps of the cloud platform event monitoring method when executing the computer program.

In a fourth aspect, the present invention also provides a computer readable storage medium storing machine executable instructions which, when invoked and executed by a processor, cause the processor to execute the cloud platform event monitoring method.

According to the cloud platform event monitoring system, the cloud platform event monitoring method and the electronic equipment, the existing defects are improved, the functions of unified alarm suppression, notification and the like are added, the active collection of the monitoring module is changed into the active report of the function module, the information can be deeply obtained from the inside of the module, the complexity of deployment is effectively avoided, and the stability of the system is improved; meanwhile, functions of alarm suppression, alarm notification and the like are added, operation and maintenance are facilitated, user experience is effectively improved, the method can be used for large-scale monitoring of the cloud platform, public cloud products or private cloud products can use the method, stability and user experience of the cloud platform are improved, and stability of the cloud products is greatly improved.

Accordingly, the computer-readable storage medium provided by the embodiment of the invention also has the technical effects.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a schematic diagram of an event write process according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an event processing flow provided by an embodiment of the present invention;

fig. 3 is an architecture diagram of event monitoring of a cloud platform according to an embodiment of the present invention;

fig. 4 is a schematic diagram of an electronic device according to an embodiment of the present invention.

In the figure: 800 electronic device, 801 memory, 802 processor, 803 bus, 804 communication interface.

Detailed Description

To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "comprising" and "having," and any variations thereof, as referred to in embodiments of the present invention, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Referring to fig. 1 to 4, a cloud platform event monitoring system provided in an embodiment of the present invention includes: the system comprises an event monitoring system, at least one functional module and an event monitoring client which is deployed on the same host with the functional module; the function module is connected with the event monitoring system through the event monitoring client.

And the function module is used for generating an event and sending an event monitoring request to the event monitoring client.

And the event monitoring system is used for processing the event based on the REST API request and storing the processed event into the time sequence database.

The invention realizes a mode that each functional module automatically reports event data, each functional module monitors the performance index and the running state of the functional module, calls the client of the event monitoring system, reports the data in real time in the form of an event, realizes internal real-time reporting but not external timing acquisition, and the mode only needs to deploy the client of the event monitoring system on the host of the functional module, thereby solving the complexity of deployment and deeply monitoring components.

The invention abandons the message queue components such as rabbitmq, the message queue provides an asynchronous communication mechanism, and the sender of the message does not need to wait until the message is successfully processed to return, but returns immediately. However, in practical application, especially for small-scale fast online cloud platforms, the message queue is not stable enough, and because real-time consumption operation of events is not needed, the invention adopts the time sequence database based on LSM Tree storage, thereby greatly improving the throughput and the stability of the system.

The invention realizes unified monitoring data definition and management, and for large-scale clusters, the unified definition and management of the monitoring data are the premise of data processing.

And meanwhile, the event with the alarm attribute is separated, so that the user can conveniently process and inform.

The invention realizes the design of the alarm suppression function of the event. The alarm suppression means that temporary shielding operation is carried out on unnecessary alarms, unified page configuration operation is provided for normalized data, and the alarm suppression function is realized.

The invention can display the event/alarm of the access system, and the event and alarm of the access system can be inquired according to time, the module, the event type, the event level and the like.

The invention meets the requirements of flexible and various online monitoring alarms, and when the cloud platform data or the third-party data needs to be accessed into the event monitoring system, only configuration needs to be added in the metadata without developing codes, thereby meeting the platform requirements and avoiding a large amount of temporary development work.

In the embodiment of the invention, the processing comprises normalization processing; and the event monitoring system is also used for calling the event metadata and carrying out normalization processing on the event based on the event metadata to obtain the processed event.

In the embodiment of the present invention, the event monitoring system is further configured to determine whether the attribute of the processed event is an alarm, and if so, send a corresponding alarm notification to the event whose attribute is an alarm, and separate the event whose attribute is an alarm.

In the embodiment of the invention, the event monitoring system is also used for judging whether the event with the alarm attribute is an unnecessary alarm event; and if so, performing alarm suppression on the unnecessary alarm event.

In the embodiment of the invention, the event monitoring system is also used for displaying the event.

In the embodiment of the invention, the event monitoring system is also used for inquiring the characteristic information of the event; the characteristic information comprises one or more of event occurrence time, affiliated function module, event type and event level.

In the embodiment of the invention, the time sequence database is an LSM Tree storage structure.

The embodiment of the invention also provides a cloud platform event monitoring method, which is applied to an event monitoring client and comprises the following steps:

after a functional module deployed on the same host computer with an event monitoring client generates an event, an event monitoring request sent by the functional module is received.

And converting the event monitoring request into a corresponding REST API request, and sending the REST API request to the event monitoring system so that the event monitoring system processes the event based on the REST API request.

The electronic device provided by the embodiment of the invention comprises a memory and a processor, wherein a computer program capable of running on the processor is stored in the memory, and the steps of the cloud platform event monitoring method are realized when the processor executes the computer program.

The embodiment of the invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores machine executable instructions, and when the computer executable instructions are called and executed by a processor, the computer executable instructions cause the processor to execute the cloud platform event monitoring method.

In the embodiment of the present invention, the data processing flow includes two parts, an event writing flow and an event warning flow, which are respectively shown in fig. 1 and fig. 2:

event writing flow:

and S1, the function module generates event data and requests the client side for platform event monitoring in real time.

And S2, converting the request of S1 into a restapi request by the event monitoring client according to the system configuration, and sending the request to the event monitoring system.

And S3, after receiving the api request, the event monitoring system processes the event according to the configuration in the metadata of the monitoring alarm, adds the attributes of the module, the alarm and the like, and stores the attributes into a rear-end time sequence database. An event with an alarm attribute is an alarm.

And (3) event processing flow:

s1, query: the event monitoring system receives the request sent by the page, and the event and the alarm can be returned after being classified according to the attributes such as time, the module to which the event belongs, the event type, the event level and the like.

S2, inhibition: the event monitoring system receives a setting request sent by a page and sets suppression on a certain type of alarm; and the piece monitoring system receives a query request sent by the page, inhibits configuration and alarms and queries.

S3, notification: and the notification task can periodically inquire the event and the notification setting which need to be notified in the system and send the notification to corresponding personnel.

In the embodiment of the invention, a schematic diagram of an implementation process of the cloud platform event monitoring method is shown in fig. 3. The specific implementation process is as follows:

(1) event monitoring Client

The event monitoring Client is deployed on all hosts of the cloud platform and comprises API calling configuration and a command line script. The event monitoring Client can also be integrated into the functional module in a library-like manner.

(2) Event receiving module

And the event receiving module provides a data receiving API to the outside, processes the data according to the metadata and writes a processing result into the time sequence database. For a large-scale cloud platform, the event receiving modules need to be deployed in a distributed mode, and a load balancing tool can be added to the front end.

(3) Metadata of events

The event metadata may be stored in a configuration database or in a configuration file, and is used for receiving the configuration of event processing after the event. The method comprises the following steps: ID. Type, description, instance ID, repair advice, possible cause, impact, whether to suppress, alarm level, etc.

(4) Time sequence database

A time sequence database or a time sequence database cluster with good read-write performance needs to be adopted for the large-scale cloud platform, and meanwhile, data backup and recovery need to be considered. The time sequence database has extremely high consumption on system resources and needs to be deployed independently.

(5) Data processing module for suppressing notification

The processing module is used for processing the event data after the persistence, comprises all processing logics of the event monitoring system and is the core of the event monitoring system.

The embodiment of the invention comprises the steps of reporting an event by a functional module, uniformly configuring the event, and not adopting a message mechanism and alarm suppression.

The invention takes notes that:

a. the method is suitable for a large-scale cloud platform, but needs to perform distributed deployment on data storage, processing and the like and increase a load balancing tool for high-concurrency and high-throughput scenes.

b. The invention can not monitor the connectivity of the host, but the management module in the functional module can monitor the connectivity and access the event monitoring system.

As shown in fig. 4, an electronic device 800 according to an embodiment of the present invention includes a memory 801 and a processor 802, where the memory stores a computer program that is executable on the processor, and the processor executes the computer program to implement the steps of the method according to the above embodiment.

As shown in fig. 4, the electronic device further includes: a bus 803 and a communication interface 804, the processor 802, the communication interface 804, and the memory 801 being connected by the bus 803; the processor 802 is used to execute executable modules, such as computer programs, stored in the memory 801.

The Memory 801 may include a high-speed Random Access Memory (RAM), and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 804 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used.

The bus 803 may be an ISA bus, PCI bus, EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 4, but that does not indicate only one bus or one type of bus.

The memory 801 is used for storing a program, the processor 802 executes the program after receiving an execution instruction, and the method performed by the apparatus defined by the process disclosed in any of the foregoing embodiments of the present invention may be applied to the processor 802, or implemented by the processor 802.

The processor 802 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 802. The Processor 802 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 801, and the processor 802 reads the information in the memory 801 and completes the steps of the method in combination with the hardware thereof.

Corresponding to the method, the embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores machine executable instructions, and when the computer executable instructions are called and executed by a processor, the computer executable instructions cause the processor to execute the steps of the method.

The apparatus provided by the embodiment of the present invention may be specific hardware on the device, or software or firmware installed on the device, etc. The device provided by the embodiment of the present invention has the same implementation principle and technical effect as the method embodiments, and for the sake of brief description, reference may be made to the corresponding contents in the method embodiments without reference to the device embodiments. It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the foregoing systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

For another example, a division of elements into only one logical division may be implemented in a different manner, and multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments provided by the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus once an item is defined in one figure, it need not be further defined and explained in subsequent figures, and moreover, the terms "first", "second", "third", etc. are used merely to distinguish one description from another and are not to be construed as indicating or implying relative importance.

In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; and the modifications, changes or substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention. Are intended to be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A cloud platform event monitoring system, comprising: the system comprises an event monitoring system, at least one functional module and an event monitoring client which is deployed on the same host with the functional module; the function module is connected with the event monitoring system through the event monitoring client;

the function module is used for generating an event and sending an event monitoring request to the event monitoring client;

the event monitoring client is used for converting the event monitoring request into a corresponding REST API request and sending the REST API request to the event monitoring system;

2. The system of claim 1, wherein the processing comprises normalization processing; the event monitoring system is further configured to invoke event metadata, and perform normalization processing on the event based on the event metadata to obtain the processed event.

3. The system of claim 2,

the event monitoring system is further configured to determine whether the attribute of the processed event is an alarm, and if so, send a corresponding alarm notification to the event with the attribute being an alarm, and separate the event with the attribute being an alarm.

4. The system of claim 3,

the event monitoring system is also used for judging whether the event with the alarm attribute is an unnecessary alarm event; and if so, performing alarm suppression on the unnecessary alarm event.

5. The system of claim 1,

the event monitoring system is also used for displaying the event.

6. The system of claim 1,

the event monitoring system is also used for inquiring the characteristic information of the event; wherein the characteristic information comprises one or more of event occurrence time, affiliated function module, event type and event level.

7. The system of claim 1, wherein the time series database is an LSM Tree storage structure.

8. A cloud platform event monitoring method is applied to an event monitoring client and comprises the following steps:

after a functional module deployed on the same host computer with the event monitoring client generates an event, receiving an event monitoring request sent by the functional module;

9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program operable on the processor, and wherein the processor implements the steps of the method of claim 8 when executing the computer program.

10. A computer readable storage medium having stored thereon machine executable instructions which, when invoked and executed by a processor, cause the processor to execute the method of claim 8.