CN114785722A

CN114785722A - Monitoring data processing method and device and computer readable storage medium

Info

Publication number: CN114785722A
Application number: CN202210666149.8A
Authority: CN
Inventors: 陈立军; 陈涛; 钟楷锋
Original assignee: Wuhan Sitong Information Service Co ltd
Current assignee: Wuhan Barda Technology Co ltd
Priority date: 2022-06-14
Filing date: 2022-06-14
Publication date: 2022-07-22
Anticipated expiration: 2042-06-14
Also published as: CN114785722B

Abstract

The embodiment of the application discloses a monitoring data processing method and device and a computer readable storage medium. The method is applied to a monitoring data processing system, a collector and a first transmitter are deployed in the system, and the method comprises the following steps: the data change information of a target data table of a database is collected in a collector, the target data table stores monitoring data for a client server, the data change information is sent to a first transmitter, the first transmitter splices alarm notification information corresponding to the data change information, the importance degree corresponding to the data change information is determined according to the monitoring abnormity degree corresponding to the data change information, the monitoring service type and the client priority corresponding to the client server, and the alarm notification information is sent to a client terminal corresponding to the client server according to the importance degree. According to the embodiment of the application, the efficiency of monitoring data processing can be improved.

Description

Monitoring data processing method and device and computer readable storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a monitoring data processing method, apparatus, and computer-readable storage medium.

Background

In cloud services, processing of monitoring data in the cloud services is typically involved. The existing monitoring data processing is usually performed together with data monitoring (monitoring data is obtained by monitoring data), monitoring software is generally deployed on a server to be detected, and the monitoring software is software provided by a third party, so as to improve compatibility, functions of the monitoring software are usually complex and learning cost is high, and when the monitoring data processing is performed, some additional operations are usually performed, for example, a liunx command (knowledge in the liunx aspect needs to be mastered) needs to be input, and the efficiency of monitoring data processing is reduced.

Disclosure of Invention

The embodiment of the application provides a monitoring data processing method, a monitoring data processing device and a computer readable storage medium, which can automatically realize the processing of monitoring data and improve the efficiency of monitoring data processing.

The embodiment of the application provides a monitoring data processing method, which is applied to a monitoring data processing system, wherein the monitoring data processing system comprises a collector and a first transmitter, and the monitoring data processing method comprises the following steps:

collecting data change information of a target data table of a database through the collector, and sending the data change information to the first sender, wherein the monitoring data aiming at the client server are stored in the target data table;

the first transmitter monitors a message queue corresponding to the processed theme according to the processed theme and acquires the data change information from the corresponding message queue;

the first transmitter splices alarm notification information corresponding to the data change information according to the data change information;

determining the importance degree corresponding to the data change information according to the monitoring service type and the monitoring abnormity degree corresponding to the data change information and the client priority corresponding to the client server;

and the first transmitter transmits the alarm notification information corresponding to the data change information to the client terminal corresponding to the client server according to the importance degree.

The embodiment of the present application further provides a monitoring data processing apparatus, which is applied to a monitoring data processing system, the monitoring data processing apparatus includes a data acquisition module, a first sending module, a message acquisition module, a splicing module, a degree determination module, and a second sending module, wherein:

the data acquisition module is used for acquiring data change information of a target data table of the database through an acquisition device, and monitoring data for a client server are stored in the target data table;

the first sending module is used for sending the data change information to a first sender;

the message acquisition module is used for acquiring the data change information through a first transmitter;

the splicing module is used for splicing the alarm notification information corresponding to the data change information according to the data change information and storing the alarm notification information;

the degree determining module is used for determining the importance degree corresponding to the data change information according to the monitoring abnormal degree corresponding to the data change information, the monitoring service type and the client priority corresponding to the client server;

and the second sending module is used for sending the alarm notification information corresponding to the data change information to the client terminal corresponding to the client server according to the importance degree.

An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, where the computer program is suitable for being loaded by a processor to perform the steps in the monitoring data processing method according to any of the above embodiments.

An embodiment of the present application further provides a monitoring data processing system, where the monitoring data processing system includes a server, the server includes a memory and a processor, the memory stores a computer program, and the processor executes the steps in the monitoring data processing method according to any of the above embodiments by calling the computer program stored in the memory.

The monitoring data processing system comprises a collector and a first transmitter, data change information of a target data table of a database is collected through the collector, monitoring data aiming at a client server are stored in the target data table, the data change information is sent to the first transmitter, the first transmitter is used for splicing alarm notification information corresponding to the data change information, the importance degree corresponding to the data change information is determined according to the monitoring abnormity degree corresponding to the data change information, the monitoring service type and the client priority corresponding to the client server, and the first transmitter sends the alarm notification information to a client terminal corresponding to the client server according to the importance degree. In the embodiment of the application, monitoring software provided by a third party is not used, monitoring of data change information of monitoring data of different client servers, generation of alarm notification information corresponding to the data change information, determination of importance degree, sending of the alarm notification information and the like are automatically realized through the collector and the first transmitter, manual operation is not needed in the whole process, and the efficiency of monitoring data processing is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic view of an application scenario of a monitoring data processing method according to an embodiment of the present application.

Fig. 2 is a schematic view of another application scenario of the monitoring data processing method according to the embodiment of the present application.

Fig. 3 is a schematic view of another application scenario of the monitoring data processing method according to the embodiment of the present application.

Fig. 4 is a schematic flowchart of a monitoring data processing method according to an embodiment of the present application.

Fig. 5 is a schematic flow chart of a monitoring data processing method according to an embodiment of the present disclosure.

Fig. 6 is a sub-flow schematic diagram of a monitoring data processing method according to an embodiment of the present application.

Fig. 7 is another schematic flow chart of a monitoring data processing method according to an embodiment of the present application.

Fig. 8 is a schematic structural diagram of a monitoring data processing apparatus according to an embodiment of the present application.

Fig. 9 is another schematic structural diagram of a monitoring data processing apparatus according to an embodiment of the present application.

Fig. 10 is a schematic structural diagram of a monitoring data processing apparatus according to an embodiment of the present application.

Fig. 11 is a schematic structural diagram of a monitoring data processing system according to an embodiment of the present application.

Fig. 12 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a monitoring data processing method, a monitoring data processing device, a computer readable storage medium and a monitoring data processing system. Specifically, the monitoring data processing method according to the embodiment of the present application may be run in a monitoring data processing system, where a collector and a first transmitter are deployed in the monitoring data processing system.

As shown in fig. 1, an application scenario diagram of the monitoring data processing method provided in the embodiment of the present application is shown, where the application scenario includes a client server, a monitoring data processing system, and a client terminal. The monitoring data processing system comprises a first server, and the client server is in communication connection with the first server, the first server and the client terminal through a network.

The first server comprises/is provided with a collector and a first transmitter, and the first server also comprises a database for storing monitoring data of the client server, such as a MySql database, an Oracle database and the like. The collector comprises a collector 1, a collector 2, a collector 3 and a collector 4, and correspondingly, the first transmitter comprises a first transmitter 1, a first transmitter 2, a first transmitter 3 and a first transmitter 4.

In the application scenario shown in fig. 1, the monitoring data processing method is executed by a first server, where the first server may be an independent physical server, may also be a server cluster or a distributed system formed by multiple physical servers, and may also be a cloud server that provides basic cloud computing services such as cloud service, a cloud database, cloud computing, cloud functions, cloud storage, network service, cloud communication, middleware service, domain name service, security service, CDN, and big data and artificial intelligence platform.

The client server, such as the easy-to-prepare server, the easy-to-cloud server and the like in fig. 1, may also be a server in different environments, for example, a server in a production environment, a server in a test environment and the like. The client server is a server purchased/rented by the client, a monitoring program is operated on the server, and the monitoring program can monitor data in the client server, for example, data such as a CPU (central processing unit), a memory and the like of the client server, monitor the data in the client server to obtain monitoring data, and store the monitoring data in a corresponding database in the first server.

And the collector in the first server collects the data change information of the target data table in the database and sends the data change information to the first transmitter.

For example, the data change information is sent to a message queue in the first server, for example, sent to a message queue corresponding to the topic in the first server through a corresponding topic, where a message queue corresponding to the topic may also be created in the first server.

A first transmitter in the first server acquires the data change information and performs a series of processing on the data change information. For example, a first transmitter in the first server obtains data change information from a message queue of a corresponding topic, and performs a series of processing on the data change information.

For example, a series of processing includes splicing alarm notification information according to the data change information, storing the alarm notification information in a database, determining an importance degree according to a monitoring abnormality degree corresponding to the data change information, a monitoring service type and a client priority corresponding to a client server, filtering the data change information according to the importance degree, performing convergence processing on the filtered alarm notification information, and the like, and after a series of processing, sending the alarm notification information corresponding to the data change information to a client terminal to notify the client of knowing corresponding monitoring data on the corresponding client server, so that the client can know the condition of the client server and make a corresponding decision.

In other embodiments, the number of collectors may also be greater, and the number of first transmitters may be fewer/greater, where one collector may correspond to one or more first transmitters.

Fig. 2 is a schematic application scenario diagram of a monitoring data processing method provided in an embodiment of the present application. In fig. 2, the monitoring data processing system includes a first server and a second server, where the first server is deployed with a collector, such as collector 1, collector 2, collector 3, etc., the first server also includes a database, such as MySql database, Oracle database, etc., and the second server is deployed with a first message server, a first transmitter, and another database, such as a distributed database MongoDB. The client server is in communication connection with the first server, the first server and the second server, and the second server and the client terminal through a network.

Specifically, the monitoring data processing method is executed by a first server and a second server together, where the first server and/or the second server may be an independent physical server, may also be a server cluster or a distributed system formed by multiple physical servers, and may also be a cloud server that can provide cloud services.

After the client server obtains the monitoring data and stores the monitoring data in a corresponding database in the first server, a collector in the first server collects data change information of a target data table in the database and sends the data change information to a message queue in a first message server of the second server through a corresponding theme. The first transmitter in the second server obtains the data change information from the message queue corresponding to the topic, and performs a series of processing on the data change information, for example, splicing the alarm notification information according to the data change information, storing the alarm notification information in a database MongoDB, determining an importance level according to a monitoring abnormality level corresponding to the data change information, a monitoring service type and a client priority corresponding to the client server, filtering the data change information according to the importance level, performing convergence processing on the filtered alarm notification information, and the like, and after performing a series of processing, transmitting the alarm notification information corresponding to the data change information to the client terminal to notify the client of knowing the corresponding monitoring data on the corresponding client server, so that the client can know the condition of the client server and make a corresponding decision.

In the embodiment shown in fig. 2, the collector and the first transmitter are respectively deployed in different servers, so as to implement collection of data change information of monitoring data in different servers, and process the collected data change information, thereby reducing the load of the first server.

Fig. 3 is a schematic view of another application scenario of the monitoring data processing method according to the embodiment of the present application. In this embodiment, a third server is newly added, in which a second message server, a second transmitter and a further database, such as a distributed database, mongoDB, etc., are deployed.

Correspondingly, the first transmitter may be configured to perform a first process on the data change information, for example, splice out alarm notification information according to the data change information, store the alarm notification information in the database MongoDB, determine an importance level according to a monitoring abnormality level corresponding to the data change information, a monitoring service type, and a client priority level corresponding to the client server, filter the data change information according to the importance level, send the alarm notification information corresponding to the filtered data change elimination information to a corresponding message queue of a second message server in a third server according to a theme, and the like, the second transmitter is configured to perform a second process on the alarm notification information, for example, obtain the alarm notification information from the corresponding message queue of the second message server, perform a convergence process on the alarm notification information, and the like, store the alarm notification information after the convergence process in the distributed database MongoDB database, and sent to the client terminal.

In fig. 3, there are two different message servers, a first message server is deployed in the second server for receiving data change information transmitted from the transmitter, and a second message server is deployed in the third server for receiving alarm notification information transmitted from the first transmitter. In fig. 3, the collector corresponds to a message producer and the first sender corresponds to a message consumer with respect to the second server, while the first sender corresponds to a message producer and the second sender corresponds to a message consumer with respect to the third server. In fig. 3, the load problem of the second server is considered, and all functions completed by the second server in the embodiment shown in fig. 2 are distributed to the second server and the third server shown in fig. 3, so that the stability of the monitoring data processing system is improved, and the efficiency of monitoring data processing is improved.

In the embodiments shown in fig. 1 to fig. 3, the client server, the first server, the second server, and the third server in the corresponding figures are independent servers, or may be a server cluster. While in fig. 2 and 3 the first message server and the first sender are deployed on a second server, in other embodiments the first message server may be deployed using a separate server/server cluster and the first sender may be deployed using another separate server/server cluster. It should be noted that the first message server may not be deployed in fig. 1, but only the message queue corresponding to the topic is used. In fig. 2 and 3, the number of the first transmitters is one, but in other embodiments, the number of the first transmitters may be plural.

While in fig. 3 the second message server and the second sender are deployed on a third server, in other embodiments the second message server may be deployed using a separate server/server cluster and the second sender may be deployed using another separate server/server cluster. In other embodiments, the number of the second transmitters may also be plural. In other embodiments, the first message server and/or the second message server, etc. may not be deployed.

In practical use, generally in order to reduce the load of the first server, the application scenario shown in fig. 1 is less used, and generally the application scenarios shown in fig. 2 and 3. The monitoring data processing method in the embodiment of the present application will be described in detail below with reference to the application scenarios shown in fig. 1, fig. 2, and fig. 3, respectively.

A monitoring data processing method, a monitoring data processing apparatus, a computer readable storage medium, and a computer device provided in embodiments of the present application will be described in detail below. The numbers in the following examples are not intended to limit the order of preference of the examples.

Fig. 4 is a schematic flowchart of a monitoring data processing method according to an embodiment of the present application, and the monitoring data processing method includes the following steps, which should be understood with reference to fig. 1.

101, a collector collects data change information of a target data table of a database, wherein the target data table stores monitoring data for a client server.

The client server runs a monitoring program, and the monitoring program can monitor data in the client server, for example, the client server has a timing task, and the timing task can periodically/regularly execute and detect the use conditions of the CPU and the memory of the client server, so as to monitor the use conditions of the CPU and the memory of the client server, for example, whether the service running on the client server is stable or not is monitored, and the monitoring data is obtained after the data in the client server is monitored, and is stored in a corresponding database in the first server.

For example, if the database corresponding to the client server is an Oracle database, the database is stored in the Oracle database in the first server, and if the database corresponding to the client server is a MySql database, the database is stored in the MySql database. The monitoring data in the client server can be stored in one database or a plurality of databases according to the corresponding scene requirements. The database in the first server may also be other types of databases, and is not particularly limited herein.

Before step 101, the monitoring data processing method further includes deploying a collector in the first server, where deploying the collector may be to install/copy a data packet corresponding to the collector to the first server, where the data packet may be a jar data packet or another type of data packet. It should be noted that in the embodiment of the present application, monitoring data can be acquired only by installing/copying the data packet corresponding to the collector.

After the collector is deployed, in an embodiment, the configuration file in the collector may also be modified, such as modifying the related information of the client server, modifying the connection mode of the connection database, modifying the monitored data table, and modifying the service address of the first message server. And if the configuration file does not need to be modified, directly starting the collector.

And after the collector is started, acquiring a configuration file in the collector, and reading the content in the configuration file. The configuration file is configured with a connection mode for connecting the database, and information related to the client server, such as service identification information and service type of the client server, which data tables in the monitoring database, the service address of the first message server, and the like.

The connection modes include connection IP and/or connection interface, and the connection modes corresponding to different databases are different, for example, the connection modes corresponding to the Oracle database and the MySql database are different. The service identification information of the client server comprises information such as an IP address corresponding to the client server, and the service type of the client server comprises a file server, a virtual machine server, a database server and the like. The data table to be monitored in the database of the first server is used as a target data table, and for different client servers, the corresponding data tables in the database are different, so that the target data tables to be monitored are different. The server address of the first message server includes information such as an IP address of the first message server that can identify the first message server.

The first message Server may be a Server corresponding to a rocktmq, the Server corresponding to the rockmq includes a Name Server, a Broker, and the like, and the data change message is stored in a message queue corresponding to a topic in the Broker. In the embodiment of the application, the Name Server and the Broker are deployed in the same Server, and in some embodiments, the Name Server and the Broker may be deployed in different servers.

After the collector is started, the collector obtains the connection mode of the connection databases in the configuration file, the collector is connected with the corresponding databases in the connection mode, and automatically creates a database monitoring plug-in for a target data table needing to be monitored in the database in the configuration file, wherein one database can correspond to one database monitoring plug-in, the database monitoring plug-in can monitor all target data tables needing to be monitored in the database, and the target data tables can comprise different data tables corresponding to different client servers.

Correspondingly, step 101 comprises: determining a database monitoring plug-in matched with the database type; and monitoring the data change information of the plug-in by using the database.

The monitoring plug-ins corresponding to different databases are different, the monitoring mode adopted in the database monitoring plug-in needs to be matched with the type of the database, for example, for Oracle data, a java-compatible monitoring technology is adopted, and for the MySql database, adding, deleting, modifying and the like of a monitoring target data table are carried out by monitoring binlog of the MySql.

And monitoring the configured data change information of the target data table of the database through the database monitoring plug-in, wherein the data change information comprises the addition, deletion, modification and check of the target data table and the like. Taking add (insert) as an example, and taking insert as an example hereinafter, when the monitoring data is detected to be inserted into the target data table, the inserted monitoring data is taken as data change information, that is, the data change information is the monitoring data that is changed by add and delete, such as the monitoring data that is newly added this time.

After the service identification information and the service type of the client server in the configuration file are obtained, the service identification information and the service type are sent to the first sender so as to register the client server with the first sender, so that the first sender is informed that data change information of the client server corresponding to the service identification information and the service type needs to be processed, and corresponding alarm notification information needs to be sent to the client terminal so as to inform the client terminal. It is understood that not all clients, and not every client server of every client, need to send the alarm notification information corresponding to the data change information to the client terminal for notification, and only the data change information of these registered client servers need to be notified.

102, sending the data change information to a first transmitter.

After acquiring the data change information, the collector sends the acquired data change information to the first transmitter.

The first transmitter may also send the data change information to a message queue, and the first transmitter acquires each piece of data change information from the message queue to send the data change information to the first transmitter.

It may also be the case as shown in step 202 in fig. 5, and please refer to the following description for details, which is not described herein again.

103, acquiring the data change information through the first transmitter, and splicing the alarm notification information corresponding to the data change information.

And the first transmitter acquires the transmitted data change information and splices alarm notification information corresponding to the data change information.

And the first transmitter acquires the data change information from the message queue and splices alarm notification information corresponding to the data change information.

In addition, the data change information may be obtained as shown in step 203, and then the alarm notification information corresponding to the data change information is obtained by splicing. Please refer to the following descriptions, which are not repeated herein.

The data change information includes a plurality of digital segments corresponding to the target data table because of the newly added inserted monitoring data, wherein, for example, the alarm time can be determined according to the insertion time specifically inserted into the target data table. In one embodiment, the data change information includes service identification information of the client server, service type of the client server, message type, message content, target data table, change time, and the like. The message type may be CPU usage, memory usage, or the like.

For example, the data change information includes service identification information of the client server, such as an IP of the client server, a service type of the client server, such as a database server, a message type, such as a CPU usage rate, a message content, such as a CPU usage rate of 95%, a target data table, such as a CPU data table, change time, such as xxxx year xx month xx day, and the like. The alarm notification information corresponding to the data change information may be spliced according to the content of the change time, the content of the service identification information, the content of the service type, the content of the message type, the message content, and the like, for example, the spliced alarm notification information may be: in xxxx year xx month xx day, CPU usage in a database server with IP xxx. For another example, in xxxx year xx month xx day, it is monitored that a file is deleted in a file server with IP xxx. In xxxx year xx month xx day, success in backup of a database in a database server having an IP of xxx. The specific splicing manner is different according to different application scenarios, and the examples herein are only for illustration and are not limiting.

The data change information comprises a plurality of different fields and field contents corresponding to the different fields, and the data change information is directly sent to the client terminal, so that a user of the client terminal cannot possibly know what specific contents are, therefore, the data change information is translated in a splicing mode, spliced alarm notification information is popular and easy to understand, and user experience is improved.

And after the alarm notification information corresponding to the data change information is obtained, storing the alarm notification information into a database corresponding to the first server.

And 104, determining the importance degree corresponding to the data change information according to the monitoring service type and the monitoring abnormity degree corresponding to the data change information and the client priority corresponding to the client server.

Firstly, determining a monitoring service type and a monitoring abnormal degree corresponding to the data change information and a client priority corresponding to the client server, and then determining an importance degree corresponding to the data change information according to the client priority, the monitoring service type and the monitoring abnormal degree.

The client priority may be determined based on the service identification information and the service type of the client server. The priorities for different service types are different, for example, the priorities of the database server and the file server are different.

The monitoring traffic type may be further determined based on the message type. Understandably, the monitoring service types concerned by different clients are different, for example, a client pays more attention to data security, correspondingly, the monitoring service types include database backup, database recovery and the like, and b client pays more attention to user experience, correspondingly, CPU utilization rate, memory utilization rate and the like.

The degree of monitoring anomaly may be determined based on the message content. For example, the message content includes the CPU usage rate, and the degree of abnormality of the CPU usage rate of 95% is greater than the degree of abnormality of the CPU usage rate of 80%.

In other embodiments, different other ways may be used to determine customer priority, monitor traffic type, monitor anomaly level, and the like.

After the client priority, the monitoring service type and the monitoring abnormal degree are determined, in one embodiment, the importance degree corresponding to the data change information is determined according to the client priority, the importance degree corresponding to the data change information is determined according to the monitoring service type under the condition that the client priorities are the same, and the importance degree corresponding to the data table update information is determined according to the monitoring abnormal degree under the condition that the monitoring service types are the same, so that the importance degree corresponding to the data change information is determined according to the client priority, the monitoring service type and the monitoring abnormal degree. For example, the weights corresponding to different customer priorities may be 1 and 0.8, respectively, and for both of them being 1, the weights corresponding to the corresponding monitoring service types are 0.6 and 0.5, and the calculated importance degrees are 1 × 0.6, 1 × 0.5, and so on. In this embodiment, customer priority is considered most important, monitoring traffic type is secondary, and monitoring anomaly level is least important.

In an embodiment, different scores corresponding to different customer priorities, different scores corresponding to different monitoring service types, and different scores corresponding to different monitoring abnormal degrees may be set. Thus, a first score corresponding to the client priority is determined according to the determined client priority, a second score corresponding to the monitoring service type is determined according to the determined monitoring service type, a third score corresponding to the monitoring abnormal degree is determined according to the determined monitoring abnormal degree, the first score, the second score and the third score are subjected to weighted summation, and the result of the weighted summation is used as the important degree corresponding to the data change information, so that the important degree corresponding to the data change information is determined according to the client priority, the monitoring service type and the monitoring abnormal degree. In this embodiment, the importance levels of the customer priority, the monitoring traffic type, and the monitoring abnormality level may be determined according to the magnitude of the weighting coefficient.

In other embodiments, other manners may be used to determine the importance level corresponding to the data change information.

And 105, sending the alarm notification information corresponding to the data change information to the client terminal corresponding to the client server according to the importance degree.

In one case, all the data change information in the current message queue is sorted according to the importance degree, and then the alarm notification information corresponding to the data change information is sent to the client terminal corresponding to the client server according to the sorting result.

In one case, the alarm notification information corresponding to the data change information may be filtered according to the importance degree, and the filtered alarm notification information may be sent to the client terminal corresponding to the client server. For example, whether the importance degree is greater than a preset weight is detected, the preset weight may be set in advance, for example, to 0.5, if the importance degree is not greater than the preset weight, the alarm notification information corresponding to the data change information is filtered, otherwise, if the importance degree is greater than the preset weight, the alarm notification information corresponding to the data change information is sent to the client terminal corresponding to the client server. And taking the alarm notification information with the importance degree greater than the preset weight as the alarm notification information after filtering processing.

And on one hand, the subsequent processing amount can be reduced, the processing speed is improved, and on the other hand, the influence of unimportant alarm information on a client can be reduced, and the user experience is improved.

In one case, as shown in step 206, please refer to the following description, which is not repeated herein.

As shown in fig. 5, fig. 5 is a schematic flow chart of a monitoring data processing method provided in an embodiment of the present application, where the monitoring data processing method includes the following steps, please refer to fig. 2 for understanding.

And 201, acquiring data change information of a target data table of the database through an acquisition unit, wherein the target data table stores monitoring data aiming at a client server.

The details of this step are described above with reference to the corresponding steps, and differences from the above-described embodiments are explained here.

After the service identification information and the service type of the client server in the configuration file are obtained, the service identification information and the service type are sent to the second server so as to register the client server with the second server to inform the second server that data change information of the client server corresponding to the service identification information and the service type needs to be processed, and corresponding alarm notification information needs to be sent to the client terminal so as to inform the client terminal. It is understood that not all clients, and not every client server of every client, need to send the alarm notification information corresponding to the data change information to the client terminal for notification, and only the data change information of these registered client servers need to be notified.

And 202, sending the data change information to a message queue corresponding to the theme according to the theme corresponding to the data change information.

Firstly, determining a theme corresponding to the data change information, and then sending the data change information to a message queue corresponding to the theme.

The data change information includes a multi-digit segment corresponding to the target data table, where the data change information may be determined according to the insertion time specifically inserted into the target data table, for example, the alarm time. In one embodiment, the data change information includes service identification information of the client server, service type of the client server, message type, message content, target data table, change time, and the like. The message type may be CPU usage, memory usage, or the like. It is to be understood that, in the client server, monitoring is performed for different message types during monitoring, and therefore, the message type is included in the data change information.

The topic corresponding to the data change message may be determined according to the message type in the data change message. One message type may correspond to one theme, and multiple message types may correspond to one theme, which is specifically determined according to an application scenario.

After the theme of the data change information is determined, the configured service address of the first message server is obtained, the data change information is sent to the first message server through the service address according to the theme corresponding to the data change information, and the first message server stores the data change information to a message queue corresponding to the theme according to the theme. The service address of the first message server may be configured in a configuration file of the collector, and the corresponding service address is obtained from the configuration file, where the service address may be information such as an IP of the first message server.

In the first message server, message queues corresponding to different topics may be set according to different topics, for example, one topic corresponds to one message queue, which is taken as an example in the embodiment of the present application for description; it should be noted that, a plurality of subjects may correspond to one message queue, or one subject may correspond to a plurality of message queues, etc. And if one theme corresponds to a plurality of message queues, storing the data change information into one message queue with the least message quantity in the plurality of message queues under the condition.

When one theme corresponds to one message queue, correspondingly, the data change information corresponding to the CPU utilization rate is sent to the message queue corresponding to the CPU utilization rate, and the data change information corresponding to the memory utilization rate is sent to the message queue corresponding to the memory utilization rate.

The data change information acquired by the collector is stored according to the topics through the message queues corresponding to different topics of the first message server, on one hand, the data change information is stored according to the topics, and the data change information is subject-classified, so that each first transmitter can only process the data change information of the corresponding topic, and the processing efficiency and stability of the first transmitters are improved; meanwhile, the data change information is stored by using the message queue, so that the problem that the data change information acquired by the acquisition unit is lost due to long-time unprocessed data change information is solved, in addition, the asynchronous processing of the data change information in the message queue can be realized by using the message queue, and the stability of the monitoring data processing system is improved by adopting an asynchronous mode. In the process of automatically realizing the acquisition and sending of the monitoring data, the data change information is stored and processed in an asynchronous mode through the message queues corresponding to different subjects, the data change information is prevented from being lost, and the stability of the monitoring data processing system is improved.

And 203, monitoring a message queue corresponding to the processed subject according to the processed subject by the first transmitter, and acquiring data change information from the corresponding message queue.

Each first transmitter has a theme which can be processed by the first transmitter, and the theme which can be processed by the first transmitter can be set in advance or adopt default setting. And the first transmitter monitors the message queue corresponding to the processed subject, and acquires the data change information from the corresponding message queue when the message queue corresponding to the processed subject contains the data change information.

And 204, splicing alarm notification information corresponding to the data change information according to the data change information.

205, determining the importance level corresponding to the data change information according to the monitoring service type and the monitoring abnormal level corresponding to the data change information and the client priority corresponding to the client server.

And 206, sending the alarm notification information corresponding to the data change information to the client terminal corresponding to the client server according to the importance degree.

In one case, step 206 may include 2061 to 2063, as shown in FIG. 6.

2061, the alarm notification information corresponding to the data change information is filtered according to the importance degree. For details of the filtering process, please refer to the above description, and further description is omitted here.

2062, convergence processing is performed to the alarm notification information after the filtering processing.

And acquiring the sending period strategy of the monitoring data of all the client servers corresponding to all the service identification information and the service types. The second server stores in advance transmission cycle policies for monitoring data of the client server, and these transmission cycle policies are used for convergence processing of the alarm notification information.

The sending period policy includes, but is not limited to, a high-level policy, a zero policy, a period merging policy, a period first-time policy, and the like. A high-level policy, which means that the alarm notification information is sent to the corresponding client terminal as long as the alarm notification information is received; a zero strategy, only the alarm notification information is stored in a database, and other information is not processed; the periodic merging strategy means that high-alarm notification information is sent to a corresponding client terminal in a period of time; the periodic transceiving strategy means that only the first piece of alarm notification information is sent to the corresponding client terminal in one period time.

And after the sending period strategy is obtained, carrying out convergence processing on the alarm notification information after the filtering processing according to the sending period strategy. Specifically, the corresponding alarm notification information is classified according to a sending period policy, and then the classification results are classified according to different clients, wherein one client may include one or more client servers, and the classification results of different clients are processed according to the period time of the sending period policy, for example, whether the alarm notification information in the classification results reaches one period time is checked, if the alarm notification information in the classification results reaches one period time, the alarm notification information may be sent, and if the alarm notification information in the classification results does not reach one period time, the alarm notification information waits for reaching one period time. Understandably, the alarm notification information belonging to the same client in the same sending period strategy is processed according to the period time in the sending period strategy, if the period time reaches one period time, the alarm notification information is sent, otherwise, the alarm notification information waits for reaching one period time.

In the embodiment, the alarm notification information is further controlled and processed through the sending period strategy, on one hand, the sending period of the alarm notification information is further controlled according to the period time of the sending period strategy, adverse effects on users caused by too frequent high-grade notification information are avoided, user experience is improved, meanwhile, a large amount of occupation of second server resources caused by real-time sending of each alarm notification information is also avoided, on the other hand, unified processing and filtering processing are further performed, and efficiency is improved.

2063, sending the alarm notice information after convergence processing to the client terminal corresponding to the client server.

And storing the alarm modes of the client terminals corresponding to the client servers in the second server, acquiring the alarm modes of the client terminals corresponding to the client servers, and sending the alarm notification information after convergence processing to the client terminals corresponding to the client servers through the corresponding alarm modes. The alarm mode includes but is not limited to at least one of mail, telephone, short message, WeChat and web page.

When the alarm notification information after the convergence processing is sent, the alarm notification information after the convergence processing needs to be stored in a database in the second server.

It should be noted that, the above steps 201 to 202 are executed in the first server, specifically, executed by the collector in the first server, and the steps 203 to 206 are executed in the second server, specifically, executed by the first transmitter in the second server. In this embodiment, please refer to the above description for the steps not described in detail, which will not be described herein.

In the above embodiment, different monitoring data (different data change information) corresponding to different client servers of different clients can be processed, different data change information corresponding to different client servers of different clients is filtered, then convergence processing is performed according to a sending period policy, and finally the alarm notification information after the convergence processing is sent to the client terminal, so that the client terminal can know the relevant information of the monitoring data in the client server. The embodiment of the application has wide applicability, is suitable for a large monitoring data processing system, and can also be suitable for a small monitoring data processing system.

Fig. 7 is another schematic flow chart of a monitoring data processing method according to an embodiment of the present application, where the monitoring data processing method includes the following steps, please refer to fig. 3 for understanding.

301, the data change information of the target data table of the database is collected by the collector, and the monitoring data for the client server is stored in the target data table.

After the collector obtains the service identification information and the service type of the client server in the configuration file, the service identification information and the service type are sent to the second server, the second server sends the service identification information and the service type to the third server, so that the client server is registered in the third server to inform the third server, and only the data change information of the registered client server needs to be notified.

And 302, sending the data change information to a message queue corresponding to the theme according to the theme corresponding to the data change information.

And determining a theme corresponding to the data change information, and sending the data change information to a message queue corresponding to the theme. The theme corresponding to the data change message can be determined according to the message type in the data change message.

After the theme of the data change information is determined, the configured service address of the first message server is obtained, the data change information is sent to the first message server through the service address according to the theme corresponding to the data change information, and the first message server stores the data change information to a message queue corresponding to the theme according to the theme. Wherein the first message server and the first transmitter are deployed in a second server.

The steps 301 to 302 are executed in the first server, and are specifically executed by the collector in the first server.

303, the first transmitter monitors the message queue corresponding to the processed subject according to the processed subject, and acquires the data change information from the corresponding message queue.

And 304, splicing alarm notification information corresponding to the data change information according to the data change information.

And 305, determining the importance degree corresponding to the data change information according to the monitoring service type and the monitoring abnormity degree corresponding to the data change information and the client priority corresponding to the client server.

And 306, filtering the alarm notification information corresponding to the data change information according to the importance degree.

For the steps not described in detail in this embodiment and the beneficial effects achieved by the corresponding steps, please refer to the description of the corresponding steps above, which is not described herein again.

307, sending the alarm notification information after the filtering processing to a message queue corresponding to the theme of the alarm notification information.

The theme of the alarm notification information is the same as the theme of the data change information corresponding to the alarm notification information, and can be directly used as the theme of the alarm notification information according to the theme of the data change information. And then acquiring a service address of a second message server, sending the alarm notification information to the second message server according to the theme, and storing the alarm notification information to a message queue corresponding to the theme by the second message server according to the theme. The service address of the second message server may be information such as an IP of the second message server.

Wherein, the second server may be a message queue corresponding to a topic, which is described in the embodiment of the present application as an example; it should be noted that, a plurality of subjects may correspond to one message queue, or one subject may correspond to a plurality of message queues, etc.

Steps 303 to 307 are executed in the second server, specifically executed by the first transmitter in the second server.

308, the second sender monitors the message queue corresponding to the processed subject according to the processed subject and obtains the alarm notification information from the corresponding message queue.

Each second transmitter has a theme which can be processed by the second transmitter, and the theme which can be processed by the second transmitter can be set in advance or adopt default setting. And the second transmitter monitors the message queue corresponding to the processed subject, and acquires the data change information from the corresponding message queue when the message queue corresponding to the processed subject contains the data change information.

309, convergence processing is performed on the alarm notification information.

The third server stores in advance transmission cycle policies of the monitoring data of the client server, and these transmission cycle policies are used for convergence processing of the alarm notification information. Specifically, the second transmitter acquires the transmission cycle policy, and performs convergence processing on the corresponding alarm notification information according to the transmission cycle policy. The specific transmission cycle strategy and the method of convergence processing of the processing can be referred to the corresponding description above.

And 310, sending the alarm notification information after the convergence processing to the client terminal corresponding to the client server.

And storing the alarm mode of the client terminal corresponding to the client server in the third server, acquiring the alarm mode of the client terminal corresponding to the client server, and sending the alarm notification information after convergence processing to the client terminal corresponding to the client server through the corresponding alarm mode. When the alarm notification information after the convergence processing is sent, the alarm notification information after the convergence processing needs to be stored in a database in the third server.

Wherein steps 308 to 310 are run in the third server, in particular, are performed by the second transmitter in the third server.

All the above technical solutions can be combined arbitrarily to form the optional embodiments of the present application, and are not described herein again.

In order to better implement the monitoring data processing method according to the embodiment of the present application, an embodiment of the present application further provides a monitoring data processing apparatus, where the monitoring data processing apparatus is applied to a monitoring data processing system. Please refer to fig. 8, fig. 8 is a schematic structural diagram of a monitoring data processing apparatus according to an embodiment of the present application. The monitoring data processing apparatus may include a data acquisition module 401, a first sending module 402, a message acquisition module 403, a concatenation module 404, a degree determination module 405, and a second sending module 406.

The data acquisition module 401 is configured to acquire, through the acquisition unit, data change information of a target data table of the database, where monitoring data for the client server is stored in the target data table.

In an embodiment, the data acquisition module 401 is specifically configured to determine a database monitoring plug-in that matches a database type; and monitoring the data change information of the plug-in by using the database.

A first sending module 402, configured to send the obtained data change information to a first sender.

In an embodiment, the first sending module 402 is specifically configured to send the data change information to a message queue.

In an embodiment, the first sending module 402 is specifically configured to determine a theme corresponding to the data change information; the collector obtains the configured service address of the first message server; and sending the data change information to a message queue corresponding to the theme in the first message server through the service address according to the theme corresponding to the data change information.

A message obtaining module 403, configured to obtain the sent data change information.

In an embodiment, the message obtaining module 403 is specifically configured to obtain the data change information from the message queue.

In an embodiment, the message obtaining module 403 is specifically configured to monitor a message queue corresponding to the processed topic according to the processed topic, and obtain the data change information from the corresponding message queue.

And a splicing module 404, configured to splice the alarm notification information corresponding to the data change information according to the data change information, and store the alarm notification information.

A degree determining module 405, configured to determine an importance degree corresponding to the data change information according to the monitoring exception degree corresponding to the data change information, the monitoring service type, and the client priority corresponding to the client server.

In an embodiment, the degree determining module 405 is specifically configured to determine a monitoring abnormal degree corresponding to the data change information, a monitoring service type, and a client priority corresponding to the client server; and determining the importance degree corresponding to the data change information according to the client priority, the monitoring service type and the monitoring abnormity degree.

In an embodiment, when the step of determining the monitoring abnormality degree corresponding to the data change information, the monitoring service type, and the client priority corresponding to the client server is executed, the degree determining module 405 specifically executes: determining the priority of the client according to the service identification information and the service type; determining the monitoring service type according to the message type; and determining the monitoring abnormity degree according to the message content.

In an embodiment, when the step of determining the importance degree corresponding to the data change information according to the client priority, the monitoring service type, and the monitoring abnormality degree is executed by the degree determining module 405, the method specifically executes: determining a first score corresponding to the client priority according to the determined client priority, determining a second score corresponding to the monitoring service type according to the determined monitoring service type, determining a third score corresponding to the monitoring abnormal degree according to the determined monitoring abnormal degree, performing weighted summation on the first score, the second score and the third score, and taking the result of the weighted summation as the important degree corresponding to the data change information.

A second sending module 406, configured to send the alarm notification information corresponding to the data change information to the client terminal corresponding to the client server according to the importance degree.

The monitoring data processing system comprises a collector and a first transmitter, wherein the data acquisition module 401 and the first transmission module 402 are integrated in the collector, and the message acquisition module 403, the splicing module 404, the degree determination module 405 and the second transmission module 406 are integrated in the first transmitter.

In an embodiment, the collector and the first transmitter are disposed on a first server of the monitoring data processing system, and understandably, the first server includes the data collecting module 401, the first sending module 402, the message obtaining module 403, the splicing module 404, the degree determining module 405, and the second sending module 406.

In an embodiment, the collector is disposed on a first server of the monitoring data processing system, and the first transmitter is disposed on a second server of the monitoring data processing system, and understandably, the first server includes the data collecting module 401 and the first sending module 402, and the second server includes the message obtaining module 403, the splicing module 404, the degree determining module 405, and the second sending module 406.

In an embodiment, as shown in fig. 9, the monitoring data processing apparatus further includes a preprocessing module 407, where the preprocessing module 407 is configured to obtain a connection manner for connecting a database from a configuration file of the collector after the collector is started, and connect the corresponding database through the connection manner; and/or creating a database monitoring plug-in for the target data table needing monitoring in the database in the configuration file; and/or acquiring the service identification information of the client server and the service type of the client server from the configuration file of the collector, and registering the client server with the second server. The pre-processing module 407 is integrated in the first server.

In an embodiment, as shown in fig. 9, the monitoring data processing apparatus further includes a filtering module 408, the filtering module 408 is configured to perform filtering processing on the alarm notification information corresponding to the data change information according to the importance degree, and the second sending module 406 is further configured to send the filtered alarm notification information to a client terminal corresponding to the client server.

In an embodiment, as shown in fig. 9, the monitoring data processing apparatus further includes a convergence processing module 409, where the convergence processing module 409 is configured to perform convergence processing on the alarm notification information after the filtering processing. A second sending module 406, configured to send the alarm notification information after the convergence processing to a client terminal corresponding to the client server.

In an embodiment, the convergence processing module 409 is specifically configured to obtain all the service identification information and the sending period policy of the monitoring data of the client server corresponding to the service type; and for the alarm notification information after the filtering processing, carrying out convergence processing on the alarm notification information through the sending period strategy.

In the embodiment shown in fig. 9, the preprocessing module 407, the data collecting module 401, and the first sending module 402 may be integrated into a collector, and the message obtaining module 403, the splicing module 404, the extent determining module 405, the second sending module 406, the filtering module 408, and the convergence processing module 409 may be integrated into a first sender.

In an embodiment, the collector and the first transmitter are disposed on a first server of the monitoring data processing system, and understandably, the first server includes the data collection module 401, the first sending module 402, the message obtaining module 403, the splicing module 404, the degree determination module 405, the second sending module 406, the preprocessing module 407, the filtering module 408, and the convergence processing module 409.

In an embodiment, the collector is disposed on a first server of the monitoring data processing system, and the first transmitter is disposed on a second server of the monitoring data processing system, and understandably, the first server includes the preprocessing module 407, the data collecting module 401, and the first sending module 402, and the second server includes the message obtaining module 403, the splicing module 404, the extent determining module 405, the second sending module 406, the filtering module 408, and the convergence processing module 409.

In an embodiment, as shown in fig. 10, the monitoring data processing apparatus includes a data collecting module 401, a first sending module 402, a message obtaining module 403, a splicing module 404, a degree determining module 405, a second sending module 406, a preprocessing module 407, a filtering module 408, a convergence processing module 409, an alarm obtaining module 410, and a third sending module 411.

In the embodiment shown in fig. 10, the preprocessing module 407, the data collecting module 401 and the first sending module 402 may be integrated into a collector, the message obtaining module 403, the splicing module 404, the extent determining module 405, the second sending module 406 and the filtering module 408 may be integrated into a first sender, and the convergence processing module 409, the alarm obtaining module 410 and the third sending module 411 may be integrated into a second sender.

In an embodiment, the collector is disposed on a first server of the monitoring data processing system, the first transmitter is disposed on a second server of the monitoring data processing system, and the second transmitter is disposed on a third server of the monitoring data processing system, and understandably, the first server includes the preprocessing module 407, the data collecting module 401 and the first sending module 402, the second server includes the message obtaining module 403, the splicing module 404, the degree determining module 405, the second sending module 406 and the filtering module 408, and the third server includes the convergence processing module 409, the alarm obtaining module 410 and the third sending module 411.

All the above technical solutions may be combined arbitrarily to form an optional embodiment of the present application, and are not described in detail herein.

Accordingly, embodiments of the present application further provide a monitoring data processing system, in one embodiment, the monitoring data processing system includes a first server and a second server, and in another embodiment, as shown in fig. 11, the monitoring data processing system includes a first server, a second server and a third server. In each embodiment, please refer to the above description of the monitoring data processing method for the contents and the achieved beneficial effects respectively realized in the first server, the second server and the third server, which are not described herein again.

The first server and/or the second server and/or the third server are collectively referred to as a server. As shown in fig. 12, fig. 12 is a schematic structural diagram of a server according to an embodiment of the present application, and it is understood that the structures of the first server, the second server, and the third server all refer to the structure of the server in fig. 12. The server 500 includes a processor 501 having one or more processing cores, memory 502 having one or more computer-readable storage media, and a computer program stored on the memory 502 and executable on the processor. The processor 501 is electrically connected to the memory 502. Those skilled in the art will appreciate that the server architectures depicted in the figures are not meant to be limiting with respect to the servers, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components.

The processor 501 is a control center of the server 500, connects various parts of the entire server 500 by various interfaces and lines, performs various functions of the server 500 and processes data by running or loading software programs (computer programs) and/or modules stored in the memory 502, and calling data stored in the memory 502, thereby performing overall monitoring of the server 500.

In this embodiment of the application, the processor 501 in the server 500 loads instructions corresponding to processes of one or more application programs into the memory 502 according to the following steps, and the processor 501 runs the application programs stored in the memory 502, so as to implement the steps of the monitoring data processing method in any of the above embodiments.

Optionally, as shown in fig. 12, the server 500 further includes: touch-sensitive display screen 503, radio frequency circuit 504, audio circuit 505, input unit 506 and power 507. The processor 501 is electrically connected to the touch display screen 503, the radio frequency circuit 504, the audio circuit 505, the input unit 506, and the power supply 507, respectively.

The touch display screen 503 can be used for displaying a graphical user interface and receiving an operation instruction generated by a user acting on the graphical user interface. The touch display screen 503 may include a display panel and a touch panel. Among other things, the display panel may be used to display information input by or provided to the user, as well as various graphical user interfaces of the server, which may be made up of graphics, text, icons, video, and any combination thereof. Alternatively, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. The touch panel may be used to collect touch operations of a user on or near the touch panel (for example, operations of the user on or near the touch panel using any suitable object or accessory such as a finger, a stylus pen, and the like), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. The touch panel may overlay the display panel, and when the touch panel detects a touch operation thereon or nearby, the touch panel may be transmitted to the processor 501 to determine the type of the touch event, and then the processor 501 may provide a corresponding visual output on the display panel according to the type of the touch event. In the embodiment of the present application, the touch panel and the display panel may be integrated into the touch display screen 503 to implement input and output functions. However, in some embodiments, the touch panel and the touch panel can be implemented as two separate components to perform the input and output functions. That is, the touch display screen 503 can also be used as a part of the input unit 506 to implement an input function.

In the embodiment of the present application, the touch display screen 503 is used for presenting a graphical user interface and receiving an operation instruction generated by a user acting on the graphical user interface.

The rf circuit 504 may be configured to send and receive rf signals to establish wireless communication with a network device or other server through wireless communication, and send and receive signals to and from the network device or other server.

The audio circuit 505 may be used to provide an audio interface between the user and the server through speakers, microphones. The audio circuit 505 may transmit the electrical signal converted from the received audio data to a speaker, and convert the electrical signal into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 505 and converted into audio data, and the audio data is processed by the audio data output processor 501, and then sent to another server via the rf circuit 504, or output to the memory 502 for further processing. The audio circuitry 505 may also include an earpiece jack to provide communication of a peripheral headset with the server.

The input unit 506 may be used to receive input numbers, character information, or user characteristic information (e.g., fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

A power supply 507 is used to supply power to the various components of the server 500. Optionally, the power supply 507 may be logically connected to the processor 501 through a power management system, so as to implement functions of managing charging, discharging, power consumption management, and the like through the power management system. The power supply 507 may also include any component including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown in fig. 12, the server 500 may further include a camera, a sensor, a wireless fidelity module, a bluetooth module, etc., which will not be described in detail herein.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of computer programs are stored, and the computer programs can be loaded by a processor to execute the steps in any monitoring data processing method provided in the embodiment of the present application, which are not described herein again.

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the computer program stored in the storage medium can execute the steps in any monitoring data processing method provided in the embodiment of the present application, beneficial effects that can be achieved by any monitoring data processing method provided in the embodiment of the present application can be achieved, for which details are given in the foregoing embodiment and are not described herein again.

The foregoing describes in detail a monitoring data processing method, apparatus, storage medium, and monitoring data processing system provided in the embodiments of the present application, and a specific example is applied in the present application to explain the principles and embodiments of the present application, and the description of the foregoing embodiments is only used to help understand the method and core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A monitoring data processing method is applied to a monitoring data processing system, wherein the monitoring data processing system comprises a collector and a first transmitter, and the monitoring data processing method comprises the following steps:

acquiring data change information of a target data table of a database through the acquisition device, and sending the data change information to a first transmitter, wherein monitoring data aiming at a client server are stored in the target data table;

the first transmitter acquires the data change information and splices alarm notification information corresponding to the data change information;

determining the importance degree corresponding to the data change information according to the monitoring service type and the monitoring abnormal degree corresponding to the data change information and the client priority corresponding to the client server;

2. The monitoring data processing method according to claim 1, wherein the data change information includes service identification information of the client server, a service type of the client server, a message type corresponding to the data change information, and a message content corresponding to the message type;

the step of determining the importance degree corresponding to the data change information according to the monitoring service type and the monitoring abnormality degree corresponding to the data change information and the client priority corresponding to the client server comprises the following steps:

determining the client priority according to the service identification information and the service type;

determining the monitoring service type according to the message type;

determining the monitoring abnormal degree according to the message content;

and determining the importance degree corresponding to the data change information according to the client priority, the monitoring service type and the monitoring abnormal degree.

3. The monitoring data processing method according to claim 1, wherein the step of sending the alarm notification information corresponding to the data change information to the client terminal corresponding to the client server according to the importance degree includes:

filtering the alarm notification information corresponding to the data change information according to the importance degree;

and sending the alarm notification information after filtering to a client terminal corresponding to a client server.

4. The monitoring data processing method according to claim 3, wherein the step of sending the filtered alarm notification information to a client terminal corresponding to a client server includes:

carrying out convergence processing on the alarm notification information after the filtering processing;

and sending the alarm notification information after the convergence processing to a client terminal corresponding to a client server.

5. The monitoring data processing method according to claim 4, wherein the data change information includes service identification information of a client server and a service type of the client server, and the step of performing convergence processing on the alarm notification information after the filtering processing includes:

acquiring all the service identification information and the sending period strategy of the monitoring data of the client server corresponding to the service type;

and for the alarm notification information after the filtering processing, carrying out convergence processing on the alarm notification information through the sending period strategy.

6. The monitoring data processing method according to claim 1, wherein the monitoring data processing system further comprises a first message server and a message queue, and the monitoring data processing method further comprises:

determining a theme corresponding to the data change information;

the collector obtains the configured service address of the first message server;

and sending the data change information to a message queue corresponding to the theme in the first message server through the service address according to the theme corresponding to the data change information.

7. The monitoring data processing method according to claim 1, further comprising a second transmitter in the monitoring data processing system; the step of sending the alarm notification information corresponding to the data change information to the client terminal corresponding to the client server according to the importance degree includes:

the first transmitter performs filtering processing on the alarm notification information corresponding to the data change information according to the importance degree;

sending the alarm notification information after filtering processing to a message queue corresponding to the theme of the alarm notification information;

the second transmitter monitors a message queue corresponding to the processed theme according to the processed theme and acquires the alarm notification information from the corresponding message queue;

and carrying out convergence processing on the alarm notification information so as to send the alarm notification information after the convergence processing to the client terminal corresponding to the client server.

8. The monitoring data processing method according to claim 1 or 7, further comprising, before the step of collecting, by the collector, data change information of a target data table of the database:

after the collector is started, acquiring a connection mode for connecting a database from a configuration file of the collector, wherein the collector is connected with the corresponding database through the connection mode;

creating a database monitoring plug-in for the target data table needing monitoring in the database in the configuration file;

and acquiring the service identification information of the client server and the service type of the client server from the configuration file of the collector, and registering the client server to a second server.

9. A monitoring data processing device is characterized by being applied to a monitoring data processing system and comprising a data acquisition module, a first sending module, a message acquisition module, a splicing module, a degree determination module and a second sending module;

the data acquisition module is used for acquiring data change information of a target data table of the database through the acquisition device, and monitoring data aiming at the client server are stored in the target data table;

the message acquisition module is used for acquiring the data change information through the first transmitter;

the splicing module is used for splicing the alarm notification information corresponding to the data change information;

the degree determining module is used for determining the importance degree corresponding to the data change information according to the monitoring abnormity degree corresponding to the data change information, the monitoring service type and the client priority corresponding to the client server;

10. A computer-readable storage medium, characterized in that it stores a computer program adapted to be loaded by a processor for performing the steps of the method of monitoring data processing according to any of claims 1-8.