CN111597091A - Data monitoring method and system, electronic equipment and computer storage medium - Google Patents
Data monitoring method and system, electronic equipment and computer storage medium Download PDFInfo
- Publication number
- CN111597091A CN111597091A CN202010429579.9A CN202010429579A CN111597091A CN 111597091 A CN111597091 A CN 111597091A CN 202010429579 A CN202010429579 A CN 202010429579A CN 111597091 A CN111597091 A CN 111597091A
- Authority
- CN
- China
- Prior art keywords
- information
- configuration
- configuration information
- alarm
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Alarm Systems (AREA)
Abstract
The application provides a data monitoring method and system, electronic equipment and a computer storage medium, wherein the data monitoring method comprises the following steps: outputting a configuration interface; the configuration interface comprises an input box for acquiring each configuration item of a task and/or an alarm rule; receiving configuration information of each configuration item input by a user in the configuration interface; storing each configuration information into a database, and calling a reloading interface to send reloading information so as to trigger the loading of the configuration information from the database; and monitoring data by using the loaded configuration information. By abstracting each configuration item to be configured in the configuration file and configuring information in a configuration interface mode of an input frame containing each configuration item, data monitoring is further achieved, so that data monitoring is achieved more conveniently, and the threshold for achieving data monitoring is effectively reduced.
Description
Technical Field
The present disclosure relates to the field of data monitoring technologies, and in particular, to a data monitoring method and system, an electronic device, and a computer storage medium.
Background
In the related technology, the monitoring system configures the configuration information of the collection task and the alarm rule by compiling the yaml file, then manually calls a reloading interface, loads the configuration information in the compiled yaml file, and monitors the data. Because information configuration is required to be carried out by compiling yaml files to realize data monitoring, the data monitoring method is not only cumbersome, but also has high professional literacy requirements.
Disclosure of Invention
Based on the defects of the prior art, the application provides a data monitoring method and system, electronic equipment and a computer storage medium, so as to solve the problems that the existing data monitoring realization mode is not only complicated, but also has high professional literacy requirements.
In order to achieve the above object, the present application provides the following technical solutions:
a first aspect of the present application provides a data monitoring method, including:
outputting a configuration interface; the configuration interface comprises an input box for acquiring each configuration item of a task and/or an alarm rule;
receiving configuration information of each configuration item input by a user in the configuration interface;
storing each configuration information into a database, and calling a reloading interface to send reloading information so as to trigger the loading of the configuration information from the database;
and monitoring data by using the loaded configuration information.
Optionally, in the above data monitoring method, the invoking a reload interface to send reload information to trigger the loading of each piece of configuration information from the database includes:
calling a reloading interface of an acquisition service system, sending the reloading information to the acquisition service system to trigger the acquisition service system to load the configuration information from the database, or simultaneously calling the reloading interface of the acquisition service system and the reloading interface of an alarm processing system, and sending the reloading information to the acquisition service system and the alarm processing system to trigger the acquisition service system and the alarm processing system to load the configuration information from the database.
Optionally, in the above data monitoring method, the monitoring data using the loaded configuration information includes:
acquiring data through an acquisition service system, and matching the data with rule configuration information in the configuration information corresponding to the loaded alarm rule; the acquisition service system acquires data based on configuration information corresponding to the acquisition task;
if the data is matched with the rule configuration information, triggering the acquisition service system to send alarm information to an alarm processing system;
and sending the alarm information based on the informer information in the configuration information corresponding to the alarm rule through the alarm processing system.
Optionally, in the above data monitoring method, after triggering the alarm processing system to send alarm information based on notifier information in the configuration information, the method further includes:
persisting, by the alert processing system, the alert information into the database.
A second aspect of the present application provides a data monitoring system, comprising:
the system comprises a unified monitoring module, a database and a data monitoring submodule;
the unified monitoring system is used for outputting a configuration interface, keeping the received configuration information of each configuration item input by a user on the configuration interface in a database, and calling a reloading interface of the data monitoring subsystem to send reloading information; the configuration interface comprises an input box of each configuration item for acquiring tasks and/or alarm rules;
the database is used for storing the configuration information of each configuration item input by the user on the configuration interface;
and the data monitoring subsystem is used for loading the configuration information from the database when the reloading information is received, and monitoring data by using the loaded configuration information.
Optionally, in the data monitoring system, the data monitoring sub-module includes an acquisition service system and an alarm processing system, and the unified monitoring module is configured to, when the unified monitoring module executes the call of the reload interface of the data monitoring sub-system to send reload information,:
calling a reloading interface of an acquisition service system, sending the reloading information to the acquisition service system, or calling the reloading interface of the acquisition service system and the reloading interface of an alarm processing system simultaneously, and sending the reloading information to the acquisition service system and the alarm processing system;
the collection service system loads the configuration information from the database when receiving the reloading information, and the alarm processing system loads the configuration information from the database when receiving the reloading information.
Optionally, in the data monitoring system, when the data monitoring subsystem performs data monitoring by using the loaded configuration information, the collection service system is configured to collect data based on the configuration information corresponding to the collection task, match the data with the rule configuration information in the configuration information corresponding to the loaded alarm rule, and send alarm information to the alarm processing system when the data is matched with the rule configuration information;
and the alarm processing system is used for sending the alarm information based on the informer information in the configuration information corresponding to the alarm rule after receiving the alarm information.
Optionally, in the data monitoring system described above, the alarm processing system is further configured to: persisting the alert information into the database.
A third aspect of the present application provides an electronic device comprising:
one or more processors;
a memory having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a data monitoring method as in any above.
A fourth aspect of the present application provides a computer storage medium storing a program for implementing the data monitoring method as claimed in any one of the above when executed.
The embodiment of the application provides a data monitoring method, and various configuration items required in a yaml file are abstracted, and then information configuration is provided for a user in a mode of outputting a configuration interface of an input box containing various configuration items of acquisition tasks and/or alarm rules, so that the user can input configuration information in various configuration items of the configuration interface, and the yaml file does not need to be compiled. And after receiving the configuration information of each configuration item input by a user on the configuration interface, storing each configuration information into the database, and calling the reloading interface to send reloading information so as to trigger the loading of the configuration information from the database, thereby utilizing the configured information to monitor data. Therefore, the information configuration is carried out through a more humanized configuration interface to realize the data monitoring, and the information configuration is not required to be carried out through the yaml file to realize the data monitoring, so that the data monitoring is more convenient and fast, and the requirement on professional literacy is effectively reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a data monitoring system according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of another data monitoring system according to another embodiment of the present application;
fig. 3 is a schematic flowchart of a data monitoring method according to another embodiment of the present application;
FIG. 4 is a schematic illustration of a configuration interface according to another embodiment of the present application;
fig. 5 is a flowchart illustrating a method for monitoring data using configuration information according to another embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In this application, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The application provides a data monitoring method, in order to solve the problem that the existing mode of realizing data monitoring is not only tedious and the professional literacy requirement is high, in order to realize the data monitoring method that this application provides, this application embodiment provides a data monitoring system, as shown in fig. 1, this data monitoring system includes:
the system comprises a unified monitoring module 101, a database 102 and a data monitoring submodule 103.
When the data monitoring method provided by the present application is implemented, the unified monitoring module 101 is mainly configured to output a configuration interface of an input box including each configuration item of an acquisition task and/or an alarm rule, and to hold the received configuration information of each configuration item input by a user on the configuration interface in a database, and to call a reload interface of the data monitoring subsystem 103 to send reload information.
The database 102 is mainly used for storing configuration information of each configuration item input by a user in the configuration interface.
The data monitoring sub-module 103 is mainly configured to load configuration information from the database when receiving the reload information, and perform data monitoring using the loaded configuration information. The data monitoring mainly monitors whether the data meets an alarm condition in real time so as to alarm in time.
Specifically, in the embodiment of the present application, each configuration item that needs to be configured in the yaml file when the acquisition task and the alarm rule are newly added or changed is abstracted, and then the unified monitoring module 101 is developed, and the unified monitoring module 101 outputs the configuration interface of the input frame including each configuration item of the acquisition task and/or the alarm rule, that is, the user can configure the acquisition task, or configure the alarm rule, or configure the acquisition task and the alarm rule at the same time through the configuration interface, so that the user can configure the configuration information of the acquisition task and the alarm rule more conveniently, and the threshold of the configuration information is also reduced.
Moreover, since the data monitoring sub-module 103 collects the configuration information of the task and the alarm rule to perform data monitoring, it is necessary to reload the newly added or modified configuration information to perform data monitoring. In order to implement data monitoring by using new configuration information without restarting the data monitoring system, in the embodiment of the present application, the unified monitoring module 101 calls a reload interface of the data monitoring subsystem 103 to send reload information, so as to trigger the data monitoring subsystem 103 to load the configuration information of the new configuration from the database.
Optionally, the data monitoring system in the embodiment of the present application may be constructed based on an open source monitoring system Prometheus. The monitoring system Prometheus also realizes data monitoring based on the configuration information, and also configures the configuration information of acquisition tasks and alarm rules by compiling the yaml file, then manually calls a reload interface (load) to load the configuration information in the compiled yaml file to realize data monitoring, so that the final data monitoring system is constructed based on the open-source monitoring system Prometheus, a brand-new data monitoring system does not need to be completely redeveloped, the development efficiency and cost are effectively improved, and the problems of complexity and high technical threshold of the configuration information of the monitoring system Prometheus are solved. Of course, the data monitoring system provided in the embodiment of the present application may also be constructed based on other open source monitoring systems having the above-mentioned common features with the monitoring system promemetus.
Specifically, the monitoring system Prometheus is used as the data monitoring submodule 103 for data acquisition and alarm. Since the monitoring system Prometheus allows a plurality of systems or modules to be integrated for data monitoring, the developed unified monitoring module 101 and the database 102 can be integrated on the monitoring system Prometheus, so that the data monitoring system provided by the embodiment of the present application can be constructed more conveniently.
Another embodiment of the present application provides another data monitoring system, as shown in fig. 2, the data monitoring system mainly includes:
the system comprises a unified monitoring module 201, a database 202, an acquisition service system 203 and an alarm processing system 204.
When the data monitoring method provided by the present application is implemented, the unified monitoring module 201 is mainly configured to output a configuration interface of an input box including configuration items of an acquisition task and/or an alarm rule, and maintain received configuration information of the configuration items input by a user on the configuration interface in a database, call a reload interface of the acquisition service system 203, send reload information to the acquisition service system 203, or call the reload interface of the acquisition service system and the reload interface of the alarm processing system at the same time, and send the reload information to the acquisition service system and the alarm processing system.
In the embodiment of the present application, the collection service system 203 and the alarm processing system 204 together form a data monitoring subsystem for performing data monitoring using the loaded configuration information. Specifically, when the loaded configuration information is used for data monitoring, the collection service system 203 is configured to collect data based on the configuration information corresponding to the collection task. Specifically, as shown in fig. 2, data is collected from each instance in a polling manner according to configuration information such as a collection period and an address corresponding to a collection task. Then, the collected data is matched with the rule configuration information in the configuration information corresponding to the loaded alarm rule, and when the data is matched with the rule configuration information, alarm information is generated and sent to the alarm processing system 204.
The alarm processing system 204 is configured to send alarm information based on the notifier information in the configuration information corresponding to the alarm rule after receiving the alarm information. Specifically, as shown in fig. 2, the warning message is sent to other third-party software such as the configured mailbox address and the communication address of the communication software, so as to notify the relevant personnel in time.
It should be noted that, when the user only configures configuration information of an acquisition task in the configuration interface, the unified monitoring module 201 only calls a reload interface of the acquisition service system 203, and sends reload information to the acquisition service system 203, so as to trigger the acquisition service system 203 to load the configuration information from the database 202. Because the collection service system 203 is responsible for collecting data, only the collection service system 203 needs configuration information for the collection task. When the user only configures the configuration information of the alarm rule in the configuration interface, or configures the acquisition task and the configuration information of the alarm rule at the same time, since the collection service system 203 needs to determine whether to generate alarm information according to the rule configuration information in the configuration information corresponding to the alarm rule, the alarm processing system 204 needs to perform subsequent processing on the alarm information according to the information such as the notifier information in the configuration information corresponding to the alarm rule, namely, the acquisition service system 203 and the alarm processing system 204 both need to use the configuration information corresponding to the alarm rule, therefore, at this time, it is necessary to call the reload interface of the collection service system 203 and the reload interface of the alarm processing system 204 at the same time, send the reload information to the collection service system 203 and the alarm processing system 204, to trigger the acquisition service system 203 and the alarm handling system 204 to load configuration information from the database 202.
Because the database 202 is mainly used for storing the configuration information of each configuration item input by the user on the configuration interface, when receiving the reload information, the collection service system 203 loads the configuration information from the database 202, and specifically may load all the configuration information corresponding to the latest collection task and the rule configuration information in the configuration information corresponding to the alarm rule. When the alarm processing system receives the reloading information, the information of the notifier in the configuration information corresponding to the alarm rule and other configuration information for processing the alarm information, such as filtering configuration information for filtering repeated alarm rules, are loaded from the database.
Optionally, the alarm processing system 204 is further configured to persist the alarm information to the database 202, i.e., store the alarm information in the database 202 for subsequent traceability. Thus, the database 202 is also used to store alarm information.
Optionally, the data monitoring system provided in the embodiment of the present application may also be constructed based on the open-source monitoring system Prometheus.
Specifically, a unified management center Prometheus Server in an open source monitoring system Prometheus is used as the collection service system 203, and an alarm processing center alert manager in the monitoring system Prometheus is used as the alarm processing system 204.
The Prometheus Server is a core part in a monitoring system Prometheus component and is mainly responsible for acquiring, storing and querying monitoring data, so that the acquisition service system 203 is mainly used for acquiring, storing, querying and generating alarm information for the monitoring data, and the functions of acquiring the data of the acquisition service system 203 and generating the alarm information can be realized. Specifically, referring to fig. 2 as well, the collection service system 203 obtains data of each node by providing each instance (target) of a program for monitoring sample data, then stores the obtained data in a local hard disk drive HDD or a solid state disk SSD, and finally provides a PromQL language defined by Prometheus of the monitoring system to the outside to query and analyze the data. The alarm processing system 204 is configured to receive the alarm information generated by the collection service system 203, and perform subsequent processing such as filtering and sending the alarm information to the outside.
Since the user interface provided by the monitoring system Prometheus is only used for data display when querying data, and is not used for configuration information. Therefore, the developed unified monitoring module 201 needs to be additionally integrated into the monitoring system promemeus, and in order to store the configuration information configured by the user, a database needs to be further integrated into the monitoring system promemeus, so as to finally obtain the data monitoring system provided by the embodiment of the present application.
Optionally, in the embodiment of the present application, referring to fig. 2 as well, in the data monitoring system, an open-source visualization platform Grafana may be further integrated. Although the open source monitoring system promemetus has its own visualization function for visualizing query data, the function is relatively simple and only displays data when data query is performed, so that the monitoring system promemeus is usually used to integrate the open source visualization platform Grafana into the system to build a visualization panel (Dashboard) which can be used for a long time. Therefore, in the embodiment of the present application, the visualization platform Grafana is also integrated in the data monitoring, specifically, the collection service system 203 is used as a data source of the visualization platform Grafana, and a visualization panel (Dashboard) is constructed by the visualization platform Grafana to visualize data acquired from the collection service system 203.
Optionally, since the visualization panel (Dashboard) and the configuration interface are both interfaces that can be displayed on the user interface for a long time, in the embodiment of the present application, the visualization panel (Dashboard) and the configuration interface are integrated into the unified monitoring module 201 together, so as to facilitate unified display.
Based on the data monitoring system provided in the foregoing embodiment, another embodiment of the present application provides a data monitoring method, as shown in fig. 3, including:
s301, outputting a configuration interface, wherein the configuration interface comprises an input box of each configuration item of the acquisition task and/or the alarm rule.
The configuration items of the collection task may include configuration items such as a task name, a collection period, and a collection address. The alarm rule comprises configuration items such as a regular name, informer information, a filter condition, an alarm threshold value and the like. The configuration items specifically contained are the same as those required to be configured in the yaml file in the prior art. The method and the device abstract the configuration items which need to be configured in the yaml file and provide the configuration items for the user in a configuration interface mode, so that the user can configure the acquisition task and the alarm rule more conveniently, and the user only needs to input the configuration information in the input box of each configuration item because each configuration item is clear, thereby reducing the threshold of the configuration information to a certain extent.
The input box of the configuration item may be the configuration information input by the user through an input method, or may be a plurality of options configured in advance and selected and input by the user. For example, as shown in fig. 4, the configuration interface of the acquisition task specifically includes an output box including five configuration items, namely, a task name, a task description, a probe set, an acquisition period (seconds), and an acquisition target address. The task name, the task description and the acquisition target address are input by a user through an input method, and the probe set and the acquisition period (seconds) are selected and input by the user. In addition, a plurality of prompt messages are displayed on the configuration interface, so that a user can accurately input configuration information, and the threshold of the configuration information of the user can be reduced. Optionally, if the configuration interface does not have the configuration item to be configured, the user may additionally reconfigure the new configuration item on the interface.
It should be noted that, because the attributes such as the types of the collected data are different due to different collection tasks, the alarm rule also needs to be adjusted accordingly, so that the collection task and the corresponding alarm rule generally need to be configured at the same time. In addition, when information is configured for the first time, the acquisition task and the corresponding alarm rule need to be configured at the same time, and in the subsequent monitoring process, in order to modify the acquisition task or the alarm rule, the acquisition task or the alarm rule can be configured only.
S302, receiving configuration information of each configuration item input by a user on a configuration interface.
Specifically, when the user finishes configuring all the configuration items and clicks a virtual key on the configuration interface for confirming that the configuration is finished, the unified monitoring module is triggered to receive configuration information of each configuration item input on the configuration interface by the user, for example, a "save" virtual key as shown in fig. 4.
S303, storing each configuration information into a database, and calling a reloading interface to send reloading information so as to trigger the loading of the configuration information from the database.
In the embodiment of the application, after the configuration information is obtained, the yaml file does not need to be generated, but the configuration information is directly stored in the data table of the database, and the reloading interface is called to send the reloading information at the same time, so that the data monitoring subsystem is triggered to load the configuration information of the new configuration from the database under the condition that the data monitoring is not required to be restarted, and the configuration information of the new configuration is used for data monitoring.
Optionally, in another embodiment of the present application, a reload interface is invoked to send reload information to trigger a specific implementation manner of loading each configuration information from a database, which specifically includes:
and calling a reloading interface of the acquisition service system, sending reloading information to the acquisition service system to trigger the acquisition service system to load the configuration information from the database, or calling the reloading interface of the acquisition service system and the reloading interface of the alarm processing system simultaneously, and sending the reloading information to the acquisition service system and the alarm processing system to trigger the acquisition service system and the alarm processing system to load the configuration information from the database.
In the data monitoring system, the acquisition service system mainly acquires data based on the configuration information corresponding to the acquisition task and determines whether alarm information is generated according to rule configuration information in the configuration information corresponding to the alarm rule, and the alarm processing system determines whether the alarm information is generated based on the configuration information corresponding to the alarm rule, so that when only the configuration information of the acquisition task is configured, only a reloading interface of the acquisition service system needs to be called, the reloading information is sent to the acquisition service system to trigger the acquisition service system to load the configuration information from a database, and if the configuration information only configured with the alarm rule or the configuration information configured with the acquisition task and the alarm rule is configured, the reloading interface of the acquisition service system and the reloading interface of the alarm processing system need to be called simultaneously to send the reloading information to the acquisition service system and the alarm processing system, to trigger the collection service system and the alarm handling system to load configuration information from the database.
And S304, monitoring data by using the newly loaded configuration information.
It should be noted that step S304 is not necessarily performed immediately after step S303, and may be performed when data monitoring is required. However, data monitoring is usually real-time, so step S304 is usually performed immediately after step S303 is performed, so as to perform continuous monitoring on data.
If only the configuration information of the acquisition task is newly configured, data monitoring needs to be performed by using the configuration information of the acquisition task loaded this time and the configuration information of the alarm rule loaded latest before. Similarly, if only the configuration information of the alarm rule is newly configured, the data monitoring needs to be specifically performed by using the configuration information of the alarm rule loaded this time and the configuration information of the acquisition task loaded latest before. And if the configuration information of the acquisition task and the alarm rule is newly configured, performing data monitoring by using the loaded acquisition task and the configuration information of the alarm rule.
Optionally, in another embodiment of the present application, as shown in fig. 5, a specific implementation manner of step S304 includes:
s501, data are collected through a collection service system, and the data are matched with rule configuration information in configuration information corresponding to the loaded alarm rule.
And the acquisition service system acquires data based on the configuration information corresponding to the acquisition task. The rule configuration information is configuration information for indicating an alarm condition. Specifically, the collection service system collects data from the instance in a polling manner based on a collection address, a collection period and the like corresponding to the collection task, and matches the collected data with corresponding rule configuration information to determine whether an alarm condition is met. If the collected data matches the rule configuration information, step S502 is executed.
Optionally, when the collection service system loads the configuration information from the database, only the configuration information corresponding to the collection service and the rule configuration information in the configuration information corresponding to the alarm rule may be loaded, and all the configuration information corresponding to the alarm rule does not need to be loaded.
And S502, triggering the acquisition service system to send alarm information to the alarm processing system.
Specifically, when it is determined that the acquired data matches the rule configuration information, the acquisition service system generates alarm information and sends the alarm information to the alarm processing system.
S503, sending alarm information based on the informer information in the configuration information corresponding to the alarm rule through the alarm processing system.
It should be noted that the configuration information corresponding to the alarm rule includes notifier information in addition to the rule configuration information. When the alarm processing system loads the configuration information from the database, the alarm processing system specifically loads the informer information in the configuration information of the alarm rule from the database. The information of the notifier can be the relevant contact information about the notifier, such as a mailbox address, a chat software ID and the like.
Optionally, after receiving the warning information, the warning processing system may further perform processing such as deduplication, noise reduction, grouping, and the like on the warning information, and then send the warning information to the notifier. In this case, the information corresponding to the alarm rule may further include configuration information required for processing the alarm information, for example, configuration information such as a filter criterion and a grouping criterion.
Optionally, in another embodiment of the present application, after performing step S503, the method may further include: and persisting the alarm information into a database through an alarm processing system. So as to trace the alarm message in the following.
The embodiment of the application provides a data monitoring method, and various configuration items required in a yaml file are abstracted, and then information configuration is provided for a user in a mode of outputting a configuration interface of an input box containing various configuration items of acquisition tasks and/or alarm rules, so that the user can input configuration information in various configuration items of the configuration interface, and the yaml file does not need to be compiled. And after receiving the configuration information of each configuration item input by the user on the configuration interface, storing each configuration information into the database, calling the reload interface to send reload information to trigger the loading of the configuration information from the database, and monitoring the data by using the loaded configuration information, so that the data monitoring can be realized through a more humanized configuration interface without information configuration through a yaml file, the data monitoring is realized, the data monitoring is more convenient and fast, and the requirement on professional literacy is greatly reduced.
Another embodiment of the present application provides an electronic device, which specifically includes: one or more processors, and a memory.
Wherein the memory has one or more programs stored thereon, and when the one or more programs are executed by the one or more processors, cause the one or more processors to implement the data monitoring method as provided by the method embodiments described above. For a specific implementation process, reference may be made to the steps in the foregoing method embodiments, which are not described herein again.
Another embodiment of the present application provides a computer storage medium for storing a program, which when executed, is used to implement the data monitoring method provided by the above method embodiment. For a specific implementation process, reference may be made to the steps in the foregoing method embodiments, which are not described herein again. The computer storage medium herein may be a computer readable storage medium.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for monitoring data, comprising:
outputting a configuration interface; the configuration interface comprises an input box for acquiring each configuration item of a task and/or an alarm rule;
receiving configuration information of each configuration item input by a user in the configuration interface;
storing each configuration information into a database, and calling a reloading interface to send reloading information so as to trigger the loading of the configuration information from the database;
and monitoring data by using the loaded configuration information.
2. The method of claim 1, wherein invoking the reload interface to send reload information to trigger loading of each of the configuration information from the database comprises:
calling a reloading interface of an acquisition service system, sending the reloading information to the acquisition service system to trigger the acquisition service system to load the configuration information from the database, or simultaneously calling the reloading interface of the acquisition service system and the reloading interface of an alarm processing system, and sending the reloading information to the acquisition service system and the alarm processing system to trigger the acquisition service system and the alarm processing system to load the configuration information from the database.
3. The method according to claim 1 or 2, wherein the monitoring data using the loaded configuration information comprises:
acquiring data through an acquisition service system, and matching the data with rule configuration information in the configuration information corresponding to the loaded alarm rule; the acquisition service system acquires data based on configuration information corresponding to the acquisition task;
if the data is matched with the rule configuration information, triggering the acquisition service system to send alarm information to an alarm processing system;
and sending the alarm information based on the informer information in the configuration information corresponding to the alarm rule through the alarm processing system.
4. The method of claim 3, wherein after triggering the alert processing system to send alert information based on notifier information in the configuration information, further comprising:
persisting, by the alert processing system, the alert information into the database.
5. A data monitoring system, comprising:
the system comprises a unified monitoring module, a database and a data monitoring submodule;
the unified monitoring system is used for outputting a configuration interface, keeping the received configuration information of each configuration item input by a user on the configuration interface in a database, and calling a reloading interface of the data monitoring subsystem to send reloading information; the configuration interface comprises an input box of each configuration item for acquiring tasks and/or alarm rules;
the database is used for storing the configuration information of each configuration item input by the user on the configuration interface;
and the data monitoring subsystem is used for loading the configuration information from the database when the reloading information is received, and monitoring data by using the loaded configuration information.
6. The data monitoring system of claim 5, wherein the data monitoring sub-module comprises a collection service system and an alarm processing system, and the unified monitoring module is configured to, when executing the invoking of the reload interface of the data monitoring sub-system to send reload information,:
calling a reloading interface of an acquisition service system, sending the reloading information to the acquisition service system, or calling the reloading interface of the acquisition service system and the reloading interface of an alarm processing system simultaneously, and sending the reloading information to the acquisition service system and the alarm processing system;
the collection service system loads the configuration information from the database when receiving the reloading information, and the alarm processing system loads the configuration information from the database when receiving the reloading information.
7. The data monitoring system of claim 6, wherein when the data monitoring subsystem performs the data monitoring using the loaded configuration information, the collection service system is configured to collect data based on the configuration information corresponding to the collection task, match the data with rule configuration information in the configuration information corresponding to the loaded alarm rule, and send alarm information to the alarm processing system when the data is matched with the rule configuration information;
and the alarm processing system is used for sending the alarm information based on the informer information in the configuration information corresponding to the alarm rule after receiving the alarm information.
8. The data monitoring system of claim 7, wherein the alarm processing system is further configured to: persisting the alert information into the database.
9. An electronic device, comprising:
one or more processors;
a memory having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the data monitoring method of any one of claims 1 to 4.
10. A computer storage medium storing a program which, when executed, implements a data monitoring method as claimed in any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010429579.9A CN111597091A (en) | 2020-05-20 | 2020-05-20 | Data monitoring method and system, electronic equipment and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010429579.9A CN111597091A (en) | 2020-05-20 | 2020-05-20 | Data monitoring method and system, electronic equipment and computer storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111597091A true CN111597091A (en) | 2020-08-28 |
Family
ID=72187533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010429579.9A Pending CN111597091A (en) | 2020-05-20 | 2020-05-20 | Data monitoring method and system, electronic equipment and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111597091A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113704065A (en) * | 2021-08-31 | 2021-11-26 | 平安普惠企业管理有限公司 | Monitoring method, device, equipment and computer storage medium |
| CN114896309A (en) * | 2022-05-17 | 2022-08-12 | 三峡高科信息技术有限责任公司 | Method and system for converting and displaying monitoring data of hydropower station |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110048888A (en) * | 2019-04-16 | 2019-07-23 | 深圳市致宸信息科技有限公司 | A kind of method based on zabbix monitoring alarm, server, equipment and storage medium |
| CN110635938A (en) * | 2019-08-19 | 2019-12-31 | 腾讯科技（深圳）有限公司 | Monitoring method, system, equipment and medium |
| CN110688281A (en) * | 2019-09-25 | 2020-01-14 | 凡普数字技术有限公司 | Alarm method and device in monitoring system and storage medium |
| CN110968482A (en) * | 2019-12-18 | 2020-04-07 | 上海良鑫网络科技有限公司 | Enterprise service and application intelligent monitoring system |
| CN111049705A (en) * | 2019-12-23 | 2020-04-21 | 深圳前海微众银行股份有限公司 | Method and device for monitoring distributed storage system |
-
2020
- 2020-05-20 CN CN202010429579.9A patent/CN111597091A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110048888A (en) * | 2019-04-16 | 2019-07-23 | 深圳市致宸信息科技有限公司 | A kind of method based on zabbix monitoring alarm, server, equipment and storage medium |
| CN110635938A (en) * | 2019-08-19 | 2019-12-31 | 腾讯科技（深圳）有限公司 | Monitoring method, system, equipment and medium |
| CN110688281A (en) * | 2019-09-25 | 2020-01-14 | 凡普数字技术有限公司 | Alarm method and device in monitoring system and storage medium |
| CN110968482A (en) * | 2019-12-18 | 2020-04-07 | 上海良鑫网络科技有限公司 | Enterprise service and application intelligent monitoring system |
| CN111049705A (en) * | 2019-12-23 | 2020-04-21 | 深圳前海微众银行股份有限公司 | Method and device for monitoring distributed storage system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113704065A (en) * | 2021-08-31 | 2021-11-26 | 平安普惠企业管理有限公司 | Monitoring method, device, equipment and computer storage medium |
| CN114896309A (en) * | 2022-05-17 | 2022-08-12 | 三峡高科信息技术有限责任公司 | Method and system for converting and displaying monitoring data of hydropower station |
| CN114896309B (en) * | 2022-05-17 | 2023-02-03 | 三峡高科信息技术有限责任公司 | Method and system for converting and displaying monitoring data of hydropower station |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107665228B (en) | Associated information query method, terminal and equipment | |
| US8078922B2 (en) | Internal server error analysis | |
| US20170192872A1 (en) | Interactive detection of system anomalies | |
| US10380867B2 (en) | Alert management within a network based virtual collaborative space | |
| CN108595316A (en) | Life cycle management method, manager, equipment and the medium of Distributed Application | |
| CN112328448A (en) | Zookeeper-based monitoring method, monitoring device, equipment and storage medium | |
| CN113704065A (en) | Monitoring method, device, equipment and computer storage medium | |
| CN111324511B (en) | Alarm rule generation method and device, electronic equipment and storage medium | |
| CN111597091A (en) | Data monitoring method and system, electronic equipment and computer storage medium | |
| CN114996085A (en) | Prometheus-based real-time service monitoring method and system | |
| CN110784377A (en) | Method for uniformly managing cloud monitoring data in multi-cloud environment | |
| CN113032252A (en) | Method and device for collecting buried point data, client device and storage medium | |
| US9800473B2 (en) | Network based virtual collaborative problem solving space | |
| CN111339466A (en) | Interface management method and device, electronic equipment and readable storage medium | |
| CN112685247B (en) | Alarm suppression method based on Zabbix monitoring system and monitoring system | |
| CN107451056B (en) | Method and device for monitoring interface test result | |
| CN113079070B (en) | Method and device for monitoring response performance of domain name system | |
| CN114816914A (en) | Data processing method, equipment and medium based on Kubernetes | |
| CN114726649A (en) | Situation awareness evaluation method and device, terminal equipment and storage medium | |
| CN110796532B (en) | Credit risk processing method, terminal equipment, server and system | |
| CN108536604B (en) | Method and terminal for testing response time of WEB page | |
| CN113138970A (en) | Real-time statistical analysis system and method for database error logs | |
| JP2021163475A (en) | Log-based mashup code generation | |
| CN112989150A (en) | Operation and maintenance diagram acquisition method, device, equipment and readable storage medium | |
| CN115904572B (en) | Template creation method, calling method, program product, system and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |