CN116340096A

CN116340096A - Data monitoring method, data transmission method, data monitoring system and electronic equipment

Info

Publication number: CN116340096A
Application number: CN202310295304.4A
Authority: CN
Inventors: 贾梦飞; 郭江亮; 高凌燕
Original assignee: Qingdao Chuangxin Qizhi Technology Group Co ltd
Current assignee: Qingdao Chuangxin Qizhi Technology Group Co ltd
Priority date: 2023-03-23
Filing date: 2023-03-23
Publication date: 2023-06-27

Abstract

The application provides a data monitoring method, a data transmission method, a data monitoring system and electronic equipment, and relates to the technical field of data monitoring. The data monitoring method is applied to monitoring equipment and comprises the following steps: analyzing the monitoring service of the monitoring group equipment of the monitoring equipment to obtain a target monitoring requirement; determining a target plug-in based on the target monitoring requirement; sending a target plug-in to the group device to acquire monitoring data sent by the group device based on the target plug-in; wherein, the target monitoring requirement includes: identity information of group devices and the type of data to be collected. The data transmission method comprises group equipment, and the method comprises the following steps: setting according to the received target plug-in; collecting corresponding monitoring data based on the target plug-in; sending monitoring data to monitoring equipment; the target plug-in is determined by a data monitoring method based on target monitoring requirements. According to the method and the device, various types of data can be monitored according to actual requirements, and the applicability of data monitoring is improved.

Description

Data monitoring method, data transmission method, data monitoring system and electronic equipment

Technical Field

The present disclosure relates to the field of data monitoring technologies, and in particular, to a data monitoring method, a data transmission method, a data monitoring system, and an electronic device.

Background

The data monitoring is a means for timely and effectively feeding back data abnormality, and whether the abnormality occurs or not is observed through monitoring the data, so that the data is analyzed.

In the field of data monitoring, many different types of data are generated due to differences in the components, indicators, etc. being monitored. In the existing monitoring mode, when data is monitored aiming at different components and indexes, fixed data can only be acquired, and different monitoring modes cannot be expanded, so that the applicability of the data monitoring mode is poor, and different types of data cannot be effectively monitored.

Disclosure of Invention

In view of the foregoing, an objective of the embodiments of the present application is to provide a data monitoring method, a data transmission method, a data monitoring system and an electronic device, so as to solve the problem of poor applicability of data monitoring in the prior art.

In order to solve the above problem, in a first aspect, an embodiment of the present application provides a data monitoring method, where the method is applied to a monitoring device, and the method includes:

Analyzing the monitoring service of the monitoring group equipment of the monitoring equipment to obtain a target monitoring requirement;

determining a target plug-in based on the target monitoring requirement;

the target plug-in is sent to the group equipment so as to acquire monitoring data sent by the group equipment based on the target plug-in;

wherein the target monitoring requirement comprises: the identity information of the group equipment and the type of data to be collected.

In the implementation process, by analyzing the monitoring service during monitoring, the current target monitoring requirement can be determined according to the actual condition during monitoring, and the target plug-in for collecting the corresponding group equipment and data type can be determined according to the target monitoring requirement. And sending the target plug-in to the group equipment through communication connection so as to enable the group equipment to acquire data, thereby receiving the monitoring data acquired and sent by the group equipment. The corresponding plug-in can be expanded in a self-defined manner according to actual monitoring service and requirements, so that different types of monitoring modes are expanded, different data monitoring functions are realized, data of different data types are collected and monitored, applicability and effectiveness of data monitoring are improved, application range of data monitoring is increased, and the method is suitable for monitoring scenes of various different requirements.

Optionally, a history plugin library is arranged in the monitoring equipment;

the history plug-in library is generated by:

generating a plurality of history plug-ins according to the history monitoring requirements of the monitoring equipment;

the history monitoring requirements and the corresponding history plugins are stored in an associated mode, and the history plugin library is obtained;

wherein the historical monitoring demand includes: historical identity information of the group devices being monitored and historical data types collected historically.

In the implementation process, a corresponding history plug-in library can be set in the monitoring equipment so as to correspondingly store the history monitoring requirements and the history plug-ins generated according to the history monitoring requirements in a correlated mode. The historical plug-ins which can be collected according to various different historical monitoring requirements and corresponding group equipment and data types are correspondingly stored and processed, so that the historical plug-in library can contain custom collection plug-ins with various different functions, and various different monitoring and collection requirements can be met.

Optionally, the determining a target plugin based on the target monitoring requirement includes:

querying a plurality of historical monitoring requirements in the historical plugin library based on the target monitoring requirements;

If the target monitoring requirement is the same as any one of the historical monitoring requirements, acquiring the historical plug-in related to the historical monitoring requirement as the target plug-in;

and if the target monitoring requirement is different from all the historical monitoring requirements, generating the target plugin according to the target monitoring requirement, and storing the target monitoring requirement and the target plugin in a historical plugin library in an associated manner.

In the implementation process, when the target plugin is determined, the current target monitoring requirement can be queried in the historical plugin library, and the target monitoring requirement is compared with each historical monitoring requirement in the historical plugin library to determine whether the historical monitoring requirement is the same as the target monitoring requirement. When the requirements are the same, directly acquiring a history plug-in which is stored in association with the history monitoring requirements as a target plug-in; when the requirements are different, corresponding target plug-ins can be customized and generated according to the actual conditions of the target monitoring requirements, and the target monitoring requirements and the target plug-ins are stored in a historical plug-in library in a correlated mode to serve as corresponding key value pairs for inquiring and using in subsequent monitoring scenes. Corresponding target plug-ins can be determined according to different conditions, repeated processes of generating the same plug-ins are effectively reduced, and therefore the efficiency of obtaining the target plug-ins is improved.

Optionally, the method further comprises:

determining an early warning condition corresponding to the target monitoring requirement based on the target plug-in;

analyzing the monitoring data based on the early warning condition;

and if the monitoring data meets the early warning condition, generating early warning information to prompt abnormal conditions.

In the implementation process, in order to effectively manage the monitored condition, the corresponding early warning condition can be extracted according to the target monitoring requirement based on the target plug-in to analyze the monitored data, and when the monitored data meets the early warning condition, corresponding early warning information can be generated to prompt the monitored abnormal condition so as to enable a user to check and analyze the monitored data, thereby positioning and analyzing the abnormal condition and correspondingly processing the abnormal condition. The abnormal condition during monitoring can be prompted in an early warning mode, and adverse effects caused by the abnormal condition are effectively reduced.

In a second aspect, an embodiment of the present application further provides a data transmission method, where the method is applied to a group device, and the method includes:

setting according to the received target plug-in;

collecting corresponding monitoring data based on the target plug-in;

Sending the monitoring data to monitoring equipment;

the target plug-in is determined by any one of the data monitoring methods based on target monitoring requirements.

In the implementation process, when the group device performs data transmission, the group device can perform corresponding deployment setting according to the target plug-in sent by the received monitoring device, so as to collect the monitoring data of the corresponding data type in the group device according to the collection function of the target plug-in, and send the monitoring data to the monitoring device for processing through communication connection. Corresponding data can be acquired based on the acquisition function of the custom plug-in, irrelevant data is abandoned, the load during data transmission is effectively reduced, the accuracy and the efficiency of data acquisition are improved, and therefore the applicability of data monitoring is improved.

Optionally, the collecting corresponding monitoring data based on the target plugin includes:

reading at least one of hardware information, state information and running information based on the target plug-in;

and carrying out encryption processing on the hardware information, the state information or the operation information to obtain the monitoring data.

In the implementation process, the self-defined acquisition function in the target plug-in can correspondingly read one or more of various different types of information such as hardware information, state information and operation information in the group device, and in order to improve the safety of data monitoring, the read information can be correspondingly encrypted so as to reduce the interception or falsification of the monitored data. The method can correspondingly extract and encrypt the needed information, and reduce the processing resources of irrelevant data, thereby reducing the load during data acquisition and improving the efficiency of data acquisition.

Optionally, the group device is provided with a real-time transmission channel and a timing transmission channel;

the sending the monitoring data to the monitoring device comprises the following steps:

detecting whether the real-time sending channel is normal or not;

if the real-time sending channel is judged to be normal, sending the monitoring data to the monitoring equipment based on the real-time sending channel;

and if the real-time transmission channel is abnormal, transmitting the monitoring data to the monitoring equipment based on the real-time transmission channel and the timing transmission channel, or transmitting the monitoring data to the monitoring equipment based on the timing transmission channel.

In the implementation process, in order to reduce abnormal situations of data transmission, two mutually noninterfere sending channels can be respectively arranged in the group equipment, before data transmission, whether the real-time sending channels are normal or not can be detected, so that when the real-time sending channels are normal, the real-time sending channels are adopted to transmit monitoring data, when the real-time sending channels are abnormal, the real-time sending channels and the timing sending channels are adopted, or only the timing sending channels are adopted to transmit the monitoring data, and the monitoring data can be normally transmitted to the monitoring equipment. By arranging a plurality of sending channels, when the real-time sending function is abnormal, the timing sending function is used for processing the data transmission, so that the stability of the data transmission is effectively improved.

In a third aspect, embodiments of the present application further provide a data monitoring system, including: monitoring devices and group devices; the monitoring equipment is in communication connection with the group equipment;

the monitoring equipment is used for analyzing the monitoring service of the monitoring equipment for monitoring the group equipment to obtain a target monitoring requirement; determining a target plug-in based on the target monitoring requirement; the target plug-in is sent to the group equipment so as to acquire monitoring data sent by the group equipment based on the target plug-in; wherein the target monitoring requirement comprises: the identity information of the group equipment and the type of data to be acquired;

the group device is used for setting according to the received target plug-in; collecting corresponding monitoring data based on the target plug-in; sending the monitoring data to monitoring equipment; wherein the target plugin is determined by the data monitoring method according to any one of the above claims based on target monitoring requirements.

In the implementation process, the target plug-in and the monitoring data are correspondingly transmitted through the communication connection between the monitoring equipment and the group equipment, so that the monitoring equipment can monitor the data of the group equipment through the self-defined plug-in function.

In a fourth aspect, an embodiment of the present application further provides an electronic device, where the electronic device includes a memory and a processor, where the memory stores program instructions, and when the processor reads and executes the program instructions, the processor executes steps in any implementation manner of the data monitoring or data transmission method.

In a fifth aspect, embodiments of the present application further provide a computer readable storage medium having stored therein computer program instructions that, when read and executed by a processor, perform the steps of any implementation of the data monitoring or data transmission method described above.

In summary, the embodiments of the present application provide a data monitoring method, a data transmission method, a data monitoring system, and an electronic device, which can define corresponding plug-ins according to actual monitoring services and requirements, expand different types of monitoring modes, and implement different data monitoring functions, so as to collect and monitor data of different data types, improve applicability and effectiveness of data monitoring, increase application range of data monitoring, and are applicable to monitoring scenes of various different requirements.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic block diagram of an electronic device according to an embodiment of the present application;

fig. 2 is a flow chart of a data monitoring method according to an embodiment of the present application;

FIG. 3 is a flowchart illustrating another data monitoring method according to an embodiment of the present disclosure;

fig. 4 is a detailed flowchart of step S200 provided in the embodiment of the present application;

fig. 5 is a flow chart of another data monitoring method according to an embodiment of the present application;

fig. 6 is a flow chart of a data transmission method according to an embodiment of the present application;

fig. 7 is a detailed flowchart of step S700 provided in the embodiment of the present application;

fig. 8 is a detailed flowchart of step S800 provided in the embodiment of the present application;

Fig. 9 is an operation schematic diagram of a data monitoring system according to an embodiment of the present application.

Icon: 100-an electronic device; 111-memory; 112-a memory controller; 113-a processor; 114-a peripheral interface; 115-an input-output unit; 116-a display unit; 900-a data monitoring system; 910-monitoring the device; 920-group devices.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments of the present application without making any inventive effort, are intended to be within the scope of the embodiments of the present application.

In the monitoring mode realized by the existing monitoring system, due to the differences of the monitored components, indexes and the like, various different types of data can be generated, so that when the data is monitored for the different components and indexes, the monitoring requirement is separated from the service, the monitoring indexes acquired by the monitoring system and the service are also in a separated relation, for example, the service availability and the service SLA level possibly focused by customers, and the monitoring system can only generate an alarm according to the system load. In addition, the monitoring function of the monitoring system is determined by hardware, in the Nagios monitoring system, the operation and maintenance management difficulty of the hardware is high, professional personnel are required to install, configure and manage, the operation and maintenance management process is complex, the monitoring function of the monitoring system is difficult to expand, the monitoring scale cannot be changed adaptively, and therefore the applicability of a data monitoring mode is poor, and different types of data cannot be effectively monitored.

In order to solve the above problems, the embodiments of the present application provide a data monitoring method and a data transmission method, which are respectively applied to a monitoring device and a group device. It should be noted that the monitoring device and the group device may be disposed in a cluster of a distributed architecture, where the monitoring device may be used as a central collection device, and the group device may be used as a collection node, and at the same time, perform data monitoring on the clusters where the plurality of group devices are located, so as to improve the efficiency of data monitoring.

Optionally, the monitoring device and the group device may be electronic devices with logic computing functions, such as servers, personal computers (Personal Computer, PCs), tablet computers, smartphones, personal digital assistants (Personal Digital Assistant, PDAs), and the like, and can process and transmit data accordingly, so as to realize data monitoring of a plurality of different types.

Optionally, referring to fig. 1, fig. 1 is a schematic block diagram of an electronic device according to an embodiment of the present application. The electronic device 100 may include a memory 111, a memory controller 112, a processor 113, a peripheral interface 114, an input output unit 115, and a display unit 116. Those of ordinary skill in the art will appreciate that the configuration shown in fig. 1 is merely illustrative and is not limiting of the configuration of the electronic device 100. For example, electronic device 100 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

The above-mentioned memory 111, memory controller 112, processor 113, peripheral interface 114, input/output unit 115 and display unit 116 are electrically connected directly or indirectly to each other to realize data transmission or interaction. For example, the components may be electrically connected to each other via one or more communication buses or signal lines. The processor 113 is used to execute executable modules stored in the memory.

The Memory 111 may be, but is not limited to, a random access Memory (Random Access Memory, RAM), a Read Only Memory (ROM), a programmable Read Only Memory (Programmable Read-Only Memory, PROM), an erasable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), an electrically erasable Read Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc. The memory 111 is configured to store a program, and the processor 113 executes the program after receiving an execution instruction, and a method executed by the electronic device 100 defined by the process disclosed in any embodiment of the present application may be applied to the processor 113 or implemented by the processor 113.

The processor 113 may be an integrated circuit chip having signal processing capabilities. The processor 113 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (digital signal processor, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field Programmable Gate Arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present application may be implemented or performed. The general purpose processor may be a microprocessor, but in the alternative, it may be any conventional processor or the like.

The peripheral interface 114 couples various input/output devices to the processor 113 and the memory 111. In some embodiments, the peripheral interface 114, the processor 113, and the memory controller 112 may be implemented in a single chip. In other examples, they may be implemented by separate chips.

The input-output unit 115 described above is used to provide input data to a user. The input/output unit 115 may be, but is not limited to, a mouse, a keyboard, and the like.

The display unit 116 described above provides an interactive interface (e.g., a user-operated interface) between the electronic device 100 and a user or is used to display image data to a user reference. In this embodiment, the display unit may be a liquid crystal display or a touch display. In the case of a touch display, the touch display may be a capacitive touch screen or a resistive touch screen, etc. supporting single-point and multi-point touch operations. Supporting single-point and multi-point touch operations means that the touch display can sense touch operations simultaneously generated from one or more positions on the touch display, and the sensed touch operations are passed to the processor for calculation and processing. In the embodiment of the present application, the display unit 116 may display various data such as the monitoring requirement, the monitoring data or the early warning information obtained by analysis.

The electronic device in this embodiment may be used to perform each step in each data monitoring method and each step in each data transmission method provided in the embodiments of the present application. The implementation of the data monitoring method and the data transmission method is described in detail below by means of several embodiments.

Referring to fig. 2, fig. 2 is a flowchart of a data monitoring method according to an embodiment of the present application, and the method may include steps S200-S400.

And step 200, analyzing the monitoring service of the monitoring equipment monitoring group equipment to obtain the target monitoring requirement.

The target monitoring requirement may include identity information of the group device and a data type to be collected, so as to define the monitored group device and the data type of the index of the component or the system to be collected. The monitoring service may be service information extracted from a monitoring task when the monitoring device obtains a corresponding monitoring task of the user, for example, when the monitoring task of the user is to monitor a service condition of the group device, the extracted monitoring service may enable the service availability and the service SLA level to be monitored. By performing corresponding analysis processing on the monitoring service, the monitored group device and the data type to be monitored can be limited, for example, information related to the operation of the system of the group device is used as collected data.

Step S300, determining a target plug-in based on the target monitoring requirement.

The target plug-in for automatically collecting the corresponding data types can be determined according to the target monitoring requirement. The target plug-in may be a custom functional extension plug-in written in code according to multiple languages or written using multiple plug-in templates.

Step S400, the target plug-in is sent to the group device so as to acquire the monitoring data sent by the group device based on the target plug-in.

The monitoring equipment can automatically load and expand the target plug-in, and send the target plug-in to the group equipment, so that the group equipment can acquire data based on a defined acquisition method in the target plug-in, receive monitoring data sent by the group equipment, and realize data monitoring of the group equipment.

In the embodiment shown in fig. 2, corresponding plug-ins can be expanded in a self-defined manner according to actual monitoring service and requirements, so that different types of monitoring modes can be expanded, different data monitoring functions can be realized, data of different data types can be collected and monitored, applicability and effectiveness of data monitoring are improved, application range of data monitoring is increased, and the method is suitable for monitoring scenes with different requirements.

Optionally, a history plug-in library may be provided in the monitoring device; referring to fig. 3, fig. 3 is a flowchart of another data monitoring method according to an embodiment of the present application, and the method may further include steps S510-S520.

Step S510, generating a plurality of history plugins according to the history monitoring requirements of the monitoring equipment.

Wherein the historical monitoring requirements may include historical identity information of the group device being monitored and historical data types of historical collection. The corresponding historical monitoring requirements can be obtained through analysis according to the monitoring service of the early stage of the monitoring equipment so as to limit the data types of the collected group equipment and the collected indexes of the components or systems. And compiling and generating corresponding history plug-ins according to the history monitoring requirements. By way of example, the history plug-in with the corresponding acquisition function can be generated by compiling multiple languages, such as go language, so that the history plug-in has the advantages of being capable of being directly deployed without depending on environments, simple to operate, high in compatibility and capable of being compatible with multiple underlying system architectures.

And step S520, the history monitoring requirements and the corresponding history plugins are stored in a correlated mode, and a history plugin library is obtained.

After the corresponding history plug-ins are generated, the history monitoring requirements and the history plug-ins with corresponding relations can be stored in an associated mode, for example, the history monitoring requirements can be used as keys, the history plug-ins can be used as values, and accordingly the history monitoring requirements and the history plug-ins can be stored as key value pairs, and a history plug-in library with multiple groups of history monitoring requirements and history plug-ins is obtained.

In the embodiment shown in fig. 3, the history plug-ins collected for the corresponding group devices and data types can be correspondingly stored and processed according to multiple different history monitoring requirements, so that the history plug-in library can contain multiple custom collection plug-ins with different functions, and multiple different monitoring and collection requirements can be met.

Optionally, referring to fig. 4, fig. 4 is a detailed flowchart of step S200 provided in the embodiment of the present application, and step S200 may include steps S210-S230.

Step S210, inquiring among a plurality of historical monitoring requirements of the historical plugin library based on the target monitoring requirements.

The current target monitoring requirement can be used as a condition during query, the query is performed in the history plug-in library, and the target monitoring requirement is compared with each history monitoring requirement in the history plug-in library to determine whether the target monitoring requirement has the same history monitoring requirement as the target monitoring requirement.

Step S220, if the target monitoring requirement is the same as any one of the history monitoring requirements, a history plug-in associated with the history monitoring requirement is obtained as the target plug-in.

When the target monitoring requirement is the same as any historical monitoring requirement, the condition that the current target monitoring requirement and the historical plug-in stock are the same in requirement is described, and the historical plug-in stored in association with the historical monitoring requirement can be directly obtained as the target plug-in.

Step S230, if it is determined that the target monitoring requirement is different from all the historical monitoring requirements, generating a target plug-in according to the target monitoring requirement, and storing the target monitoring requirement and the target plug-in a historical plug-in library in an associated manner.

When the target monitoring requirement is different from all the historical monitoring requirements, the condition that the current target monitoring requirement and the historical plug-in stock are different in requirement is described, corresponding target plug-ins can be generated through custom writing according to the actual condition of the target monitoring requirement, and the target monitoring requirement and the target plug-ins are stored in the historical plug-in library in an associated mode, so that the historical plug-in library is updated according to the real-time monitoring requirement, and the subsequent monitoring scene is queried and used.

In the embodiment shown in fig. 4, the corresponding target plugins can be determined according to different situations, so that the repeated process of generating the same plugins is effectively reduced, and the efficiency of acquiring the target plugins is improved.

Optionally, referring to fig. 5, fig. 5 is a flowchart of another data monitoring method according to an embodiment of the present application, and the method may further include steps S530 to S550.

Step S530, determining the pre-warning condition corresponding to the target monitoring requirement based on the target plug-in.

In order to effectively manage the monitored situation, the target plugin may further analyze and process the monitored situation to extract a corresponding early warning condition according to the target monitoring requirement, for example, when the target monitoring requirement includes monitoring the memory usage rate of the group device, a corresponding usage rate threshold, for example, 70% may be determined in advance according to the memory usage rate as the corresponding early warning condition.

Step S540, analyzing the monitoring data based on the early warning condition.

The monitoring data and the early warning condition can be compared and analyzed, for example, the memory usage rate in the monitoring data is compared with the early warning condition of 70%, when the memory usage rate is less than 70%, the monitoring data does not meet the early warning condition, and when the memory usage rate is greater than or equal to 70%, the monitoring data meets the early warning condition.

And step S550, if the monitoring data is judged to meet the early warning condition, generating early warning information to prompt the abnormal condition.

If the monitored data meets the early warning condition, for example, when the memory utilization rate is 80%, corresponding early warning information can be generated to prompt the monitored abnormal condition so that a user can look over and analyze the monitored data, thereby tracing the source of the fault, positioning and analyzing the abnormal condition and correspondingly processing the abnormal condition.

Optionally, in order to facilitate the user to view and analyze, the monitoring data and the generated early warning information may be displayed in the display unit of the monitoring device, for example, the monitoring data may be displayed in a chart or the like, the monitoring data may be displayed in a comparison with the history data, and the early warning information may also be prompted in a voice form.

It should be noted that, when the monitored data includes multiple different types of data, the corresponding pre-warning conditions may also be set as multiple different sub-conditions, and when a certain data meets the pre-warning conditions, the corresponding pre-warning conditions may be generated, so as to respectively pre-warn different types of abnormal conditions.

In the embodiment shown in fig. 5, the abnormal condition during monitoring can be prompted in an early warning manner, so that adverse effects caused by the abnormal condition are effectively reduced.

Referring to fig. 6, fig. 6 is a flowchart of a data transmission method according to an embodiment of the present application, and the method may include steps S600-S800.

Step S600, setting is carried out according to the received target plug-in.

The target plug-in is determined by the data monitoring method according to any one of the above steps based on the target monitoring requirement. When the group equipment transmits data, the group equipment can perform corresponding deployment setting according to the target plugin sent by the received monitoring equipment so as to integrate the target plugin into a processing program in the group equipment.

And step S700, corresponding monitoring data are collected based on the target plug-in.

The group device can collect the monitoring data of the corresponding data type in the group device according to the collection function of the target plug-in, so that the data needing to be monitored can be collected only, processing resources during processing such as collection of irrelevant data are reduced, and the operation speed during collection is improved.

Step S800, sending monitoring data to the monitoring device.

The group device can send the monitoring data to the monitoring device for processing through the communication connection.

In the embodiment illustrated in fig. 6, the corresponding data can be acquired based on the acquisition function of the custom plug-in, and irrelevant data is abandoned, so that the load during data transmission is effectively reduced, the accuracy and the efficiency of data acquisition are improved, and the applicability of data monitoring is improved.

Optionally, referring to fig. 7, fig. 7 is a detailed flowchart of step S700 provided in the embodiment of the present application, and step S700 may include steps S710-S720.

Step S710, at least one of hardware information, status information, and operation information is read based on the target plug-in.

The monitoring data may include a plurality of different types of information, such as hardware information, status information, and operation information. The self-defined acquisition function in the target plug-in can automatically read one or more of various different types of information such as hardware information, state information, running information and the like in the group equipment according to the requirement.

For example, the hardware information may include a CPU model number, a CPU core number, a load condition of the CPU for 5 minutes, 10 minutes, and 15 minutes, a memory model number, a total memory amount, a memory usage rate, a byte number of a used swap partition, a disk model number, a maximum capacity of a disk, a disk usage rate, a used capacity and an available capacity of each partition, network card information, mac addresses and IP addresses, a status of each network card interface, and various information such as a data amount transmitted by receiving in real time, a GPU model number, a GPU memory total amount, a GPU core number, a used GPU resource amount, and the like. The state information may include various information such as IOwait, context switch times, open file descriptions, etc.; optionally, when the group device application provides the socket service, the target plug-in may call a socket API to initiate a command, modify the system configuration, and the state information may further include network information (IPV 4, IPV 6) configuration, NTP Server configuration, DNS Server configuration, and SSH configuration. The running information can comprise various information such as https certificate expiration time, running condition of the current cluster service system, running condition of each component of the current cluster, daemon running condition and the like.

Step S720, the hardware information, the state information or the operation information is encrypted to obtain the monitoring data.

In order to improve the security during data monitoring, the read information can be correspondingly encrypted so as to reduce the condition that the monitored data is intercepted or tampered.

Illustratively, the encryption process may be performed in a variety of ways, such as: the hardware information, the state information or the running information is encrypted through ed25519, or access authority is limited through a custom unix.

In the embodiment shown in fig. 7, the required information can be extracted and encrypted accordingly, so that the processing resources of irrelevant data are reduced, the load during data acquisition is reduced, and the data acquisition efficiency is improved.

Optionally, referring to fig. 8, fig. 8 is a detailed flowchart of step S800 provided in the embodiment of the present application, and step S800 may include steps S810-S830.

Step S810, detecting whether the real-time transmission channel is normal.

In order to reduce abnormal situations of data transmission, two transmission channels which do not interfere with each other may be respectively set in the group device, for example, a real-time transmission channel and a timing transmission channel may be set in a mode of a daemon system d+timing cron.d, which supports real-time information transmission and also supports timing batch reporting. Before data transmission, whether the real-time sending channel is normal or not can be detected so as to select the corresponding channel for data transmission.

Step S820, if the real-time transmission channel is judged to be normal, the monitoring data is transmitted to the monitoring device based on the real-time transmission channel.

The real-time sending channel is normal, and the volume of the monitoring data is small, when the monitoring data can be normally transmitted by the real-time sending channel, the real-time sending channel is normal, the timing sending channel can be closed, the monitoring data is transmitted by the real-time sending channel, and therefore the load of the group equipment in data transmission is reduced under the condition of normal data transmission.

In step S830, if it is determined that the real-time transmission channel is abnormal, the monitoring data is transmitted to the monitoring device based on the real-time transmission channel and the timing transmission channel, or the monitoring data is transmitted to the monitoring device based on the timing transmission channel.

The real-time sending channel abnormality can be divided into various situations, for example, when the real-time sending channel abnormality, for example, is closed or blocked, the real-time sending channel can be closed, the timing sending channel is opened, and the monitoring data is transmitted only by adopting the timing sending channel; when the volume of the monitored data is large and the real-time sending channel cannot normally transmit the monitored data, the timing sending channel can be started, and meanwhile, the real-time sending channel and the timing sending channel are adopted to normally transmit the monitored data together, so that when transmission abnormality occurs, normal transmission of the data is maintained with a small transmission load.

In the embodiment shown in fig. 8, by setting a plurality of transmission channels, when the real-time transmission function is abnormal, the transmission of data can be processed by using the timing transmission function, so that the stability of the data transmission is effectively improved.

Referring to fig. 9, fig. 9 is a schematic operation diagram of a data monitoring system according to an embodiment of the present application, where the data monitoring system 900 may include a monitoring device 910 and a group device 920, where the monitoring device 910 is communicatively connected to the group device 920.

Optionally, the monitoring device 910 and the group devices 920 may be disposed in a cluster of a distributed structure, where the monitoring device 910 may be communicatively connected to one or more group devices 920 through a wired network, a wireless network, bluetooth, etc., and only one group device 920 is shown in fig. 9, and the other number of cases will not be described herein.

The monitoring device 910 is configured to analyze a monitoring service of the monitoring device 910 for monitoring the group device 920, so as to obtain a target monitoring requirement; determining a target plug-in based on the target monitoring requirement; transmitting the target plugin to the group device 920 to acquire monitoring data transmitted by the group device 920 based on the target plugin; wherein, the target monitoring requirement includes: identity information of the group device 920 and the type of data to be collected;

The group device 920 is configured to perform setting according to the received target plugin; collecting corresponding monitoring data based on the target plug-in; sending monitoring data to the monitoring device 910; wherein the target plugin is determined by the data monitoring method according to any one of the above based on the target monitoring requirement.

In an alternative embodiment, a library of history plug-ins is provided in the monitoring device 910; the monitoring device 910 is further configured to: generating a plurality of history plugins according to the history monitoring requirements of the monitoring device 910; the history monitoring requirements and the corresponding history plugins are stored in an associated mode, and a history plugin library is obtained; wherein, the historical monitoring needs include: historical identity information and historical collected historical data types for the monitored group device 920.

In an alternative embodiment, the monitoring device 910 is specifically configured to: inquiring among a plurality of historical monitoring demands of a historical plugin library based on the target monitoring demands; if the target monitoring requirement is the same as any one of the history monitoring requirements, acquiring a history plug-in associated with the history monitoring requirement as a target plug-in; if the target monitoring requirement is different from all the historical monitoring requirements, generating a target plug-in according to the target monitoring requirement, and storing the target monitoring requirement and the target plug-in a historical plug-in library in an associated mode.

In an alternative embodiment, the monitoring device 910 is further configured to: determining an early warning condition corresponding to the target monitoring requirement based on the target plug-in; analyzing the monitoring data based on the early warning condition; and if the monitoring data meets the early warning condition, generating early warning information to prompt the abnormal condition.

In an alternative embodiment, group device 920 is specifically configured to: reading at least one of hardware information, state information and running information based on the target plug-in; and encrypting the hardware information, the state information or the operation information to obtain the monitoring data.

In an alternative embodiment, the group device 920 has a real-time transmission channel and a timing transmission channel; the group device 920 is specifically configured to: detecting whether the real-time transmission channel is normal or not; if the real-time transmission channel is judged to be normal, monitoring data is transmitted to the monitoring device 910 based on the real-time transmission channel; if it is determined that the real-time transmission channel is abnormal, the monitoring data is transmitted to the monitoring apparatus 910 based on the real-time transmission channel and the timing transmission channel, or the monitoring data is transmitted to the monitoring apparatus 910 based on the timing transmission channel.

Since the principle of the data monitoring system 900 in the embodiment of the present application for solving the problem is similar to the foregoing embodiments of the data monitoring method and the data transmission method, the implementation of the data monitoring system 900 in the embodiment of the present application may refer to the descriptions in the foregoing embodiments of the data monitoring method and the data transmission method, and the repetition is omitted.

The embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium stores computer program instructions, and when the computer program instructions are read and executed by a processor, the steps in any one of the data monitoring or data transmission methods provided in the embodiment are executed.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other ways. The system embodiments described above are merely illustrative, for example, the block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices according to various embodiments of the present application. In this regard, each block in the block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams, and combinations of blocks in the block diagrams, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In addition, the functional modules in the embodiments of the present application may be integrated together to form a single part, or each module may exist alone, or two or more modules may be integrated to form a single part.

The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely exemplary embodiments of the present application and is not intended to limit the scope of the present application, and various modifications and variations may be suggested to one skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application. It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.

The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.

Claims

1. A data monitoring method, wherein the method is applied to a monitoring device, the method comprising:

determining a target plug-in based on the target monitoring requirement;

2. The method of claim 1, wherein a library of history plug-ins is provided in the monitoring device;

the history plug-in library is generated by:

3. The method of claim 2, wherein the determining a target plugin based on the target monitoring requirement comprises:

4. A method according to any one of claims 1-3, characterized in that the method further comprises:

analyzing the monitoring data based on the early warning condition;

5. A method of data transmission, the method being applied to a group of devices, the method comprising:

setting according to the received target plug-in;

collecting corresponding monitoring data based on the target plug-in;

Sending the monitoring data to monitoring equipment;

wherein the target plugin is determined by the data monitoring method of any one of claims 1-4 based on target monitoring requirements.

6. The method of claim 5, wherein the collecting the respective monitoring data based on the target plugin comprises:

7. The method of claim 5, wherein the group device has a real-time transmit channel and a timing transmit channel disposed therein;

detecting whether the real-time sending channel is normal or not;

8. A data monitoring system, the system comprising: monitoring devices and group devices; the monitoring equipment is in communication connection with the group equipment;

the group device is used for setting according to the received target plug-in; collecting corresponding monitoring data based on the target plug-in; sending the monitoring data to monitoring equipment; wherein the target plugin is determined by the data monitoring method of any one of claims 1-4 based on target monitoring requirements.

9. An electronic device comprising a memory and a processor, the memory having stored therein program instructions which, when executed by the processor, perform the steps of the method of any of claims 1-7.

10. A computer readable storage medium, characterized in that the readable storage medium has stored therein computer program instructions which, when executed by a processor, perform the steps of the method of any of claims 1-7.