WO2020147264A1

WO2020147264A1 - Method, apparatus and device for monitoring multi-system log data, and readable storage medium

Info

Publication number: WO2020147264A1
Application number: PCT/CN2019/092960
Authority: WO
Inventors: 谢满锐; 付飞腾; 李志冬; 宫林涛
Original assignee: 平安科技（深圳）有限公司
Priority date: 2019-01-14
Filing date: 2019-06-26
Publication date: 2020-07-23
Also published as: CN109739730A; CN109739730B

Abstract

Disclosed by the present application are a method, apparatus and device for monitoring multi-system log data, and a readable storage medium. The method comprises: when a deployment request is received, reading a parameter type corresponding to the deployment request, and determining whether a target system parameter corresponding to the parameter type exists among system parameters of each deployment system; if the target system parameter exists, then allocating an interface group number and a display template group number to a system to be deployed according to the target system parameter; when detection reaches a preset time interval corresponding to the interface group number, calling an interface corresponding to the interface group number, and receiving current parameters transmitted on the basis of the interface; and reading a system identifier carried in each current parameter, and according to the system identifier, transmitting each current parameter to a display template corresponding to the display template group number for display so as to monitor the current parameters in log data that originates from each deployment system. The present solution conducts differential monitoring on various parameters of a plurality of systems by means of big data processing technology and meets the monitoring needs of different systems.

Description

Monitoring method, device, equipment and readable storage medium of multi-system log data The

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on January 14, 2019, the application number is 201910037704.9, and the invention title is "Multi-system log data monitoring method, device, equipment, and readable storage medium". The entire content is incorporated into the application by reference.

Technical field

This application mainly relates to the technical field of data processing, and specifically to a method, device, equipment and readable storage medium for monitoring log data of multiple systems.

Background technique

With the development of science and technology and the Internet, more and more organizations tend to use different systems to manage different types of data and resources, so that when acquiring different types of data or resources, different systems are required. Access; In order to ensure the normal operation of each system, it is usually necessary to monitor the log data of each system, and use the log data to determine whether there is any abnormality in the operation of each system.

At present, the log data monitoring of each system is performed in the same way, but the types of data stored or the business resources provided by each system are different, and the same method is used to monitor each system, which does not reflect the characteristics of each system; at the same time; In the case of large differences between systems, the same monitoring method is difficult to balance the monitoring requirements of each system, making the monitoring not accurate enough, and manual assistance is needed; this reduces the monitoring efficiency and increases the labor cost.

Summary of the invention

The main purpose of this application is to provide a method, device, equipment, and readable storage medium for monitoring log data of multiple systems, aiming to solve the problem that different systems are monitored in the same way in the prior art, and the monitoring does not accurately reflect each system The problem of low monitoring efficiency and high labor cost.

To achieve the above objective, the present application provides a method for monitoring log data of multiple systems. The method for monitoring log data of multiple systems includes the following steps:

When a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system;

If there is a target system parameter corresponding to the parameter type, according to the target system parameter, the system to be deployed corresponding to the deployment request is assigned an interface group number and a display template group number to update the system to be deployed To deploy the system;

When the detection reaches the preset time interval corresponding to the interface group number, call the interface corresponding to the interface group number, and receive the current parameters transmitted based on the interface;

Read the system identifier carried in each of the current parameters, and according to the system identifier, transmit each of the current parameters to the display template corresponding to the display template group number for display, so as to display The current parameters in the log data of the system are monitored.

In addition, in order to achieve the above objective, this application also proposes a monitoring device for multi-system log data, and the monitoring device for multi-system log data includes:

The reading module is configured to, when a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system;

The allocation module is configured to, if there is a target system parameter corresponding to the parameter type, according to the target system parameter, assign an interface group number and a display template group number to the system to be deployed corresponding to the deployment request, so as The system to be deployed is updated to the deployment system;

The calling module is configured to call the interface corresponding to the interface group number when the detection reaches the preset time interval corresponding to the interface group number, and receive the current parameters transmitted based on the interface;

The monitoring module is used to read the system identification carried in each of the current parameters, and according to the system identification, transmit each of the current parameters to the display template corresponding to the display template group number for display, so as to verify the source Monitor the current parameters in the log data of each deployment system.

In addition, in order to achieve the above objective, the present application also proposes a monitoring device for multi-system log data. The monitoring device for multi-system log data includes a memory, a processor, a communication bus, and a multi-system log stored on the memory. Data monitoring program;

The communication bus is used to realize connection and communication between the processor and the memory;

The processor is used to execute the monitoring program of the multi-system log data to implement the following steps:

In addition, in order to achieve the above object, the present application also provides a readable storage medium that stores one or more programs, and the one or more programs can be executed by one or more processors to Used for:

The multi-system log data monitoring method of this embodiment reads the parameter type corresponding to the received deployment request, and determines whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system; if it exists, According to the target system parameters, the system to be deployed corresponding to the deployment request is assigned the interface group number and the display template group number, and the system to be deployed is updated to the deployment system; after that, when the detection reaches the preset time interval corresponding to the interface group number, then Call the interface corresponding to the interface group number, and receive the current parameters transmitted based on the interface; then read the system identification carried in each current parameter, and transmit each current parameter according to the read system identification Display in the display template corresponding to the display template group number, so as to realize the monitoring of the current parameters in the log data from each deployment system. The parameter type corresponding to the deployment request in this solution is the parameter type that needs to be monitored by the system to be deployed. When there is a target system parameter corresponding to the parameter type, it means that the system parameters of each deployed system that have been deployed exist The deployment system that monitors this parameter type can assign the interface group number and display template group number to the system to be deployed based on the target system parameters, and update the system to be deployed to the deployment system; have the same interface group number and display template group number Each deployment system of the company uses the same interface for data transmission and uses the same display template for data display; and each deployment system with different interface group numbers and display template group numbers uses different interfaces for data transmission and uses different display templates for data display ; While achieving differentiated monitoring of the different monitoring requirements between deployment systems, it also implements the reuse of interfaces and display templates between deployment systems with the same monitoring requirements; each deployment system is based on its own While performing accurate monitoring, it saves monitoring resources.

BRIEF DESCRIPTION

FIG. 1 is a schematic flowchart of a first embodiment of a method for monitoring log data of multiple systems according to the present application;

2 is a schematic diagram of functional modules of the first embodiment of the multi-system log data monitoring device of the present application;

FIG. 3 is a schematic diagram of the device structure of the hardware operating environment involved in the method of the embodiment of the present application.

The implementation, functional characteristics and advantages of the present application will be further described in conjunction with the embodiments and with reference to the drawings.

detailed description

It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

This application provides a method for monitoring log data of multiple systems.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a first embodiment of a method for monitoring log data of multiple systems according to this application. In this embodiment, the method for monitoring multi-system log data includes:

Step S10, when a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system;

The multi-system log data monitoring method of this application is applied to a monitoring server, and is suitable for monitoring log data generated by multiple systems through the monitoring server, and the monitored log data reflects the operation of each system. In order to monitor the log data of each system, the information of each system needs to be added to the monitoring server first, so that the monitoring server has the authority to obtain the log data of each system. Adding system information to the monitoring server can be done through deployment requests. When a system has monitoring requirements for the log data it generates, a deployment request is sent to the monitoring server; because the log data involves multiple types of data, some The data is related to the operation of the system, while some other data is not related to the operation of the system; in order to monitor the operation of the system, it is necessary to specify the parameter type of the data to be monitored when sending the deployment request, such as the amount of access to the system interface and the response time , Access success rate, call status code, etc. The specified parameter type and deployment request are sent to the monitoring server. When the monitoring server receives the deployment request, it reads the parameter type corresponding to the deployment request and judges the deployments that have been deployed on the monitoring server Among the system parameters selected by the system for monitoring, whether there are target system parameters that are consistent with the corresponding parameter types of the deployment request. This consistent target system parameter indicates that there is a system parameter monitored by a certain system in each deployment system that has been deployed, and is consistent with the parameter type that the system currently sending the deployment request needs to monitor.

Considering that different systems are developed from different versions of development environments, such as Python2.6, Python2.7 or Python3.x, etc.; and the monitoring environment version supported by the monitoring server has certain restrictions, and it cannot support any environment version. Monitoring; for example, it can support monitoring of the system developed by the environment version Python2.7, but does not support the monitoring of the system developed by the environment version Python1.0, etc. The environment version number supported by the monitoring server is used as the preset version number. Before monitoring the system that sends the deployment request, the validity of the system environment version needs to be tested; specifically, when the deployment request is received, The steps to read the parameter type corresponding to the deployment request include:

Step S11, when a deployment request is received, read the environment version number of the system to be deployed, and determine whether the environment version number is a valid version number;

Further, the system that sends the deployment request is taken as the system to be deployed, and when the monitoring server receives the deployment request sent by the system to be deployed, it reads the environment version number of the system to be deployed, and reads the read environment version number and The preset version numbers are compared to determine whether the environment version number exists in each preset version number, that is, it is determined that the environment version number is consistent with one of the preset version numbers.

Step S12, if it is a valid version number, read the log path of the system to be deployed, and after adding the log path to the preset configuration file, read the parameter type corresponding to the deployment request;

Step S13: If it is not a valid version number, output a first prompt message to prompt that the system to be deployed does not support deployment.

If it is determined that the environment version number exists in each preset version number, it means that the environment version number is a valid version number, and the monitoring server supports the monitoring of the system to be deployed; thus, the log path of the path to be deployed is read and read The log path is added to the preset configuration file. The log path is the path used to store the log data generated by the system to be deployed, and the preset configuration file is a file preset in the monitoring server to configure the log path of each deployment system; add the log path to the preset configuration file After the addition is complete, read the corresponding parameter type in the deployment request to determine the parameters that need to be monitored in the log data through the parameter type; during the operation of the monitoring server, collect and deploy according to the path in the preset configuration file This type of parameters in the log data generated by the system is then analyzed and monitored for the collected parameters. When it is judged that the environment version number does not exist in each preset version number, that is, the environment version number is not a valid version number, it means that the monitoring server does not support monitoring of the system developed by this environment version number, and thus outputs the first Prompt information. The first prompt information includes two aspects. On the one hand, it prompts personnel related to the system to be deployed that the system to be deployed does not support monitoring; on the other hand, it prompts developers to optimize the monitoring server so that the monitoring server supports the system to be deployed. monitor.

In addition, for a system that provides services in a distributed manner, that is, the various functions of the system are distributed on multiple servers, and the overall function of the system is realized in a distributed manner; if such a system has monitoring requirements, it will cooperate with the system. The log paths of the corresponding servers are respectively added to the preset configuration files, and the monitoring server collects the parameter data of the distributed system one by one according to each log path, and conducts integrated analysis of each parameter data.

Step S20: If there is a target system parameter corresponding to the parameter type, according to the target system parameter, the system to be deployed corresponding to the deployment request is assigned an interface group number and a display template group number, so as The deployment system is updated to the deployment system;

Understandably, there are differences in the types of parameters that need to be monitored by different systems. For example, the types of parameters that need to be monitored for some systems are the amount of access, response time and success rate of the system interface, while the types of parameters that need to be monitored for other systems It is the access volume, response time, success rate and calling status code of the system interface. If it is determined that there is a target system parameter corresponding to the parameter type among the monitored system parameters, it means that there is a monitored deployed system in the monitoring server that has the same monitoring requirements for the parameter type as the system to be deployed. For deployment systems with the same monitoring requirements, the same interface can be used to read this type of parameter, and the same display template can be used to display the monitored parameters to reuse various resources in the monitoring server.

Divide the deployment systems that have the same monitoring requirements, the same interface and the same display template into the same interface group and the same display template group; when there is a target system parameter, the target system parameter corresponds to the interface group and display template group , Each deployment system possesses monitors and displays the target system parameters. Therefore, for the system to be deployed corresponding to the deployment request, the system to be deployed can be assigned the interface group number and the display template group number according to the target system parameters; the system to be deployed is divided into the target system parameters corresponding to the target system parameters through the interface combination and display template group number In the interface group and the display template group, update the system to be deployed to the deployment system to complete the deployment of the system to be deployed, and then the monitoring server can monitor the parameters of the deployed system to be deployed. For example, the read parameter types include a1, b1, and c1, and for the deployed systems W1, W2, W3, and W4 that have been monitored, the system parameters monitored by W1 and W3 are parameters of types a1, a2, b2, and b3, and W2 The system parameters monitored by W4 and W4 are parameters of types a1, b1, and c1; thus there are target system parameters corresponding to the parameter types, and the deployment systems W2 and W4 corresponding to the target system parameters belong to the same interface group and the same display template group, The group numbers are p1 and p2 respectively, then the interface group number and display template group number of the system to be deployed are assigned to p1 and p2 to assign the system to be deployed and W2 and W4 to the same interface group and the same display template group. Read and monitor the parameters of each deployment system whose parameter types are a1, b1, and c1.

Understandably, the currently deployed system that sends the deployment request requires monitoring parameters that are not the same as the monitored parameters of the deployed system; that is, there is no target system parameter corresponding to the parameter type among the monitored system parameters. The monitored parameter type is a newly emerging parameter type; the monitoring server lacks a mechanism for monitoring the newly emerging parameter type, and the monitoring service needs to be optimized. Specifically, the step of determining whether there is a target system parameter corresponding to the parameter type among the system parameters of each deployment system includes:

Step a1, if there is no target system parameter corresponding to the parameter type, output second prompt information to prompt to update the preset parameter based on the parameter type;

When it is determined that the parameter type that needs to be monitored by the system to be deployed does not have a corresponding target system parameter in each deployed system that has been monitored, a second prompt message is output; the second prompt message includes the parameter type so that developers can follow The parameter type updates the preset parameters. The preset parameters are the parameters that can be monitored by the monitoring server, and the update is to update the type of the preset parameters according to the parameter type, and form the updated parameters into an update interface and an update display template. The update interface and the update display template can be treated The types of parameters that need to be monitored by the deployment system are monitored and displayed.

Step a2: When the updated preset parameters and the updated interface group number and the updated display template group number corresponding to the updated preset parameters are received, the update interface combination and the updated display template group number are assigned as the same The deployment request corresponds to the interface group number and the display template group number of the system to be deployed, so as to update the system to be deployed to the deployment system.

Understandably, during the operation of the monitoring server, the update interface and update display template may be used for monitoring of other systems, that is, other systems have monitoring requirements for the parameters corresponding to the parameter type; in order to facilitate subsequent monitoring operations, the interface and The updated display template is formed into the updated interface group and the updated display template, and the interface numbers of both are set, that is, the updated interface group number and the updated display template number. Due to the updated preset parameters and the corresponding updated interface group and updated display template group, they are used to monitor the parameters corresponding to the parameter type, so that the updated preset parameters and the corresponding updated preset parameters are received. When updating the interface group number and updating the display template group number, assign the update interface group number and the update template group number as the interface group number and display template group number of the system to be deployed, and treat them by updating the interface group number and update template group number The parameter type of the deployment system is monitored, and the system to be deployed is updated to the deployment system.

Step S30: When it is detected that the preset time interval corresponding to the interface group number is reached, the interface corresponding to the interface group number is called, and the current parameters transmitted based on the interface are received;-corresponding to the preset time basis Varies by deployed system

Further, set the preset time interval for reading and monitoring the parameters in each deployment system according to the monitoring requirements in advance, such as 10 minutes, two hours, one day, one week, etc.; each deployment system with the same interface group number is the same interface The preset time intervals set by each deployment system in the group may be the same or different. If they are the same, the parameters of each deployment system will be read at the same time, and the read parameters will be distinguished according to the deployment system; If they are not the same, read the parameters of each deployed system at different times. The same or different preset time interval is regarded as the preset time interval corresponding to the interface group number. When the detection reaches the preset time interval, the interface corresponding to the interface group number is called, and the The current parameters transmitted by the interface. The current parameter is the parameter corresponding to the parameter type and received within the current preset time interval.

Step S40: Read the system identification carried in each of the current parameters, and according to the system identification, transmit each of the current parameters to the display template corresponding to the display template group number for display, so that The current parameters in the log data of the deployment system are monitored.

Furthermore, because the preset time interval may involve the monitoring time of multiple deployment systems, the current parameters received may also originate from multiple deployment systems and need to be distinguished. Specifically, different deployment systems are assigned different system identifiers during the deployment process, so that different deployment systems can be distinguished by the system identifiers, and the current parameters transmitted by each deployment system also carry information that characterizes the deployment system from which they originate. System identification, so that the system identification carried in the received current parameter is read first, and then each current parameter is classified as corresponding to different deployment systems according to the system identification. Since the display template groups used for parameter display between different deployment systems in the same interface group are also the same, after dividing each current parameter into corresponding to each deployment system, the current parameters corresponding to each deployment system are transmitted To the display template paired with the display template group. Because the display template corresponding to the display template group is applicable to each deployment system with the display template group number, in the process of transmitting the current parameters of each deployment system to the display template, the display template can be called multiple times to correct The current parameters of different deployment systems are displayed. If the deployment system with the display template group number includes M1, M2, and M3, and the corresponding system identifiers are m1, m2, and m3, the current parameters received this time include the parameters that carry m1 and the parameters that carry m3. According to the system identification, the current parameters are divided into a parameter D1 corresponding to M1 and a parameter D2 corresponding to M3; the display template is then called twice to transmit D1 and D2 to the display template for display.

Considering that relative to the current parameters received in the current preset time interval, the corresponding parameters will be received in the previous preset time interval, and the corresponding parameters will also be transmitted to the display template for display; When displaying, you can directly use the previously displayed display template to avoid re-calling the display template, and to achieve a comparison with the previous corresponding parameters. For example, for the above-mentioned parameter D1 corresponding to M1 and parameter D2 corresponding to M3, if the parameters corresponding to M1 and M3 are displayed before, the display template is called, and the display template is assigned its corresponding system identifiers m1 and m3; During the current display, the display templates previously displayed for the corresponding parameters of M1 and M3 can be determined according to the system identification, and the parameters D1 and D2 are respectively transmitted to the previous display templates for display. Through the same interface group and display template group, the current parameters transmitted by each deployment system in the current preset time interval are received and displayed, so as to realize the monitoring of each parameter in each deployment system that has the same monitoring requirements for log data; For each deployment system with different monitoring requirements for log data, different interface groups and display template groups can be used to receive and display parameters; that is, through various types of interface groups and display template groups, various monitoring requirements can be realized The deployment system for log data monitoring.

Further, in another embodiment of the multi-system log data monitoring method of the present application, the step of transmitting each of the current parameters to the display template corresponding to the display template group number according to the system identifier includes :

Step S41, classify each of the current parameters according to the system identifier, and determine the current system parameters corresponding to each of the deployment systems;

Furthermore, in the process of classifying the current parameters according to the system identification, the current parameters from the same deployment system with the same system identification are classified into the same category, that is, the current parameters in the same category are all derived from the same Deployment system; after all current parameters are classified, the current system parameters corresponding to each deployment system can be determined.

Step S42: Read the type identifiers carried in the current parameters of each of the systems, and perform classified statistics on the current parameters of each of the systems according to the type identifiers, and generate various types of current parameters of the systems in each of the deployment systems Statistical results;

Considering that the parameters to be monitored by the deployment system involve multiple types, that is, the current system parameters of each deployment system obtained by classification involve multiple types, such as visit volume, response time, success rate, etc. . In order to display each parameter according to type in the display template, it is necessary to classify the current system parameters of each deployed system. When each deployment system generates its log data, it assigns different type identifiers according to different types, so that each parameter data transmitted by each deployment system, that is, the current parameters of the system, carries a type identifier that characterizes its type. After determining the current system parameters of each deployment system, take each deployment system as a unit, read the type identification carried in the current parameters of each system, and classify and count the current parameters of each system according to each type identification, and generate each deployment The statistical results of current parameters of various systems possessed by the system. The number of classes of statistical results is determined by the number of classes identified by the type, that is, the number of parameter types that need to be monitored; for example, in one embodiment, the type identification includes three types: access identification, response time identification, and success identification, that is, what needs to be monitored There are three types of parameters; according to the identification of each type, the current parameters of each system are classified and statistics, and the steps to generate statistical results of the current parameters of various systems in each deployment system include:

Step S421: Classify the access data, response time data, and success data in the current parameters of each system according to the access identifier, response time identifier, and success identifier;

Understandably, when the type identification includes access identification, response identification, and success identification, it indicates that the parameter types that need to be monitored are access data, response data, and success data; thus, based on the access identification, response identification, and success identification, each deployment The system is a unit, and the current parameters of each system are classified into access data, corresponding data and success data. Read the type identification carried by the current parameters of each system one by one, and compare the type identification with the access identification, response identification, and success identification to determine the identification of the three that is consistent with the read type identification; this consistent identification characterizes the system The type of the current parameter. If the consistent identifier is the access identifier, it means that the current parameter of the system is access data; when the current parameters of each system in each deployment system have been read type identification and comparison operations, the deployment of each system is completed The current parameters of each system are divided into access data, response time data and success data.

Step S422, counting the number of times of access to the access data and the number of successes of the success data, and using the counted number of successes and the number of visits as a ratio to generate an access success rate;

Further, the access data is the data generated by each access to the deployment system in the preset time interval, and the success data is the data generated by the successful access to the deployment system each time in the preset time interval; access to the access data The number of times is counted to represent the number of accesses to the deployment system within a preset time interval; at the same time, the number of successes in the success data is counted to represent the number of successful accesses to the deployment system within a preset time interval. Using the statistics of the number of successful visits and the number of visits as a ratio, the result of the ratio is the success rate of successful visits to the deployed system within a preset time interval, which represents the probability of successful visits in the total visits.

Step S423: Divide each of the response time data into each of the preset time intervals, and count the number of response time data in each of the preset time intervals to generate each quantity value;

Furthermore, multiple preset time intervals characterizing different response durations are preset, such as 1s to 2s, 2s to 5s, 5s to 8s, and other preset time intervals; the greater the value represented in the preset time interval, Explain that the longer the response time. Each response time data obtained by classification is compared with each preset time interval to determine the preset time interval where each response time data is located, and then each response time data is divided into the preset time interval where it is located. Thereafter, the quantity of response time data in each preset time interval is counted, and the quantity value in each preset time interval is generated. If the response time data includes 1.2s, 1.5s, 1.8s, 1.2s, 3s, 3.5s, 4s, 6s, after comparison, 1.2s, 1.5s, 1.8s, 1.2s can be divided into 1s to 2s. In the preset time interval, 3s, 3.5s, 4s are divided into the preset time interval formed by 2s to 5s, and 6s is divided into the preset time interval formed by 5s to 8s; and then each preset time The number of response time data in the interval is counted, and the data amount from 1s to 2s is 4, the data amount from 2s to 5s is 3, and the data amount from 5s to 8s is 2.

In step S424, each of the quantity values and the total quantity of the response time data are ratioed to generate the response rate of each of the preset time intervals, and each of the response rates, access data, success data, and access success rate Generated as a statistical result of the current parameters of the various types of systems in each of the deployment systems.

Further, the amount of data in each preset time interval represents the number of responses in each preset time interval when the deployment system responds to the visit; in order to reflect the degree of the response times in each preset time interval High and low, the total number of response time data is counted, and the total number is the total number of times the system is deployed to respond to each visit within the preset time interval. The ratio of each quantity value to the total quantity is used to generate the response rate of each preset time interval. The response rate characterizes the number of responses in each preset time interval. When the response rate of the preset time interval is larger, it means The more the response times within the preset time interval, the more the response time of the deployment system to access falls within the preset time interval. For example, for the above response time data of 1.2s, 1.5s, 1.8s, 1.2s, 3s, 3.5s, 4s, 6s, the total number is 8, and the response rates obtained by ratioing the number value to the total number are respectively 0.5, 0.375, and 0.125; it indicates that the response time of the deployment system to the access is more likely to fall within the preset time interval between 1s and 2s. The response rate, access data, success data and access success rate generated by the statistics are the statistical results generated by the statistics of the current parameters of the various systems in the deployment system; for the access data and response time data as the current parameters of the system Perform statistics with the three types of success data, and the resulting statistical results include response rate, access data, success data, and access success rate; the number of categories of the statistical results can be set according to requirements. After the setting is completed, The statistical results corresponding to the number of types can be generated; each statistical result carries the type identification of the current parameter of the system from which it originated, such as the response rate carrying the response time identification, and the access success rate carrying the success identification.

Step S43: Call the display template corresponding to the display template group number, and add each statistical result to each display area in the display template for display according to the type identification.

Furthermore, after generating the statistical results of the current parameters of various systems, the display template corresponding to the display template group number is called. The display template has different display areas, and each display area carries the system that characterizes it. The type identification of the current parameter type is used to differentiate and display the current parameters of different types of systems. The type identification carried in the statistical result is compared with the type identification in the display area one by one to determine the target display area in the display area that has the same type identifier as the statistical result, and then the statistical result is added to the target display area for display. After each statistical result is added to each corresponding display area for display, the display of each statistical result is completed.

Further, in another embodiment of the multi-system log data monitoring method of the present application, the step of adding each of the statistical results to each display area in the display template for display includes:

Step S44: Read the last statistical result generated by each deployment system in the last preset time interval, and compare each statistical result with the last statistical result according to the system identifier, and generate Comparison results;

Further, in order to reflect the changes in the operation of each deployment system, a mechanism is set up to compare various statistical results at different preset time intervals; specifically, the statistics generated by each deployment system in the previous preset time interval are compared. A statistical result is read, and the statistical result generated by each deployed system at the current preset time interval is compared with the previous statistical result to generate a comparison result. Since there are many deployment systems involved, the comparison process is based on the system identification, that is, the previous statistical result with the same system identification is compared with the statistical result. At the same time, compare the previous statistical result with the various parameters in the statistical result according to the type identification to ensure that the comparison is carried out between the same type of parameters; for example, the access success rate in the statistical result of the same deployment system and the previous statistical result Compare the access success rate in.

Step S45: According to the type identification, the comparison result is added to the comparison area in the display template for display, so as to update the statistical results displayed in each display area in the display template.

Furthermore, each statistical result carries a type identifier that characterizes its type. In the comparison result obtained by comparing the statistical result with the previous statistical result, while carrying the type identifier of the statistical result from its source, it also corrects The type identification is updated, and a comparison identification is added on the basis of the type identification to characterize the data generated by the comparison of a certain type of parameter in the comparison result. A comparison area is preset in the display area of the display template, and the comparison area is provided with an identifier for displaying the comparison data and the type of the parameter displayed in the comparison area. Therefore, according to the updated type identification, the comparison area of the parameter type corresponding to the comparison result displayed in the display template is determined, and each comparison result is added to each comparison area of the display template based on the type identification for display, and the previous display template displays various items The display area of the statistical results is updated.

In addition, you can capture the real-time data of the log data in each deployed system and display the real-time data in the display template. By displaying the real-time data in the log data, the statistical results of the current parameters of various systems, and the comparison results that characterize the changing trend Display templates in different display areas at the same time to facilitate the monitoring of various monitoring data of each deployment system, and then analyze and optimize each deployment system.

Considering that there are many deployment systems monitored by the monitoring server, each deployment system has a corresponding display template. If each display template is displayed in the same interface, it will have an impact on the display effect; thus, a unified system can be set for each deployment system. The display template management interface, by selecting the deployment system to be displayed in the management interface, it jumps to the display template corresponding to the deployment system for display. Specifically, the step of updating the statistical results displayed in each display area in the display template includes:

Step S46, when receiving the viewing instruction, read the viewing system identification carried in the viewing instruction;

Step S47, comparing the viewing system identification with the system identification corresponding to each of the display templates to determine the target system identification;

Step S48: Call the target display template corresponding to the target system identifier, and output the target display template to the monitoring interface for display.

Further, the names of each deployment system are displayed in the management interface in the form of virtual buttons, and each virtual button of the name carries the system identification of the corresponding deployment system; when there is a need to view the display template of a certain deployment system , By clicking the virtual button corresponding to the name of the deployment system in the management interface, you can view the display templates of the deployment system. Specifically, the click operation is received as a viewing instruction for viewing the display template, because the viewing instruction is triggered according to the virtual button of the deployment system name, which carries the system identification; the system identification is read as the viewing system identification, And compare the viewing system identification with the system identification corresponding to each display template, determine the target system identification of each system identification that is consistent with the viewing system identification; then call the target display template with the target system identification, and the target display template is The display template viewed for the needs. The target display template is output to the monitoring interface for display to realize the viewing requirements for the display template.

In addition, please refer to Figure 2. The present application provides a monitoring device for multi-system log data. In the first embodiment of the multi-system log data monitoring device of the present application, the multi-system log data monitoring device includes:

The reading module 10 is configured to, when a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system;

The allocation module 20 is configured to, if there is a target system parameter corresponding to the parameter type, according to the target system parameter, assign an interface group number and a display template group number to the system to be deployed corresponding to the deployment request to The system to be deployed is updated to a deployment system;

The calling module 30 is configured to call the interface corresponding to the interface group number when the detection reaches the preset time interval corresponding to the interface group number, and receive the current parameters transmitted based on the interface;

The monitoring module 40 is configured to read the system identification carried in each of the current parameters, and according to the system identification, transmit each of the current parameters to the display template corresponding to the display template group number for display. The current parameters in the log data derived from each deployment system are monitored.

The multi-system log data monitoring device of this embodiment reads the parameter type corresponding to the received deployment request through the reading module 10, and determines whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system ; If it exists, according to the target system parameters, the allocation module 20 allocates the interface group number and the display template group number to the system to be deployed corresponding to the deployment request, and updates the system to be deployed to the deployment system; after that, when the detection reaches the interface group number corresponding to At the preset time interval, the calling module 30 calls the interface corresponding to the interface group number, and receives the current parameters transmitted based on the interface; the monitoring module 40 then reads the system identification carried in each current parameter, and According to the read system identification, each current parameter is transmitted to the display template corresponding to the display template group number for display, thereby realizing the monitoring of the current parameters in the log data from each deployment system. The parameter type corresponding to the deployment request in this solution is the parameter type that needs to be monitored by the system to be deployed. When there is a target system parameter corresponding to the parameter type, it means that the system parameters of each deployed system that have been deployed exist The deployment system that monitors this parameter type can assign the interface group number and display template group number to the system to be deployed based on the target system parameters, and update the system to be deployed to the deployment system; have the same interface group number and display template group number Each deployment system of the company uses the same interface for data transmission and uses the same display template for data display; while each deployment system with different interface group numbers and display template group numbers uses different interfaces for data transmission and uses different display templates for data display ; While achieving differentiated monitoring of the different monitoring requirements between the deployment systems, it also implements the reuse of interfaces and display templates between the deployment systems with the same monitoring requirements; each deployment system is based on its own While performing accurate monitoring, it saves monitoring resources.

Among them, the virtual function modules of the above-mentioned multi-system log data monitoring device are stored in the memory 1005 of the multi-system log data monitoring device shown in FIG. 3, and when the processor 1001 executes the multi-system log data monitoring program, the implementation shown in FIG. 2 The function of each module in the embodiment is shown.

It should be noted that those of ordinary skill in the art can understand that all or part of the steps in the above-mentioned embodiments can be completed by hardware, or by a program to instruct related hardware, and the program can be stored in a computer readable Among the storage media, the aforementioned storage media may be read-only memory, magnetic disks, or optical disks.

Referring to FIG. 3, FIG. 3 is a schematic diagram of the device structure of the hardware operating environment involved in the method of the embodiment of the present application.

The monitoring device for multi-system log data in the embodiment of the application may be a PC (personal computer, personal computer ), or terminal devices such as smart phones, tablet computers, e-book readers, and portable computers.

As shown in Figure 3, the multi-system log data monitoring device may include: a processor 1001, such as a CPU (Central Processing Unit, central processing unit), memory 1005, communication bus 1002. Among them, the communication bus 1002 is used to implement connection and communication between the processor 1001 and the memory 1005. The memory 1005 may be a high-speed RAM (random access memory, random access memory), or stable memory (non-volatile memory), such as disk storage. The memory 1005 may optionally be a storage device independent of the foregoing processor 1001.

Optionally, the monitoring equipment for the multi-system log data may also include user interfaces, network interfaces, cameras, RF (Radio Frequency, radio frequency) circuit, sensor, audio circuit, WiFi (Wireless Fidelity, wireless broadband) module and so on. The user interface may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface may also include a standard wired interface and a wireless interface. Optional network interface can include standard wired interface, wireless interface (such as WI-FI interface).

Those skilled in the art can understand that the structure of the monitoring device for multi-system log data shown in FIG. 3 does not constitute a limitation on the monitoring device for multi-system log data, and may include more or less components than shown in the figure, or a combination Certain components, or different component arrangements.

As shown in FIG. 3, the memory 1005 as a readable storage medium may include an operating system, a network communication module, and a monitoring program for multi-system log data. The operating system is a program that manages and controls the hardware and software resources of the monitoring device for multi-system log data, supports the operation of the multi-system log data monitoring program and other software and/or programs. The network communication module is used to realize the communication between various components in the memory 1005 and the communication with other hardware and software in the monitoring equipment of multi-system log data.

In the multi-system log data monitoring device shown in FIG. 3, the processor 1001 is used to execute the multi-system log data monitoring program stored in the memory 1005 to implement the steps in the above-mentioned multi-system log data monitoring method in each embodiment.

This application provides a readable storage medium that stores one or more programs, and the one or more programs may also be executed by one or more processors to implement the above-mentioned multiple systems The steps in each embodiment of the method for monitoring log data.

The sequence numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation. Based on this understanding, the technical solution of this application essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a readable storage medium (such as ROM) as described above. /RAM, magnetic disk, optical disk), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) execute the method described in each embodiment of the present application.

The above descriptions are only the preferred embodiments of this application, and do not limit the scope of this application. Under the concept of this application, equivalent structural transformations made using the contents of the specification and drawings of this application, or directly/indirectly used in Other related technical fields are included in the scope of patent protection of this application.

Claims

A method for monitoring multi-system log data, characterized in that the method for monitoring multi-system log data includes the following steps:

When a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system;

If there is a target system parameter corresponding to the parameter type, according to the target system parameter, the system to be deployed corresponding to the deployment request is assigned an interface group number and a display template group number to update the system to be deployed To deploy the system;

When the detection reaches the preset time interval corresponding to the interface group number, call the interface corresponding to the interface group number, and receive the current parameters transmitted based on the interface;

Read the system identifier carried in each of the current parameters, and according to the system identifier, transmit each of the current parameters to the display template corresponding to the display template group number for display, so as to display The current parameters in the log data of the system are monitored.
The method for monitoring log data of multiple systems according to claim 1, wherein the step of transmitting each of the current parameters to the display template corresponding to the display template group number according to the system identification comprises: :

Classify each of the current parameters according to the system identification, and determine the current system parameters corresponding to each of the deployment systems;

Read the type identifiers carried in the current parameters of each of the systems, and perform classified statistics on the current parameters of each of the systems according to the type identifiers, and generate statistical results of the current parameters of the various types of systems in each of the deployment systems ；

The display template corresponding to the display template group number is called, and according to the type identification, each statistical result is added to each display area in the display template for display.
The method for monitoring log data of multiple systems according to claim 2, wherein after the step of adding each of the statistical results to each display area in the display template for display, it comprises:

Read the last statistical result generated by each deployment system in the last preset time interval, and compare each statistical result with the last statistical result according to the system identifier, and generate each comparison result ；

According to the type identification, the comparison result is added to the comparison area in the display template for display, so as to update the statistical results displayed in each display area in the display template.
The method for monitoring log data in multiple systems according to claim 3, wherein the step of updating each of the statistical results displayed in each display area in the display template afterwards comprises:

When receiving a viewing instruction, read the viewing system identifier carried in the viewing instruction;

Comparing the viewing system identifier with the system identifier corresponding to each of the display templates to determine the target system identifier;

The target display template corresponding to the target system identifier is called, and the target display template is output to the monitoring interface for display.
The method for monitoring log data of multiple systems according to claim 2, wherein the type identification includes an access identification, a response time identification, and a success identification; according to each of the type identifications, the current parameters of each system The steps of performing classified statistics and generating statistical results of the current parameters of the various types of systems in each of the deployment systems include:

Classify the access data, response time data, and success data in the current parameters of each system according to the access identifier, response time identifier, and success identifier;

Count the number of visits to the access data and the number of successes of the success data, and use the counted number of successes and the number of visits as a ratio to generate an access success rate;

Divide each of the response time data into each of the preset time intervals, and count the number of response time data in each of the preset time intervals to generate each quantity value;

The ratio of each of the quantity value and the total quantity of the response time data is used to generate the response rate of each of the preset time intervals, and the response rate, access data, success data, and access success rate are generated as respective Statistical results of current parameters of various types of the system in the deployment system.
The monitoring method of multi-system log data according to claim 1, wherein when a deployment request is received, the step of reading the parameter type corresponding to the deployment request comprises:

When a deployment request is received, read the environment version number of the system to be deployed, and determine whether the environment version number is a valid version number;

If it is a valid version number, read the log path of the system to be deployed, and after adding the log path to the preset configuration file, read the parameter type corresponding to the deployment request;

If it is not a valid version number, output the first prompt message to prompt that the system to be deployed does not support deployment.
7. The method for monitoring log data of multiple systems according to claim 6, wherein the step of determining whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system afterwards comprises:

If there is no target system parameter corresponding to the parameter type, output second prompt information to prompt to update the preset parameters based on the parameter type;

When the updated preset parameters are received, and the update interface group number and the update display template group number corresponding to the updated preset parameters are received, the update interface combination and the update display template group number are allocated to the deployment request Corresponding to the interface group number and the display template group number of the system to be deployed, so as to update the system to be deployed to the deployment system.
A monitoring device for multi-system log data, characterized in that the monitoring device for multi-system log data includes:

The reading module is configured to, when a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system;

The allocation module is configured to, if there is a target system parameter corresponding to the parameter type, according to the target system parameter, assign an interface group number and a display template group number to the system to be deployed corresponding to the deployment request, so as The system to be deployed is updated to the deployment system;

The calling module is configured to call the interface corresponding to the interface group number when the detection reaches the preset time interval corresponding to the interface group number, and receive the current parameters transmitted based on the interface;

The monitoring module is used to read the system identification carried in each of the current parameters, and according to the system identification, transmit each of the current parameters to the display template corresponding to the display template group number for display, so as to verify the source Monitor the current parameters in the log data of each deployment system.
A monitoring device for multi-system log data, characterized in that the monitoring device for multi-system log data includes: a memory, a processor, a communication bus, and a monitoring program for multi-system log data stored on the memory;

The communication bus is used to realize connection and communication between the processor and the memory;

The processor is used to execute the multi-system log data monitoring program to implement the following steps: when a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether the system parameters of each deployment system There is a target system parameter corresponding to the parameter type;

If there is a target system parameter corresponding to the parameter type, according to the target system parameter, the system to be deployed corresponding to the deployment request is assigned an interface group number and a display template group number to update the system to be deployed To deploy the system;

When the detection reaches the preset time interval corresponding to the interface group number, call the interface corresponding to the interface group number, and receive the current parameters transmitted based on the interface;

Read the system identifier carried in each of the current parameters, and according to the system identifier, transmit each of the current parameters to the display template corresponding to the display template group number for display, so as to display The current parameters in the log data of the system are monitored.
The monitoring device for multi-system log data according to claim 9, wherein the step of transmitting each of the current parameters to the display template corresponding to the display template group number according to the system identification comprises: :

Classify each of the current parameters according to the system identification, and determine the current system parameters corresponding to each of the deployment systems;

Read the type identifiers carried in the current parameters of each of the systems, and perform classified statistics on the current parameters of each of the systems according to the type identifiers, and generate statistical results of the current parameters of the various types of systems in each of the deployment systems ；

The display template corresponding to the display template group number is called, and according to the type identification, each statistical result is added to each display area in the display template for display.
The monitoring device for multi-system log data according to claim 10, wherein after the step of adding each of the statistical results to each display area in the display template for display, the processor is configured to execute The multi-system log data monitoring program realizes the following steps:

Read the last statistical result generated by each deployment system in the last preset time interval, and compare each statistical result with the last statistical result according to the system identifier, and generate each comparison result ；

According to the type identification, the comparison result is added to the comparison area in the display template for display, so as to update the statistical results displayed in each display area in the display template.
The monitoring device for multi-system log data according to claim 11, wherein after the step of updating each of the statistical results displayed in each display area in the display template, the processor is configured to execute all Describe the monitoring program of multi-system log data to achieve the following steps:

When receiving a viewing instruction, read the viewing system identifier carried in the viewing instruction;

Comparing the viewing system identifier with the system identifier corresponding to each of the display templates to determine the target system identifier;

The target display template corresponding to the target system identifier is called, and the target display template is output to the monitoring interface for display.
The monitoring device for multi-system log data according to claim 10, wherein the type identification includes an access identification, a response time identification, and a success identification; according to each of the type identifications, the current parameters of each system The steps of performing classified statistics and generating statistical results of the current parameters of the various types of systems in each of the deployment systems include:

Classify the access data, response time data, and success data in the current parameters of each system according to the access identifier, response time identifier, and success identifier;

Count the number of visits to the access data and the number of successes of the success data, and use the counted number of successes and the number of visits as a ratio to generate an access success rate;

Divide each of the response time data into each of the preset time intervals, and count the number of response time data in each of the preset time intervals to generate each quantity value;

The ratio of each of the quantity value and the total quantity of the response time data is used to generate the response rate of each of the preset time intervals, and the response rate, access data, success data, and access success rate are generated as respective Statistical results of current parameters of various types of the system in the deployment system.
The monitoring device for multi-system log data according to claim 9, wherein when a deployment request is received, the step of reading the parameter type corresponding to the deployment request comprises:

When a deployment request is received, read the environment version number of the system to be deployed, and determine whether the environment version number is a valid version number;

If it is a valid version number, read the log path of the system to be deployed, and after adding the log path to the preset configuration file, read the parameter type corresponding to the deployment request;

If it is not a valid version number, output the first prompt message to prompt that the system to be deployed does not support deployment.
A readable storage medium, characterized in that a monitoring program for multi-system log data is stored on the readable storage medium, and the monitoring program for multi-system log data is executed by a processor, and the following steps are implemented:

When a deployment request is received, read the parameter type corresponding to the deployment request, and determine whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system;

If there is a target system parameter corresponding to the parameter type, according to the target system parameter, the system to be deployed corresponding to the deployment request is assigned an interface group number and a display template group number to update the system to be deployed To deploy the system;

When the detection reaches the preset time interval corresponding to the interface group number, call the interface corresponding to the interface group number, and receive the current parameters transmitted based on the interface;

Read the system identifier carried in each of the current parameters, and according to the system identifier, transmit each of the current parameters to the display template corresponding to the display template group number for display, so as to display The current parameters in the log data of the system are monitored.
15. The readable storage medium according to claim 15, wherein the step of transmitting each of the current parameters to the display template corresponding to the display template group number according to the system identification comprises:

Classify each of the current parameters according to the system identification, and determine the current system parameters corresponding to each of the deployment systems;

Read the type identifiers carried in the current parameters of each of the systems, and perform classified statistics on the current parameters of each of the systems according to the type identifiers, and generate statistical results of the current parameters of the various types of systems in each of the deployment systems ；

The display template corresponding to the display template group number is called, and according to the type identification, each statistical result is added to each display area in the display template for display.
The readable storage medium according to claim 16, wherein after the step of adding each of the statistical results to each display area in the display template for display, the monitoring program of the multi-system log data To be executed by the processor, the following steps are implemented:

Read the last statistical result generated by each deployment system in the last preset time interval, and compare each statistical result with the last statistical result according to the system identifier, and generate each comparison result ；

According to the type identification, the comparison result is added to the comparison area in the display template for display, so as to update the statistical results displayed in each display area in the display template.
The readable storage medium of claim 17, wherein after the step of updating each of the statistical results displayed in each display area of the display template, the monitoring program of the multi-system log data is The processor executes the following steps:

When receiving a viewing instruction, read the viewing system identifier carried in the viewing instruction;

Comparing the viewing system identifier with the system identifier corresponding to each of the display templates to determine the target system identifier;

The target display template corresponding to the target system identifier is called, and the target display template is output to the monitoring interface for display.
The readable storage medium according to claim 16, wherein the type identification includes an access identification, a response time identification, and a success identification; the classification and statistics of the current parameters of the system are performed according to each of the type identifications , The step of generating statistical results of the current parameters of the various systems in each deployment system includes:

Classify the access data, response time data, and success data in the current parameters of each system according to the access identifier, response time identifier, and success identifier;

Count the number of visits to the access data and the number of successes of the success data, and use the counted number of successes and the number of visits as a ratio to generate an access success rate;

Divide each of the response time data into each of the preset time intervals, and count the number of response time data in each of the preset time intervals to generate each quantity value;

The ratio of each of the quantity value and the total quantity of the response time data is used to generate the response rate of each of the preset time intervals, and the response rate, access data, success data, and access success rate are generated as respective Statistical results of current parameters of various types of the system in the deployment system.
15. The readable storage medium according to claim 15, wherein when a deployment request is received, the step of reading a parameter type corresponding to the deployment request comprises:

When a deployment request is received, read the environment version number of the system to be deployed, and determine whether the environment version number is a valid version number;

If it is a valid version number, read the log path of the system to be deployed, and after adding the log path to the preset configuration file, read the parameter type corresponding to the deployment request;

If it is not a valid version number, output the first prompt message to prompt that the system to be deployed does not support deployment.