CN109739730B

CN109739730B - Method, device and equipment for monitoring multi-system log data and readable storage medium

Info

Publication number: CN109739730B
Application number: CN201910037704.9A
Authority: CN
Inventors: 谢满锐; 付飞腾; 李志冬; 宫林涛
Original assignee: Ping An Technology Shenzhen Co Ltd
Current assignee: Ping An Technology Shenzhen Co Ltd
Priority date: 2019-01-14
Filing date: 2019-01-14
Publication date: 2022-05-17
Anticipated expiration: 2039-01-14
Also published as: WO2020147264A1; CN109739730A

Abstract

The invention discloses a method, a device, equipment and a readable storage medium for monitoring multi-system log data, wherein the method comprises the following steps: when a deployment request is received, reading a parameter type corresponding to the deployment request, and judging whether target system parameters corresponding to the parameter type exist in system parameters of each deployment system; if the interface group number exists, the interface group number and the display template group number are distributed to the system to be deployed according to the target system parameters; when the preset time interval corresponding to the interface group number is detected, calling the interface corresponding to the interface group number, and receiving the current parameters transmitted based on the interface; and reading the system identification carried in each current parameter, and transmitting each current parameter to the display template corresponding to the display template group number according to the system identification for display so as to monitor the current parameter in the log data from each deployment system. According to the scheme, various parameters of a plurality of systems are monitored in a differentiated mode through a big data processing technology, and monitoring requirements of different systems are met.

Description

Method, device and equipment for monitoring multi-system log data and readable storage medium

Technical Field

The invention mainly relates to the technical field of data processing, in particular to a method, a device, equipment and a readable storage medium for monitoring multi-system log data.

Background

With the development of science and technology and networks, more and more organizations tend to use different systems to specially manage different types of data and resources, so that when different types of data or resources are acquired, different systems need to be accessed; in order to ensure the normal operation of each system, it is usually necessary to monitor log data of each system, and determine whether each system has an abnormality during the operation process through the log data.

At present, log data monitoring of each system is carried out in the same mode, but the data types stored in each system or the provided service resources are different, and the system is monitored in the same mode, so that the characteristics of each system cannot be reflected; meanwhile, under the condition that the system differentiation is large, the monitoring requirements of the systems are difficult to balance by the same monitoring mode, so that the monitoring is not accurate enough and manual assistance is needed; therefore, the monitoring efficiency is reduced, and the labor cost is increased.

Disclosure of Invention

The invention mainly aims to provide a method, a device, equipment and a readable storage medium for monitoring multi-system log data, and aims to solve the problems that different systems are monitored in the same mode in the prior art, the characteristics of the systems are not accurately reflected in monitoring, monitoring efficiency is low, and labor cost is high.

In order to achieve the above object, the present invention provides a method for monitoring multisystem log data, wherein the method for monitoring multisystem log data comprises the following steps:

when a deployment request is received, reading a parameter type corresponding to the deployment request, and judging whether target system parameters corresponding to the parameter type exist in system parameters of each deployment system;

if the target system parameters corresponding to the parameter types exist, distributing an interface group number and a display template group number to the system to be deployed corresponding to the deployment request according to the target system parameters so as to update the system to be deployed into a deployment system;

when the preset time interval corresponding to the interface group number is detected, calling the interface corresponding to the interface group number, and receiving the current parameters transmitted based on the interface;

and reading a system identifier carried in each current parameter, and transmitting each current parameter to a display template corresponding to the display template group number according to the system identifier to be displayed so as to monitor the current parameter in log data from each deployment system.

Preferably, the step of transmitting each of the current parameters to the display template corresponding to the display template group number for display according to the system identifier includes:

classifying the current parameters according to the system identification, and determining the current parameters of the system corresponding to the deployment systems;

reading type identifiers carried in the current parameters of each system, performing classified statistics on the current parameters of each system according to each type identifier, and generating statistical results of the current parameters of each system in each deployment system;

and calling the display template corresponding to the display template group number, and adding each statistical result to each display area in the display template for display according to the type identification.

Preferably, the step of adding each statistical result to each display area in the display template for display includes:

reading a previous statistical result generated by each deployment system in a preset time interval, and comparing each statistical result with the previous statistical result according to the system identification to generate each comparison result;

and adding the comparison result to a comparison area in the display template for display according to the type identifier so as to update each statistical result displayed in each display area in the display template.

Preferably, the step of updating each statistical result displayed in each display area in the display template includes:

when a viewing instruction is received, reading a viewing system identifier carried in the viewing instruction;

comparing the viewing system identification with the system identification corresponding to each display template to determine a target system identification;

and calling a target display template corresponding to the target system identification, and outputting the target display template to a monitoring interface for display.

Preferably, the type identifier comprises an access identifier, a response time identifier and a success identifier; the step of performing classification statistics on the current parameters of each system according to each type identifier to generate statistical results of the current parameters of each system in each deployment system comprises:

classifying the access data, the response time data and the success data in the current parameters of each system according to the access identification, the response time identification and the success identification;

counting the access times of the access data and the success times of the success data, and generating an access success rate by taking the counted success times and the access times as a ratio;

dividing each piece of response time data into each preset time interval, and counting the number of the response time data in each preset time interval to generate each number value;

and taking the ratio of each quantity value to the total quantity of the response time data to generate the response rate of each preset time interval, and generating each response rate, access data, success data and access success rate as the statistical result of the current parameters of each system in each deployment system.

Preferably, when a deployment request is received, the step of reading a parameter type corresponding to the deployment request includes:

when a deployment request is received, reading the environment version number of the system to be deployed, and judging whether the environment version number is a valid version number;

if the version number is valid, reading a log path of the system to be deployed, and reading a parameter type corresponding to the deployment request after adding the log path to a preset configuration file;

and if the version number is not the effective version number, outputting first prompt information to prompt that the system to be deployed does not support deployment.

Preferably, the step of determining whether there is a target system parameter corresponding to the parameter type in the system parameters of each deployment system includes:

if the target system parameter corresponding to the parameter type does not exist, outputting second prompt information to prompt that the preset parameter is updated based on the parameter type;

when receiving the updated preset parameters, and the updated interface group number and the updated display template group number corresponding to the updated preset parameters, allocating the updated interface combination and the updated display template group number to the interface group number and the display template group number of the system to be deployed corresponding to the deployment request, so as to update the system to be deployed to the deployment system.

In addition, in order to achieve the above object, the present invention further provides a monitoring apparatus for multisystem log data, including:

the reading module is used for reading the parameter type corresponding to the deployment request when the deployment request is received, and judging whether the system parameters of each deployment system have the target system parameters corresponding to the parameter type;

the allocation module is used for allocating an interface group number and a display template group number to the system to be deployed corresponding to the deployment request according to the target system parameters if the target system parameters corresponding to the parameter types exist, so as to update the system to be deployed into a deployment system;

the calling module is used for calling the interface corresponding to the interface group number when the preset time interval corresponding to the interface group number is detected to be reached, and receiving the current parameter transmitted based on the interface;

and the monitoring module is used for reading the system identification carried in each current parameter, transmitting each current parameter to the display template corresponding to the display template group number according to the system identification, and displaying to monitor the current parameter in the log data from each deployment system.

In addition, in order to achieve the above object, the present invention further provides a monitoring device for multi-system log data, where the monitoring device for multi-system log data includes: the system comprises a memory, a processor, a communication bus and a monitoring program of multi-system log data stored on the memory;

the communication bus is used for realizing connection communication between the processor and the memory;

the processor is used for executing the monitoring program of the multi-system log data to realize the following steps:

Further, to achieve the above object, the present invention also provides a readable storage medium storing one or more programs, the one or more programs being executable by one or more processors for:

In the monitoring method for multi-system log data of the embodiment, whether target system parameters corresponding to the parameter types exist in system parameters of each deployment system is judged by reading the parameter types corresponding to the received deployment requests; if the target system parameter exists, according to the target system parameter, allocating an interface group number and a display template group number to the system to be deployed corresponding to the deployment request, and updating the system to be deployed into a deployment system; when the detection reaches the preset time interval corresponding to the interface group number, calling the interface corresponding to the interface group number, and receiving the current parameters transmitted based on the interface; and reading the system identification carried in each current parameter, and transmitting each current parameter to a display template corresponding to the display template group number according to the read system identification for display, thereby realizing the monitoring of the current parameter in the log data from each deployment system. In the scheme, the parameter type corresponding to the deployment request is a parameter type required to be monitored by the system to be deployed, and when a target system parameter corresponding to the parameter type exists, the parameter type is monitored in system parameters of each deployed system, so that an interface group number and a display template group number can be distributed to the system to be deployed according to the target system parameter, and the system to be deployed is updated to be the deployed system; each deployment system with the same interface group number and the same display template group number uses the same interface to transmit data and uses the same display template to display the data; each deployment system with different interface group numbers and display template group numbers uses different interfaces to transmit data and uses different display templates to display data; while realizing the differential monitoring of different monitoring requirements among all deployment systems, the multiplexing of interfaces and display templates is realized among all deployment systems with the same monitoring requirements; the monitoring resources are saved while the accurate monitoring is carried out on each deployment system according to the respective characteristics.

Drawings

FIG. 1 is a flowchart illustrating a method for monitoring log data of multiple systems according to a first embodiment of the present invention;

FIG. 2 is a functional block diagram of a monitoring apparatus for multi-system log data according to a first embodiment of the present invention;

fig. 3 is a schematic device structure diagram of a hardware operating environment related to the method according to the embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The invention provides a method for monitoring multi-system log data.

Referring to fig. 1, fig. 1 is a flowchart illustrating a method for monitoring log data of multiple systems according to a first embodiment of the present invention. In this embodiment, the method for monitoring the multi-system log data includes:

step S10, when a deployment request is received, reading the parameter type corresponding to the deployment request, and judging whether the system parameters of each deployment system have the target system parameters corresponding to the parameter type;

the monitoring method of the log data of the multiple systems is applied to the monitoring server, is suitable for monitoring the log data generated by the multiple systems through the monitoring server, and reflects the running condition of each system through the monitored log data. In order to monitor the log data of each system, the information of each system needs to be added to the monitoring server first, so that the monitoring server has the authority to obtain the log data of each system. Adding the information of each system to the monitoring server can be carried out through a deployment request, and when a certain system has a monitoring requirement on the generated log data, the deployment request is sent to the monitoring server; because of the multiple types of data involved in the log data, some data is relevant to system operation and other data is not relevant to system operation; in order to monitor the operating condition of the system, it is necessary to specify the parameter types of the data to be monitored, such as the access amount, response time, access success rate, and call status code of the system interface, when sending the deployment request. And when receiving the deployment request, the monitoring server reads the parameter type corresponding to the deployment request and judges whether target system parameters consistent with the parameter type corresponding to the deployment request exist in the system parameters selected and monitored by each deployment system deployed by the monitoring server. The consistent target system parameters represent that the system parameters monitored by a certain system exist in each deployed system, and are consistent with the types of the parameters required to be monitored by the system which sends the deployment request currently.

Consider that different systems are developed from different versions of development environments, such as python2.6, python2.7, python3.x, etc.; the environment versions supported and monitored by the monitoring server have certain limitation, and monitoring cannot be supported for any environment version; such as supporting monitoring of a system developed by the environment version python2.7, not supporting monitoring of a system developed by the environment version python1.0, etc. Taking the environment version number supported and monitored by the monitoring server as a preset version number, and detecting the validity of the system environment version before monitoring the system sending the deployment request; specifically, when a deployment request is received, the step of reading a parameter type corresponding to the deployment request includes:

step S11, when receiving a deployment request, reading the environment version number of the system to be deployed and judging whether the environment version number is a valid version number;

further, the system sending the deployment request is used as a system to be deployed, when receiving the deployment request sent by the system to be deployed, the monitoring server reads the environment version number of the system to be deployed, compares the read environment version number with preset version numbers, and determines whether the environment version number exists in the preset version numbers, that is, determines that the environment version number is consistent with a preset version number of the preset version numbers.

Step S12, if the version number is valid, reading the log path of the system to be deployed, and after adding the log path to a preset configuration file, reading the parameter type corresponding to the deployment request;

and step S13, if the version number is not the effective version number, outputting a first prompt message to prompt that the system to be deployed does not support deployment.

If the environment version number exists in the preset version numbers, the environment version number is a valid version number, and the monitoring server supports the monitoring of the system to be deployed; and reading the log path of the path to be deployed, and adding the read log path into a preset configuration file. The system comprises a monitoring server, a log path, a preset configuration file and a log path, wherein the log path is a path for storing log data generated by the system to be deployed in the system to be deployed, and the preset configuration file is a file which is preset in the monitoring server and used for configuring log paths of all the deployed systems; adding the log path into a preset configuration file, and reading a corresponding parameter type in the deployment request after the addition is finished so as to determine a parameter to be monitored in the log data according to the parameter type; and the monitoring server collects the parameters in the log data generated by the deployment system according to the path in the preset configuration file in the operation process, and further analyzes and monitors the collected parameters. And when the environment version number is judged not to exist in the preset version numbers, namely the environment version number is not a valid version number, the monitoring server does not support monitoring of the system developed by the environment version number, so that the first prompt information is output. The first prompt information comprises two aspects, on one hand, personnel related to the system to be deployed are prompted, and the system to be deployed does not support monitoring; and on the other hand, the developer is prompted to optimize the monitoring server, so that the monitoring server supports the monitoring of the system to be deployed.

In addition, for a system providing services in a distributed mode, the functions of the system are distributed on a plurality of servers, and the overall functions of the system are realized in a distributed mode; if the system has monitoring requirements, the log paths of the servers corresponding to the system are added into a preset configuration file, and the monitoring servers acquire parameter data of the distributed system one by one according to the log paths and integrate and analyze the parameter data.

Step S20, if the target system parameter corresponding to the parameter type exists, according to the target system parameter, allocating an interface group number and a display template group number to the system to be deployed corresponding to the deployment request, so as to update the system to be deployed into a deployment system;

understandably, the parameter types to be monitored by different systems are different, for example, the parameter types to be monitored by some systems are the access amount, response time and success rate of the system interface, and the parameter types to be monitored by other systems are the access amount, response time, success rate and call status code of the system interface. If it is determined that the target system parameter corresponding to the parameter type exists in the monitored system parameters, it indicates that the monitored deployment system having the same monitoring requirement of the parameter type as the system to be deployed exists in the monitoring server. For all deployment systems with the same monitoring requirements, the same interface can be used for reading the parameters, and the same display template is adopted for displaying the monitored parameters so as to multiplex all resources in the monitoring server.

Dividing deployment systems with the same monitoring requirements and using the same interface and the same display template into the same interface group and the same display template group; when the target system parameters exist, all the deployment systems in the interface group and the display module group corresponding to the target system parameters monitor and display the target system parameters. Thus, for the system to be deployed corresponding to the deployment request, the interface group number and the display template group number can be distributed to the system to be deployed according to the target system parameters; the system to be deployed is divided into an interface group and a display template group corresponding to the target system parameter through the interface combination and the display template group number, the system to be deployed is updated to be a deployed system, deployment of the system to be deployed is completed, and then the monitoring server can monitor the parameter in the deployed system to be deployed. The parameter types as read include a1, b1, and c1, while for the monitored deployment systems W1, W2, W3, and W4, where the system parameters monitored by W1 and W3 are of types a1, a2, b2, b3, and the system parameters monitored by W2 and W4 are of types a1, b1, and c 1; therefore, target system parameters corresponding to the parameter types exist, deployment systems W2 and W4 corresponding to the target system parameters belong to the same interface group and the same display template group, the group numbers are p1 and p2 respectively, the interface group number and the display template group number of the system to be deployed are allocated to p1 and p2, the system to be deployed, W2 and W4 are allocated to the same interface group and the same display template group, and parameters of parameter types a1, b1 and c1 of each deployment system are read and monitored.

Understandably, the parameters to be monitored of the system to be deployed which currently sends the deployment request are different from the parameters monitored by the monitored deployment system; target system parameters corresponding to the parameter types do not exist in the monitored system parameters, and the parameter types to be monitored are newly appeared parameter types; the monitoring server lacks a mechanism for monitoring the emerging parameter types, and needs to optimize the monitoring service. Specifically, the step of determining whether the target system parameter corresponding to the parameter type exists in the system parameters of each deployment system includes:

a1, if there is no target system parameter corresponding to the parameter type, outputting a second prompt message to prompt updating of the preset parameter based on the parameter type;

when the parameter type to be monitored of the system to be deployed is judged to have no corresponding target system parameter in each monitored deployment system, outputting second prompt information; the second prompt message includes a parameter type, so that a developer can update the preset parameter according to the parameter type. The preset parameters are parameters which can be monitored by the monitoring server, the updating is to update the types of the preset parameters according to the parameter types, and form an update interface and an update display template for the updated parameters, and the update interface and the update display template can monitor and display the parameter types which need to be monitored by the system to be deployed.

Step a2, when receiving the updated preset parameters, and the updated interface group number and the updated display template group number corresponding to the updated preset parameters, allocating the updated interface combination and the updated display template group number as the interface group number and the display template group number of the system to be deployed corresponding to the deployment request, so as to update the system to be deployed into the deployment system.

Understandably, in the operation process of the monitoring server, the updating interface and the updating display template can be used for monitoring other systems, namely, the other systems have monitoring requirements on parameters corresponding to the parameter types; in order to facilitate subsequent monitoring operation, the updated interface and the updated display template are formed into an updated interface group and an updated display template, and interface numbers of the updated interface group and the updated display template are set, namely the updated interface group number and the updated display template number. The updated preset parameters, the updated interface group and the updated display template group corresponding to the updated preset parameters are used for monitoring the parameters corresponding to the parameter types, so that when the updated preset parameters, the updated interface group number and the updated display template group number corresponding to the updated preset parameters are received, the updated interface group number and the updated template group number are distributed as the interface group number and the display template group number of the system to be deployed, the parameter types of the system to be deployed are monitored through the updated interface group number and the updated template group number, and the system to be deployed is updated to the system to be deployed.

Step S30, when the detection reaches the preset time interval corresponding to the interface group number, the interface corresponding to the interface group number is called, and the current parameter transmitted based on the interface is received; the corresponding preset time is different according to the deployed system

Further, preset time intervals for reading and monitoring parameters in each deployment system are set in advance according to monitoring requirements, such as 10 minutes, two hours, one day, one week and the like; each deployment system with the same interface group number, namely the preset time intervals set by each deployment system in the same interface group can be the same or different, if the preset time intervals are the same, each parameter of each deployment system is read at the same time, and then each read parameter is distinguished according to the deployment system; and if the parameters are different, reading the parameters of each deployment system at different time respectively. And taking the same or different preset time intervals as the preset time intervals corresponding to the interface group numbers, calling the interfaces corresponding to the interface group numbers when the preset time intervals are detected to be reached, and receiving the current parameters transmitted through the interfaces. The current parameter is a parameter corresponding to the parameter type and received within a current preset time interval.

Step S40, reading a system identifier carried in each current parameter, and transmitting each current parameter to a display template corresponding to the display template group number according to the system identifier, so as to monitor the current parameter in the log data from each deployment system.

Further, since the predetermined time interval may relate to monitoring times of a plurality of deployed systems, the received current parameters may also be derived from a plurality of deployed systems, which need to be distinguished. Specifically, different deployment systems are allocated with different system identifiers in the deployment process, so that the different deployment systems can be distinguished through the system identifiers, and the current parameters transmitted by each deployment system also carry the system identifiers representing the respective source deployment system, so that the system identifiers carried in the received current parameters are read first, and then the current parameters are classified to correspond to the different deployment systems according to the system identifiers. Because the display template groups for parameter display among different deployment systems in the same interface group are the same, after each current parameter is divided to correspond to each deployment system, the current parameter corresponding to each deployment system is transmitted to the display template of the display template group for display. The display template corresponding to the display template group is suitable for each deployment system with the display template group number, and the display template can be called for many times in the process of transmitting the current parameters of each deployment system to the display template for display so as to display the current parameters of different deployment systems. If the deployment system with the displayed template group number comprises M1, M2 and M3, and the corresponding system identifiers are M1, M2 and M3 respectively, when the current parameters are received, the current parameters comprise a parameter carrying M1 and a parameter carrying M3, the current parameters are divided into a parameter D1 corresponding to M1 and a parameter D2 corresponding to M3 according to the system identifiers; two calls are then made to the presentation template to transmit D1 and D2, respectively, to the presentation template for presentation.

Considering that the current parameters received relative to the current preset time interval all receive corresponding parameters in the previous preset time interval, and the corresponding parameters are also transmitted to the display template for displaying; when the current parameters are displayed, the display templates displayed before can be directly used, so that the display templates are prevented from being recalled, and the comparison with the corresponding parameters before can be realized. If the parameters corresponding to M1 and M3 are displayed before, as for the parameter D1 corresponding to M1 and the parameter D2 corresponding to M3, the display template is called, and the corresponding system identifiers M1 and M3 are respectively allocated to the display template; then, when the display is currently performed, the display templates respectively displayed for the parameters corresponding to M1 and M3 before can be determined according to the system identifier, and the parameters D1 and D2 are respectively transmitted to the display templates before to be displayed. Receiving and displaying current parameters transmitted by each deployment system in a current preset time interval through the same interface group and the display template group, and monitoring each parameter in each deployment system with log data having the same monitoring requirement; different interface groups and display module groups can be adopted for receiving and displaying parameters of each deployment system with different monitoring requirements on log data; the log data monitoring of the deployment systems with different monitoring requirements is realized through various different types of interface groups and display module groups.

Further, in another embodiment of the method for monitoring multisystem log data according to the present invention, the step of transmitting each of the current parameters to the display template corresponding to the display template group number according to the system identifier includes:

step S41, classifying the current parameters according to the system identification, and determining the current parameters of the system corresponding to the deployment system;

furthermore, in the process of classifying the current parameters according to the system identifiers, the current parameters with the same system identifier representation from the same deployment system are divided into the same class, that is, each current parameter in the same class is derived from the same deployment system; after the classification of each current parameter is completed, the current parameters of the system corresponding to each deployment system can be determined.

Step S42, reading type identifiers carried in the current parameters of each system, and performing classified statistics on the current parameters of each system according to each type identifier to generate statistical results of the current parameters of each system in each deployment system;

the parameters required to be monitored by the deployment system are related to multiple types, that is, the classified current system parameters of each deployment system are related to multiple types, such as the possible access amount, the response time, the success rate and the like. In order to display each parameter in the display template according to the type, the current system parameters of each deployment system need to be classified. When each deployment system generates log data, different types of identifiers are distributed according to different types, so that each parameter data transmitted by each deployment system, namely the current parameters of the system all carry type identifiers representing the types of the system. After the current system parameters of each deployment system are determined, the type identifiers carried in the current system parameters are read by taking each deployment system as a unit, and the current system parameters are classified and counted according to the type identifiers to generate the counting results of the current system parameters of each deployment system. The class number of the statistical result is determined by the class number of the type identifier, namely the class number of the parameter type to be monitored; for example, in an embodiment, the type identifier includes three types, i.e., an access identifier, a response time identifier, and a success identifier, that is, the type of the parameter to be monitored is three types; then, according to each type of identifier, performing classification statistics on the current parameters of each system, and generating the statistical result of the current parameters of each system in each deployment system includes:

step S421, according to the access identifier, the response time identifier and the success identifier, classifying the access data, the response time data and the success data in the current parameters of each system;

understandably, when the type identifier comprises an access identifier, a response identifier and a success identifier, the parameter type to be monitored is the access data, the response data and the success data; therefore, according to the access identification, the response identification and the success identification, the current parameters of each system are classified into the access data, the corresponding data and the success data by taking each deployment system as a unit. Reading the type identifiers carried by the current parameters of each system one by one, comparing the type identifiers with the access identifiers, the response identifiers and the success identifiers respectively, and determining identifiers which are consistent with the read type identifiers in the three; the consistent identification represents the type of the current parameter of the system, and if the consistent identification is an access identification, the current parameter of the system is represented as access data; when the current parameters of each system in each deployment system are subjected to reading type identification and comparison operation, the current parameters of each system in each deployment system are divided into access data, response time data and success data.

Step S422, the access times of the access data and the success times of the success data are counted, and the ratio of the counted success times and the access times is used for generating the access success rate;

further, the access data is generated by accessing the deployment system each time in a preset time interval, and the successful data is generated by successfully accessing the deployment system each time in the preset time interval; counting the access times of the access data, and representing the access times of the deployment system in a preset time interval; and meanwhile, counting the success times in the success data, and representing the times of successful access to the deployment system in a preset time interval. And (4) taking the counted success times and access times as a ratio, wherein the obtained ratio result is the access success rate of successful access to the deployment system in a preset time interval, and representing the probability of the successful access times in the total access times.

Step S423, dividing each of the response time data into each of the preset time intervals, and counting the number of the response time data in each of the preset time intervals to generate each number value;

furthermore, a plurality of preset time intervals for representing different response durations are preset, such as each preset time interval from 1s to 2s, from 2s to 5s, from 5s to 8s and the like; the larger the value represented in the predetermined time interval, the longer the duration of the response. And comparing each classified response time data with each preset time interval, determining the preset time interval in which each response time data is positioned, and further dividing each response time data into the preset time interval in which each response time data is positioned. And then counting the number of the response time data in each preset time interval to generate a number value in each preset time interval. If the response time data comprises 1.2s, 1.5s, 1.8s, 1.2s, 3s, 3.5s, 4s and 6s, the 1.2s, 1.5s, 1.8s and 1.2s can be divided into a preset time interval formed by 1s to 2s through comparison, and the 3s, 3.5s and 4s can be divided into a preset time interval formed by 2s to 5s and 6s can be divided into a preset time interval formed by 5s to 8 s; and then counting the number of the response time data in each preset time interval to obtain that the data volume from 1s to 2s is 4, the data volume from 2s to 5s is 3, and the data volume from 5s to 8s is 2.

Step S424, taking a ratio of each quantity value to the total quantity of the response time data, generating a response rate of each preset time interval, and generating each response rate, access data, success data, and access success rate as a statistical result of the current parameters of each system in each deployment system.

Furthermore, the data volume in each preset time interval represents the response times of the deployment system in each preset time interval when responding to the access; in order to reflect the degree of the response times in each preset time interval, counting the total number of the response time data, wherein the total number is the total times of the response of the deployment system to each access in the preset time interval. And comparing each quantity value with the total quantity to generate a response rate of each preset time interval, representing the response times in each preset time interval through the response rate, wherein when the response rate of the preset time interval is larger, the response times in the preset time interval are more, namely, the response time of the deployment system to the access falls in the preset time interval for more times. As for the above-mentioned response time data of 1.2s, 1.5s, 1.8s, 1.2s, 3s, 3.5s, 4s, 6s, the total number thereof is 8, and the response rates obtained by ratioing the number value and the total number are 0.5, 0.375, and 0.125, respectively; it shows that there is a high probability that the response time of the deployment system to the access falls within a preset time interval between 1s and 2 s. The response rate, the access data, the success data and the access success rate generated by statistics are statistical results generated by performing statistics on the current parameters of various systems in the deployment system; counting three types of data of access data, response time data and success data which are used as current parameters of the system, wherein the obtained counting results comprise four types of response rate, access data, success data and access success rate; the number of the statistical result can be set according to requirements, and after the setting is finished, the statistical result corresponding to the number can be generated; each statistical result carries a type identifier of the current parameter of the system from which the statistical result is obtained, for example, the response rate carries a response time identifier, and the access success rate carries a success identifier.

And step S43, calling the display template corresponding to the display template group number, and adding each statistical result to each display area in the display template for display according to the type identification.

Furthermore, after the statistical results of the current parameters of various systems are generated, the display template corresponding to the display template group number is called, different display areas are arranged in the display template, and each display area carries a type identifier representing the type of the current parameters of the displayed system, so that the current parameters of the systems of different types are displayed in a distinguishing manner. Comparing the type identifiers carried in the statistical result with the type identifiers in the display area one by one, determining a target display area with the same type identifiers in the display area and the statistical result, and then adding the statistical result to the target display area for display. And after each statistical result is added to each corresponding display area for display, the display of each statistical result is completed.

Further, in another embodiment of the method for monitoring multisystem log data according to the present invention, the step of adding each statistical result to each display area in the display template for displaying includes:

step S44, reading the last statistical result generated by each deployment system in a preset time interval, and comparing each statistical result with the last statistical result according to the system identification to generate each comparison result;

furthermore, in order to reflect the operation change condition of each deployment system, a mechanism for comparing various statistical results of different preset time intervals is arranged; specifically, a previous statistical result generated by each deployment system in a previous preset time interval is read, and the statistical result generated by each deployment system in the current preset time interval is compared with the previous statistical result to generate a comparison result. Because the number of the related deployment systems is large, the comparison process is carried out according to the system identification, namely, the last statistical result with the same system identification is compared with the statistical result. Meanwhile, various parameters in the previous statistical result and the statistical result are compared according to the type identification so as to ensure that the comparison is carried out between the parameters of the same type; for example, the access success rate in the statistical result in the same deployment system is compared with the access success rate in the last statistical result.

Step S45, adding the comparison result to the comparison area in the display template for display according to the type identifier, so as to update each of the statistical results displayed in each display area in the display template.

Furthermore, each statistical result carries a type identifier for representing the type of the statistical result, the type identifier is updated while carrying the type identifier of the statistical result from which the statistical result is obtained by comparing the statistical result with the previous statistical result, a comparison identifier is added on the basis of the type identifier, and data generated by comparing a certain type parameter is used for representing the comparison result. A comparison area is preset in a display area of the display template, and an identifier for representing the comparison area and displaying comparison data and the type of the displayed parameters in the comparison area are arranged in the comparison area. And then, according to the updated type identification, determining a comparison area of the parameter type corresponding to the display comparison result in the display template, further adding each comparison result into each comparison area of the display template according to the type identification for display, and updating the display area for displaying each statistical result in the display template.

In addition, real-time data of log data in each deployment system can be captured, the real-time data are displayed in a display template, and the real-time data in the log data, statistical results of current parameters of various systems and comparison results of characteristic change trends are displayed in the display template in different display areas, so that various monitoring data of each deployment system can be monitored conveniently, and further, each deployment system is analyzed and optimized.

Considering that a plurality of deployment systems monitored by the monitoring server exist, each deployment system has a corresponding display template, and if the display templates are displayed in the same interface, the display effect is influenced; therefore, a uniform interface for managing the display templates of each deployment system can be set, and the deployment system to be displayed is selected from the management interface, so that the display template corresponding to the deployment system is skipped to display. Specifically, the step of updating each statistical result displayed in each display area in the display template includes:

step S46, when a viewing instruction is received, reading a viewing system identifier carried in the viewing instruction;

step S47, comparing the viewing system identification with the system identification corresponding to each display template to determine a target system identification;

and step S48, calling a target display template corresponding to the target system identification, and outputting the target display template to a monitoring interface for display.

Further, the names of the deployment systems are arranged and displayed in the management interface in a virtual key mode, and each name virtual key carries a system identifier of the corresponding deployment system; when a display template of a certain deployment system needs to be viewed, the display template of the deployment system can be viewed by clicking a name virtual key corresponding to the deployment system in a management interface. Specifically, the click operation is received as a viewing instruction for viewing the display template, and the viewing instruction is triggered according to a name virtual key of the deployment system and carries a system identifier; reading the system identification as a viewing system identification, comparing the viewing system identification with the system identifications corresponding to the display templates, and determining a target system identification which is consistent with the viewing system identification in each system identification; and then calling the target display template with the target system identification, wherein the target display template is the display template required to be checked. And outputting the target display template to a monitoring interface for display, and realizing the viewing requirement of the display template.

In addition, referring to fig. 2, the present invention provides a monitoring apparatus for multiple system log data, and in a first embodiment of the monitoring apparatus for multiple system log data of the present invention, the monitoring apparatus for multiple system log data includes:

the reading module 10 is configured to, when a deployment request is received, read a parameter type corresponding to the deployment request, and determine whether a target system parameter corresponding to the parameter type exists in system parameters of each deployment system;

the allocation module 20 is configured to allocate an interface group number and a display template group number to the system to be deployed corresponding to the deployment request according to the target system parameter if the target system parameter corresponding to the parameter type exists, so as to update the system to be deployed into a deployment system;

a calling module 30, configured to call, when it is detected that a preset time interval corresponding to the interface group number is reached, an interface corresponding to the interface group number, and receive a current parameter transmitted based on the interface;

and the monitoring module 40 is configured to read a system identifier carried in each of the current parameters, and transmit each of the current parameters to a display template corresponding to the display template group number according to the system identifier, so as to monitor the current parameter in log data from each of the deployment systems.

In the monitoring device for multi-system log data of this embodiment, the reading module 10 reads the parameter type corresponding to the received deployment request, and determines whether the system parameters of each deployment system have the target system parameters corresponding to the parameter type; if the system to be deployed exists, the distribution module 20 distributes an interface group number and a display template group number to the system to be deployed corresponding to the deployment request according to the target system parameters, and updates the system to be deployed into a deployment system; when the detection reaches the preset time interval corresponding to the interface group number, the calling module 30 calls the interface corresponding to the interface group number and receives the current parameters transmitted based on the interface; the monitoring module 40 reads the system identifier carried in each current parameter, and transmits each current parameter to the display template corresponding to the display template group number according to the read system identifier, thereby monitoring the current parameter in the log data from each deployment system. In the scheme, the parameter type corresponding to the deployment request is a parameter type required to be monitored by the system to be deployed, and when a target system parameter corresponding to the parameter type exists, the parameter type is monitored in system parameters of each deployed system, so that an interface group number and a display template group number can be distributed to the system to be deployed according to the target system parameter, and the system to be deployed is updated to be the deployed system; each deployment system with the same interface group number and the same display template group number uses the same interface to transmit data and uses the same display template to display the data; each deployment system with different interface group numbers and display template group numbers uses different interfaces to transmit data and uses different display templates to display data; while realizing the differential monitoring of different monitoring requirements among all deployment systems, the multiplexing of interfaces and display templates is realized among all deployment systems with the same monitoring requirements; the monitoring resources are saved while the accurate monitoring is carried out on each deployment system according to the respective characteristics.

Further, in another embodiment of the monitoring apparatus for multiple system log data of the present invention, the monitoring module is further configured to:

Further, in another embodiment of the monitoring apparatus for multi-system log data of the present invention, the type identifier includes an access identifier, a response time identifier, and a success identifier; the monitoring module is further configured to:

Further, in another embodiment of the monitoring apparatus for multiple system log data according to the present invention, the reading module is further configured to:

Further, in another embodiment of the apparatus for monitoring multisystem log data of the present invention, the apparatus for monitoring multisystem log data further includes:

the output module is used for outputting second prompt information to prompt that preset parameters are updated based on the parameter types if target system parameters corresponding to the parameter types do not exist;

and the updating module is used for distributing the updating interface combination and the updating display template group number to the interface group number and the display template group number of the system to be deployed corresponding to the deployment request so as to update the system to be deployed to the deployment system when receiving the updated preset parameters and the updating interface group number and the updating display template group number corresponding to the updated preset parameters.

Each virtual function module of the monitoring apparatus for multi-system log data is stored in the memory 1005 of the monitoring device for multi-system log data shown in fig. 3, and when the processor 1001 executes the monitoring program for multi-system log data, the function of each module in the embodiment shown in fig. 2 is implemented.

Referring to fig. 3, fig. 3 is a schematic device structure diagram of a hardware operating environment related to the method according to the embodiment of the present invention.

The monitoring device for the multi-system log data in the embodiment of the invention can be a Personal Computer (PC), and also can be a terminal device such as a smart phone, a tablet computer, an electronic book reader, a portable computer and the like.

As shown in fig. 3, the monitoring device for multi-system log data may include: a processor 1001, such as a CPU (Central Processing Unit), a memory 1005, and a communication bus 1002. The communication bus 1002 is used for realizing connection communication between the processor 1001 and the memory 1005. The memory 1005 may be a Random Access Memory (RAM) or a non-volatile memory (disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.

Optionally, the monitoring device for multi-system log data may further include a user interface, a network interface, a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi (Wireless broadband) module, and the like. The user interface may comprise a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface may also comprise a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface).

Those skilled in the art will appreciate that the configuration of the monitoring device for multi-system log data shown in fig. 3 does not constitute a limitation of the monitoring device for multi-system log data, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

As shown in fig. 3, a memory 1005, which is a readable storage medium, may include an operating system, a network communication module, and a monitoring program of multi-system log data. The operating system is a program for managing and controlling hardware and software resources of the monitoring equipment for the multi-system log data, and supports the running of the monitoring program for the multi-system log data and other software and/or programs. The network communication module is used for realizing communication among components in the storage 1005 and communication with other hardware and software in the monitoring equipment for the multi-system log data.

In the monitoring apparatus for multiple system log data shown in fig. 3, the processor 1001 is configured to execute a monitoring program for multiple system log data stored in the memory 1005, so as to implement the steps in each embodiment of the monitoring method for multiple system log data.

The invention provides a readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors for implementing the steps in the embodiments of the monitoring method for multi-system log data.

It should also be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a readable storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above, and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all modifications and equivalents of the present invention, which are made by the contents of the present specification and the accompanying drawings, or directly/indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A monitoring method for multi-system log data is characterized by comprising the following steps:

2. The method for monitoring multisystem log data according to claim 1, wherein the step of transmitting each of the current parameters to a presentation template corresponding to the presentation template group number for presentation according to the system identifier includes:

3. The method for monitoring multisystem log data according to claim 2, wherein the step of adding each statistical result to each presentation area in the presentation template for presentation comprises:

4. The method for monitoring multisystem log data according to claim 3, wherein the step of updating the statistical results for each presentation area in the presentation template comprises:

5. The method for monitoring multisystem log data according to claim 2, characterized in that the type identifier comprises an access identifier, a response time identifier and a success identifier; the step of performing classification statistics on the current parameters of each system according to each type identifier to generate statistical results of the current parameters of each system in each deployment system comprises:

dividing each response time data into each preset time interval, and counting the number of the response time data in each preset time interval to generate each number value;

6. The method for monitoring multisystem log data according to any one of claims 1 to 5, wherein the step of reading, when a deployment request is received, a parameter type corresponding to the deployment request comprises:

7. The method for monitoring multisystem log data according to claim 6, wherein the step of determining whether the target system parameter corresponding to the parameter type exists in the system parameters of each deployment system is followed by:

8. A monitoring apparatus for multisystem log data, comprising:

9. A monitoring device for multi-system log data is characterized in that the monitoring device for multi-system log data comprises: the system comprises a memory, a processor, a communication bus and a monitoring program of multi-system log data stored on the memory;

the processor is configured to execute the monitoring program for multi-system log data to implement the steps of the monitoring method for multi-system log data according to any one of claims 1 to 7.

10. A readable storage medium, on which a monitoring program of multi-system log data is stored, which when executed by a processor implements the steps of the monitoring method of multi-system log data according to any one of claims 1 to 7.