JP2004259146A - Method and system for setting threshold automatically - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To set a threshold for measuring performance in execution of a software application to detect fluctuation of a measured value. <P>SOLUTION: Measured value groups measured in the past are collected, the desired measured value group is selected by a parameter out of the collected measured value groups, the threshold for detecting the performance measurement and the fluctuation of the measured value is automatically determined to be regulatable, based on the selected measured value group, and the threshold is set, automatically. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a method and a system for measuring the performance of a software application at the time of execution and for setting a threshold value for detecting a change in the measured value.In particular, the present invention relates to a method for automatically setting a threshold value based on a measured value measured in the past. The present invention relates to a method and system for dynamically setting.
[0002]
[Prior art]
When a software application is executed, for example, the execution time of the application is 100 msec or the memory usage of the application is 20 megabytes. The performance is measured, and a threshold is set to detect a change in the measured value. Setting has been done. In the conventional method in this case, the operator who sets the threshold value manually sets the threshold value (for example, see Non-Patent Document 1).
[0003]
[Non-patent document 1]
Wily Technology (http://www.wilytech.com)
Product Introscope
Introscope material “introscopeuserguide2-6.pdf” Page 34
[0004]
[Problems to be solved by the invention]
In the above-described conventional threshold value setting method, the operator who sets the threshold value must determine the threshold value by his / her own judgment, and thus it is difficult to set an appropriate threshold value. In addition, when the number of threshold values to be set is large, the threshold values must be manually set for all of them.
[0005]
It is an object of the present invention to automatically set a threshold used when measuring the performance of a software application at the time of execution.
[0006]
[Means for Solving the Problems]
In the threshold value automatic setting method and system according to the claims, a threshold value is determined based on a group of measurement values measured in the past, and upon determining the threshold value, a parameter for setting the threshold value is received, so that the threshold value is determined. At the time of the determination, the threshold determined using the parameter is determined to be adjustable.
And a step.
[0007]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a configuration diagram of an entire system including a monitoring system provided with a threshold automatic setting method in the present embodiment. It comprises a computer device 1, a computer device 2, a computer device 3, and a computer device 4.
[0008]
The computer device 1 includes an application 11, a monitoring agent unit 12, and a performance information log 13.
[0009]
The application 11 is a software application whose execution performance is to be measured in the present embodiment. The monitoring agent unit 12 is a component of the monitoring system, and collects execution performance information of the application 11.
[0010]
The monitoring agent unit 12 includes a performance information collection unit 121, a threshold excess verification unit 122, and a recording unit 123. The threshold excess verification unit 122 includes a threshold change reception unit 51, a threshold comparison unit 52, and a threshold comparison unit 52. An excess notification unit 53 is provided.
[0011]
The performance information log 13 records performance information at the time of execution of the application 11, and is generated by the monitoring agent unit 12.
[0012]
The computer device 2 includes a monitoring system operation unit 21. The monitoring system operation unit 21 is a component of the monitoring system, and provides a function for an operator operating the monitoring system to operate the monitoring system.
[0013]
The monitoring system operation unit 21 includes an automatic threshold setting unit 211, a threshold excess notification display unit 212, and a threshold excess notification accepting unit 213. The automatic threshold setting unit 211 includes a log analysis unit 61, a parameter setting unit 62, a threshold calculation unit 63, and a threshold change instruction unit 64.
[0014]
The computer device 3 includes a monitoring manager unit 31. The monitoring manager unit 31 is one component of the monitoring system, and functions as a manager of the monitoring system.
[0015]
The monitoring manager unit 31 includes a threshold change management unit 311, a threshold excess notification reception unit 312, and a threshold excess notification unit 313. The threshold change management unit 311 includes a threshold change instruction reception unit 71, a threshold write A unit 72 and a threshold change notification unit 73 are provided.
[0016]
The computer device 4 includes a data storage unit 41. The data storage unit 41 is one component of the monitoring system, and stores various data. The data storage unit 41 stores information on the monitoring conditions 411 including information on the threshold.
[0017]
FIG. 2 shows that the monitoring system including the monitoring agent unit 12, the monitoring system operation unit 21, the monitoring manager unit 31, and the data storage unit 41 measures the performance of the application 11 at the time of execution, and It is a flowchart explaining operation | movement when exceeds a threshold value.
[0018]
FIG. 3 is a flowchart illustrating an operation of automatically setting a threshold in a monitoring system having features of the present invention.
FIG. 4 is an example of a screen of the threshold automatic setting unit 211.
[0019]
Hereinafter, first, the operation when the measured value exceeds the threshold will be described with reference to the operation flowchart of FIG.
[0020]
The application 11 receives a processing request from the outside and executes the processing. The performance at the time of the execution is collected by the performance information collection unit 121 of the monitoring agent unit 12. The collected performance information at the time of execution includes the processing execution time of each software component constituting the application 11 and the processing execution time of each method of the software component.
[0021]
The performance information collection unit 121 passes the collected performance information to the threshold comparison unit 52 of the threshold excess verification unit 122 (Step S1). The threshold comparing unit 52 compares the performance information with a threshold (Step S2). As the threshold value used in the comparison, a threshold value set at that time is used for the individual performance information passed. For example, when examining the execution time as the performance of the application as described above, a threshold value such as 110 msec or 200 msec is appropriately changed and used, and when examining the memory usage, the threshold value is, for example, 100 megabytes (change appropriately). Is used.
[0022]
As a result of the comparison with the threshold, if the threshold is not exceeded, the verification processing of the threshold excess is terminated, the performance information is passed to the recording unit 123, and an instruction to record the performance information is issued (step S3). . The recording unit 123 records the performance information on the memory (Step S4).
[0023]
If the result of comparison with the threshold value in step S2 indicates that the threshold value has been exceeded, the performance information is notified to the threshold excess notification unit 53 that the threshold value has been exceeded (step S5). The threshold excess notification unit 53 notifies the threshold excess notification reception unit 312 of the monitoring manager unit 31 that the performance information has exceeded the threshold (step S6). The threshold excess notification receiving unit 312 receives the notification from the threshold excess notification unit 53 of the monitoring agent unit 12, and requests the threshold excess notification unit 313 to perform processing (step S7). The threshold excess notification unit 313 notifies the threshold excess notification reception unit 213 of the monitoring system operation unit 21 that the performance information has exceeded the threshold (step S8). The threshold excess notification receiving unit 213 receives the notification from the threshold excess notification unit 313 of the monitoring manager unit 31, and requests the threshold excess notification display unit 212 to perform processing (step S9). The threshold excess notification display unit 212 displays on a screen or the like that the performance information has exceeded the threshold (step S10).
[0024]
In the monitoring system having the features of the present invention, the above operation is repeated every time the performance information is measured. In this operation, the recording unit 123 records the performance information recorded on the memory in step S4 in a performance information log at a timing such as a designated time interval (step S11).
[0025]
Next, an operation of automatically setting a threshold value in a monitoring system having the features of the present invention will be described with reference to FIG.
[0026]
The log analysis unit 61 of the automatic threshold value setting unit 211 reads the performance information log 13 generated in the description of the operation according to an instruction of the operator who operates the monitoring system (Step S21). The log analysis unit 61 analyzes the read performance information log 13 (step S22), and requests the parameter setting unit 62 for the next processing (step S23). The parameter setting unit 62 provides an interface for inputting parameters to the operator of the monitoring system, and the operator sets parameters using the interface (step S24). The parameter setting unit 62 requests the threshold calculation unit 63 to perform the next process (step S25).
[0027]
The threshold calculator 63 calculates a threshold based on the parameter values set by the operator in step S24 (step S26). The threshold calculation unit 63 requests the threshold change instruction unit 64 for the next process (step S27). The threshold change instruction unit 64 instructs the threshold change instruction receiving unit 71 of the monitoring manager unit 31 to set the threshold calculated in step S26 as a new threshold (step S28). The threshold change instruction receiving unit 71 receives the instruction and requests the threshold writing unit 72 to perform processing (step S29). The threshold writing unit 72 stores the threshold calculated in step S26 in the data storage unit 41 (step S30).
[0028]
The threshold value change instruction receiving unit 71 issues the instruction to the threshold value writing unit 72 and also instructs the threshold value change notification unit 73 to notify the change content of the threshold value (step S31). The threshold change notification unit 73 notifies the threshold change receiving unit 51 of the monitoring agent unit 12 of the change of the threshold (Step S32). The threshold change receiving unit 51 recognizes the changed new threshold based on the notification (step S33).
[0029]
The new threshold obtained in step S33 is used by the threshold excess verification unit 122 for verification of the threshold excess from the next time.
[0030]
Next, the parameter setting in step S24 will be described with reference to FIG.
The example shown in FIG. 4 is an example of a screen when parameter setting is performed using a graphical user interface.
[0031]
In this screen example, there is a specification column 81 for specifying the performance information log 13 to be analyzed by the log analysis unit 61. Here, the operator specifies the location and name of the performance information log 13 so that the log analysis unit 61 It is read by 61.
[0032]
There are also specification columns 82 and 83 for specifying a log analysis exclusion range. The specification column 82 indicates how many parts from the beginning of the performance information log 13 specified in the specification column 81 are excluded from the analysis target. specify. In this case, it is assumed that the performance information log 13 is recorded in chronological order in the order in which the performance information was measured. Similarly, the specification column 83 specifies how many parts from the end of the performance information log 13 specified in the specification column 81 are excluded from the analysis target.
[0033]
In a Web application or the like constructed by the Java language ((Java language): an object-oriented programming language developed by Sun Microsystems), a part of the program can usually be executed when first externally accessed. In this case, the processing execution time at the time of the first access includes the processing time for converting a part of the program into an executable form, and is compared with the subsequent normal processing execution time. Then, it is measured as a longer time. Further, even when the application is terminated, a process different from the normal process may be performed. Therefore, a specific measurement value may be measured as compared with the normal process execution time.
[0034]
Therefore, as described above, by specifying the range to be excluded from the analysis target, a more effective value can be calculated as the threshold. When it is determined that there is no possibility that the performance information log 13 to be analyzed includes a measurement value different from the normal processing execution time, zero is displayed in the specification columns 82 and 83 according to the operator's determination. Is specified, all the performance information included in the performance information log 13 is to be analyzed.
Further, in this screen example, an example of a calculation formula of the threshold is also shown.
[0035]
In this example, the performance information included in the performance information log 13 is classified into measurement values for the same target for which a threshold is set, and a plurality of measurement values in the same target are arranged in descending order of the value. On the other hand, a value corresponding to the percentage is calculated based on the value specified in the specification column 84. For example, when there are ten data with a measurement value of 1 (second) to 10 (second), when the value specified in the specification column 84 is 70 (%), the measurement value used for calculating the threshold value Is assumed to be 7 (seconds).
[0036]
This value is further multiplied by the weight coefficient specified in the specification field 85.
In the specification column 86, a weighting factor for the average value of a plurality of measurement values in the same target is specified and used for calculating the threshold.
[0037]
In this calculation example, instead of using a measurement value that may have been obtained in a specific situation, such as the maximum value, the threshold value can be calculated using a value corresponding to the top few percent of the measurement value. , A more effective value can be calculated. Further, by adjusting the values specified in the specification fields 84, 85, and 86, a threshold value based on only the average value or a threshold value based on the maximum value is calculated based on the judgment of the operator. be able to.
[0038]
In this case, if the operator desires to use a value corresponding to the top few percent of the measured values as the threshold value, the value specified in the specification column 86 is set to 0, and the threshold value based on only the average value is desired. In this case, the value specified in the specification column 85 may be set to 0.
[0039]
The present invention is not limited to the embodiments described above, and various modifications and applications are possible within the scope of the claims.
[0040]
【The invention's effect】
As described above, according to the present invention,
Since the threshold value can be automatically set except for the parameter setting operation, when the number of targets for setting the threshold value is large, the labor of the operator who sets the threshold value can be reduced.
[0041]
Further, since the parameter value can be set by the operator when calculating the threshold value, the threshold value to be determined can be adjusted at the time of determining the threshold value, and the threshold value desired by the operator can be set. This also enables effective monitoring.
[Brief description of the drawings]
FIG. 1 shows an example of a configuration diagram of an entire system including a monitoring system provided with a threshold automatic setting method of the present invention.
FIG. 2 is a flowchart illustrating an operation when a measured value exceeds a threshold.
FIG. 3 is a flowchart illustrating an operation of automatically setting a threshold.
FIG. 4 shows a screen example of a threshold automatic setting unit.
[Explanation of symbols]
REFERENCE SIGNS LIST 1 computer device 11 application 12 monitoring agent unit 121 performance information collection unit 122 threshold excess verification unit 51 threshold change reception unit 52 threshold comparison unit 53 threshold excess notification unit 123 recording unit 13 performance information log 2 computer device 21 monitoring system operation unit 211 threshold Automatic setting unit 61 Log analysis unit 62 Parameter setting unit 63 Threshold calculation unit 64 Threshold change instruction unit 212 Threshold excess notification display unit 213 Threshold excess notification reception unit 3 Computer device 31 Monitoring manager unit 311 Threshold change management unit 71 Threshold change instruction reception unit 72 Threshold writing unit 73 Threshold change notification unit 312 Threshold excess notification receiving unit 313 Threshold excess notification unit 4 Computer device 41 Data storage unit 411 Monitoring condition

Claims (8)

Regarding a data processing system having at least a processor and a memory for executing a software application, a performance of the software application at the time of execution is measured, and in order to detect a change in a measured value, a threshold automatic setting method for setting a threshold ,
A group of measurement values measured as a result of the execution of the application in the past is collected, and a threshold for detecting the performance measurement and the fluctuation of the measurement value is automatically set based on the collected measurement value group. A threshold automatic setting method, characterized in that: In measuring the performance of the software application at run time and detecting the fluctuation of the measured value, in automatically setting the threshold based on the measured value measured in the past,
A parameter set to select a desired measurement value group among the measurement value groups measured in the past is received, and the automatically set threshold value is determined to be adjustable based on the desired measurement value group. 2. The method for automatically setting a threshold value according to claim 1, wherein: To measure the performance of the software application at run time and detect fluctuations in the measured values, the threshold is automatically set based on the measured values measured in the past. 3. The threshold value automatic setting method according to claim 1, wherein the threshold value is determined excluding a part and a latter half part. To measure the runtime performance of software applications and automatically set thresholds based on measured values in the past to detect fluctuations in measured values,
Processes the measured values measured in the past for each threshold setting target and determines the threshold based on the top few percent of the measurement values for each setting target and the average of the measurement values for each setting target 4. The method for automatically setting a threshold value according to claim 1, wherein: Regarding a data processing system having at least a processor and a memory that executes a software application, in a threshold automatic setting system that sets a threshold in order to measure the performance at the time of execution of the software application and detect a change in the measured value ,
Means for collecting a group of measurement values measured as a result of executing the application in the past,
Means for automatically determining a threshold value for detecting the performance measurement and the fluctuation of the measurement value based on the collected measurement value. To measure the runtime performance of software applications and automatically set thresholds based on measured values in the past to detect fluctuations in measured values,
Means for receiving a parameter for selecting a desired measurement value group among the measurement value groups measured in the past,
6. The automatic threshold setting system according to claim 5, further comprising: means for determining the automatically set threshold based on the desired measurement value group so as to be adjustable. To measure the performance of the software application at run time and detect fluctuations in the measured values, the threshold is automatically set based on the measured values measured in the past. Means for excluding the part and the latter part;
7. The automatic threshold value setting system according to claim 5, further comprising: means for determining a threshold value based on the excluded measurement value group. To measure the runtime performance of software applications and automatically set thresholds based on measured values in the past to detect fluctuations in measured values,
In addition to the means for extracting the measured value measured in the past, the measured value corresponding to the top few percent of the measured value for each setting target for each setting target of the threshold, and the average value of the measured value for each setting target,
8. The automatic threshold value setting system according to claim 5, further comprising: means for determining a threshold value based on the extracted measured value and the average value.

Images