KR101674787B1 - System and method for measuring performance of program - Google Patents

Abstract

A program performance measurement system and method are disclosed. A program performance measurement system according to an embodiment of the present invention includes: a code insertion unit for inserting a measurement code for measuring the performance of the functional block into each of at least one functional block constituting a program; And a collecting unit for collecting information on the functional blocks determined as the performance degrading functional blocks by the measurement code among the one or more functional blocks when the program is executed.

Description

[0001] SYSTEM AND METHOD FOR MEASURING PERFORMANCE OF PROGRAM [0002]

Embodiments of the present invention relate to techniques for efficiently measuring the performance of a program.

Application Performance Management (APM) or application performance management refers to system management principles that focus on monitoring and managing application performance and service availability. Recently, as the service provided to the user becomes more diverse and complex, a program performance management technique for executing a desired transaction without delay is becoming more important. In particular, in the case of a large-scale system providing a large-capacity service, it is very important to quickly find out the cause of the program failure and to handle it, and it is also necessary to minimize the load on the system in this process.

However, in the case of the conventional program performance management technology, the performance information of the program for the approximate interval of the transaction is provided to the user (or the system administrator) through profiling. , Method (method)) can not be provided to the user in real time. Accordingly, the system administrator has to perform a secondary analysis to determine the exact position of the functional block in which the performance degradation or abnormality occurs, and the time and cost are wasted in this process. Further, in the case of the conventional program performance management technology, in order to grasp the exact position of the functional block in which the performance degradation or abnormality has occurred, all of the performance information of the analyzed program has to be provided to the user. In this process, .

Korean Patent Registration No. 10-0503776 (July 26, 2005)

Embodiments of the present invention are to select a functional block in which a performance degradation has occurred and provide an accurate position of the functional block in which performance degradation occurs to the user in real time.

According to an exemplary embodiment of the present invention, a code insertion unit for inserting a measurement code for measuring the performance of the functional block into each of at least one functional block constituting a program; And a collecting unit for collecting information of a functional block determined as a performance degrading functional block by the measurement code among the one or more functional blocks upon execution of the program.

Wherein the measurement code includes at least one instruction for calculating a difference between an execution start time and an execution end time of the functional block when the functional block is executed and determining the functional block as the performance reduction functional block when the difference is equal to or greater than a set threshold value . ≪ / RTI >

The performance measurement system of the program may further include a preprocessor for acquiring information on each of the one or more functional blocks before inserting the measurement code.

The code inserting unit may insert the information of the functional block obtained by the preprocessing unit into the functional block by inserting the information into the functional code.

The code inserting unit may insert the measurement code into the functional block through a bytecode instrument.

The information of the functional block may include at least one of a name of the functional block and a name of a class to which the functional block belongs.

The performance measurement system of the program may further include a display unit for displaying information of the functional blocks determined as the performance reduction functional blocks.

According to another exemplary embodiment of the present invention, there is provided a method for testing a function block, comprising: inserting a measurement code for measuring the performance of the functional block into each of at least one functional block constituting a program; And collecting information on a functional block determined as a performance degrading functional block by the measurement code among the one or more functional blocks at the time of execution of the program.

Wherein the measurement code includes at least one instruction for calculating a difference between an execution start time and an execution end time of the functional block when the functional block is executed and determining the functional block as the performance reduction functional block when the difference is equal to or greater than a set threshold value . ≪ / RTI >

The method for measuring the performance of the program may further include acquiring information on each of the one or more function blocks before the step of inserting the measurement code.

The step of inserting the measurement code may include information on the obtained function block in the measurement code and insert the measurement code into the function block.

The step of inserting the measurement code may insert the measurement code into the function block by means of a by-code instrument.

The information of the functional block may include at least one of a name of the functional block and a name of a class to which the functional block belongs.

The method of measuring the performance of the program may further include displaying information of the functional block determined as the performance degrading functional block, after the step of collecting information of the functional block determined as the performance degrading functional block.

According to the embodiments of the present invention, the name of the functional block determined to be degraded and the name of the class to which the functional block belongs are selected and provided to the user in real time, so that the user can accurately grasp the cause of the failure of the service, . As a result, the analysis time of the cause of the failure can be shortened, which ultimately leads to an improvement in the quality of the service. Particularly, in a large-scale system that provides a large-capacity service, the time and cost effect becomes larger.

1 is a block diagram for explaining a performance measurement system of a program according to an embodiment of the present invention;
2 is a diagram illustrating an example of detecting a degradation method in a transaction flow by a program performance measurement system according to an embodiment of the present invention;
3 is a flowchart illustrating a method of measuring a performance of a program according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, this is an exemplary embodiment only and the present invention is not limited thereto.

In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions of the present invention, and may be changed according to the intention or custom of the user, the operator, and the like. Therefore, the definition should be based on the contents throughout this specification.

The technical idea of the present invention is determined by the claims, and the following embodiments are merely a means for effectively explaining the technical idea of the present invention to a person having ordinary skill in the art to which the present invention belongs.

FIG. 1 is a block diagram illustrating a program performance measurement system 100 according to an embodiment of the present invention. Prior to specific description, the program 150 to be referred to below may be software or application written in an object-oriented language such as Java, C ++, C #, etc., and may be composed of one or more functional blocks. Here, the function block refers to a set of instructions for performing a specific function such as a method, a function, and the like. Hereinafter, for convenience of description, it is assumed that the program 150 according to an embodiment of the present invention is an application or software written in Java, and that the function block is a Java method. However, the programming language of the program 150 is not limited thereto, and the program 150 may be written in another programming language such as C, C ++, or the like.

The performance measurement system 100 of the program according to the embodiment of the present invention compares a source code (source code) of a target class (here, class 1 to class n is defined as a target class) This is to efficiently detect a functional block in which a performance degradation or an abnormality occurs without making any modification. As shown in FIG. 1, each of the target classes may include one or more methods. Here, a class defines attributes and behaviors belonging to a group, and is designed independently of other classes or external elements. An object is an instance of a class, has its own properties, and can perform the actions defined by the class. A method is a method of using an object created from a class to send an instruction to an object.

1, the program performance measurement system 100 includes a preprocessing unit 102, a code inserting unit 104, a collecting unit 106, and a display unit 108. The pre-

The preprocessing unit 102 collects information on each of the functional blocks. The information of the function block may include at least one of the name of the function block and the name of the class to which the function block belongs. The preprocessing unit 102 may collect information on each of the functional blocks before inserting the measurement code of the code inserting unit 104, which will be described later. The preprocessing unit 102 may inquire, for example, the name of the target class and the names of the respective methods in the target class, and may collect and store them from the Java virtual machine, for example, in a Java Virtual Machine (JVM) . The Java virtual machine is software for interpreting and executing a program written in Java. For example, the Java virtual machine grasps the name of a target class and the name of each method in a target class according to a query from the preprocessing unit 102, . As will be described later, the code inserting unit 104 can insert the information of the functional blocks obtained by the preprocessing unit 102 into the functional blocks by including them in the measurement code. The information of the functional blocks inserted in the functional blocks can be used to determine the exact positions of the functional blocks.

The code inserting unit 104 inserts a measurement code into each of one or more functional blocks. Here, the measurement code calculates the difference between the execution start time and the execution end time of the functional block when the functional block is executed. When the time difference is equal to or larger than the set threshold (for example, 0.0001) And < / RTI > For example, at the beginning of the method, a command to record the execution start time of the method at the time of execution of the program 150 is inserted. At the end of the method, a command to record the execution end time of the method at the time of execution of the program 150 A command for calculating a difference between an execution start time of the method and an execution end time of the method, a command for determining whether the difference is equal to or greater than the set threshold value and determining the method as a performance degradation method if the difference is equal to or greater than the set threshold value Can be inserted. On the other hand, the code inserting unit 104 may assign the same threshold value to each functional block, but different threshold value may be given to each functional block.

In addition, the code inserting unit 104 may insert the information of the functional blocks obtained by the preprocessing unit 102 into the functional blocks by including them in the measurement codes. As described above, the information of the function block may include at least one of the name of the function block and the name of the class to which the function block belongs. At this time, the information of the function blocks inserted into the respective function blocks is not a method or a function for inquiring the name of the corresponding function block and the name of the class to which the corresponding function block belongs in the memory (not shown) And the name of the class to which the corresponding function block belongs. Accordingly, the functional block does not need to inquire the name of the functional block and the name of the corresponding class separately in the execution process. This prevents the increase of the service load due to the addition of the functional block in the large capacity system. The following is an example of the measurement code inserted into the function block by the code inserting unit 104. [

class Sell // Class declaration

{

int numofObject = 30; // Define variables

int myMoney = 0; // Define variables

public int saleva (int money) // method declaration

{

long start = System.currentTimeMillis (); // record the start time of method execution

char methodname = 'saleva' // Name of Method Definition

char classname = 'Sell' // Define the name of the class to which the method belongs

int num = money / 1000; // Method contents

numofObject - = price; // Method contents

return price; // Method contents

long end = System.currentTimeMillis (); // Record execution end time of method

long elapsedTime = (end-start) / 1000.0; // Calculate the difference between the start and end times of the method

if (elapsedTime> 0.00001) // Determine whether the difference between the execution start time and the execution end time of the method is equal to or greater than the set threshold value

System.out.println (methodname); // Output method name

System.out.println (classname); // Output the class name to which the method belongs

}

public void Buy (sell price, int money) // method declaration

...

}

In this example, only when the difference between the execution start time and the execution end time of the functional block becomes equal to or greater than the set threshold value, the name of the functional block and the class name to which the functional block belongs are outputted. However, But is not limited thereto. For example, the measurement code is configured to output the name of each functional block and the name of the class to which the functional block belongs, and the collecting unit 106, which will be described later, The name and the name to which the function block belongs can be selected and collected.

On the other hand, the code inserting unit 104 may insert a measurement code into each functional block through a by-code instrument. Byte code instrument means a technique of dynamically inserting a specific bytecode at the execution stage of the program 150 without modifying the source code (source code) of the program 150. [ Bytecode is a compiled form of a Java program that can be executed by a Java additive machine. The code inserting section 104 does not insert the measurement code into each functional block at the source code level but at the execution stage of the program 150 and more specifically the start preparation stage (or just before the start of the program 150) The measurement code can be inserted into each function block by means of the means.

When the program 150 is executed, the collecting unit 106 collects information on the functional blocks determined as the performance degrading functional blocks by the measurement code among the one or more functional blocks. As described above, the measurement code inserted into each functional block by the code inserting unit 104 calculates the difference between the execution start time and the execution end time of the corresponding functional block when the program 150 is executed, Or whether the corresponding functional block is a performance degradation functional block according to whether the functional block is a performance degradation functional block or not. If the difference between the execution start time and the execution end time of the functional block becomes equal to or greater than the set threshold value, the measurement code may be configured to output the name of the functional block and the name of the class to which the functional block belongs. That is, the response time of the function block (the difference between the execution start time and the execution end time) is used as a criterion for judging whether or not the performance of the functional block deteriorates. The collection unit 106 may collect the names of the performance degradation function blocks output by the measurement code and the names of the classes to which the performance degradation function blocks belong.

If the measurement code outputs both the name of each functional block and the name of the class to which the functional block belongs, the collecting unit 106 acquires the name of the functional block determined as a performance degradation functional block by the measurement code, You may collect these names by selecting them. Then, the collecting unit 106 may transmit the name of the collected performance degrading functional block and the name of the class to which the performance degrading functional block belongs to the display unit 108.

The display unit 108 displays the name of the performance degradation function block received from the collection unit 106 and the name of the class to which the degradation method belongs, thereby providing the user with the precise location of the functional block and the class where the problem occurred. In addition, the display unit 108 may provide the name of the performance reduction function block to the user for each transaction, which will be described later with reference to FIG.

According to the embodiments of the present invention, the name of the functional block determined to be degraded and the name of the class to which the functional block belongs are selected and provided to the user in real time, so that the user can accurately grasp the cause of the failure of the service, . As a result, the analysis time of the cause of the failure can be shortened, which ultimately leads to an improvement in the quality of the service. Particularly, in a large-scale system that provides a large-capacity service, the time and cost effect becomes larger.

FIG. 2 is a diagram illustrating an example of detecting a degradation method in a transaction flow by a program performance measurement system 100 according to an embodiment of the present invention. As shown in FIG. 2, a transaction may be represented by a combination of a plurality of methods, which can be expressed as follows.

Transaction 1: Method 1 → Method 2 → Method 4

Transaction 2: Method 1 → Method 3 → Method 4 → Method 5

Transaction 3: Method 1 → Method 5 → Method 6

The measurement code inserted into each method by the code inserting unit 104 calculates the difference between the execution start time and the execution end time of the corresponding method when the program 150 is executed and judges whether or not the difference is equal to or more than the set threshold value . If the difference between the execution start time and the execution end time of the method is equal to or greater than the set threshold value, the measurement code may be configured to output the name of the method and the name of the class to which the method belongs. Can collect the name of the degraded method and the name of the class to which the degraded method belongs.

If it is determined that the method 2 and the method 6 are performance degradation methods by the above process, the collecting unit 106 acquires not only the names of the performance degradation methods (method 2 and method 6) (Transaction 1, transaction 3) to the display unit 108. [ Accordingly, the display unit 108 can display to the user the name of the degradation method, the name of the class to which the degradation method belongs, and the name of the transaction to which the degradation method belongs.

3 is a flowchart illustrating a method of measuring a performance of a program according to an embodiment of the present invention.

First, the preprocessing unit 102 obtains information of each functional block (S302). For example, the preprocessing unit 102 queries the name of the target class and the name of each method in the target class to the Java Virtual Machine (JVM, not shown) before inserting the measurement code of the code inserting unit 104 , And can collect and store it from the Java virtual machine.

Next, the code inserting unit 104 inserts the information of the function block into each function block by inserting the information of the function block into the measurement code (S304). The measurement code is a set of instructions for judging a performance degradation of a functional block and is inserted at the beginning and end of each functional block to record the execution start time and execution end time of each functional block at the time of execution of the program 150 And determine whether the difference between the execution start time and the execution end time of each functional block is equal to or greater than a set threshold value. Further, the measurement code may include an instruction to define information of the functional block. The information of the function block may include at least one of the name of the function block and the name of the class to which the corresponding function block belongs. In this case, the information of the function block is not a function or a method type but a name that defines the name of the corresponding function block and the name of the class to which the function block belongs. Accordingly, the functional block does not need to inquire the name of the functional block and the name of the corresponding class separately in the execution process. This prevents the increase of the service load due to the addition of the functional block in the large capacity system.

On the other hand, the code inserting unit 104 may insert a measurement code into each functional block through a by-code instrument. Byte code instrument means a technique of dynamically inserting a specific bytecode at the execution stage of the program 150 without modifying the source code (source code) of the program 150. [

Next, the collecting unit 106 collects the name of the functional block judged to be the performance degrading functional block and the name of the class to which the performance degrading functional block belongs (S306). As described above, when the difference between the execution start time and the execution end time of the functional block becomes equal to or greater than the set threshold (for example, 0.0001), the measurement code includes the name of the functional block and the name of the class And the collecting unit 106 may collect the name of the performance degrading functional block output by the measurement code and the name of the class to which the performance degrading functional block belongs.

Finally, the display unit 108 displays the name of the degraded function block and the name of the class to which the degraded function block belongs (308). Thus, it is possible to provide the user with an accurate position of the function block and the class in which the problem occurs. In addition, the display unit 108 may provide a name of the performance degrading function block to the user on a transaction-by-transaction basis.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, I will understand. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by equivalents to the appended claims, as well as the following claims.

100: Program performance measurement system
102:
104:
106: collecting section
108:
150: Program

Claims (14)

A preprocessor for obtaining information of a function block including a name of a function block constituting a program and a name of a class to which the function block belongs;
Inserting one or more instructions for defining information of the functional block into a measurement code for measuring the performance of the functional block and inserting the measurement code into which the instruction is inserted into each of the functional blocks;
A collecting unit for collecting information on a functional block judged to be a performance degrading functional block by the measurement code and a name of a transaction to which a functional block judged to be the performance degrading functional block belongs among the one or more functional blocks when the program is executed; And
And a display unit for displaying the information of the functional blocks judged to be the performance degrading functional blocks and displaying the names of the functional blocks judged as the performance degrading functional blocks for each transaction to which the functional blocks determined as the performance degrading functional blocks belong, Program performance measurement system.
The method according to claim 1,
Wherein the measurement code includes at least one instruction for calculating a difference between an execution start time and an execution end time of the functional block when the functional block is executed and determining the functional block as the performance reduction functional block when the difference is equal to or greater than a set threshold value And the program performance metric.
delete delete The method according to claim 1,
Wherein the code inserting unit inserts the measurement code into each of the functional blocks through a Byte Code Instrument.
delete delete Acquiring information of a functional block including a name of a functional block constituting a program and a name of a class to which the functional block belongs;
Inserting at least one instruction defining the information of the functional block into a measurement code for measuring the performance of the functional block and inserting the measurement code into which the instruction is inserted into each of the functional blocks,
In the collecting unit, when the program is executed, the information of the functional blocks judged to be the performance degrading functional blocks by the measurement code and the names of the transactions to which the functional blocks determined as the performance degrading functional blocks belong are collected step; And
Displaying the information of the functional blocks judged to be the degraded functional blocks in the display unit and displaying the names of the functional blocks judged to be the degraded functional blocks for each of the transactions to which the functional blocks judged to be the degraded functional blocks belong; / RTI > of a program.
The method of claim 8,
Wherein the measurement code includes at least one instruction for calculating a difference between an execution start time and an execution end time of the functional block when the functional block is executed and determining the functional block as the performance reduction functional block when the difference is equal to or greater than a set threshold value / RTI > of a program.
delete delete The method of claim 8,
Wherein inserting the measurement code into each of the functional blocks inserts the measurement code into each of the functional blocks through a Byte Code Instrument.
delete delete

Images