JPH0934754A - Instrument and method for measuring performance of program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a means, with which measurement can be executed without preparing any driver programs dedicated to each route by facilitating environment preparation for performance measurement and the performance of various kinds of items can be measured simultaneously with time measurement as well, concerning a device for measuring the execution performance of a program. SOLUTION: A performance measuring part 200, in which the program is executed in a debugging mode for generating the trap each time an instruction is executed and control is assigned by the trap, is provided with an instruction execution time collecting means 6 for measuring the instruction execution time for each instruction, program execution time measuring means 9 for measuring the execution time of the program from this instruction execution time, measuring means 7 and 8 for a dynamic step and route trace to be simultaneously measured, execution control means 1 for designating a measurement start point and an end point and state operating means 2 for operating data and deciding any route.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for measuring program execution performance. For business application programs, it is necessary to measure the execution performance of the program and verify whether the performance as designed is obtained before starting actual operation. However, in order to measure the performance of the program, it is necessary to prepare a special environment for the performance measurement, and the problem of the performance of the program cannot be detected early in the development process.

Therefore, it is necessary to easily measure the performance of the application program.

[0003]

2. Description of the Related Art In the conventional performance measurement of programs, an application program to be measured is started in an environment for performance measurement, and performance measurement is performed for specific parts of the program. In this case, the performance can be measured only for a specific route of the program that operates under the measurement environment, and in order to measure another route on the program, prepare the environment such as the driver program to execute the route. Had to do. Therefore, in order to measure a route that does not frequently travel on a special route, it is necessary to prepare a driver program environment for each route, and it is not possible to easily measure the performance.

In an example of time measurement, Japanese Patent Laid-Open No. 3-102437
Using the depagger symbol information created by the compiler, by embedding trap instructions in the program whose performance is to be measured, the preprocessor that calls the performance measurement routine for the program whose performance is to be measured, A method characterized by eliminating the need for compilation and relinking is shown.

However, it is possible to perform flexible and easy-to-operate performance measurement in which various performance items such as means for easily setting a program execution route and dynamic steps can be measured simultaneously with time measurement. Not not.

[0006]

As described above, in the conventional technique, the application program whose performance is to be measured is started in the environment for performance measurement. Therefore, in order to measure a certain route on the program, the route is measured. There is a problem that it is necessary to create a driver program for Windows, which requires considerable effort to prepare the environment.

In view of the above points, the present invention facilitates environment preparation for performance measurement, enables measurement without creating a driver program dedicated to each route, and measures various performance items with time. At the same time, it is an object of the present invention to provide a performance measuring means capable of flexibly measuring.

[0008]

The above problems can be solved by a program performance measuring apparatus configured as follows.

FIG. 1 is a block diagram of the present invention. A debug mode program execution environment unit 300 is an environment for executing the measurement target program in a debug mode in which indexing is generated for each instruction (claims 1 to 8).

A measurement operation unit 100 designates an instruction to start measurement and an instruction to end measurement of the program to be measured by an address, starts the program, and the started program starts the measurement specified by the above. Execution control means 1 for interrupting the execution of the program when the instruction of the address is reached and restarting the execution of the interrupted program, and execution of the interrupted program when the measurement target program interrupts the execution. And a status operating means 2 for setting data for determining a route (claims 4 and 8).

Reference numeral 200 denotes a performance measurement unit, which is controlled by an index generated when the measurement target program is executed in the debug mode, and the necessary performance measurement information is processed for each instruction to determine the measurement target program. It returns control to the original.

The respective means constituting this will be shown below (claims 1 to 3, 5 to 7). Instruction execution time collection means 6
Starts timing when the performance measuring unit whose control is transferred by the above-mentioned indexing returns control to the indexing source and ends timing when control is transferred by the indexing generated after the execution of one instruction of the measurement target program. The execution time of one instruction is temporarily stored (claim 1,
5).

The performance measurement control unit 5 controls the execution of the operation of each means of the performance measurement unit 200, and includes a storage unit (not shown) for temporarily storing information (claims 1 to 1).
3, 5-7).

The program execution time measuring means 9 integrates and stores the temporarily stored instruction execution time for the instructions to be executed from the measurement start to the measurement end of the measurement object program (claims 1 and 5). ).

The dynamic step measuring means 7 counts and stores the number of times each time the control is transferred by the indexing (claims 2 and 6). The route trace measuring means 8 stores the address and code of the instruction executed by the measurement target program in time series every time the control is transferred by the above-mentioned indexing (claims 3 and 7).

[0016]

By executing the measurement target program in the debug mode program execution environment unit 300 in the debug mode, control is transferred to the performance measurement unit 200 according to the generated index, and the necessary performance measurement information is processed for each instruction. Performance is measured while tracing execution of instructions according to the logic of the program so that control is returned to the index source of the measurement target program.

The measurement of the execution time of the program is started after the instruction execution time collection means 6 whose control is transferred by the above-mentioned indexing returns control to the indexing source, and after the execution of one instruction of the program to be measured. When the control is transferred by indexing, the time measurement is ended, and the instruction execution time of the above-mentioned one instruction is temporarily stored, and the instruction is executed by the program execution time measuring means 9 from the start of measurement to the end of measurement, and is sequentially accumulated and stored. (Claims 1 and 5).

The dynamic step measurement is performed by accumulating and storing the number of times each time the control is transferred by the dynamic step measuring means 7 by the indexing (claims 2 and 6).

The route trace measuring means 8 measures and records the route of the instruction of the executed program by accumulating and storing the address and code of the instruction to be executed by the program to be measured every time the control is transferred by the above-mentioned indexing. (Claims 3 and 7).

Reference numeral 100 denotes a measurement operation unit, which is an execution control means 1
When the address of the instruction to start the measurement of the measurement target program and the address of the instruction to end the measurement are specified by, the above program is started, and the started program reaches the execution of the specified measurement start instruction. The execution of the program is interrupted, the state operation means 2 sets the data for determining the execution route of the interrupted program, and the operation execution control means 1 restarts the execution of the interrupted program again. (Claim 4,
8).

[0021]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 2 shows a block diagram of an embodiment of the present invention. The measurement operation unit 100 is a measurement condition of the measurement target program 300,
It operates the measurement environment and includes an execution control unit 1, a state operation unit 2, and a data analysis unit 23. The measurement operation unit 1
00 is a function of a conventional debugger.

The execution operation unit 1 is a measurement target program 300.
Is set to a state where it can be executed in the debug mode, and the start of the instruction for performance measurement and the instruction for ending the measurement are set by designating their addresses as measurement points XA25 and XB26, respectively. The address can be specified as a symbol by using the symbol information of the debugger, or can be specified by checking the address from the list of object code.

The execution route can be specified by changing the data in the data section 27 of the program to be measured and setting it to change the route determined by the internal logic. That is, the route can be specified by operating the data, which is the function of the debugger, by the state operating unit 2 and setting the necessary data.

The operation is controlled by the operator at the time of starting the measurement and when reaching the set measuring point, and is carried out by a conversation with the operator through the operation terminal 21 having an input / output function such as a display screen, a keyboard and a mouse. . The data of the measurement result can be displayed on the operation terminal 21 and can be recorded on the output device 22 including the analysis result.

The performance measuring unit 200 uses the measurement target program 3
The performance information generated by executing 00 is collected, stored, processed, and recorded in the measurement data storage unit 10. Next, an operation flowchart of the embodiment of the present invention shown in FIG. 3 will be described. There are various combinations of performance measurement items, but here, the measurement of the program execution time will be described as an example.

In step S31, the program whose execution time is to be measured is specified by the execution control unit 1 so that the program can be executed in an environment where performance can be measured.
In other words, the program is arranged so that it can be executed in the debug mode, and the function of the above-mentioned debugger is used.

In step S32, the measurement point XA25 is set as the position to start the execution time measurement in the set program and the measurement point XB26 is set as the end position by designating the addresses in the corresponding program list.

In step S33, the execution control unit 1 gives an instruction to start the execution of the program. The program starts executing from the entry point, just like a normal start. That is, the functions provided in the measurement target program operate as they are for the initial setting of data in the normal operation of the program. However, since the execution mode is the debug mode as set above, the measurement target program 300 will generate an index each time one instruction is executed, and the performance measurement unit 200 will be controlled by the indexing. Therefore, it is detected whether or not the address has reached the set measurement start point, that is, the measurement point XA25.

As shown in step S34, the measurement point XA2
The execution control unit 1 notifies the operator that the number 5 has been reached, and the operator can operate the state operation unit 2 from the operation terminal 21.

The operator can change the setting of the program environment in step S35. Here, the operating environment such as the contents of the memory of the program is set by using the state operation unit 2, and preparation is made so that the intended execution route on the program operates.

Further, a measurement item to be measured when executing the set route between the two set measuring points is selected from the menu. In addition to measuring the program execution time in the menu, the number of dynamic steps and the route of the executed program are measured, but here the measurement of the execution time is specified.

In step S36, the execution control unit 1 restarts the execution of the program while measuring the performance.
To instruct. The performance measurement unit 200, to which control is passed each time a command is executed as the program is executed, collects performance information according to the specified performance measurement items. Here, in order to measure the execution time of the program, the execution time of each instruction is measured while reading the time information to measure the time required to execute the program. At the same time, performance measurement unit 2
At 00, it is monitored whether or not the execution address of the program reaches the measurement point XB26 indicating the end of measurement.

When the measurement point XB is reached in step S37, the execution control unit 1 notifies the operator of the reason and waits for the operator's instruction. Step S
At 38, the operator decides whether to change the data setting to measure the execution time of another route or to end the measurement. When the measurement is performed again, the execution control unit moves to step S32.

Before entering the description of the operation of the performance measuring section 200, the indexing in the debug mode will be described with reference to FIG. In the figure of the measurement target program 300, the instructions are arranged in the order of execution. That is, when the execution order of a branch instruction or the like is changed instead of the physical address order, the branch destination instruction is arranged next.

After the A instruction execution 41, indexing occurs as shown by the arrow, and the execution of the instruction of the measurement target program 300 does not proceed to the next, and control is passed to the performance measuring unit 200 by the indexing. Details of the operation of the performance measuring unit 200 are shown in FIGS.
As will be described later, the performance measurement process, which is the original process, causes the performance measurement unit 200 to perform the process depending on the measurement content or by the time-consuming I / O operation of storing the measurement data in the external storage medium. The time required is not constant, and more steps are required in comparison with the number of execution steps of the instruction of the measurement target program 300. In particular, in measuring the time, it is necessary to be careful where the clock is recorded. Therefore, saving and restoring the state of the measurement target program 300 such as a register for indexing and restoring is minimized, and reading of the clock is performed as close to the entrance and exit as possible so as to be used for time measurement. I have to. On the contrary, in this way, in the performance measurement processing 45, it is possible to prevent the accuracy of the performance measurement from being affected by any processing.

When returning from the performance measuring unit 200, as a result of the execution of the A instruction 41 as described above, the control shifts to the instruction B42 to be executed next. When the B instruction 42 is executed, control is transferred to the head of the performance measuring unit by indexing as in the above. Then, when the performance measurement processing 45 ends, the performance measurement unit 200 returns to the C instruction 43, and thereafter, the instructions of the measurement target program 300 are similarly executed.

As described above, various performances can be measured for each instruction by determining each execution of one instruction of the measurement target program 300. 5 and 6 are flowcharts (No. 1 and No. 2) of the operation of the performance measuring unit.
Further, FIG. 7 shows a configuration explanatory diagram of a measurement information storage table used for performance measurement processing, and the operation will be described with reference to these.

In step S501, the next step S50
Save the minimum number of registers necessary for the temporary storage of the clock performed in 2. In step S502, the clock is stored in the TG of the measurement information storage table 72 as the read instruction execution end time as the execution end time of the instruction of the measurement target program executed immediately before the indexing. Next, the other registers are saved in step S503, and the operation of the main body of the performance measuring unit proceeds.

First, the in-measurement flag in TB of the measurement information storage table 72 is checked. The in-measuring flag indicates whether or not the command of the part to be measured between the measurement start point XA25 and the measurement end point XB26 is being executed, and it is set to ON when indexing at the measurement target part. Is.

If the address has not reached the measurement target portion, it is determined in step S508 whether or not the address has reached the measurement point XA. If it is found that the measurement point is not at the measurement point XA, the operation of the main body of the performance measurement unit 200 is not performed and the process returns to the measurement target program 300.
It is necessary to restore the register as a procedure for returning to the indexing source by 13. Thus, until the measurement start point is reached, nothing is actually done and only the measurement start point is detected.

When it is detected in step S508 that the measurement start point has been reached, the process proceeds to step S509 to set the measuring flag TB to ON. As a result, the performance measurement data will be collected when control is passed to the performance measurement unit 200 next by indexing.

In step S510, the control is the measurement operation unit 1
00, the operator is informed that the measurement start point has been reached, and the operator waits for input of an instruction. Therefore,
Check the data so that the program can proceed on the intended route and set the data to be changed. After confirming the necessary settings, the control is returned to the performance measuring unit 200 for restarting according to the operator's instruction.

The procedure from step S511 onward is the procedure for returning to the measurement object program 300 as described above, but the reading of the clock in step S512, which has been omitted from the above description, is the execution start time of the instruction of the measurement object program to be executed next. Is stored in TH of the measurement information storage table 72.

Next, returning to step S504, if the in-measuring flag TB is ON when the indexing occurs, the performance is being measured and the process proceeds to step S505. First, as a process for measuring the program execution time, a process of integrating the difference between the start time and the end time of each executed instruction is performed in steps S505 to S507.

In step S505, the first instruction execution time is set as the first step S50 of the performance measuring unit 200 at this time.
The time read in 2 is the execution end time of the instruction executed immediately before the occurrence of the current index, and this and the time read in the last step S507 of the performance measuring unit 200, that is, the occurrence of the previous index. This is the difference from the execution start time of the instruction executed after the execution. The primary instruction execution time includes not only the time when the instruction was actually executed, but also the time for indexing and the time for returning to the indexing source. These times are times of fixed values measured in advance such as limited register saving and restoration times, and are stored in TK of the measurement information storage table as constants of indexing processing time.

In step S506, the value obtained by performing the above correction is calculated as the secondary command execution time, and the TJ of the table is calculated.
I remember. In step S507, the secondary command execution time TJ is accumulated during measurement, that is, while the measurement flag TB is ON, and is stored in TL of the table as the total program execution time of the commands executed during measurement.

In step S601, whether the measurement of dynamic steps is required as a measurement item is checked, and the measurement condition is confirmed. When it is necessary, the TM is counted in the measurement information storage table.

Similarly for the route trace, whether or not it is necessary is determined in step S603, and if necessary, step S604.
And in the measurement information storage table T in step S605.
The address trace information and the instruction code of the instruction executed by the measurement target program 300 are accumulated and stored in the route trace record 74 in O as a pair. When the record 74 to be recorded becomes full, the record 74 is written and stored in the measurement data storage unit 10.

When the processing of the item to be measured is completed, the measurement is ended when the address coincides with the measurement point XB in step S606, and when the measurement is continued, the process of returning from step S511 to the program 300 to be measured is performed.

In the measurement end processing, the measurement data in the current measurement section is stored in the measurement data storage unit 10 in step S607.
The data is output so that it can be recorded in the data analysis section 23 and can be processed later by the data analysis section 23.

The measuring flag is turned off in step S608.
As a result, in step S609, control is transferred to the measurement operation unit 100, and a new measurement point is set according to an operator's instruction. At this time, the measurement information storage table 72 for new measurement is initialized. In step S511, the registers are restored and the measurement target program is newly executed.

As described above, it is possible to measure the data of the specified performance item while executing the measurement target program 300 on the route determined by the data set for the arbitrary section. [Other Embodiments] In the above embodiments, the performance measurement items are the program execution time, the number of dynamic steps, and the route trace, but in addition to this, the status is monitored for each instruction and based on the specified status. The performance information may be stored or arbitrary performance measurement such as information processing may be performed.

Although the execution time of one instruction is measured by reading the clock at the time of returning to the indexing source and the time of indexing, other time measuring means such as a timer may be used, or indexing and restoration may be performed. Although the correction of the processing time is performed for each instruction, it may be corrected collectively by using the measured number of instructions.

Further, although the measurement range is specified and the data is set by the operation of the operator from the operation terminal in the measurement operation unit, the operation of the data given by the operator and the operation of the data given by the operator are performed as in the prior art. A command operation may be automatically generated by the system to perform continuous automatic measurement of performance measurement.

[0055]

As is apparent from the above description, according to the present invention, it is possible to easily prepare an environment for measuring the performance of a program, perform the measurement without creating a driver program dedicated to each execution route, and perform various measurements. Providing a performance measurement means that can measure performance items flexibly at the same time as time measurement, and improve the performance and reliability of information processing systems that use computers, and further improve the productivity of system construction. There is.

[Brief description of drawings]

FIG. 1 is a block diagram of the present invention.

FIG. 2 is a configuration diagram of an embodiment of the present invention.

FIG. 3 is an operation flowchart of an embodiment of the present invention.

FIG. 4 is an explanatory diagram of indexing in debug mode.

FIG. 5 is a flowchart (part 1) of the operation of the performance measuring unit.

FIG. 6 is a flowchart (No. 2) of the operation of the performance measuring unit.

FIG. 7 is an explanatory diagram of the configuration of a measurement information storage table.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Execution control means 2 State operation means 5 Performance measurement control section 6 Instruction execution time collection means 7 Dynamic step measurement means 8 Route trace measurement means 9 Program execution time measurement means 10 Measurement information storage section 100 Measurement operation section 200 Performance measurement section 300 Debug Mode program execution environment section

Claims (8)

[Claims] 1. A performance measuring apparatus for a program of a computer having a debug mode for generating an index each time a program instruction is executed, wherein a program to be measured is executed in the debug mode, and control is transferred by the index generated. When the performance measurement unit returns control to the indexing source, time counting is started, and when control is transferred by indexing that occurs after execution of one instruction of the measurement target program, time counting is ended and the execution time of the one instruction is temporarily stored. Instruction execution time collecting means, and program execution time measuring means for accumulating and storing the execution time of the temporarily stored one instruction for the instructions to be executed from the measurement start to the measurement end of the measurement target program,
An apparatus for measuring performance of a program, comprising: 2. The performance measuring device for a program according to claim 1, further comprising a dynamic step measuring means for counting and storing the number of times each time the control is transferred by the indexing. 3. The method according to claim 1, further comprising a route trace measuring means for storing, in time series, an address and a code of an instruction executed by the measurement target program each time control is transferred by the indexing. Item 2
Program performance measuring device. 4. An instruction for starting measurement and an instruction for ending measurement of the measurement target program are designated by addresses, the measurement target program is activated, and the activated program executes the designated measurement start instruction. Execution control means for interrupting the execution of the program when it reaches and restarting the execution of the interrupted program, and setting of data for determining the execution route of the interrupted program when the measurement target program interrupts the execution 4. The performance measuring device for a program according to claim 1, 2 or 3, further comprising a state operating means for performing. 5. A method for measuring program performance of a computer having a debug mode for generating an index each time a program instruction is executed, wherein a measurement target program is executed in the debug mode, and control is transferred by the generated index. When the performance measurement unit returns control to the indexing source, timing is started, and when control is transferred by indexing that occurs after the execution of one instruction of the measurement target program, the timing is ended and the instruction execution time is set as the instruction execution time. A method of measuring performance of a program, characterized in that instructions to be executed from the measurement start to the measurement end of the measurement target program are added up to obtain an execution time of the measurement target program. 6. The program according to claim 5, wherein the number of dynamic steps of the measurement target program is measured by adding counting the number of instructions to be measured each time control is transferred by the indexing. Performance measurement method. 7. The route trace is measured by adding the time-series storage of the address and code of the instruction executed by the measurement target program each time the control is transferred by the indexing. 5. The program performance measuring method according to claim 5 or claim 6. 8. An instruction to start measurement and an instruction to end measurement of the measurement target program are specified by addresses, the measurement target program is activated, and the activated program executes the designated measurement start instruction. 6. The execution of the program is interrupted when the time reaches, and data for determining the execution route of the interrupted program is set to restart the execution of the interrupted program. A method of measuring performance of a program according to claim 6 or claim 7.