JP2798364B2 - Application evaluation method and system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to obtaining and evaluating statistical information of external module calls of an application program in a computer system.

[0002]

2. Description of the Related Art Conventionally, there are the following two typical methods for acquiring and evaluating statistical information of an external module call of an application.

A first technique is to add a code for directly evaluating a part calling an external module on the source code of an application, obtain statistical information, and evaluate the result.

A second technique is to directly give an instruction for creating profile information or debug information to the compiler itself, recompile the source code of the application under evaluation, and use the profile information or debug information to create the application under evaluation based on the created profile information or debug information. Is a method of evaluating

[0005]

According to the first method,
It is necessary to directly modify the source code of the application to be evaluated, and therefore, the number of such corrections increases as the size of the application to be evaluated increases, which is not practical as a method for performing statistical analysis and evaluation. . Further, in order to directly modify the source code of the application to be evaluated, it is necessary to obtain the source code of the application to be evaluated. Labor is required.

According to the second method, since it is necessary to embed profile information or debug information inside the application to be evaluated, the profile information or debug information is given to the compiler before measurement, and the source code of all the application to be evaluated is obtained. You have to recompile. Furthermore, since the profile information or the debug information is embedded inside the application to be evaluated, the content of the application to be evaluated changes and accurate information cannot be obtained, and therefore the evaluation cannot be performed accurately. Further, according to this method, the measurement information is stored in the memory area of the application to be evaluated, so that the memory usage increases, and a large-scale application cannot be evaluated. Furthermore, in evaluating a plurality of applications related to each other, measurement information is obtained only as individual information for each application, and a comprehensive evaluation of the plurality of applications cannot be performed.

[0007] It is therefore an object of the present invention to overcome the above-mentioned drawbacks and to facilitate a comprehensive evaluation of a large application and a plurality of applications.

[0008]

According to the present invention, in order to achieve the above object, in an application for calling a module such as an external module, an original call is replaced with a call via an observing means so that the original processing can be performed. The statistical information is acquired and stored, and the observation means to be passed is shared with another independent application to acquire and store the statistical information over a plurality of applications.

Further, in the application statistical information acquisition method of the present invention, a period from when a measurement start instruction is given to a measurement application to when a measurement end instruction is given is given.
The object is achieved by acquiring statistical information at the time of execution of the application under evaluation by the observation means, displaying the result in the display area of the measurement application, and saving the result as necessary.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below in detail with reference to the drawings.

FIG. 2 does not require observation of statistical information;
FIG. 4 is a configuration diagram of the application during normal execution. The application 201 makes an external module call 204 to use the service 203 provided by the external service provider 103. The result of the service 203 is returned to the application 201 as a return 205.

FIG. 3 is a diagram showing a configuration of observation means in which the present invention is applied to the configuration of FIG. In addition to the configuration shown in FIG. 2, an observation unit 104 for acquiring and storing statistical information of an external module call, and an observation unit 10 forcibly changing the call destination of the external module call to the observation unit 104
5 has been added. The observation means 104 provides the same service as the external service provision document 103, and is statically linked to the application to be evaluated 101.

FIG. 8 shows the processing contents of the present invention in the configuration of FIG. When the evaluated application 101 calls an external module (801), the observation unit 1
05 determines whether the call is a measurement target (80).
2). If the call is not a measurement target, the same processing as in FIG. 2 is performed (820, 807). When the call is a measurement target, the observation unit 105 replaces the external module call 204 to the external service provider 103 performed by the application to be evaluated 101 with the external module call 307 to the service 306 provided by the observation unit 106. (803). The service 306 provided by the observation means 104 stores the total number of calls for each call, and calls the original service 203 provided by the external service provider 103 by the call 309 (804). The processing result of the service 203 is returned to the observation means 104 as a return 310 (805). The observation unit 104 measures the processing time and the memory usage required for the service 203, and acquires and saves the number of calls, the processing time, and the memory usage as necessary. Thereafter, the observation unit 104 returns the return 310 received from the 103 to the application to be evaluated 101 as the return 311 (806). As a result, the evaluated application 10
The first external module call 204 is
Is replaced by an external module call 307-309 via the observation means 104. Similarly, the return 205 is a return 309-311 via the observation means 104.
Is replaced by

The observation means 105 and 104 are detachable application parts, and
1 are linked statically when created. Therefore, the user does not need to change the source code or the object code of the application to be evaluated 101 when observing the statistical information.

FIG. 5 is a configuration diagram when a plurality of evaluated applications operate. Evaluated program 101
And 102 are applications that use the service of the external service provider 103. As in FIG. 3, observation means 105 and 106 are statically linked to the evaluated applications 101 and 102, respectively. External module calls 505 and 507 from the evaluated applications 101 and 102 to the external service provider 103
Are the observation means 104 when they are measurement targets.
Are replaced by calls 509 and 510 via.
In this way, the observation unit 104 can uniformly acquire and store the statistical information of the external module call from the plurality of evaluated applications. FIG. 6 shows a schematic diagram of the processing contents.

FIG. 4 is a configuration diagram of the observation application 107 and the observation means 104. Observation application 1
In the step 07, the statistical information acquired and held by the observation means 104 is displayed. In addition, the observation unit 104 holds control variables for all calls that are passed, and can determine whether to acquire statistical information based on the state of the control variables. The user can use the observation application 1
By changing the control variable of the observation means 104 using 07, the acquisition status of statistical information can be changed. FIG. 7 shows the processing contents.

FIG. 1 is a configuration diagram of a statistical information acquisition method showing an embodiment of the present invention. Referring to FIG. 1, the evaluated applications 101 and 102, which are applications that call external modules and obtain statistical information at the time of execution, and these evaluated applications are called by external module calls from 101 and 102. An external service provider 103 that provides services to 101 and 102, a statistical information observing unit 104 that obtains and holds statistical information of calls from 101 and 102 to 103, and an observing unit that observes calls to the external service provider 103. Observation means 105 and 106 forcibly replacing the call with the call via 104, control of the observation means 104,
It comprises an observation application 107 for displaying the statistical information held by the observation means 104.

In summary, the following matters are disclosed regarding the configuration of the present invention.

(1) A method for evaluating one or more applications running on a computer system, the method including a monitoring step, the monitoring step comprising: when each of the applications calls a module, The method, comprising: receiving a call for the module; storing the call; and responsive to the call, calling the module. (2) The method according to (1), wherein the monitoring step further includes storing an end of the module. (3) The method according to (1) or (2), wherein the monitoring step further includes a step of counting the number of calls. (4) The method according to any one of (1) to (3), wherein the monitoring step further includes a step of counting a processing time of the module. (5) The monitoring step further includes a step of counting a required memory amount of the module (1) to (4).
The method according to any of the above. (6) The method according to any one of (1) to (5), wherein the monitoring step further includes a step of outputting the stored result. (7) The method according to any one of (3) to (5), wherein the monitoring step further includes a step of outputting the counted result. (8) The method according to any one of (3) to (5), wherein the monitoring step further includes a step of outputting the stored result and the counted result. (9) The plurality of applications are applications that operate on different computer systems.
The method according to any one of (1) to (8). (10) A monitoring system for evaluating one or more applications operating on a computer system, wherein when each of the applications calls a module, a module call is replaced with a call via the monitoring system. The system shared by a plurality of applications, comprising: means for storing the call; and means for calling the module in response to the call. (11) The system according to (10), further comprising means for storing an end of the module. (12) The system according to (10) or (11), further comprising means for counting the number of calls. (13) The system according to any one of (10) to (12), further including means for counting a processing time of the module. (14) The system according to any one of (10) to (13), further including means for counting a required memory amount of the module. (15) The system according to any one of (10) to (14), further including means for outputting the stored result. (16) The system according to any one of (12) to (14), further including means for outputting the counted result. (17) The system according to any one of (12) to (14), further including means for outputting the stored result and the counted result. (18) The system according to any one of (10) to (17), wherein the plurality of applications operate on a plurality of different computer systems.

[0020]

As described above, according to the present invention, in the application statistical information acquisition and evaluation method, the direct external module call of the application is replaced with a call via a different path, so that the call processing is performed. Statistical information can be obtained and stored.
By sharing the module that passes through with other independent applications, it became possible to acquire and store statistical information across multiple applications.

Furthermore, even for a large-scale application, it is possible to easily obtain and evaluate the statistical information of the external module call.

Further, measurement and evaluation can be appropriately performed for an application composed of a plurality of execution applications.

Furthermore, since it is not necessary to modify the source code of the application to be evaluated and no debug information is embedded, it is possible to obtain the same result as that of the execution application at the time of completion.

Further, since it is not necessary to compile the application again in order to obtain the statistical information, it is possible to save time and work for compiling which takes a long time.

[Brief description of the drawings]

FIG. 1 is a configuration diagram illustrating an embodiment in which the present invention is applied to a plurality of applications.

FIG. 2 is a configuration diagram during normal execution of an application.

FIG. 3 is a configuration diagram in which observation means is added to one application.

FIG. 4 is a configuration diagram of an observation means and an observation application.

FIG. 5 is a configuration diagram of a plurality of applications and observation means.

FIG. 6 shows a processing flow of the configuration of FIG.

FIG. 7 shows a processing flow of FIG.

FIG. 8 shows a processing flow of FIG.

[Explanation of symbols]

 101 Evaluated application 102 Evaluated application 103 External service provider 104 Observation means 105 Observation means 106 Observation means 107 Observation application 201 Application 203 Service 204 Call 205 Return 306 Service 307 Call 309 Call 310 Return 311 Return 505 Call 507 Call 509 Return 510 return

──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Kosuke Okamoto 1623-14 Shimotsuruma, Yamato-shi, Kanagawa Prefecture IBM Japan, Ltd. Yamato Office (56) References JP-A-63-68939 (JP, A JP-A-4-167302 (JP, A) (58) Fields investigated (Int. Cl. ⁶ , DB name) G06F 11/28-11/34

Claims (18)

(57) [Claims] 1. A method for evaluating one or more applications running on a computer system, the method including a monitoring step, the monitoring step comprising: when each of the applications invokes a module, Receiving said call; storing said call; and making a call to said module in response to said call. 2. The method of claim 1, wherein said monitoring step further comprises storing an end of said module. 3. The method according to claim 1, wherein said monitoring step further comprises a step of counting said number of calls. 4. The method according to claim 1, wherein said monitoring step further comprises a step of counting a processing time of said module. 5. The method according to claim 1, wherein said monitoring step further comprises the step of counting a memory requirement of said module. 6. The method according to claim 1, wherein said monitoring step further comprises a step of outputting said stored result. 7. The method according to claim 3, wherein said monitoring step further includes outputting the counted result. 8. The method according to claim 3, wherein said monitoring step further comprises a step of outputting said stored result and said counted result. 9. The method according to claim 1, wherein the plurality of applications are applications running on different computer systems. 10. A monitoring system for evaluating one or more applications running on a computer system, wherein when each of the applications calls a module, the call of the module is replaced with a call via the monitoring system. Means for storing the call, and means for calling the module in response to the call, wherein the system is shared by a plurality of applications. 11. The system according to claim 10, further comprising means for storing an end of said module. 12. The system according to claim 10, further comprising means for counting the number of calls. 13. The system according to claim 10, further comprising means for counting a processing time of said module. 14. The system according to claim 10, further comprising means for counting a memory requirement of said module. 15. The system according to claim 10, further comprising means for outputting the stored result. 16. The system according to claim 12, further comprising means for outputting the counted result. 17. The apparatus according to claim 12, further comprising means for outputting said stored result and said counted result.
The system according to any one of the above. 18. The system according to claim 10, wherein the plurality of applications operate on a plurality of different computer systems.