JPH0713808A - Method for evaluating performance of on-line system - Google Patents

Abstract

PURPOSE:To enable advance verification by realizing the load state of the on-line system even when all application programs do not end and to greatly reduce the time and cost required for on-line system constitution by preventing the process systems of all the application programs from being reviewed or reconstituted after the development of the on-line system is completed. CONSTITUTION:Various conditions regarding an incomplete application program are set in a load generation part 8 from a host console 3. An application program which is already completed is stored as an application program 7. When a host computer 1 is actuated from the host console 3, the program operation of the application program 7 and the dummy program operation of the incomplete application program that the load generation part 8 generates are processed in real time respectively to realize a conflict state of resource consumption, which is observed to perform the previous verification.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for evaluating the performance of an online system, and more particularly to a method for evaluating the performance of an online system when an application program including an undeveloped application program is executed.

[0002]

2. Description of the Related Art A conventional online system performance evaluation method calculates a static retention time in a host computer from the CPU consumption time of this application program and the number of input / output instructions when the development of each application program is completed. The performance was evaluated by this calculation result. or,
To evaluate the performance of the entire online system, after the completion of all application programs, the systems are integrated, and a simultaneous keystroke test using an actual terminal device is performed. CPU time characteristics in the host computer, I / O command issuing characteristics, terminal device response It was verified by measuring the time characteristics.

The above is a description of the evaluation method performed after the completion of the application programs. As a performance evaluation method before the completion of the development of all the conventional application programs, for example, Japanese Patent Laid-Open No. 62-34 can be used.
There is one published in Japanese Patent No. 241. That is, the method disclosed in this publication includes a load generating means for generating a pseudo transaction in the host computer that consumes only CPU as resource consumption, and a pseudo CPU resource contention state, and a function for running an application program in parallel. Is used for performance evaluation.

[0004]

In the above-described conventional method for evaluating the performance of an online system, the evaluation method performed after the completion of the application program cannot perform the evaluation until the completion of the application program, and moreover, it takes a lot of time to perform the evaluation. However, if a problem is discovered at this point, the processing method must be re-examined or recreated, resulting in a significant increase in time and cost. Further, a method for performing performance evaluation using a load generating means for generating a pseudo transaction that consumes only CPU as resource consumption in the host computer and causing a pseudo CPU resource contention state and a function for running an application program in parallel. Then, there is a problem that the peripheral device resource race condition, which is one of the resource restrictions in the online system, cannot occur, which is insufficient from the viewpoint of verifying the online system.

An object of the present invention is to realize the load state of the online system in question even when all the application programs have not been completed, and to enable pre-verification. An object of the present invention is to provide a performance evaluation method for an online system, which can prevent the review or remake and can significantly reduce the time and cost required for building the online system.

[0006]

A method of evaluating the performance of an online system according to the present invention comprises a communication line, a plurality of terminal devices connected to the communication line, and a developed application for performing communication processing with the terminal device. A host computer having a program and a CPU involved in all control operations, a console having a function of inputting control information in a state of being connected to each host computer, and a plurality of peripherals for improving or assisting the functions of the host computer. Device,
In an online system performance evaluation method for evaluating the performance of an online system configured with a communication control processor for controlling communication by connecting to the terminal device via the communication line, an undeveloped application program in the host computer. When the developed application program is operated by storing the predicted value of resource consumption consumed by the developed application program, the undeveloped application program is stored based on the stored predicted value in accordance with the operation of the developed application program. Also, a load generating unit for simulating the operation and consuming resources in the host computer is provided.

In the method for evaluating the performance of an online system according to the present invention, the load generation unit generates per unit time for each transaction type provided to simulate the operation of the application program which has not been developed in the online system. A transaction characteristic table describing a characteristic requirement including a ratio, a consumption time of the CPU, and the number of input / output instructions to the peripheral device, and the host by simulating the operation of the undeveloped application program according to the given characteristic requirement. A transaction program that consumes resources in a computer, and a transaction program that analyzes the transaction characteristic table and gives the transaction program characteristic requirements to the transaction program for each of the undeveloped application programs and instructs a pseudo operation. It may be provided and no control mechanism.

In the method for evaluating the performance of an online system according to the present invention, the transaction program analyzes the characteristic requirements of the transaction given from the transaction program control mechanism, executes a resource consumption execution instruction for the CPU and an input instruction for the peripheral device. A transaction characteristic analysis unit that outputs an operation condition including the number of output instructions, and a CPU consumption that executes the resource consumption for the CPU that has received an instruction to execute the resource consumption execution instruction for the CPU output from the transaction characteristic analysis unit A mechanism and an input / output command generation mechanism that executes an input / output command for the peripheral device instructed by receiving the operating condition for the peripheral device may be provided.

[0009]

Embodiments of the present invention will now be described with reference to the drawings.

FIG. 1 is a block diagram of an embodiment of an online system to which the present invention is applied.

The host computer 1 is connected to a peripheral device 2 for improving or assisting the functions of the host computer 1, a host console 3 having a function of inputting control information, and a communication control processor 4 for controlling communication. There is. Further, the communication control processor 4 is connected to a plurality of terminal devices 6 via the communication line 5 to form an online system 10 as a whole. In the host computer 1, in order to evaluate the performance of the online system 10, the developed application program 7 for communicating with the terminal device 2 and the predicted value of the resource consumption consumed by the undeveloped application program When operating the application program 7, the host computer generates a load that simulates the operation of the application program that has not been developed based on the predicted value stored in advance according to the operation of the application program 7. 1, a load generating unit 8 that consumes resources and a CPU 9 that participates in all control operations.

FIG. 2 is an explanatory diagram for explaining the function and configuration of the load generator. In the following description, the names and reference numerals of FIG. 1 are also used.

The load generator 8 is an online system 10
The characteristic requirements including the occurrence rate per unit time, the consumption time of the CPU 9, and the number of input / output instructions to the peripheral device 2 are described for each transaction type provided to simulate the operation of an application program that has not been developed. Transaction characteristic table 11, a transaction program 12 that simulates the operation of an undeveloped application program according to the given characteristic requirements, and consumes resources in the host computer 1, and a transaction characteristic table 11
And a transaction program control mechanism 13 for giving a transaction characteristic requirement to the transaction program 12 for each undeveloped application program and instructing a pseudo operation. The transaction program 12 analyzes the transaction characteristic requirements given from the transaction program control mechanism 13 and outputs a resource consumption execution instruction to the CPU 9 and an operation condition including the number of input / output instructions to the peripheral device. 14, a CPU consumption mechanism 15 for executing the resource consumption execution instruction for the CPU 9 output by the transaction characteristic analysis unit 14 and executing the resource consumption for the CPU 9, and a peripheral receiving the operation condition for the peripheral device 2 and instructed An input / output instruction generation mechanism 16 that executes an input / output instruction to the device 2 is provided.

Next, the operation will be described.

FIG. 3 is an explanatory diagram for explaining the operation of the CPU consuming mechanism, and FIG. 4 is an explanatory diagram for explaining the operation of the input / output instruction generating mechanism. In the following explanation, FIG. 1 is used for the outline explanation,
2 to 4 will be used for the detailed description.

First, the general operation will be described. In order to realize the load status of the relevant online system and evaluate the performance in advance when all the application programs have not been completed, the load generation unit 8 from the host console 3
In, set various conditions for unfinished application programs. The already completed application program is stored as the application program 7. When the host computer 1 is started from the host console 3 in this state, the program operation of the application program 7 and the pseudo program operation of the uncompleted application program generated by the load generation unit 8 are processed in real time, and resources are processed. A race condition of consumption can be realized. By observing this competitive state of resource consumption,
Before the completion of all application programs, check the validity of the performance requirements of individual application programs and the usage of hardware resources (distributed allocation status of files, hardware capacity), and the individual design phases (functions) before the completion of online system development. Pre-verification by design, detailed design, manufacturing, unit test) can be prevented after the online system development is completed, and the processing method of all application programs can be prevented from being re-examined or recreated. It is possible to reduce.

Next, the detailed operation will be described.

As shown in FIG. 2, in the load generating unit 8, a transaction characteristic table 11 is provided for each transaction type for simulating the operation of an application program that has not been developed in the online system 10 per unit time. Transaction generation rate and CPU9
, A plurality of sets of characteristic requirements consisting of an address of the peripheral device 2 and the number of input / output instructions are described. Using the data of this transaction characteristic table 11, transaction program control is performed. The mechanism 13 repeatedly gives to the transaction program 12 a plurality of sets of characteristic requirements of a transaction for each undeveloped application program, and gives a pseudo operation for consuming resources in the host computer 1. To do.

When the transaction program 12 receives the pseudo operation instruction, the transaction characteristic analyzing unit 14 first analyzes the characteristic requirement of the transaction given from the transaction program control mechanism 13, and C
First output the resource consumption execution instruction to PU9, and
After the operation of the PU consuming mechanism 15 is completed, the operating condition including the number of input / output instructions to the peripheral device 2 is output. CPU consumption mechanism 15 which has received a resource consumption execution instruction to the CPU 9
As shown in FIG. 3, first, in step (hereinafter referred to as S) 1, the transaction characteristic analysis unit 14 causes the CPU processing program P to be composed of an instruction sequence that occupies the CPU 9 for a unit time P _{T in} one cycle of operation. CPU time C _T that specifies how many cycles are to be operated is obtained. Next, by dividing the CPU time C _T received in S2 by the unit time P _T ,
The number of activations of the CPU processing program P is calculated. Then, the CPU processing program P is called to start the processing, and the cumulative number of times is confirmed at S4 each time the processing is completed, and compared with the number of times of start calculated in S2. If not, the process jumps to S3, the CPU processing program P is called again, and if the calculated number of times has been started, the CPU consuming mechanism 15 notifies the transaction characteristic analyzing unit 14 of the end of the operation and ends the operation. Next CPU
The transaction characteristic analysis unit 14 that has received the operation end notification from the consumption mechanism 15 outputs the operation condition including the number of input / output instructions to the peripheral device 2 to the input / output instruction generation mechanism 16 based on the analysis result of the characteristic requirement of the transaction. To do.

The input / output instruction generation mechanism 16 which has received the operating condition for the peripheral device 2 obtains the address of the peripheral device and the number of input / output times from the transaction characteristic analysis unit 14 in S5, as shown in FIG. Then, the input / output command issuing program P _I for issuing a read command to the peripheral device 2 designated in S6 is called, the address of the target peripheral device 2 is designated, and the processing is started. I / O command issuing program P _I
Every time the process of is completed once, the cumulative number is confirmed in S7,
If the number of times given as the operating condition has not been reached, S
6, the processing of the _I / O command issuing program P _I is executed again, and if the given number of times has been reached, the I / O command generation mechanism 16 indicates the end of operation as the transaction characteristic analysis unit 1
4 is notified and the operation ends. The transaction characteristic analysis unit 14 uses the transaction program control mechanism 13
Notify that the operation for the set of characteristic requirements forming the corresponding transaction is completed.

Upon receiving this notification, the transaction program control mechanism 13 confirms the data in the transaction characteristic table 11 and determines whether or not there is a set of characteristic requirements which follows a set of characteristic requirements constituting the transaction whose operation is currently terminated. If there is the next set of characteristic requirements, this is given to the transaction program 12 as a new characteristic requirement. The transaction program 12 uses the transaction characteristic analysis unit 14 as in the procedure described above.
Analyzes the transaction characteristic requirements given from the transaction program control mechanism 13 and performs a pseudo operation for consuming resources in the host computer 1.

In this way, by treating the application programs 7 and the load generating section 8 equally, it is possible to confirm in advance the performance requirements of individual application programs and the appropriateness of the usage method of the hardware resources before the completion of all the application programs. It becomes possible to verify.

[0023]

As described above, according to the present invention, the resource consumption amount of the undeveloped application program as well as the developed application program for communicating with the terminal device is predicted in the host computer. When the value is stored and the developed application program is operated, the operation is simulated for the undeveloped application program based on the predicted value stored in advance according to the operation of the developed application program. By providing a load generation part that consumes resources inside, the load status of the relevant online system can be realized when all application programs have not been completed, and pre-verification is possible. Re-examine the processing method of the application program or Ri fix it can be prevented that, there is an effect that it is possible to significantly reduce the time and cost required for the online system construction.

[Brief description of drawings]

FIG. 1 is a block diagram of an embodiment of an online system to which the present invention is applied.

2 is an explanatory diagram illustrating a function and a configuration of a load generating unit illustrated in FIG.

FIG. 3 is an explanatory diagram illustrating an operation of the CPU consuming mechanism shown in FIG.

FIG. 4 is an explanatory diagram illustrating an operation of the input / output instruction generation mechanism shown in FIG.

[Explanation of symbols]

 1 Host Computer 2 Peripheral Device 3 Host Console 4 Communication Control Processor 5 Communication Line 6 Terminal Device 7 Application Program 8 Load Generator 9 CPU 10 Online System 11 Transaction Characteristic Table 12 Transaction Program 13 Transaction Program Control Mechanism 14 Transaction Characteristic Analyzer 15 CPU consumption mechanism 16 I / O instruction generation mechanism

Claims (3)

[Claims] 1. A host computer comprising a communication line, a plurality of terminal devices connected to the communication line, a developed application program for performing communication processing with the terminal device, and a CPU involved in all control operations. , Connected to the host computer, a console having a function of inputting control information, a plurality of peripheral devices for improving or assisting the function of the host computer, and the terminal device via the communication line. In an online system performance evaluation method for evaluating the performance of an online system configured with a communication control processor that controls communication, a predicted value of resource consumption consumed by an undeveloped application program is stored in the host computer. When operating the developed application program, the developed application program A load generation unit is provided which simulates the operation of the undeveloped application program based on the stored predicted value according to the operation of the application program and consumes resources in the host computer. System performance evaluation method. 2. The generation rate per unit time, the CPU consumption time, and the CPU consumption time for each transaction type provided by the load generation unit for simulating the operation of the undeveloped application program in the online system. A transaction characteristic table that describes characteristic requirements including the number of input / output instructions to peripheral devices, and a transaction program that simulates the operation of the undeveloped application program according to the given characteristic requirements and consumes resources in the host computer. And a transaction program control mechanism that analyzes the transaction characteristic table and gives characteristic requirements of the transaction to the transaction program for each of the undeveloped application programs to instruct a pseudo operation. The method for evaluating the performance of the online system according to 1. 3. An operating condition, wherein the transaction program analyzes characteristic requirements of the transaction given from the transaction program control mechanism and includes a resource consumption execution instruction for the CPU and an input / output instruction count for the peripheral device. And a C which executes the resource consumption for the CPU instructed by the execution instruction of the resource consumption for the CPU output by the transaction characteristic analysis unit.
3. A PU consumption mechanism and an input / output instruction generation mechanism for executing an input / output instruction for a peripheral device instructed to receive an operating condition for the peripheral device.
Performance evaluation method for the described online system.