JP2003173277A - Apparatus, system, and method for measuring performance, recording medium, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To input a plurality of different measuring conditions at the same time and to automatically and continually conduct performance tests on an information processing system under the plurality of different measuring conditions. <P>SOLUTION: A screen in a tabular format enabling columns for inputting parameters and set values to be added is used as a condition input screen; the set values, each of which is transmitted from each group of different parameters inputted via the condition input screen, are freely combined with one another by a test pattern control part 211 so as to automatically create a parameter file as information about test patterns and the set values. Based on the parameter file, an execution control part 220 controls the server 103 and client terminal 104 of the information processing system to enable the performance tests to be conducted continually by only one input operation. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a performance measuring device, a performance measuring system, a performance measuring method, a recording medium and a program for continuously measuring the performance of an information processing system under a plurality of different measurement conditions.

[0002]

2. Description of the Related Art Conventionally, in order to compare and evaluate the performance of hardware and software of an information processing system (information processing device) under various conditions, a benchmark has been used as a method for measuring the performance of the information processing system. There was a test (hereinafter also referred to as "benchmark").
In the benchmark, the measurement conditions of the information processing system to be measured are input and defined for each benchmark one by one, and the information processing system is caused to execute processing based on the defined measurement conditions to measure the performance.

For example, when measuring the performance of a mail server as an information processing system, the number of CPUs the mail server has, the number of users who use the mail server, the data size of sent and received electronic mails, etc. are defined as measurement conditions. Was. Then, according to the defined measurement conditions, prepare the same number of client terminals and operators as the number of users and the same number as the number of users to access the mail server manually by the operator, or to define the defined measurement conditions virtually. The performance of the mail server was measured by converting the data (program) as a process into a client terminal and executing it.

When the performance of the information processing system under one measurement condition is measured and then the performance of the information processing system under different measurement conditions is to be measured, the operator inputs a new measurement condition. Then, the performance was measured by causing the information processing system to execute processing based on the redefined measurement conditions. That is, the performance of the information processing system under a plurality of different measurement conditions is measured by repeatedly performing the input operation of the measurement conditions by the operator and the execution of the benchmark. In this way, the performance of the information processing system under different measurement conditions is measured,
By comparing and evaluating the measurement results, the specifications of the mail server most suitable for the usage conditions were determined.

[0005]

However, there are the following problems in executing the above-mentioned conventional benchmark. (First problem) The operator who defines the measurement condition must define the measurement condition each time he or she wants to execute the benchmark, and must input a new measurement condition or modify the measurement condition. It was

Therefore, even when trying to execute benchmarks under a plurality of different measurement conditions, it has not been possible to automatically execute benchmarks continuously. That is, after confirming the end of the benchmark under one measurement condition, the operator must perform the input work and the correction work for inputting and redefining a new measurement condition, and the efficiency of performing the performance measurement. Was very bad.

Further, for example, when the benchmarks are executed by changing the measurement conditions such as the number of CPUs and the memory size of the information processing system, conventionally, the CPUs, the memories, etc. must be inserted and removed according to the measurement conditions. I had to do it. Therefore, even when changing the number of CPUs, memory size, etc., the operator must confirm the end of the benchmark under one measurement condition and then insert or remove the CPU, memory, etc. to define a new measurement condition. did not become.

Depending on the type of benchmark and the measurement conditions, the process (benchmark execution) may take many hours, and for example, the benchmark execution result may be obtained at midnight (benchmark ends). In such a case, since the operator is often absent, there is a problem in that the next measurement condition is not input until the operator operates the next morning, resulting in wasting time.

(Second problem) When defining measurement conditions,
Different measurement conditions are defined for each information processing system (application of the information processing system) that is a measurement target. For example, when measuring the performance of a mail server as an information processing system, the measurement conditions such as the data size of transmitted and received electronic mail, the number of users who access, and the access frequency of users have been defined. Further, when measuring the performance of the web server, the measurement conditions such as the number of simultaneous accesses, the data size of one content provided to the user, and the presence or absence of applets and servlets have been defined.

As described above, since the measurement conditions defined for each information processing system to be measured are different, the user interface for the operator to input the measurement conditions also has a unique user interface for each information processing system to be measured. Had. Therefore, when the same operator wants to execute a benchmark for various different information processing systems, the measurement conditions must be defined using different user interfaces for each information processing system. Is complicated and lacks in convenience.

(Third Problem) As described in the first problem, in order to execute a benchmark under a plurality of different conditions, even if the measurement condition is a part of the condition changed, Since the input work for each item of the measurement condition must be repeated, the work efficiency is very poor, and the operator may make an error in inputting the measurement condition. Even if you try to re-enter only different parts of the changed measurement conditions, if you have many combinations of measurement conditions, you may forget to edit the measurement conditions that should be re-entered or forget to enter certain measurement conditions. was there.

Therefore, when a benchmark is executed under a plurality of different conditions, whether or not the measurement conditions to be input and the input measurement conditions are the same so that there is no input error of the measurement conditions. However, there is a problem in that a great deal of time and labor is required for the confirmation work. further,
In the confirmation work, if no input of the measurement condition is found, there is a problem that the benchmark cannot be performed under the desired measurement condition.

The present invention has been made in order to solve such a problem, and enables a plurality of different measurement conditions to be input at the same time, and a performance test of an information processing system under a plurality of different measurement conditions. The purpose is to enable automatic and continuous execution.

[0014]

The performance measuring device of the present invention is a performance measuring device for measuring the performance of an information processing system which provides a predetermined service based on the input measuring condition. A condition input screen for inputting information relating to the above, a part related to the first information processing device group including at least one information processing device and providing the above-described predetermined service, and at least one information processing device including the predetermined information processing device. The condition input screen is divided into a part related to the second information processing device group that receives the service and a part related to the predetermined service, and the condition input screen has a common format regardless of the predetermined service. Multiple setting values can be entered in the same item of the As an information processing system, the information processing system is caused to execute a performance test based on performance test data automatically generated by arbitrarily combining setting values of different items of the measurement condition input through the condition input screen. It is characterized by

Another feature of the performance measuring apparatus of the present invention is that the measurement conditions of the first information processing apparatus group, the second information processing apparatus group, and the predetermined service are different. The input area of such information is arranged in a two-dimensional table format.

Another feature of the performance measuring apparatus of the present invention is a performance measuring apparatus that measures the performance of an information processing system that provides a predetermined service based on the input measurement conditions. Display means for displaying a condition input screen for inputting information related to the condition, input means for inputting information related to the measurement condition according to the condition input screen displayed by the display means, and the measurement condition One set of set values consisting of set values of different items is used as one performance test data, and the set values of different items of the measurement conditions input by the input means are arbitrarily combined to automatically perform the performance test data. To the information processing system based on the performance test data generated by the test data generation means and the test data generation means. A condition relating to the first information processing device group that includes at least one information processing device and provides the predetermined service, and a test execution control unit that executes the test execution control means, and at least one information processing device. It is divided into a part related to the second information processing device group receiving the predetermined service and a part related to the predetermined service, and a plurality of setting values can be input to the same item of the measurement condition. Is characterized by.

Another feature of the performance measuring apparatus of the present invention is that it relates to the first information processing apparatus group and the second information processing apparatus group.
The input areas of the information relating to the above measurement conditions in the part related to the information processing device group and the part related to the predetermined service are arranged in a two-dimensional table format.

Another feature of the performance measuring apparatus of the present invention is that the hardware and software configurations of the information processing apparatus constituting the information processing system can be set based on the performance test data, and the test execution control can be performed. The means, when setting the hardware configuration of the information processing apparatus, supplies a predetermined command to the information processing apparatus to set the hardware configuration.

Another feature of the performance measuring apparatus of the present invention is that the test data storage means stores the test data storage means for storing the performance test data generated by arbitrarily combining the set values of the items whose measurement conditions are different from each other. Further, when inputting the information related to the measurement condition by the input means, the set value of the measurement condition based on the performance test data stored in the test data storage means is provided in response to the instruction from the input means. It is characterized by doing.

Another feature of the performance measuring apparatus of the present invention is that the result storage for storing the measurement result of the performance test executed by the information processing system by the test execution control means based on the generated performance test data. It is characterized by further comprising means.

Another feature of the performance measuring apparatus of the present invention is that information is obtained from all performance test data generated by the test data generating means by arbitrarily combining set values of items different from each other under measurement conditions. The processing system further includes selection means for selecting performance test data for executing the performance test, and the test execution control means causes the information processing system to perform only the performance test based on the performance test data selected by the selection means. It is characterized by being executed.

Another feature of the performance measuring apparatus of the present invention is an interface for generating measurement condition items to be input in a portion related to a predetermined service of a condition input screen according to a service provided by the information processing system. It is characterized in that it further comprises generation means.

Another feature of the performance measuring apparatus of the present invention is that the information processing system has a server computer and a client terminal, the first information processing apparatus group is a server computer, and the second information processing apparatus. The device group is a client terminal.

Another feature of the performance measuring apparatus of the present invention is a performance measuring apparatus for measuring the performance of an information processing apparatus that provides a predetermined service based on the input measurement conditions. A condition input screen for inputting information related to a condition, a part related to a first information processing function for providing the predetermined service, a part related to a second information processing function for receiving the predetermined service, and It is divided into a part related to a predetermined service, and the condition input screen has a common format regardless of the predetermined service. Of one set of set values consisting of set values of different items as one performance test data, the measurement conditions different from each other entered through the condition input screen are different from each other. Based on the automatically generated performance test data any combination of the setting values of items, characterized in that to execute the performance tests to the information processing apparatus.

Another feature of the performance measuring apparatus of the present invention is a performance measuring apparatus that measures the performance of an information processing apparatus that provides a predetermined service based on the input measurement conditions. Display means for displaying a condition input screen for inputting information related to the condition, input means for inputting information related to the measurement condition according to the condition input screen displayed by the display means, and the measurement condition 1 set value group consisting of setting values of different items
As one performance test data, by the test data generating means for automatically generating the performance test data by arbitrarily combining the setting values of the different items of the measurement conditions input by the input means, and the test data generating means. A test execution control unit that causes the information processing apparatus to execute a performance test based on the generated performance test data, and the condition input screen provides a first service that provides the predetermined service.
Is divided into a part related to the information processing function, a part related to the second information processing function of receiving the predetermined service, and a part related to the predetermined service.
A plurality of setting values can be input to the same item of the above measurement conditions.

The performance measuring system of the present invention is a performance measuring system that measures the performance of an information processing system that provides a predetermined service based on the input measuring conditions, and inputs information relating to the measuring conditions. A condition input screen provided for the purpose of providing a part related to the first information processing device group including at least one information processing device and providing the predetermined service, and providing the predetermined service including at least one information processing device. It is divided into a portion related to the second information processing device group to be received and a portion related to the predetermined service, and the condition input screen has a common format regardless of the predetermined service and the same item of the measurement condition is set. Multiple set values can be entered, and one set of set values consisting of the set values of the items under the above measurement conditions that are different from each other is used as one performance test data. The performance test is performed on the information processing system based on the performance test data automatically generated by arbitrarily combining the setting values of the different items of the measurement conditions input through the condition input screen provided above. It is characterized by being executed.

The performance measuring method of the present invention is a performance measuring method for measuring the performance of an information processing system that provides a predetermined service based on the input measurement conditions, and sets different items of the above measurement conditions. Using one set of set values consisting of values as one piece of performance test data, set values of different items of the above measurement conditions input via the condition input screen for inputting information related to the above measurement conditions are arbitrarily set. A test data generation step of automatically generating performance test data in combination, and a test execution control step of causing the information processing system to execute a performance test based on the performance test data generated in the test data generation step. The condition input screen includes a first information processing device group that includes at least one information processing device and provides the predetermined service. A portion that, the second to be provided for the predetermined service consists of at least one information processing apparatus
Of the information processing device group and a part related to the predetermined service, and the condition input screen has a common format regardless of the predetermined service, and a plurality of settings are made for the same item of the measurement condition. The feature is that the value can be input.

Another feature of the performance measuring method of the present invention is a performance measuring method for measuring the performance of an information processing system that provides a predetermined service based on the input measurement conditions. A display step of displaying a condition input screen for inputting information related to the condition, an input step of inputting information related to the measurement condition according to the condition input screen displayed at the display step, and One set of set values consisting of set values of different items is used as one performance test data, and the set values of the different items of the measurement conditions input in the input step are arbitrarily combined to obtain the performance test data. Based on the test data generation step automatically generated and the performance test data generated in the test data generation step, the information processing system A test execution control step for causing the system to execute a performance test, and the condition input screen includes at least one part related to a first information processing device group that provides the predetermined service and includes at least one information processing device. A part relating to a second information processing device group which is provided with one information processing device and is provided with the predetermined service;
It is characterized in that it is divided into a part related to the predetermined service and a plurality of setting values can be input to the same item of the measurement condition.

Another feature of the performance measuring method of the present invention is a performance measuring method for measuring the performance of an information processing apparatus that provides a predetermined service based on the input measurement conditions. The measurement conditions that are input via the condition input screen for inputting the information relating to the measurement conditions are different from each other, with one set of set values consisting of the setting values of the items having different conditions as one piece of performance test data. Perform a performance test on the information processing device based on the test data generation step of automatically generating performance test data by arbitrarily combining the set values of items and the performance test data generated in the test data generation step. And a test execution control step for allowing the condition input screen to include a portion related to the first information processing function for providing the predetermined service and the predetermined information processing function. The condition input screen is divided into a part related to the second information processing function for receiving the service and a part related to the predetermined service, and the condition input screen has a common format regardless of the predetermined service. The feature is that multiple setting values can be input to the same item.

Another feature of the performance measuring method of the present invention is a performance measuring method for measuring the performance of an information processing apparatus that provides a predetermined service based on the input measurement conditions. A display step of displaying a condition input screen for inputting information related to the condition, an input step of inputting information related to the measurement condition according to the condition input screen displayed at the display step, and One set of set values consisting of set values of different items is used as one performance test data, and the set values of the different items of the measurement conditions input in the input step are arbitrarily combined to obtain the performance test data. Based on the test data generation step automatically generated and the performance test data generated in the test data generation step, the information processing device And a test execution control step for executing a performance test on the condition input screen, wherein the condition input screen is related to a first information processing function for providing the predetermined service and second information for receiving the predetermined service. It is characterized in that it is divided into a part relating to the processing function and a part relating to the predetermined service, and a plurality of setting values can be input to the same item of the measurement condition.

The program of the present invention comprises a condition input screen for inputting information relating to measurement conditions in a performance test to be executed by the information processing system, the condition input screen comprising at least one information processing device and providing the predetermined service. The information processing apparatus is divided into a portion related to one information processing apparatus group, a second information processing apparatus group including at least one information processing apparatus and receiving the predetermined service, and a portion related to the predetermined service. The condition input screen has a common format regardless of the above-mentioned predetermined service, and a plurality of set values can be input to the same item of the measurement condition, and a set of set values of different items of the measurement condition is set. Using the set value group as one performance test data, set values of different items of the above measurement conditions input via the above condition input screen can be set arbitrarily. The combination based on the automatically generated performance test data, characterized in that to execute the processing procedure for executing the performance tests to the information processing system on the computer.

Another feature of the program of the present invention is that a condition input screen for inputting information relating to measurement conditions in a performance test to be executed by the information processing device is provided as the first service for providing the predetermined service. Is divided into a part related to the information processing function of the above, a part related to the second information processing function of receiving the predetermined service, and a part related to the predetermined service, and the condition input screen is displayed regardless of the predetermined service. With a common format, a plurality of setting values can be input to the same item of the above measurement conditions, and one set value group consisting of the setting values of different items of the above measurement conditions is used as one performance test data. Based on the performance test data automatically generated by arbitrarily combining the setting values of the different items of the measurement conditions input via the condition input screen, Characterized in that to execute the processing procedure for executing the performance tests to the information processing apparatus to the computer.

A computer-readable recording medium of the present invention is characterized by recording the above program.

[0034]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration example of a benchmark test system including a benchmark test control device to which a performance measuring device according to an embodiment of the present invention is applied. It should be noted that FIG. 1 shows, as an example, a benchmark test system which is one of client / server type systems and measures the performance of a mail system for transmitting and receiving electronic mail.

In FIG. 1, 101 is a benchmark test control device (hereinafter also referred to as "benchmark control device"), which displays a condition input screen, a test pattern selection screen, a result display screen, and the like. Further, the benchmark control device 101 generates a test pattern (measurement condition) that is a combination of condition patterns obtained by grouping the set values of the parameters for each parameter group of the benchmark, and executes the test pattern on the information processing system 102 that is the measurement target. It controls the execution of the benchmark by supplying the setting value of each parameter of the benchmark. In addition,
Details of the benchmark control device 101 will be described later.

The information processing system 102 is composed of a mail server 103 and a client terminal 104.
The mail server 103 is used by the information processing system 102 to send and receive electronic mail and manage the electronic mail. In addition, the mail server 103 changes the hardware configuration such as the number of CPUs and the memory size of the mail server 103 according to an instruction from the benchmark control device 101, and changes the benchmark pattern every time the test pattern (measurement condition) changes. The measurement result (resource information such as CPU operating rate) is supplied to the benchmark control device 101.

The client terminal 104 is a terminal that accesses the mail server 103 and sends and receives electronic mail. In this embodiment, the client terminal 1
04 generates a virtual process based on the setting values of the parameters of the benchmark supplied from the benchmark control device 101, and accesses the mail server 103 according to the generated virtual process. Also, the client terminal 104 uses the benchmark measurement result (response time of the mail server 103 for access, etc.) in the benchmark every time the test pattern (measurement condition) changes.
01 to supply.

The benchmark control device 101, the mail server 103, and the client terminal 104 are connected so that they can communicate with each other via individual signal lines. Also, the mail server 103 and the client terminal 10
4 is a LAN (Local Area Network) or W by a network interface (not shown) provided in each.
They are communicably connected to each other via a network 105 such as an AN (Wide Area Network).

In FIG. 1, the benchmark control device 101, the mail server 103 and the client terminal 104 are connected to each other via individual signal lines, but the mail server 103 and the client terminal 104 are connected to each other. The benchmark control device 101 may be connected to the network 105 so that it can communicate with it.

Although FIG. 1 shows two client terminals 104, the number of client terminals 104 is arbitrary as long as it has a processing capacity capable of executing a benchmark and supplying the result to the benchmark control device 101. Is.

FIG. 2 is a block diagram showing a configuration example of the benchmark control device 101 according to this embodiment. In FIG. 2, blocks having the same functions as those of the blocks shown in FIG. 1 are designated by the same reference numerals, and duplicated description will be omitted.

In FIG. 2, the benchmark control device 10
1 includes a user interface unit 200, a management unit 210, and an execution control unit 220. The user interface unit 200 includes a user interface generation unit 20.
2 and a display unit 203 including a display device such as a display.
And an input unit 204 including an input device such as a keyboard and a mouse.

The user interface control section 201 supplies the information input from the input section 204 (benchmark measurement condition values, test pattern selection (execution) / non-selection (non-execution), etc.) to the management section 210. The user interface control unit 201 also manages the data (file) based on the instruction or the like input from the input unit 204.
The user interface is read from 0, a user interface corresponding to the data (file) is generated by the user interface generation unit 202, and is supplied to the display unit 203.

The display unit 203 displays a display screen relating to the display data supplied from the user interface control unit 201. The displayed display screen includes a condition input screen, a test pattern selection screen, and a result display. There are screens etc.

Here, on the condition input screen, the operator inputs benchmark parameters (number of CPUs, number of users on the client side, measurement conditions such as processing contents).
Is a screen for adding, deleting, and inputting parameter setting values (measurement condition values). The test pattern selection screen is a screen for displaying all test patterns created based on the input benchmark condition patterns (parameter setting values) and prompting the operator to select a test pattern to be executed. The result display screen is a screen for presenting the measurement result of the performance of the executed benchmark to the operator or the like.

The input unit 204 inputs benchmark parameters and setting values, selects a test pattern to be executed from all test patterns, and supplies it to the user interface control unit 201.

The management unit 210 stores data such as the test pattern of the benchmark, the parameter and its setting value, and the measurement result of the benchmark, and supplies the stored data to the user interface unit 200 and the execution control unit 220. The management unit 210 uses the test pattern generation unit 2
12 and a parameter file generation unit 213, a test pattern control unit 211, a measurement condition file storage unit 214, and a result storage unit 215.

The test pattern control unit 211 generates all benchmark test patterns and parameter files based on the benchmark parameters and condition patterns supplied from the user interface unit 200. Further, the test pattern control unit 211 requests the operator to select a test pattern to be executed from the generated test patterns, or supplies a parameter file corresponding to the test pattern to be executed to the execution control unit 220. .

The test pattern generating section 212 has the input section 2
All test patterns of the benchmark are generated in accordance with the condition pattern of the benchmark input from 04 according to the condition input screen and supplied via the user interface control unit 201. That is, the test pattern generator 21
2 automatically generates all combinations of condition patterns of different parameter groups.

The parameter file generation unit 213 generates parameter files of all test patterns based on the benchmark condition patterns input from the input unit 204 according to the condition input screen and supplied via the user interface control unit 201. Here, the parameter file indicates a measurement condition (set value of each parameter) of a benchmark in which one condition pattern of each parameter group is combined, and one parameter file exists for one test pattern. To do.

For example, the parameter group of the benchmark is 4
If there are three types of condition patterns set for each parameter group, the test pattern generation unit 2
12 generates 81 (3 × 3 × 3 × 3) test patterns. At this time, the parameter file generator 21
In No. 3, by selecting one condition pattern from each of the four parameter groups and arbitrarily combining them, 81 parameter files respectively corresponding to 81 test patterns are generated.

The test pattern and the parameter file respectively generated as described above are stored in the execution controller 2
20 is supplied to the measurement condition file storage unit 214 and stored in the measurement condition file storage unit 214. The test pattern and parameter files stored in the measurement condition file storage unit 214 are stored in the measurement condition file storage unit 21 as required.
4 and can be supplied to the user interface unit 200, and can be used to input parameters and their setting values in benchmarks from the next time onward.

The result storage unit 215 stores the mail server 103 by the result collection unit 225, which will be described later, in the execution control unit 220 each time the benchmark of one test pattern is completed.
And the execution result of the benchmark (CPU operation rate, processing response time, etc.) collected from the client terminal 104 is stored.

The execution control unit 220 has a server control unit 221.
The client control unit 222 and the result collection unit 225 control the execution of the benchmark in the information processing system 102. The server control unit 221 is supplied with the parameter file of the test pattern to be executed from the test pattern control unit 211 in the management unit 210, and when executing the benchmark, the hardware configuration and the initial state setting are performed based on the supplied parameter file. Etc. to the mail server 103.

The client control section 222 controls the client terminal 104 when executing the benchmark, and has an execution control data output section 223 and a process control section 224.

The execution control data output unit 223 supplies the parameter file of the test pattern to be executed supplied from the test pattern control unit 211 to the client terminal 104 as the execution control data. As a result, the client terminal 104 creates a virtual process based on the parameter file supplied as the execution control data. The execution control data output unit 223 generates a virtual process to be executed by the client terminal 104 from the supplied parameter file, and supplies data for executing the generated virtual process to the client terminal 104 as execution control data. You may do it.

The process control unit 224 controls the execution of the virtual process on the client terminal 104 based on the parameter file of the test pattern to be executed. The result collection unit 225 collects the benchmark execution results (CPU operation rate, processing response time, etc.) from the mail server 103 and the client terminal 104 each time the benchmark of one test pattern is completed, and the results in the management unit 210 are collected. It is supplied to the storage unit 215 and stored therein.

Next, the operation will be described. FIG. 3 is a flowchart showing the processing operation of the benchmark test system shown in FIG.

First, when the processing operation is started, step S
At 301, the user interface control unit 201 displays an application selection screen (test selection screen) on the display unit 2
03, and requests the information processing system 102 to select an application for performance measurement. Here, on the application selection screen, a list of selectable application names is displayed by a GUI (graphic user interface) such as a list box.

The operator selects an application from the list of application names by using the input unit 204. For example, in the information processing system 102,
If the application to be measured is related to email, select "Mail" as the application. Similarly, if the application to be measured is related to the Web, select "Web" to select that related to the database. If so, select "database".

Next, in step S302, the user interface generation unit 202 generates the contents (input items etc.) of the condition input screen, which is an interface, according to the application selected in step S301.

Specifically, the user interface generation unit 202 sets the benchmark parameters (items) requesting the input of setting values via the condition input screen as server-dependent parameters (server condition parameter group). The parameters are classified into client-dependent parameters (client condition parameter group) and application-dependent parameters. Further, the application-dependent parameter is classified into a transaction parameter (transaction condition parameter group) related to processing contents in the information processing system 102 and a workload parameter (workload condition parameter group) related to load.

When the user interface generating unit 202 generates an interface according to the selected application, the server-dependent parameter and the client-dependent parameter are common parameters regardless of the selected application. Further, application-dependent parameters (transaction parameters, workload parameters) are changed to appropriate parameters (items) according to the selected application. However, the display format and the basic input method on the condition input screen are the same, only by changing the item name of the parameter depending on the application.

For example, when the selected application is "mail", the user interface generation unit 202 sets transaction parameters such as mail transmission, mail reception (by POP protocol), and mail reception (IMAP). (By protocol)
And so on. Also, the user interface generation unit 202
Sets the workload parameters to the data size of one email, the access interval (time) from the same user, the number of users who have emails at the start of benchmark execution, the number of emails, etc. To do.

The user interface control section 201 causes the display section 203 to display a condition input screen which is an interface corresponding to the selected application. In step S303, the operator uses the input unit 204 according to the condition input screen displayed on the display unit 203 to add or delete benchmark parameters or input parameter setting values. Then, when the addition and deletion of the parameter and the input of the setting value of the parameter are completed, the parameter and the input setting value are updated by the management unit 210.
It is supplied to the test pattern control unit 211 inside.

FIG. 4 is a diagram showing an example of the condition input screen. Note that FIG. 4 shows a condition input screen in which the set values of the benchmark parameters are input.

As shown in FIG. 4, the condition input screen 440 is displayed.
Is a server condition input window 400 for displaying the parameter group of the server condition, a client condition input window 410 for displaying the parameter group of the client condition, and a transaction condition input window 42 for displaying the parameter group of the transaction condition.
0 and a workload condition input window 430 for displaying the parameter group of the workload condition.

The server condition input window 400 is provided with a setting button 401 and a read button 402. The operator operates the input unit 204 and presses (clicks) the setting button 401 to set the input parameters and setting values displayed on the parameter display unit 403, that is, the test pattern in the management unit 210. It is supplied to the control unit 211.

By operating the input unit 204 and pressing (clicking) the read button 402, the previously set parameters and their set values stored in the measurement condition file storage unit 214, which is a repository, are read. It is output and displayed on the parameter display unit 403. By using the read button 402 and reusing the parameter and its setting value that have been set in the past, the input work of the parameter and its setting value using the input unit 204 is reduced, and the confirmation work is simplified. Even if it does, it is possible to prevent an input error or the like from occurring.

Further, the server condition input window 400
Is provided with a row insert button 404 and a row delete button 405. When adding a parameter, by pressing (clicking) the row insert button 404, one row is added to the parameter display portion 403. It Similarly, when deleting a parameter, the line to be deleted is selected and the line deletion button 405 is pressed (clicked) to delete the selected line from the parameter display unit 403.

The parameter display section 403 is a section for displaying the server condition parameters and their set values in a table format. In the parameter display unit 403, the server name “machine 1” is input as a parameter, and the number of CPUs and the memory size of the server “machine 1” used in the benchmark are input as set values.

That is, regarding the server condition, the server name (parameter) “machine 1” forms a parameter group, and the number of CPUs “4” and the memory size “1 GB” which are the setting values of the server name “machine 1” are conditions. The pattern S1 is formed, and the number of CPUs “4” and the memory size “2 GB” that are the set values form the conditional pattern S2. Here, in the present embodiment, since the number of mail servers 103 is one,
Although only the setting value of the server name "Machine 1" is entered, if there are multiple servers, enter multiple server names,
You can enter the setting value for each server.

The client condition input window 4
10. Regarding the transaction condition input window 420 and the workload condition input window 430,
Similar to the server condition window 400, a setting button, a read button, a line insert button, and a line delete button are provided respectively. In addition, each window 410, 420,
The functions of the setting button, the read button, the line insert button, and the line delete button respectively provided in 430 are the same as the functions of the buttons provided in the server condition window 400, and thus the description thereof will be omitted.

The client condition input window 4
10, the parameter display portions 413, 423, 433 of the transaction condition input window 420 and the workload condition input window 430 also display the parameters and their setting values in a table format regardless of the application, as in the server condition window 400.
Similar to the server condition, a parameter group and a condition pattern (client conditions C1, C2, C3, transaction conditions T1, T2, workload conditions W1, W2) are respectively formed.

Although the transaction ratio is input to the condition pattern of the transaction condition, the transaction ratio may be input as a percentage or as a ratio. Even if the ratio of transactions is entered as a ratio, the process is executed by converting it into a percentage in executing the benchmark.

Further, FIG. 4 shows the condition input screen 440 divided into four by the input windows 400, 410, 420 and 430 of the server condition, the client condition, the transaction condition and the workload condition. Is not limited to the display screen divided into four, and only the window for inputting the setting value of the parameter may be displayed, or one window may be displayed.

Although not shown in FIG. 4, like the line insert button and line delete button, when adding a condition pattern, the parameter display section is set to 1
A column insert button for adding a column, and a column delete button for deleting a column selected from the parameter display section when deleting a condition pattern are displayed on each window 400, 4
It may be provided in 10, 420, 430.

Returning to FIG. 3, in step S303,
When the setting buttons of all condition input windows are pressed and all parameters and setting values (condition patterns) are supplied to the test pattern control unit 211, in step S304, the test pattern generation unit in the test pattern control unit 211. 212 automatically generates, as a test pattern, a combination of all the condition patterns based on the condition patterns of different parameter groups. Further, the parameter file generation unit 213 in the test pattern control unit 211 generates parameter files respectively corresponding to all test patterns in the same manner as the test pattern generation unit 212.

As a result, a test pattern covering all combinations of the input condition patterns and a parameter file including the set values of the parameters corresponding to the test pattern are generated. In step S305, the test pattern control unit 211 determines in step S304.
The test pattern and the parameter file respectively generated in the above are stored in the measurement condition file storage unit 214.

Next, in step S306, the test pattern control unit 211 makes a list of all test patterns generated in step S304, and a test pattern selection screen as shown in FIG. Is displayed on the display unit 203. The operator uses the input unit 204 to select a test pattern for executing the benchmark from all the test patterns displayed on the test pattern selection screen, and instructs the test pattern control unit 211 to start executing the benchmark.

FIG. 5 is a diagram showing an example of the test pattern selection screen. As shown in FIG. 5, on the test pattern selection screen, all combinations of the condition patterns set in each parameter group, that is, all the test patterns are appropriately combined with a plurality of parameter groups, so that the X-series condition pattern is obtained. And the Y-series condition pattern are displayed two-dimensionally. In FIG. 5, as an example, the condition pattern of the client condition (three ways) in FIG. 4 is used as the X-series condition pattern, and the condition pattern (12 ways) combining the condition patterns of the server condition, the transaction condition, and the workload condition is Y. It is shown as a condition pattern of the series.

The combination of a plurality of parameter groups when the two-dimensionalization of all test patterns for displaying as a test pattern selection screen is performed by the test pattern control unit 2
11 may automatically combine arbitrary parameter groups, or the test pattern control section 211 may combine the parameter groups according to the instruction by allowing the operator to instruct using the input section 204.

In the test pattern selection screen displayed in the table format, each intersection of the X-series condition pattern and the Y-series condition pattern corresponds to one test pattern. Further, on the test pattern selection screen, a check box provided at each intersection of the X-series condition pattern and the Y-series condition pattern indicates whether to execute the benchmark of the test pattern indicated at the intersection. Is for selecting. When the check box is checked (selected), it indicates that the benchmark of the test pattern is to be executed. When it is not checked (not selected), the benchmark of the test pattern is not executed. Shows.

When the display of the test pattern selection screen is started, the test pattern selection screen is displayed with all the check boxes checked. This makes it possible to prevent omission of the benchmark to be executed due to omission of check boxes. The execute button 501 is for instructing the start of benchmark execution.

Returning to FIG. 3, in step S306,
When the operator selects / deselects the check box on the test pattern selection screen by the operator using the input unit 204 and presses the execution button 501, the process proceeds to step S307, and the benchmark execution start is the test pattern control unit. 211 is instructed. When the test pattern control unit 211 receives an instruction to start benchmark execution, the test pattern control unit 211 starts benchmark execution processing for the information processing system 102. This benchmark execution process will be described later.

When the benchmark execution process in step S307 is completed, in step S308, the user interface control unit 202 reads the measurement result of the benchmark executed in step S307 from the result storage unit 215 and displays it in a predetermined format in the display unit 203. , And the processing operation of the benchmark test system ends.

FIG. 6 is a flow chart showing in detail the operation of the benchmark execution processing shown in FIG. In the benchmark execution process, first, in step S601, the test pattern control unit 211 selects one test pattern from the list of all test patterns created based on the input condition pattern. In the selection of test patterns by the test pattern control unit 211 in step S601, test patterns that have not been previously selected are selected one by one in the list of all test patterns.

Next, in step S602, the test pattern control unit 211 checks whether or not the test pattern selected in step S601 is selected for execution, that is, a check box is displayed on the test pattern selection screen as shown in FIG. It is determined whether or not is checked.
As a result of the above determination, if the test pattern control unit 211 determines that the test pattern selected in step S601 has been selected for execution, the process proceeds to step S603. It returns to S601.

In step S603, which is executed when it is determined that the test pattern selected in step S601 has been selected for execution, the test pattern control unit 211
The parameter file corresponding to the test pattern is read. Further, the test pattern control unit 211 supplies the read parameter file to the server control unit 221 and the client control unit 222, respectively.

Next, in step S604, the server control unit 221 instructs the mail server 103 to change the server configuration based on the parameter file supplied in step S603. Then, the mail server 103
When the server controller 221 receives a server configuration change instruction, the server configuration is changed according to the instruction.

In the instruction to change the server configuration performed in step S604, not only the software configuration of the mail server 103 (for example, in the case of an email system, the number of emails held at the start of the benchmark) but also the hardware configuration ( For example, it is possible to instruct to change the number of CPUs used, memory size, etc.). In changing the hardware configuration, the server configuration is changed by a switching instruction by software that controls the number of CPUs and the memory size by outputting a predetermined command, for example, and the CPU and memory in the mail server 103 are not inserted or removed.

In step S605, the execution control data output unit 223 in the client control unit 222 outputs the parameter file supplied in step S603 to the client terminal 104 as execution control data.
Then, in step S606, the client terminal 10
4 creates a virtual process based on the supplied parameter file.

Further, the process control unit 224 in the client control unit 222 instructs the client terminal 104 to start the execution of the virtual process, so that the client terminal 104 executes the virtual process generated based on the parameter file. As a result, the benchmark of one test pattern is executed in the information processing system 102.

When the execution of the virtual process by the client terminal 104 is completed, that is, when the benchmark of one test pattern is completed, in step S607, the result collection unit 225 causes the result collection unit 225 to execute the benchmark execution results (from the mail server 103 and the client terminal 104). The measurement results) are collected and stored in the result storage unit 215.

Next, in step S608, the test pattern control unit 211 determines whether or not there is a selectable test pattern in the list of all test patterns, that is, a test pattern not selected in step S601. As a result of the determination, if there is a selectable test pattern, the process returns to step S601 and the above-described step S6.
The processing from 01 to S608 is repeated, and steps S601 to S6 described above are executed until there are no selectable test patterns.
The processing of 08 is repeated. That is, the processes of steps S601 to S608 described above are repeated until all the test patterns displayed in the list of all test patterns are selected, and the benchmarks of the test patterns selected for execution are automatically and continuously executed.

On the other hand, there is no selectable test pattern,
That is, in the selection processing in step S601, when the selection of all test patterns is completed, the benchmark execution processing is ended.

Next, the result display screen will be described. FIG. 7A is a diagram showing an example of a result display screen displaying the measurement result for each test pattern for which the benchmark is executed.

In FIG. 7A, reference numeral 701 is a list showing the measurement results of one test pattern on which the benchmark is executed, the test pattern name, the response time (average value, variance value, maximum value) in the benchmark, CPU The operating rate is displayed. Further, the list 701 is provided with a graph button 702 for displaying the CPU operation rate in a graph, and when the graph button 702 is pressed by the operation of the input unit 204, it is shown in FIG. 7B. The screen is switched to the result display screen that displays the graph of the CPU operating rate in the benchmark. In FIG. 7B, the horizontal axis is the time from the start of benchmark execution, and the vertical axis is the CPU operating rate.

Further, in the benchmark test system of the present embodiment, the benchmark in the test pattern selected from all the test patterns is automatically performed continuously, and the measurement result of the benchmark is stored in the result storage unit 21.
Store in 5. Therefore, it is possible to easily execute the benchmark with a plurality of test patterns in which only the set value of a certain parameter is changed, and obtain the measurement result of the benchmark.

Therefore, in the result display screen shown in FIG. 7A, in addition to the above-mentioned list 701, the measurement result (in FIG. 7A, in response to the change of the set value of one parameter of the test pattern). Display buttons 704 and 706 for displaying changes in CPU utilization rate and response time)
Is provided.

For example, when the operator wants to display the change in the CPU operating rate with respect to the change in the number of CPUs to be used, the operator uses the input unit 204 to select "CPU number" in the list box 703 for designating the parameter to be changed. "
After selecting, the display button 704 is pressed. At this time, if there is a test pattern in which the parameter setting values differ by the number of CPUs from the test pattern whose measurement result is displayed in the list 701, the user interface control unit 201 determines that the test patterns differ by the number of CPUs. The measurement result of the benchmark is read from the result storage unit 215.

Further, the user interface controller 20
In FIG. 1, the measurement result of the benchmark in the test pattern different in the number of CPUs is displayed as a graph with the horizontal axis as the parameter to be changed, as shown in FIG. 7C.

When it is desired to display the change in the response time when the set value of one parameter is changed, the list box 705 and the display button 706 are used to display the CP.
Since the same operation as that for displaying the change in the U operation rate may be performed, the description thereof will be omitted.

As described above in detail, according to the present embodiment, the condition input screen for the operator to add or delete the parameter of the benchmark and to input the set value of the parameter is displayed on the server condition, the client condition, and the client condition. It is divided into parts for inputting conditions related to applications. Further, for conditions related to applications, it is divided into parts for inputting transaction conditions and workload conditions. In addition, the parameter display section for actually inputting parameters and parameter setting values is displayed in a table format, and parameter fields and setting value input fields are added.
It can be deleted so that a plurality of setting values can be set for one parameter at the same time. And
The server condition and the client condition are the same regardless of the application. Regarding the transaction condition and the workload condition related to the application, although the parameter contents change depending on the application, the basic format for displaying in table format is the application. Do the same regardless of

As a result, the operator can input an arbitrary number of setting values for each parameter at the same time, and there is no need to input the setting value for each benchmark each time. It can be done very easily. Further, by adding or deleting a parameter column or a setting value input column, only the parameter to be changed can be displayed and the setting value can be input.

Further, in the present embodiment, the test pattern control unit 211 makes all combinations of condition patterns of different parameter groups based on parameters and setting values (condition patterns) input via the condition input screen. A parameter file corresponding to the test pattern is generated. Furthermore, from all the test patterns,
A test pattern to be executed is selected via the test pattern selection screen, and the benchmark in the information processing system 102 is executed.

As a result, even if there are many parameters, a combination (test pattern) of all the setting values can be generated simply by inputting the setting values for each parameter.
By simply selecting from the test patterns displayed via the test pattern selection screen, it is possible to easily select and execute the test pattern corresponding to the benchmark to be executed without much input work. Further, even if a plurality of test patterns are selected on the test pattern selection screen, the parameter file corresponding to the test pattern is sequentially supplied from the test pattern control unit 211 to the information processing system 102 via the execution control unit 220, and the benchmark is displayed. To be executed.

Further, even if the hardware configuration has to be changed at the time of benchmarking, since the hardware is controlled by a predetermined instruction in this embodiment, the work such as insertion / removal is actually performed. No need. Therefore, the operator only needs to select the test pattern on the test pattern selection screen, and the information processing system 102
In this case, since the benchmarks using the plurality of test patterns are automatically performed continuously, the labor required for the plurality of benchmarks can be reduced and the time can be significantly shortened as compared with the conventional method.

Further, in the present embodiment, the result storage unit 2 for storing the benchmark execution result in the benchmark control device.
Since 15 is provided, it is possible to accumulate a plurality of execution results in which the set values of the parameters are changed, and it is possible to analyze the data required for performance evaluation and sizing of the measurement target system.

In the above-described embodiment, the information processing system 1 for executing the benchmark and measuring the performance.
02 shows an electronic mail system as an example,
The present invention is applicable not only to the electronic mail system but also to a system having a database server or a system having a web server. The different systems are the same as in the case of the electronic mail system, except that the condition items related to the application on the condition input screen are different.

Further, in the present embodiment, the information processing system 102 including the server 103 and the plurality of client terminals 104 is shown as an example of the measurement target by the benchmark, but the information processing function corresponding to the server (server function)
And one information processing device having both the information processing function (client function) corresponding to the client terminal may be the measurement target.

Further, in the present embodiment, the benchmark control device 101 is composed of one device including the input unit 204 and the display unit 203. However, for example, another terminal device as the input unit 204 and the display unit 203. Even if it is connected to the benchmark control device via a communication means such as a network using, the same effect as this embodiment can be obtained.

The performance measuring apparatus of the present embodiment described above is the CPU of the computer or MPU, RA.
It can be composed of M, ROM, etc., RAM, RO
It can be realized by the operation of the program stored in M, and the program is included in the embodiment of the present invention.
In addition, a program that causes a computer to perform the above functions can be realized by recording the program in a recording medium such as a CD-ROM and causing the computer to read the program. Embodiment of the present invention. As the recording medium for recording the program, a flexible disk, a hard disk, a magnetic tape, a magneto-optical disk, a non-volatile memory card, or the like can be used in addition to the CD-ROM.

Further, a program product in which the functions of the above-described embodiments are realized by a computer executing a program and performing processing is included in the embodiments of the present invention. As the program product, the program itself for realizing the functions of the above-described embodiments, a computer loaded with the program, a transmission device capable of providing the program to a computer communicably connected via a network, and the transmission There is a network system including a device.

Further, not only the functions of the above-described embodiments are realized by executing the supplied program by the computer, but also the OS (operating system) or other application software running the program on the computer. In the case where the functions of the above-described embodiments are realized in cooperation with the above, or all or part of the processing of the supplied program is performed by the function expansion board or function expansion unit of the computer, the functions of the above-described embodiments are realized. However, such a program is also included in the embodiment of the present invention. Further, in order to use the present invention in a network environment, all or part of the program may be executed by another computer.

For example, the performance measuring apparatus shown in this embodiment has a computer function 800 as shown in FIG.
The operation in this embodiment is carried out by the CPU 801.

As shown in FIG. 8, the computer function 800 includes a CPU 801, a ROM 802, and a RAM 8
03, a keyboard controller (KBC) 805 of a keyboard (KB) 809, and a CRT controller (CR of a CRT display (CRT) 810 as a display unit.
A configuration in which a TC) 806, a disk controller (DKC) 807 of a hard disk (HD) 811 and a flexible disk (FD) 812, and a network interface card (NIC) 808 are communicably connected to each other via a system bus 804. I am trying.

The CPU 801 has a ROM 802 or H
By executing the software (program) stored in the D811 or the software (program) supplied from the FD 812, the respective components connected to the system bus 804 are comprehensively controlled. That is, the CPU 8
01 is a processing program for performing the above-described operation, which is stored in the ROM 802, the HD 811, or the F
By reading from D812 and executing the control, control for realizing the operation in the present embodiment is performed.

The RAM 803 functions as the main memory or work area of the CPU 801. KBC805
Controls an instruction input from the KB 809 or a pointing device (not shown). CRTC806 is C
It controls the display of the RT 810. The DKC 807 controls access to the HD 811 and the FD 812 that store a boot program, various applications, user files, a network management program, the processing program described above in this embodiment, and the like. The NIC 808 bidirectionally exchanges data with other devices on the network 813.

[0120]

As described above, according to the present invention,
Enter the condition input screen to enter the information related to the measurement conditions.
It is divided into a part related to the first information processing device group, a part related to the second information processing device group, and a part related to a predetermined service to have a common format regardless of the predetermined service, and a plurality of measurement conditions are used. You can enter the setting values of, and based on the performance test data that is automatically generated by arbitrarily combining the setting values of the items with different measurement conditions,
Cause the information processing system to execute a performance test.

As a result, a plurality of different measurement conditions are input at the same time, a plurality of performance test data are automatically generated by arbitrarily combining them, and the performance of the information processing system is improved based on the generated plurality of performance test data. The test can be run. Therefore, by inputting multiple setting values at the same time on the condition input screen, the generated multiple performance test data are supplied to the information processing system and the benchmark tests under different measurement conditions are automatically and continuously performed. Can be executed.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration example of a benchmark test system including a benchmark test control device to which a performance measuring device according to an embodiment of the present invention is applied.

FIG. 2 is a block diagram showing a configuration example of a benchmark test control device 101 in this embodiment.

FIG. 3 is a flowchart showing the processing operation of the benchmark test system.

FIG. 4 is a diagram showing an example of a condition input screen.

FIG. 5 is a diagram showing an example of a test pattern selection screen.

6 is a flowchart showing in detail the operation of the benchmark execution process shown in FIG.

FIG. 7 is a diagram showing an example of a result display screen.

FIG. 8 is a block diagram showing a configuration example of a computer that can realize a performance measuring device.

[Explanation of symbols]

101 Benchmark test controller 102 Information processing system (mail system) 103 mail server 104 client terminal 105 network 200 User interface section 201 User interface control unit 202 user interface generator 203 display 204 Input section 210 Administration Department 211 Test pattern controller 212 Test Pattern Generation Unit 213 Parameter file generator 214 Measurement condition file storage 215 result storage 220 Execution control unit 221 server control unit 222 Client control unit 223 Execution control data output section 224 Process control unit 225 Result Collection Department

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Tatsuya Hasegawa             2-20-15 Shinkawa, Chuo-ku, Tokyo Nippon Steel             Solutions Co., Ltd. (72) Inventor Taku Oshiro             2-20-15 Shinkawa, Chuo-ku, Tokyo Nippon Steel             Solutions Co., Ltd. F term (reference) 5B042 HH20 LA13 LA17 MA05 MA08                       MC29 MC33 NN08 NN23 NN34                       NN44 NN45

Claims (20)

[Claims] 1. A performance measuring device for measuring the performance of an information processing system which provides a predetermined service based on the inputted measuring condition, wherein a condition input screen for inputting information relating to the measuring condition is displayed. A part relating to a first information processing device group including at least one information processing device and providing the predetermined service, and a second information processing device group including at least one information processing device and receiving the predetermined service Related parts and the part related to the above-mentioned predetermined service, and the condition input screen has a common format regardless of the above-mentioned predetermined service, and a plurality of setting values can be input to the same item of the above-mentioned measurement condition. Then, one set of set values consisting of set values of different items of the above measurement conditions is entered as one performance test data via the above condition input screen. Has been described above on the basis of the automatically generated performance test data of any combination of different items of the setting values with each other in measurement conditions, performance measuring device, characterized in that to execute a performance test on said information processing system. 2. An input area of information relating to each of the measurement conditions in a portion related to the first information processing device group, a portion related to the second information processing device group, and a portion related to the predetermined service is two-dimensional. The performance measuring device according to claim 1, wherein the performance measuring device is arranged in a table format. 3. A performance measuring device for measuring the performance of an information processing system which provides a predetermined service on the basis of the inputted measuring condition, wherein a condition input screen for inputting information relating to the measuring condition is displayed. A display means for displaying, an input means for inputting information relating to the measurement condition according to the condition input screen displayed by the display means, and a set of set value groups consisting of set values of mutually different items of the measurement condition. As one piece of performance test data, the test data generation means for automatically generating the performance test data by arbitrarily combining the setting values of the items of the measurement conditions different from each other inputted by the input means, and the test data generation means. A test execution control means for causing the information processing system to execute a performance test based on performance test data generated by the means. The input screen includes a portion related to a first information processing apparatus group that includes at least one information processing apparatus and provides the predetermined service, and second information including at least one information processing apparatus that receives the predetermined service. A performance measuring device characterized by being divided into a part related to a processing device group and a part related to the predetermined service, and a plurality of setting values can be input to the same item of the measurement condition. 4. An input area of information relating to each of the measurement conditions in a portion related to the first information processing device group, a portion related to the second information processing device group, and a portion related to the predetermined service is two-dimensional. The performance measuring apparatus according to claim 3, wherein the performance measuring apparatus is arranged in a table format. 5. The hardware and software configurations of an information processing apparatus that constitutes the information processing system can be set based on the performance test data, and the test execution control means is a hardware of the information processing apparatus. 5. The performance measuring apparatus according to claim 3, wherein when setting the configuration, the information processing apparatus is supplied with a predetermined command to set the hardware configuration. 6. The test data generating means further comprises test data storing means for storing the performance test data generated by arbitrarily combining set values of different items of the measuring conditions, and the input means means for measuring the measuring conditions. 4. When inputting information related to, the setting value of the measurement condition based on the performance test data stored in the test data storage means is provided in response to an instruction from the input means. ~
5. The performance measuring device according to any one of 5 above. 7. The method further comprises result storage means for storing a measurement result of a performance test executed by the information processing system by the test execution control means, based on the generated performance test data. Item 7. The performance measuring device according to any one of items 3 to 6. 8. A performance test is executed by the information processing system from all performance test data generated by the test data generating means by arbitrarily combining set values of items different from each other in the measurement condition. The selection means for selecting the performance test data of 1., the test execution control means causes the information processing system to execute only the performance test based on the performance test data selected by the selection means. The performance measuring device according to any one of 3 to 7. 9. An interface generation unit is further provided, which generates an item of the measurement condition to be input in a portion related to the predetermined service of the condition input screen according to a service provided by the information processing system. The performance measuring device according to any one of claims 3 to 8. 10. The information processing system includes a server computer and a client terminal, the first information processing apparatus group is a server computer, and the second information processing apparatus group is a client terminal. The performance measuring device according to any one of claims 3 to 9. 11. A performance measuring device for measuring the performance of an information processing device which provides a predetermined service based on the inputted measuring condition, wherein a condition input screen for inputting information on the measuring condition is displayed. And a condition related to the first information processing function for providing the predetermined service, a part related to the second information processing function for receiving the predetermined service, and a part related to the predetermined service. The input screen has a common format regardless of the above-mentioned service, and multiple set values can be input to the same item of the above measurement conditions, and a set of settings of different items of the above measurement conditions can be set. Using a group of values as one piece of performance test data, the set values of the different items of the measurement conditions input via the condition input screen are arbitrarily combined and automatically generated. It was based on performance test data, performance measuring apparatus characterized by executing a performance test to the information processing apparatus. 12. A performance measuring device for measuring the performance of an information processing device which provides a predetermined service based on the inputted measuring condition, wherein a condition input screen for inputting information relating to the measuring condition is displayed. A display means for displaying, an input means for inputting information relating to the measurement condition according to the condition input screen displayed by the display means, and a set of set value groups consisting of set values of mutually different items of the measurement condition. As one piece of performance test data, the test data generation means for automatically generating the performance test data by arbitrarily combining the setting values of the items of the measurement conditions different from each other inputted by the input means, and the test data generation means. A test execution control unit that causes the information processing apparatus to execute a performance test based on the performance test data generated by the means. The surface is divided into a portion related to the first information processing function for providing the predetermined service, a portion related to the second information processing function for receiving the provision of the predetermined service, and a portion related to the predetermined service. A performance measuring device characterized in that a plurality of setting values can be input to the same item of the above measurement conditions. 13. A performance measurement system for measuring the performance of an information processing system that provides a predetermined service based on the input measurement conditions, the condition input being provided for inputting information related to the measurement conditions. A portion of the screen related to a first information processing device group that includes at least one information processing device and provides the predetermined service, and second information processing that includes at least one information processing device and receives the predetermined service. Dividing into a part related to the device group and a part related to the above-mentioned predetermined service, the condition input screen has a common format regardless of the above-mentioned predetermined service, and a plurality of set values are input to the same item of the above-mentioned measurement condition It was made possible to provide one set of set values consisting of set values of items different from each other in the above measurement conditions as one performance test data. The information processing system is caused to execute a performance test based on performance test data automatically generated by arbitrarily combining the setting values of the different items of the measurement conditions input via the item input screen. Performance measurement system. 14. A performance measuring method for measuring the performance of an information processing system which provides a predetermined service based on the input measuring condition, wherein a set of set values of different items of the measuring condition is set. The set value group is used as one performance test data, and the set value of the items different from each other of the above measurement conditions input through the condition input screen for inputting the information related to the above measurement conditions is arbitrarily combined to automatically perform the performance. A test data generation step of generating test data; and a test execution control step of causing the information processing system to execute a performance test based on the performance test data generated in the test data generation step. The screen is composed of at least one information processing device and provides at least a portion related to the first information processing device group that provides the predetermined service. Is divided into a part related to the second information processing device group including only one information processing device and receiving the predetermined service and a part related to the predetermined service, and the condition input screen is displayed regardless of the predetermined service. Instead of using a common format, multiple setting values can be entered for the same item of the above measurement conditions. 15. A performance measuring method for measuring the performance of an information processing system which provides a predetermined service based on the inputted measuring condition, wherein a condition input screen for inputting information related to the measuring condition is displayed. A display step for displaying, an input step for inputting information relating to the measurement condition according to the condition input screen displayed in the display step, and a set of set values consisting of set values of different items of the measurement condition A test data generation step of automatically generating the performance test data by arbitrarily combining set values of mutually different items of the measurement conditions input in the input step with the group as one performance test data, Test execution control for causing the information processing system to execute a performance test based on the performance test data generated in the data generation step The condition input screen includes a portion related to the first information processing device group including at least one information processing device and providing the predetermined service, and the predetermined service including at least one information processing device. Is divided into a part related to the second information processing device group that is provided with the above and a part related to the predetermined service, and a plurality of setting values can be input to the same item of the measurement condition. Measuring method. 16. A performance measuring method for measuring the performance of an information processing device that provides a predetermined service based on the input measuring condition, wherein a set of set values of different items of the measuring condition is set. The set value group is used as one performance test data, and the set value of the items different from each other of the above measurement conditions input through the condition input screen for inputting the information related to the above measurement conditions is arbitrarily combined to automatically perform the performance. A test data generation step of generating test data; and a test execution control step of causing the information processing apparatus to execute a performance test based on the performance test data generated in the test data generation step. The screen shows a portion related to the first information processing function for providing the predetermined service and a second information processing function for receiving the provision of the predetermined service. And the part related to the predetermined service, the condition input screen has a common format regardless of the predetermined service, and a plurality of set values can be input to the same item of the measurement condition. A performance measuring method characterized by the above. 17. A performance measuring method for measuring the performance of an information processing device which provides a predetermined service based on the inputted measuring condition, wherein a condition input screen for inputting information related to the measuring condition is displayed. A display step for displaying, an input step for inputting information relating to the measurement condition according to the condition input screen displayed in the display step, and a set of set values consisting of set values of different items of the measurement condition A test data generation step of automatically generating the performance test data by arbitrarily combining set values of mutually different items of the measurement conditions input in the input step with the group as one performance test data, Test execution control step for causing the information processing apparatus to execute a performance test based on the performance test data generated in the data generation step And the condition input screen is related to the first information processing function for providing the predetermined service, the second information processing function for receiving the predetermined service, and the predetermined service. A performance measuring method characterized by being divided into parts and a plurality of setting values can be input to the same item of the above measurement conditions. 18. A first information processing system comprising a condition input screen for inputting information relating to measurement conditions in a performance test to be executed by an information processing system, said first information processing system comprising at least one information processing device and providing said predetermined service. The condition input screen is divided into a part related to the device group, a part related to the second information processing device group including at least one information processing device and receiving the predetermined service, and a part related to the predetermined service. In addition to using the same format regardless of the above prescribed service, it is possible to input multiple set values to the same item of the above measurement conditions, and to set a set of set values consisting of the set values of different items of the above measurement conditions. As one performance test data, set values of different items of the above measurement conditions input via the above condition input screen are automatically combined by combining them arbitrarily. On the basis of the generated performance test data in a program for executing a processing procedure for executing the performance tests to the information processing system on the computer. 19. A condition input screen for inputting information relating to measurement conditions in a performance test to be executed by an information processing device, a condition input screen, a part relating to a first information processing function for providing the predetermined service, and the predetermined information processing function. The condition input screen is divided into a part related to the second information processing function for receiving the service and a part related to the predetermined service, and the condition input screen has a common format regardless of the predetermined service. A plurality of setting values can be input to the same item, and one set of setting value groups consisting of setting values of different items of the above measurement conditions is regarded as one performance test data, and the above-mentioned condition input screen is entered. A process for causing the information processing device to execute a performance test based on performance test data automatically generated by arbitrarily combining setting values of different measurement conditions. Program for executing the order on the computer. 20. A computer-readable recording medium on which the program according to claim 18 or 19 is recorded.