JP2765549B2 - Operation evaluation system in computer system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an operation evaluation system for evaluating the operation suitability of software and hardware constituting a computer system, and in particular, to automatically evaluate display data for displaying a processing result on a display screen. The present invention relates to an operation evaluation system for evaluating operation suitability by performing the above.

[0002]

2. Description of the Related Art When a software program operating on a computer system is improved, an operation test of the program is performed to check whether the revised version of the program operates in the same manner as the current version of the program. In this case, the same data (key) is input and operated for the current version program and the revised version program or related program, and it is evaluated whether the same processing result is output.

Conventionally, in this type of test, the processing result of each program is displayed on a display device, and the display result is visually recognized and evaluated by an operator. Further, in order to improve the accuracy of the evaluation of the processing result and avoid erroneous recognition, a program evaluation technique for mechanically evaluating the processing result without depending on the visual recognition of the operator has been proposed.

[0004] As a conventional technique of this type for automatically evaluating the processing result, there is a technique described in, for example, Japanese Patent Application Laid-Open No. 3-182951. In the same document, the same program is input to the current version program and the revised version program, and the same program is input and operated, a file storing the screen display results of each program is created, and a control program for comparing both files is created. It discloses a technique for automatically comparing data by using it.

[0005] However, in the above-described conventional technique, although the screen display results can be automatically compared, the data input must still be performed from the input device by the operation of the operator. Therefore, it takes time and effort to input,
In addition, there is a possibility that an erroneous operation may occur at the time of input.

The prior art described in the above-mentioned Japanese Patent Application Laid-Open No. Hei 3-182941 is effective for evaluating a program operating on a platform, particularly a revised version of an application program. However, because the program is evaluated at the application level, if the operating system is changed or the hardware is changed or added, whether the operating system or hardware is compatible or not compatible with the computer system Could not be evaluated.

[0007]

As described above, in the conventional program evaluation technology, the operator visually recognizes and evaluates the processing result displayed on the display device. Was.

Further, the conventional program evaluation technique for automatically performing the evaluation also has the disadvantage that the data used for the test is input from an input device by an operator's operation, which is troublesome and may cause an erroneous operation. there were.

Further, since the operation test is executed at the application level, there is a disadvantage that it cannot be used for evaluation of operation suitability and compatibility due to a revision of an operating system or a change or addition of hardware.

The present invention solves the above disadvantages of the prior art,
Automatically performs the entire process from data entry to comparison of screen display results and evaluation, reducing operation time, avoiding erroneous operations, and updating operating systems, changing or adding hardware, etc. It is an object of the present invention to provide an operation evaluation system capable of performing an evaluation of operation suitability and compatibility.

[0011]

SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides an input key storing means for preliminarily inputting and storing an input key input for an operation test, and operates normally. Standard result storage means for storing a standard result that is a result of performing an operation test based on the input key in a predetermined operating environment, and inputting the input result in an operating environment different from the predetermined operating environment for obtaining the standard result An operation evaluation unit that executes an operation test based on the key and compares the operation result with a standard result corresponding to the operation stage stored in the standard result storage unit at a predetermined operation stage; and a comparison unit that stores a comparison result by the operation evaluation unit. And a result storage unit.

In another aspect, the input key storage means stores, as one type of input key, a comparison code for instructing to compare a processing result with the standard result, and the operation evaluation means includes An operation test is executed based on an input key, and when the comparison code is detected, a processing result of the operation test at the time when the comparison code is detected is compared with a corresponding standard result.

In still another aspect, a screen buffer memory for storing various processing results as display data for display output on a display device, and an IO buffer for reading and storing standard results stored in the standard result storage means. A memory, wherein the operation evaluation means compares the storage content of the screen buffer memory with the storage content of the IO buffer memory.

In another aspect, the operating environment includes at least application software for executing various processes, an operating system for controlling the operation of a computer system, and hardware for implementing peripheral functions. In another operation evaluation system that achieves the above object, an input key storage means for preliminarily inputting and storing an input key input for an operation test, and a predetermined operation environment that normally operates. A standard result storing means for storing a standard result which is a result of performing an operation test based on the input key; a screen buffer memory for storing various processing results as display data for display output on a display device; An IO buffer memory for reading and storing the standard result stored in the result storage means; An operation test based on the input key in an operating environment different from the predetermined operating environment for performing the operation test, and the IO buffer memory storing the storage contents of the screen buffer memory and the corresponding standard result in a predetermined operation stage And a comparison result storage unit for storing the comparison result by the operation evaluation unit.

[0015]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of an operation evaluation system according to one embodiment of the present invention.

As shown in the figure, the operation evaluation system of the present embodiment executes a desired arithmetic processing according to a program and performs an operation test in a new operation environment of the computer system. And a processing result (display result of the display device 20, hereinafter referred to as a standard result) when a specific test process is executed in a conventional operating environment of the computer system. The system includes a standard result file 30, an input log file 40 storing input data used for executing a specific test process, and a comparison result storage file 50 storing test results of a program. Also,
A keyboard 60, which is an input device for inputting various data and commands, is connected to the computer 10.

As shown, the computer 10 includes a screen buffer memory 11 for storing image data to be displayed on the display device 20, an IO buffer memory 12 for reading and storing standard results from a standard result file 30, and
A comparison unit 13 for comparing the contents stored in the screen buffer memory 11 and the IO buffer memory 12 is provided.

The screen buffer memory 11 sequentially stores display data to be displayed on the display device as the processing is executed in the computer system. The IO buffer memory 12 reads and stores the standard result from the standard result file 30 according to an instruction from the comparing unit 13 after the computer 10 enters a mode in which the computer 10 performs an operation test (test mode).

The comparison section 13 is realized by a CPU and a memory such as a RAM mounted on the computer 10 and executes an operation test in a new operation environment under the control of an image display automatic comparison program. Here, the new operating environment means processing by a revised program or a related program, control by a revised operating system, a new system configuration including changed or added hardware, and the like.

The operation test includes execution of a test operation based on a program and comparison processing between the execution result and a standard result. The comparing unit 13 executes a specific process for testing based on an input key from a keyboard or a key read from an input log file, and when detecting a screen comparison code included in these keys, an IO buffer memory 12 reads the standard result stored in the standard result file 30, and compares the execution result stored in the screen buffer memory 11 with the standard result stored in the IO buffer memory 12.

The input log file 40 is stored in the computer 1
0 is operating in test mode, the keyboard 60
Is stored as an input key. After the input keys are stored in the input log file 40, an operation test is executed using the stored input keys. In this case, when it is necessary to input a key that is not stored in the input log file 40 in order to execute a new process in the operation test, the key is input from the keyboard 60. The input key is stored in the input log file 40 as an input key, and is used together with other input keys in the next and subsequent operation tests.

The comparison result storage file 50 stores the comparison result of the comparison unit 13 of the computer 10. After performing the operation test, the operator refers to the stored comparison result to obtain information as to when and what kind of error (inconsistency with the operation result in the conventional operation environment) occurred in the operation test. Can be obtained.

FIG. 1 shows only the characteristic configuration of the present embodiment, and the other configuration is omitted. Actually, the computer 10 is equipped with an arithmetic processing unit and a memory for executing various arithmetic processes according to programs, and also includes an input / output device such as a printer for printing out processing results and a mouse for inputting data. It goes without saying that they are connected.

Next, the operation of this embodiment will be described with reference to the flowchart of FIG.

As an initial stage, when nothing is stored in the input log file 40, the operation test is performed according to a key input from the keyboard 60. The comparison unit 13 of the computer 10 executes a processing operation according to a key input from the keyboard 60. The operator inputs a screen comparison code when a screen to be compared with the processing result in the conventional operating environment is displayed on the display device 20. When the screen comparison code is input, the comparing unit 13 compares the processing result to be displayed on the display device 20 with the standard result stored in the standard result file 30. All of these keys input in the operation test are sent to the input log file 40 and stored.

Next, when an operation test is performed in a state where the input keys are stored in the input log file 40, first, when the computer 10 is switched to the test mode by an operation from the keyboard 60 or the like (step 201), the comparison unit 13
Reads out necessary input keys from the input log file 40 (step 202) and executes a specific process for an operation test (step 203).

When a screen comparison code is detected from the input keys, the corresponding standard result is read from the standard result file 30 and stored in the IO buffer memory 12 (steps 204 and 205). Then, the comparison result is stored in the comparison result storage file 50 (step 206). The above operation is performed until all processing of the operation test is completed (step 207).

If necessary, a new key used for the operation test can be input from the keyboard 60 at an arbitrary timing. If a new key is input prior to the execution of the operation test and the operation test is started after storing it in the input log file 40, no operation by the operator is required during the execution of the operation test, and the new key is used. An operation test including an operation can be performed.

The above operation test is performed not by application level control but by the operation evaluation system shown in FIG. 1 constructed on the computer system. Therefore, when the operating system for controlling the computer system is changed. Also, the present invention can be used without any problem when verifying whether or not proper operation is performed when hardware is changed or added, and whether or not compatibility is checked.

Although the present invention has been described with reference to the preferred embodiments, the present invention is not necessarily limited to the above embodiments.

[0032]

As described above, according to the operation evaluation system of the present invention, the processing result to be displayed on the display device can be automatically evaluated without relying on the visual recognition of the operator. Therefore, erroneous recognition due to operator intervention can be avoided, and the accuracy of evaluation can be improved.

In addition, except for an operation test in an initial stage in which an input key is not stored in an input log file, all operations from input of a key to comparison of a processing result are automatically performed. The labor can be greatly reduced.

It is possible to confirm. As a result, the computer automatically performs the evaluation, so that the man-hour related to the evaluation can be reduced.

Further, since the key input is automatically performed and the input operation by the operator is not required, the occurrence of an erroneous operation can be avoided.

Further, according to the present invention, since the operation test is performed by the operation evaluation system built on the computer system, not only the operation test of the application but also the case where the operating system is changed or the hardware is changed or added is performed. In this case, the present invention can also be applied to the case of verifying whether or not proper operation can be performed or compatibility, and can be used in a wider range.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of an operation evaluation system according to one embodiment of the present invention.

FIG. 2 is a flowchart illustrating the operation of the present embodiment.

[Explanation of symbols]

 Reference Signs List 10 computer 11 screen buffer memory 12 IO buffer memory 13 comparison unit 20 display device 30 standard result file 40 input log file 50 comparison result storage file 60 keyboard

Claims (4)

(57) [Claims] 1. A method for testing an operation at an arbitrary timing.
Key input means for inputting an input key, input key input for an operation test being input and stored in advance , and input input by the key input means
Input key storage means for storing the key for the next and subsequent operation tests; and standard result storage means for storing a standard result which is a result of performing an operation test based on the input key in a predetermined operating environment in which the key operates normally. A new operating environment different from the predetermined operating environment from which the standard result was obtained.
A Do operating environment, at least, to perform various processing
New application software for computers
New operating system to control the operation of the system
New and changed systems that realize the system and peripheral functions
In a new operating environment including hardware, the input key case
Operation evaluation means for executing an operation test based on the input key from the storage means or the key input means, and comparing with a standard result corresponding to the operation step stored in the standard result storage means at a predetermined operation step; An operation evaluation system for a computer system, comprising: a comparison result storage unit for storing a comparison result by the operation evaluation unit. Wherein said input key storing means is inputted in advance
Alternatively, a comparison code for instructing to compare a processing result with the standard result is stored as one type of input key input from the key input unit , and the operation evaluation unit performs an operation test based on the input key. Executing the input key storing means or the key input means.
2. The computer system according to claim 1, wherein when the comparison code input from a stage is detected, the processing result of the operation test at the time when the comparison code is detected is compared with a corresponding standard result. Operation evaluation system. 3. A screen buffer memory for storing various processing results as display data in order to display and output them on a display device, and an IO buffer memory for reading and storing standard results stored in the standard result storage means. The operation evaluation system according to claim 1, wherein the operation evaluation unit compares the contents stored in the screen buffer memory with the contents stored in the IO buffer memory. 4. An operation test at an arbitrary timing.
Key input means for inputting an input key, input key input for an operation test being input and stored in advance , and input input by the key input means
Input key storage means for storing the key for the next and subsequent operation tests, and standard result storage means for storing a standard result which is a result of performing an operation test based on the input key in a predetermined operating environment that normally operates. A screen buffer memory for storing various processing results as display data for display and output on a display device; an IO buffer memory for reading and storing standard results stored in the standard result storage means; different new and acquired predetermined operating environment
A Do operating environment, at least, to perform various processing
New application software for computers
New operating system to control the operation of the system
New and changed systems that realize the system and peripheral functions
In a new operating environment including hardware, the input key case
An operation test is executed based on the input key from the storage unit or the key input unit, and the storage contents of the screen buffer memory and the storage contents of the IO buffer memory storing the corresponding standard result at a predetermined operation stage. An operation evaluation system for a computer system, comprising: an operation evaluation unit that compares the operation results; and a comparison result storage unit that stores a comparison result obtained by the operation evaluation unit.