JPH05265794A - Automatic discrimination processing system for test result - Google Patents

Abstract

PURPOSE:To provide the automatic discrimination processing system for test result which acquires contents to be compared and collated from an item by information of the relative position and the length of the item and compares acquired contents with each other to automatically discriminate the validity. CONSTITUTION:An interactive input device 1, a keyword table generating part 2, a keyword table file 3, a keyword table 4, and a comparing and collating part 5 are provided. In this constitution, execution results to be compared exist in 1st and 2nd execution result files 8 and 9. When the validity of test results will be discriminated, an item corresponding to a preliminarily defined keyword is extracted, and contents to be compared and collated are acquired from this item by information of the relative position from the keyword and the length of the item, and acquired contents are compared with each other to discriminate the validity. Thus, records different by output forms are automatically compared with each other.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a test result automatic judgment processing system, and more particularly to a processing system for automatically judging the validity of a test result of a program under test in a data processing system.

[0002]

2. Description of the Related Art When there are a plurality of programs under test in which the output results for input data of the same content have the same format and content, each output result is determined as a method of judging whether the test result is valid or not. There is a method of reading one record at a time, comparing and collating the corresponding records one by one, and if all the records match, it is judged as valid.

However, since this method is premised on that the output format is the same, when the output format is changed in one of the programs under test, the item positions to be compared and collated in the record are made one-to-one. Since it does not correspond, automatic comparison and collation becomes impossible, and human beings have no choice but to visually check the output list of execution results.

On the other hand, as can be seen from the example of the test result automatic judgment processing method described in JP-A-60-69753, a record which is always output as a correct answer file.
Even if the order of the records is changed by retaining the records and the records output arbitrarily as separate master files and common master files and comparing the records of the test program execution results. There is a method of automatically performing comparison and collation.

[0005]

However, JP-A-60-
In the conventional automatic judgment processing method disclosed in No. 69753, when the position of the comparison and collation item within a record and between records is changed, that is, when the output format is changed, the correct answer file is recorded. The position and length of each data item to be compared are calculated because the correspondence with the
There was a problem that items had to be compared and collated manually.

An object of the present invention is to provide a test result automatic judgment processing method capable of automatically judging the correctness even when the output format of the test result is changed.

[0007]

In order to achieve the above object, the present invention provides a keyword for identifying the record of an item having a different output format, and a relative position from the keyword. And item length information are defined in advance in the keyword table, and when the validity of the test result is determined, the item corresponding to the keyword is extracted based on the keyword. After that, the contents to be compared and collated among these items are acquired from the information on the relative position and the length of the item, and the validity is determined by comparing the acquired contents.

[0008]

According to the above means, when the validity of the test result is judged, the key word is defined based on the previously defined key word.
After extracting the item corresponding to the item, acquire the contents to be compared and collated from this item by the information of the relative position from the keyword and the length of the item, and compare the acquired contents with each other. Since the correctness is determined by, the records having different output formats can be automatically compared with each other.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be specifically described below with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of the present invention, FIG. 2 is a block diagram of a keyword table which defines the existence positions of data items to be compared and collated used in the embodiment, and FIG. 3 is a comparison collation. It is a block diagram of the comparison data table which stores the data item which performs.

In FIG. 1, 1 is an interactive input device, 2 is a keyword table creating unit, 3 is a keyword table file, 4 is a keyword table, 5 is a comparing and collating unit, 6 is a first tested program, and 7 is a second. Program under test, 8 is a first execution result file storing the execution result of the first test program, 9 is a second execution result file storing the execution result of the second test program,
10 is a record buffer, 11 is a comparison data table,
Reference numeral 12 represents a comparison result list.

In this configuration, the execution result to be compared exists in the first execution result file 8 and the second execution result file 9. These files 8 and 9 store records in which data items having different formats but having the same contents are present.

FIG. 4 shows the item attribute lists 80 and 90 as an example of the data items having the same contents although the output formats are different, and the output item name "CONS" of these lists 80 is shown.
1 ”includes REGULAR, NORM, NOREV, N
There is data having an item attribute of OBLINK, and the output item name "CONS1" of the list 90 has REGU.
There is data having item attributes of LAR, NOREV, GREEN, and NOBLINK, and the data structure is common except for "GREEN". However, in list 80, REGULAR, NORM, NOREV, N
The output is made in the order of OBLINK, whereas in the list 90, REGULAR and NORE are output.
The output is performed in the order of V, GREEN, and NOBLINK, and the output format (in this case, the output order) is different.

On the other hand, in the interactive input device 1, a keyword 40 for identifying a data item to be compared and a data item.
Information 41 on the length of the data item and information 4 indicating the relative position from the keyword in each of the first and second execution results.
2, 43 are input prior to the validity determination process.

The input information is edited by the keyword creating unit 2 into a keyword table 4 as shown in FIG. 2 and stored as a keyword table file 3. Here, the keyword 40 is only required to identify the data item to be compared, and in FIG.
The output item "CONS" of the lists 80 and 90 in FIG.
Attribute information of "1" is set as the keyword 40, and REG is set.
An example of comparing data such as ULAR, NOREV, and NOBLINK is shown. The information 42 and 43 indicating the relative position from the keyword 40 are shown as "position 1" for the first execution result and "position 2" for the second execution result.

When the above conditions are met, the first program under test 6 and the second program under test 7 are executed, and the output results thereof are stored in the execution result file 8 and the execution result file 9, respectively. In this case, the contents of both files 8 and 9 are the same, but the record formats are different.

The comparison and collation unit 5 first reads the contents of the keyword table file 3 into the main storage device as the keyword table 4 (step 49).

The keyword table 4 is composed of four information elements as shown in FIG.

Next, the two execution result files 8 and 9 are set to 1
Each record is read into the record buffer 10 (step 50). Thereafter, the record buffer 10 is searched using the keyword 40 in the keyword table 4 as a search word (step 51).

If a matching keyword is found as a result of this search (step 52), the data item to be compared is recorded based on the information of "position 1" 42 and "position 2" 43 in the keyword table 4. The data is sequentially extracted from the buffer 10 and stored in the comparison data table 11 (step 53).

In the comparison data table 11, as shown in FIG. 3, a keyword 40, information 41 on the length of a data item to be compared, and position information 4 on the keyword table 4 are shown.
Comparison data item 11 of each execution result obtained from 2, 43
The contents 2 and 113 (REGULAR in the illustrated example) are sequentially stored in correspondence with the execution result file 8 and the execution result file 9.

After the storage, the keyword search is repeated until EOF (file end code) is read from the execution result files 8 and 9.

When the EOF is read, the contents of the comparison data items 112 and 113 are sequentially read from the comparison data table 11 and compared (step 54).

This comparison is performed for "comparison data 1" and "comparison data 2" on a keyword basis, and the information of match / mismatch is output to the comparison result list 12 (step 55).

By this, even data having different output formats can be automatically compared.

In the above description, an example in which the output order is different as the output format is shown, but the present invention is not limited to this, and the difference in the output format that does not affect the contents such as the output position. The present invention can be applied to comparison and collation of data.

[0027]

As described above, according to the present invention, for items having different output formats, the keyword for identifying the record of the item, the relative position from the keyword, and the item length. Information is previously defined in the keyword table, and when judging the validity of the test result, after extracting the item corresponding to the keyword based on the keyword, Even if the output format of the test result is different, the contents to be compared and collated are acquired from the information of the relative position and the length of the item, and the validity is judged by comparing the acquired contents with each other. The validity can be automatically determined, and the efficiency of the validity determination work can be improved.

[Brief description of drawings]

FIG. 1 is a configuration diagram showing an embodiment of the present invention.

FIG. 2 is a configuration diagram showing an example of a keyword table.

FIG. 3 is a configuration diagram showing an example of a comparison data table.

FIG. 4 is an explanatory diagram showing an example of data having different output formats.

[Explanation of symbols]

1 ... Dialogue input device, 2 ... Keyword table creation unit, 3
... keyword table file, 4 ... keyword table, 5 ... comparison and collation unit, 6 ... first tested program,
7 ... Second test program, 8 ... First test program execution result file, 9 ... Second test program execution result file, 10 ... Record buffer,
11 ... Comparison data table, 12 ... Comparison result list.

 ─────────────────────────────────────────────────── ─── Continuation of front page (72) Inventor Takeshi Sano 6-81 Onoue-cho, Naka-ku, Yokohama-shi, Kanagawa Hitachi Software Engineering Co., Ltd. In-house

Claims (1)

[Claims] 1. An automatic determination processing method of test results, which automatically determines the correctness of each item of the test results of a plurality of programs under test having different output formats and the same output content, and items having different output formats. , The keyword for identifying the record of the item and the information of the relative position from the keyword and the item length are defined in advance in the keyword table, and the validity of the test result is judged. When
After extracting the item corresponding to the keyword based on the keyword, the contents to be compared and collated among the items are acquired by the information of the relative position and the item length, and this acquisition An automatic determination processing method for test results, which is characterized by determining the validity by comparing the obtained contents.