JPH0566957A - Test system for information processor - Google Patents

Abstract

PURPOSE:To accurately and effectively detect the error that is produced by one of plural tested information processors and affects other processors. CONSTITUTION:The random test program groups 30 are carried out and compared with each other and the number' of error detecting instructions are detected. Then the instruction shown by the error detecting instruction number of the test procedure where no error is detected by a communication receiving instruction pointing means 26 is replaced with a communication instruction which is given to a tested information processor 2 where an error is detected. Then a test procedure group is carried out again and the communication interruption generating order number is pointed. A composite error generating instruction pointing means 27 increases successively the instruction number to the communication interruption generating instruction number for the test procedure that detected an error and then repeats the execution and the comparison of the test procedure groups to point the errors.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a test method for an information processing device, and more particularly to a test method using randomly generated test data and test procedure.

[0002]

2. Description of the Related Art Conventionally, in a test method of this type of information processing apparatus, a random test program consisting of test data randomly generated using random numbers and a test procedure is used to enable advance control of the information processing apparatus under test. Compare the result executed in the state with the result executed in the state in which the preceding control is disabled,
If they do not match, a test method was adopted in which the cause analysis was performed based on both execution results.

When a comparison error is detected after the random test program is executed, the number of instructions is sequentially increased from the instruction start address of the random test program, and the execution and comparison are repeated until the comparison error is detected again. The test method was adopted when pointing out the order.

Furthermore, the information processing apparatus test method of this type employs a continuous test method in which these test methods are repeatedly executed.

[0005]

In the above-described conventional information processing apparatus testing method, when a plurality of information processing apparatuses under test simultaneously execute respective random test programs and detect a comparison error, the same instruction number is sequentially increased. However, although the instruction causing the error is pointed out, the execution time of the different random test programs is different in all the information processing devices under test, and one information processing device under test is the other information processing device under test. In the case of an error that affects the information processing device under test, the information processing device under test affects the information processing device under test even if there is an instruction causing the error in the other information processing device under test. There is a drawback in that the error is not pointed out until the instruction appears, and the instruction causing the error cannot be pointed out in the other information processing device under test.

[0006]

According to a test method of an information processing apparatus of the present invention, a random test program generating means and a plurality of test procedures generated by the random test program generating means are used to generate an arbitrary instruction from an arbitrary instruction start address. A number of test instruction executing means for executing simultaneously, an execution result determining means for determining an execution result of the random test program, and a plurality of test procedures from an arbitrary instruction start address when an error is detected by the execution result determining means. Test instruction re-execution means for simultaneously executing only an arbitrary number of instructions, error detection instruction indication means for pointing out an error instruction, and the number of instructions indicated by the error detection instruction indication means in an error-free information processing device The instruction is replaced with the communication instruction to the information processing device in which the error has occurred, and the instruction is executed. A communication receiving command pointing means for pointing out a command to receive a notification from a raw information device, and an instruction replaced by a communication command in the communication receiving command pointing means in the error occurrence information processing device is restored and executed, and The execution result determining means determines whether or not there is an error, and based on the determination result, it has a composite error occurrence instruction pointing out means for operating the number of execution instructions in the information processing device causing the error and pointing out the error.

[0007]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of the present invention. In FIG. 1, the main storage device 1 has an operating system 10 and a random test program generating means 21.
A random test task 20 having a test instruction execution means 22, an execution result determination means 23, a test instruction re-execution means 24, an error detection instruction pointing means 25, a communication reception instruction pointing means 26 and a composite error occurrence instruction pointing means 27, A random test program group 30 including a random test procedure group and a random test data group generated by the random test task 20 is stored, and the main memory 1 is connected to the information processing device group 2 under test. ..

FIG. 2 shows the random test task 2 shown in FIG.
It is a figure which shows the content of one of the random test procedure groups in the random test program group 30 which 0 produced | generated, and has shown that it consists of 100 instructions produced | generated using the random number, and the test procedure completion notification instruction. ..

FIG. 3 is a flow chart showing the processing of the random test task 20 of FIG.

FIG. 4 is a flow chart showing the processing of the error detection command indication 105 of FIG.

FIG. 5 shows the communication reception command indication 106 of FIG.
6 is a flowchart showing the processing of FIG.

FIG. 6 shows the number 30 of communication receiving commands in FIG.
9 is a flowchart showing the processing of No. 9.

FIG. 7 shows the composite error generation instruction indication 10 of FIG.
7 is a flowchart showing the processing of No. 7.

FIG. 8 is a flow chart showing a process of pointing out the minimum instruction number 207 of the composite error occurrence in FIG.

FIG. 9 is a flow chart showing the processing of the maximum instruction number indication 508 in FIG.

FIG. 10 is a diagram showing the structure of an error flag which stores whether or not an error has occurred in each information processing device under test.

FIG. 11 is a diagram showing the configuration of exception information in which exception occurrence addresses are stored in accordance with the types of exceptions that occur during the execution of random tests in each information processing device under test.

First, in FIG. 1, the operating system 10 loads the random test task 20 into the main memory 1.
To start the random test task 20. The started random test task 20 performs the processing shown in FIG. That is, in process 100, the random test procedure shown in FIG. 2 is generated by the number of information processing devices under test forming the information processing device group 2 under test, and in process 101, random test data used by each random test procedure is generated as a random number. The random test procedures are generated at the same time, and the random test procedures are simultaneously executed in a state in which the advance control of the information processing device under test 2 is enabled in process 102, and the execution results are saved in the main storage device 1. That is, from the first instruction to the tenth instruction of each random test procedure.
The random test task 20 which has simultaneously executed the 0 instruction and the test procedure end notification instruction simultaneously and has been notified of the end of execution of each random test procedure by the test procedure end notification instruction,
Contents of the software visible register of each device under test at the time of receiving the end notification and the contents of the memory accessed by each random test procedure, and the exception occurrence information shown in FIG. Save in the area.

Next, in the process 103, the random test procedure is simultaneously executed with the preceding control of the information processing device group 2 under test disabled, and the execution result is saved in the work area of the main memory 1. Here, the process 103 is the same as the process 102 except that the preceding control is invalidated by generating an interrupt to the random test task 20 for each simultaneous execution of each instruction of each random test procedure. Perform similar processing.

Subsequently, in the processing 102 and the processing 103, the execution result saved in the work area on the main memory 1 is processed 1
The comparison is made in 04, and if they match each other, the process 109
Then, the end request from the operating system 10 is checked, and if there is no end request, the process returns to step 100 to continue the test, and if there is an end request, the process ends.

On the other hand, if the execution results saved in the work area on the main storage device 1 do not match between process 102 and process 103, the process proceeds to process 105, the instruction in which the comparison error occurs is searched, and the error location and error Point out the number of random test procedure instructions that occurred.

Further, in the process 106, the number of instructions of the random test procedure in which the error pointed out in the process 105 out of the random test procedure of the information processing device under test having no error part in the information processing device group under test 2 ( The instruction indicated by (the number of error occurrence instructions) will be replaced with the communication instruction to the information processing device under test having the error portion, the information processing device group 2 under test will be re-executed in each random test procedure, and In a certain information processing device under test, the number of commands in the random test procedure (hereinafter, referred to as the number of received commands for communication) when the communication from the information processing device under test having no error point is received is pointed out, and in step 107, the information processing under test is performed. In the information processing device under test having no error part in the device group 2,
The random test procedure is always executed from the beginning until the number of error occurrence instructions pointed out in step 105 is indicated, and in the information processing device under test having the error portion, first, the random test procedure from the top instruction to the communication reception pointed out in step 106 is received. Execute up to the number of instructions, increase or decrease the number of instructions in the random test procedure by error judgment, repeat the execution, and point out the error location.

Next, in step 108, the error location is output as an error message via the operating system 10, and in step 109 the operating system 10 is output.
The termination request from the server, and if there is no termination request, process 10
The test is returned to 0 and the test is continued, and if there is a termination request, the test is terminated.

Next, the error detection command indication processing executed in the processing 105 of FIG. 3 will be described in detail with reference to FIGS. 4 and 10.

First, in process 200, the number of re-executed instructions is initialized to 1. Next, in process 201, after the command next to the command instructed by the number of re-execution commands is replaced with the test end notification command in each random test procedure for the information processing device group under test 2, the same as process 102 in FIG. Further, each random test procedure is executed in a state in which the preceding control of the information processing device group under test 2 is enabled, the execution result is saved in the work area on the main storage device 1, and the information processing device under test is processed in step 202. After replacing the instruction next to the instruction instructed by the number of re-execution instructions with the test notification instruction in each random test procedure for the group 2, the preceding control of the information processing device group 2 under test is performed, as in the process 103 in FIG. Each random test procedure is executed in a state in which is disabled, and the execution result is saved in the work area on the main storage device 1.

Subsequently, the execution results saved in the work area on the main storage device 1 in the processing 201 and the processing 02 are compared in the processing 203 for each information processing device under test. The FF indicating execution result non-coincidence is set in the corresponding position of the information processing device under test whose non-coincidence of the error flags shown in (3) is set, and the process is terminated.

On the other hand, if the execution results saved in the work area on the main memory 1 in process 201 and process 202 match, the process proceeds to process 105, the value obtained by adding 1 to the number of re-execution instructions is set, and the process proceeds to process 206. , It is determined whether the number of re-execution instructions exceeds 100 in the random test procedure. If the number of re-execution instructions exceeds 100 in the random test procedure, the process is terminated and re-executed. If the number of instructions does not exceed the total number 100 of instructions in the random test procedure, the process returns to step 201.

Next, the communication receiving command pointing process performed in the process 106 of FIG. 3 will be described in detail with reference to FIG.

First, in process 300, the number of error detection commands is set to the number of re-execution commands determined in process 105 as an initial value. Next, in process 301, the number of devices constituting the information processing device group under test 2 is set to the number N of constituent devices. Then, in process 302, the information processing device number under test M is initialized to 0. Further, in process 303, it is determined whether or not M matches the value of N−1. If they do not match, the process proceeds to process 304, and the content of the error flag of the information processing device under test indicated by M is extracted and extracted. If the content is 00, in the random test procedure of the information processing device under test indicated by M, the command indicated by the error detection command number is rewritten to the communication command to all the information processing devices under test whose error flag is FF, and the error The next instruction indicated by the number of detected instructions is rewritten to the test end notification instruction, M is incremented by 1 in step 307, and the process returns to step 303.

On the other hand, if the content of the error flag of the information processing device under test indicated by M in process 304 is FF, process 30
In the random test procedure of the information processing device under test indicated by M in FIG. 6, the next instruction indicated by the number of error detection instructions is rewritten to a test end notification instruction, and the instruction counter of the first instruction is saved in the work area on the main storage device 1. Then, the process proceeds to process 307. If M matches the value of N−1 in process 303, process 30
8, the information processing device group under test 2 is processed similarly to the process 201.
The respective random test procedures are simultaneously executed in a state where the preceding control is enabled, and the execution result is saved in the work area on the main storage device 1.

Then, in process 309, the error flag is set to FF.
Then, the number of communication receiving instructions is determined from the execution results of all the information processing devices under test, and the process is terminated.

Next, referring to FIGS. 6 and 11, the process 3 of FIG.
09 will be described in more detail.

First, in process 400, the number of devices constituting the information processing device group 2 to be tested is set to the number N of constituent devices, the information processing device number M to be tested is initialized to 0, and the number of rewriting commands is initialized to 101. To do. Further, in process 401, M is N-
It is determined whether or not the value matches the value of 1, and if they match, the processing ends.

On the other hand, if M does not match the value of N-1 in process 401, the process proceeds to process 402, and it is determined whether or not the content of the error flag of the information processing device under test indicated by M matches 00. If they do not match, the process proceeds to step 407, and if they match, the process proceeds to step 403, and the instruction counter having the smallest communication interrupt information among the exception information shown in FIG. To extract.

Subsequently, in step 404, the processing is repeated until the instruction counter indicating the first instruction of the random test procedure of the information processing device under test indicated by M stored in the work area on the main storage device 1 in step 307 matches. The number of instructions at that time is set as the number of interrupt instructions. Further, process 4
In 05, it is determined whether or not the condition of the number of rewriting instructions <the number of interrupt instructions is satisfied. If the condition is not satisfied in process 405, the process proceeds to process 407.

Next, the composite error occurrence instruction pointing out process executed in the process 107 of FIG. 3 will be described in detail with reference to FIG.

First, in process 500, the number of devices forming the information processing device group 2 under test is set to the number N of constituent devices, and the information processing device number M under test is initialized to 0. Subsequently, in process 501, it is determined whether M matches the value of N−1. If they do not match, in process 502, the error flag is 00 in the random test procedure of the information processing device under test indicated by M. In this case, the instruction indicated by the error detection instruction number is written back to the instruction before being rewritten in the process 304, and the next instruction indicated by the error detection instruction number is rewritten to the test end notification instruction. When the error flag is FF, the rewriting instruction is executed. The command indicated by the number is rewritten to the test end notification command. Then, the process 50
In step 3, M is incremented by 1, and the process returns to step 501.

On the other hand, when M is equal to the value of N-1 in the process 501, the process proceeds to the process 504, and similarly to the process 201, the random control is performed with the preceding control of the information processing device group 2 under test enabled. The test procedure is executed simultaneously, and the execution result is saved in the work area on the main memory phase device 1. Then, in process 505, similarly to process 202, the random test procedures are simultaneously executed in a state in which the preceding control of the information processing device group under test 2 is disabled, and the execution result is stored in the work area on the main storage device 1. Save.

Next, in process 506, as in process 104,
The execution results saved in the work area on the main memory 1 are compared in processing 504 and processing 505, and if they match, the processing proceeds to processing 507, and the random test procedures are simultaneously executed until a comparison error is detected. Repeat the comparison,
In process 509, the number of rewrite commands determined in process 507 is pointed out as the composite error occurrence count, and the process ends.

On the other hand, in process 506, process 504 and process 50
When the execution results saved in the work area on the main storage device 1 are compared with 5 and the two do not match, each random test procedure is simultaneously executed and the comparison is repeated until no comparison error is detected in the process 508, In process 510, the value obtained by adding 1 to the number of rewrite commands determined in process 508 is pointed out as the number of composite error occurrence commands, and the process is terminated.

Next, the composite error occurrence minimum instruction number indication processing of the processing 507 shown in FIG. 7 will be described in detail with reference to FIG.

First, in process 600, the number of rewriting instructions is incremented by 1, the number of devices forming the information processing device group 2 under test is set to the number N of constituent devices, and the information processing number under test M is 0.
Initialize to. Subsequently, in process 601, it is determined whether M matches the value of N−1. If they do not match, process 60 is performed.
Then, the process proceeds to step 2, and it is determined whether the content of the error flag of the information processing device under test indicated by M matches 00. If they do not match, the process proceeds to step 603, where the random number of the information processing device under test indicated by M is random. In the test procedure, the command indicated by the number of rewriting commands is rewritten into the spread fishing notification command, and in step 605 M
Is incremented by 1 and the process returns to step 601.

On the other hand, when the content of the error flag of the information processing device under test indicated by M in processing 602 matches 00,
In process 604, the next command indicated by the number of error detection commands is rewritten to the test end notification command and the process proceeds to process 605.

If M matches the value of N-1 in process 601, each random test is performed in process 606 in the same manner as in process 504 with the preceding control of the information processing device group 2 under test enabled. The procedures are executed simultaneously, and the execution results are saved in the work area on the main storage device 1. Next, processing 607
In the same manner as the processing 505, the random test procedures are simultaneously executed in a state in which the information processing device group under test 2 advance control is disabled, and the execution result is saved in the work area on the main storage device 1. Next, in process 607, like the process 505, the random test procedures are simultaneously executed in a state in which the preceding control of the information processing device group under test 2 is disabled, and the execution result is saved in the work area on the main storage device 1. To do. Subsequently, process 60
In step 8, as in step 506, the execution results saved in the work area on the main storage device 1 are compared in steps 606 and 607. If they match, the process returns to step 600, and if they do not match, the process is executed. finish.

Next, the process for pointing out the maximum number of instructions in which the composite error has not occurred in the process 508 shown in FIG. 7 will be described in detail with reference to FIG.

First, in the process 700, the number of rewriting instructions is subtracted by 1, the number of devices forming the information processing device group 2 under test is set to the number N of constituent devices, and the information processing device number under test M is initialized to 0. .. Next, in process 701, it is determined whether M matches the value of N−1. If they do not match, the process proceeds to process 702, and the content of the error flag of the information processing device under test indicated by M matches 00. If it does not match, the process proceeds to step 703. In the random test procedure of the information processing device under test indicated by M, the instruction indicated by the number of rewrite instructions is rewritten to the test end notification instruction, and in step 705 M is set to 1 Addition is performed and the process returns to step 701.

On the other hand, if the content of the error flag of the information processing device under test indicated by M in processing 702 matches 00,
In process 704, the next command indicated by the number of error detection commands is rewritten to the test end notification command and the process proceeds to process 705.

If M matches the value of N-1 in the process 701, in the same manner as the process 606 in the process 706, each random test is performed with the advanced control of the information processing device group 2 under test enabled. The target results are executed simultaneously, and the execution results are saved in the work area on the main memory.

Next, In process 707, similarly to process 607, the random test procedures are simultaneously executed in a state in which the preceding control of the information processing device group under test 2 is disabled, and the execution result is saved in the work area on the main storage device 1.

Next, in process 708, as in process 608,
The execution results saved in the work area on the main storage device 1 are compared in processing 706 and processing 707. If they do not match, the processing returns to processing 700, and if they match, the processing ends.

[0052]

As described above, according to the present invention, in a plurality of information processing devices to be tested, a command for detecting a comparison error is pointed out by the conventional technique after a plurality of random test procedures are executed. An information processing device under test that issues a communication to the test information processing device and outputs a communication from the information processing device under test and receives a communication by the information processing device under test with an error Is the number of orders pointed out in the prior art, and the information processing device under test in which the error occurs is the device under test in which the error occurs in accordance with the execution result of the commands received at the same time. By operating the number of instructions to be executed sequentially, the information processing device under test that does not generate an error affects the information processing device under test that generates the error. In that error, it is possible to point out exactly the error cause instruction, an effect of improving the error analysis efficiency.

[Brief description of drawings]

FIG. 1 is a configuration diagram showing an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a random test procedure in this example.

3 is a flow chart showing the processing of the random test task 20 of FIG.

FIG. 4 is a flowchart showing a process of an error detection command indication 105 in FIG.

5 is a flow chart showing a process of a communication reception instruction indication 106 of FIG.

6 is a flowchart showing the processing of the communication reception instruction number indication 309 of FIG.

7 is a flowchart showing the processing of a composite error occurrence instruction indication 107 of FIG.

FIG. 8 is a flowchart showing the processing of a compound error occurrence minimum instruction number indication 507 of FIG.

FIG. 9 shows the maximum number of instructions 508 in which a composite error has not occurred in FIG.
6 is a flowchart showing the processing of FIG.

FIG. 10 is a diagram showing a configuration of an error flag in the present embodiment.

FIG. 11 is a diagram showing a configuration of exception information in the present embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Main storage device 2 Information processing device group under test 10 Operating system 20 Random test task 21 Random test program generation means 22 Test instruction execution means 23 Execution result judgment means 24 Test instruction re-execution means 25 Error detection instruction indication means 26 Communication reception instruction Pointing means 27 Compound error generation instruction pointing means 30 Random test program group

Claims (1)

[Claims] 1. A random test program generating means and this random generating means in a test system for generating and executing a random test program for testing a plurality of information processing devices connected to a main memory device in the main memory device. The test instruction execution means for simultaneously executing the plurality of test procedures generated in 1. from an arbitrary instruction start address for an arbitrary number of instructions at the same time, an execution result determination means for determining the random test program execution result, and an error in this execution result determination means Test instruction re-execution means for simultaneously executing the plurality of test procedures from an arbitrary instruction start address for an arbitrary number of instructions, an error detection instruction indication means for indicating an error instruction, and an error-free instruction In the information processing device, a command for notifying the information processing device of the error occurrence of the number of commands pointed out by the error detection command pointing means And a communication receiving command pointing means for pointing out a command for receiving communication from the information processing device in which the error has not occurred, and the communication receiving command in the information processing device in which the error has occurred. The instruction replaced by the communication instruction by the pointing means is restored and executed, the presence / absence of the error is determined by the execution result determination means, and the number of execution instructions in the information processing device having the error is operated based on the determination result. A method of testing an information processing apparatus, comprising: a composite error generation instruction indicating means for indicating an error.