KR20010027916A - Method for testing chill programs using test scenario - Google Patents

Abstract

PURPOSE: A method for testing a chill program using a scenario is provided to automatically repeat and test a parallel chill program by generating and repeating a procedure for testing on line using a parallel chill debugger as a history file, and by converting the procedure into a test scenario. CONSTITUTION: IF a user operates a parallel chill debugging system, the system inputs a test scenario list and the number of repeated test(310, 321). The system comprises a chill process control command list(323). An execution chill file is executed(324). The system makes the chill process control command executed one by one(326). If a result of execution equals to a condition precedent, a pass item is increased(329). If the result doesn't equal to the condition, a fail item is increased(328). A test command execution is repeatedly performed till a test command list is null(325 or 329). If a test on one test scenario is completed(325), next test scenario is read. An execution result is outputted using each execution scenario result table(330).

Description

METHOD FOR TESTING CHILL PROGRAMS USING TEST SCENARIO}

The present invention relates to a method of testing a chill program for effectively testing a plurality of CHILL programs executed on a general-purpose computer system, and to a computer readable recording medium having recorded thereon a program for realizing the method. And the non-deterministic realization of the seven program test method and the above method in which a test scenario is generated using an existing test procedure and automatically tested using the existing test procedure in testing a parallel CHILL program having various execution scenario spaces. The present invention relates to a computer-readable recording medium having recorded thereon a program.

In general, when testing a parallel program, it is not commonly used to test iteratively using a commercial debugger because of the amorphousness and the parallelism of the program.

Therefore, conventionally, a method of recording an execution sequence of a parallel program by modifying an operating system or a runtime library for executing a program, using the method of re-execution, or a method of detecting an error by performing static analysis without executing the program. Used.

In the former case, in order to test the parallel program, the type and sequence of events causing concurrency and non-determination in the program executed while executing the parallel program were recorded and used as a means of re-execution. This method has an inefficient problem because the operating system or runtime support system must be extended to record the execution of the program.

In the latter case, the program was analyzed at compile time to construct a program association graph, and then used to check whether the deadlock exists in the program and whether data contention or access order contention occurs due to concurrency. In this method, only a part of errors occurring in the parallel program can be corrected, but there is a problem in that the overall error occurring at execution time cannot be detected.

In order to solve the above problems, the present invention provides a computer program recording method for testing a parallel chiller program using a test scenario in order to increase test efficiency on a computer system, and a computer for recording the program for realizing the method. The purpose is to provide a readable recording medium.

In addition, the present invention, by using the CHILL debugger to convert the test procedure generated as a test file generated by the test results generated online and the results of repeated tests into a test scenario, using the parallel paint program It is an object of the present invention to provide a seven-program test method for automatically repeating a test and a computer-readable recording medium recording a program for realizing the method.

1 is an exemplary configuration diagram of hardware to which the present invention is applied.

Figure 2 is an embodiment flow diagram for a parallel chill (CHILL) program test method using a scenario according to the present invention.

Figure 3 is an embodiment detailed flow chart for a parallel fill program test method using a scenario according to the present invention.

* Explanation of symbols for the main parts of the drawings

101: central processing unit 102: main memory

103: auxiliary memory 104: input and output device

105: system bus

In the method of the present invention for achieving the above object, in the chill program test method applied to the chill program test apparatus for testing the parallel chill program, the test procedure is executed in the execution scenario file while executing each CHILL program. A first step of recording to generate a plurality of execution scenarios; A second step of recognizing the generated plurality of execution scenarios and converting the generated plurality of test scenarios into a plurality of test scenarios so as to reproduce the recorded test procedure; And a third step of checking an error of the program while re-executing the CHILL program using each of the converted test scenarios.

In addition, another method of the present invention is a seven program test method applied to a seven program test apparatus for testing a parallel seven program, comprising: a first step of receiving a list of test scenarios and the number of repetitive tests; Read one of the above test scenarios to construct a list of CHILL process control commands to control the execution of the parallel CHILL program under test, set a breakpoint at the beginning of the CHILL file, and then run the CHILL. A second step of executing the file; If all the CHILL process control commands are executed one by one and the result of executing the command matches the preceding condition, the pass item is increased by one in the test scenario result table. fail) a third step of increasing the item; And a fourth step of outputting an execution result using each execution scenario result table after repeatedly performing the second step with respect to all the test scenarios.

On the other hand, the present invention provides a computer program comprising: a first function of generating a plurality of execution scenarios by recording a test procedure in an execution scenario file while executing each parallel CHILL program; A second function of recognizing the generated plurality of execution scenarios and converting the generated plurality of test scenarios into a plurality of test scenarios for reproducing according to the recorded test procedure; And a computer-readable recording medium having recorded thereon a program for realizing a third function of checking an error of a program while re-executing a parallel CHILL program using each of the converted test scenarios.

The present invention also provides a computer with a first function of receiving a test scenario list and a repetition test frequency; Read one of the above test scenarios to construct a list of CHILL process control commands to control the execution of the parallel CHILL program under test, set a breakpoint at the beginning of the CHILL file, and then run the CHILL. A second function to execute the file; If all the CHILL process control commands are executed one by one and the result of executing the command matches the preceding condition, the pass item is increased by one in the test scenario result table. fail) a third function of incrementing one item; And a computer readable recording medium having recorded thereon a program for realizing a fourth function of outputting execution results using each execution scenario result table after repeatedly performing the second function with respect to all the test scenarios. .

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary configuration diagram of a hardware to which the present invention is applied, in which a central processing unit 101, a main memory 102, an auxiliary memory device 103, and an input / output device 104 are connected to each other by a system bus 105. It is a system with a general operating system on a general purpose computer.

The parallel CHILL execution blocks are mounted in the main memory 102 of the computer system, executed in the central processing unit 101, output and error messages are inputted and outputted through the input / output device 104, and messages exchanged between the devices. Is done via the system bus 105. The universal operating system (UNIX) controls programs and devices.

The auxiliary memory 103 stores the output from the user execution block and the shared library block, and stores files and tools not mounted in the main memory 102.

Next, looking at the features of the present invention, the present invention records the execution scenarios when testing online the parallel CHILL executable file running on a computer system using a general-purpose operating system and connected via Ethernet, and records the recorded execution scenarios. After converting to a test scenario, the parallel CHILL program is repeatedly tested using the collected test scenarios and the result is output. This method is described in detail with reference to FIG. 2 as follows.

2 is a flow chart of an embodiment of a parallel chill (CHILL) program test method using a scenario according to the present invention.

First, a user drives a parallel chiller program debugger (201), executes a parallel chiller program using the same, and performs debugging (202). At this time, a series of debugging procedures performed by the user using the debugger is recorded in one execution scenario file (203). In the process 201, 202, 203, one execution scenario for the parallel CHILL program is generated. Repeating the above process generates an execution scenario as many times as the repeated number.

The execution scenario generated in this manner is converted into a test scenario so that the parallel CHILL debugger recognizes and reproduces the recorded debugging procedure (204).

All parallel CHILL program test scenarios are executed to execute the CHILL program, and the test results for the test results recorded in each test scenario are collected and the test results for the total test scenario are output. 206).

This method provides a method for automatically testing a CHILL program using test scenarios in which execution scenario space varies due to concurrency and indetermination. In addition, these methods can automatically test all previously performed test procedures using previously collected test scenarios, enabling efficient testing of large CHILL programs.

FIG. 3 is a detailed flowchart illustrating an exemplary parallel fill program test method using a scenario according to the present invention, and illustrates a method of automatically testing a parallel chill program using a collected test scenario.

First, when the user runs the parallel CHILL debugging system, the debugging system receives a list of test scenarios and the number of repeated tests (310 and 321). The running debugging system reads one scenario to construct a list of CHILL process control commands to control the execution of the parallel CHILL program under test (323), and sets a breakpoint at the beginning of the CHILL file. After that, the executable CHILL file is executed (324). The CHILL executable file that started execution stops at the program start point. At this time, the debugging system executes the written CHILL process control command 323 one by one (326). If the result of executing the command matches the preceding condition, the pass item is increased by one in the test scenario result table (329), and if it does not match, the fail item is increased by one in the test scenario result table (328). Commands include a command to execute a statement and a command to compare an execution result with a precondition. These two commands can be used to compare the results of the current command with the desired result. Test command execution is repeated until the test command list is null (325 to 329). When the test for one test scenario is finished (325), the following test scenarios are read and the processes 323 to 329 are repeated. After the repeated test process is performed for all test scenarios (322), the execution result is output using the execution scenario result table for each operation (330).

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes can be made in the art without departing from the technical spirit of the present invention. It will be apparent to those of ordinary knowledge.

As described above, the present invention can test various execution spaces of a parallel chill (CHILL) program using a test scenario.

In addition, the present invention automatically converts the collected execution scenarios into test scenarios and tests using them, so that the richer the collected test scenarios, the more fully the test subject program can be tested.

In addition, the present invention can automatically test all the test procedures that were previously performed using the previously collected test scenarios, and thus can efficiently test a large CHILL program, thereby reducing the cost of program development. Can be.

In addition, the present invention can test the various execution scenarios of the parallel program when the test using the scenario can predict the completeness of the program.

Claims (8)

In the fill program test method applied to a fill program test apparatus for testing a parallel fill program, A first step of generating a plurality of execution scenarios by recording a test procedure in an execution scenario file while executing each CHILL program; A second step of recognizing the generated plurality of execution scenarios and converting the generated plurality of test scenarios into a plurality of test scenarios so as to reproduce the recorded test procedure; And A third step of checking an error of the program while re-executing a parallel CHILL program using the converted test scenarios Chill program test method comprising a. The method of claim 1, The first step is, A fourth step of driving the parallel CHILL program debugger; A fifth step of performing debugging while executing a parallel chill program using the driven parallel chiller program debugger; A sixth step of generating one execution scenario by recording the series of debugging procedures for performing the debugging in one execution scenario file; And A seventh step of generating an execution scenario for the predetermined number of repetitions by repeating the predetermined number of times from the fourth step; Chill program test method comprising a. The method according to claim 1 or 2, The third step, After re-executing the CHILL program using all the generated CHILL program test scenarios, comparing the execution result with the predicted results, and checking the program for errors, the result of the test in each test scenario is examined. A chilling program test method comprising collecting and outputting. In the fill program test method applied to a fill program test apparatus for testing a parallel fill program, A first step of receiving a test scenario list and a repetition test number; Read one of the above test scenarios to construct a list of CHILL process control commands to control the execution of the parallel CHILL program under test, set a breakpoint at the beginning of the CHILL file, and then run the CHILL. A second step of executing the file; If all the CHILL process control commands are executed one by one and the result of executing the command matches the preceding condition, the pass item is increased by one in the test scenario result table. fail) a third step of increasing the item; And A fourth step of repeatedly outputting the execution result using each execution scenario result table after repeating the second step with respect to all the test scenarios; Chill program test method comprising a. On your computer, A first function of creating a plurality of execution scenarios by recording a test procedure in an execution scenario file while executing each parallel CHILL program; A second function of recognizing the generated plurality of execution scenarios and converting the generated plurality of test scenarios into a plurality of test scenarios for reproducing according to the recorded test procedure; And A third function of checking an error of the program while re-executing the parallel CHILL program using the converted test scenarios A computer-readable recording medium having recorded thereon a program for realizing this. The method of claim 5, The first function, A fourth function of driving a parallel CHILL program debugger; A fifth function of performing debugging while executing the CHILL program using the driven CHILL program debugger; A sixth function of recording one series of debugging procedures for performing the debugging in one execution scenario file to generate one execution scenario; And A seventh function of generating the execution scenario for the predetermined number of repetitions by repeatedly performing the predetermined number of times from the fourth function; A computer-readable recording medium having recorded thereon a program for realizing this. The method according to claim 5 or 6, The third function, After re-executing the CHILL program using all the generated CHILL program test scenarios, comparing the execution result with the predicted results, and checking the program for errors, the result of the test in each test scenario is examined. A computer-readable recording medium having recorded thereon a program, which is collected and output. On your computer, A first function of receiving a test scenario list and a repetition test number; Read one of the above test scenarios to construct a list of CHILL process control commands to control the execution of the parallel CHILL program under test, set a breakpoint at the beginning of the CHILL file, and then run the CHILL. A second function to execute the file; If all the CHILL process control commands are executed one by one and the result of executing the command matches the preceding condition, the pass item is increased by one in the test scenario result table. fail) a third function of incrementing one item; And A fourth function for outputting an execution result using each execution scenario result table after repeatedly performing the second function with respect to all the test scenarios A computer-readable recording medium having recorded thereon a program for realizing this.