KR20040075464A - Software testing device and method thereof - Google Patents

Abstract

PURPOSE: A device and a method for testing software are provided to perform a test by dynamically generating test data if necessary during the test without making the test data before the test. CONSTITUTION: A test scripter outputs a stored test script if a test executing signal is inputted(210). A test data generator(220) generates the test data by selecting one from a test data set, and outputs the test data by combining with the test script. A test executer(230) provides the test script received from the test scripter and performs the test by the test script combined with the test data received from the test data generator. A monitor(240) monitors a test result of the test executer and outputs a control signal for generating the additional test data depending on a monitoring result to the test data generator.

Description

Software testing device and method

The present invention relates to a software test apparatus and method, and more particularly, to an apparatus and method for testing the integrity of the software using the test script and the test data.

1 is a view showing a general structure of a conventional software testing apparatus.

The conventional software testing apparatus performs testing using only test cases prepared in advance. In this case, since the test cases include test scripts and test data, both the scripts and the data for testing are fixed before the test is performed.

Since the test data is fixed, the conventional method cannot compensate for the incomplete or incomplete part of the test, and it is expensive and time-consuming because new test data must be created through separate analysis after the test is completed. There is a lot of problems.

The technical problem to be achieved by the present invention is to provide a software test apparatus and method for dynamically generating test data as needed during the testing performance without performing the test data before making the test in advance.

Another technical problem to be solved by the present invention can be read by a computer that records a program for executing a software test method in which a test data is dynamically generated as needed during the test and the test is performed without performing test data beforehand. To provide a record carrier.

1 is a block diagram of a conventional universal testing apparatus without a test data dynamic generation function,

2 is a configuration diagram of a software test apparatus according to the present invention;

3 is a block diagram showing the configuration of an embodiment of a test data generation unit of the software test apparatus according to the present invention;

4 is a flowchart illustrating a process of performing a software test method according to the present invention;

5 is a flowchart illustrating a process of performing an embodiment of a test data generation process employed in a software test method according to the present invention;

6 is a flowchart illustrating a process of performing another embodiment of the test data generation process employed in the software test method according to the present invention.

In order to achieve the above technical problem, a software test apparatus according to the present invention includes: a test script unit for outputting a test script held when a test execution signal is input; A test data generator for generating test data by selecting at least one test data from a predetermined test data set, and combining the generated test data with the test script and outputting the test data; A test execution unit providing the test script input from the test script unit to the test data generation unit, and performing a test by a test script combined with the test data received from the test data generation unit; And a monitoring unit for monitoring a test result performed by the test execution unit and outputting a control signal to the test data generation unit to generate additional test data according to the monitoring result.

The test data generation unit may include: a division unit dividing the data set by a predetermined reference; And a data generation unit for generating test data by selecting at least two or more test data in each divided section, wherein the monitoring unit is configured for the section in which the test performance result by the test data is different among the divided sections. The test data generator outputs a control signal for generating additional test data.

Preferably, the dividing unit divides the data set based on a median or randomly generated value of the data set for a section in which the test performance result of the test data is different.

Preferably, the data generator selects at least two or more test data from among a median, a minimum value, a maximum value, and an average value among the data belonging to each of the divided sections. Alternatively, the data generator may randomly select at least two test data from among the data belonging to each of the divided sections.

Preferably, the test data generation unit determines a value of a specific variable among the data belonging to the dataset, and depends on the specific variable based on the value of the determined specific variable among the data belonging to the dataset. Determine the values of the variables.

Preferably, the apparatus further includes a storage unit for storing a check table indicating whether the test is performed on the path of the test target software, wherein the monitoring unit monitors a test performance result based on the test data so that the path on which the test is not performed is stored. If present, a control signal for generating additional test data is output to the test data generation unit, and the test path is displayed on the corresponding path of the check table for the path on which the test is performed.

According to another aspect of the present invention, there is provided a software test method comprising: (a) selecting at least one test data from a predetermined test data set to generate test data; (b) combining and outputting the generated test data to the test script; (c) performing a test by a test script in which the test data is combined; And (d) monitoring a test performance result to determine whether to end the test and generating additional test data. Steps (a) to (d) are repeatedly performed until the end of the test.

Step (a) may include: (a1) dividing the data set by a predetermined criterion; And (a2) generating at least two test data by selecting at least two test data in each divided section, wherein step (d) includes performing different test results by the test data among the divided sections. Determine the generation of additional test data for the interval.

Preferably, the step (a1) divides the data set based on a median or randomly generated value of the data set for a section in which the test performance result of the test data is different.

Preferably, the step (a2) selects at least two or more test data from among a median, a minimum value, a maximum value, and an average value among the data belonging to each of the divided sections. Alternatively, step (a2) may select at least two or more test data randomly from the data belonging to each of the divided sections.

Preferably, the step (a) determines a value of a specific variable among the data belonging to the dataset, and based on the value of the determined specific variable among the data belonging to the dataset. Determine the values of the variables

Preferably, the step (d) monitors the test performance result by the test data to generate additional test data to the test data generator if there is a path where the test is not performed, and for the path on which the test is performed. Indicates that the test was performed on the corresponding path in the check table that indicates whether the test is performed on the path of the software to be tested.

According to the present invention, test coverage can be improved and various test data can be generated, thereby improving error detection capability of the test apparatus. In addition, test scripts can be reused by providing separate test scripts and test data.

Hereinafter, a software test apparatus and method according to the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals in the drawings denote like elements.

2 is a block diagram showing the configuration of an embodiment of a software test apparatus according to the present invention.

Referring to FIG. 2, the software test apparatus 200 includes a test script unit 210, a test data generator 220, a test performer 230, and a monitor 240.

The test script unit 210 holds a test script prepared in advance before the test is performed. The test script consists of calls / inputs to the test target, and the part of the test script that needs data consists of a symbolic name (eg arg).

The test data generator 220 dynamically generates test data. Here, dynamic generation of test data means that test data is generated according to the test progress.

3 is a block diagram illustrating a configuration of an embodiment of the test data generator 220.

Referring to FIG. 3, the test data generator 220 includes a divider 222 and a data generator 224.

The divider 222 divides a data set suitable for the test target. For example, if the data set suitable for the test object is a natural number between 1 and 100, the division unit 222 divides the data set in the first test (that is, divides the data set 0 times). In addition, when the monitoring result input from the monitoring unit 240 is not satisfactory after performing the test, the data set is divided into two sets having a range of 1-50 and 51-100. The dividing process of the dividing unit 222 continues until the monitoring result is satisfactory. The division criterion of the dividing unit 222 may be a median value of the data set in which the monitoring result is not satisfactory. Alternatively, the division criterion may be randomly divided for the data set in which the monitoring result is not satisfactory.

The data generator 224 generates test data by selecting at least two or more pieces of data from the data set divided by the divider 222. Based on the above example, during the initial test, the data generation unit 224 selects 1 and 100 from 1-100 natural numbers to generate first test data including these. The test performer 230 performs a test based on the first test data, and when the monitoring result is not satisfactory, the divider 222 divides the data set into two sections 1-50 and 51-100 as described above. do.

The data generator 224 selects at least two test data in each division section and generates test data composed of them. For example, 2, 45, 52, and 95 are selected in the data sections 1-50 and 51-100, respectively, to generate 2-1 test data and 2-2 test data.

If the test results based on the second-two test data are not satisfactory among the test performance results based on the test data, the division unit 222 selects 51-100 which is a section in which the second-2 test data is selected. And 76-100 two sections. The data generator 224 selects at least two test data from each of the two division sections, and generates the 3-1 test data and the 3-2 test data, which are composed of them, until the test result is satisfactory. Is repeated.

The data generator 220 may select the test data from among the median, the average value, the minimum value, and the maximum value of the data set. Alternatively, the data generator 220 may randomly select the test data from the data set.

The test data generator 220 may generate test data based on a path. In this case, the test data generator 220 selects at least one data from a data set suitable for a test target and generates test data. If an untested path exists as a result of monitoring, test data is generated from data except for test data already selected from a data set suitable for a test target. For example, if the data set is a natural number between 1 and 100, the initial test data may be 50, and 79 may be the next generated test data when the test result is not satisfactory. This process is repeated until the test results are satisfactory.

In the case of generating test data based on a path, the test data generator 220 generates test data by a dependency between variables. Variables in the program have interdependencies. For example, if there is a statement x = y + 1 in the program, the x and y values are interdependent. That is, when one of x and y is determined, the other value is also determined. Accordingly, since the variables in the dependency relationship are determined by the value of one variable, the values of the remaining variables are also determined, so that the test data generator 220 may determine the equations / equalities required in the conventional symbolic execution method. Test data can be obtained without performing a solution.

The test performer 230 reads out the test script stored in the test script unit 210 and provides the test script to the test data generator 220. The test data generator 220 generates test data necessary to test the test script and then outputs the test script filled with the test data to the test performer 230. The test performer 230 performs a test on the test script provided from the test data generator 220. The test execution operation of the test execution unit 230 is controlled by the monitoring result of the monitoring unit 240. Unlike this, a controller (not shown) controls the operations of the test script unit 210, the test data generator 230, and the test performer 240 based on the monitoring result received from the monitor 240. You may.

The monitoring unit 240 monitors the test results performed by the test execution unit 230. When the test data is dynamically generated based on the partition, the monitoring unit 240 checks whether the test is appropriate by checking whether the test results performed by the two or more test data are the same.

On the contrary, in the case where the test data is dynamically generated based on the path, the monitoring unit 240 checks whether the test is appropriate by the existence of the path on which the test is not performed. To verify that the test is performed, you need to indicate that the test was not performed for all paths before the test began. To this end, a check table indicating whether the test is performed on the path of the test target software may be stored in the monitoring unit 240 or a separate storage unit (not shown). In this case, the monitoring unit 240 indicates that the test is performed on the corresponding path of the check table with respect to the path on which the test is performed.

If the test results performed by the two or more test data are different or it is determined that there is a path in which the test is not performed, the monitoring unit 240 instructs the test data generation unit 220 to generate new test data. .

4 is a flowchart illustrating a process of performing an embodiment of a software test method according to the present invention.

The test performer 230 outputs the test script provided from the test script unit 210 to the test data generator 220 (S400). The test data generation unit 220 generates test data necessary for the input test script, fills the test script, and outputs the test data to the test execution unit 230 (S410). The test performer 230 performs a test by the test script received from the test data generator 220 (S420).

The monitoring unit 240 monitors the test results performed in the test execution unit 230 to check whether the test is appropriate (for example, whether the test results performed by different test data are identical or all the paths are tested). (S430). If it is determined that the test is not complete, the monitoring unit 240 controls to generate new test data in the test data generator 220 and provide the test data to the test performer 230 (S440).

Steps S410 to S440 are repeatedly performed until the test is confirmed to be appropriate.

5 is a flowchart illustrating an example of a test data generation method performed in step S410.

Referring to FIG. 5, the divider 222 divides a data set suitable for a test target (S500). The data generator 224 generates test data by selecting at least two pieces of data in each of the divided sections (S510). The test data generator 220 fills the test data generated by the data generator 224 in the test script and outputs the test data to the test performer 230 (S520).

On the other hand, if it is determined that the test is not complete in the monitoring unit 240 (S530), the division unit 222 divides the data set of the section is confirmed that the test is not complete (S540). The data generator 224 selects at least two test data in each divided section, fills the test script, and outputs the test script to the test performer 230. The above interval division, data generation, test execution, and monitoring process are repeatedly performed until the test result is satisfactory.

6 is a flowchart illustrating another example of a test data generation method performed in step S410.

Referring to FIG. 6, the test data generator 220 generates test data by selecting test data from a data set suitable for a test target (S600). The test data generator 220 fills the generated test data in the test script and outputs the generated test data to the test performer 230 (S610).

If it is determined that there is an untested path in the monitoring unit 240 (S620), the test data generator 220 generates test data from data other than the test data already selected in the data set suitable for the test target. . This data generation, test run, and monitoring process is performed repeatedly until the test is performed for all paths.

In the above description, a method and apparatus for dynamically generating test data have been described with reference to a specific embodiment, but it is also possible to use a method for generating test data based on a partition and a method for generating test data based on a path. In addition, when using test data generation method based on path, it is difficult to theoretically generate data for testing all paths (NP-complete), so testing for all sentences and testing for all branches Modifications of various algorithms are possible, including testing of some paths.

The invention can also be embodied as computer readable code on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer device is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may also be implemented in the form of a carrier wave (for example, transmission over the Internet). Include. The computer readable recording medium can also be distributed over network coupled computer devices so that the computer readable code is stored and executed in a distributed fashion.

Although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific preferred embodiments described above, and the present invention belongs to the present invention without departing from the gist of the present invention as claimed in the claims. Various modifications can be made by those skilled in the art, and such changes are within the scope of the claims.

According to the present invention, by dynamically generating test data, test coverage can be improved, and various test data can be generated, thereby improving error detection capability of the testing apparatus. Also, by separately providing test scripts and test data, test scripts can be reused.

Claims (15)

A test script unit for outputting a test script held when a test execution signal is input; A test data generator for generating test data by selecting at least one test data from a predetermined test data set, and combining the generated test data with the test script and outputting the test data; A test execution unit providing the test script input from the test script unit to the test data generation unit, and performing a test by a test script combined with the test data received from the test data generation unit; And And a monitoring unit for monitoring a test result performed by the test execution unit and outputting a control signal to the test data generation unit to generate additional test data according to the monitoring result. The method of claim 1, The test data generation unit, A dividing unit dividing the data set by a predetermined criterion; And And a data generator for selecting at least two test data from each divided section to generate test data. And the monitoring unit outputs a control signal for generating additional test data to the test data generator for a section in which the test performance result of the test data is different among the divided sections. The method of claim 2, The dividing unit divides the data set based on a median or randomly generated value of the data set for a section in which the test performance result of the test data is different. The method of claim 2, And the data generator selects at least two or more test data from among media, minimum, maximum, and average values among the data belonging to each of the divided sections. The method of claim 2, And the data generation unit randomly selects at least two test data from among the data belonging to each of the divided sections. The method of claim 1, The test data generator determines a value of a specific variable among the data belonging to the data set, and based on the value of the determined specific variable among the data belonging to the data set, the test data generation unit determines a value of a variable that is dependent on the specific variable. Software test apparatus, characterized in that the decision. The method of claim 6, The apparatus may further include a storage unit for storing a check table that displays whether or not a test is performed on a path of a test target software. The monitoring unit monitors a test performance result based on the test data, and outputs a control signal for generating additional test data to the test data generation unit when a path in which a test is not performed exists, and checks the path on which the test is performed. Software test apparatus, characterized in that it indicates that the test was performed in the corresponding path of the table. (a) selecting at least one test data from a predetermined test data set to generate test data; (b) combining and outputting the generated test data to the test script; (c) performing a test by a test script in which the test data is combined; And (d) monitoring the test performance result to determine whether to terminate the test and generate additional test data; The steps of (a) to (d) are repeatedly performed until the end of the test. The method of claim 8, In step (a), (a1) dividing the data set by a predetermined criterion; And and (a2) selecting at least two test data from each divided section to generate test data. The step (d) is a software test method, characterized in that for generating the additional test data for the section in which the test performance result by the test data in the divided section is different. The method of claim 9, In the step (a1), the data set is divided based on a median value or a randomly generated value of the data set for a section in which the test performance result of the test data is different. The method of claim 9, In the step (a2), at least two or more test data are selected from among median, minimum, maximum, and average values among the data belonging to each of the divided sections. The method of claim 9, In the step (a2), at least two test data are randomly selected from among the data belonging to each of the divided sections. The method of claim 8, In step (a), a value of a specific variable is determined among the data belonging to the data set, and the values of the variables that are dependent on the specific variable based on the determined value of the specific variable among the data belonging to the data set. Software testing method, characterized in that determining the. The method of claim 13, Step (d) monitors the test result based on the test data to generate additional test data to the test data generator if there is a path where no test is performed. The software test method, characterized in that indicating that the test has been performed on the path of the check table that displays whether or not the test for the path is displayed. A computer-readable recording medium having recorded thereon a program for executing the software test method according to any one of claims 8 to 14.