JP5944258B2 - Test case generation support device - Google Patents

Description

  Embodiments described herein relate generally to a test case generation support apparatus.

  In recent years, many devices are controlled by computer software. The number of parameters for controlling the operation of the device has increased as the functionality of the device has increased.

  The behavior of software varies depending on the combination of various parameters. Combining these parameters with brute force leads to an explosion in the number of tests, and in many cases it is impossible to do it in practice. Therefore, all-pair algorithms and orthogonal tables are used as efficient combinatorial testing techniques for large and complex software.

  It is common for defects in many devices to be caused by up to two parameters. Thus, focusing on two factors, parameter combinations are made more efficient.

  However, even in the method of creating a combined test case by paying attention to the degree of coverage between two factors, the number of generated test cases increases and there is a demand for further reduction. When a combination is created mechanically, there is a possibility that a combination test case having a high appearance frequency does not appear. In addition, when creating a combination mechanically, there is a possibility that a combination test case with a high appearance frequency may not appear, and there is a possibility that the test under the most frequently used combination conditions may be missed. Not only is it difficult to embed the intention, but when new test cases are added manually, there are cases where unnecessary test cases increase in terms of the coverage between two factors. Furthermore, if there are many prohibitions that are impossible combinations, contradictions may occur between the prohibitions.

JP 2006-252316 A JP 2006-227958 A JP 2004-288034 A

  The problem to be solved by the present invention is to provide a test case generation support apparatus capable of reducing the generated test cases for further efficiency and improving the quality of the test cases.

The test case generation support apparatus according to the embodiment includes an input unit that inputs factors relating to the function of the device or system to be tested and the levels that each factor can take, and two factors based on the factors and levels input at the input unit. A matrix creation unit for generating a two-factor coverage matrix of a lattice structure in which factors are arranged vertically and horizontally so as to cover combinations between them, and a combination of two variables arbitrarily selected from the factors and levels are input as test cases Combination generation that generates a combination test that combines a test case input unit, a coverage calculation unit that calculates the coverage between two factors based on the matrix, and two variables arbitrarily selected from the factors and levels And a detection unit for detecting a test case that is unnecessary to satisfy 100% coverage between the two factors, The detection of the unnecessary test cases is performed for each of Nt test cases. 1) For the N factors, the levels of the i-th and j-th factors are extracted and appear on the coverage matrix between the two factors. Confirm the number of times (i is 1 to N-1, j is i to N), and 2) In all of the above, if the number of appearances is 2 or more except for the prohibited combinations, it is detected as an unnecessary test case The series of processes is repeated Nt times , and the unnecessary test cases are deleted from the combination test generated by the combination generation unit.

It is a figure which shows the structural example of the test case production | generation assistance apparatus which concerns on 1st Embodiment. FIG. 6 is a diagram illustrating an example of print settings. It is a flowchart which shows the flow of a process of the generation assistance by the test case production | generation assistance apparatus which concerns on 1st Embodiment. It is a figure which shows an example of a factor and level information. It is a figure which shows an example of the coverage factor matrix between 2 factors. It is a figure which shows an example of the input existing test case. It is a figure explaining calculation of the coverage between two factors. It is a figure explaining the detection of an unnecessary test case. It is a figure which shows the structural example of the test case production | generation assistance apparatus which concerns on 2nd Embodiment. It is a flowchart which shows the flow of a process of the generation assistance by the test case production | generation assistance apparatus which concerns on 2nd Embodiment. It is a figure which shows an example of prohibition information. It is a figure which shows an example of the produced | generated test case. It is a figure which shows an example of the detection of a changeable level. It is a figure which shows the structural example of the test case production | generation assistance apparatus which concerns on 3rd Embodiment. It is a flowchart which shows the flow of a process of the generation assistance by the test case production | generation assistance apparatus which concerns on 3rd Embodiment. It is a figure which shows an example of the prohibition information input from the prohibition information input part. It is a figure explaining contradiction of prohibition, detection of leak, and re-input of prohibition. It is a flowchart which shows the flow of a process of the generation assistance by the test case production | generation assistance apparatus which concerns on 4th Embodiment. It is a figure which shows an example of the setting of an exclusion factor and an exclusion level. It is a figure which shows an example of the coverage factor matrix between 2 factors which considered the exclusion factor and the exclusion level. It is a figure which shows the example of the production | generation of the test case which considered the exclusion factor and the exclusion level. It is a figure which shows an example of a single function coverage test. An example of the calculated degree of coverage between two factors is shown in comparison.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the drawings, the same portions are denoted by the same reference numerals, and redundant description is omitted.

  First, main terms used in the present embodiment will be described.

  A “test case” is a unit of test execution in which a device or system to be inspected is executed by software. Generally, a test point records a check point, an operation procedure (event sequence), an expected value (sequence of state transitions) as a result of testing a device or system to be inspected in the operation procedure, and the like. In the present embodiment, the input of the combination is referred to as a test case without considering the expected value or the like.

  An “existing test case” is a test case that has been generated by another test case generation device or generation method. In the present embodiment, existing test cases are reduced more efficiently while improving quality.

  A “combination test” is a test technique that is performed by combining two or more variables with each other.

  The “pair configuration test” is a test technique for testing all combinations of two arbitrary variables. The “All-pair algorithm” and “Orthogonal table” can be used to create all combinations of two variables. The orthogonal table is a table for assignment such that combinations between two arbitrary factors appear the same number of times. In the All-pair method, a combination between any two factors appears at least once. The combination test handled in the present embodiment is a pair configuration test.

  “Factors” are factors such as condition items, variables, and parameters that are the basis of combination tests.

  The “level” is an element of factors such as options and parameter values.

  The “degree of coverage between two factors” is a coverage rate indicating how much of the possible combinations between two factors are covered. The degree of coverage between two factors is calculated by using a combination of levels between any two factors except the prohibition as a denominator and a combination of levels between two factors included in the prepared test case as a numerator.

  “Forbidden” is an input of parameters that cannot be combined.

  The test case generation support apparatus according to the present embodiment includes an arithmetic processing unit (CPU), a main memory (RAM), a read only memory (ROM), an input device (for example, a keyboard, an operation panel, etc.), a hard disk device, and a semiconductor memory. A general-purpose computer such as a personal computer or workstation equipped with a storage device such as a solid state drive (SSD) device that uses a certain flash memory can be used, and it is realized by installing a processing program for supporting test case generation. it can.

(First embodiment)
In the first embodiment, the degree of coverage between two factors is confirmed, test cases that are unnecessary for the degree of coverage between two factors to satisfy 100% are extracted, and the test cases are deleted.

  FIG. 1 is a diagram illustrating a configuration example of a test case generation support apparatus according to the first embodiment. The test case generation support apparatus 100 according to the first embodiment mainly includes a factor / level information input unit 10, a coverage matrix creation unit 11, a test case input unit 12, a coverage level calculation unit 13, and a combination generation unit. 14 and an unnecessary test case detection unit 15.

  The factor / level information input unit 10 inputs factor information and level information. The factor / level information input unit 10 is a device that transmits information on factors and levels when operated by a user, and can be configured by a keyboard, a mouse, or the like, for example.

  The coverage matrix creation unit 11 generates a coverage two-dimensional matrix between two factors based on the factor / level information input by the factor / level information input unit 10. The matrix is a matrix in which elements are arranged vertically and horizontally, and indicates whether or not there is an association between the events at the intersection of the events in the rows in the horizontal array and the events in the columns in the vertical array. The matrix is generated, for example, in a table format such as CSV format or a tag format such as XML. The generated matrix may be displayed on, for example, a display unit (not shown) or may be stored in a storage unit such as a memory (not shown).

  The test case input unit 12 inputs an existing test case. The test case input unit 12 is a device that transmits information related to a test case when operated by a user, and can be configured by, for example, a keyboard or a mouse. As the test case format, for example, a table format such as CSV format or a tag format such as XML can be used.

  The coverage level calculation unit 13 calculates the coverage level between two factors based on the matrix generated by the coverage level matrix creation unit 11.

  The combination generation unit 14 generates a combination test formed by combining two variables arbitrarily selected from factors and levels.

  The unnecessary test case detection unit 15 detects and deletes test cases that are unnecessary when the coverage between the two factors calculated by the coverage calculation unit 13 satisfies 100%. For example, the unnecessary test case detection unit 15 itself includes a display unit (not shown), and unnecessary test cases are deleted from the test cases displayed as GUI information by the user's operation.

  Next, generation support by the test case generation support apparatus 100 configured as described above will be described.

  FIG. 2 is a diagram illustrating an example of print settings, and a case where various combinations in print settings are tested will be described as an example. In the print settings shown in FIG. 2, there are “original size”, “paper size”, “division”, and “color” as factors. Further, there are “A4”, “A3”, and “B5” as “original size” levels, “A4”, “A3”, and “B5” as “paper size” levels, and “divided” levels. There are “none”, “2 divisions”, and “4 divisions”, and “color” levels include “black and white”, “gray”, and “color”.

  FIG. 3 is a flowchart showing a flow of generation support processing by the test case generation support apparatus according to the first embodiment.

  First, factor and level information as shown in FIG. 4 is input from the factor / level information input unit 10 (step S31). The input factor and level information is sent to a coverage matrix creation unit 11 that creates a coverage matrix between two factors.

  Next, the coverage matrix creation unit 11 creates a coverage matrix between two factors based on the input factor and level information (step S32). FIG. 6 is a diagram illustrating an example of the coverage matrix between two factors. By using a simple two-dimensional matrix, all combinations appear in intersecting squares. Combinations of the same factors appear on the diagonal. A combination in which the order of the two factors is changed appears up and down with the diagonal line as the axis of symmetry. Information on the created two-factor coverage matrix is sent to the combination generation unit 14 and the coverage calculation unit 13.

  Next, an existing test case is input from the test case input unit 12 (step S33). FIG. 6 is a diagram illustrating an example of an input existing test case. In this example, the total number of test cases is 10. The input information of the existing test case is sent to the combination generation unit 14.

  Next, the coverage factor calculating unit 13 calculates the coverage factor between the two factors based on the information of the coverage factor matrix between the two factors (step S34). FIG. 7 is a diagram for explaining the calculation of the degree of coverage between two factors. In FIG. 7, the numbers in the coverage factor matrix between two factors represent the number of appearances of combinations between the two factors in the prepared test case. Since combinations appearing twice can be excluded, there are 54 combinations of two factors, and 54 combinations appearing. Therefore, the coverage between the two factors is 100%. Information on the calculated coverage between the two factors is sent to the combination generation unit 14 and the unnecessary test case detection unit 15.

  Then, the unnecessary test case detection unit 15 detects a test case that is unnecessary for the coverage between the two factors to satisfy 100% (step S35). That is, a test case in which the degree of coverage between two factors does not decrease even when the test case is deleted is detected.

  FIG. 8 is a diagram for explaining detection of unnecessary test cases. The tenth of the existing test cases that have been entered is that the factor “original size” level is “A4”, the factor “paper size” level is “A4”, the factor “division” level is “four divisions”, and the factor “color” "Is black and white.

  As shown in FIG. 8, in the tenth existing test case, the number of appearances of each level combination is 2 or more. Therefore, even if a test case with the number of appearances of 2 or more is deleted and the number of appearances of the combination is reduced by 1, all the combinations appear at least once, and the coverage between the two factors does not decrease.

  Unnecessary test cases are detected by repeating the following process Nt times for each Nt test cases.

1) For the N factors, take the levels of the i-th and j-th factors and confirm the number of appearances on the coverage matrix between the two factors (i is 1 to N-1, j is i to N).
2) In all of the above, when the number of appearances is 2 or more except for the combination of prohibitions, it is detected as an unnecessary test case.
3) Confirm whether or not to delete this test case, and if it is confirmed by the user that deletion is possible, determine that this test case is unnecessary.
Information on unnecessary test cases detected as described above is sent to the combination generation unit 14.

  The combination generation unit 14 outputs the result of the combination test in which the number of test cases that can be deleted is reduced through, for example, a table format such as CSV format or a tag format such as XML. As the output destination, for example, a display device or a printing device (not shown) connected to the outside is suitable.

  According to the first embodiment, it is possible to efficiently reduce test cases without reducing the coverage between two factors.

(Second Embodiment)
Next, a second embodiment will be described. In the second embodiment, taking the print setting shown in FIG. 2 as an example, in a test case of a combination satisfying 100% coverage between two factors, the level of changeable detection and the status of coverage between two factors are visualized. It is.

  FIG. 9 is a diagram illustrating a configuration example of the test case generation support apparatus 200 according to the second embodiment. In the second embodiment, in addition to the configuration of the first embodiment, a prohibition information input unit 16 and a changeable level detection unit 17 are provided. It is also preferable to provide a display unit (not shown) that displays the degree of coverage between two factors.

  The prohibition information input unit 16 inputs a combination of two variables that cannot be combined as prohibition information. The prohibition information input unit 16 is a device that transmits information related to prohibition when operated by a user, and may be configured by, for example, a keyboard or a mouse. The input prohibition information is sent to the combination generation unit 14.

  The changeable level detection unit 17 detects a changeable level such that the coverage between the two factors does not decrease even if the level is changed to another level.

  FIG. 10 is a flowchart showing a generation support process performed by the test case generation support apparatus 200 according to the second embodiment.

  First, factor and level information as shown in FIG. 4 is input from the factor / level information input unit 10 (step S101). The input factor and level information is sent to the coverage matrix creation unit 11.

  Next, the coverage matrix creation unit 11 creates a coverage matrix between two factors as shown in FIG. 5 based on the input factor and level information (step S102).

  Next, prohibition information is input from the prohibition information input unit 16 (step S103). FIG. 11 is a diagram illustrating an example of prohibition information. In this example, the level “color” of the factor “color” is set as a prohibition as a combination of the factor “division” with respect to the level “four divisions”.

  Next, the combination generation unit 14 generates a test case of a combination that satisfies 100% coverage between the two factors so that a forbidden combination does not appear (step S104). FIG. 12 is a diagram illustrating an example of the generated test case. In step S <b> 104, an existing test case may be input from the test case input unit 12, and in this case, information on the input existing test case is sent to the combination generation unit 14.

  Next, the coverage factor calculation unit 13 calculates the coverage factor between the two factors based on the information of the coverage factor matrix between the two factors (step S105). Here, it becomes 100% as in the first embodiment.

  Next, the changeable level detection unit 17 detects a changeable level that does not lower the coverage between the two factors even if the level is changed to another level (step S106). FIG. 13 is a diagram illustrating an example of detection of a changeable level.

  According to FIGS. 12 and 13, the level of the factor “original” is “A4”, the level of the factor “paper” is “B5”, the level of the factor “division” is “four divisions”, and the level of the factor “color” is In the ninth test case of “black and white”, the number of occurrences of the level “black and white” of the factor “color” and the level of other factors is 2 or more. That is, even if the level of the factor “color” is changed to another level, the number of appearances has appeared once or more, and the coverage between the two factors does not decrease. Therefore, in the test case shown in FIG. 12, the level of the factor “color” can be changed.

  Similarly, even if the level of the tenth test case shown in FIG. 12 and the factor “division” is “none”, even if the level is changed to another level, the coverage between the two factors does not decrease.

  To summarize the above, it is possible to detect the changeable level by repeating the following processing Nt times for each Nt test cases.

1) First, for the N factors, the level of the i-th factor is extracted, and the following processing is repeated N times.
The level of the j-th factor other than i is taken out, and the number of appearances on the test matrix with the level of the i-th factor is determined (j is 1 to N).
In all of the above, if the number of appearances is 2 or more except for the prohibited combinations, it is detected as a changeable level.
2) After detecting the changeable level up to the Nth factor, the level of the ith factor is taken out again, and the following processing is repeated N times.
If the level of the i-th factor is a changeable level, the level of the j-th factor other than i is taken out, and the number of occurrences on the test matrix with the level of the i-th factor is reduced by 1 (j is 1 to N).

  In the above, the test case generation support process is terminated after the process of step S106 is completed. However, it is not limited to this. That is, in order to reflect the user's intention more, it is also preferable to return to step S104 and continue the process after detecting the level that can be changed in step S106, and further detect the level that can be changed.

  As described above, according to the second embodiment, it is possible to extract a level that can be changed without reducing the degree of coverage between two factors, so that a test case reflecting the user's intention is acquired. Can do.

(Third embodiment)
Next, a third embodiment will be described. In the third embodiment, the print setting shown in FIG. 2 is taken as an example, and inconsistency of prohibition relations and leakage of prohibitions are confirmed in a test case of a combination that satisfies 100% coverage between two factors.

  FIG. 14 is a diagram illustrating a configuration example of a test case generation support apparatus 300 according to the third embodiment. In the third embodiment, a prohibition contradiction detection unit 18 is provided in addition to the configuration of the second embodiment.

  The prohibition contradiction detection unit 18 detects prohibition contradiction or leakage of prohibition set by the user.

  FIG. 15 is a flowchart illustrating a flow of generation support processing by the test case generation support apparatus 300 according to the third embodiment.

  First, factor and level information as shown in FIG. 4 is input from the factor / level information input unit 10 (step S151). The input factor and level information is sent to the coverage matrix creation unit 11.

  Next, the coverage matrix creation unit 11 creates a coverage matrix between two factors based on the input factor and level information (step S152).

  Next, prohibition information is input from the prohibition information input unit 16 (step S153). FIG. 16 is a diagram illustrating an example of prohibition information input from the prohibition information input unit 16. In the example shown in FIG. 16, the combination of the level “A4” of the factor “original” and the level “four divisions” of the factor “division”, the level “B5” of the factor “original” and the level “four divisions” of the factor “division”. The combination of the level “A3” of the factor “original” and the level “color” of the factor “color” is forbidden and input.

  However, the prohibition information entered here is complex, and in fact, if you try to create a test case that includes a combination of the factor “division” level “4 divisions” and the factor “color” level “color” There is a problem that the level of the manuscript cannot be selected. This is a contradiction, and such prohibitions must be removed.

  Next, an existing test case is input (step S154) and sent to the combination generation unit 14. Of course, when there is no existing test case, it is generated in the combination generation unit 14 as in the second embodiment.

  Next, forbidden contradiction and leakage are detected (step S155). Next, prohibition information is re-input from the prohibition information input unit 16 (step S156). FIG. 17 is a diagram for explaining prohibition contradiction, leakage detection, and prohibition re-input. In the example shown in FIG. 17, the level “4 divisions” of the factor “division” and the level “color” of the factor “color” are re-entered as prohibitions. The re-input may be performed by software processing or manually by the user.

  Here, detection of prohibition contradiction and prohibition leakage will be described in detail.

In level B1 of factor B and level C1 of factor C, for example, in a forbidden relationship with factor A (level A1, A2, A3),
1) Either level A1 or level B1, C1 (or both) is prohibited 2) Either level A2 or level B1, C1 (or both) is prohibited 3) Either level A3 or level B1, C1 If (or both) are prohibited, levels B1 and C1 can be prohibited. Conversely, any level of factor A and both are not prohibited unless they are prohibited.

  In terms of algorithm, the above relationship is established for all factors X other than these two factors for each combination of two factors (levels B1 and C1, levels B1 and C2, etc.). Check for any problems. That is, it is only necessary to confirm that one (or both) of the two levels checked against all levels of factor X is prohibited. If it is not forbidden, it means that the forbidden setting is omitted or the setting is wrong.

  Next, detection of prohibition contradiction will be described in detail.

  For the N factors, the i-th and j-th factors are extracted from the test matrix, and the following processing is repeated (i is 1 to N-1, j is i to N).

  If the Fi-th level of the i-th factor and the Fj-th level of the j-th factor are not forbidden, repeat the following process (Fi is the number of levels of the i-th factor from 1 to 1 and Fj is 1 to j-th Number of levels of the factor).

  The k-th factor other than the i-th and j-th factors is taken out and the following processing is repeated (k is 1 to N).

  The following processing is repeated for the Fkth level of the Kth factor (Fk is the number of levels of the kth factor).

  Make sure that the Fk level of the Kth factor and the Fith level of the ith factor, or the Fjth level of the jth factor are prohibited.

  In all of the above, if there is a prohibition, it is detected as a contradiction of the prohibition.

  Here, when returning to the flow, the re-input prohibition information is reflected, and the combination generation unit 14 regenerates the test case of the combination (step S157).

  In the test case generation support process described above, the process for calculating the coverage is not performed. However, for example, after the process of step S156, it is also preferable to calculate the degree of coverage between two factors and confirm the influence of re-input of prohibition information.

  As described above, according to the third embodiment, it is possible to check contradictions of prohibition relations and leakage of prohibitions, so that the quality of the combination test case can be improved.

(Fourth embodiment)
Next, a fourth embodiment will be described. In the fourth embodiment, the print setting shown in FIG. 2 is taken as an example, and factors and levels are narrowed down to further reduce the number of test cases from a combination test case satisfying 100% coverage between two factors. . In the print setting shown in FIG. 2, if a test case of a combination that satisfies 100% coverage between two factors is generated as it is, the total number becomes 16. Therefore, the total number is reduced by further efficiency.

  The configuration of the test case generation support apparatus according to the fourth embodiment can be the same as the configuration according to the first embodiment. FIG. 18 is a flowchart illustrating a flow of generation support processing by the test case generation support apparatus according to the fourth embodiment.

  First, factor and level information as shown in FIG. 4 is input from the factor / level information input unit 10 (step S181). The input factor and level information is sent to the coverage matrix creation unit 11.

  Next, the coverage matrix creation unit 11 creates a coverage matrix between two factors based on the input factor and level information (step S182).

  Next, an existing test case is input from the test case input unit 12 (step S183) and sent to the combination generation unit 14.

  Next, the factor / level information input unit 10 sets an exclusion factor and an exclusion level that do not consider the combination (step S184). In addition to the factor / level information input unit 10, an exclusion factor / level setting unit (not shown) may be separately provided for setting the exclusion factor and the exclusion level.

  FIG. 19 is a diagram illustrating an example of setting exclusion factors and exclusion levels. In the example illustrated in FIG. 19, “application” is set as an exclusion factor that does not consider the combination. Further, as exclusion levels not considering the combination, the level “B4” in the factor “original”, the level “B4” in the factor “paper”, the level “8 divisions” in the factor “division”, and the level “full color” in the factor “color” Set each.

  Information on the set exclusion factor and exclusion level is sent to the coverage matrix creation unit 11.

  Next, the coverage matrix creation unit 11 creates a two-factor coverage matrix in consideration of the exclusion factor and the exclusion level (step S185). FIG. 20 is a diagram illustrating an example of a coverage matrix between two factors in consideration of an exclusion factor and an exclusion level. The exclusion factor is characterized in that the matrix is created at the end of the list of factors and the exclusion level is at the end of the list of levels of the factors. In the example shown in FIG. 20, the arrangement remains as it is.

  Information on the created two-factor coverage matrix is sent to the coverage calculation unit 13 and the combination generation unit 14.

  Next, the combination generation unit 14 generates a test case in consideration of the exclusion factor and the exclusion level (step S186). Test cases are generated so as to cover 100% of the exclusion factor and the two-factor coverage of factors other than the exclusion level, and the exclusion factor level and single-function coverage of the exclusion level. FIG. 21 is a diagram illustrating a generation example of a test case in consideration of an exclusion factor and an exclusion level. In the example shown in FIG. 21, the coverage between two factors of “original”, “paper”, “division”, and “color” excluding the exclusion level in 10 test cases and the original size “B4” designated as the exclusion level and the paper size “ It covers single function coverage of “B4”, division “8 divisions”, color “full color” and single function of “application” level.

  The generation of test cases in the fourth embodiment is summarized as follows.

  First, regarding the excluded factors and factors / levels that are not set as excluded levels, a combination is created using an existing test case generation algorithm.

  Next, the factor set as the exclusion factor is added to the created combination so that the level appears at least once.

  Next, regarding the level set as the exclusion level, a separate combination is created so that it appears at least once. However, if the total number of test cases does not change even if a test case is created so as to cover two factors including the exclusion level, it will be created.

  The above-mentioned single function comprehensive test means that a test including the extracted level such as the condition value and the presence / absence of a function is included at least once. FIG. 22 is a diagram illustrating an example of a single function coverage test. Performing a test that includes all the extracted levels once is the minimum necessary to confirm the operation of the device.

  Next, the coverage level calculation unit 13 switches between the calculation of the coverage factor between the two factors excluding the exclusion factor and the exclusion level and the calculation of the coverage factor between the two factors including the exclusion factor and the exclusion level (step S187). ). By switching the calculation of the degree of coverage between two factors, it is possible to review the necessity of adding test cases and the setting of exclusion factors and exclusion levels.

  In calculating the coverage between two factors excluding excluded factors and exclusion levels, the coverage is calculated by subtracting all levels of exclusion factors and the number of combinations of exclusion levels and other factors from the number of combinations of all levels. When counting the number of numerators using the combination of levels included in the test case as the denominator of the calculation, all levels of exclusion factors and the coverage of two factors without counting the combinations of exclusion levels and other factor levels are counted. Calculate the degree.

  On the other hand, in calculating the coverage between two factors including the exclusion factor and the exclusion level, the number of combinations of all levels is used as the denominator of the coverage calculation, and the number of numerators is counted by the combination of levels included in the test case. Calculate the degree of coverage between factors.

  FIG. 23 shows an example of the calculated degree of coverage between two factors. As shown in FIG. 23, the coverage between the two factors excluding the exclusion factor and the exclusion level is 100%, but the coverage between the two factors including the exclusion factor and the exclusion level is 65.28%. .

  When the exclusion factor and the exclusion level are taken into account, when the coverage is considerably lower than 100%, for example, less than 60%, it is preferable to start over from the setting of the exclusion factor and the exclusion level in step S194. is there.

  As described above, according to the fourth embodiment, it is possible to remove the designated factor / level from the target of coverage between two factors, realize a single function coverage test, and realize test efficiency. In addition, by switching the calculation method of the coverage level, grasping the impact and pros and cons of removing the specified factor and level from the scope of coverage between the two factors, reviewing the necessity and exclusion factors of test cases, the setting of the level It can be performed. And further efficiency can reduce the total number of test cases.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

100, 200, 300 ... test case generation support device 10 ... factor / level information input unit 11 ... coverage matrix creation unit 12 ... test case input unit 13 ... coverage calculation unit 14 ..Combination generation unit 15 ... unnecessary test case detection unit 16 ... prohibition information input unit 17 ... changeable level detection unit 18 ... prohibition contradiction detection unit

Claims (14)

An input unit for inputting factors related to the function of the device or system to be tested and the level that each factor can take;
A matrix creation unit that generates a two-factor coverage matrix of a lattice structure in which factors are arranged vertically and horizontally so as to cover combinations between two factors based on the factors and levels input in the input unit;
A test case input unit for inputting a combination of two variables arbitrarily selected from the factors and levels as a test case;
An coverage calculation unit that calculates the coverage between two factors based on the matrix;
A combination generation unit that generates a combination test in which two variables arbitrarily selected from the factors and levels are combined with each other;
A detection unit that detects a test case that is unnecessary for the coverage between the two factors to satisfy 100%,
The detection of the unnecessary test cases is performed for each Nt test cases.
1) For the N factors, take the levels of the i-th and j-th factors and confirm the number of occurrences on the coverage matrix between the two factors (i is 1 to N-1, j is i to N),
2) In all of the above, if the number of appearances is 2 or more except for the prohibited combinations, it is detected as an unnecessary test case.
Repeat the process of Nt times,
A test case generation support apparatus that deletes the unnecessary test cases from the combination test generated by the combination generation unit.   The test case generation support apparatus according to claim 1, wherein the matrix is generated in a CSV table format or an XML tag format.   The test case generation support device according to claim 1, wherein the test case input unit inputs data of an existing test case that has already been generated. The test according to any one of claims 1 to 3 , wherein the detection unit includes a display unit that displays a test case as GUI information, and deletion of the detected unnecessary test case can be determined by a user operation. Case generation support device. Test case generation support device according to any one of claims 1 to 3 comprising a display unit for displaying the result of the combination tests remove the unnecessary test case. Test case generation support device according to any one of claims 1 to 3 comprising a printing device for printing the results of the combination tests remove the unnecessary test case. An input unit for inputting factors related to the function of the device or system to be tested and the level that each factor can take;
A matrix creation unit that generates a two-factor coverage matrix of a lattice structure in which factors are arranged vertically and horizontally so as to cover combinations between two factors based on the factors and levels input in the input unit;
A test case input unit for inputting a combination of two variables arbitrarily selected from the factors and levels as a test case;
An coverage calculation unit that calculates the coverage between two factors based on the matrix;
A combination generation unit that generates a combination test in which two variables arbitrarily selected from the factors and levels are combined with each other;
A detection unit for detecting a test case that is unnecessary for the coverage between the two factors to satisfy 100%;
A prohibition information input unit for inputting a combination of two variables that cannot be combined as prohibition information;
A changeable level detection unit that detects a changeable level that does not reduce the coverage between two factors even if the level is changed to another level, and
The changeable level detection is performed for each Nt test cases.
1) For the N factors, take the level of the i-th factor and repeat the following process N times:
Take the level of the jth factor other than i and determine the number of occurrences on the test matrix with the level of the ith factor (j is 1 to N),
In all of the above, if the number of appearances is 2 or more except for the prohibited combinations, it is detected as a changeable level.
2) After detecting the changeable level up to the Nth factor, the level of the ith factor is taken out again, and the following process is repeated N times.
If the level of the i-th factor is a changeable level, take the level of the j-th factor other than i and reduce the number of occurrences in the test matrix with the level of the i-th factor by 1 (j is 1 to N),
Is repeated Nt times,
The combination generation unit deletes the unnecessary test cases and generates a test case of a combination satisfying 100% coverage between two factors so that a combination of prohibitions does not appear based on the prohibition information Support device. The test case generation support apparatus according to claim 7 , wherein the combination generation unit generates a test case of a combination that satisfies 100% coverage between two factors at the level detected by the changeable level detection unit. An input unit for inputting factors related to the function of the device or system to be tested and the level that each factor can take;
A matrix creation unit that generates a two-factor coverage matrix of a lattice structure in which factors are arranged vertically and horizontally so as to cover combinations between two factors based on the factors and levels input in the input unit;
A test case input unit for inputting a combination of two variables arbitrarily selected from the factors and levels as a test case;
An coverage calculation unit that calculates the coverage between two factors based on the matrix;
A combination generation unit that generates a combination test in which two variables arbitrarily selected from the factors and levels are combined with each other;
A detection unit for detecting a test case that is unnecessary for the coverage between the two factors to satisfy 100%;
Providing a prohibition contradiction detection unit that detects a contradiction of prohibition set by the user or leakage of prohibition,
Combination test generated by the combination generating unit, together with deleting the unnecessary test case, in response to said inconsistency or leakage of prohibition of the detected constraint, to regenerate a combined test based on the re-entered prohibition information Test case generation support device. Detection of the forbidden leak is
In level B1 of factor B and level C1 of factor C, the forbidden relationship with factor A (levels A1, A2, A3) is
1) Level A1 and level B1, C1 (or both) are prohibited 2) Level A2 and level B1, C1 (or both) are prohibited 3) Level A3 and level B1, C1 If (or both) are prohibited, take advantage of the fact that levels B1 and C1 can be prohibited,
10. The test case generation support apparatus according to claim 9 , wherein the test case generation support apparatus performs the determination by determining that one or both of the two levels for which the combination is checked for all levels of the factor X is prohibited. The test case generation support device according to claim 9 , wherein after the re-input of the prohibition information, a coverage factor between two factors is calculated to determine an influence of the re-input of the prohibition information. An input unit for inputting factors related to the function of the device or system to be tested and the level that each factor can take;
A matrix creation unit that generates a two-factor coverage matrix of a lattice structure in which factors are arranged vertically and horizontally so as to cover combinations between two factors based on the factors and levels input in the input unit;
A test case input unit for inputting a combination of two variables arbitrarily selected from the factors and levels as a test case;
An coverage calculation unit that calculates the coverage between two factors based on the matrix;
A combination generation unit that generates a combination test in which two variables arbitrarily selected from the factors and levels are combined with each other;
A detection unit for detecting a test case that is unnecessary for the coverage between the two factors to satisfy 100%;
Equipped with an exclusion factor and level setting unit that sets exclusion factors and exclusion levels that do not consider combinations,
A test case generation support device that allows the unnecessary test cases to be deleted from the combination test generated by the combination generation unit and allows the factor / level specified by the user to be excluded from the coverage of two factors. 13. The test case generation support according to claim 12 , wherein test cases are generated so as to satisfy 100% of the two-factor coverage of the factors other than the exclusion factor and the exclusion level and the single-function coverage of the exclusion factor level and the exclusion level. apparatus. The test case generation support apparatus according to claim 12 , wherein the input unit also serves as the exclusion factor / level setting unit.