JP2004288034A - Test plan creation support device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a test planning creation support device which can support the creation of test plans in conformity to Japanese hyphenation information with a low processing load by an easy operation. <P>SOLUTION: The present device is configured to support the plan creation of a test on compatibility among a plurality of setting factors. A control part 11 creates a test plan table which lists a plurality of test plans previously defined so that at least one of a plurality of test conditions is different from each other. The device defines n numbers of setting factors among a plurality of setting factors as first to n-th interest setting factors, and, with reference to Japanese hyphenation information which defines default settings which cannot be set together among respective default settings for the n numbers of the interest setting factors, classifies the Japanese hyphenation information into predetermined Japanese hyphenation patterns. As for the setting factors associated with the Japanese hyphenation information, the device executes a predetermined processing for each Japanese hyphenation pattern obtained as the result of such classification, and assigns the default settings of the setting factors to the test conditions in the test plan table. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a test plan creation support device that supports creation of a test plan for equipment software.
[0002]
[Prior art]
In recent years, many devices have been controlled by computer software, and the functions of the devices have advanced, and the number of setting parameters as setting factors for controlling the operation of the devices has also increased. Since such software is created as a module for each function, it is easy to test the set values of the setting factors related to the individual functions in the software creation process. However, testing for compatibility between functions, that is, compatibility between setting factors, can be performed only by combining each software after the software creation process.
[0003]
It is known that the number of combinations of the setting factors is generally enormous. For example, when the combination of each set value is counted in driver software such as a printer, the number of combinations may be on the order of 100 million. Therefore, it is not realistic to manually examine the combination of the set values. Accordingly, an apparatus has been developed which generates a combination of these set values by a computer and supports creation of a software test plan.
[0004]
As an example, an apparatus using an experiment design method creates a test plan using a table called an orthogonal table. In this orthogonal table, a list of tests to be performed is arranged on the vertical axis, a list of set values is arranged on the horizontal axis, and each set value has two levels (one of two states of ON or OFF). Only), 2 n combinations are created for the n set values. Then, while referring to the created combination, a set value for each test is set, and a program (test script) for performing the process is created.
[0005]
In another example, a combination of set values in each test is created using combination theory.
[0006]
[Problems to be solved by the invention]
However, an apparatus using the above-described conventional design of experiment includes all combinations of set values in an orthogonal table. Therefore, as a specification of the device, in a prohibited combination, for example, in a specification that two-sided printing cannot be performed when a color original is printed, a color setting value is selected for a color / monochrome setting factor, and a one-sided / two-sided printing is selected. Although a combination in which the setting values of both sides are selected for the setting factor does not require a test, the apparatus using the above-described conventional experiment design method also includes this combination in the test.
[0007]
In an apparatus using the combination theory, it is possible to create a test that avoids such set values that cannot be set together (prohibition setting). However, in this case, it is always necessary to set all the setting values other than the prohibition setting. List the combinations and target them for testing. According to this, although the quality of the test is desirable, there is a problem that the processing load for creating the test plan increases due to the processing for avoiding the setting of the prohibition. Furthermore, in order to avoid the setting of prohibition by adopting the combination theory, the information (prohibition information) defining the set values that cannot be set together must be set by a logical expression in accordance with the combination theory. For this reason, a tester must create a logical expression, and there is a problem that the operation is complicated.
[0008]
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a test plan creation support device that can support creation of a test plan corresponding to prohibition information with low processing load and simple operation. One.
[0009]
[Means for Solving the Problems]
The present invention for solving the problems of the above conventional example is an apparatus for supporting creation of a plan for testing compatibility between a plurality of setting factors, wherein at least one of a plurality of test conditions is different from each other. Means for creating a test plan table listing a plurality of test plans defined in advance, and n setting factors among the plurality of setting factors as first, second,. A classification in which, for the n target setting factors, prohibition information that specifies setting values that cannot be set together among the setting values is referred to, and the prohibition information is classified into a predetermined prohibition pattern. Means, for a set factor related to the prohibition information, execute a process determined for each prohibition pattern obtained as a result of the classification. The test conditions of the test plan table is characterized in that it comprises, an assignment means for assigning each set value of the setting factor.
[0010]
In addition, the classification unit may be configured to set the prohibition information such that (a) the first attention setting factor is a specific setting value, or the second to n-th attention setting factors are each a combination of specific setting values. A first prohibition pattern that can be set only when the second attention mode is set, and (b) the second to n-th settings that can be set together with the set value of the first attention setting factor regardless of the setting value of the first attention setting factor. Regardless of the combination of the setting values of the attention setting factors or the combination of the setting values of the second to n-th attention setting factors, the first setting can be performed together with the combination of the setting values of the second to n-th attention setting factors. (C) any one of the first prohibition pattern and the second prohibition pattern, in which one of the set value of the attention setting factor exists. And the third prohibition pattern, and the allocating means performs at least the first prohibition pattern on the prohibition information classified as either the first prohibition pattern or the second prohibition pattern. For the two first and second attention setting factors classified as, a process of generating a virtual setting factor having a set value, which is a set of set values that can be set together, is performed. A process of allocating to one of the test conditions in the created test plan table is performed. (B) For the n attention setting factors classified as the second prohibition pattern, specific setting values of the first attention setting factor A sub-test plan table is created in which the test conditions are assigned with the setting values of the second to n-th attention setting factors that can be set together therewith. , The test plan table, assign each setting value of the first target set factor as a test condition, in the test plan table, the may perform the processing for combining the sub-test plan table.
[0011]
Furthermore, a value obtained by dividing the number of tests performed in accordance with the test plan table after the assignment of the set values by the assigning means by the number of patterns of all combinations except for the combinations of the settings related to the prohibition information is a coverage ratio. May be further provided, and the calculated coverage may be subjected to a predetermined process.
[0012]
Here, when the coverage is lower than a predetermined value, for each of the setting factors related to the prohibition information, a combination that is not specified by the prohibition information among combinations of the set values, and a test plan table It is also preferable to selectively add at least one combination not included in the test plan table to the test plan table. In this case, in selecting a combination of set values to be added to the test plan table, reference is made to a predetermined priority for each set factor, and selection is performed in order from the set value relating to the set factor with the highest priority. It is also preferable to use it.
[0013]
Further, the present invention for solving the problems of the above-mentioned conventional example is a method for supporting creation of a plan for testing compatibility between a plurality of setting factors, and is a test plan creation support method using a computer. Creating a test plan table listing a plurality of test plans defined in advance such that at least one of the plurality of test conditions is different from each other; and n sets out of the plurality of setting factors, As the first, second,..., N-th attention setting factors, for each of the n attention setting factors, reference is made to prohibition information that defines setting values that cannot be set together among the respective setting values. A classification step of classifying the prohibition information into a predetermined prohibition pattern, and a setting factor related to the prohibition information, Executes processing specified to each prohibition pattern obtained as a result, the test conditions of the test plan table, is characterized by performing a assignment step of assigning each set value of the setting factor.
[0014]
Further, a program for supporting the creation of a plan for testing compatibility between a plurality of setting factors according to another aspect of the present invention has a computer in which at least one of a plurality of test conditions is predefined so as to be different from each other. A procedure for creating a test plan table listing a plurality of test plans; and setting the n set factors among the plurality of set factors as first, second,. Referring to the prohibition information that specifies setting values that cannot be set together among the respective setting values, and classifying the prohibition information into a predetermined prohibition pattern; For the setting factor according to the information, execute a process determined for each prohibition pattern obtained as a result of the classification, A serial test plan table test conditions, to execute a procedure for assigning each set value of the setting factor.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
An embodiment of the present invention will be described with reference to the drawings. The test plan creation support device according to the embodiment of the present invention is realized by a computer including a control unit 11, a storage unit 12, an operation unit 13, and a display unit 14, as shown in FIG. The control unit 11 operates according to the program stored in the storage unit 12, creates a test plan table, and assigns set values of set factors to create an orthogonal table. Further, the control unit 11 refers to prohibition information defined in advance, performs a predetermined process based on the prohibition information, and creates an orthogonal table. The specific contents of the processing of the control unit 11 will be described later in detail.
[0016]
The storage unit 12 includes a computer-readable storage medium such as a hard disk that holds a program executed by the control unit 11, and may also serve as a work memory that holds information created by the control unit 11 in the course of the processing. Operate. The operation unit 13 is a keyboard, a mouse, or the like, and outputs user operation contents to the control unit 11. The display unit 14 is a display or the like that displays information according to an instruction input from the control unit 11.
[0017]
Here, the content of the processing by the control unit 11 will be described. The processing of the control unit 11 specifically includes input of information, creation of a test plan table, classification of prohibition information, processing for a setting factor related to prohibition, assignment of each set value to the test plan table, and the like. Yes, they will be described first. In the following example, a case where the software of the printer driver is tested will be described as an example.
[0018]
[Reception of information input]
In the present embodiment, the user specifies information specifying each set factor (factor), set values (levels) related to each set factor, prohibition information, and a coverage threshold as required quality information. Enter each. The information for specifying each setting factor is, for example, the name of a setting parameter, such as “paper size” and “output tray”. The set value related to each set factor is a list of values that can be set for each set factor, and is, for example, a value such as “A4” or “B4” for the set factor of “paper size”.
[0019]
In this embodiment, the prohibition information is input using a guidance display as shown in FIG. When the control unit 11 receives the information for specifying the setting factors and the input of the setting values for each of the setting factors, the control unit 11 stores them in the storage unit 12, and then displays a list of the information for specifying the setting factors on the display unit 14. indicate. The user selects a plurality of setting factors for which the prohibition information is to be set from this display. Specifically, the user selects one of the setting factors as the prohibition setting factor, and selects at least one setting factor as the prohibition condition factor. The control unit 11 arranges the combinations of the setting values related to the prohibition condition factors on the vertical axis, and arranges the setting values related to the prohibition setting factors on the horizontal axis (FIG. 2). The example of FIG. 2A shows an example in which the paper size is set as the prohibition condition factor and the setting factor of double-sided printing is selected as the prohibition setting factor. In the example of FIG. An example is shown in which each setting factor for printing is set as a condition factor, and a setting factor for a binding margin is selected as a prohibition setting factor. As shown in FIG. 2B, when a plurality of prohibition condition factors are selected, all combinations of the respective values are listed.
[0020]
The user clicks with the mouse on a matrix portion related to a combination that cannot be set together (a combination having a prohibited relationship) in the matrix displays of FIGS. 2A and 2B. At this time, it is preferable that the control unit 11 performs a display indicating that the prohibition information has been defined, such as changing the color of the clicked matrix portion or displaying a symbol such as “x”. Here, when the user instructs that the input has been completed, the control unit 11 stores information of the displayed matrix in the storage unit 12 as prohibition information. When there are a plurality of prohibition information, the control unit 11 stores each of them in the storage unit 12.
[0021]
Further, the user may input a coverage threshold as the required quality information. The threshold value is a value from 0 to 100%, and can be input as a numerical value. The control unit 11 stores and holds the input value in the storage unit 12.
[0022]
[Create Test Plan Table]
The control unit 11 performs a test of a size capable of arranging all combinations of the respective set values of the set factors of the set factors input by the user, except for those selected as the prohibition set factors. A plan table (orthogonal table) is created and stored in the storage unit 12. At this point, it is not necessary to assign specific setting values, and an orthogonal table for identifiers may be created instead of setting values (FIG. 3). Since the creation of the orthogonal table is the same as that of the apparatus using the conventional design of experiment, detailed description thereof is omitted. Hereinafter, this orthogonal table is referred to as a main test plan table.
[0023]
Each row of the orthogonal table corresponds to each test, and the setting value of each setting factor is assigned to each column, and the test condition is formed by a combination of the assigned setting values.
[0024]
[Classification of prohibited information]
Next, the control unit 11 refers to each prohibition information input by the user and classifies them into a predetermined prohibition pattern. Specifically, a setting factor selected by the user as a prohibition setting factor (hereinafter, referred to as a first attention setting factor) and a plurality selected as prohibition condition factors (hereinafter, referred to as second to n-th attention setting factors, respectively) , A pattern in which both can be set only when the first attention setting factor is a specific setting value or when the second to n-th attention setting factors are a combination of specific setting values. Check if it is not.
[0025]
This pattern is, as shown in FIG. 4 (a), specifically, whether the set of set values that can be set together is one column or one row in the matrix input in FIG. It can be detected by checking whether at least one of them is present. In the example of FIG. 4A, prohibition information between a setting factor for enlargement / reduction and a setting factor for printing a plurality of original documents together on one sheet (referred to as an N-up setting factor for convenience) is shown. However, in this case, any setting value of the N-up setting factor can be set as long as the setting value indicates that the enlargement / reduction is not performed. Similarly, if the N-up setting factor is a setting value of “no”, the setting value of the enlargement / reduction may be any setting value. For this reason, a set of set values that can be set together appears in both “no” rows and columns.
[0026]
When such a pattern is detected, the control unit 11 classifies the prohibition information as a “first prohibition pattern” and stores the classification result in the storage unit 12. Specifically, an identifier may be assigned to each piece of prohibition information in the storage unit 12, and a table may be created and stored in which the classification result of the prohibition pattern is associated with the identifier.
[0027]
Further, the control unit 11 may set a combination of the setting values of the second to n-th attention setting factors that can be set together with the setting value of the first attention setting factor, regardless of the setting value of the first attention setting factor, or One of the setting values of the first attention setting factor that can be set together with the combination of the setting values of the second to n-th attention setting factors regardless of the combination of the setting values of the second to n-th attention setting factors Check whether to do it.
[0028]
For example, as shown in FIG. 4 (b), when the paper size is “A6” or “B4”, the set factor of the duplex In this case, it can be performed by checking whether there is a combination of set values that can be set for a plurality of rows or a plurality of columns, as defined as not being prohibited. The control unit 11 classifies such prohibition information as a “second prohibition pattern” and stores the classification result in the storage unit 12.
[0029]
Further, the control unit 11 classifies a prohibition pattern that does not correspond to any of these as a “third prohibition pattern”, and stores the classification result in the storage unit 12.
[0030]
In short, as shown in FIG. 5, the control unit 11 selects one of the prohibition information stored in the storage unit 12 for which the classification has not been completed (S1), and selects the selected prohibition information. It is checked whether or not the prohibition information is the first prohibition pattern (S2). If the prohibition information is the first prohibition pattern, information for specifying the selected prohibition information and information indicating that it is the “first prohibition pattern” are displayed. Is stored in the storage unit 12 (S3), and it is checked whether there is any prohibition information whose classification has not been completed (S4). If there is such prohibition information, the process returns to step S1 to continue the processing. .
[0031]
If there is no such prohibition information in the process S4, the process ends. Further, in the processing S2, if the selected prohibition information is not the first prohibition pattern, it is checked whether or not it is the second prohibition pattern (S5). If the prohibition information is the second prohibition pattern, the information for specifying the selected prohibition information is determined. And the information indicating that the pattern is a “second prohibition pattern” are stored in the storage unit 12 in association with each other (S6), and the process proceeds to S4. If it is not the second prohibition pattern in the process S5, the information specifying the selected prohibition information is stored in the storage unit 12 in association with the information indicating the “third prohibition pattern” (S7). Then, the process proceeds to S4.
[0032]
[Process for setting factor related to prohibition]
Next, the control unit 11 performs the following processing for each piece of prohibition information based on the result of each classification. The processing corresponding to the result of each classification will be described below.
[0033]
[Process on First Prohibition Pattern]
For the prohibition information classified as the first prohibition pattern, a set of set values that can be set together is extracted with reference to the prohibition information, and each of the extracted set of set values is replaced with a virtual set value. Create a virtual configuration factor.
[0034]
To be more specific, using the example shown in FIG. 4A, enlargement / reduction and enlargement / reduction are not performed for a set of one set factor, and none of the set factors are collectively set to “none”. , "No / No", and similarly, "25% / No", "70% / No", "400% / No", "No / 2-up", "No / 4" A virtual setting factor that takes one of seven virtual setting values of "up" and "8 up" and fuses a setting factor of "enlargement / reduction" and a setting factor of "one piece at a time". Create
[0035]
Then, this virtual setting factor is assigned to the main test plan table using a dotted line diagram. The result of this assignment is as shown in FIG. Since the dotted line diagram is an assignment assisting method that is widely known in the experimental design method, a detailed description thereof will be omitted. If the number of the dotted diagrams is larger than the number of virtual setting values of the virtual setting factors to be allocated, a dummy is allocated. In FIG. 6A, “DMY_No. 2 up” is assigned as a dummy.
[0036]
Next, for the main test plan table after the assignment, the original (before fusion) setting factors are separated from the virtual setting factors (FIG. 6B). Thus, the assignment is completed.
[0037]
[Processing for Second Prohibition Pattern]
The control unit 11 processes the prohibition information classified as the second prohibition pattern as follows. Hereinafter, for the purpose of explanation, the prohibition information of the second prohibition pattern to be processed is referred to as “attention prohibition information”.
[0038]
First, among the set values related to the prohibition condition factor and the prohibition setting factor of the prohibition information of interest, all of the specific setting values of the prohibition condition factor are such that all the setting values of the prohibition setting factor do not have a prohibition relation. A test plan table (orthogonal table) having a size that can be arranged is created as a sub test plan table and stored in the storage unit 12 (FIG. 7A). Then, the setting value relating to the prohibition condition factor is assigned to the subtest plan table. Here, if the number of set values is smaller than the number that can be arranged in the created sub test plan table, a dummy set value is created and assigned to the sub test plan table.
[0039]
The specific processing contents will be described below with reference to the example shown in FIG. In this example, of the seven setting values of the prohibition condition factor “paper size”, there are two specific setting values “A4” and “B4” that are not prohibitively related to all the setting values of the prohibition setting factor. Yes, there are three set values for the prohibition setting factor "double-sided", so create a sub-test plan table containing four types of test plans for the number that can be arranged, for example, prohibition condition factors, and for the surplus two Assigns dummy paper sizes “DMY_A4” and “DMY_B4”.
[0040]
When the same processing is performed for the prohibition setting factor, a sub test plan table is created as shown in FIG. 7B.
[0041]
On the other hand, on the main test plan table, all set values related to the prohibition condition factors are assigned. Then, among the set values of the prohibition condition factors on the main test plan table, the rows having the same set values as the set values on the sub test plan table include the row of the sub test plan table. This is called a plan table combining process). At this time, a column of prohibition setting factor is added to the main test plan table.
[0042]
For the rows related to the setting values not in the sub-test plan table, in this example, for the rows in which the “paper size” is “postcard”, the column of the added prohibition setting factor is set to the default value ( Default value). If a default value is not defined in advance for the setting factor that is the prohibition setting factor and there is no information on the default value in the storage unit 12, a NULL value is assigned to the column. Thus, the assignment to the main test plan table is completed as shown in FIG.
[0043]
Further, another prohibition information may be set in the storage unit 12 using the setting factor related to the prohibition setting factor on the sub-test plan table as the prohibition condition factor. That is, in this example, the setting factor related to the prohibition setting factor is “double-sided”, but another prohibition information (FIG. 8) in which this setting factor “double-sided” is a prohibition condition factor may be included. In this case, for this prohibition information, a sub test plan table (second sub test plan table) of the sub test plan table (first sub test plan table) is created, and the second sub test plan table is stored in the first sub test plan table. The sub test plan table may be combined, and the combined first test plan table may be combined with the main test plan table.
[0044]
Similarly, the processing can be performed in the same manner when the set factor relating to the prohibition setting factor on the second sub-test plan table includes another prohibition information that is a prohibition condition factor.
[0045]
In addition, among the prohibition information stored in the storage unit 12, if the prohibition information currently being processed and the prohibition condition factor are common, and if there is another prohibition information having the same prohibition relation to it, The prohibition information being processed and the other prohibition information may be assigned to the same sub-test plan table. For example, as shown in FIG. 9, there is prohibition information for setting a prohibition setting factor “paper tray” for a prohibition condition factor “paper size”, and the relation of the prohibition in this information is a paper size “A4” or “B4”. In this case, it is assumed that each setting value of the paper feed tray can be set. In this case, with respect to the three setting factors (one prohibition condition factor and two prohibition setting factors), among the set values of the prohibition condition factors, the set values that do not have any prohibition relationship with any of the prohibition setting factors (specified) What is necessary is just to create a sub-test plan table in which the items related to (set values) are arranged, and to combine this with the main test plan table.
[0046]
In addition, in the description so far, an example has been described in which the prohibition relation disappears when the prohibition condition factor has a specific setting value (an example in which there are a plurality of rows having no prohibition relation), but the prohibition setting factor has a specific value. The same processing can be performed in an example where the prohibition relation is sometimes lost (an example in which there are a plurality of columns having no prohibition relation).
[0047]
[Process on Third Prohibition Pattern]
The third prohibition pattern does not belong to any of the first and second prohibition patterns, and it looks as if the prohibition relations are randomly arranged. For example, for two setting factors “document orientation” and “double-sided”, a setting factor of a position for setting a margin by a stapler or the like is “document orientation” as shown in FIG. When the set value of “double-sided” is a combination of specific set values, there is no relation that all the set values related to the binding position can be set together.
[0048]
For the prohibition information classified as the third prohibition pattern, the control unit 11 either (1) ignores the prohibition information and creates a brute force test plan for each set value, or (2) sacrifice orthogonality. Or assigning while avoiding the prohibition relationship indicated in the prohibition information. This selection may be made based on the content set by the user. By doing so, when processing is performed as in (1), the combination of the set values of the prohibition relation of the third prohibition pattern is included in the test, but the combination of the prohibition relation of the first and second prohibition patterns is included. Since the test of a certain combination of setting values is omitted, improvement in test efficiency is expected. Further, according to the method (2), the processing load for creating the test plan increases, but the test efficiency can be further improved.
[0049]
In the following, a description will be given of the processing of the control unit 11 in the case where the assignment is performed with respect to the third prohibition pattern while avoiding the prohibition relationship indicated in the prohibition information at the expense of orthogonality. In this process, the control unit 11 performs a four-stage process of pattern analysis, generation of a virtual set value, selection of a virtual set value, and assignment of a virtual set value.
[0050]
First, in the pattern analysis, a virtual setting value in which setting values on the prohibition condition factor side having a common prohibition relationship are created with reference to the prohibition relationship of the prohibition setting factor for each prohibition condition factor. More specifically, in the example of FIG. 10A, the prohibition condition factors including the two setting factors of “orientation of the original” and “both sides” are “vertical / short side binding”, “horizontal / none”, and “horizontal / none”. Since the three setting values “short side binding” have a common prohibition relationship, they are put together to generate an analysis pattern shown in FIG. 10B.
[0051]
Next, for each line of the analysis pattern, a line having no prohibition relation is extracted as a set. Then, from the example shown in FIG. 10 (b), a set of “no / short side / long side left / long side right” is extracted from the first line for the prohibition setting factor “margin position”. From the second row, a set of “No / Long side left / Long side right” is extracted. From the third row, a set of “No / Short side left / Short side right” is extracted. From the line, a set of "No / long side" is extracted. The control unit 11 stores each of the extracted sets as a virtual setting factor, and stores each value included in each of the virtual setting factors in the storage unit 12 as a virtual setting value.
[0052]
Next, for each virtual setting factor, the control unit 11 creates a table including 2 n (n is 2 or more) entries to which all of the virtual setting values can be assigned. That is, in the case of the example here, since at most four virtual setting values are included, a table including four entries is created. Then, for each entry, a line diagram for assignment to the main test plan table is associated. Since the dotted line diagram is an assignment assisting method that is widely known in the experimental design method, a detailed description thereof will be omitted.
[0053]
In this example, there are four types of virtual setting factors, but the same diagram is used when assigning the diagram. The control unit 11 assigns a line diagram relating to the “margin position” on the main test plan table (FIG. 11), and then, in the prohibition information, sets each setting value on the prohibition condition factor side to which virtual setting factor. Is created (FIG. 12).
[0054]
The control unit 11 examines each set of the set values of the above-mentioned prohibition condition factors in each row on the main test plan table with reference to the correspondence table, and specifies the virtual set factors corresponding to the set. Then, the set value of the “margin position” corresponding to the dotted line diagram in the row in the specified virtual setting factor is assigned (FIG. 13).
[0055]
In more detail with reference to the example of FIG. 13, in the first line, the set of the set values of the prohibition condition factors is “vertical / none”, which is “1” of the virtual setting factor on the correspondence table. Corresponding to Then, since the line diagram of the “margin position” in the first line is “0”, the set value of the line diagram “0” in the virtual setting factor “1” and “not performed” are “0” in the line. Is assigned to the "margin position".
[0056]
The second line similarly corresponds to a set of set values of the prohibition condition factor of “vertical / long side binding”, which corresponds to the virtual set factor “2”. Then, since the line diagram of the "margin position" on the second line is "11", the set value of the line diagram "11" in the virtual setting factor "2" and the "long side left" are Is assigned to the "margin position".
[0057]
Depending on the assignment of the setting values related to the third prohibition pattern performed in this way, not all of the setting values (levels) on each virtual setting factor are necessarily assigned to the main test plan table, and the orthogonality is not guaranteed. It is not certain.
[0058]
[Assignment of setting value of setting factor regardless of prohibition information]
Note that the assignment of the setting value of the setting factor irrespective of the prohibition information is performed in the same manner as the assignment of the setting value in the apparatus using the conventional experiment design method, and thus the detailed description is omitted.
[0059]
[Use Main Test Plan Table]
Using the main test plan table to which the setting values have been assigned in this way, the control unit 11 sets the setting values of each row as test conditions and creates a test script for causing an actual test to be performed. In this case, if any of the set values is dummy, the test script corresponding to the line is not created. If any of the setting values is NULL, a test script in which the setting of the setting value is omitted is created.
[0060]
Specifically, when “1”, “2”, and “3” are set as test conditions for the setting factors A to C, respectively, the control unit 11 sets “A = 1.B = 2.C = 3”. A test script that outputs an instruction to set and then outputs an instruction to start a test is created. For the setting factors A to C, “1”, “NULL”, and “3” are set as test conditions, respectively. In this case, the control unit 11 creates a test script that omits the setting for B, outputs an instruction to set “A = 1.C = 3”, and then outputs an instruction to start a test.
[0061]
A test based on the test script is performed on the software to be tested, a list of the test results is stored in the storage unit 12, and the main test plan table is displayed on the display unit 14 in accordance with a user's instruction. The test result is displayed in association with each of the above tests. With this display, the user obtains information on the compatibility of each setting factor. For example, when the results are sequentially displayed while each test is sequentially performed, if the test always fails in a combination of “1” for the setting factor A and “3” for C, these setting values Interoperability between them is suspected.
[0062]
[Calculation of coverage rate]
In addition, the control unit 11 determines the number of tests (the number of created test scripts) obtained from the main test plan table to which the assignment has been performed for all the setting values except for the combination of the settings related to the prohibition information. A value obtained by dividing by the number of combinations of patterns may be calculated as the coverage rate and output to the display unit 14 for display.
[0063]
In this case, the control unit 11 compares the calculated coverage with the coverage threshold when the coverage threshold is input in advance by the user and is stored in the storage unit 12. Is lower than the coverage threshold, for each set factor related to the prohibition information, a combination that is not specified by the prohibition information and that is not included in the test plan table among combinations of the set values. , At least one of which is selectively added to the test plan table.
[0064]
Specifically, if there is a setting value that does not appear among the setting values of the setting factors included as the prohibition setting factor in the prohibition information classified as the third prohibition pattern, the prohibition does not appear. A set of set values of each set factor including the set values (rows on the main test plan table) may be individually input and created by the user, and may be added.
[0065]
The control unit 11 recalculates the coverage of the main test plan table after the addition, and repeatedly performs the additional processing until the coverage exceeds the coverage threshold.
[0066]
In this case, in selecting a combination of setting values to be added to the test plan table, reference is made to a predetermined priority order for each setting factor, and selection is performed in order from the setting value relating to the setting factor having a higher priority order. Is also preferable. That is, when there are a plurality of prohibition information classified as the third prohibition pattern, of the prohibition setting factors in each of the prohibition information, a priority determined in advance as an order of performing a test with higher priority among the set factors in advance. A test including a setting value that does not appear among the setting values of the setting factor is created for the setting factor with a high value.
[0067]
[motion]
As described above, according to the test plan creation support device of the present embodiment, the prohibition information is set according to the relationship of the matrix, and the prohibition information is classified into the prohibition patterns. Then, according to the classification result, a test plan table (main test plan table) in which the set of setting values having a prohibition relationship is reduced (or does not include such a set of set values) is created, and based on the test plan table. A test script is created.
[0068]
Further, the coverage is calculated, and the quality of the created test plan table is objectively calculated. At this time, if the required quality is not achieved, a test is added to ensure the quality.
[Brief description of the drawings]
FIG. 1 is a configuration block diagram of a test plan creation support device according to an embodiment of the present invention.
FIG. 2 is an explanatory diagram illustrating an example of an input interface for prohibition information.
FIG. 3 is an explanatory diagram illustrating an example of an orthogonal table before assignment.
FIG. 4 is an explanatory diagram illustrating an example of prohibition information.
FIG. 5 is a flowchart illustrating an example of a prohibition information classification process.
FIG. 6 is an explanatory diagram illustrating a process of a process regarding a first prohibition pattern.
FIG. 7 is an explanatory diagram showing an example of sub-test plan tables created in the process of a process related to a second prohibition pattern, and an example of assigning them to a main test plan table.
FIG. 8 is an explanatory diagram illustrating an example of other prohibition information referred to in a process regarding a second prohibition pattern.
FIG. 9 is an explanatory diagram illustrating an example of other prohibition information referred to in a process regarding a second prohibition pattern.
FIG. 10 is an explanatory diagram illustrating a state of a pattern analysis of a process regarding a third prohibited pattern.
FIG. 11 is an explanatory diagram illustrating a setting example on a main test plan table for assigning a setting factor according to a third prohibition pattern.
FIG. 12 is an explanatory diagram illustrating an example of a correspondence table for selecting a virtual setting value according to a third prohibition pattern.
FIG. 13 is an explanatory diagram illustrating an example in which a setting factor according to a third prohibition pattern is assigned to a main test plan table.
[Explanation of symbols]
11 control unit, 12 storage unit, 13 operation unit, 14 display unit.

Claims (7)

A device that assists in creating a plan for testing compatibility between multiple configuration factors,
Means for creating a test plan table, listing a plurality of test plans that are defined in advance such that at least one of the plurality of test conditions is different from each other,
.., N-th attention setting factor among the plurality of setting factors, respectively, and the n attention setting factors are set together among the respective setting values. Classifying means for classifying the prohibition information into a predetermined prohibition pattern by referring to prohibition information that specifies setting values that cannot be performed;
Allocating means for executing a process determined for each of the prohibition patterns obtained as a result of the classification, and assigning each set value of the set factor to a test condition of the test plan table for the set factor relating to the prohibition information; When,
A test plan creation support device characterized by including: The test plan creation support device according to claim 1, wherein
The categorizing means may include the prohibition information,
(A) A first prohibition pattern that can be set only when the first attention setting factor is a specific setting value or when the second to n-th attention setting factors are each a combination of specific setting values. When,
(B) Regardless of the setting value of the first attention setting factor, a combination of the setting values of the second to n-th attention setting factors that can be set together with the setting value of the first attention setting factor, or the second to the n-th attention setting factors. Irrespective of the combination of the setting values of the n-th attention setting factor, the setting value of the first attention setting factor which can be set together with the combination of the setting values of the second to n-th attention setting factors;
A second forbidden pattern in which any one of
(C) a third prohibited pattern, which is neither the first prohibited pattern nor the second prohibited pattern;
Classified into one of
The allocating means may include at least the prohibition information classified into one of the first prohibition pattern and the second prohibition pattern,
(A) For the two first and second attention setting factors classified as the first prohibition pattern, a process of generating a virtual setting factor having a set value, which is a set of set values that can be set together. Performing the process of assigning the virtual setting factor to one of the test conditions of the created test plan table,
(B) For the n attention setting factors classified as the second prohibition pattern, the specific setting value of the first attention setting factor and the setting values of the second to n-th attention setting factors that can be set together therewith. Is created as a test condition, and each set value of the first attention setting factor is assigned as a test condition to the test plan table, and then the sub test plan table is assigned to the test plan table. A test plan creation support device that performs a combining process. The test plan creation support device according to claim 1 or 2,
The value obtained by dividing the number of tests performed in accordance with the test plan table after the assignment of the set values by the assigning means by the number of patterns of all combinations except for the combination of settings related to the prohibition information is calculated as the coverage. Further comprising means for:
A test plan creation support device characterized in that the calculated coverage is provided for a predetermined process. The test plan creation support device according to claim 3, wherein
When the coverage is lower than a predetermined value, each set factor related to the prohibition information is a combination that is not defined by the prohibition information among combinations of the set values, and is included in the test plan table. A test plan creation supporting device, wherein at least one combination that does not exist is selectively added to a test plan table. The test plan creation support device according to claim 4,
In selecting a combination of setting values to be added to the test plan table, a predetermined priority is referred to for each setting factor, and selection is sequentially performed from setting values related to setting factors having higher priority. Test plan creation support device. A method that assists in developing a plan for testing the compatibility of multiple configuration factors, using a computer,
A step of creating a test plan table, listing a plurality of test plans defined in advance such that at least one of the plurality of test conditions is different from each other,
.., N-th attention setting factor among the plurality of setting factors, respectively, and the n attention setting factors are set together among the respective setting values. Referring to the prohibition information defining the set values that cannot be performed, and classifying the prohibition information into a predetermined prohibition pattern;
An assigning step of executing a process determined for each of the prohibition patterns obtained as a result of the classification for the set factors related to the prohibition information, and assigning each set value of the set factors to a test condition of the test plan table; When,
A test plan creation support method, characterized by executing the following. A program that helps you create a plan for testing the compatibility of multiple configuration factors,
A procedure for creating a test plan table that enumerates a plurality of test plans defined in advance such that at least one of the plurality of test conditions is different from each other,
.., N-th attention setting factor among the plurality of setting factors, respectively, and the n attention setting factors are set together among the respective setting values. A procedure for referring to prohibition information that defines setting values that cannot be performed, and classifying the prohibition information into a predetermined prohibition pattern;
For a setting factor related to the prohibition information, executing a process determined for each prohibition pattern obtained as a result of the classification, and allocating each set value of the setting factor to a test condition of the test plan table. ,
A test plan creation support program characterized by executing

Images