JP2006209521A - Automatic test item generating device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an automatic test item generating device which automatically prepares and extracts a test item from advice etc. of a technical standard and an inputted function standard. <P>SOLUTION: The automatic test item generating device is provided with a standard storing part 101 for storing standards or the like and performing modification and addition, a user specification inputting part 102 for inputting system standards, limitation conditions or the like, a flowchart preparing part 103 for preparing a system flowchart, a sequence preparing part 104 for preparing, as a program, a sequence that is realized by a system from the flowchart, a test item preparing part 105 for automatically preparing a test item of a function that is realized by the system, a test item extracting part 106 for setting and extracting an extraction condition for the automatically prepared test item, a memory part 107 and a control part 108 for controlling the whole, and the automatic test item generating device automatically generates a test item that satisfies system specifications and standard requirement conditions. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for automatically creating test items used for software development or the like.

  Normally, when testing a system that involves software development, it is necessary to prepare each functional specification of the system to be tested, a processing flow realized in the system, test items, and test results.

  The function specifications of the system are input data, output data, processing contents, restrictions and restrictions of each function. The processing flow is the processing order or branching condition of each function in the system. The test item is a parameter value transmitted and received between the test apparatus and the apparatus under test. The test result is to determine whether or not it matches the assumed specification when processing based on the designated test item and processing flow is performed, according to the end state.

  Conventionally, when creating test items, in order to test all paths in the processing flow realized in the system, the patterns of all paths in the processing flow have to be extracted manually, and technical standards In a system that has a function that complies with the recommendations of the system, test items that satisfy the requirements of the recommendation and take the scope of application into consideration must be created. In addition, since the parameter values set for each path pattern are manually determined as test items, a huge amount of work has occurred.

  In addition, if a developer who is not familiar with the content of the technical standard recommendation performs these test item creation tasks, it may create test items that are outside the scope of the recommendation, or errors due to lack of test items or careless mistakes. As a result, the reliability of the test item itself is reduced.

In order to solve such a problem, a technique for automatically extracting test items from an input functional specification has been developed. For example, the technology disclosed in Patent Document 1 automatically uses a knowledge base and an inference mechanism to test items for confirming whether or not a communication node that implements a communication protocol conforms to the protocol specifications. It is related to the method of extracting.
Japanese Patent Publication No. 7-105828

  The method disclosed in Patent Document 1 automatically extracts test items using an expert system and gives a function to be tested, a test sequence, test data, and a test result. It is excellent in that it can help.

  However, the method using an expert system is extremely useful in a system suitable for creating a knowledge base and using an inference mechanism, such as a communication node that implements a communication protocol. It is not always easy to apply.

  The present invention provides a test item automatic generation apparatus capable of automatically creating and extracting test items from technical standard recommendations and inputted functional specifications in a system test involving general software development. For the purpose.

  An automatic test item generation apparatus according to the present invention includes a standard storage unit that stores standards and corrects and adds them, a user specification input unit that inputs system specifications and restriction conditions, and a flowchart creation unit that creates a flowchart of the system A sequence creation unit that creates a sequence realized by the system as a program in a high-level programming language from the flowchart, a test item creation unit that automatically creates a test item of a function realized by the system, and a test item that is automatically created A test item extraction unit for setting and extracting extraction conditions; a memory unit for storing programs; the standard storage unit, a user specification input unit, a flowchart creation unit, a test item creation unit, a test item extraction unit, and a memory unit; A control unit for controlling.

  According to the above configuration, when creating and extracting test items for a system having functions in accordance with the specifications of the input system specifications and technical standard recommendations, the applicable range and conditions that satisfy these requirements In addition, since test items can be automatically generated taking into account the processing contents and restrictions of each function, it is possible to reduce the amount of work for creating test items and improve the reliability of test items.

  In the present invention, the sequence creation unit automatically creates the program from the flowchart.

  In the present invention, the sequence creation unit holds information associating a step shape (shape) in the flowchart with a step of the program.

  In the present invention, the standard storage unit has a standard image created on the basis of a technical standard recommendation, etc., and specifications, restrictions, conditions, etc. specific to the system inputted by the standard image and the user specification input means Search the parameter list to be used and determine the symbol specifications, restrictions and conditions.

  According to the above configuration, even when a developer who is not familiar with the content of the recommendation collection performs work, the scope of application that satisfies these requirements and the processing content and restrictions of each function can be determined. It is possible to avoid the occurrence of errors and omissions in the generated test items.

  According to the present invention, it is possible to reduce the amount of work in the creation of test items that take into account the application requirements that satisfy the requirements of standards such as input system specifications and technical standard recommendations, and the processing contents and restrictions of each function. The reliability of test items can be improved. In addition, test items for functions realized by the system can be created without errors or omissions.

  FIG. 1 is a block diagram showing a configuration of a test item automatic generation apparatus according to an embodiment of the present invention. In FIG. 1, 101 is a standard storage unit, 102 is a user specification input unit, 103 is a flowchart creation unit, 104 is a sequence creation unit, 105 is a test item creation unit, 106 is a test item extraction unit, 107 is a memory unit, and 108 is It is a control unit.

  In the standard storage unit 101, standards such as technical standard recommendations are stored by the standard storage means, and are corrected and added. In the user specification input unit 102, specification of standards realized by the system, restrictions and conditions are input by the user specification input means. In addition, not only functions defined by the standard but also restrictions and conditions of other functions realized by the system are input.

  The flowchart creation unit 103 creates a flowchart of a processing flow realized by the system using information input from the user specification input unit 102. The sequence creation unit 104 creates a sequence program using a high-level programming language or the like from the flowchart created by the flowchart creation unit 103.

  The test item creation unit 105 automatically creates test items. The test item extraction unit 106 sets extraction conditions such as which test items are extracted from the automatically created test items, and sets extraction conditions for test items to be newly added or deleted. Extract test items.

  The memory unit 107 stores a program to be executed by the computer, and the control unit 108 controls the standard storage unit 101, the user specification input unit 102, the sequence creation unit 103, the test item creation unit 105, the test item extraction unit 106, and the memory unit 107. To do.

  Hereinafter, each process will be described in detail in order. FIG. 2 describes a basic DCT sequential method of “Digital Still Image Compression Encoding Recommendations” as an example of a standard image stored in the standard storage unit 101. In the following figures, description will be made using an example based on “Recommended Collection of Digital Still Image Compression Encoding”.

  The standard image is created based on, for example, a recommendation issued by the New Japan ITU Association. Because this test item automatic generation device is intended to create test items for system operation confirmation, the standard image is not an algorithm for realizing the standard, but the standard-specific allowable values, restrictions, etc. It shall be expressed as

  Here, when the allowable values and restrictions are described in a high-level programming language or the like, symbols defined in a recommendation document or the like must be used. It is also recommended to categorize the relevant categories.

  The standard storage means stores the standard image using means equivalent to normal data download, and corrects or adds the standard image. The stored standard images are described in list format as a standard image list with the recommended collection name and method name of the standard image created so that they can be displayed and selected on the user specification input screen. Associate with.

  3 and 4 show user specification input screens for the user to input system-specific specifications using the user specification input means. Items to be input are composed of standards, user specifications, other functions, and parameter lists.

  FIG. 3 shows an example of input screens related to standards, user specifications, and other functions. Regarding standards, the standards and methods realized by the system are selected from the standard image list already stored in the standard storage unit 101 by the standard storage means.

  When a plurality of standard images are stored, a plurality of recommendation collection names and method names are displayed on the screen as shown in FIG. 3, and a selection is made from them. By this selection, the standard used when the test item creation unit 105 automatically creates test items is determined.

  For user specifications, the system implementation range (limitations, restrictions, etc.) for the standard is described in a high-level programming language. In addition, when defining restrictions, conditions, etc., symbols defined in recommendations are used.

  When test items are automatically created by the test item creation unit 105, test items are created within the realization range described in relation to this user specification when normal test items are created, and other function-related items described later are created when abnormal test items are created. Test items are created so that they are out of the realization range described in terms of the functions and constraints described in, or related to this user specification.

  In relation to other functions, not only functions defined in the standard but also restrictions and conditions of various other functions realized by the system are described in a high-level programming language. In the user specification input screen, an arbitrary number of function columns and constraint condition columns are prepared. The function column describes the name of the function to be realized, and the restriction condition column describes restrictions and restrictions on the function in a free description format. The function name described in the function column is recognized as information when the flowchart creation unit 103 creates a flowchart.

  FIG. 4 shows an example of a parameter list input screen. A table is created for each function, and the character string input in the function column of FIG. 3 is inserted in the first line. The parameter list includes a use / non-use column that specifies whether or not to use as a parameter to be determined when creating test items, a parameter name column for entering the parameter name used by the system, a (parameter) type column, a parameter description, etc. And an explanation column to fill in.

  For parameters used in the same meaning as symbols defined in a recommendation, etc., enter the symbol name defined in the recommendation in the parameter name column. The use / non-use column is checked when used as a parameter determined at the time of test item creation by a check box format or the like, and not checked when not used.

  At this time, a check is performed to indicate that the parameter defined in the recommendation document is a symbol, and a check is performed to indicate that the parameter defined by the user is not a symbol. This parameter list is used in the sequence creation method described below and test item creation means described later.

  FIG. 5 shows a flowchart shape for creating a flowchart of the system by the flowchart creation unit 103. The user selects an appropriate shape from the flowchart shape and creates a flowchart.

  The flow chart shape includes 200 indicating “beginning” of the function, 201 indicating “normal end” of the function, 202 indicating “abnormal end” of the function, 203 indicating “branch condition” of the processing flow, and “processing” of the function. 205, 208, 210 indicating “path” selected when “branching condition” 203 is true, 206, 209, 211 indicating “path” selected when “branching condition” 203 is false. , And 207 representing a “path” from 200 or 204 to 201, 202, 203, 204.

  FIG. 6 is an example of a flowchart using a flowchart shape. The “branch condition” 203 is described using parameters and symbols input to the parameter list by the user specification input means. In the “process” 204 of the function, when the parameter is changed when the process is performed, the parameter and the symbol input in the parameter list are described, and when not changed, 0 is described.

  In order to create a sequence program using a high-level programming language or the like from the flowchart, the sequence creation unit 104 associates each flowchart shape with the sequence programming creation operation and defines it as a sequence creation rule.

  For example, 201 indicating “normal end” of the function sets the return value of the program to 0, and 202 indicating “abnormal end” of the function sets the return value of the program to 1.

  The “branch condition” 203 of the processing flow is associated with “If (A) {B} else {C}”, and the content indicated by “branch condition” 203 is A, and is selected when the branch condition is true 201, 202. , 203, and 204 are indicated by B, and the contents indicated by 201, 202, 203, and 204 that are selected when the branch condition is false are indicated by C.

  When “0” is described in 204 representing the “processing” of the function, the input parameter (argument) does not change by “processing”, so a program line related to 204 is not created, and other than 0 is described. In this case, the content indicated by 204 is the program line.

  FIG. 7 shows a sequence program in a high-level programming language format automatically created from the flowchart based on these sequence creation rules.

  Next, test item creation means will be described. The test item creation means is a means for sequentially determining parameter values using the parameters checked in the use / non-use column of the parameter list described on the user specification input screen as test item parameters. FIG. 8 shows a processing flow of the test item creation means.

  The test item creation means searches and numbers all path patterns that the system can take from the flowchart created by the flowchart creation unit 103 first.

  Next, for the values of parameters (symbols) that are defined in the recommendation document and checked in the parameter list, first search for allowable values and restrictions using the symbol as a keyword from the standard image, and then select the symbol from the test item extraction condition. When the allowed values and limits searched for keywords, the system realization range (limits, restrictions, etc.) for the standards entered in relation to user specifications on the user specification input screen, and test item extraction conditions are set by the test item extraction means The parameter (symbol) value is determined by a combination of the maximum value, the minimum value, and the intermediate value in the range that satisfies the test item extraction condition.

  For the intermediate value, the value obtained by adding the minimum value to the maximum value divided by 2 is used as the first intermediate value, and the first intermediate value obtained is added with the maximum value or the minimum value. The value obtained by dividing by 2 is determined as a second intermediate value, and the number of possible intermediate values is arbitrarily determined.

  Next, using the sequence program in the high-level programming language format created from the flowchart in the sequence creation unit 104, parameter values other than the symbols checked in the parameter list for each function are input in relation to other functions of the user specification input screen. Within the constraint condition for each function, the parameter values are sequentially determined from the first of the numbered paths, and the determined parameter values are entered in a test specification described later.

  A path that is “normally ended” in the flowchart is a normal test specification, and a path that is “abnormally ended” in the flowchart is an abnormal test specification. Further, even when an immediate value or a condition is input to the parameter intended by the user on the test item extraction condition screen of the test item extraction unit described later, the parameter value is determined based on the processing flow of the test item creation unit.

  The test item creation means creates a test specification as shown in FIG. 9 composed of parameters checked in the parameter list. The header line of the test specification is composed of “test No.” and a character string automatically extracted from the parameter name column of the parameter checked in the parameter list.

  As the test specification, either a normal test specification or an abnormal test specification or both can be created. In addition, the created test specifications can be arbitrarily modified by the user, and the rows can be inserted and deleted.

  Next, test item extraction means will be described. The test item extraction unit is a unit for adding and extracting test items automatically created by the test item creation unit 105. FIG. 10 shows a test item extraction condition screen for inputting a test item extraction condition that the user wants to add or extract using the test item extraction function.

  The test item extraction condition screen is composed of a parameter name field and a setting value field, and the parameter checked in the use / non-use field of the parameter list is displayed in the parameter name field. In the setting value column, the condition of the test item that the user wants to add or extract is input in an immediate value or a high-level programming language.

  If you want to add or extract a test item with a random value for any other parameter by entering an immediate value or condition for the parameter intended by the user, you may select a value at random within the realization range described in relation to the user specifications. This can be done by describing "-" or the like indicating the above.

  Next, a program for controlling each means of the test item automatic generation apparatus will be described. A menu screen image is shown in FIG. The menu screen image includes a standard image related process button 301 for starting the standard image related process, a user specification input button 302 for starting the user specification input process, a flowchart creating process button 303 for starting the flowchart creating process, The test item creation process button 304 and the test item extraction process button 305 are configured, and the user selects a process to be activated from the menu screen image.

  FIG. 12 is a flowchart of the control program. In FIG. 12, 401 is a branch condition indicating whether or not the standard image related processing button 301 has been selected, 403 is a branch condition indicating whether or not the user specification input button 302 has been selected, and 405 is a flowchart creation processing button 303 having been selected. It is a branch condition of no.

  402 is a standard image storage, addition, and correction process performed when the standard image related process button 301 is selected, 404 is a user specification input process performed when the user specification input button 302 is selected, and 406 is a flowchart. This is a flowchart creation process performed when the creation process button 303 is selected.

  Further, 407 is a sequence creation process for creating a sequence from the flowchart after the flowchart creation process 406, 408 is a branching condition indicating whether or not the test item creation button 304 is selected, and 409 is a test performed when the test item creation button 304 is selected. Item creation processing 410 is a branching condition indicating whether or not the test item extraction button 305 is selected, and 411 is a test item extraction processing performed when the test item extraction button 305 is selected.

  According to the above test item automatic generation device, the application range that satisfies the requirements of the standards such as the input system specifications and technical standard recommendation collections, and other parameter values that consider the processing contents and restrictions of each function are determined, Test items can be automatically created / extracted for patterns of all paths in the flow realized by the system.

  As a result, it is possible to reduce the amount of work for creating test items and improve the reliability of test items. In addition, test items for functions realized by the system can be created without errors or omissions, and the amount of work can be reduced and the test performance can be improved.

  The test item automatic generation apparatus according to the present invention works in the creation of test items that take into account the requirements that satisfy the requirements of the standards such as the specifications of the input system and the technical standards, and the processing contents and restrictions of other functions. The amount can be reduced and the reliability of test items can be improved. Further, it has an effect that it is possible to create test items for functions realized by the system without errors or omissions, and is useful as a technique for automatically creating test items used for software development or the like.

The block diagram which shows the structure of the test item automatic generation apparatus which concerns on one Embodiment of this invention. An example of the standard image stored in the standard storage part of a test item automatic generation device. Examples related to standards, user specifications, and other functions on the user specification input screen. Example of parameter list input screen on user specification input screen. Flowchart shape for creating a system flowchart. The example of the flowchart using a flowchart shape. An example of a sequence program automatically created from a flowchart. The flowchart of the process which determines the parameter value by a test item preparation means. An example of a test specification created by the test item creation means. The example of the test item extraction condition screen by a test item extraction function. The example of the menu screen by the control program of a test item automatic generation device. The flowchart of the control program of a test item automatic generation apparatus.

Explanation of symbols

101 Standard storage unit 102 User specification input unit 103 Flowchart creation unit 104 Sequence creation unit 105 Test item creation unit 106 Test item extraction unit 107 Memory unit 108 Control unit 200 First flowchart shape 201 Normal termination flowchart shape 202 Abnormal termination flowchart shape 203 Flowchart shape of branch condition 204 Flowchart shape of processing 205 to 211 Flowchart shape of path 301 to 305 Menu screen image processing start button 401 to 411 Control program processing steps

Claims (6)

  A standard storage unit that stores and modifies and adds standards, a user specification input unit that inputs system specifications and restriction conditions, a flowchart creation unit that creates a flowchart of the system, and a sequence realized by the system from the flowchart A sequence creation unit that creates a program in a high-level programming language, etc., a test item creation unit that automatically creates test items for functions realized by the system, and a test item that sets and extracts extraction conditions for automatically created test items A tester comprising: an extraction unit; a memory unit for storing a program; and a control unit for controlling the standard storage unit, a user specification input unit, a flowchart creation unit, a test item creation unit, a test item extraction unit, and a memory unit Automatic item generator.   The test item automatic generation apparatus according to claim 1, wherein the sequence creation unit automatically creates the program from the flowchart.   The test item automatic generation device according to claim 2, wherein the sequence creation unit holds information that associates a step shape (shape) in the flowchart with a step of the program.   The standard storage unit has a standard image created based on a technical standard recommendation, etc., and system-specific specifications, restrictions, conditions, and parameter list used by the standard image and the user specification input means The test item automatic generation device according to claim 1, wherein the symbol specification, restrictions, and conditions are determined by searching for.   Flowchart creation means for creating a flowchart of the system, sequence creation means for creating a sequence realized by the system from the flowchart as a program in a high-level programming language, etc., test item creation means for automatically creating test items for functions realized by the system, automatic A program that causes a computer to function as test item extraction means for setting and extracting extraction conditions for a created test item.   A computer-readable recording medium on which the program according to claim 5 is recorded.

Images