JP2011028313A - Automatic verification item generation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an automatic verification item generation device for achieving efficient verification without omission. <P>SOLUTION: This automatic verification item generation device (100) for automatically generating verification items of a system that is a development target based on a specification of the system includes: a conceptual function extraction means (10) extracting conceptual functions based the specification; a constituent element-like function extraction means (11) extracting constituent element-like functions constituting each of the conceptual functions based on the specification; a verification item setting means (12) setting each of the constituent element-like functions as the verification item; and a priority order determination means (13) determining priority order of the verification items based on a duplication degree of each of the constituent element-like functions capable of being duplicately used in each of the conceptual functions. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a verification item automatic generation apparatus for automatically generating verification items of a system to be developed based on the specifications of the system, and in particular, priorities are assigned based on the specifications of the system that can be read by a computer. The present invention relates to a verification item automatic generation apparatus for automatically generating verification items.

  Conventionally, priorities were set for the verification of functions represented by each use case based on a use case diagram consisting of use cases defined in UML (Unified Modeling Language) and related information indicating the relationship between two use cases. A verification support apparatus is known in which priority is given to verification of a high-level function so as to improve the efficiency of verification work of a development target (see, for example, Patent Document 1).

  This verification support device grasps the hierarchical relationship (inclusion relationship) of each use case, sets the priority of the highest use case as a predetermined reference value, and sets the priority of other use cases from the reference value. Expressed as a difference, the function becomes more complex as the use case becomes a subordinate concept, and the priority is set so that the lowest use case has the highest priority, and further, the priority is presented to the verifier. Enable a person to decide which verification items have priority for verification.

  Also, the degree of risk is determined based on the system impact level to be verified and the business impact level, and the priority of the test scenario is determined based on the risk level and a test scenario predetermined for each verification target. In addition, by presenting the priority to the test planner, the test planner determines which test scenario to test in what order, or the test case depth (the test case pattern There is known an information processing apparatus that can determine how the number is to be determined (see, for example, Patent Document 2).

JP 2006-252489 A JP 2007-226526 A

  However, the verification support apparatus described in Patent Literature 1 provides a verifier with a verification item list in which verification items related to each function and their priorities are associated with each other in consideration of the vertical relationship between the functions to be developed. Since the priority of lower-level use cases is prioritized by setting the priority of lower-level use cases with increased complexity, the verifier will precede the verification of lower-level use cases according to the priority. If a failure is found in the subsequent upper use case verification after the execution, the verification result for the lower use case that has already been successfully performed becomes meaningless.

  In addition, the information processing apparatus described in Patent Document 2 desirably executes a test scenario corresponding to each verification target on a one-to-one basis, taking into consideration the degree of influence of each verification target on a task related to a system including a plurality of verification targets. The order is provided to the test planner, but since the functional connection of each verification target is not considered, if a failure is found in a test scenario with a slow execution order, the execution order that has already been performed successfully This would make the verification result of a quick test scenario meaningless.

  In view of the above points, an object of the present invention is to provide a verification item automatic generation device that realizes efficient and leak-free verification.

  In order to achieve the above object, an automatic verification item generation apparatus according to an embodiment of the present invention is an automatic verification item generation apparatus for automatically generating a verification item of a system to be developed based on the specification of the system. A conceptual function extracting means for extracting a conceptual function based on the specification; and a component function extracting means for extracting a component function constituting each of the conceptual functions based on the specification; Verification item setting means for setting each of the component function as the verification item, and the verification item based on the degree of overlap of the component function that can be used redundantly in each of the conceptual functions Priority order determining means for determining the priority order.

  Further, the verification item automatic generation apparatus according to the embodiment of the present invention further includes verification item output means for outputting the verification item so that a verifier can visually recognize the verification item, and the verification item output means has a higher priority order verification. A list of verification items may be output so that the items are more easily recognized by the verifier.

  In addition, the verification item automatic generation device according to the embodiment of the present invention further includes a test pattern generation unit that generates a test pattern corresponding to each of the verification items based on the specification, and the test pattern generation unit includes the test pattern generation unit, The number of test patterns or the test coverage rate may be determined based on the priority of each verification item.

  Further, in the verification item automatic generation apparatus according to the embodiment of the present invention, the verification item output means may output a test pattern corresponding to each of the verification items in association with each of the verification items. .

  With the above-described means, the present invention can provide an automatic verification item generation device that realizes efficient and leak-free verification.

It is a block diagram which shows the structural example of the verification item automatic generation apparatus which concerns on this invention. FIG. 6 schematically illustrates a relationship between a conceptual function and a component function. It is a flowchart which shows the flow of a verification item automatic generation process.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram illustrating a configuration example of a verification item automatic generation device according to the present invention. The verification item automatic generation device 100 verifies the system based on a computer-readable control specification related to a system to be developed. This is a device that generates and presents information related to verification items that can be viewed by a person. The system to be developed may be any of a system realized by hardware, a system realized by software, or a system realized by a combination of hardware and software.

  The control unit 1 is a computer including a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. A program corresponding to each of the component function extracting unit 11, the verification item setting unit 12, the priority order determination unit 13, the test pattern generation unit 14, and the verification item output unit 15 is stored in the ROM, and each unit is supported. Causes the CPU to execute processing.

  The specification acquisition unit 2 is a device for acquiring computer-readable specifications related to a system to be developed, such as a hard disk drive, a DVD (Digital Versatile Disk) drive, a semiconductor memory, a communication interface, etc. The specifications recorded on the recording medium are acquired through a drive corresponding to each recording medium or through a communication network.

  The output unit 3 is a device for outputting various types of information. For example, a display, a printer, a speaker, and the like, and a verifier recognizes a list of test items, a test pattern, and the like generated by the verification item automatic generation device 100. Output as much as possible.

  Next, various units included in the control unit 1 will be described.

  The conceptual function extracting unit 10 is a unit for extracting a conceptual function of a system to be developed from a computer-readable specification regarding the system to be developed.

  In this document, “conceptual function” means various functions of the system that can be conceptually recognized by the user of the system to be developed or the verifier of the system, and can have, for example, a plurality of statuses. When the boosting system is a development target system, it means a function of the boosting system that shifts to a specific status under a predetermined condition.

  The conceptual function extraction unit 10 acquires, for example, a computer-readable specification regarding the system to be developed, acquired through the specification acquisition unit 2, and uses a specification analysis algorithm corresponding to the format of the specification. Extract conceptual functions.

  The component function extracting unit 11 is a unit for extracting a component function constituting each of the conceptual functions of the system based on a computer readable specification regarding the system to be developed.

  In this document, “component function” means a function of a component (including hardware and software) necessary to realize each of the conceptual functions. For example, the boosting system can take a plurality of statuses. Is a development target system, it means the function of each component necessary to shift the boosting system to a specific status.

  FIG. 2 is a diagram schematically showing a relationship between a conceptual function and a component function, and nine components in which a system to be developed is composed of four conceptual functions A to D and software The state comprised by the functional function ai is shown.

  Also, as shown in FIG. 2, the component function a is shared by the conceptual functions A and B, the component function e is shared by the conceptual functions B and C, and the component function h is Are shared by the conceptual functions B, C and D, and the component function i is shared by all of the conceptual functions A to D. The component functions d and g are used only for the conceptual function A, the component function b is used only for the conceptual function C, and the component functions c and f are only the conceptual function D. Used in.

  Thus, the conceptual function of the system to be developed is configured by a combination of a plurality of component functions, and these component functions can be shared by the plurality of conceptual functions.

  For example, taking FIG. 2 as an example, the component-like function extracting means 11 acquires a computer-readable specification related to the system to be developed, and uses the specification analysis algorithm corresponding to the format of the specification to obtain the component. Recognize that the conceptual functions A to i are extracted and the conceptual function A is composed of the component functions a, d, g, and i.

  Similarly, the component function extracting means 11 is configured such that the conceptual function B is configured by the component functions a, e, h, and i, and the conceptual function C is configured by the component functions b, e, h, And that the conceptual function D is composed of the component functions c, f, h, and i.

  The verification item setting unit 12 is a unit for setting a verification item of the system to be developed. For example, whether or not each of the component functions extracted by the component function extraction unit 11 operates as specified. Is set as a verification item.

  For example, taking FIG. 2 as an example, the verification item setting means 12 verifies whether each of the nine constituent functions a to i extracted by the constituent function extracting means 11 operates as specified. Set as.

  The priority order determining means 13 is a means for determining the priority order of the verification items. For example, the component function extracting means 11 used for each conceptual function extracted by the conceptual function extracting means 10 Based on the degree of duplication of each extracted component function, the priority of each verification item set by the verification item setting means 12 is determined.

  In this document, “priority” is an index that indicates the importance of verification items. The higher the priority, the more important the verification item, and the more priority should be given to verify the test items. Means that. As the priority order, a unique order may be given to each verification item, or a common order may be given to a plurality of verification items.

  In addition, “degree of duplication” means the degree to which each component function is shared by a plurality of conceptual functions. The greater the number of conceptual functions that share one component function, the higher the degree of duplication. Shall be.

  For example, taking FIG. 2 as an example, the priority determining means 13 gives the highest priority to the component function i shared by all four conceptual functions A to D, and then the concept. The component function h shared by the three conceptual functions B to D is given the second highest priority, and then the component shared by the two conceptual functions A and B. Each of the component functions e shared by the two conceptual functions of the functional function a and the conceptual functions B and C is given the third highest priority, and finally, only in a single conceptual function The lowest priority is given to each of the component functions b, c, d, f, g used.

  The test pattern generation unit 14 is a unit for generating a test pattern corresponding to each of the verification items. For example, the verification item setting unit 12 sets the test pattern based on a computer-readable specification related to the system to be developed. A test pattern corresponding to each verification item is generated.

  Further, the test pattern generation unit 14 may determine the number of test patterns or the test coverage rate based on the priority order of each verification item determined by the priority order determination unit 13.

  In this document, “test coverage rate” means the ratio of the operation verified by the test pattern to the total operation of the verification item (component function) to be verified. When the verification item is realized by software This is a concept that includes the code coverage rate.

  For example, taking FIG. 2 as an example, the test pattern generation means 14 has the instruction coverage ratio (C0), the branch coverage ratio (C1), and the condition coverage ratio ( The test pattern is generated so that all of C2) are 100%, and the instruction coverage rate (C0) and the branch coverage rate (C1) are 100% for the component function h having the second highest priority, A test pattern is generated so that the condition coverage ratio (C2) is 50%, and the instruction coverage ratio (C0) is 100% and the branch coverage ratio for the component functions a and e having the third highest priority. A test pattern is generated so that (C1) is 50%, and only the instruction coverage (C0) is 100% for the component functions b, c, d, f, and g having the lowest priority. Generate a test pattern.

  The test pattern generation process 14 may determine the number of test patterns for each verification item so that the number of test patterns for the normal process is larger than the number of test patterns for the exception process.

  The verification item output means 15 is a means for outputting the verification items of the system to be developed so that the verifier can recognize the verification items. For example, the verification items with high priority are more easily seen by the verifier. Then, a list of verification items is output to the printer or display as the output unit 3 so that the verification items with high priority are arranged on the paper or display as the output destination.

  Further, the verification item output means 15 may change the size of the character, the character position, the character color, etc. so that the verification item with a higher priority is more easily recognized by the verifier.

  Further, the verification item output means 15 may output a test pattern in association with each verification item. In this case, the test pattern may be output, for example, as a combination of an input value to be input to the system to be verified and an output value to be obtained corresponding to the input value.

  Next, a flow of processing in which the verification item automatic generation apparatus 100 presents a list of verification items to the verifier (hereinafter referred to as “verification item automatic generation processing”) will be described with reference to FIG. FIG. 3 is a flowchart showing the flow of the verification item automatic generation processing. The verification item automatic generation apparatus 100 automatically generates the verification item every time it acquires a computer-readable control specification related to the system to be developed. Processing shall be executed.

  First, the control unit 1 acquires a computer-readable control specification related to a system to be developed via the specification acquisition unit 2 (step S1).

  Thereafter, the control unit 1 extracts the conceptual function based on the acquired control specification by using the conceptual function extraction means 10 by using the specification analysis algorithm (step S2).

  Furthermore, the control part 1 extracts the component function which comprises each conceptual function based on the acquired control specification, using the component analysis function extraction means 11 using a specification analysis algorithm (step S3).

  Thereafter, the control unit 1 sets, as verification items, whether or not each of the component functions extracted by the component function extraction unit 11 operates according to the control specifications by the verification item setting unit 12 (step S4). ).

  Thereafter, the control unit 1 acquires the degree of duplication of each component function based on the extraction result of the conceptual function extraction means 10 and the extraction result of the component function extraction means 11 (step S5), and priority is given. The priority determination unit 13 determines the priority of each verification item based on the degree of overlap (step S6).

  Thereafter, the control unit 1 uses the verification item output unit 15 to sort the verification items set by the verification item setting unit 12 in accordance with the priority order determined by the priority order determination unit 13, and then prints it via the output unit 3. An output is made or a display is made (step S7).

  Furthermore, the control unit 1 uses the test pattern generation unit 14 to change the number of test patterns and the test coverage rate according to the priority order determined by the priority order determination unit 13 and change each verification item based on the acquired control specifications. A corresponding test pattern is generated (step S8).

  Finally, the control unit 1 prints out the test patterns classified for each verification item (combination of input values input to the verification target system and output values corresponding to the input values) or displays them on the display. (Step S9), the verification item automatic generation process is terminated.

  With the above configuration, the verification item automatic generation device 100 outputs the verification items in order according to the priority order determined based on the overlapping degree of the component function, so that there is a problem with the verification item having a low priority order. Even when a discovery is made, verification of a high-priority verification item that has already been performed is not made meaningless, and efficient and complete verification can be performed by the verifier.

  Further, the verification item automatic generation apparatus 100 outputs a list of verification items so that verification items with higher priorities are more easily recognized by the verifier. Therefore, the verifier gives priority to verification items with lower priorities. It is possible to prevent verification prior to verification items with higher ranks, and to allow the verifier to perform efficient and complete verification.

  Moreover, since the verification item automatic generation apparatus 100 determines the number of test patterns or the test coverage based on the priority order of each verification item, the verifier performs a clear and efficient verification without omission. Can do.

  Further, since the verification item automatic generation apparatus 100 outputs test patterns corresponding to the verification items in association with the verification items, it reduces the burden on the verifier to manually create the test patterns, and is efficient. In this way, it is possible to have the verifier perform verification without omission.

  Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the present invention. Can be added.

  For example, in the above-described embodiment, the verification item automatic generation apparatus 100 automatically generates a test pattern based on a computer-readable specification related to the system to be developed by the test pattern generation unit 14. The test pattern may be added, modified, deleted, etc. while accepting manual input from the user.

DESCRIPTION OF SYMBOLS 1 Control part 2 Specification acquisition part 3 Output part 10 Conceptual function extraction means 11 Constituent function extraction means 12 Verification item setting means 13 Priority order determination means 14 Test pattern generation means 15 Verification item output means 100 Verification item automatic generation apparatus

Claims (4)

A verification item automatic generation device for automatically generating verification items of a system to be developed based on the specifications of the system,
A conceptual function extracting means for extracting a conceptual function based on the specification;
A component function extracting means for extracting a component function constituting each of the conceptual functions based on the specification;
Verification item setting means for setting each of the component function as the verification item;
Priority order determining means for determining the priority order of the verification items based on the degree of duplication of each of the component functions that can be used redundantly in each of the conceptual functions;
A verification item automatic generation apparatus comprising: A verification item output means for outputting the verification item so that a verifier can visually recognize the verification item;
The verification item output means outputs a list of verification items so that verification items with higher priorities are more easily recognized by the verifier.
The verification item automatic generation apparatus according to claim 1, wherein: A test pattern generating means for generating a test pattern corresponding to each of the verification items based on the specification;
The test pattern generation means determines the number of test patterns or the test coverage based on the priority of each of the verification items.
The verification item automatic generation device according to claim 1, wherein the verification item automatic generation device is provided. The verification item output means outputs a test pattern corresponding to each of the verification items in association with each of the verification items;
The verification item automatic generation device according to claim 3, wherein:

Images