JPH0333617A - Testing apparatus of product - Google Patents

Abstract

PURPOSE:To indicate the quantitative scale of the quality of a product by evaluating the coverage which is a reference of the sufficiency to a test on the basis of the coverage information updated by a coverage updating part. CONSTITUTION:After a discriminating number adding part 2 adds numbers to the specification/design state and the transition of the state of a product, the product is tested. At this time, a coverage measuring part 4 responds to the operation of the product, thereby measuring the passing number of times of the specification/design state and the transition of the state. Then, a coverage updating part 5 discriminates the coverage information to be put aside from the evaluating items if the specification of the product is changed and the coverage information which will be a new evaluating item on the basis of the information from the coverage measuring part 4, thereby updating the total coverage information from the start of the test of the product. After the information is updated, a sufficiency evaluating part 6 evaluates the coverage as a sufficiency reference to the test based on the updated coverage information from the coverage updating part 5. Accordingly, the quantitative scale of the product is indicated.

Description

[Detailed Description of the Invention] [Objective of the Invention] (Industrial Application Field) The present invention provides a method for evaluating a product by measuring the coverage of product specifications/designs expressed based on an eyed state machine model. It relates to product inspection equipment that inspects quality.

(Prior Art) Generally, the test sufficiency evaluation standard in system testing (product testing) is determined by the ratio of inspected items to inspection items for each product.

In this test sufficiency evaluation method, first, inspection items for the product to be tested are created. In creating these inspection items, in addition to general knowledge about the product, detailed knowledge about the realization of the product is required in order to eliminate omissions in the items.

Furthermore, based on the empirical rule that product defects often appear when multiple functions of a product are used simultaneously, the inspection items do not only test a single function of the product under test, but also examine the combination of those functions. Unless a test is also performed, it cannot be considered a sufficient inspection item.

By the way, in order to test all combinations of functions, the number of test items may become too large to be completed within a finite amount of time. For this reason, tests involving many combinations are omitted, and test items are created that can be completed during the system test implementation period.

Since test items are created in this way, there is a possibility that test items may be omitted due to human error or the restriction that they must be completed within a reasonable amount of time.

Particularly because of the latter problem, the creation of conventional test items requires the experience of the test item creator, but it is not possible to quantitatively understand the quality of the product by relying on such experience. , especially in the case of products with new functions or products with different implementation methods, the discovery of product defects may be delayed.

Furthermore, it is not possible to calculate quantitative measures that indicate product quality, such as the probability that a product has a defect (risk rate).
In the case of a product that has just been released, there is also the problem that the quality of the product cannot be fully guaranteed.

(Problem to be Solved by the Invention) As described above, the conventional test sufficiency evaluation method described above relies on the experience of the test item creator when creating test items, so the quality of the product can be quantitatively understood. This results in delays in discovering product defects. Additionally, it is not possible to calculate quantitative measures that indicate product quality, such as the probability that a product has a defect (risk rate), so the quality of the product cannot be fully guaranteed in the case of a product that has just been released. was there.

The present invention was made in response to these circumstances, and
The purpose is to provide a product inspection device that can post a quantitative measure of product quality.

[Structure of the invention] (Means for solving the problem) In order to achieve the above object, the product inspection device of the present invention has the following features:
Product specifications expressed based on a finite state machine model/
In a product inspection device that inspects product quality by measuring design coverage, an identification number addition means for assigning unique numbers to product specifications/design states and state transitions, and product behavior during product testing. In response to this, there is a coverage measurement means that measures the state of the product specifications/design and the number of state transitions, and based on the coverage information from this coverage measurement means, if there is a change in the product specifications, the coverage will be calculated based on this change. A coverage update means for identifying coverage information to be removed from evaluation targets and coverage information to be newly targeted for coverage evaluation, and for updating overall coverage information from the start of a product test implementation period; The test sufficiency evaluation means evaluates coverage, which is a criterion for test sufficiency, based on updated coverage information, and expresses the product quantitatively.

(Function) In the product inspection device of the present invention, when a product test is performed after the identification number addition means assigns unique numbers to the product specifications/design states and state transitions, the coverage measurement means It corresponds to the operation and measures the state of the product specification/design and the number of state transitions. When the measurement of the number of passages is completed, the coverage update means updates the coverage information based on the coverage information obtained by the coverage measurement means, and if there is a change in the product specifications, the coverage information that is removed from the coverage evaluation target due to this change and the new coverage information are updated. Identify the coverage information that is subject to coverage evaluation and update the overall coverage information from the beginning of the product testing period. When the update of this coverage information is completed, the test sufficiency evaluation means evaluates coverage, which is a rough standard of test sufficiency, based on the coverage information updated by the coverage update means, and expresses the product quantitatively.

(Embodiments) Hereinafter, details of embodiments of the present invention will be described with reference to the drawings.

FIG. 1 shows an embodiment of the product inspection device of the present invention.

As shown in the figure, the product inspection device includes a system specification/design 1, an identification number addition section 2, a product inspection section 3, a coverage measurement section 4, a coverage update section 5, and a test sufficiency evaluation section 6. has been done.

System specification/design 1 is a product specification/design expressed based on a finite state machine model.

The identification number A4 addition section 2 assigns a unique number to the product specification/design state and state transition.

The product inspection unit 3 is equipped with a behavior model that serves as a standard for the behavior to be tested, and when performing system testing, compares the behavior model that serves as the standard with the behavior of the product that is actually tested. Determine normal or abnormal.

The coverage measurement unit 4 corresponds to the operation of the product during system testing, and measures the state of the product specifications/design and the number of times state transitions have passed.

The coverage update unit 5 updates the coverage jl/1111 unit 4
Based on the coverage information provided by Renew overall coverage information from the start.

The test sufficiency evaluation unit 6 evaluates coverage, which is a criterion for test sufficiency, based on the coverage information updated by the coverage update unit 5, and expresses the product quantitatively.

Figure 2 shows an example of system specification/design 1, which is a product specification/design expressed based on a finite state machine model, and the states, events, and actions of the product specification are as follows. be.

The product specifications are as follows: State SO: initial state and final state State S1 State S2 State S3 Status S4 State S5 State S6 Status S7 Status S8 Status S9 It is.

The product specification events are: [5source=ON]: The power was turned on.

[5source-OFF]: The power is turned off.

[timerO=8.111]: Timer 0 is 6
．． It's been an hour.

[timerO = 13.511: Timer 0 is 13
．． It's been 5 hours.

[tiIIlerl=6M]: Timer l has reached 6 minutes.

[tjmer2=32M]: Timer 2 has reached 32 minutes.

[Eye mar2 = 37M]: Timer 2 has reached 37 minutes.

[timer3=5M]: Timer 3 has reached 5 minutes.

[h temp-130]: Defrosting chamber temperature is 13°
It became C.

[f'tamp<-24.5C]: Refrigerator room temperature became lower than -24.5C.

[f'Lemp>-21.5C]: The temperature of the refrigerator compartment became higher than -21.5C.

It is.

The product specification action is [compressor=ON]: Compressor (
compressor).

[compressor-OFF]: Turns off the compressor.

Cfan -oN]: Turn on the fan (air blower).

[('an=OPP]: Turn off the fan.

[heater-ON]: Heater
Turn on.

[heater=OPP]: Turn off the heater.

[lamp=ON ko: lamp (front; i; 7u
Month) is added to 0.

[lamp=OPP]: Turn off the lamp.

[timerO=5tart: Set timer 0.

[timerl-start]: Set timer 1.

[timcr2=start]: Set timer 2.

[timer3=start]: Set timer 3.

[null: Do nothing.

It is.

An example of the operation of such a product is as follows.

(1) When the power is turned on in state SO, set timer 0 and transition to state St.

(2) In state S1, when the temperature of the refrigerator compartment becomes higher than -21.5°C, turn on the compressor and transition to state S1.

(3) In state S1, when the temperature of the freezer compartment becomes lower than -24.5°C, turn off the compressor, set timer 1, and transition to state S9.

(4) In state S9, when timer 1 reaches 6 minutes, the process transitions to S9.

(5) In state St, when timer O reaches 6.1 hours, timer 0 and timer 2 are set, the compressor and fan are turned on, and the state transitions to state S2.

Next, the operation when inspecting a product using the product inspection apparatus having the above-described configuration will be described.

The finite state machine model that serves as the basis for the description of product system specifications/design 1 is expressed using a set of Arimachi states and a set of state transitions caused by each human symbol (event).
Due to one event, there is only one state (which may be the same as the previous state) to which the state transitions from state -.

Here, the state is, for example, as shown in FIG.
When the event ``power turned on'' occurs in ``, the action ``set timer'' and the action ``turn on compressor'' are triggered, and the transition to ``state 1'' occurs. expressing.

First, the identification number addition unit 2 first processes the system specifications/design 1 of the product described based on the finite state machine model.
Assign an identification number to each state and state transition. Next, the product inspection department 3
When the system test starts, the coverage measurement unit 4 measures the state of the product specification/design and the number of state transitions, corresponding to the operation of the product during the system test.

When the coverage metering section 4 finishes measuring the number of passages, the coverage updating section 5 updates the coverage meter ff111 section 4.
Based on the coverage information provided by Update overall coverage information from the start.

After this, the test sufficiency evaluation section 6 updates the coverage update section 5.
Based on the updated coverage information, the coverage that exceeds the test sufficiency standard is evaluated and the evaluation result is output.

Here, the following are measures of test sufficiency:

(1) State coverage: ratio of passing states 3 to all states (2) State transition coverage: ratio of passing state transitions to all state transitions (3) Basic state transitions: ratio of passing states to all states Passage coverage ratio for state transitions Ratio of state transitions (4) Total route coverage... Ratio of passing routes to all routes (5) Basic route coverage... Ratio of passing routes to basic routes. For example, the state coverage is 40%, the state transition coverage is 33%, and the basic state transition coverage is 36% for the product operation example.

In addition, if the system specification/design 1 is changed during system testing, the identification number of the unnecessary state or state transition is registered in the test sufficiency evaluation unit 6, and the Exclude from. In addition, for the added state or state, the identification number addition unit 2 reissues a unique identification number, registers this reissued unique identification number in the test sufficiency evaluation unit 6, and tests 4 Add to the test sufficiency evaluation target by the test sufficiency evaluation unit 6. Thereby, by changing the system specifications/design 1, the coverage information accumulated up to that point can be used without wasting it.

In this way, in this example, a systematic inspection item reduction method was applied that reduces the number of routes (inspection items) according to the importance of functions in the product under test. It can be understood quantitatively, and together with test coverage, it can provide various objective measures of test sufficiency for product quality.

In addition, in this example, the combination of usable functions (including individual functions) of the product under test is expressed as a "state" in the finite state machine model, so it is possible to reach the final state from the initial state of the product under test. All possible routes become all possible inspection items, and by conducting system tests based on the use/design of the product to be tested, it is also possible to prevent omission of inspection items due to human error.

] 5 Furthermore, in this embodiment, since the combinatorial problem of test item [1 is also described using a finite state machine model, redundant test items such as combinations of functions that are not realistically possible can be removed.

[Effects of the Invention] As explained above, according to the product inspection device of the present invention,
A quantitative measure of product quality can be provided.

[Brief explanation of drawings]

Fig. 1 is a block diagram showing an embodiment of the product inspection device of the present invention, Fig. 2 is a diagram showing an example of the system specifications/design of Fig. 1, and Fig. 3 is a system specification based on an eyed state machine model. It is a figure which shows the example of a / design expression. 1... System specifications/design, 2... Identification number addition section, 3... Product inspection section, 4. Coverage measurement section, 5.
... Coverage update section, 6... Test sufficiency evaluation section. 6

Claims (1)

[Claims] (1) In a product inspection device that inspects the quality of the product by measuring the coverage of the product specifications/design expressed based on a finite state machine model,
Identification number adding means for assigning unique numbers to design states and state transitions; Coverage measurement for measuring the number of passes through the specification/design states and state transitions of the product corresponding to the operation of the product during product testing; and, based on the coverage information obtained by the coverage measurement means, when there is a change in the specifications of the product, the coverage information that will be removed from the coverage evaluation target due to this change and the coverage information that will newly become the coverage evaluation target are identified. and a coverage update means for updating the overall coverage information from the start of the product test implementation period, and a coverage that is a criterion for test sufficiency based on the coverage information updated by this coverage update means, and the above-mentioned A product inspection device characterized by comprising a test sufficiency evaluation means for quantitatively expressing a product.