JPH05233268A - Execution system for suitability test - Google Patents

Abstract

PURPOSE:To provide a suitability test execution system capable of automating a test and judging an accurate test result. CONSTITUTION:In a suitability test for the N-layer (hereinafter expressed by (N)) protocol loading of a product for loading (N) of an OSI reference model, an execution type test suite 70 is formed from an abstraction test suite 20 described by using an (N-1) service primitive, an (N) service primitive and an (N) protocol data unit. The formed suite 70 is integrated in a suitablity testing device 80 consisting of a test suite loader 81, a logic circuit memory 82, a test suite interpreter 83, and a protocol processing part 84 as a logic circuit and the device 80 is driven to automatically judge a test result.

Description

Detailed Description of the Invention

[0001]

The present invention relates to OSI (Open Systems).
Generation of an execution test suite and an execution test case from an abstract test suite and an abstract test case in an information communication terminal that implements a protocol product based on Interconnection), and execution of a conformance test based on the execution test suite and the execution test case. It is about the method.
Here, the test suite is a whole set of test items (test cases) that are the minimum units of the test.

The usage of the terms of event and action described in the specification is as follows. That is, as shown in FIG. 4, the output of the state transition table is an action, and the test execution control unit (hereinafter referred to as the test suite interpreter)
The test is executed by using this as input. As a result, the test suite interpreter knows the event (event) that occurs by detecting the reaction of the processing unit of the protocol data unit (hereinafter referred to as PDU), and outputs this. The test suite interpreter operates the state transition table using the output as an input event of the state transition table. This series of steps is repeated until the test is judged.

[0003]

2. Description of the Related Art FIG. 3 is a diagram showing the configuration principle of a conventional compatibility test system.

According to the same international standard (document) 10 of the same OSI protocol, in order to ensure the interoperability of the information communication terminals on which the OSI protocol products are mounted, each information communication terminal product correctly conforms to the international standard. There is a compatibility test as a test for determining whether or not there is.
IUT to be tested by the conformance testing device 40
50. Furthermore, the compatibility test apparatus 40 includes a test execution control unit 41, an upper tester 43, and a lower tester 42.
The IUT 50 and the low-order tester 42 of the compatibility testing device are OS
I lower layer service (hereinafter referred to as lower layer) 60
Under the control of the test execution control unit 41, the upper tester 43 and the lower tester 42 coordinate the test operation, add an action to the IUT 50, and observe the reaction event to test the operation of the IUT 50.

The test suite of the conformance test is, for example, TTCN (Tree and tree) as the abstract test suite 20.
Tabular Combined Notation
It is described in a human-readable form using a description language called ISO 9646), but this is generally a form that cannot be executed by the conformance test apparatus 40. Therefore, in order to execute the test, it is necessary to efficiently derive the program-type test suite that can be executed by a workstation or the like, that is, the execution-type test suite 30, but conventionally, the execution-type test suite 30 is described. It takes a lot of time and effort to generate the test program for the test execution control unit 41 by using the dedicated programming language.

Further, in the determination of the test result, conventionally, I which responds to the action from the compatibility test apparatus 40
Detects the action of UT50,
The collation with the abstract test suite 20 by the CN is performed manually, and the result of the test is determined from the description in the test result determination column of the abstract test suite 20.

[0007]

Therefore, it is difficult to automate the test, and the result determination may be erroneous due to the manual work. The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an execution method of a compatibility test that enables automatic test and accurate determination of test results.

[0008]

In order to solve the above problems, the present invention provides a compatibility test of (N) protocol implementation in an information communication terminal product implementing N layer (hereinafter referred to as (N)) of OSI reference model. In (N-1) service primitive, (N) service primitive and (N) PD
From the abstract test suite written using U and (N-
1) For each of the service primitive, (N) service primitive, and (N) PDU, the input event that occurs is the horizontal axis, the state identification number is the vertical axis, the action to be executed is described in each column, and the mutual state is further described. A state transition is made between transition tables according to an event, and a test result is judged for the final reached state (pass = conforms to protocol. Failure = does not conform to protocol. Indeterminate = conformity can be judged. No.) is used to generate an execution type test suite by a state transition table, and the execution type test suite is read by a test suite reading device (hereinafter referred to as a test suite loader) to provide (N-1) service. Primitive state transition table, (N) protocol data unit state transition table, (N) service primitive state transition table A means for expanding and holding on the logic circuit memory of the conformance test equipment, and a test suite interpreter reads the output action of the state transition table on the logic circuit memory corresponding to the test start action of the abstract test item, and the protocol in the conformance test equipment. Handed over to the processing unit, the protocol processing unit sends (N-1) service primitives, (N) PDU
Is sent to the IUT, and the (N-1) service primitive, (N) service primitive, or (N) P generated by the IUT is transmitted.
Starting from the means for collecting the reaction of the DU and executing the test and the output action of the state transition table on the logic circuit memory, I
(N-1) service primitive by UT reaction,
(N) a service primitive and (N) a means for transitioning states in the state transition table expanded and held on the logic circuit memory according to the result of the PDU and determining the test result by the determination described in the final reached state. It is characterized by having.

[0009]

According to the present invention, in the conformity test of the (N) protocol implementation in the product implementing (N), (N-
1) An execution type test suite is generated from an abstract test suite described using a service primitive, (N) service primitive and (N) PDU, and is incorporated as a logic circuit into a conformance test apparatus, Is operated to automatically determine the test result, which enables automation of the test and accurate determination of the test result.

[0010]

Embodiments of the present invention will now be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing a compatibility test system for implementing (N) protocol in an information communication terminal product implementing (N) according to an embodiment of the present invention. In the figure, 20 is an abstract test suite, 43 is a high-level tester, and 5
0 is an IUT (test target implementation), 60 is a lower layer, 70
Is an execution type test suite, 71 is a (N-1) service primitive state transition table, 72 is an (N) PDU state transition table, 73 is an (N) service primitive state transition table,
80 is a compatibility testing device, 81 is a test suite loader (test suite reading device), 82 is a logic circuit memory, 83 is a test suite interpreter (test execution control unit), 84 is a protocol processing unit, 85 is a lower interface function unit, Reference numeral 86 is a determination result output unit. The conformance test system includes an abstract test suite 20, an IUT 50, a lower layer 60, an execution type test suite 70, and a conformance test apparatus 80.

The execution type test suite 70 is composed of (N-1) service primitive state transition table 71, (N) PDU state transition table 72 and (N) service primitive state transition table 73.

The compatibility test apparatus 80 includes a test suite loader 81, a logic circuit memory 82, a test suite interpreter 83, a protocol processing section 84, a lower interface function section 85, a determination result output section 86 and an upper tester 43.
It is composed of FIG. 2 is a flow chart showing an example of the flow from creation of the execution type test suite to execution of the test.

(1) The abstract test suite (ATS) 20 is
For example, it is described in a language having a tree-like structure called TTCN, which includes (N) service primitives,
It is described including (N-1) service primitive, (N) PDU, and test result determination information (creation 1).

(2) Referring to the abstract test suite 20,
For each of the (N-1) service primitive, the (N) service primitive, and the (N) PDU, the input event that occurs is represented by the horizontal axis, the state identification number is represented by the vertical axis, and the action to be executed is described in each column. The state transition between the mutual state transition tables is performed according to the event, and the test result is determined for the final reached state (pass = conform to the protocol. Failure = not conform to the protocol. Indeterminate = conformity is determined). I can say neither.)
An execution type test suite (ETS) 70 including a (N) service primitive state transition table 73, a (N-1) service primitive state transition table 71, and a (N) PDU state transition table 72 in a text file format is created. (Create 2).

(3) Three state transition tables 71 to 7 of the execution type test suite (ETS) 70 in the test suite loader 81
3 is read (read), and each state transition table is hierarchically divided and expanded (expanded) on the logic circuit memory 82 of the compatibility test apparatus 80.

(4) The test suite interpreter 83
The output action of the state transition table on the logic circuit memory 82 corresponding to the test start action of the abstract test item is read, and the action to be performed at present is obtained from the value (arrow 1).

(5) The test suite interpreter 83
For the protocol processing unit 84, the action is IU
Values such as primitive types, timer values, and address values necessary for transmission / reception to / from the T50 are given (action execution instruction), and the protocol processing unit 84 uses lower functions such as timer operation, test and test management channel operation, and data transmission / reception. , Take other actions,
The (N-1) service primitive, the (N) service primitive, and the (N) PDU are used as the lower interface function unit 8
5 and lower layer 60 to the IUT 50.

(6) The protocol processing unit 84 causes the (N-1) service primitive, (N) service primitive, (N) generated by the IUT 50, which occurs as a result of the action.
The reaction of the PDU is collected, and the event is notified to the test suite interpreter 83 (action execution result).

(7) The test suite interpreter 83 is
In response to the event notified from the protocol processing unit 84, the output action of the hierarchically divided state transition table on the logic circuit memory 82 is used as a starting point, and the (N-1) service primitive and (N) service primitive are generated according to the reaction of the IUT 50. , (N) The state number is changed to the next state number in the state transition table expanded and held in the logic circuit memory 82 according to the result of the PDU (arrow 2). (8) Above (4) to (7)
The above process is repeated until one test case is completed.

(9) A test judgment is described in the final arrival state of the state transition table on the logic circuit memory 82, and the test result is judged from the actual final arrival state. It is achieved by the execution method.

The test suite loader 81 reads in the text files of the environment definition file, test schedule file, PDU file and other information files created in creation 3. Also, test suite interpreter 8
3 records actions and events in a text file format log file.

Note that (N-1) service primitives,
(N) Service primitives and (N) PDUs are exchanged a plurality of times, and the test object is initialized to a state suitable for the test purpose as the determination of the test result when the determination of the state transition table is performed a plurality of times accordingly. (N-1) service primitive, (N) service primitive, and (N) for the test front part for performing the operation and for returning the setting to the initial state.
The determination result corresponding to the exchange of PDUs may be masked, and the determination of the test result may be performed only by the arrival state of the state transition table corresponding to the purpose of the test.

[0024]

As described above, according to the present invention, the conformity test apparatus is executed based on the abstract test suite which is highly abstracted for human understanding and is not suitable for the test apparatus. By incorporating it into a test device by converting it into an executable test suite that can be used to drive the test device,
Since the test execution process and the test result can be determined based on this, there is an advantage that the test can be automated and the test result can be accurately determined.

Since the system is based on the state transition table, even if the protocol to be tested is changed, if the contents of the transition table are rewritten and the protocol processing section is changed, the test suite interpreter need not be changed, and the test apparatus is not required. It is possible to generalize the test suite interpreter, which is the core part of the.

[Brief description of drawings]

FIG. 1 is a block diagram showing a compatibility test system according to an embodiment of the present invention.

FIG. 2 is a flowchart showing an example of the flow from execution type test suite creation to test execution according to the present invention.

FIG. 3 is a block diagram showing a conventional compatibility test system.

FIG. 4 is a block diagram illustrating usage of terms of events and actions.

[Explanation of symbols]

20 ... Abstract test suite, 43 ... Upper tester, 50 ... I
UT (test target implementation), 60 ... Lower layer, 70 ... Execution type test suite, 71 ... (N-1) state transition table for service primitive, 72 ... (N) State transition table for PDU, 7
3 ... (N) State transition table for service primitives, 80 ...
Compatibility test device, 81 ... Test suite loader (test suite reading device), 82 ... Logical circuit memory, 83 ...
Test suite interpreter (test execution control unit), 84
... Protocol processing unit, 85 ... Lower interface function unit, 86 ... Judgment result output unit.

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Internal reference number FI technical display location H04L 29/14

Claims (2)

[Claims] 1. In a compatibility test of an N-layer protocol implementation of an OSI reference model in an information communication terminal product implementing an N-layer of the OSI reference model, an N-1 layer service primitive of the OSI reference model and an O
From the abstract test suite described using the N layer service primitives of the SI reference model and the N layer protocol data units of the OSI reference model, the N-
1-layer service primitives and N-layer service primitives of the OSI reference model and N-layer protocol data units of the OSI reference model, the horizontal axis is the input event that occurs and the vertical axis is the state identification number. In addition, the means for performing the state transition between the mutual state transition tables according to the event and generating the execution type test suite by the state transition table in the format that describes the judgment of the test result for the final reached state And a state transition table for the N-1 layer service primitive of the OSI reference model, a state transition table for the N layer protocol data unit of the OSI reference model, and an N of the OSI reference model using the test suite reading device. Deployed as a state transition table for layer service primitives on the logic circuit memory of the conformance tester The means for holding and the test execution control unit read the output action of the state transition table on the logic circuit memory corresponding to the test start action of the abstract test item, and pass it to the protocol processing unit in the conformity testing apparatus, and the protocol processing unit sends the OSI. The N-1 layer service primitive of the reference model and the N layer protocol data unit of the OSI reference model are transmitted to the test target implementation, and the N-1 layer service primitive of the OSI reference model caused by the test target implementation and the N layer service of the OSI reference model are generated. Starting from the means for collecting the reactions of the N-layer protocol data unit of the primitive and the OSI reference model and executing the test, and the output action of the state transition table on the logic circuit memory as the starting point, the N- of the OSI reference model depending on the reaction of the implementation to be tested 1 layer service primitive, N of OSI reference model
According to the result of the layer service primitive and the N-layer protocol data unit of the OSI reference model, the state transition table expanded and held in the logical circuit memory is used to transit the state, and the test result is determined by the determination described in the final reached state. A method of executing a conformity test characterized by comprising means. 2. The N-1 layer service primitive of the OSI reference model, the N layer service primitive of the OSI reference model, and the N layer protocol data unit of the OSI reference model are exchanged a plurality of times, and a plurality of state transition tables corresponding thereto are exchanged. As the determination of the test result when passing through the determination of (1), the OS of the test front part for initializing the test object to a state suitable for the test purpose and the OS of the test rear part for the operation of returning the setting to the initial state.
N-1 layer service primitive of I reference model, OSI
It is possible to mask the judgment result corresponding to the exchange of the N layer service primitive of the reference model and the N layer protocol data unit of the OSI reference model, and judge the test result only by the arrival state of the state transition table corresponding to the purpose of the test. The conformity test execution method according to claim 1.