CN100440887C

CN100440887C - Protocol testing method

Info

Publication number: CN100440887C
Application number: CNB2003101169288A
Authority: CN
Inventors: 关健; 肖峰
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2003-12-03
Filing date: 2003-12-03
Publication date: 2008-12-03
Anticipated expiration: 2023-12-03
Also published as: CN1625172A

Abstract

The present invention provides a protocol testing method used for testing a tested protocol in a tested system through using a test suite, wherein the test suite comprises a primary test component and a parallel test component. The test suite is divided into a high layer protocol part and a bottom layer protocol part; the primary test component acts on the high layer protocol part so that a high layer protocol for the realization of the tested protocol is tested, and the parallel test element acts on the bottom layer protocol part so that a bottom layer protocol for the realization of the tested protocol is tested. The protocol testing method of the present invention has preferable protocol testing flexibility and simplifies the design process of a test case in the test suite.

Description

Protocol testing method

Technical field

The present invention relates to the communication system field tests, particularly a kind of protocol testing method that is applied in the communication system.

Background technology

At present, in the protocol test process of communication system, extensively adopt the tree table to write test suite to carry out the test of variety of protocol in conjunction with notation (TTCN, Tree and Table Combined Notation) agreement.The protocol testing method that is used in now in the communication system mainly contains following dual mode:

First kind of mode is directly the definition and the description of a plurality of complete agreements to be measured to be programmed in the protocol suite with reference to the definition in the TTCN protocol specification, specifically write a plurality of test cases at each agreement to be measured again, use unique main test component (MTC at last, Main Test Component) passes through control and point of observation (PCO, Point of Control and Observation) and system under test (SUT) and carry out the mutual mutually of packet.With reference to Fig. 1, in test suite, by the test case that weaves in advance, all test assignment packets are all produced by MTC and send to system under test (SUT) by PCO; The protocol test result data bag of system under test (SUT) generation simultaneously also directly sends among the MTC of test suite by PCO, further finishes the decoding matching treatment by MTC; (heartbeat message is a kind of message of regularly transmitting between two equipment in communication system to all heartbeat message of being sent by system under test (SUT), and this message is used for inquiry unit and whether is in normal operating conditions simultaneously.Jump message to method, apparatus when an equipment sends to unite as one, when whether inquiry is in normal operating conditions to method, apparatus,, then can responds the jumping response message of uniting as one and giving this equipment if method, apparatus is in normal operating conditions; If method, apparatus is not responded heartbeat message, represent that then the other side's equipment working state is unusual) also all respond by MTC.The shortcoming of this protocol testing method is that test suite can only be exclusively used in a kind of test of agreement in the section at one time, is not easy to test suite various protocols is tested simultaneously, causes the flexibility of protocol test relatively poor; All bear alone owing to all test assignments simultaneously, so just increased the complexity that designs to a plurality of test cases in the test suite by MTC.

The second way is according to the definition in the TTCN protocol specification test suite to be carried out layering to handle, and some underlying protocol fixedly is programmed in the inside of TTCN actuator, and upper-layer protocol is connected as external interface and then with system under test (SUT).With reference to Fig. 2, at first test suite is divided into underlying protocol and upper-layer protocol two parts, different agreements complete to be measured fixedly is programmed in a plurality of concurrent testing parts (PTC of the TTCN actuator inside that is positioned at the underlying protocol part respectively, Parallel Test Component) in, make each PTC be responsible for one type protocol test respectively; Simultaneously with the MTC in the upper-layer protocol part as external interface, and then carry out data-bag interacting by PCO and system under test (SUT).Its course of work is to be the relation of concurrent working between MTC and a plurality of PTC, each PTC passes through cooperation point (CP with protocol test task data bag separately respectively, Coordination Point) directly sends to MTC, MTC does not carry out any processing to these test assignment packets, after just simply discerning, then the test assignment packet is sent to during corresponding tested agreement in the system under test (SUT) realizes by PCO respectively, to carry out the corresponding protocol test.On the contrary, respond to the protocol test result data bag of test suite by system under test (SUT), also corresponding at first simply discern by MTC after, upload among the corresponding PTC by CP respectively, by corresponding PTC to the whole protocol test result data bag matching treatment of decoding.Though this protocol testing method can make test suite that the agreement of number of different types is tested simultaneously, has protocol test function relatively flexibly; But every type protocol test task but all will be born separately and be finished by each corresponding PTC, so for each PTC, the MTC test assignment in the test assignment that it is finished and the first kind of mode is similar; The protocol test task that each PTC is responsible is again changeless simultaneously, if test other protocol tests outside the protocol test that a plurality of PTC is responsible for, will change whole test case among certain PTC, so for the various protocols test, this method has the relative also more complicated with change procedure of design of significant limitation and many test cases.

Summary of the invention

The present invention proposes a kind of protocol testing method, to solve in the protocol in prior art test process in the relatively poor and test suite of protocol test flexibility comparatively complicated problems of test case design process.

For this reason, the protocol testing method that the present invention proposes, the use test cover sends the test assignment packet to system under test (SUT), and by receiving and analyze the test result data bag that system under test (SUT) returns, realize the tested agreement in the system under test (SUT) is realized testing, described test suite comprises main test component and concurrent testing parts, and described method comprises the following steps:

(1) described test suite is divided into upper-layer protocol part and underlying protocol part;

(2) main test component is acted on described upper-layer protocol part, be used for the upper-layer protocol that described tested agreement realizes is tested;

(3) the concurrent testing parts are acted on described underlying protocol part, be used for the underlying protocol that described tested agreement realizes is tested.

Wherein said test suite to the process that system under test (SUT) sends the test assignment packet is:

(S 1) described main test component sends to the test assignment packet of upper-layer protocol part in the described concurrent testing parts;

(S2) described concurrent testing parts are packaged into a complete test assignment packet with the test assignment packet of described underlying protocol part and the upper-layer protocol test assignment packet partly that receives, and send in the described system under test (SUT).

After concurrent testing parts described in the above-mentioned steps (S2) are packaged into a complete test assignment packet with described underlying protocol test assignment packet partly and the upper-layer protocol that receives test assignment packet partly, also comprise step: the complete test assignment packet that described concurrent testing parts will have been beaten behind the bag is grouped into a plurality of test assignment packets, and sends to successively in the described system under test (SUT).

The process of the test result data bag that wherein said test suite reception system under test (SUT) returns is:

(R1) described system under test (SUT) responds the test result data bag to the described concurrent testing parts in the described test suite;

(R2) described concurrent testing parts split into upper-layer protocol test result data bag and underlying protocol test result data bag two parts with the test result data bag;

(R3) described concurrent testing parts are directly to the underlying protocol test result data bag matching treatment of decoding, and the upper-layer protocol test result data are wrapped pass to described main test component;

(R4) described main test component is to the upper-layer protocol test result data bag that the receives matching treatment of decoding.

The above-mentioned step that further comprises between described step (R1) and step (R2): described concurrent testing parts are responded a plurality of test result data bags that come to described system under test (SUT) and are merged, to form a complete test result data bag.

Described test suite also can receive by system under test (SUT) being used to of sending and inquire the heartbeat message that test suite is whether working properly when receiving the test result data bag that system under test (SUT) returns in the cycle.When described test suite when receiving the heartbeat message that test macro sends, directly described heartbeat message is responded the heartbeat response message by the concurrent testing parts of described underlying protocol part.

Beneficial effect of the present invention: because the present invention is divided into upper-layer protocol part and underlying protocol part to test suite, upper-layer protocol part and underlying protocol part are responsible for the test assignment of place layer separately respectively, and then same upper-layer protocol test and different underlying protocols are tested in conjunction with carrying out protocol test; Also can make different upper-layer protocol tests and the test of same underlying protocol in conjunction with carrying out protocol test; So promptly can guarantee agreement the flexibility of test, also can make design process become easy to the test case in the test suite.

Description of drawings

Fig. 1 is a kind of protocol test process in the prior art;

Fig. 2 is an another kind of protocol test process in the prior art;

Fig. 3 is a test suite hierarchy schematic diagram in the protocol testing method of the present invention;

Fig. 4 is the flow chart that data-bag interacting is handled between test suite and the system under test (SUT) in the protocol testing method of the present invention;

Fig. 5 is protocol testing method one an application example schematic diagram of the present invention;

Fig. 6 is the TTCN detailed process figure of application example among Fig. 5.

Embodiment

The mentality of designing of protocol testing method of the present invention is: general in a complete protocol test process, mainly the upper-layer protocol of this complete agreement is partly tested, and the underlying protocol test partly of this complete agreement almost can not considered, thereby can carry out layering to test suite handles, make MTC be responsible for the test assignment of upper-layer protocol part, make a plurality of PTC be responsible for the test assignment of underlying protocol part simultaneously, further, can also carry out layering once more to the underlying protocol part handles; When needs change protocol test task, only need of the design of its test case of change in the upper-layer protocol part, and need not change of the design of this test case once more in the underlying protocol part, can make simultaneously and be responsible for the lighter underlying protocol part of test assignment some common messages, directly answer as heartbeat message, to alleviate the test assignment of upper-layer protocol part.So this method both can guarantee to have protocol test flexibility preferably, can simplify design process again to test case in the test suite.

With reference to Fig. 3, be protocol testing method test suite hierarchy schematic diagram of the present invention.Before various types of protocol tests of writing with the TTCN agreement in the test suite 1, at first test suite 1 is carried out layering and handle, promptly be divided into upper-layer protocol and underlying protocol two parts.

Then MTC 2 is acted on the upper-layer protocol part, to be responsible for the test assignment of upper-layer protocol; Simultaneously a plurality of PTC 31, PTC 32...PTC 3n are acted on the underlying protocol part, to be responsible for the test assignment of underlying protocol; The purpose of She Zhiing is that test suite 1 is tested by the test assignment of the upper-layer protocol part of 2 pairs of systems under test (SUT) of MTC like this, and test suite 1 is tested the test assignment of the underlying protocol part of system under test (SUT) by a plurality of PTC 31, PTC 32...PTC3n.

Wherein has only a MTC 2 in the upper-layer protocol of each test suite 1 part, control a plurality of PTC 31, the PTC 32...PTC 3n of underlying protocol part, general MTC 2 meetings are dissimilar according to agreement task to be measured, start corresponding dissimilar PTC 31, PTC 32...PTC 3n; It is the corresponding different respectively protocol test type of PTC 31, PTC 32...PTC 3n, so each PTC among MTC 2 collaborative PTC 31, the PTC 32...PTC 3n can both finish the test process of the complete agreement of a cover, thereby reaches the purpose that the various protocols in the communication system is tested flexibly.

PTC 31, PTC 32...PTC 3n carry out the mutual mutually of packet by a CP and MTC 2 respectively simultaneously, and described CP can realize that the logic between PTC and the MTC connects; Each PTC among PTC 31, the PTC 32...PTC 3n carries out the mutual mutually of packet by a PCO and system under test (SUT) 4 respectively again in addition.

CP and the present state of PCO that each PTC among PTC 31 in the test suite 1, the PTC 32...PTC 3n is connected with self by the samsara inquiry respectively, detect the arrival of packet, in case detecting the CP state changes, the MTC 2 that just can learn the upper-layer protocol part has sent the test assignment packet, can receive this test assignment packet, and handle; Change in case detect the PCO state, just can learn that system under test (SUT) 4 sends the test result data bag, also can and then receive this test result data bag, and handle.The test assignment packet here not only comprises test assignment, but also comprises the data of some other types; The test result data bag also not only comprises test result simultaneously, but also comprises the data of some other types.

In hierarchy schematic diagram shown in Figure 3, MTC 2 sends to the test assignment packet of upper-layer protocol part among corresponding PTC 31, the PTC 32...PTC 3n of underlying protocol part, corresponding PTC 31, the PTC 32...PTC 3n of underlying protocol part carry out uniform packing with the test assignment packet of the test assignment packet of underlying protocol part and the upper-layer protocol part that receives then, form a complete protocol test task data bag and send in the system under test (SUT) 4; On the contrary, if the corresponding PTC 31 of underlying protocol part, when PTC 32...PTC 3n receives the response test result data bag of system under test (SUT) 4, at first the test result data bag to this response splits, underlying protocol test result data bag is stayed, then the upper-layer protocol test result data is wrapped among the MTC 2 that passes to the upper-layer protocol part, corresponding PTC 31, PTC 32...PTC 3n and MTC 2 be respectively to the matching treatment operation of decoding of underlying protocol test result data bag and upper-layer protocol test result data bag, follow-up the protocol test result data analyzed being used for.

With reference to Fig. 4, be the flow chart that data-bag interacting is handled between test suite and the system under test (SUT) in the protocol testing method of the present invention; Its detailed process is:

Step 10: test suite is dissimilar according to agreement task to be measured of the MTC of protocol section at the middle and upper levels, start the PTC of respective type;

Step 20:PTC detects MTC by the state of inquiring about CP and whether sends the test assignment packet; Change if find the state of CP, forward step 30 to; If the state of CP does not change, forward step 70 to;

Step 30:PTC receives the test assignment packet that upper-layer protocol part MTC sends, and the test assignment packet of the upper-layer protocol of the test assignment packet of underlying protocol part and reception part carried out uniform packing, form a complete test assignment packet, execution in step 40 then;

Step 40:PTC judges whether and will divide into groups to send to this complete test assignment packet according to the amount of capacity of the complete test assignment packet after packing, forwards step 50 if desired to; If do not need to forward to step 60;

Step 50:PTC carries out division operation to the complete test assignment packet after packing, and respectively each the group test assignment packet after the grouping is sent in the system under test (SUT);

Complete test assignment packet after step 60:PTC directly will pack sends in the system under test (SUT);

Step 70:PTC detects system under test (SUT) by the state of inquiring about PCO and whether sends the test result data bag; Change if find the state of PCO, forward step 80 to; If the state of PCO does not change, transfer back to step 20;

Step 80:PTC receives the test result data bag that system under test (SUT) is sent, and judges whether this test result data bag is heartbeat message, if forward step 90 to; If not, forward step 100 to;

Step 90:PTC responds the heartbeat response message and gives system under test (SUT) directly according to the heartbeat message that receives;

Step 100:PTC judge once more test result data bag that system under test (SUT) responds whether be content intact the test result data bag (sometimes, system under test (SUT) is responded to the test result data containing amount of test suite very big, so need transmitted in packets, thereby the test result data bag content that causes PTC to receive is imperfect), if forward step 110 to; If not, forward step 140 to;

The complete test result data bag that step 110:PTC responds system under test (SUT) to test suite splits into upper-layer protocol test result data bag and underlying protocol test result data bag two parts;

Step 120:PTC is directly to the underlying protocol test result data bag that the splits out matching treatment of decoding, and follow-up the underlying protocol test result data analyzed being used for; And a upper-layer protocol test result data that splits out is wrapped the MTC that passes to the upper-layer protocol part;

Step 130:MTC is to the upper-layer protocol test result data bag that the receives matching treatment of decoding, and follow-up the upper-layer protocol test result data analyzed being used for;

Step 140:PTC continues the relevant test result data bag of content that the follow-up system under test (SUT) of wait is sent, all receive up to a plurality of test result data bags that content is relevant, the test result data bag that a plurality of contents that will receive then are relevant is merged into a complete test result data bag;

Test result data bag after step 150:PTC will merge is split as upper-layer protocol test result data bag and underlying protocol test result data bag two parts, continues execution in step 120 then to step 130.

With reference to Fig. 5, be protocol testing method one application example schematic diagram of the present invention.This application example is that example is further set forth the whole process that employing layering means are carried out protocol test with CAP (Camel Application Part) agreement, and wherein CAMEL Application Part is a standard agreement in the GSM mobile intelligent net.Article one, complete CAMEL Application Part message is by Message Transfer Part (MTP, Message Transfer Part) agreement, SCCP (SCCP, Signaling Connection and Control Part) agreement, transaction-capable applying portion (TCAP, Transaction Capability Application Part) agreement and CAMEL Application Part four parts are formed jointly.And it is general in protocol test, emphasis only is concerned about the situation of change of upper-layer protocol parameter, as above-mentioned when CAMEL Application Part is tested, only need emphasis to be concerned about the CAMEL Application Part parameter of upper-layer protocol and the situation of change of TCAP parameter, and the situation of change of the SCCP parameter of underlying protocol and MTP parameter almost can be considered.Promptly in test suite, write in this CAP test case, only need emphasis to consider and design the upper-layer protocol part at CAMEL Application Part parameter and TCAP parameter place, consider or directly ignore that the accuracy of gained test result is can't deviation too big like this and can take second place to the SCCP parameter of underlying protocol part and MTP parameter.When change CAP test case, can only change, and need not go to change SCCP parameter and MTP parameter again, thereby can simplify the complexity of test case design process CAMEL Application Part parameter and TCAP parameter.

Corresponding to protocol testing method of the present invention,, simultaneously SCCP and MTP are collectively referred to as the underlying protocol part should can in test suite, being collectively referred to as the upper-layer protocol part to CAMEL Application Part and TCAP with in the example; MTC is acted on the upper-layer protocol part, be responsible for CAMEL Application Part and TCAP are tested; Simultaneously PTC is acted on the underlying protocol part, be responsible for SCCP and MTP are tested.Upper-layer protocol part (being CAMEL Application Part and TCAP place layer) directly is issued to underlying protocol part (be SCCP and MTP place layer) by the MTC effect via CP with the test assignment packet, and the underlying protocol part is packaged in the test assignment packet of the test assignment packet of underlying protocol part and upper-layer protocol part together by PTC and sends in the system under test (SUT) by PCO.

Equally, test suite is when receiving the test result data bag of the content intact that system under test (SUT) sends by PCO, the PTC of underlying protocol part splits upper-layer protocol test result data bag in the test result data bag and underlying protocol test result data bag automatically, and directly to the underlying protocol test result data bag matching treatment of decoding, simultaneously upper-layer protocol test result data bag is uploaded to the upper-layer protocol part by CP, the MTC of upper-layer protocol part is to the upper-layer protocol test result data bag matching treatment of decoding then.

When processing is dealt into the heartbeat message of test suite by system under test (SUT), directly the PTC by the underlying protocol part responds the heartbeat response message to corresponding heartbeat message, needn't further upload to the upper-layer protocol part handles again, can avoid the unexpected appearance of heartbeat message can interrupt the logical process process of upper-layer protocol part like this, thereby reduce complexity test case design in the test suite.

Through above-mentioned process, just can finish the test suite that utilizes hierarchy and finish the whole process that a complete CAMEL Application Part is tested.

With reference to Fig. 6, be the TTCN detailed process figure of above-mentioned application example.At first an emulation statement+StartSCCPSimulator (SCCP) is set, starts the underlying protocol test assignment in underlying protocol part (being the protocol layer that SCCP and MTP are formed); A statement+MyProcessdure is set in the centre then, and statement+MyProcessdure is the upper-layer protocol test assignment that really will carry out; Carry out+during the MyProcessdure statement, be automatically brought to the CAMEL Application Part test statement and the TCAP test statement of the 4th row and the 5th row and carry out the promptly main task of finishing the upper-layer protocol test according to the CAMEL Application Part test statement and the TCAP test statement of the 4th row and the 5th row; After this CAMEL Application Part test finished, execution+EndSCCPSimulator (SCCP) statement finished this protocol test then.Wherein change the task of protocol test if desired, promptly test the agreement outside the CAMEL Application Part, only need change the upper-layer protocol test statement of the 4th row and the 5th row, and the underlying protocol test statement still use+StartSCCPSimulator (SCCP) get final product, because for a complete protocol test, its underlying protocol test can be ignored.Thereby can further find out, adopt protocol testing method of the present invention, can simplify complexity greatly test case design process in the test suite.

The above only is a preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.

Claims

1, a kind of protocol testing method, this method use test cover sends the test assignment packet to system under test (SUT), and by receiving and analyze the test result data bag that system under test (SUT) returns, realize the tested agreement in the system under test (SUT) is realized testing, described test suite comprises main test component and concurrent testing parts, it is characterized in that described method comprises the following steps:

2, protocol testing method according to claim 1 is characterized in that, described test suite to the process that system under test (SUT) sends the test assignment packet is:

(S1) described main test component sends to the test assignment packet of upper-layer protocol part in the described concurrent testing parts;

3, protocol testing method according to claim 2, it is characterized in that: concurrent testing parts described in the step (S2) also comprise step after described underlying protocol test assignment packet partly and the upper-layer protocol that receives test assignment packet partly are packaged into a complete test assignment packet:

The complete test assignment packet that described concurrent testing parts will have been beaten behind the bag is grouped into a plurality of test assignment packets, and sends to successively in the described system under test (SUT).

4, protocol testing method according to claim 1 is characterized in that, the process of the test result data bag that described test suite reception system under test (SUT) returns is:

5, protocol testing method according to claim 4 is characterized in that, further comprises step between described step (R1) and step (R2):

Described concurrent testing parts are responded a plurality of test result data bags that come to described system under test (SUT) and are merged, to form a complete test result data bag.

6, protocol testing method according to claim 1, it is characterized in that, described test suite also can receive by system under test (SUT) being used to of sending and inquire the heartbeat message that test suite is whether working properly when receiving the test result data bag that system under test (SUT) returns in the cycle.

7, protocol testing method according to claim 6 is characterized in that, described test suite is directly responded the heartbeat response message by the concurrent testing parts of described underlying protocol part to described heartbeat message when receiving the heartbeat message that test macro sends.

8, protocol testing method according to claim 1 is characterized in that, carries out data-bag interacting by cooperation point between described main test component and the described concurrent testing parts.

9, protocol testing method according to claim 1 is characterized in that, carries out data-bag interacting by control and point of observation between described concurrent testing parts and the described system under test (SUT).

10, protocol testing method according to claim 8 is characterized in that, the state that described concurrent testing parts are inquired about described cooperation point by samsara detects the arrival of packet.

According to right 9 described protocol testing methods, it is characterized in that 11, the state that described concurrent testing parts are inquired about described control and point of observation by samsara detects the arrival of packet.