CN100535866C - Consistency detection method to test protocal containing complex computation procedue - Google Patents
Consistency detection method to test protocal containing complex computation procedue Download PDFInfo
- Publication number
- CN100535866C CN100535866C CNB2004100315154A CN200410031515A CN100535866C CN 100535866 C CN100535866 C CN 100535866C CN B2004100315154 A CNB2004100315154 A CN B2004100315154A CN 200410031515 A CN200410031515 A CN 200410031515A CN 100535866 C CN100535866 C CN 100535866C
- Authority
- CN
- China
- Prior art keywords
- test
- computation
- executive system
- adopt
- description method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The method changes independent between testing set and executing system in standard testing framework. Mode of realizing computational functions through testing description is adopted in the invented method. Using interactive mode between testing description method and executing system realizes computing function. The testing description method assigns name of algorithm, input parameters etc. attributes of computation. Implementation of computing procedure is embedded into executing system. In testing protocol, computation requirement is divided into three types: default, static decided and dynamic decided. The invention gives out the solutions for the three types of computation requirement under the invented testing framework, which can solve any complex computation procedure virtually.
Description
Technical field
The present invention relates to computation process protocol engineering technical field, particularly a kind ofly be used to test the conformance test method that contains complicated calculations process agreement, its applicable object is to contain complicated computation process in the tested agreement.
Background technology
Testing protocol consistency is an important branch of the protocol engineering, and the method by experiment that its objective is finds that tested agreement realizes (Implementation Under Test, IUT) mistake aspect function and logic.The reason of research testing protocol consistency is that consensus standard is to use natural language description at present basically, the implementor can cause different agreements to realize for the different understanding of consensus standard, sometimes even can be wrong realization, therefore need a kind of effective method to come agreement is realized verifying and differentiating.For the tester, the internal logic structure that tested agreement realizes loses, so uniformity test is a kind of Black-box Testing.
International standard ISO/IEC9646 has defined the method and the framework of uniformity test, is used to test a product of claiming to have realized a certain osi protocol and the consistance of its consensus standard, and this standard mainly is towards the test practice, is used for instructing the test practice.This standard recommendation a kind ofly be used to describe the tree table of abstract test suite in conjunction with representation (the tree and tabular combined notation, below use without exception TTCN), provided general uniformity test framework simultaneously, promptly adopt TTCN to describe abstract test suite, by the behavior of executive system (generally be the actuator of TTCN, adopt the mode of carrying out or compiling execution of explaining) specific protocol is realized testing according to the abstract test suite regulation.The principal character of this standard testing framework can describe from two aspects:
● test set and executive system are independent fully
Test set adopts TTCN to describe, and executive system is the actuator of TTCN, and any abstract test suite of describing with TTCN can be input in the executive system to be carried out; Test set is transparent fully to executive system;
● all the elements relevant with test all adopt TTCN to be described
In this test frame, all the elements relevant with test comprise that test data, computation process, behavioral test, test judgement etc. adopt TTCN to describe fully, and abstract test suite contains all;
Uniformity test is the process of a complexity, and the type of tested agreement is varied, should select suitable measuring technology for use according to the concrete characteristics and the testing requirement of tested agreement, can spend minimum test cost like this, reach the highest testing efficiency.This test frame that defines among the ISO/IEC9646 is not considered the characteristics of tested agreement, inevitably can be powerless in the test of some specific protocol when taking into account versatility, when containing the agreement of complicated calculations process, test will run into this problem.
Uniformity test is to finish by communicating by letter between executive system and the system under test (SUT), in this process, executive system need send suitable test packet to system under test (SUT), the packet that system under test (SUT) is returned is judged simultaneously, on this basis, draw whether conforming conclusion of tested realization.Though executive system is not a complete realization of tested agreement, it should be able to simulate most behaviors of tested agreement, particularly should be able to construct all possible packet in the tested agreement, comprises correct data bag and misdata bag.For the tested agreement that contains the complicated calculations process, structure test packet and the packet that receives judged all need to carry out very complicated calculating.Defined the syntax format of supporting calculating among the TTCN, can satisfy the demand of simple computation, but then powerless for complicated especially computation process (for example adopting very complicated cryptographic algorithm that whole raw data packets such as is encrypted at operation), so the standard testing framework can not carry out high efficiency test to the agreement that contains the complicated calculations process.
Summary of the invention
The object of the present invention is to provide a kind of uniformity test framework and method thereof that contains complicated calculations process agreement.
Analyze the agreement characteristics, clear and definite testing requirement is the prerequisite of carrying out the Validity Test activity.Test description method and executive system are the big key elements of two in the uniformity test, in the standard testing framework, test set and executive system are independent fully, all information (comprise computation process) relevant with test, all use the test description method to be described, test description method (TTCN) and executive system are general, with the irrelevant (see figure 1) of the characteristics of tested agreement.In general, the test description method of text formatting is difficult to describe complicated computation process, if the test description method can not be described complicated computation process, then this test frame can not satisfy the testing requirement that contains complicated calculations process agreement.
Break fully independently test frame of the test set of standard and executive system, the agreement that contains the complicated calculations process is carried out uniformity test in this mode that proposes test description method and executive system interaction.The test description method generally is text or script, describes comparatively difficulty of complicated calculations process; Executive system generally adopts high-level programming language to realize, and high-level programming language can be realized complicated arbitrarily computation process.The two characteristics are combined, specify computation attribute, realize in the executive system, then can satisfy the testing requirement (see figure 2) that contains complicated calculations process agreement and computation process is embedded into by the test description method.Because the computation process that may use in the concrete agreement all is limited, adopt the mode of test description method and executive system interaction to realize computing function, the test description method provides computation attributes such as relevant parameter and algorithm with text mode, real computation process is embedded in the executive system and realizes.This test frame can be realized complicated arbitrarily computation process, can satisfy the testing requirement to complicated calculations.Following the computation requirement that may run in the protocol test is divided three classes, introduces the solution of test description method and executive system interaction respectively:
1. Mo Ren compute type
This compute type does not need the tester to be described with showing, calls the corresponding calculated module where necessary automatically by executive system fully and finishes.Concerning tested agreement, specific can the static environment of determining under, always should call this computation process.The calculating that is represented as checksum field in the header of modal this compute type, concerning certain header, verification and computing method be completely specified, verification and filling position also be completely specified, if other field of header assignment, then verification and just can uniquely determining.When the design test description, the descriptor format of regulation header, can reserve checksum field edition interface (be used to test tested agreement realize to error-checking and processing), also can not reserve and calculate automatically and fill by executive system.Realized computation process and call format in the executive system, when executive system reads header and describes, can call computation process automatically, thereby obtained the test data of final complete binary stream form checksum field;
2. can the static compute type of determining
This compute type needs the tester to specify statically.Concerning tested agreement, the value of under equal conditions calculating some specific fields may exist more than a kind of algorithm or computation process, so just need realize all possible computation process in executive system.This agreement is being carried out in the process of uniformity test, when judging, can staticly in advance determine to adopt which kind of computation process at the structure test packet or to the data that system under test (SUT) returns.If under a certain condition, there is multiple computation process, when the design test description, can reserve the edition interface of specifying computation process.When the design test collection, adopt this edition interface to specify computation process, executive system can be called suitable computation process in view of the above.For instance; internet security protocol IP Sec is the security protocol that internet engineering duty group IETF designs for the communication of protecting network layer specially; wherein defined authentication header AH; the form of authentication header AH is fixed; but calculate algorithm that verifying field wherein adopts and be unfixed (hash algorithm that meets specific input/output condition arbitrarily all is fine, but HMAC-MD5-96, the HMAC-SHA1-96 etc. of comprising commonly used at present).When ipsec protocol is tested, in executive system, realize all identifying algorithms, during the AH header that defines in the test description method is described except the edition interface of all fields, add a field of specifying identifying algorithm, specify in the mode of text name and calculate the algorithm that verifying field adopts in this header; When the data that receive were judged, the mode of specific authentication algorithm was similar with it.When transmission/reception data, executive system can be called computing module according to appointed information and realize computation process;
3. dynamically definite compute type
This compute type is more special, it is characterized in that parameter even the computation process relevant with calculating all can not be definite fully in advance, need could determine according to middle execution result in measuring executing process that it is very difficult that the agreement that has this compute type is carried out uniformity test.Demand to computing power in the protocol test is described by three attributes: computation process (being algorithm), input parameter, output valve, in case preceding two attributes determine that then output valve is unique determines.For the compute type that could determine in carrying out, computation process and input parameter all can not be determined in advance, should could determine according to dynamic implementation status.Can adopt dual mode to realize this compute type, its common ground is that real computation process is realized by executive system, and difference is to determine that the process of computation attribute (computation process and input parameter) is to adopt the test description method to describe, still be embedded in the executive system:
● the test description method is determined computation attribute: when the design test collection, adopt the test description method that the implementation status of centre is judged, determine different computation attributes respectively, call different computation process according to different branch's situations; This mode requires the test description method to possess stronger branch's descriptive power, need consider during the design test collection that test set is comparatively huge comprehensively;
● executive system is determined computation attribute: when the design test collection, the information relevant with definite computation attribute all is defined as the global parameter of test set,, realize these parameter assignment according to implementation status determining that according to these global parameters the task of computation attribute is put in the executive system; Its advantage only is in the test set parameter assignment to execution result in the middle of can describing, when surveying the requirement of description comparatively simple, simplified the design of test set; Shortcoming is as above not a kind of mode in dirigibility;
The principal feature of this test frame is to have broken in the standard testing framework fully independently test structure of test set and executive system, but adopts the mode of test description method and executive system interaction to realize containing the uniformity test of complicated calculations process agreement.Its main points are not to be to adopt fully the test description method to describe computation process, but the realization of complicated calculations process is embedded in the executive system, only need to adopt the test description method to specify computation attribute to get final product in suitable place in the test set.The realization of this test frame need be according to tested agreement characteristics design test description, and and then realizes executive system.In the uniformity test of reality,, can adopt two kinds of approach to realize about the design of test description method:
1. fully from the beginning design brand-new test description method: current commonly used be the test description method of design text mode, according to tested agreement characteristics, adopt text mode to describe test set fully;
2. on the basis of existing test description method, designing new test description method: TTCN is the test description method that international standard is recommended, but it is too huge really, the actuator of realizing TTCN is a quite complicated job, certain concrete agreement is carried out uniformity test need not adopt complete TTCN; According to the agreement characteristics, remove some unwanted parts among the TTCN, replenish necessary part, form new test description method, this mode is the method for current the most frequently used design test description;
In this test frame structure, test description method and tested agreement are closely bound up, and executive system is the explanation/compiling actuator of test description method; Finish in design on the basis of test description method, need to realize supporting the executive system of this description, wherein realized all computation process that to use in the tested agreement.
Description of drawings
Fig. 1 has described the mode of standard testing framework realization computing function.
Fig. 2 has described the mode of the test frame realization computing function of the present invention's proposition.
Fig. 3 has provided and has adopted the present invention the agreement that contains the complicated calculations process to be carried out the process flow diagram of uniformity test.
Embodiment
Fig. 1 has described the standard testing framework, in this test frame, adopts the test description method to describe abstract test suite fully; Complete computation process is included in the test set, adopts the test description method to describe computation process fully.The principal character of this test frame structure is that test set and executive system are independent fully, and the calculating descriptive power of test set descriptive language is limited, is difficult to containing the test of complicated calculations process agreement.
Fig. 2 has described the test frame that the present invention proposes, and in this test frame, computation process is embedded in the executive system and realizes; Only adopt the test description method to specify computation attribute in the test set, real computation process is realized by executive system.This test frame is characterised in that test set no longer separates with executive system but cooperatively interacts and realizes complicated computation process.
Fig. 3 has described and has adopted the present invention the agreement that contains the complicated calculations process to be carried out the process flow diagram of uniformity test.May further comprise the steps altogether:
Step S1 analyzes consensus standard, according to the mode that the present invention is pointed computation process in the tested agreement is classified;
Step S2, according to consensus standard, in conjunction with the computation process in the agreement, the design test description;
Step S3 realizes and tested protocol-dependent computing module;
Step S4, the mode that adopts compiling/explanation to carry out realizes the test execution system at the test description method, needs to introduce computing module in the executive system;
Step S5, according to consensus standard, the design test sequence; Adopt the test description method to describe cycle tests, obtain abstract test suite;
Step S6 is loaded into abstract test suite in the test execution system, by testing alternately of realizing with concrete tested agreement;
Step S7 generates the test report that realizes at concrete tested agreement.
Illustrate:
Test frame (Testing Framework) is the standard terminology in testing protocol consistency field, and the present invention has provided a kind of new test frame, can be used for the agreement that contains the complicated calculations process is carried out uniformity test.
Claims (2)
1, a kind ofly is used to test the conformance test method that contains complicated calculations process agreement, it is characterized in that, adopt the mode of test description method and executive system interaction to realize computing function, the test description method provides relevant parameter and algorithm computation attribute with text mode, real computation process is embedded in the executive system and realizes, specifically comprises:
The computation requirement that may run in the tested agreement is divided three classes: the compute type of acquiescence, can the static compute type of determining, the compute type dynamically determined;
For the compute type of acquiescence, call the corresponding calculated module where necessary automatically by executive system fully and finish;
For can the static compute type of determining, when making up test packet or the data that system under test (SUT) returns are judged, staticly in advance determine to adopt which kind of computation process; When the design test description, reserve the edition interface of specifying calculating parameter; When the design test collection, adopt described edition interface to specify computation process, executive system can be called suitable computation process in view of the above;
For the compute type of dynamically determining, computation process is realized by executive system, adopt the test description method to determine computation attribute, when the design test collection, adopt the test description method that the implementation status of centre is judged, determine different computation attributes respectively, call different computation process according to different branch's situations; Adopt executive system to determine computation attribute, when the design test collection, the information relevant with definite computation attribute all is defined as the global parameter of test set, to these parameter assignment, realizes determining that according to these global parameters the task of computation attribute is put in the executive system according to implementation status.
2, according to claim 1ly be used to test the conformance test method that contains complicated calculations process agreement, it is characterized in that, described test description method is used to specify algorithm title and the input parameter in the computation attribute, concrete computation process is embedded in the executive system realizes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100315154A CN100535866C (en) | 2004-03-19 | 2004-03-19 | Consistency detection method to test protocal containing complex computation procedue |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100315154A CN100535866C (en) | 2004-03-19 | 2004-03-19 | Consistency detection method to test protocal containing complex computation procedue |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1564135A CN1564135A (en) | 2005-01-12 |
| CN100535866C true CN100535866C (en) | 2009-09-02 |
Family
ID=34481261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100315154A Expired - Fee Related CN100535866C (en) | 2004-03-19 | 2004-03-19 | Consistency detection method to test protocal containing complex computation procedue |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100535866C (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100377538C (en) * | 2006-03-20 | 2008-03-26 | 北京星河亮点通信软件有限责任公司 | Construction of protocol testing platform for supporting TD SCDMA terminal protocol |
| CN1829127B (en) * | 2006-04-20 | 2011-06-29 | 北京星河亮点通信软件有限责任公司 | Method for building communication terminal test instrumentation control platform based on microkernel |
| CN102789654A (en) * | 2012-08-03 | 2012-11-21 | 北京速通科技有限公司 | Method and system for protocol conformance testing of electronic toll collection core equipment |
| CN105024873A (en) * | 2014-04-29 | 2015-11-04 | 中国科学院沈阳自动化研究所 | Protocol conformance testing system and method based on equipment and scene simulation |
| CN104657272A (en) * | 2015-03-04 | 2015-05-27 | 上海华东电信研究院 | Method and system for judging test items in mobile terminal |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6373822B1 (en) * | 1999-01-08 | 2002-04-16 | Cisco Technology, Inc. | Data network protocol conformance test system |
| US20030233395A1 (en) * | 2002-06-17 | 2003-12-18 | Cherian Sanjay John | Conformance testing without reference implementation of an XML standard |
-
2004
- 2004-03-19 CN CNB2004100315154A patent/CN100535866C/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6373822B1 (en) * | 1999-01-08 | 2002-04-16 | Cisco Technology, Inc. | Data network protocol conformance test system |
| US20030233395A1 (en) * | 2002-06-17 | 2003-12-18 | Cherian Sanjay John | Conformance testing without reference implementation of an XML standard |
Non-Patent Citations (4)
| Title |
|---|
| IPv6中IPSec协议一致性测试. 于东，郑红霞，张玉军，田军，李忠诚.计算机工程，第29卷第2期. 2003 * |
| IPv6协议一致性测试例的设计. 郑红霞，田军，张玉军，于东，李忠诚.计算机应用，第23卷第4期. 2003 * |
| IPv6协议一致性测试的实现. 李忠诚，张玉军.电信技术. 2003 * |
| IPv6协议一致性测试系统. 田军，张玉军，李忠诚.计算机辅助设计与图形学学报，第14卷第4期. 2002 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1564135A (en) | 2005-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Hagerer et al. | Model generation by moderated regular extrapolation | |
| CN102402481B (en) | The fuzz testing of asynchronous routine code | |
| Kristensen et al. | The practitioner’s guide to coloured Petri nets | |
| Baina et al. | Model-driven web service development | |
| Avalle et al. | Formal verification of security protocol implementations: a survey | |
| US20040060038A1 (en) | Verifiable processes in a heterogeneous distributed computing environment | |
| US7827013B1 (en) | Using symbolic evaluation to validate models that have incomplete information | |
| Ponge et al. | Fine-grained compatibility and replaceability analysis of timed web service protocols | |
| Bonfiglio et al. | Executable models to support automated software FMEA | |
| CN109240908A (en) | Abnormality test use-case template establishment method and device | |
| CN100535866C (en) | Consistency detection method to test protocal containing complex computation procedue | |
| US10310962B2 (en) | Infrastructure rule generation | |
| Nguyen et al. | Change sensitivity based prioritization for audit testing of webservice compositions | |
| KR20070060378A (en) | System and method for ensuring stability of server application by load test | |
| Sampaio et al. | Sound and mechanised compositional verification of input‐output conformance | |
| Hogrefe | Validation of SDL systems | |
| CN114077737A (en) | Android inter-component communication data flow detection method based on taint analysis | |
| CN108366040B (en) | Programmable firewall logic code detection method and device and electronic equipment | |
| Oladimeji et al. | Levels of testing | |
| Kajtazovic et al. | Constraint-based verification of compositions in safety-critical component-based systems | |
| Sprenger et al. | Cryptographically-sound protocol-model abstractions | |
| Rubio-Medrano et al. | Verifying access control properties with design by contract: Framework and lessons learned | |
| EP4235437A1 (en) | A test system and method for testing of apis | |
| Schieferdecker et al. | The Testing and Test Control Notation TTCN‐3 and its Use | |
| Vercauteren et al. | Derivation of formal representations from process-based specification and implementation models |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190121 Address after: 100085 C906-1, 8th floor, Block C, 9th Shangdi Third Street, Haidian District, Beijing Patentee after: Chongshi Communication Technology (Beijing) Co., Ltd. Address before: 100080 No. 6 South Road, Zhongguancun Academy of Sciences, Beijing Patentee before: Institute of Computing Technology, Chinese Academy of Sciences |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090902 Termination date: 20200319 |