CN117749675A - CMS communication protocol testing method and system - Google Patents
CMS communication protocol testing method and system Download PDFInfo
- Publication number
- CN117749675A CN117749675A CN202311621596.2A CN202311621596A CN117749675A CN 117749675 A CN117749675 A CN 117749675A CN 202311621596 A CN202311621596 A CN 202311621596A CN 117749675 A CN117749675 A CN 117749675A
- Authority
- CN
- China
- Prior art keywords
- test
- traversal
- test case
- control block
- configuration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 505
- 238000004891 communication Methods 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 16
- 230000002159 abnormal effect Effects 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 claims description 9
- 238000010998 test method Methods 0.000 claims description 8
- 241000272814 Anser sp. Species 0.000 claims description 6
- 102100030686 Beta-sarcoglycan Human genes 0.000 claims description 6
- 101000703495 Homo sapiens Beta-sarcoglycan Proteins 0.000 claims description 6
- 238000011084 recovery Methods 0.000 claims description 4
- 238000005070 sampling Methods 0.000 claims description 3
- 238000006467 substitution reaction Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 8
- 125000004122 cyclic group Chemical group 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 125000006850 spacer group Chemical group 0.000 description 1
Landscapes
- Maintenance And Management Of Digital Transmission (AREA)
Abstract
The invention belongs to the field of communication protocol testing, and particularly relates to a CMS communication protocol testing method and system. According to the invention, by setting the test case capable of configuring the traversal attribute and the corresponding traversal test step, under the condition that the traversal attribute is configured by the test case, according to the test step corresponding to the traversal attribute value to be tested, continuously executing the current test step under the condition that the test step is not executed, executing the next test step after the execution is completed until each test step of the current traversal attribute value is executed, and then testing the new untested traversal attribute value until the untested traversal attribute value does not exist; therefore, after one test case is called, different traversal attribute values of the test case can be circularly tested, tests corresponding to all traversal attribute values are completed, the tests of a plurality of traversal attribute values can be realized without setting a plurality of test cases, reusability of the test cases is improved, a test case library is simplified, and therefore test efficiency is improved.
Description
Technical Field
The invention belongs to the field of communication protocol testing, and particularly relates to a CMS communication protocol testing method and system.
Background
In order to optimize the communication between secondary equipment in a transformer substation, an autonomous controllable new generation transformer substation adopts a station control layer communication protocol (CMS communication protocol: communication Message Specification) of a transformer substation secondary system communication message based on DL/T860 to replace the original MMS protocol, and on the premise of following the IEC61850 standard in the field of power system automation, the localization of a communication service protocol between a transformer substation station control layer and a spacer layer equipment is realized. The corresponding automatic testing tools of the transformer substation communication protocol are mainly limited to MMS protocol testing, lack of automatic testing means for the CMS communication protocol, only manual means can be adopted, the testing efficiency is low, and meanwhile, the correctness and the reliability cannot be guaranteed, so that the automatic testing tools are very important for the development of the CMS communication protocol automatic testing method.
The Chinese patent application publication No. CN115396352A discloses a method, a system, a device and a storage medium for testing a protocol of a CMS server side; according to the scheme, the tested equipment which completes test data and service setting is automatically analyzed and selected to be executed test cases, and the test is executed according to the selected test cases to realize automatic test; step information is gradually taken out from the step queue to execute corresponding service, the actual results of the steps are put into the actual result queue until the step queue is completely executed, then the actual results of the steps are checked in sequence, if all the steps meet the expectations, the test case results pass, otherwise, the test case results do not pass; however, the CMS server-side protocol testing method in this solution depends on the tested device that completes the test data and service setting, that is, a single test case can only test for the same set of test data and service setting, if different settings are to be tested, corresponding test cases need to be set separately, and many different test cases may need to be set to complete one communication function test, which results in a larger number of required test cases, complex case library configuration and lower testing efficiency.
Disclosure of Invention
The invention aims to provide a CMS communication protocol testing method and system, which are used for solving the problems that in the traditional CMS communication protocol testing method, different test cases possibly need to be set in a communication function testing process, so that the number of required test cases is large, the constitution of a case library is complex and the testing efficiency is low.
In order to achieve the above purpose, the present invention provides a CMS communication protocol test method, including a test case execution step in a test task execution flow, wherein the test case execution step includes checking a configuration condition of a test case, and performing a traversal test of the test case according to the condition; the configuration of the test case comprises the configuration of the traversal attribute; under the condition that the test step is executed normally, the traversal test comprises the following steps:
1) Judging whether the test case is configured with the traversal attribute, if not, performing the step 2) according to the corresponding set test step; otherwise, continuing to judge whether an untested traversal attribute value exists in the configuration of the traversal attribute, ending the traversal test if the untested traversal attribute value does not exist, otherwise, executing the step 2 according to the testing step corresponding to the traversal attribute value to be tested;
2) Continuously executing the current test step under the condition that the test step is not executed, and continuously executing the next test step until each test step is executed after the execution is completed; and (3) repeating the processes of the steps 1) -2) until the traversal test is finished under the condition that the test step corresponding to the current traversal attribute value is executed.
The beneficial effects of the technical scheme are as follows: by setting the test cases capable of configuring the traversal attribute and the corresponding traversal test steps, the cyclic test can be performed on different traversal attribute values of one test case after the test case is called, so that the test corresponding to all traversal attribute values is completed, namely, the test corresponding to a plurality of traversal attribute values can be realized without setting a plurality of test cases, reusability of the test cases can be improved, the test cases are not required to be respectively set according to different traversal attribute values, the test case library is simplified, and the calling times can be reduced, so that the test efficiency is comprehensively improved.
Further, the configuration of the test case further comprises an object grouping configuration and a single frame transmission configuration, wherein the operation object grouping refers to a set of a plurality of operation objects of the same type, and configurable traversal attributes of the operation objects of the same type are consistent; the method for correspondingly performing the test case traversal test according to the configuration attribute condition of the test case comprises the following steps:
a) Judging whether the test case is configured with object grouping and is not configured with single frame transmission, if not, performing traversal test corresponding to the set operation object; if yes, continuing to judge whether an untested operation object exists in the configuration of the object group, if not, not performing the traversal test, otherwise, performing the traversal test corresponding to the operation object to be tested;
b) And d) after the traversing test corresponding to the operation object is finished, repeating the process of the step a) until the traversing test is not performed.
The beneficial effects of the technical scheme are as follows: through the setting of object grouping configuration and single frame sending configuration, the cyclic test can be carried out on different operation objects of one test case after the test case is called, namely, the test corresponding to a plurality of operation objects of the same type is completed through one test case, the plurality of test cases do not need to be set for the plurality of operation objects, the relatively smaller number of test cases is ensured on the basis of realizing the test on the plurality of operation objects, the reusability of the test cases is further improved, and the case library is simplified.
Further, the test task execution flow includes:
a) Judging whether the current test task is circularly executed, ending the test if the current test task is circularly executed, otherwise, continuing to execute the current test task and performing the step B);
b) Judging whether the test module in the current test task is executed completely, if so, re-executing the step A), otherwise, continuing to execute the current test module and executing the step C);
c) Judging whether all the test cases in the current test module are executed, if not, continuing to execute the current test cases according to the test case execution step and performing the step D); otherwise, judging whether the current test module is completely circularly executed, if so, selecting the next test module and repeating the steps B) -C), and if not, continuing to execute the current test module and repeating the steps;
d) Judging whether the current test case is circularly executed, if not, continuing to execute, otherwise, selecting the next test case and repeating the judgment of the steps C) -D);
the test task comprises a test module and cycle number information thereof; the test module comprises one or more test cases, and the test cases comprise one or more test steps and cycle number information thereof.
The beneficial effects of the technical scheme are as follows: by setting the execution flow of the test task, the test module, the test case and the test step, the execution of the test is divided into four layers, the test task is taken as a test whole, and each test task is called to test, so that the test module, the test case and the test step included in the test task can be tested correspondingly according to the content of the test task, and the test efficiency is further improved.
Further, if the communication interruption occurs in the corresponding communication equipment to be tested in the test process, judging whether the next test step belongs to delay, association, operation prompt or service operation of other clients, if so, continuing to execute the current test case, otherwise, prompting whether to wait for communication recovery or ending the test; if the communication waiting is selected to be recovered, the tested communication equipment continues to execute the test case after the communication is recovered.
The beneficial effects of the technical scheme are as follows: the method can conveniently and timely and pointedly process the condition of communication interruption, and conveniently reduces the influence of the abnormal communication state on the subsequent testing steps.
Further, if an abnormal execution of a certain test step occurs in the test process, judging whether the test case has set a failure continuing execution flag, if so, judging that the test case fails the test and continuing to execute the subsequent test step of the test case, otherwise, judging that the test case fails the test and discarding the subsequent test step of the test case.
The beneficial effects of the technical scheme are as follows: the follow-up treatment measures corresponding to the abnormal execution of the test steps can be flexibly selected by setting the failure continuous execution mark, so that the influence of the abnormal execution of the follow-up test steps is reduced conveniently.
Further, the configuration of the traversal attribute comprises configuration of the traversal attribute type and the corresponding traversal attribute value; the traversal attribute types include one or more of ACSI type, control block, FC function constraint, and constant value group number.
Further, the traversal attribute value corresponding to the ACSI type includes one or more of a DATA object DataObject, a DATA SET DATA-SET, a buffer report control block BRCB, a non-buffer report control block URCB, a LOG control block LCB, a LOG, a constant value group control block SGCB, a GOOSE control block goscb, and a multicast sample value control block MSVCB;
the traversal attribute values corresponding to the control blocks comprise one or more of a buffer report control block BRCB, a non-buffer report control block URCB, a log control block LCB, a fixed value group control block SGCB, a GOOSE control block GoCB and a multicast sampling value control block MSVCB;
the traversal attribute values corresponding to the FC function constraint comprise one or more of state information ST, measured value MX, control CO, description DC, configuration CF, substitution SV, fixed value group SG, editable fixed value group SE and set point parameter SP;
the traversal attribute values corresponding to the constant value group numbers comprise one or more of a numerical range formed from a set numerical value to a maximum value, and the maximum value is determined according to the constant value group number in the test model corresponding to the test.
The beneficial effects of the technical scheme are as follows: the traversal test corresponding to the test case can support various traversal attribute types, and the applicability of the test case is improved.
Further, the test module comprises one or more test cases with the same service type, and the service type comprises one or more of various service types specified by the substation secondary system communication message specification.
The beneficial effects of the technical scheme are as follows: the method is equivalent to grouping the test cases according to the service types through the test module, and indexing according to the service types is convenient, so that the test cases required by management and searching are convenient.
The invention also provides a CMS communication protocol testing system, which comprises a processor, wherein the processor is used for executing program instructions to realize the CMS communication protocol testing method.
The CMS communication protocol testing system can realize the same beneficial effects as the CMS communication protocol testing method.
Drawings
FIG. 1 is a flow chart of a traversal test of a test case according to an embodiment of the CMS communication protocol test method of the present invention;
FIG. 2 is a flow chart of a method for performing test case traversal test in an embodiment of the CMS communication protocol test method according to the present invention;
FIG. 3 is a schematic block diagram of an overall flow of CMS protocol testing in an embodiment of the method for testing CMS protocol according to the present invention;
fig. 4 is a block diagram of a system for intelligently monitoring and controlling GIS devices in an embodiment of a CMS communication protocol testing method according to the present invention;
fig. 5 is a flow chart of a flow for preparing a test scheme in an embodiment of the CMS communication protocol test method of the present invention;
FIG. 6 is a flow chart of a loading test scheme flow in an embodiment of the CMS communication protocol testing method of the present invention;
fig. 7 is a flow chart of a process of loading historical tasks in an embodiment of the CMS communication protocol testing method of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent.
CMS communication protocol test method embodiment
The embodiment provides a technical scheme of a CMS communication protocol testing method, the testing method comprises a test case execution step in a test task execution flow, the test case execution step comprises checking the configuration condition of the test case, and performing traversal test of the test case according to the configuration condition;
the configuration of the test case comprises traversing the attribute; referring to fig. 1, in the case where the test step is performed normally, the traversal test includes the steps of:
1) Judging whether the test case is configured with the traversal attribute, if not, performing the step 2) according to the corresponding set test step; otherwise, continuing to judge whether an untested traversal attribute value exists in the configuration of the traversal attribute, ending the traversal test if the untested traversal attribute value does not exist, otherwise, executing the step 2 according to the testing step corresponding to the traversal attribute value to be tested; note that the "attribute values" mentioned in fig. 1 all refer to traversal attribute values.
The configuration of the traversal attribute comprises the configuration of the type of the traversal attribute and the corresponding value of the traversal attribute; in this embodiment, the traversal attribute supports an ACSI type, a control block, an FC function constraint, a fixed value group number, and the like, and the configurable traversal attribute type includes one or more of the ACSI type, the control block, the FC function constraint, and the fixed value group number, and the configurable attribute value is one or more of attribute values corresponding to the configured traversal attribute; configuring the traversal attribute, namely configuring the traversal attribute type and the attribute value corresponding to the traversal attribute type; specifically, the traversal attribute value corresponding to the ACSI type includes one or more of a DATA object DataObject, a DATA SET DATA-SET, a buffer report control block BRCB, a non-buffer report control block URCB, a LOG control block LCB, a LOG, a constant value group control block SGCB, a GOOSE control block goscb, and a multicast sample value control block MSVCB;
the traversal attribute values corresponding to the control blocks comprise one or more of a buffer report control block BRCB, a non-buffer report control block URCB, a log control block LCB, a fixed value group control block SGCB, a GOOSE control block GoCB and a multicast sampling value control block MSVCB;
the traversal value corresponding to the FC function constraint attribute comprises one or more of state information ST, a measured value MX, a control CO, a description DC, a configuration CF, a substitution SV, a fixed value group SG, an editable fixed value group SE and a setpoint parameter SP;
the traversal attribute values corresponding to the constant value group numbers include one or more of the numerical ranges from the set numerical value (in this embodiment, from 1) up to the maximum value, which is determined according to the number of constant value groups in the test model corresponding to the test.
2) Initializing test state information of the test case (the test state information is used for judging a test result, and the test state information of the test case is reset or emptied by parameters or sets saved or changed in the last test process so as to perform a test corresponding to a new traversal attribute value), continuously executing the current test step under the condition that the test step is not executed, and continuously executing the next test step until the execution of each test step is completed after the execution is completed; and (3) repeating the processes of the steps 1) -2) until the traversal test is finished under the condition that the test step corresponding to the current traversal attribute value is executed.
Therefore, the CMS communication protocol testing method in the embodiment can carry out cyclic testing on different traversal attribute values of different traversal types of one test case after the test case is called by setting the test case capable of configuring the traversal attribute and the corresponding traversal testing step, so that the testing of the plurality of traversal attribute values can be realized without setting the plurality of test cases, reusability of the test case can be improved, the test case library is simplified, the times of calling the test case can be reduced, and the testing efficiency is comprehensively improved.
In this embodiment, the configuration of the test case further includes an object grouping configuration and a single frame transmission configuration, where the operation object grouping refers to a set of multiple operation objects of the same type, and configurable traversal attributes of the operation objects of the same type are consistent; referring to fig. 2, the method for performing the test case traversal test according to the configuration attribute of the test case includes:
a) Judging whether the test case is configured with object grouping and is not configured with single frame transmission, if not, performing traversal test corresponding to the set operation object; if yes, continuing to judge whether an untested operation object exists in the configuration of the object group, if not, not performing the traversal test any more, otherwise, after instantiating the operation object to be tested, performing the traversal test corresponding to the operation object; because configurable traversal attributes of the operation objects of the same type are consistent, the operation objects in the operation object group can be suitable for configuration of the same traversal attributes, so that traversal tests of all operation objects in the operation object group of the same test case can share the same traversal test configuration and related test steps, and the effect of completing traversal tests of a plurality of operation objects through the same test case is achieved.
b) And d) after the traversing test corresponding to the operation object is finished, repeating the process of the step a) until the traversing test is not performed.
The traversing test mentioned in the steps a), b) and shown in the block of fig. 2 corresponds to the traversing test step of the steps 1) -2), wherein the test case configures the object group to indicate that there are a plurality of operation objects to be tested, and configures single-frame transmission to indicate that all operation objects will be transmitted in one frame of CMS message (if single-frame transmission is not configured, each frame of CMS message contains only one operation object); therefore, only a single frame of CMS message including the operation object is sent to the test object if a single frame of sending or unconfigured object grouping is configured, so that only a single cycle is needed to perform a traversal test on the frame of CMS message, that is, only a traversal test corresponding to the operation object is set; if the object group is configured and the single frame transmission is not configured, it is stated that multiple frames of CMS messages containing the operation objects are transmitted to the test object, so that multiple loops are required to perform the traversal test on each frame of CMS message, i.e. perform the traversal test on each operation object.
According to the embodiment, through the arrangement of object grouping configuration and single-frame sending configuration, cyclic tests can be conducted on different operation objects of one test case after the test case is called, namely tests corresponding to a plurality of operation objects of the same type are completed through one test case, the plurality of test cases do not need to be set for the plurality of operation objects, the relatively smaller number of the test cases is guaranteed on the basis of testing the plurality of operation objects, reusability of the test cases is further improved, and a case library is simplified.
Referring to fig. 3, in the present embodiment, a test task execution flow including the test case execution step described above includes:
a) Judging whether the current test task is circularly executed, ending the test if the current test task is circularly executed, otherwise, continuing to execute the current test task and performing the step B);
b) Judging whether the test module in the current test task is executed completely, if so, re-executing the step A), otherwise, continuing to execute the current test module and executing the step C);
c) Judging whether all the test cases in the current test module are executed, if not, executing the current test cases according to the test case executing steps (namely the steps a) to b)) and executing the step D); otherwise, judging whether the current test module is completely circularly executed, if so, selecting the next test module and repeating the steps B) -C), and if not, continuing to execute the current test module and repeating the steps;
d) And C) judging whether the current test case is circularly executed, if not, continuing to execute, otherwise, selecting the next test case and repeating the judgment of the steps C) -D).
The test task comprises a test module and cycle number information thereof; the test module comprises one or more test cases, in this embodiment, one or more test cases with the same service type, and the test cases comprise one or more test steps and cycle number information thereof; therefore, the test task execution flow and the setting of the test task, the test module, the test case and the test step in the embodiment are equivalent to dividing the execution of the test into four layers, taking the test task as the whole test, and each time one test task is called for testing, the test module, the test case and the test step included in the test task can be tested correspondingly according to the content of the test task, so that the test efficiency is further improved. In addition, in the embodiment, the test case library is set to be a communication protocol rule knowledge base which is divided into three layers of a test module, test cases and test steps, so that the corresponding test cases can be conveniently selected.
Specifically, the service types include various service types specified by the substation secondary system communication message specification, such as an association class service, a directory class service, a data set class service, a constant value class service, a report class service, a log class service, a control class service, a file class service, a test service, an association negotiation service, a remote procedure call class service, and the like.
In this embodiment, the configuration of the test case may further include globally unique case numbers, that is, description, and other information, where the types of operation objects used in the test step in the test case are classified into a logic device, a logic node, a data object, a data set, a cache report control block, a non-cache report control block, a log control block, a constant value group control block, a log, and the like. The testing step is the minimum execution unit of the test case, one testing step realizes a basic service, and the configuration related to the testing step comprises unique step numbers, descriptions, basic service type codes, client lists, repeated execution times, operation objects, operation parameters, expected responses and other information in the case; in particular, for the CMS communication protocol, the test step types include association, abort, release association, read server directory, read logical device directory, read logical node directory, read all data values, read all data definitions, read all control block values, read data values, set data values, read data directory, read data definitions, create data sets, delete data sets, read data set directory, read data set values, set data set values, select, tape value select, cancel, execute, time activate operation, select activate set value group, select edit set value group, set edit set value, confirm edit set value group, read set value group control block value, read cache report control block value, set cache report control block value, read non-cache report control block value, read log control block value, set log control block value, log after querying specified entries, read log status value, read file, write file, delete file, read file attribute value, column file directory, delay, start report simulation, start report collection, stop report collection, block report collection, judge, operate prompt, override quality report, override report control block value, override report value, set override report value, write system record, total record cycle number, etc.
In this embodiment, referring to fig. 4, the overall flow principle when performing CMS communication protocol test is that a model configuration file corresponding to a test case library and a test object (i.e., an IED object, which is equivalent to a server model corresponding to CMS communication protocol test) is loaded first; then, a test scheme is formulated or loaded by formulating a test scheme flow or loading the test scheme flow, and IED objects to be tested are selected; or loading the historical task through a historical task loading flow; then, starting and testing; the test can be suspended at any time in the test execution process, and the test can be ended after the history task is saved in the suspended state, or the test can be continued or terminated; and automatically outputting a test report after the test is completed.
Specifically, referring to fig. 5, the process of making a test scheme in the CMS communication protocol test method of the present embodiment includes the following steps:
newly creating a test task and setting the cycle times of the test task; selecting a test module required by the test task, and setting the cycle times of the test module; selecting a required test case in the selected test module, and setting the cycle times of the test case; after the test cases corresponding to the required test modules are selected, the test tasks are saved so as to complete the formulation of the test scheme.
Referring to fig. 6, the flow of the loading test scheme in the CMS communication protocol test method of the present embodiment includes the following steps:
firstly, loading a test scheme, and if the test scheme (namely a test task) needs to be modified, modifying the test module and the test case setting in the test scheme, and storing other test schemes or new test schemes after modification.
Referring to fig. 7, the load history task flow in the CMS communication protocol testing method of the present embodiment includes the following steps:
and loading the saved historical task, and recovering task execution progress information, wherein the task execution progress information comprises data such as the current cycle times of the test task, the current cycle times of each test module, the current cycle times of each test case, the current execution test case, the historical test results of each test case and the like.
In addition, the CMS communication protocol testing method of this embodiment is further provided with an abnormal state self-recovery processing mechanism, for example, for processing a communication abnormal state and executing an abnormal processing in a certain step in a test case, where a processing manner for the communication abnormal state includes: if the communication interruption occurs in the corresponding communication equipment to be tested (namely IED equipment) in the test process, judging whether the next test step belongs to delay, association, operation prompt or service operation of other clients, if so, continuing to execute the current test case, otherwise, prompting whether to wait for communication recovery or ending the test; if the communication is selected to be recovered, the tested communication equipment continues to execute the test case after the communication is recovered. Therefore, the communication interruption condition can be conveniently and timely processed in a targeted manner, and the influence of the communication abnormal state on the subsequent testing steps is reduced conveniently.
The processing mode for executing the exception for a certain step in the test case comprises the following steps: if the execution abnormality of a certain test step occurs in the test process, judging whether the test case is provided with a failure continuous execution mark, if so, judging that the test case fails the test and continuously executing the subsequent test step of the test case, otherwise, judging that the test case fails the test and abandoning the subsequent test step of the test case; therefore, the follow-up treatment measures corresponding to the abnormal execution of the test steps can be flexibly selected by setting the failure continuous execution mark, and the influence of the abnormal execution of the follow-up test steps on the follow-up treatment measures is reduced conveniently.
CMS communication protocol test System embodiment
The embodiment provides a technical scheme of a CMS communication protocol testing system, which comprises a processor, wherein the processor is used for executing program instructions to realize the CMS communication protocol testing method in the CMS communication protocol testing method embodiment.
Since the specific operation and principles of the CMS communication protocol testing system in this embodiment have been described in detail in the above CMS communication protocol testing method embodiment, the details are not repeated here.
The invention has the following characteristics:
1) By setting the test cases capable of configuring the traversal attribute and the corresponding traversal test steps, the cyclic test can be performed on different traversal attribute values of different traversal types of one test case after the test case is called, so that the test corresponding to all the traversal attribute values is completed, namely, the test corresponding to a plurality of traversal attribute values can be realized without setting a plurality of test cases, the reusability of the test case can be improved, the test cases are not required to be respectively set according to different traversal attribute values, the test case library is simplified, the calling times can be reduced, and the test efficiency is comprehensively improved.
2) Through the setting of object grouping configuration and single frame sending configuration, the cyclic test can be carried out on different operation objects of one test case after the test case is called, namely, the test corresponding to a plurality of operation objects of the same type is completed through the call of one test case, the plurality of test cases do not need to be set for the plurality of operation objects, the relatively smaller number of the test cases is ensured on the basis of realizing the test on the plurality of operation objects, the reusability of the test cases is further improved, and the case library is simplified.
3) By setting the execution flow of the test task, the test module, the test case and the test step, the execution of the test is divided into four layers, the test task is taken as a test whole, and each test task is called to test, so that the test module, the test case and the test step included in the test task can be tested correspondingly according to the content of the test task, and the test efficiency is further improved.
It is to be understood that the above-described embodiments of the present invention are merely illustrative of or explanation of the principles of the present invention and are in no way limiting of the invention.
Claims (9)
1. The CMS communication protocol testing method comprises a test case execution step in a test task execution flow, and is characterized in that the test case execution step comprises the steps of checking the configuration condition of the test case and correspondingly performing traversal test of the test case according to the condition; the configuration of the test case comprises the configuration of the traversal attribute; under the condition that the test step is executed normally, the traversal test comprises the following steps:
1) Judging whether the test case is configured with the traversal attribute, if not, performing the step 2) according to the corresponding set test step; otherwise, continuing to judge whether an untested traversal attribute value exists in the configuration of the traversal attribute, ending the traversal test if the untested traversal attribute value does not exist, otherwise, executing the step 2 according to the testing step corresponding to the traversal attribute value to be tested;
2) Continuously executing the current test step under the condition that the test step is not executed, and continuously executing the next test step until each test step is executed after the execution is completed; and (3) repeating the processes of the steps 1) -2) until the traversal test is finished under the condition that the test step corresponding to the current traversal attribute value is executed.
2. The CMS communication protocol testing method of claim 1, wherein the configuration of the test cases further comprises an object grouping configuration and a single frame transmission configuration, the operation object grouping refers to a set of multiple operation objects of the same type, and configurable traversal attributes of the operation objects of the same type are consistent; the method for correspondingly performing the test case traversal test according to the configuration attribute condition of the test case comprises the following steps:
a) Judging whether the test case is configured with object grouping and is not configured with single frame transmission, if not, performing traversal test corresponding to the set operation object; if yes, continuing to judge whether an untested operation object exists in the configuration of the object group, if not, not performing the traversal test, otherwise, performing the traversal test corresponding to the operation object to be tested;
b) And d) after the traversing test corresponding to the operation object is finished, repeating the process of the step a) until the traversing test is not performed.
3. The CMS communication protocol testing method of claim 1 or 2, wherein the test task execution flow comprises:
a) Judging whether the current test task is circularly executed, ending the test if the current test task is circularly executed, otherwise, continuing to execute the current test task and performing the step B);
b) Judging whether the test module in the current test task is executed completely, if so, re-executing the step A), otherwise, continuing to execute the current test module and executing the step C);
c) Judging whether all the test cases in the current test module are executed, if not, continuing to execute the current test cases according to the test case execution step and performing the step D); otherwise, judging whether the current test module is completely circularly executed, if so, selecting the next test module and repeating the steps B) -C), and if not, continuing to execute the current test module and repeating the steps;
d) Judging whether the current test case is circularly executed, if not, continuing to execute, otherwise, selecting the next test case and repeating the judgment of the steps C) -D);
the test task comprises a test module and cycle number information thereof; the test module comprises one or more test cases, and the test cases comprise one or more test steps and cycle number information thereof.
4. The CMS communication protocol testing method of claim 1 or 2, wherein if the communication interruption occurs in the corresponding communication device under test during the testing, it is first determined whether the next testing step belongs to a delay, association, operation prompt or service operation of other clients, if yes, the current test case is continuously executed, otherwise, whether the communication is waiting for recovery or ending the testing is prompted; if the communication waiting is selected to be recovered, the tested communication equipment continues to execute the test case after the communication is recovered.
5. The CMS communication protocol test method of claim 1 or 2, wherein if an abnormal execution of a certain test step occurs during the test, it is determined whether the test case has set a fail continue flag, if so, it is determined that the test case fails the test and continues to execute the subsequent test step of the test case, otherwise, it is determined that the test case fails the test and the subsequent test step of the test case is abandoned.
6. The CMS communication protocol testing method of claim 1 or 2, wherein the configuration of the traversal attribute comprises configuration of a traversal attribute type and a corresponding traversal attribute value; the traversal attribute types include one or more of ACSI type, control block, FC function constraint, and constant value group number.
7. The method according to claim 6, wherein the traversal attribute values corresponding to the ACSI type include one or more of a DATA object DataObject, a DATA SET DATA-SET, a buffer report control block BRCB, a non-buffer report control block URCB, a LOG control block LCB, a LOG, a constant value group control block SGCB, a GOOSE control block gcb, and a multicast sample value control block MSVCB;
the traversal attribute values corresponding to the control blocks comprise one or more of a buffer report control block BRCB, a non-buffer report control block URCB, a log control block LCB, a fixed value group control block SGCB, a GOOSE control block GoCB and a multicast sampling value control block MSVCB;
the traversal attribute values corresponding to the FC function constraint comprise one or more of state information ST, measured value MX, control CO, description DC, configuration CF, substitution SV, fixed value group SG, editable fixed value group SE and set point parameter SP;
the traversal attribute values corresponding to the constant value group numbers comprise one or more of a numerical range formed from a set numerical value to a maximum value, and the maximum value is determined according to the constant value group number in the test model corresponding to the test.
8. The CMS communication protocol testing method of claim 3, wherein the testing module comprises one or more test cases of the same service type, the service type comprising one or more of the service types specified by the substation secondary system communication message specification.
9. A CMS communication protocol testing system comprising a processor for executing program instructions to implement the CMS communication protocol testing method of any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311621596.2A CN117749675A (en) | 2023-11-29 | 2023-11-29 | CMS communication protocol testing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311621596.2A CN117749675A (en) | 2023-11-29 | 2023-11-29 | CMS communication protocol testing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117749675A true CN117749675A (en) | 2024-03-22 |
Family
ID=90251750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311621596.2A Pending CN117749675A (en) | 2023-11-29 | 2023-11-29 | CMS communication protocol testing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117749675A (en) |
-
2023
- 2023-11-29 CN CN202311621596.2A patent/CN117749675A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108459951B (en) | Test method and device | |
| US6651241B1 (en) | Scriptor and interpreter | |
| CN102306122A (en) | Automated testing method and equipment | |
| CN113704046B (en) | Fault alarm processing method and device, equipment and storage medium | |
| CN112306877A (en) | Power system fault operation and maintenance method and system | |
| CN102984737B (en) | A kind of improve parameter unification collocation method of wireless network and device | |
| CN111694752B (en) | Application testing method, electronic device and storage medium | |
| CN112685370A (en) | Log collection method, device, equipment and medium | |
| CN114238081A (en) | Method and system suitable for small satellite batch test | |
| CN110287092A (en) | A kind of electricity transaction system and its automatic test approach based on graphical interfaces | |
| CN103457996B (en) | A kind of Protocol Conformance Test System internal data store method and system | |
| CN117749675A (en) | CMS communication protocol testing method and system | |
| US20230412457A1 (en) | Method for multi-policy conflict avoidance in autonomous network | |
| Han et al. | Automated warship software testing system based on loadrunner automation API | |
| CN112069144A (en) | Method and device for collecting system logs by multi-control cluster | |
| CN116647490A (en) | Aviation AFDX network data detection system | |
| CN113194124B (en) | Distributed real-time database-based DCS background multi-node directory synchronization method | |
| CN115599881A (en) | Workflow creation method, system, electronic device, and computer-readable storage medium | |
| CN115878448A (en) | Database test method, distributed database and storage medium | |
| CN113381896A (en) | Substation information protection substation full life cycle dynamic configuration management and control method and system | |
| CN112732551A (en) | Automatic test method and system for radio frequency indexes | |
| CN111240920B (en) | Performance test method, device, server and storage medium | |
| CN114915562B (en) | IEC 61850 station control layer network communication service simulation server and simulation method | |
| CN104808599A (en) | Test process management and control system, method and apparatus for filters | |
| CN105407112B (en) | Equipment capability learning method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |