CN104980317B - A kind of Auto-Test System and method of testing of dispatch data net equipment - Google Patents
A kind of Auto-Test System and method of testing of dispatch data net equipment Download PDFInfo
- Publication number
- CN104980317B CN104980317B CN201510342761.XA CN201510342761A CN104980317B CN 104980317 B CN104980317 B CN 104980317B CN 201510342761 A CN201510342761 A CN 201510342761A CN 104980317 B CN104980317 B CN 104980317B
- Authority
- CN
- China
- Prior art keywords
- test
- case
- automation
- platform
- configuration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 452
- 238000010998 test method Methods 0.000 title claims abstract description 14
- ABEXEQSGABRUHS-UHFFFAOYSA-N 16-methylheptadecyl 16-methylheptadecanoate Chemical compound CC(C)CCCCCCCCCCCCCCCOC(=O)CCCCCCCCCCCCCCC(C)C ABEXEQSGABRUHS-UHFFFAOYSA-N 0.000 claims description 43
- 241000764238 Isis Species 0.000 claims description 43
- 238000005417 image-selected in vivo spectroscopy Methods 0.000 claims description 43
- 238000012739 integrated shape imaging system Methods 0.000 claims description 43
- 238000000034 method Methods 0.000 claims description 26
- 238000011056 performance test Methods 0.000 claims description 26
- 230000000875 corresponding effect Effects 0.000 claims description 17
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000011990 functional testing Methods 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 11
- 238000007493 shaping process Methods 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 3
- 230000002596 correlated effect Effects 0.000 claims description 3
- 238000005314 correlation function Methods 0.000 claims description 3
- 230000003993 interaction Effects 0.000 claims description 3
- 238000004088 simulation Methods 0.000 claims description 3
- 238000012795 verification Methods 0.000 claims description 3
- 238000013497 data interchange Methods 0.000 claims description 2
- 238000013480 data collection Methods 0.000 claims 1
- 238000012423 maintenance Methods 0.000 abstract 1
- 230000008569 process Effects 0.000 description 4
- -1 MPLS Chemical compound 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of Auto-Test System and method of testing of dispatch data net equipment, the execution interface that test instrumentation automation use-case performs platform is connected with automatic test network frock interface 1；The control interface of test instrumentation is connected with the interface 2 of automatic test network frock；The control interface of tested dispatch data net equipment is connected with the interface 3 of automatic test network frock；Test instrumentation automate storehouse and equipment under test automation storehouse respectively by logic interfacing 4 and logic interfacing 5 be automated use-case perform platform call.The present invention incorporates each scattered links such as the maintenance of test instrumentation operation, equipment under test control, test log archive and beta version, realize the automatic test of network router, interchanger for dispatching data, solves the problems, such as otherness present in traditional manual test, efficiency is low and test period is long, standard, uniformity and the fairness of test are realized, and substantially increases operating efficiency.
Description
Technical field
The present invention relates to the automatic test system of a kind of network equipment detection technology, more particularly to a kind of dispatch data net equipment
System and method of testing.
Background technology
The IPv4 Routing Protocols that dispatch data net equipment is related to mainly have RIP, OSPF, ISIS, BGP, MPLS, LDP etc.,
The application of IPv6 Routing Protocols is also in process of construction.The traditional method of testing of dispatch data net equipment be using manual test,
Because the Routing Protocol type being related to is more, device category is more, test event is more, therefore the workload tested is big, to tester
The quantity of member and the requirement of skill level are also high, and different testers due to the understanding to standard it is different, in test process
In be also possible to produce certain deviation.
The test instrumentation of the network equipment mainly uses TESTCENTER at present, its Automated condtrol software I TEST, integrates
TESTCENTER supports storehouse, by working out specific automatized script, can control instrument to be run by specific step.The invention
Surveyed using the dispatching automation of ITEST, TESTCENTER, server, network frock interchanger and automatic test cases structure
Test system, solve uniformity, the fairness problem of test.
Tested by the manual test and Auto-Test System that are carried out to different types of dispatch data net equipment a large amount of
Compare, using dispatch data net equipment Auto-Test System and its method of testing（Performance, functional test use-case）, it is greatly reduced
The workload of tester, operating efficiency is improved, and eliminate the different issuable measurement errors of tester.
The content of the invention
In order to solve the problems of the prior art, the present invention provide a kind of dispatch data net equipment Auto-Test System and
Method of testing, the automatic test of dispatch data net equipment can be realized so that test process is without manual intervention, test result
Automatically analyze, test report is automatically generated and stored, and is eliminated measurement error, is reached the uniformity and fairness of test, carry significantly
High operating efficiency.
In order to solve the above problems, the technical solution used in the present invention is：
A kind of automatization test system of dispatch data net equipment, it is characterised in that：Including test instrumentation, test instrumentation certainly
Dynamicization storehouse, automatic test network frock, equipment under test automation storehouse and automation use-case perform platform, and the test instrumentation is certainly
Dynamicization use-case performs being connected with the interface 1 of automatic test network frock interchanger for Platform communication interface；The test instrumentation
Control interface be connected with the interface 2 of automatic test network frock interchanger；The control of the tested dispatch data net equipment
Interface is connected with the interface 3 of automatic test network frock interchanger；The test instrumentation automation storehouse and equipment under test are automatic
Change storehouse respectively by logic interfacing 4 and logic interfacing 5 be automated use-case perform platform call data；
The test instrumentation, for carrying out relevant parameter with postponing, platform courses are performed by automatic test cases, are called
The automation storehouse of test instrumentation, automatically generates test flow, is sent and assisted to tested dispatch data net equipment by its test port
Message and data message are discussed, completes protocol interaction and data interchange between test instrumentation and tested dispatch data net equipment；
The automatic test cases perform platform, for carrying out relevant parameter with postponing, are called by its logic interfacing 4
Test instrumentation automates the automatic test cases in storehouse, calls equipment under test to automate the automation in storehouse by logic interfacing 5 and surveys
Device configuration file corresponding to example on probation, and corresponding order is performed by the test logical order of test case, realize test number
According to automatic collection and test data automatically analyze；
The automatic test network frock interchanger, for carrying out relevant parameter with postponing, by its interface 1 receive come
Automatic test cases perform the test instrumentation control message part of platform, and it is sent into test instrumentation by interface 2；And lead to
Cross interface 1 and receive the equipment under test control file that platform is performed from test case, and it is sent to tested tune by interface 3
Degrees of data net equipment；
The test instrumentation automates storehouse, for converging dispatch data net automatic test cases, for automation simulation
Specific test scene, platform is performed by automation use-case and is called by logic interfacing 4, and control test instrumentation to be held
OK；
The equipment under test automates storehouse, for converging the device configuration corresponding to dispatch data net automatic test cases
File, platform is performed by automation use-case and is called by logic interfacing 5, control equipment under test is performed；
The tested dispatch data net equipment, for carrying out relevant parameter with postponing, received by its control interface automatic
Change use-case and perform the configuration file progress device configuration that platform issues, corresponding protocol massages and datagram are sent to test instrumentation
Text.
A kind of automatization test system of foregoing dispatch data net equipment, it is characterised in that：The test instrumentation is carried out
Relevant configuration includes：Configure quantity and IP address, the Routing Protocol for configuring port analog equipment, the configuration end of port analog equipment
The transmission rate of mouth analogue flow rate and testing time；The related Routing Protocol configuration of the test instrumentation includes：RIP agreements,
Ospf protocol, ISIS agreements, bgp protocol, mpls protocol, LDP agreements, RIPng agreements, OSPFv3 agreements, BGP4+ agreements,
ISISv6 agreements.
A kind of automatization test system of foregoing dispatch data net equipment, it is characterised in that：The automation use-case is held
The configuration of row platform includes：Configuration testing instrument control interface IP address, configuration testing Meter Test port, configuration implementation procedure
Store path, configuration testing instrument automation test case and the equipment under test of journal file automate the calling of base configuration file
The store path that path, the execution of configuration testing instrument automation test case are reported after terminating.
A kind of automatization test system of foregoing dispatch data net equipment, it is characterised in that：Configured automatic test
The VLAN configurations of network frock interchanger：Test instrumentation, tested dispatch data net equipment and automation use-case perform platform division
In same VLAN.
A kind of automatization test system of foregoing dispatch data net equipment, it is characterised in that：The test instrumentation is automatic
Changing the automatic test cases of storehouse configuration includes：Performance test case and functional test use-case；The test instrumentation automates storehouse
The performance test case of configuration includes：RIP routing capacitys, OSPF routing capacitys, ISIS routing capacitys, BGP routing capacitys,
RIPng routing capacitys, OSPFv3 routing capacitys, ISISv6 routing capacitys, BGP4+ routing capacitys, ospf neighbor capacity, ISIS
Neighbours' capacity, bgp neighbor capacity；The performance test case in the test instrumentation automation storehouse configures its test flow load：
The linear speed of port 100%, its flow send the time be：60s.
A kind of automatization test system of foregoing dispatch data net equipment, it is characterised in that：The tested scheduling number
Configuration file according to the automation storehouse of net equipment includes：Performance configuration file and functional configuration file；The tested scheduling data
The performance configuration file in the automation storehouse of net equipment includes：RIP routing capacitys, OSPF routing capacitys, ISIS routing capacitys, BGP
Routing capacity, RIPng routing capacitys, OSPFv3 routing capacitys, ISISv6 routing capacitys, BGP4+ routing capacitys, ospf neighbor
Capacity, ISIS neighbours' capacity, bgp neighbor capacity.
A kind of automatization test system of foregoing dispatch data net equipment, it is characterised in that：The test instrumentation is automatic
Changing the functional test use-case of storehouse configuration includes：Md5 authentication OSPF, ISIS, BGP of Routing Protocol, the load balancing of Routing Protocol
OSPF, ISIS, BGP MED attributes, QoS classification/shaping, VPN nat features.
A kind of automatization test system of foregoing dispatch data net equipment, it is characterised in that：The tested scheduling data
The functional configuration file in the automation storehouse of net equipment includes：Md5 authentication OSPF, ISIS, BGP of Routing Protocol, Routing Protocol
Load balancing OSPF, ISIS, BGP MED attributes, QoS classification/shaping, VPN nat features.
A kind of automated testing method of dispatch data net equipment, it is characterised in that：Methods described includes performance test side
Method and function test method,
The automatic performance method of testing of the dispatch data net equipment comprises the following steps：
1）, automation use-case performs platform and configure the related route of tested dispatch data net equipment in test envelope file and assist
The routing capacity parameter of view, neighbours' capacity parameter, Routing Protocol include RIP, OSPF, ISIS, BGP, RIPng, OSPFv3, BGP4
+；
2）, that automation use-case performs the store path of platform configuration implementation procedure journal file, configuration testing instrument is automatic
Change storehouse automatic test cases and equipment under test automation storehouse correspond to the calling path of configuration file, configuration testing report deposit
Store up path；
3）, automation use-case perform platform pass through automatic test network frock interchanger call test instrumentation automate storehouse
Performance test case, the Routing Protocol of the port analog of the meter configuration file configuration testing instrument in test case,
Flow is built, the load for setting flow is 100%, testing time 60s；
4）, automation use-case perform platform pass through automatic test network frock interchanger call equipment under test automate storehouse
Performance test case configuration file, by automatic test network frock interchanger in a manner of SSHv2 session control to tested
Equipment carries out the configuration of correlated performance test；
5）, automation use-case perform platform by the port of automatic test network frock Switch control test instrumentation with
The port of tested dispatch data net equipment carries out ARP study；
6）, test instrumentation automation use-case perform platform control under, carry out routing capacity test when, with tested scheduling
Data network equipment establishes the neighbours of related protocol, issues the routing capacity for the related protocol that tested dispatch data net equipment is supported；
When carrying out routing neighbor volume test, neighbours that related protocol is established with tested dispatch data net equipment, the number of the neighbours of foundation
Measure to be tested neighbours' capacity that dispatch data net is supported, each neighbours issue 10 routes；
7）, automation use-case perform platform by the port of automatic test network frock Switch control test instrumentation to
Tested dispatch data net device port sending destination location is the flow for having issued route, and stopping flow after 60s sends, automation
Use-case, which performs platform and obtains traffic statistics, simultaneously carries out result judgement, if the transmission data packet number of flow is more than zero, and
And flow transmission packet quantity be equal to flow received data packet quantity, discriminating test result be by, it is on the contrary then
Discriminating test result is failure；
8）, automation use-case perform platform pass through automatic test network frock Switch control test instrumentation release test
Port, empty the configuration of test instrumentation；
9）, automation use-case perform platform by automatic test network frock interchanger call be devices under automating
Base configuration file, all configurations of tested dispatch data net device clear are controlled, return to original state；
10）, automation use-case perform the survey that platform generates corresponding routing capacity, the volume automated performance test case of neighbours
Examination report, and be stored under the path of setting；
The method for automatically testing functions of the dispatch data net equipment comprises the following steps：
（1）Store path, the configuration testing instrument for automating use-case execution platform configuration implementation procedure journal file are automatic
Change the automatic test cases in storehouse and the storage road for calling path, configuration testing to report of equipment under test automation base configuration file
Footpath；
（2）Automate use-case execution platform and pass through automatic test network frock interchanger calling test instrumentation automation storehouse
Functional test use-case, the Routing Protocol of the port analog of the meter configuration file configuration testing instrument in test case,
Structure test flow, configure the transmission rate of flow and send the time；
（3）Automate use-case execution platform and pass through automatic test network frock interchanger calling equipment under test automation storehouse
Functional test use-case configuration file, by automatic test network frock interchanger in a manner of SSHv2 session control to tested
Equipment carries out the configuration of correlation function test；
（4）Automation use-case perform platform by automatic test network frock interchanger control respectively test instrumentation and by
Survey dispatch data net equipment and interact formula functional verification by the flow of automatic test cases, and according to the decision rule of setting
Carry out result judgement；
（5）Automate use-case execution platform and pass through the release test of automatic test network frock Switch control test instrumentation
Port, empty the configuration of test instrumentation；
（6）Automation use-case performs platform and is devices under automating by automatic test network frock interchanger calling
Base configuration file, all configurations of tested dispatch data net device clear are controlled, return to original state；
（7）Automate use-case and perform md5 authentication OSPF, ISIS, BGP that platform generates corresponding Routing Protocol, route association
Load balancing OSPF, ISIS of view, BGP MED attributes, QoS classification/shaping, the automated function test of VPN nat features are used
The test report of example, and be stored under the path of setting.
The present invention has following advantage relative to traditional manual test：
（1）Test has uniformity：The Routing Protocol that dispatch data net equipment is related to is numerous, distinct device manufacturer for
The difference that agreement understands, the mode taken in design is also different, and for method specified in standard, different testers also can
The deviation on understanding is produced, therefore testing differentia is occurred using manual test unavoidably；Automatic test system provided by the invention
System and method, after Test Sample Design is fixed, performed flow is consistent, therefore test has uniformity, can be specialty inspection
Survey mechanism or equipment manufacturers provide effective detection means and instrument.
（2）Improve testing efficiency：The test of number net equipment is dispatched, particularly performance test, the configuration amount of equipment under test is big,
Therefore during traditional manual test, waiting facilities configuration occupies the substantial amounts of testing time；Using the automatic test system of the present invention
When system is tested, test process can be tested without manual intervention, whole day any time, substantially increase test effect
Rate.
（3）Ensure the fairness of test：Dispatch data net equipment Auto-Test System provided by the invention, automatically generates knot
The test report of fruit, automatic storage, without manual intervention, therefore the fairness of test is ensure that well.
Brief description of the drawings
Fig. 1 is the system block diagram that dispatch data net equipment provided by the invention tests test system implementation automatically；
Fig. 2 is the flow that the dispatch data net equipment of the present invention tests the performance test methods example of test system automatically
Figure；
Fig. 3 is the flow that the dispatch data net equipment of the present invention tests the function test method example of test system automatically
Figure.
Embodiment
The invention will be further described below in conjunction with the accompanying drawings.
As shown in figure 1, the automatization test system of kind dispatch data net equipment, it is characterised in that：Including test instrumentation,
Test instrumentation automation storehouse, automatic test network frock, equipment under test automation storehouse and automation use-case perform platform, described
Test instrumentation automation use-case performs being connected with the interface 1 of automatic test network frock interchanger for Platform communication interface；Institute
The control interface for stating test instrumentation is connected with the interface 2 of automatic test network frock interchanger；The tested dispatch data net
The control interface of equipment is connected with the interface 3 of automatic test network frock interchanger；Test instrumentation automation storehouse and by
Measurement equipment automation storehouse respectively by logic interfacing 4 and logic interfacing 5 be automated use-case perform platform call data；
The test instrumentation, for carrying out relevant parameter with postponing, platform courses are performed by automatic test cases, are called
The automation storehouse of test instrumentation, automatically generates test flow, is sent and assisted to tested dispatch data net equipment by its test port
Message and data message are discussed, so as to realize that protocol interaction between test instrumentation and tested dispatch data net equipment and data are mutual
It is logical, complete performance, the functional test of dispatch data net equipment；
The automatic test cases perform platform, for carrying out relevant parameter with postponing, are called by its logic interfacing 4
Test instrumentation automates the automatic test cases in storehouse, calls equipment under test to automate storehouse by logic interfacing 5（Automatic test
Configuration file corresponding to use-case）To realize the control to test instrumentation and tested dispatch data net equipment, and by test case
Test logical order and perform corresponding order, realize the automatic collection of test data and automatically analyzing for test data；
The automatic test network frock interchanger, for carrying out relevant parameter with postponing, by its interface 1 receive come
Automatic test cases perform the test instrumentation control message part of platform, and it is sent into test instrumentation by interface 2；And lead to
Cross interface 1 and receive the equipment under test control file that platform is performed from test case, and it is sent to tested tune by interface 3
Degrees of data net equipment；
The test instrumentation automates storehouse, for converging dispatch data net automatic test cases, for automation simulation
Specific test scene, platform is performed by automation use-case and is called by logic interfacing 4, and control test instrumentation to be held
OK；
The equipment under test automates storehouse, for converging the device configuration corresponding to dispatch data net automatic test cases
File, platform is performed by automation use-case and is called by logic interfacing 5, control equipment under test is performed；
The tested dispatch data net equipment, for carrying out relevant parameter with postponing, received by its control interface automatic
Change use-case and perform the configuration file progress device configuration that platform issues, corresponding protocol massages and datagram are sent to test instrumentation
Text.
The test instrumentation, which carries out relevant configuration, to be included：Configure quantity and IP address, the configuration port of port analog equipment
The Routing Protocol of analog machine, the transmission rate for configuring port analog flow and testing time.
The related Routing Protocol configuration of the test instrumentation includes：RIP agreements, ospf protocol, ISIS agreements, bgp protocol,
Mpls protocol, LDP agreements, RIPng agreements, OSPFv3 agreements, BGP4+ agreements, ISISv6 agreements.
The configuration that the automation use-case performs platform includes：Configuration testing instrument control interface IP address, configuration testing
Meter Test port, configure the store path of implementation procedure journal file, configuration testing instrument automation test case and tested
The storage that the calling path of equipment automatization base configuration file, the execution of configuration testing instrument automation test case are reported after terminating
Path.
The VLAN configurations of configured automatic test network frock interchanger：Test instrumentation, tested dispatch data net equipment
Platform is performed with automation use-case to be divided in same VLAN.
The automatic test cases of the test instrumentation automation storehouse configuration include：Performance test case and functional test are used
Example.
The performance test case of the test instrumentation automation storehouse configuration includes：RIP routing capacitys, OSPF routing capacitys,
ISIS routing capacitys, BGP routing capacitys, RIPng routing capacitys, OSPFv3 routing capacitys, ISISv6 routing capacitys, BGP4+ roads
By capacity, ospf neighbor capacity, ISIS neighbours' capacity, bgp neighbor capacity.
The performance test case in the test instrumentation automation storehouse configures its test flow load：The linear speed of port 100%,
Its flow send the time be：60s.
The functional test use-case of the test instrumentation automation storehouse configuration includes：The md5 authentication OSPF of Routing Protocol,
ISIS, BGP, load balancing OSPF, ISIS of Routing Protocol, BGP MED attributes, QoS classification/shaping, VPN nat features.
The configuration file in the automation storehouse of the tested dispatch data net equipment includes：Performance configuration file and function are matched somebody with somebody
Put file.
The performance configuration file in the automation storehouse of the tested dispatch data net equipment includes：RIP routing capacitys, OSPF roads
By capacity, ISIS routing capacitys, BGP routing capacitys, RIPng routing capacitys, OSPFv3 routing capacitys, ISISv6 routing capacitys,
BGP4+ routing capacitys, ospf neighbor capacity, ISIS neighbours' capacity, bgp neighbor capacity.
The functional configuration file in the automation storehouse of the tested dispatch data net equipment includes：The md5 authentication of Routing Protocol
OSPF, ISIS, BGP, load balancing OSPF, ISIS of Routing Protocol, BGP MED attributes, QoS classification/shaping, VPN NAT work(
Energy.
The invention also discloses a kind of dispatch data net equipment automatic test approach, methods described is applied to described scheduling
In data network Auto-Test System, methods described includes performance test methods and function test method.Wherein, test instrumentation is automatic
Changing storehouse includes dispatch data net automatic performance test performance use-case：RIP routing capacitys, OSPF routing capacitys, ISIS routes are held
Amount, BGP routing capacitys, RIPng routing capacitys, OSPFv3 routing capacitys, ISISv6 routing capacitys, BGP4+ routing capacitys,
Ospf neighbor capacity, ISIS neighbours' capacity, bgp neighbor capacity；Also include dispatch data net Function Test Automation performance use case：
The md5 authentication of Routing Protocol（OSPF、ISIS、BGP）, Routing Protocol load balancing（OSPF、ISIS）, BGP MED attributes,
QoS classification/shaping, VPN nat features.
As shown in Fig. 2 the automatic performance method of testing of the dispatch data net equipment comprises the following steps：
（a）Automation use-case performs the related route association that platform configures tested dispatch data net equipment in test envelope file
View（RIP、OSPF、ISIS、BGP、RIPng、OSPFv3、BGP4+）Routing capacity parameter, neighbours' capacity parameter；
（b）Store path, the configuration testing instrument for automating use-case execution platform configuration implementation procedure journal file are automatic
Change the store path for calling path, configuration testing to report of test case and equipment under test automation base configuration file；
（c）Automate use-case execution platform and pass through automatic test network frock interchanger calling test instrumentation automation storehouse
Performance test case, the meter configuration file in test case（*.xml）The road of the port analog of configuration testing instrument
By agreement, structure flow, the load for setting flow is 100%, testing time 60s；
（d）Automate use-case execution platform and pass through automatic test network frock interchanger calling equipment under test automation storehouse
Performance test case configuration file, by automatic test network frock interchanger in a manner of SSHv2 session control to tested
Equipment carries out the configuration of correlated performance test；
（e）Automate use-case perform platform by the port of automatic test network frock Switch control test instrumentation with
The port of tested dispatch data net equipment carries out ARP study；
（f）Test instrumentation is in the case where automation use-case performs the control of platform, when carrying out routing capacity test, with tested scheduling
Data network equipment establishes the neighbours of related protocol, issues the routing capacity for the related protocol that tested dispatch data net equipment is supported；
When carrying out routing neighbor volume test, neighbours that related protocol is established with tested dispatch data net equipment, the number of the neighbours of foundation
Measure to be tested neighbours' capacity that dispatch data net is supported, each neighbours issue 10 routes；
（g）Automate use-case perform platform by the port of automatic test network frock Switch control test instrumentation to
Tested dispatch data net device port sending destination location is the flow for having issued route, and stopping flow after 60s sends, automation
Use-case, which performs platform and obtains traffic statistics, simultaneously carries out result judgement, if the transmission data packet number of flow is more than zero, and
And flow transmission packet quantity be equal to flow received data packet quantity, discriminating test result be by, it is on the contrary then
Discriminating test result is failure；
（h）Automate use-case execution platform and pass through the release test of automatic test network frock Switch control test instrumentation
Port, empty the configuration of test instrumentation；
（i）Automation use-case performs platform and is devices under automating by automatic test network frock interchanger calling
Base configuration file, all configurations of tested dispatch data net device clear are controlled, return to original state；
（j）Automate use-case and perform the survey that platform generates corresponding routing capacity, the volume automated performance test case of neighbours
Examination report, and be stored under the path of setting.
As shown in figure 3, the method for automatically testing functions of the dispatch data net equipment comprises the following steps：
（1）Store path, the configuration testing instrument for automating use-case execution platform configuration implementation procedure journal file are automatic
Change the store path for calling path, configuration testing to report of test case and equipment under test automation base configuration file；
（2）Automate use-case execution platform and pass through automatic test network frock interchanger calling test instrumentation automation storehouse
Functional test use-case, the meter configuration file in test case（*.xml）The road of the port analog of configuration testing instrument
By agreement, structure test flow, configure the transmission rate of flow and send the time；
（3）Automate use-case execution platform and pass through automatic test network frock interchanger calling equipment under test automation storehouse
Functional test use-case configuration file, by automatic test network frock interchanger in a manner of SSHv2 session control to tested
Equipment carries out the configuration of correlation function test；
（4）Automation use-case perform platform by automatic test network frock interchanger control respectively test instrumentation and by
Survey dispatch data net equipment and interact formula functional verification by the flow of automatic test cases, and according to the decision rule of setting
Carry out result judgement；
（5）Automate use-case execution platform and pass through the release test of automatic test network frock Switch control test instrumentation
Port, empty the configuration of test instrumentation；
（6）Automation use-case performs platform and is devices under automating by automatic test network frock interchanger calling
Base configuration file, all configurations of tested dispatch data net device clear are controlled, return to original state；
（7）Automate use-case and perform the md5 authentication that platform generates corresponding Routing Protocol（OSPF、ISIS、BGP）, route
The load balancing of agreement（OSPF、ISIS）, BGP MED attributes, QoS classification/shaping, the automation function such as VPN nat features survey
The test report of example on probation, and be stored under the path of setting.
Wherein, the step（4）In, in the case where automation use-case performs the control of platform, carry out ISIS/OSPF/BGP routes
During the md5 authentication Function Test Automation of agreement, the fixed md5 authentication password of test instrumentation configuration, tested dispatch data net is set
When attempting to establish neighbours with test instrumentation for standby 1st time, md5 authentication function is not configured, attempts to establish neighbours with test instrumentation for the 2nd time
When, the md5 authentication password of configuration error, when attempting to establish neighbours with test instrumentation for the 3rd time, correct md5 authentication password is configured,
Check that the neighbours of test instrumentation establish situation every time, and verified by sending data traffic, automation use-case performs platform
Obtain traffic statistics and carry out result judgement, if the transmission data packet number of flow is more than zero, and the transmission of flow
The quantity of packet is equal to the quantity of the received data packet of flow, and discriminating test result is to pass through on the contrary then discriminating test result
For failure；
Wherein, the step（4）In, in the case where automation use-case performs the control of platform, carry out OSPF/ISIS Routing Protocols
Load-balancing function automatic test when, the neighbours that two ports of test instrumentation establish same protocol with equipment under test are concurrent
Cloth identical is route, and the 3rd port sending destination location of test instrumentation is the flow for having issued route, is loaded as 100% port
Linear speed, automatic test platform obtain the port flow statistical information of test instrumentation by automatic test network frock interchanger
And result judgement is carried out, if the packet that two flow receiving ports receive is more than zero, and two flow receiving ports
The ratio r atio ranges of variables of the packet received are between 0.95 ~ 1.05, then discriminating test result is by the contrary
Then discriminating test result is failure；
Wherein, the step（4）In, in the case where automation use-case performs the control of platform, carry out BGP MED attributes function certainly
When dynamicization is tested, two ports and the equipment under test of test instrumentation establish ebgp neighbor and issue identical route, and route is set
Different med values, the 3rd port sending destination location of test instrumentation are the flow for having issued route, are loaded as 100% port
Linear speed, automatic test platform obtain the port flow statistical information of test instrumentation by automatic test network frock interchanger
And result judgement is carried out, if issue route the packet that the small port of med value receives and is more than zero, and equal to the number sent
According to packet stream amount, then discriminating test result is by the way that on the contrary then discriminating test result is failure；
Wherein, the step（4）In, in the case where automation use-case performs the control of platform, it is automatic to carry out QoS classification/shaping
When changing test, 1 port of test instrumentation builds 8 flows and is sent to tested dispatch data net equipment, and load is 10Mbit/
S, automatic test platform call the policy configuration file of equipment under test by logic port 5 and are issued to equipment under test, automatically
Change test platform to go forward side by side by the receiving port traffic statistics of automatic test network frock interchanger acquisition test instrumentation
Row result judges, if the speed that 8 flows receive is respectively 1Mbit/s, 2Mbit/s, 3Mbit/s, 4Mbit/s, 5Mbit/
S, 6Mbit/s, 7Mbit/s, 8Mbit/s or so, error ratio ratio ranges of variables then judge to survey between 0.95 ~ 1.05
Test result is by the way that on the contrary then discriminating test result is failure；
Wherein, the step（4）In, in the case where automation use-case performs the control of platform, carry out VPN nat feature automations
During test, automatic test platform is called the NAT break-through VPN of equipment under test configuration file by logic port 5 and is issued to
Equipment under test, while control 3 ports of test instrumentation to bind 3 different VPN respectively by logic interfacing 4, at two ends
Mouth structure source IP address change identical flow, loads and passes through automation for 20fps, transmission time 1s, automatic test platform
Test network frock interchanger obtains the packet capturing data of the 3rd port of test instrumentation and carries out result judgement, if from difference
The source port number of VPN source IP address identical message is different, then discriminating test result is to pass through on the contrary then discriminating test result
For failure.
General principle, the main features and advantages of the present invention have been shown and described above.The technical staff of the industry should
Understand, the present invention is not limited to the above embodiments, the original for simply illustrating the present invention described in above-described embodiment and specification
Reason, without departing from the spirit and scope of the present invention, various changes and modifications of the present invention are possible, these changes and improvements
It all fall within the protetion scope of the claimed invention.The claimed scope of the invention is by appended claims and its equivalent circle
It is fixed.
Claims (9)
- A kind of 1. automatization test system of dispatch data net equipment, it is characterised in that：It is automatic including test instrumentation, test instrumentation Change storehouse, automatic test network frock, equipment under test automation storehouse and automation use-case and perform platform, the automation use-case is held Row Platform communication interface is connected with the interface 1 of automatic test network frock interchanger；The control interface of the test instrumentation with The interface 2 of automatic test network frock interchanger connects；The control interface of the tested dispatch data net equipment and automation The interface 3 of test network frock interchanger connects；The test instrumentation automation storehouse and equipment under test automation storehouse pass through respectively Logic interfacing 4 and logic interfacing 5 be automated use-case perform platform call data；The test instrumentation, for carrying out relevant parameter with postponing, platform courses are performed by automation use-case, call test instrumentation Storehouse is automated, automatically generates test scene, protocol massages sum is sent to tested dispatch data net equipment by its test port According to message, the protocol interaction and data interchange between test instrumentation and tested dispatch data net equipment are completed；The automation use-case performs platform, and for carrying out relevant parameter with postponing, test instrumentation is called by its logic interfacing 4 The automatic test cases in storehouse are automated, the automatic test cases pair in equipment under test automation storehouse are called by logic interfacing 5 The device configuration file answered, and corresponding order is performed by the test logical order of test case, realize the automatic of test data Collection automatically analyzes with test data；The automatic test network frock interchanger, for carrying out relevant parameter with postponing, received by its interface 1 come automatic Change use-case and perform the test instrumentation control message of platform, and it is sent to test instrumentation by interface 2；And connect by interface 1 The equipment under test control file that platform is performed from test case is received, and it is sent to tested dispatch data net by interface 3 Equipment；The test instrumentation automates storehouse, and for converging dispatch data net automatic test cases, automatic simulation is specifically tested Scene, platform is performed by automation use-case and is called by logic interfacing 4, and control test instrumentation to be performed；The equipment under test automates storehouse, for converging the device configuration text corresponding to dispatch data net automatic test cases Part, platform is performed by automation use-case and is called by logic interfacing 5, equipment under test is controlled；The tested dispatch data net equipment, for carrying out relevant parameter with postponing, automation is received by its control interface and used The configuration file that example execution platform issues carries out device configuration, and corresponding protocol massages and data message are sent to test instrumentation.
- A kind of 2. automatization test system of dispatch data net equipment according to claim 1, it is characterised in that：The survey Examination instrument, which carries out relevant configuration, to be included：Configure the quantity and IP address, the route for configuring port analog equipment of port analog equipment Agreement, the transmission rate for configuring port analog flow and testing time；The related Routing Protocol configuration bag of the test instrumentation Include：RIP agreements, ospf protocol, ISIS agreements, bgp protocol, mpls protocol, LDP agreements, RIPng agreements, OSPFv3 agreements, BGP4+ agreements, ISISv6 agreements.
- A kind of 3. automatization test system of dispatch data net equipment according to claim 2, it is characterised in that：It is described from The configuration that dynamicization use-case performs platform includes：Configuration testing instrument control interface IP address, configuration testing Meter Test port, match somebody with somebody Put store path, configuration testing instrument automation test case and the equipment under test automation storehouse configuration of implementation procedure journal file The store path that the calling path of file, the execution of configuration testing instrument automation test case are reported after terminating.
- A kind of 4. automatization test system of dispatch data net equipment according to claim 3, it is characterised in that：Configured The VLAN configurations of automatic test network frock interchanger：Test instrumentation, tested dispatch data net equipment and automation use-case are held Row platform is divided in same VLAN.
- A kind of 5. automatization test system of dispatch data net equipment according to claim 4, it is characterised in that：The survey The automatic test cases of examination instrument automation storehouse configuration include：Performance test case and functional test use-case；The tester The performance test case of table automation storehouse configuration includes：RIP routing capacitys, OSPF routing capacitys, ISIS routing capacitys, BGP roads Held by capacity, RIPng routing capacitys, OSPFv3 routing capacitys, ISISv6 routing capacitys, BGP4+ routing capacitys, ospf neighbor Amount, ISIS neighbours' capacity, bgp neighbor capacity；The performance test case in the test instrumentation automation storehouse configures it and tests flow Load and be：The linear speed of port 100%, its flow send the time be：60s.
- A kind of 6. automatization test system of dispatch data net equipment according to claim 5, it is characterised in that：The quilt The configuration file in the automation storehouse of test dispatching data network equipment includes：Performance configuration file and functional configuration file；The quilt Surveying the performance configuration file in the automation storehouse of dispatch data net equipment includes：RIP routing capacitys, OSPF routing capacitys, ISIS roads Held by capacity, BGP routing capacitys, RIPng routing capacitys, OSPFv3 routing capacitys, ISISv6 routing capacitys, BGP4+ routes Amount, ospf neighbor capacity, ISIS neighbours' capacity, bgp neighbor capacity.
- A kind of 7. automatization test system of dispatch data net equipment according to claim 5, it is characterised in that：The survey The functional test use-case of examination instrument automation storehouse configuration includes：Md5 authentication OSPF, ISIS, BGP of Routing Protocol, Routing Protocol Load balancing OSPF, ISIS, BGP MED attributes, QoS classification/shaping, VPN nat features.
- A kind of 8. automatization test system of dispatch data net equipment according to claim 6, it is characterised in that：The quilt Surveying the functional configuration file in the automation storehouse of dispatch data net equipment includes：Md5 authentication OSPF, ISIS, BGP of Routing Protocol, Load balancing OSPF, ISIS of Routing Protocol, BGP MED attributes, QoS classification/shaping, VPN nat features.
- A kind of 9. automated testing method of dispatch data net equipment, it is characterised in that：Methods described includes performance test methods And function test method,The performance test methods of the dispatch data net equipment comprise the following steps：1）, automation use-case performs platform and configure the related Routing Protocol that is tested dispatch data net equipment in test envelope file Routing capacity parameter, neighbours' capacity parameter, Routing Protocol includes RIP, OSPF, ISIS, BGP, RIPng, OSPFv3, BGP4+；2）, automation use-case perform the store path of platform configuration implementation procedure journal file, configuration testing instrument automation storehouse Automatic test cases and equipment under test automation storehouse correspond to configuration file call path, configuration testing report storage road Footpath；3）, automation use-case perform platform pass through automatic test network frock interchanger call test instrumentation automate storehouse property Energy test case, Routing Protocol, the structure of the port analog of the meter configuration file configuration testing instrument in test case Flow, the load for setting flow are 100%, testing time 60s；4）, automation use-case perform platform pass through automatic test network frock interchanger call equipment under test automate storehouse property Can test case configuration file, by automatic test network frock interchanger in a manner of SSHv2 session control to equipment under test Carry out the configuration of correlated performance test；5）, automation use-case perform platform by the port of automatic test network frock Switch control test instrumentation with it is tested The port of dispatch data net equipment carries out ARP study；6）, test instrumentation automation use-case perform platform control under, carry out routing capacity test when, with tested scheduling data Net equipment establishes the neighbours of related protocol, and two-way issue is tested the routing capacity for the related protocol that dispatch data net equipment is supported； When carrying out routing neighbor volume test, neighbours that related protocol is established with tested dispatch data net equipment, the number of the neighbours of foundation Measure to be tested neighbours' capacity that dispatch data net is supported, each neighbours issue 10 routes；7）, automation use-case perform platform by the port of automatic test network frock Switch control test instrumentation to tested Dispatch data net device port sending destination location is the flow for having issued route, and stopping flow after 60s sends, and automates use-case Perform platform to obtain traffic statistics and carry out result judgement, if the transmission data packet number of flow is more than zero, and flow The quantity of the transmission packet of amount is equal to the quantity of the received data packet of flow, and discriminating test result is by the contrary then judge Test result is failure；8）, automation use-case perform platform pass through automatic test network frock Switch control test instrumentation discharge test lead Mouthful, empty the configuration of test instrumentation；9）, automation use-case perform platform by automatic test network frock interchanger call be devices under automate storehouse match somebody with somebody File is put, all configurations of tested dispatch data net device clear is controlled, returns to original state；10）, automation use-case performs platform and generates corresponding routing capacity, the test report of the volume automated performance test case of neighbours Accuse, and be stored under the path of setting；The function test method of the dispatch data net equipment comprises the following steps：（1）Automate use-case and perform the store path of platform configuration implementation procedure journal file, configuration testing instrument automation storehouse Automatic test cases and equipment under test automation base configuration file call path, configuration testing report store path；（2）Automate use-case and perform the work(that platform calls test instrumentation to automate storehouse by automatic test network frock interchanger Energy test case, Routing Protocol, the structure of the port analog of the meter configuration file configuration testing instrument in test case Flow is tested, the transmission rate of flow is configured and sends the time；（3）Automate use-case and perform the work(that platform calls equipment under test to automate storehouse by automatic test network frock interchanger Can test case configuration file, by automatic test network frock interchanger in a manner of SSHv2 session control to equipment under test Carry out the configuration of correlation function test；（4）Automation use-case performs platform and controls test instrumentation and tested tune respectively by automatic test network frock interchanger Degrees of data net equipment interacts formula functional verification by the flow of automatic test cases, and is carried out according to the decision rule of setting As a result judge；（5）Automate use-case execution platform and pass through automatic test network frock Switch control test instrumentation release test lead Mouthful, empty the configuration of test instrumentation；（6）Automation use-case execution platform is devices under automation storehouse by automatic test network frock interchanger calling and matched somebody with somebody File is put, all configurations of tested dispatch data net device clear is controlled, returns to original state；（7）Automate use-case and perform md5 authentication OSPF, ISIS, BGP that platform generates corresponding Routing Protocol, Routing Protocol Load balancing OSPF, ISIS, BGP MED attributes, QoS classification/shaping, the automated function test use-case of VPN nat features Test report, and be stored under the path of setting.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510342761.XA CN104980317B (en) | 2015-06-18 | 2015-06-18 | A kind of Auto-Test System and method of testing of dispatch data net equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510342761.XA CN104980317B (en) | 2015-06-18 | 2015-06-18 | A kind of Auto-Test System and method of testing of dispatch data net equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104980317A CN104980317A (en) | 2015-10-14 |
| CN104980317B true CN104980317B (en) | 2018-03-02 |
Family
ID=54276447
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510342761.XA Active CN104980317B (en) | 2015-06-18 | 2015-06-18 | A kind of Auto-Test System and method of testing of dispatch data net equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104980317B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106453506A (en) * | 2016-09-13 | 2017-02-22 | 南京南瑞集团公司 | Resource unified scheduling test system and method |
| CN106776346B (en) * | 2017-01-18 | 2020-12-04 | 鼎点视讯科技有限公司 | Test method and device of CCMTS (China center testing System) equipment |
| CN107204893B (en) * | 2017-05-11 | 2020-09-04 | 南京南瑞继保电气有限公司 | Method and system for testing large-batch whole Ethernet switch |
| CN107341099A (en) * | 2017-05-23 | 2017-11-10 | 烽火通信科技股份有限公司 | The automatic test cases generation system and generation method of a kind of instrument arrangement |
| CN107505520B (en) * | 2017-07-28 | 2021-12-28 | 南京能云电力科技有限公司 | Scene type intelligent automatic test platform and method |
| CN107977317A (en) * | 2017-12-22 | 2018-05-01 | 上海庆科信息技术有限公司 | A kind of test method of data network, system and relevant apparatus |
| CN109995425B (en) * | 2017-12-29 | 2021-07-06 | 中兴通讯股份有限公司 | Method for testing communication port of equipment and tool device |
| CN108494628B (en) * | 2018-03-29 | 2021-08-27 | 苏州盛科通信股份有限公司 | Automated test tool for assisting switch to verify compliance with IEEE802.3 standard specification |
| CN109347790B (en) * | 2018-08-30 | 2021-04-09 | 南瑞集团有限公司 | Security attack test system and test method for electric power MPLS VPN network |
| CN109359098B (en) * | 2018-10-31 | 2023-04-11 | 云南电网有限责任公司 | System and method for monitoring scheduling data network behaviors |
| CN110290025B (en) * | 2019-06-27 | 2023-01-31 | 太仓市同维电子有限公司 | One-stop production test method for switch |
| CN111083011A (en) * | 2019-12-18 | 2020-04-28 | 北京网太科技发展有限公司 | Automatic testing method and device for routing security firewall and management platform |
| CN111130936B (en) * | 2019-12-24 | 2021-05-28 | 杭州迪普科技股份有限公司 | Method and device for testing load balancing algorithm |
| CN111835579B (en) * | 2020-06-04 | 2021-12-21 | 南瑞集团有限公司 | Method and system for testing effectiveness of network traffic scheduling simulation |
| CN115437351A (en) * | 2022-09-06 | 2022-12-06 | 中国第一汽车股份有限公司 | Automated test system, automated test method, electronic device, and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6687748B1 (en) * | 2000-01-04 | 2004-02-03 | Cisco Technology, Inc. | Network management system and method of operation |
| CN1870542A (en) * | 2005-05-23 | 2006-11-29 | 中兴通讯股份有限公司 | Sofeware simulation method of large number quipments |
| CN101179456A (en) * | 2007-12-11 | 2008-05-14 | 福建星网锐捷网络有限公司 | Network appliance testing approach and device |
| CN103412558A (en) * | 2013-07-30 | 2013-11-27 | 国电南瑞科技股份有限公司 | Automatic testing system and method for relay protection measuring and controlling device |
-
2015
- 2015-06-18 CN CN201510342761.XA patent/CN104980317B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6687748B1 (en) * | 2000-01-04 | 2004-02-03 | Cisco Technology, Inc. | Network management system and method of operation |
| CN1870542A (en) * | 2005-05-23 | 2006-11-29 | 中兴通讯股份有限公司 | Sofeware simulation method of large number quipments |
| CN101179456A (en) * | 2007-12-11 | 2008-05-14 | 福建星网锐捷网络有限公司 | Network appliance testing approach and device |
| CN103412558A (en) * | 2013-07-30 | 2013-11-27 | 国电南瑞科技股份有限公司 | Automatic testing system and method for relay protection measuring and controlling device |
Non-Patent Citations (2)
| Title |
|---|
| 一种电力调度数据网性能测试软件的设计与实现;朱晓东、江泽鑫;《科技前沿》;20150531;60-61 * |
| 电力调度数据网测试模型;李芹、胡婷、何晓阳;《电力系统自动化>;20150110;187-192 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104980317A (en) | 2015-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104980317B (en) | A kind of Auto-Test System and method of testing of dispatch data net equipment | |
| US11968118B2 (en) | Planning and managing network probes using centralized controller | |
| CN106452942B (en) | The vehicle-mounted Ethernet exchanging software performance test system and method for track transportation industry | |
| US11323312B1 (en) | Software-defined network monitoring and fault localization | |
| CN106656847A (en) | Software defined network (SDN) load balancing method with highest network utility | |
| CN101145977B (en) | A QoS monitoring system and its measuring method of IP data network | |
| US20110010585A1 (en) | System and method for a testing vector and associated performance map | |
| AU2022256142A1 (en) | Systems and methods for chaining control-plane virtual functions for ensuring end-to-end quality of service (qos) of internet services | |
| CN102333005B (en) | Tester control method in automatic testing system | |
| CN102868553B (en) | Fault Locating Method and relevant device | |
| CN110430096A (en) | A kind of gateway test method and equipment | |
| CN101656637A (en) | Virtual trunk measuring device and method for network protocol | |
| CN103078791B (en) | OAM message processing method, equipment and system | |
| CN102209010B (en) | Network test system and method | |
| CN105391592A (en) | Packet transport network service detecting and measuring method, device and system | |
| CN106713074A (en) | Data network quality piecewise detection method and system based on service content | |
| CN106487605A (en) | packet loss detection method and device | |
| CN104270282B (en) | A kind of IP network end-to-end test method and apparatus | |
| CN104038382B (en) | Network monitoring system | |
| CN110022238A (en) | A kind of test method and device of Ethernet switching chip | |
| CN103166807B (en) | Flux and flow direction analysis and processing method based on application and system | |
| CN109618363B (en) | Mobile gateway test system and method | |
| CN108494625A (en) | A kind of analysis system on network performance evaluation | |
| CN107483336A (en) | Network equipment MAC Address volume test system and method | |
| CN101527730B (en) | Test method for obtaining load factors of router and system thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 210003 Jiangsu city of Nanjing province Pukou high tech Development Zone of High Road No. 19-1 Co-patentee after: State Grid Corporation of China Patentee after: NARI Group Corp. Address before: 210003 Jiangsu city of Nanjing province Pukou high tech Development Zone of High Road No. 19-1 Co-patentee before: State Grid Corporation of China Patentee before: NARI Group CORPORATION STATE GRID ELECTRIC POWER INSTITUTE |