CN116132357A - Test information determining method, device and computer readable storage medium - Google Patents
Test information determining method, device and computer readable storage medium Download PDFInfo
- Publication number
- CN116132357A CN116132357A CN202111350111.1A CN202111350111A CN116132357A CN 116132357 A CN116132357 A CN 116132357A CN 202111350111 A CN202111350111 A CN 202111350111A CN 116132357 A CN116132357 A CN 116132357A
- Authority
- CN
- China
- Prior art keywords
- target
- test
- path
- information
- test case
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/22—Alternate routing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/145—Network analysis or design involving simulating, designing, planning or modelling of a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/24—Multipath
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/28—Routing or path finding of packets in data switching networks using route fault recovery
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Test And Diagnosis Of Digital Computers (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the application discloses a test information determining method, which comprises the following steps: determining a target test case logic template and target test data corresponding to the target test case logic template based on the test requirement information; determining target test case information based on the target test data and the target test case logic template; and testing the equipment to be tested corresponding to the test requirement information based on the target test case information. The embodiment of the application also discloses test information determining equipment and a computer readable storage medium.
Description
Technical Field
The present application relates to a test information determination technology in the field of communications, and in particular, to a test information determination method, apparatus, and computer-readable storage medium.
Background
In future software defined (Software Defined Network, SDN) networks, segment Routing (SR) technology has the characteristics of maintaining a state only at the network edge and based on a source Routing forwarding method, so that it can support ultra-large scale traffic engineering and is suitable for being combined with an SDN, and has become an SDN practical network architecture standard. In the test of SDN-oriented new network, network equipment deployment presents complexity and diversity, and has more application scenes in aspects of network topology, service requirements, flow planning and reliability. In a laboratory environment, a single scenario test cannot cover and restore an existing network scenario, and a multi-scenario test also requires more time, equipment resources and human input.
In the traditional automatic test, test instrument configuration and equipment configuration are tested and executed as known test inputs, but in SDN test, more complex technology and networking schemes are required to be selected according to test scenes, comprehensive test verification is carried out by focusing on key service requirements, load networking function performances and the like, when large-scale service network simulation, TE path calculation, control simulation and test faults are introduced, scenes and test logics are difficult to be generated and verified one by one in a 'display' script writing mode, and quick construction of complex test environments and verification logics cannot be realized.
Disclosure of Invention
In order to solve the technical problems, it is desirable in the embodiments of the present application to provide a method, an apparatus, and a computer readable storage medium for determining test information, which solve the problem that in the related art, a complex test environment and verification logic cannot be quickly built in an SDN test.
The technical scheme of the application is realized as follows:
a method of testing information determination, the method comprising:
determining a target test case logic template and target test data corresponding to the target test case logic template based on the test requirement information;
Determining target test case information based on the target test data and the target test case logic template;
and testing the equipment to be tested corresponding to the test requirement information based on the target test case information.
In the above scheme, determining the target test case logic template and the target test data corresponding to the target test case logic template based on the test requirement information includes:
acquiring test requirement information aiming at the equipment to be tested;
determining the logic template of the target test case corresponding to the test requirement information;
and acquiring the target test data corresponding to the target test case logic template from a model database corresponding to the target test case logic template.
In the above solution, the obtaining the test requirement information for the device to be tested includes:
receiving test requirement information input by a user for the equipment to be tested in the software defined network; the test requirement information comprises a target identifier and a test intention of the equipment to be tested.
In the above solution, the determining the target test case logic template corresponding to the test requirement information includes:
Determining a target test template matched with the target identifier and the test intention from the basic test templates; the target test template comprises a basic simulation network;
acquiring path topology information of the basic simulation network, and determining basic test logic based on the path topology information of the basic simulation network;
and generating the target test case logic template based on the basic test logic and the target test template.
In the above solution, the obtaining path topology information of the basic simulation network, and determining basic test logic based on the path topology information of the basic simulation network, includes:
analyzing the basic simulation network to obtain path topology information of the basic simulation network;
and when the equipment in the basic simulation network is normally started, setting the basic test logic to simulate path faults and path recovery of the main path based on the main path and the standby path in the path topology information so as to determine the path switching condition.
In the above solution, the obtaining, from a model database corresponding to the target test case logic template, the target test data corresponding to the target test case logic template includes:
Determining a target network topology corresponding to the basic simulation network from a model database corresponding to the target test case logic template;
determining a target main path and a target standby path in the target network topology based on a graph theory algorithm;
determining a primary-backup switching failure set based on the target primary path and the target backup path; the primary-backup switching fault set comprises a first subset and a second subset; the first subset includes nodes which are not overlapped in the target main path and the target standby path, and the second subset includes nodes which are overlapped in the target main path and the target standby path.
In the above scheme, the determining the target test case information based on the target test data and the target test case logic template includes:
setting the target test case information based on the first subset and the second subset of the active-standby switching failure set when the normal starting of the equipment in the target network topology simulation network is determined;
the setting target test case information based on the first subset and the second subset of the active-standby switching failure set includes:
Aiming at the nodes in the target main path, based on the first subset and the second subset of the main-standby switching failure set, path failure and path recovery simulation are carried out on the nodes in the target main path, and path switching time and a switched target path are obtained;
and determining an expected switching result of path switching based on the path switching time and the path information of the switched target path.
In the above scheme, the method further comprises:
and acquiring and displaying test running information and test environment information in real time according to a target acquisition period in a multi-process mode in the process of testing the equipment to be tested.
A test information determination apparatus, the apparatus comprising: a processor, a memory, and a communication bus;
the communication bus is used for realizing communication connection between the processor and the memory;
the processor is configured to execute the test information determining program in the memory, so as to implement the steps of the test information determining method.
A computer-readable storage medium storing one or more programs executable by one or more processors to implement the steps of the test information determination method described above.
According to the test information determining method, the device and the computer readable storage medium, the target test case logic template and the target test data corresponding to the target test case logic template are determined based on the test requirement information, the target test case information is determined based on the target test data and the target test case logic template, and then the to-be-tested device corresponding to the test requirement information is tested based on the target test case information, so that the target test case logic template and the target test data corresponding to the test requirement information can be automatically determined, the target test case information is automatically generated by adopting the target test data and the target test case logic template, the scenes and the test logic do not need to be generated and verified one by one in a mode of 'displaying' script writing, and the problem that complex test environments and verification logics cannot be quickly built in SDN tests in related technologies is solved.
Drawings
Fig. 1 is a flow chart of a test information determining method according to an embodiment of the present application;
FIG. 2 is a flowchart of another test information determining method according to an embodiment of the present application;
Fig. 3 is a schematic diagram of a physical topology in a test information determining method according to an embodiment of the present application;
fig. 4 is a network topology diagram of a simulation network in the test information determining method according to the embodiment of the present application;
FIG. 5 is a flowchart of another test information determining method according to an embodiment of the present application;
fig. 6 is a network topology diagram of a target network in the test information determining method according to the embodiment of the present application;
fig. 7 is a schematic diagram of a connectivity diagram formed by a target network in the test information determining method according to the embodiment of the present application;
fig. 8 is a schematic architecture diagram of a system corresponding to the test information determining method provided in the embodiment of the present application;
fig. 9 is a schematic structural diagram of a test information determining apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
It should be appreciated that reference throughout this specification to "an embodiment of the present application" or "the foregoing embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrase "in an embodiment of the present application" or "in the foregoing embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In various embodiments of the present application, the sequence number of each process does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
Without being specifically illustrated, the electronic device may perform any of the steps in the embodiments of the present application, and may be a processor of the electronic device performing the steps. It is further noted that the embodiments of the present application do not limit the order in which the following steps are performed by the electronic device. In addition, the manner in which the data is processed in different embodiments may be the same method or different methods. It should be further noted that any step in the embodiments of the present application may be independently executed by the electronic device, that is, when the electronic device executes any step in the embodiments described below, execution of the other step may not be dependent.
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
The embodiment of the application provides a test information determining method, which can be applied to test information determining equipment, and is shown with reference to fig. 1, and the method comprises the following steps:
and step 101, determining a target test case logic template and target test data corresponding to the target test case logic template based on the test requirement information.
In the embodiment of the application, the test requirement information can represent the device to be tested and the test intention to be tested. The target test case logic template refers to a test template used for testing equipment to be tested; the target test data refers to test data required by the target test case logic template.
In the embodiment of the present application, the target test case information may be obtained by synthesizing the target test data and the target test case logic template; in one possible implementation, the target test case information may be generated after substituting the target test data into the corresponding target test case logic template. The target test case information may be a test case for testing the device to be tested.
And step 103, testing the equipment to be tested corresponding to the test requirement information based on the target test case information.
The determined target test case information can be directly used for testing the equipment to be tested. That is, the device to be tested may be tested accordingly according to the test case and the test logic included in the target test case information.
According to the test information determining method provided by the embodiment of the application, the target test case logic template and the target test data corresponding to the target test case logic template are determined based on the test requirement information, the target test case information is determined based on the target test data and the target test case logic template, and then the to-be-tested equipment corresponding to the test requirement information is tested based on the target test case information, so that the target test case logic template and the target test data corresponding to the test requirement information can be automatically determined, the target test case information is automatically generated by adopting the target test data and the target test case logic template, the scenes and the test logic do not need to be generated and verified one by one in a mode of 'displaying' script writing, and the problem that complex test environments and verification logics cannot be quickly built in SDN tests in related technologies is solved.
Based on the foregoing embodiments, embodiments of the present application provide a test information determining method, referring to fig. 2, which includes the following steps:
The test requirement information can be actively acquired by the test information determining device, or can be sent to the test information determining device by other devices.
In the embodiment of the present application, step 201 may be implemented by:
step 201a, test information determining device receives test requirement information input by a user for a device to be tested in a software defined network.
The test requirement information comprises a target identifier and a test intention of the equipment to be tested.
In the embodiment of the application, the device to be tested can be any device needing to be tested in a software defined network; moreover, the test requirement information can be generated after the user inputs the test intention and the target identifier of the device to be tested through the corresponding input interface on the intelligent platform.
The target test case logic template corresponds to a target identifier of the equipment to be tested and is matched with the test intention; that is, the target test case logic template may be determined based on the target identification and test intent of the device to be tested.
In the embodiment of the present application, step 202 of determining the target test case logic template corresponding to the test requirement information may be implemented by:
step 202a, the test information determining device determines a target test template matched with the target identifier and the test intention from the basic test templates.
The target test template comprises a basic simulation network.
In the embodiment of the application, the basic test templates comprise a function verification logic script test template, a performance verification logic script test template, a fault verification logic script test template and the like. It should be noted that, the target test template may be determined from the basic test template based on a selection instruction input by a user, or may be determined from the basic test template using a specific recommendation algorithm; wherein the particular recommendation algorithm may be determined based on information retrieval of the input content and popularity of the historical data.
Step 202b, the test information determining device obtains path topology information of the basic simulation network, and determines basic test logic based on the path topology information of the basic simulation network.
In the embodiment of the present application, an SDN traffic engineering test is described as an example: first, a physical topology needs to be connected, mainly consisting of a basic test bed that determines (Device Under Test, DUT) the device under test and meter composition. In one possible implementation, the physical topology formed may be as shown in fig. 3. If the input test requirements comprise SR-TE and PE and the reliability, the intelligent test platform screens/recommends a target test template and basic test logic which accord with the test requirement information according to the test intention input by a user, wherein the recommended target test template is an SR-TE/BE L3VPN basic test template marked as end-to-end; as shown in FIG. 4, the SR-TE/BE L3VPN base test template labeled end-to-end can include devices under test, meter emulation networks (R2/R3/R4), and traffic nodes. Of course, the recommended basic test logic mainly depends on the path topology information corresponding to the target test template.
Step 202c, the test information determining device generates a logic template of the target test case based on the basic test logic and the target test template.
In the embodiment of the application, after the basic test logic and the target test template are determined, the basic test logic and the target test template can be synthesized to obtain the target test case logic template. In one possible implementation, the underlying test logic may be substituted into the target test template to obtain the target test case logic template.
In the embodiment of the application, the model database may include a network model database, a protocol model database, a tunnel model database, a traffic model database, a fault model database, and the like. After the test case logic template is selected, the definition of the network model database, the protocol model database or the path model database which needs to be imported here exists in the corresponding case template script logic, and the target test data which needs to be filled in the association is defined.
It should be noted that, in this embodiment, the descriptions of the same steps and the same content as those in other embodiments may refer to the descriptions in other embodiments, and are not repeated here.
The test information determining method provided by the embodiment of the application can automatically determine the target test case logic template and the target test data corresponding to the test requirement information, further automatically generate the target test case information by adopting the target test data and the target test case logic template, and generate and verify the scenes and the test logic one by one without a mode of writing a 'display' script, thereby solving the problem that complex test environment and verification logic cannot be quickly built in SDN test in the related technology.
Based on the foregoing embodiments, embodiments of the present application provide a test information determining method, referring to fig. 5, which includes the steps of:
The test requirement information comprises a target identifier and a test intention of the equipment to be tested.
The target test template comprises a basic simulation network.
In the embodiment of the application, the target test template may be a basic simulation network which is determined from all simulation networks set and matches the target identification and the test intention.
And 303, analyzing the basic simulation network by the test information determining equipment to obtain path topology information of the basic simulation network.
And 304, when the test information determining equipment determines that the equipment in the basic simulation network is normally started, setting basic test logic to perform path fault and path recovery simulation on the main path based on the main path and the standby path in the path topology information so as to determine the path switching condition.
In this embodiment, taking SDN traffic engineering test as an example for illustration, the basic test logic may include the following implementation procedures:
a1, loading and starting an intermediate system-to-intermediate system (ISIS-Intermediate system to intermediate system, ISIS) routing protocol of all devices, checking whether an ISIS neighbor state of a port is normally started, and feeding back to a User Interface (UI) display Interface; ISIS SR link state information is published. Here, it is necessary to populate all device-related ISIS protocol and ISIS SR link state information, labeled device (ISIS).
And A2, after the routing protocol works normally, starting a path computation unit (Path Computation Element Protocol, PCEP) protocol, and checking whether the PCEP state is started or not. And according to the path selection of the user on the interface, the path information of the SR-TE (process engineering) is issued to the equipment to be tested through the PCEP, wherein the equipment to be tested comprises a main path and a standby path. Here, route list (Segment list) information of the primary path and the backup path needs to be filled, and is labeled as Tunnel1 (ERO) and Tunnel2 (ERO). It is checked whether the PCEP primary and backup path states are normal.
A3, starting bidirectional traffic, checking whether the traffic is normal in receiving and transmitting, and analyzing whether the multi-layer label accords with the setting of a main path label Tunnel1 (ERO) by grabbing the packet, displaying a corresponding path on a UI interface, and displaying through warning information if the traffic path is inconsistent with a PCEP issuing path.
A4, simulating the failure of the main path, controlling or automatically disconnecting the nodes/links of the main path through SDN on the interface, wherein the filling of Break is from a main link database Break (VE). And checking the PCEP path state, checking whether the traffic can be forwarded normally, and calculating the switching time. Through automatic analysis of the grabbing packets, if Break occurs in the non-overlapping part of the main path and the standby path, whether the flow is switched to the standby path Tunnel2 (ERO) is confirmed, the switching time is less than 50ms, and corresponding display is carried out on an interface; otherwise, whether the flow is switched to the SR BE path is confirmed, and corresponding display is carried out.
A5, simulating the recovery of the main path, and finishing the path switching; it is checked whether the PCEP primary path state is Updated (Updated). And checking whether the traffic can be forwarded normally or not, and calculating the switching time. And (3) confirming whether the flow is restored to the main path Tunnel1 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
A6, traversing all Break points in Break (V E) (namely path topology information), repeatedly executing the steps A4-A5, recording all results, and ending the test.
The target test case logic template can be obtained by combining basic test logic and a target test template; in one possible implementation, the base test logic may be input into a target test template, and then the target test case logic template may be obtained.
The target network topology is that network topology matched with the basic simulation network is determined from a model database corresponding to the logic template of the target test case. In one possible implementation, taking SDN traffic engineering test as an example, the target network topology may be a path topology in a dashed box as shown in fig. 6, which may be a 3*3 network-like topology. As shown in fig. 7, according to the network topology stored in the form of a connectivity graph G (V E), V of the connectivity graph is the simulated router information, E is the simulated link information, and the simulated routing topology configuration information device (ISIS) can be generated according to the connection relationship.
In embodiments of the present application, graph theory algorithms may include Dijkstra path algorithm and depth first search (Depth First Search, DFS) algorithm; then, the primary path T1 may be calculated by Dijkstra path algorithm (V E); other possible path information between two points is traversed as a backup path T2 by the DFS algorithm (V E). Generating Tunnel1 (ERO) information as a target active path according to T1 (V E) and T2 (V E): 3302-3211-3212-3213-3223-3233-3304, tunnel2 (ERO) information is the target alternate path 3302-3211-3221-3231-3232-3222-3223-3233-3304.
The primary-standby switching fault set comprises a first subset and a second subset; the first subset includes nodes which are not overlapped in the target main path and the target standby path, and the second subset includes nodes which are overlapped in the target main path and the target standby path.
In the embodiment of the application, a first subset Break1 (V E) and a second subset Break2 (V E) of the primary-standby switching failure set are generated according to target primary paths and target standby paths T1 (V E) and T2 (V E); wherein the first subset Break1 (V E) may include nodes in the target primary path and the target backup path that do not overlap, and the second subset Break2 (V E) may include nodes in the target primary path and the target backup path that overlap. It should be noted that the target test data may include: the system comprises a target main path, a target standby path and a main-standby switching fault set.
The method for setting the target test case information based on the first subset and the second subset of the active-standby switching failure set comprises the following steps:
step 309a, the test information determining device performs path fault and path recovery simulation on the nodes in the target main path based on the first subset and the second subset of the main-standby switching fault set aiming at the nodes in the target main path, so as to obtain path switching time and a switched target path.
Step 309b, the test information determining device determines an expected switching result of the path switching based on the path switching time and the path information of the switched target path.
In the embodiment of the present application, taking SDN traffic engineering test as an example, the process of setting the target test case information may be as follows:
b1, loading and starting ISIS routing protocols of all devices, checking whether the ISIS neighbor state of the port is normally started or not, and feeding back to the UI display interface; ISIS SR link state information is published.
And B2, after the routing protocol works normally, starting the PCEP protocol, and checking whether the PCEP state is started or not. And according to the path selection of the user on the interface, the SR-TE path information is issued to the tested equipment through the PCEP, wherein the equipment comprises a main path Tunnel1 (ERO) and a standby path Tunnel2 (ERO).
And B3, starting bidirectional traffic, checking whether the traffic is normal in receiving and transmitting, and analyzing whether the multi-layer label accords with the setting of a main path label Tunnel1 (ERO) by grabbing the packet, displaying a corresponding path on a UI interface, and displaying through warning information if the traffic path is inconsistent with the PCEP issuing path.
And B4, simulating a main path fault, disconnecting the nodes R2-12 on the main path, checking the path state of the PCEP, checking whether the traffic can be forwarded normally, and calculating switching time, wherein the switching time is less than 50ms. And (3) confirming whether the flow is switched to a standby path Tunnel2 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
And B5, simulating main path recovery, finishing path switching, and checking whether the state of the PCEP main path is Updated. And checking whether the traffic can be forwarded normally or not, and calculating the switching time. And (3) confirming whether the flow is restored to the main path Tunnel1 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
And B6, simulating a main path fault, disconnecting the nodes R2-13 on the main path, checking the path state of the PCEP, checking whether the traffic can be forwarded normally, and calculating switching time, wherein the switching time is less than 50ms. And (3) confirming whether the flow is switched to a standby path Tunnel2 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
And B7, simulating main path restoration, finishing path switching, and checking whether the state of the PCEP main path is Updated. And checking whether the traffic can be forwarded normally or not, and calculating the switching time. And (3) confirming whether the flow is restored to the main path Tunnel1 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
B8, simulating the failure of the main path, disconnecting the nodes R2-11 on the main path, checking the path state of the PCEP, checking whether the traffic can be forwarded normally, and calculating the switching time. And (3) confirming whether the flow is switched to the SR BE or not through automatic packet grabbing analysis, and correspondingly displaying on an interface.
And B9, simulating main path recovery, finishing path switching, and checking whether the state of the PCEP main path is Updated. And checking whether the traffic can be forwarded normally or not, and calculating the switching time. And (3) confirming whether the flow is restored to the main path Tunnel1 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
B10, simulating the failure of the main path, disconnecting the nodes R2-23 on the main path, checking the path state of the PCEP, checking whether the traffic can be forwarded normally, and calculating the switching time. And (3) confirming whether the flow is switched to the SR BE or not through automatic packet grabbing analysis, and correspondingly displaying on an interface.
And B11, simulating main path recovery, finishing path switching, and checking whether the state of the PCEP main path is Updated. And checking whether the traffic can be forwarded normally or not, and calculating the switching time. And (3) confirming whether the flow is restored to the main path Tunnel1 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
B12, simulating the failure of the main path, disconnecting the nodes R2-33 on the main path, checking the path state of the PCEP, checking whether the traffic can be forwarded normally, and calculating the switching time. And (3) confirming whether the flow is switched to the SR BE or not through automatic packet grabbing analysis, and correspondingly displaying on an interface.
And B13, simulating main path recovery, finishing path switching, and checking whether the state of the PCEP main path is Updated. And checking whether the traffic can be forwarded normally or not, and calculating the switching time. And (3) confirming whether the flow is restored to the main path Tunnel1 (ERO) through automatic packet grabbing analysis, and displaying the flow on an interface correspondingly.
It should be noted that, the test information determining method provided in the embodiment of the present application may replace manual display programming to automatically generate complex control plane information and dynamic test judgment logic in an SDN test environment. And, the test topology and test logic are automatically arranged/interactively selected based on the test scene or intention, so that the simulation service network, the verification flow, the test steps and the expected result can be dynamically generated.
Based on the foregoing embodiments, in other embodiments of the present application, the method may further include the steps of:
step 310, acquiring and displaying test running information and test environment information in real time according to a target acquisition period in a multi-process mode in the process of testing the equipment to be tested.
When the test running information and the test environment information are obtained in real time in a multi-process mode, a full duplex working mode can be realized in a packet grabbing mode; therefore, in the whole testing process, the topology information of the test bed, the state information of the router and the link, the state information of the routing protocol, the state information of the SR-TE tunnel, the flow path information and the like can be obtained in real time, and the states of the bottom equipment and the instrument are interactively presented by combining the testing topology through the visualization of the information in the testing process, so that the testing effect is enhanced. Also, taking the SRV6 network as an example, the traffic path may refer to all paths that pass through in the whole testing process, and all paths may be displayed. In one possible implementation, the traffic path may be obtained by means of a packet-grabbing.
In the embodiment of the present application, the test information determining method may be applied to the system architecture shown in fig. 8; the test information determining method in the embodiment of the application adds an intelligent platform, test arrangement and test state observation module on the basis of the execution of the traditional test platform and the test script. The intelligent platform mainly provides test intention input, network topology intention display, dynamic test execution, log output and the like; the test arrangement module mainly realizes the functions of topology planning, path calculation, traffic engineering and the like of the SDN controller, and generates a test scene/intention by an algorithm, so that the complexity and the randomness of the test can be ensured. The test state observation module can run in parallel with the test script module, supports real-time display of network states, path states, flow states, fault states and the like of observation objects in a multi-process mode, and supports layered display and interaction of service plane data and a management plane.
It should be noted that, in this embodiment, the descriptions of the same steps and the same content as those in other embodiments may refer to the descriptions in other embodiments, and are not repeated here.
The test information determining method provided by the embodiment of the application can automatically determine the target test case logic template and the target test data corresponding to the test requirement information, further automatically generate the target test case information by adopting the target test data and the target test case logic template, and generate and verify the scenes and the test logic one by one without a mode of writing a 'display' script, thereby solving the problem that complex test environment and verification logic cannot be quickly built in SDN test in the related technology.
Based on the foregoing embodiments, embodiments of the present application provide a test information determining apparatus, which may be applied to the test information determining methods provided in the corresponding embodiments of fig. 1, 2 and 5, and referring to fig. 9, the apparatus may include: a processor 41, a memory 42 and a communication bus 43;
a communication bus 43 for enabling a communication connection between the processor 41 and the memory 42;
the processor 41 is configured to execute the test information determination program in the memory 42 to implement the steps of:
determining a target test case logic template and target test data corresponding to the target test case logic template based on the test requirement information;
Determining target test case information based on the target test data and the target test case logic template;
and testing the equipment to be tested corresponding to the test requirement information based on the target test case information.
In other embodiments of the present application, the processor is configured to execute a test information determining program in the memory, determine a target test case logic template and target test data corresponding to the target test case logic template based on the test requirement information, so as to implement the following steps:
acquiring test requirement information aiming at equipment to be tested;
determining a target test case logic template corresponding to the test requirement information;
and obtaining target test data corresponding to the target test case logic template from a model database corresponding to the target test case logic template.
In other embodiments of the present application, the processor is configured to execute the acquisition of the test information determining program in the memory, for the test requirement information of the device to be tested, so as to implement the following steps:
receiving test requirement information input by a user for equipment to be tested in a software defined network;
the test requirement information comprises a target identifier and a test intention of the equipment to be tested.
In other embodiments of the present application, the processor is configured to execute a test information determining program in the memory to determine a target test case logic template corresponding to the test requirement information, so as to implement the following steps:
determining a target test template matched with the target mark and the test intention from the basic test templates;
the basic test template comprises a basic simulation network;
acquiring path topology information of a basic simulation network, and determining basic test logic based on the path topology information of the basic simulation network;
and generating a target test case logic template based on the basic test logic and the target test template.
In other embodiments of the present application, the processor is configured to execute a test information determining program in the memory to obtain path topology information of the base simulation network, and determine the base test logic based on the path topology information of the base simulation network, so as to implement the following steps:
analyzing the basic simulation network to obtain path topology information of the basic simulation network;
when the normal starting of the equipment in the basic simulation network is determined, setting basic test logic to perform path fault and path recovery simulation on the main path based on the main path and the standby path in the path topology information so as to determine the path switching condition.
In other embodiments of the present application, the processor is configured to execute a test information determining program in the memory, and obtain, from a model database corresponding to the target test case logic template, target test data corresponding to the target test case logic template, so as to implement the following steps:
determining a target network topology corresponding to the basic simulation network from a model database corresponding to the logic template of the target test case;
determining a target main path and a target standby path in a target network topology based on a graph theory algorithm;
determining a primary-backup switching failure set based on the target primary path and the target backup path;
the primary-standby switching fault set comprises a first subset and a second subset; the first subset includes nodes which are not overlapped in the target main path and the target standby path, and the second subset includes nodes which are overlapped in the target main path and the target standby path.
In other embodiments of the present application, the processor is configured to execute a test information determination program in the memory, determine target test case information based on the target test data and the target test case logic template, so as to implement the following steps:
when the normal starting of equipment in the target network topology simulation network is determined, setting target test case information based on a first subset and a second subset of the active-standby switching failure set;
The method for setting the target test case information based on the first subset and the second subset of the active-standby switching failure set comprises the following steps:
aiming at nodes in the target main path, based on a first subset and a second subset of the main-standby switching failure set, path failure and path recovery simulation are carried out on the nodes in the target main path, and path switching time and a switched target path are obtained;
and determining an expected switching result of path switching based on the path switching time and the path information of the switched target path.
In other embodiments of the present application, the processor is configured to execute the test information determining program in the memory, and further may implement the following steps:
and acquiring and displaying test running information and test environment information in real time according to a target acquisition period in a multi-process mode in the process of testing the equipment to be tested.
It should be noted that, in the specific implementation process of the steps executed by the processor in this embodiment, reference may be made to the implementation process in the test information determining method provided in the corresponding embodiment of fig. 1, 2 and 5, which is not repeated herein.
The test information determining device provided by the embodiment of the application can automatically determine the target test case logic template and the target test data corresponding to the test requirement information, further automatically generate the target test case information by adopting the target test data and the target test case logic template, and does not need to generate and verify the scenes and the test logic one by one in a mode of 'displaying' script writing, thereby solving the problem that complex test environment and verification logic cannot be quickly built in SDN test in the related technology.
Based on the foregoing embodiments, embodiments of the present application provide a computer-readable storage medium storing one or more programs executable by one or more processors to implement the steps of the test information determination method provided by the corresponding embodiments of fig. 1, 2, and 5.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the present application.
Claims (10)
1. A method of determining test information, the method comprising:
determining a target test case logic template and target test data corresponding to the target test case logic template based on the test requirement information;
Determining target test case information based on the target test data and the target test case logic template;
and testing the equipment to be tested corresponding to the test requirement information based on the target test case information.
2. The method of claim 1, wherein determining a target test case logic template and target test data corresponding to the target test case logic template based on the test requirement information comprises:
acquiring test requirement information aiming at the equipment to be tested;
determining the logic template of the target test case corresponding to the test requirement information;
and acquiring the target test data corresponding to the target test case logic template from a model database corresponding to the target test case logic template.
3. The method of claim 2, wherein the obtaining test requirement information for the device under test comprises:
receiving test requirement information input by a user for the equipment to be tested in the software defined network; the test requirement information comprises a target identifier and a test intention of the equipment to be tested.
4. The method of claim 3, wherein the determining the target test case logic template corresponding to the test requirement information comprises:
determining a target test template matched with the target identifier and the test intention from the basic test templates; the target test template comprises a basic simulation network;
acquiring path topology information of the basic simulation network, and determining basic test logic based on the path topology information of the basic simulation network;
and generating the target test case logic template based on the basic test logic and the target test template.
5. The method of claim 4, wherein the obtaining path topology information of the underlying simulation network and determining underlying test logic based on the path topology information of the underlying simulation network comprises:
analyzing the basic simulation network to obtain path topology information of the basic simulation network;
and when the equipment in the basic simulation network is normally started, setting the basic test logic to simulate path faults and path recovery of the main path based on the main path and the standby path in the path topology information so as to determine the path switching condition.
6. The method of claim 4, wherein the obtaining the target test data corresponding to the target test case logical template from a model database corresponding to the target test case logical template comprises:
determining a target network topology corresponding to the basic simulation network from a model database corresponding to the target test case logic template;
determining a target main path and a target standby path in the target network topology based on a graph theory algorithm;
determining a primary-backup switching failure set based on the target primary path and the target backup path; the primary-backup switching fault set comprises a first subset and a second subset; the first subset includes nodes which are not overlapped in the target main path and the target standby path, and the second subset includes nodes which are overlapped in the target main path and the target standby path.
7. The method of claim 6, wherein the determining target test case information based on the target test data and the target test case logic template comprises:
setting the target test case information based on the first subset and the second subset of the active-standby switching failure set when the normal starting of the equipment in the target network topology simulation network is determined;
The setting target test case information based on the first subset and the second subset of the active-standby switching failure set includes:
aiming at the nodes in the target main path, based on the first subset and the second subset of the main-standby switching failure set, path failure and path recovery simulation are carried out on the nodes in the target main path, and path switching time and a switched target path are obtained;
and determining an expected switching result of path switching based on the path switching time and the path information of the switched target path.
8. The method according to claim 1, wherein the method further comprises:
and acquiring and displaying test running information and test environment information in real time according to a target acquisition period in a multi-process mode in the process of testing the equipment to be tested.
9. A test information determination apparatus, characterized in that the apparatus comprises: a processor, a memory, and a communication bus;
the communication bus is used for realizing communication connection between the processor and the memory;
the processor is configured to execute a test information determination program in a memory to implement the steps of the test information determination method according to any one of claims 1 to 8.
10. A computer-readable storage medium storing one or more programs executable by one or more processors to implement the steps of the test information determination method of any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111350111.1A CN116132357A (en) | 2021-11-15 | 2021-11-15 | Test information determining method, device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111350111.1A CN116132357A (en) | 2021-11-15 | 2021-11-15 | Test information determining method, device and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116132357A true CN116132357A (en) | 2023-05-16 |
Family
ID=86293717
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111350111.1A Pending CN116132357A (en) | 2021-11-15 | 2021-11-15 | Test information determining method, device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116132357A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117240552A (en) * | 2023-09-19 | 2023-12-15 | 中国人民解放军32039部队 | Cross-field data transmission automatic verification method and device |
-
2021
- 2021-11-15 CN CN202111350111.1A patent/CN116132357A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117240552A (en) * | 2023-09-19 | 2023-12-15 | 中国人民解放军32039部队 | Cross-field data transmission automatic verification method and device |
| CN117240552B (en) * | 2023-09-19 | 2024-06-11 | 中国人民解放军32039部队 | Cross-field data transfer automatic verification method, device, electronic equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109802852B (en) | Method and system for constructing network simulation topology applied to network target range | |
| Benveniste et al. | Diagnosis of asynchronous discrete-event systems: a net unfolding approach | |
| CN112153010B (en) | Network security shooting range system and operation method thereof | |
| CN109697500A (en) | Data processing method, device, electronic equipment and storage medium | |
| CN102611568A (en) | Failure service path diagnosis method and device | |
| CN110650035B (en) | Method and system for generating and managing virtual industrial devices in an industrial network | |
| JP2007208633A (en) | Device, method and program for designing network | |
| US11663113B2 (en) | Real time fault localization using combinatorial test design techniques and test case priority selection | |
| CN116132357A (en) | Test information determining method, device and computer readable storage medium | |
| CN109039959A (en) | A kind of the consistency judgment method and relevant apparatus of SDN network rule | |
| Kushik et al. | On testing against partial non-observable specifications | |
| CN111797152B (en) | Data scene generation method and device and computer equipment | |
| CN108334319A (en) | Code development method, apparatus, data processing method and electronic equipment | |
| Berriri et al. | Towards Model based Testing for Software Defined Networks. | |
| CN109656825A (en) | The method and device of fine arts resource processing, electronic equipment, storage medium | |
| CN111669290B (en) | Network element management method, management server and storage medium | |
| CN103019862B (en) | A kind of symbolic excution methodology, Apparatus and system | |
| Yao et al. | Testing black-box sdn applications with formal behavior models | |
| CN107800555A (en) | Business diagnostic method and device | |
| CN115766472A (en) | Simulation method and device for superposition of prefix scheduling strategy | |
| CN105683938A (en) | Recording an application test | |
| CN115412447B (en) | Service testing method, device and medium based on SDN | |
| US20170220450A1 (en) | Analytic method and analyzing apparatus | |
| Pathak et al. | Composing web services through automatic reformulation of service specifications | |
| JPH0666603A (en) | Interconnection test system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |