CN116489046A

CN116489046A - Reliability test method, device, equipment, medium and system of shunt equipment

Info

Publication number: CN116489046A
Application number: CN202310286811.1A
Authority: CN
Inventors: 方子明; 刘佳; 张少平; 刘薇; 吴楠; 方靖炜; 彭代文; 马小慢; 杜小光; 丁韦杰; 陈晓辉; 杨琛
Original assignee: Dawning Network Technology Co ltd
Current assignee: Dawning Network Technology Co ltd
Priority date: 2023-03-20
Filing date: 2023-03-20
Publication date: 2023-07-25

Abstract

The invention discloses a method, a device, equipment, a medium and a system for testing the reliability of shunt equipment. The method comprises the following steps: obtaining simulation flow description information matched with the to-be-detected flow distribution equipment, generating simulation flow matched with the simulation flow description information through flow simulation equipment, and sending the simulation flow to the to-be-detected flow distribution equipment; acquiring a reliability test script, and splitting the reliability test script into a software exception simulation script and a hardware exception simulation script; the software exception simulation script is executed by the software simulation equipment, and software and hardware exceptions are injected into the to-be-tested shunt equipment in a mode that the hardware simulation equipment executes the hardware exception simulation script so as to perform reliability test; and generating a reliability test result by the performance monitoring equipment according to the real-time running state of the to-be-tested shunt equipment in the reliability test process. The technical scheme of the invention solves the problem of insufficient coverage of the reliability related scene in the reliability test of the existing shunt equipment, and improves the effectiveness and completeness of the reliability test.

Description

Reliability test method, device, equipment, medium and system of shunt equipment

Technical Field

The present invention relates to the field of network communications technologies, and in particular, to a method, an apparatus, a device, a medium, and a system for testing reliability of a shunt device.

Background

With the development of communication technology, the information communication mode is diversified, and network communication plays a vital carrier role. The method meets the development requirement of the age, and needs to recognize the importance of network communication, so that the country truly moves to an informatization society.

When network communication is carried out, the reliability of the network shunt equipment plays a crucial role, and the network shunt equipment can be put into use after passing a reliability test. The existing shunt equipment reliability test generally sends a simulated flow message to the shunt equipment at a fixed rate, simulates equipment faults (power on and off of the whole equipment, main and standby switching, abnormal switching boards, high temperature and the like), calculates the difference between packet sending and packet receiving of the shunt equipment, divides the packet sending rate, and calculates the fault switching time.

The shunt equipment reliability test method can cover basic scenes, but has certain difference from actual current network scenes, and lacks burst scenes and abnormal scene simulation based on the current network scenes.

Disclosure of Invention

The invention provides a reliability test method, a device, equipment, a medium and a system for shunt equipment, which are used for realizing burst and abnormal scene simulation of reliability test on the premise of maximally simulating and restoring the actual scene of the existing network.

In a first aspect, an embodiment of the present invention provides a method for testing reliability of a shunt device, including:

obtaining simulation flow description information matched with the to-be-detected flow distribution equipment, generating simulation flow matched with the simulation flow description information through flow simulation equipment, and sending the simulation flow to the to-be-detected flow distribution equipment;

acquiring a reliability test script, and splitting the reliability test script into a software exception simulation script and a hardware exception simulation script;

the software exception simulation script is executed by the software simulation equipment, and the hardware exception simulation script is executed by the hardware simulation equipment, so that software and hardware exceptions are injected into the to-be-tested shunt equipment to perform reliability test;

and generating a reliability test result by the performance monitoring equipment according to the real-time running state of the to-be-tested shunt equipment in the reliability test process.

Further, obtaining the analog flow description information matched with the to-be-detected shunt device includes:

collecting historical flow data of a user in a current network scene adapted to the to-be-detected shunt equipment;

according to the historical flow data of the user, the flow distribution characteristics of the historical messages of different types are counted and used as the simulated flow description information matched with the to-be-tested shunt equipment.

Through the arrangement, the association relation between the simulated flow description information and the message flow distribution characteristics of the existing historical real flow is considered, and the authenticity of the simulated flow description information is improved.

Further, generating, by the flow simulation device, a simulated flow matched with the simulated flow description information, and sending the simulated flow to the to-be-tested shunt device, including:

determining message types matched with the simulated flow and message expected flow values of each message type according to the overall expected flow value of the simulated flow and the description information of the simulated flow;

acquiring a byte length type matched with the analog traffic and the quantity ratio of each byte length type, wherein the byte length type comprises a normal scene byte length and an abnormal scene byte length;

determining the message quantity value of each message type under each byte length type according to the message type matched with the analog flow, the message expected flow value of each message type, the byte length type and the quantity ratio of each byte length type;

and calling a simulated flow model to generate simulated flow according to the message quantity value of each message type under each byte length type by the flow simulation equipment, and sending the linear speed of the simulated flow to the to-be-tested shunt equipment.

Through the arrangement, the message quantity values of different message types under different byte length types are increased, the simulation of burst scenes of the shunt equipment can be realized, and the diversity of relevant scenes of the reliability test is improved.

Further, when the simulated flow matched with the simulated flow description information is generated by the flow simulation device and sent to the to-be-tested shunt device, the method further comprises the steps of:

and synchronously transmitting the real playback flow to the to-be-detected shunt device through the flow playback device.

Through the arrangement, the real playback flow and the analog flow are synchronously sent to the to-be-tested shunt equipment, so that the effectiveness of the reliability test result of the to-be-tested shunt equipment is improved, and the actual reference value of the test result is improved.

Further, splitting the reliability test script into a software exception simulation script and a hardware exception simulation script includes:

identifying a software exception simulation instruction and a hardware exception simulation instruction in each simulation instruction included in the reliability test script;

determining instruction execution time of each software exception simulation instruction and each hardware exception simulation instruction according to the execution sequence of each simulation instruction in the reliability test script and the preset test script starting time;

Generating a software exception simulation script according to each software exception simulation instruction and the instruction execution time of each software exception simulation instruction;

and generating a hardware exception simulation script according to each hardware exception simulation instruction and the instruction execution time of each hardware exception simulation instruction.

Through the arrangement, multi-scene coverage can be performed through the automatic script, and related fault simulation control can be automatically configured according to scene requirements without human intervention, so that the working efficiency is improved.

Further, generating, by the performance monitoring device, a reliability test result according to a real-time running state of the to-be-tested shunt device in a reliability test process, including:

monitoring at least one item of running state information of the shunt equipment to be tested in the reliability test process in real time through the performance monitoring equipment;

when the running state abnormality of the to-be-tested shunt equipment is determined according to the running state information, sending a test flow stopping sending instruction to the flow equipment by the performance monitoring equipment, and synchronously recording the equipment information of the to-be-tested shunt equipment in the running state abnormality as a reliability test result.

Through the arrangement, whether the flow forwarding is normal or not is considered, the states of a hardware system, a software module, a log system and the like of the to-be-detected shunt equipment are also considered, real-time monitoring is carried out, once the reliability test abnormality is found, the flow input is stopped immediately, and the equipment states and information are recorded and stored.

In a second aspect, an embodiment of the present invention further provides a reliability testing apparatus for a shunt device, including:

the simulated flow sending module is used for obtaining simulated flow description information matched with the to-be-detected flow distribution equipment, generating simulated flow matched with the simulated flow description information through the flow simulation equipment and sending the simulated flow to the to-be-detected flow distribution equipment;

the test script splitting module is used for acquiring a reliability test script and splitting the reliability test script into a software exception simulation script and a hardware exception simulation script;

the reliability test execution module is used for injecting software and hardware anomalies into the to-be-tested shunt equipment in a mode that the software simulation equipment executes the software anomaly simulation script and the hardware simulation equipment executes the hardware anomaly simulation script so as to perform reliability test;

the reliability result generation module is used for generating a reliability test result according to the real-time running state of the to-be-tested shunt equipment in the reliability test process through the performance monitoring equipment.

In a third aspect, an embodiment of the present invention further provides a reliability test apparatus for a shunt apparatus, where the reliability test apparatus for a shunt apparatus includes:

at least one processor; and

A memory communicatively coupled to the at least one processor; wherein,,

the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the reliability test method of the shunt device provided by any one of the embodiments of the present invention.

In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium stores computer instructions, where the computer instructions are configured to cause a processor to implement a reliability testing method for a shunt device provided by any one of the embodiments of the present invention when executed.

In a fifth aspect, an embodiment of the present invention further provides a reliability testing system for a shunt device, including: the system comprises a main control device, and flow simulation equipment, software simulation equipment, hardware simulation equipment and performance monitoring equipment which are respectively connected with the main control device; the flow simulation device, the software simulation device, the hardware simulation device and the performance monitoring device are respectively connected with the to-be-tested shunt device;

the main control equipment is used for executing the reliability test method of the shunt equipment provided by any embodiment of the invention;

the flow simulation device is used for generating simulated flow and sending the simulated flow to the to-be-tested shunt device when the reliability test is carried out on the to-be-tested shunt device;

The software simulation equipment is used for injecting software abnormality into the to-be-tested shunt equipment by executing the software abnormality simulation script when the reliability test is carried out on the to-be-tested shunt equipment;

the hardware simulation equipment is used for injecting hardware abnormality into the to-be-tested shunt equipment by executing the hardware abnormality simulation script when the reliability test is carried out on the to-be-tested shunt equipment;

the performance monitoring equipment is used for generating a reliability test result according to the real-time running state of the to-be-tested shunt equipment when the reliability test is carried out on the to-be-tested shunt equipment.

The embodiment of the invention provides a method, a device, equipment, a medium and a system for testing the reliability of a shunt device, which are characterized in that analog flow description information matched with the shunt device to be tested is obtained, and analog flow matched with the analog flow description information is generated by a flow simulation device and is sent to the shunt device to be tested; acquiring a reliability test script, and splitting the reliability test script into a software exception simulation script and a hardware exception simulation script; the software exception simulation script is executed by the software simulation equipment, and the hardware exception simulation script is executed by the hardware simulation equipment, so that software and hardware exceptions are injected into the to-be-tested shunt equipment to perform reliability test; and generating a reliability test result by the performance monitoring equipment according to the real-time running state of the to-be-tested shunt equipment in the reliability test process. By adopting the technical scheme, the simulated flow which is generated by the flow simulation device and matched with the simulated flow description information is sent to the to-be-tested shunt device, when the reliability test is carried out on the to-be-tested shunt device, the software simulation device injects software abnormality into the to-be-tested shunt device by executing the software abnormality simulation script, the hardware simulation device injects hardware abnormality into the to-be-tested shunt device by executing the hardware abnormality simulation script, and the performance monitoring device generates a reliability test result according to the real-time running state of the to-be-tested shunt device. The method solves the problems that the simulation flow model is limited and burst and abnormal scene simulation is lacking in the prior art, realizes the increase of the simulation of burst and abnormal scenes on the premise of enriching the simulation flow model to the maximum extent, realizes the diversification of the flow model and improves the effectiveness and completeness of the reliability test result.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flowchart of a method for testing reliability of a shunt device according to a first embodiment of the present invention;

fig. 2 is a flowchart of a reliability testing method of a shunt device according to a second embodiment of the present invention;

FIG. 3 is a flowchart of a reliability test result generation method according to a second embodiment of the present invention;

fig. 4 is a schematic structural diagram of a reliability testing apparatus of a shunt device according to a third embodiment of the present invention;

fig. 5 is a schematic structural diagram of a reliability testing device of a shunt device according to a fourth embodiment of the present invention;

Fig. 6 is a schematic structural diagram of a reliability testing system of a shunt device according to a fifth embodiment of the present invention.

Detailed Description

In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

Fig. 1 is a flowchart of a reliability testing method for a shunt device according to a first embodiment of the present invention, where the method may be applied to a case of performing reliability testing on a shunt device to be tested, where the reliability testing device for the shunt device may be implemented in hardware and/or software, and the reliability testing device for the shunt device may be configured on a computer device, where the computer device may be a desktop computer, a notebook computer, a server, or the like with a function of the shunt device. As shown in fig. 1, the method includes:

s110, obtaining the simulated flow description information matched with the to-be-detected flow distribution device, generating the simulated flow matched with the simulated flow description information through the flow simulation device, and sending the simulated flow to the to-be-detected flow distribution device.

In this embodiment, the analog traffic may be understood as an analog test traffic packet input to the to-be-tested splitter device during the reliability test of the to-be-tested splitter device, where the traffic packet is typically an analog data packet generated according to the characteristics of the real data packet of the network. The analog traffic description information may be understood as information describing the analog traffic, and may include information such as a packet type, a packet sending rate, and a byte length. A flow simulation device may be understood as a device that generates and transmits simulated flow.

Specifically, when the reliability test is performed on the to-be-tested shunt equipment, a flow data packet matched with the to-be-tested shunt equipment can be obtained in a real network, the description information of the flow data packet is obtained, the simulation flow matched with the description information is generated through the flow simulation equipment, and the simulation flow is injected into the to-be-tested shunt equipment according to the test requirement.

It can be understood that while the flow simulation device generates the simulated flow matched with the simulated flow description information and sends the simulated flow to the to-be-tested shunt device, the real flow in the network can be synchronously injected into the to-be-tested shunt device so as to jointly perform the reliability test.

Or when the simulated flow generated by the flow simulation device cannot meet the test requirement of the to-be-tested shunt device, a flow copying device can be added between the flow simulation device and the to-be-tested shunt device so as to expand the simulated flow and then inject the expanded simulated flow into the to-be-tested shunt device. The flow simulation device may be a network meter.

S120, acquiring a reliability test script, and splitting the reliability test script into a software exception simulation script and a hardware exception simulation script.

In this embodiment, the reliability test script may be understood as an instruction set for performing reliability test on the to-be-tested shunt device, and may include a control instruction, a software exception simulation instruction, a hardware exception simulation instruction, and various instructions related to the to-be-tested shunt device. The software abnormality simulation script can be understood as an instruction for simulating various software abnormalities of the to-be-tested shunt device by controlling various software modules of the to-be-tested shunt device in order to test the reliability of the to-be-tested shunt device. The hardware abnormality simulation script may be understood as an instruction for controlling hardware related to the to-be-tested shunt device to execute hardware abnormality simulation in the reliability test of the to-be-tested shunt device, and the hardware abnormality simulation may be understood as a hardware abnormality condition which may occur to the related hardware of the to-be-tested shunt device under real circumstances by controlling the working state of the related hardware of the to-be-tested shunt device, and for example, may simulate a power supply abnormality caused by damage to a part of components in a power supply circuit of the to-be-tested shunt device by turning off a power supply controller of one or more circuit modules in the to-be-tested shunt device.

Specifically, a reliability test script may be written before the reliability test is performed, in which one or more software exception simulation instructions and one or more hardware exception simulation instructions may be programmed in a hybrid manner to simulate various software and hardware exception scenarios. Specifically, if an abnormal scene is: after the software reboot restarting abnormality occurs to the single board card in the to-be-measured shunting equipment, the interval is 5 minutes, and the complete machine hard restarting abnormality of the to-be-measured shunting equipment occurs again. Based on the scene, a reliability test script can be constructed in a mode of software exception simulation instruction, waiting instruction and hardware exception simulation instruction.

It can be understood that, in general, the software exception simulation instruction may be executed by the software simulation device alone, and the hardware exception simulation instruction may be executed by the hardware simulation device alone, so that when a tester constructs a reliability test script from the overall exception scene simulation angle, the reliability test script needs to be split into the software exception simulation script and the hardware exception simulation script.

In an optional implementation manner of this embodiment, when splitting the software exception simulation script and the hardware exception simulation script, when a subsequent instruction of a certain software exception simulation instruction in the software exception simulation script is a hardware exception simulation instruction in the reliability test script, the software exception simulation instruction may be identified, or when a subsequent instruction of a certain hardware exception simulation instruction in the hardware exception simulation script is a software exception simulation instruction in the reliability test script, the hardware exception simulation instruction may be identified, and further, based on the identification, the software exception simulation device and the hardware simulation device may be linked to execute the software exception simulation script and the hardware exception simulation script in order according to an instruction arrangement order in the reliability test script.

In another alternative implementation of this embodiment, when the software exception simulation script and the hardware exception simulation script are split, absolute execution times of each software exception simulation instruction and each hardware exception simulation instruction, for example, 2023.06.04:12:00:00, may be planned according to the relative execution times of the software exception simulation instruction and the hardware exception simulation instruction in the reliability test script, for example, the software exception simulation instruction B is executed 5 minutes after the hardware exception simulation instruction a is executed, and a preset initial script execution time. And splitting to obtain the software exception simulation script carrying the absolute execution time and the hardware exception simulation script. At this time, the software simulation device and the hardware simulation device may execute the respective software exception simulation script and hardware exception simulation script without affecting each other.

S130, software and hardware anomalies are injected into the to-be-tested shunt device by means of software simulation equipment executing a software anomaly simulation script and hardware simulation equipment executing a hardware anomaly simulation script so as to conduct reliability test.

In this embodiment, a software simulation device may be understood as a device having the capability of executing software-related commands in a simulation script, where the software-related commands may include correct instructions, error instructions, and the like. The error instruction may include instructions to perform a complete machine reboot restart, a single board card reboot restart, software module exception simulation, software process exception simulation, and the like at an improper time. The hardware simulation device may be understood as a device capable of executing commands related to hardware in a simulation script, where the commands related to hardware may include a normal operation command and an abnormal operation command of hardware, and the abnormal operation command may be a command such as starting and closing a power supply of a complete machine, a single board card, or a certain functional circuit.

Specifically, in the reliability test of the to-be-tested shunt device, a software simulation script is executed through a software simulation device, software abnormality is simulated in a mode of sending an error instruction to the to-be-tested shunt device, and a hardware abnormality simulation script is executed through a hardware simulation device, so that the power management of the to-be-tested shunt device can be used for controlling the power-on and power-off modes of the whole device to simulate hardware abnormality, thereby carrying out the reliability test.

And S140, generating a reliability test result by the performance monitoring equipment according to the real-time running state of the to-be-tested shunt equipment in the reliability test process.

In this embodiment, the performance monitoring device may be understood as a device having a function of performing real-time monitoring on the to-be-tested shunt device, where the real-time monitoring function may include functions of determining abnormality of reliability test data, automatically closing flow input, monitoring and saving current information of the to-be-tested shunt device, and the like.

Specifically, when the to-be-tested shunt device performs reliability test, the to-be-tested shunt device can be monitored in real time through the performance monitoring device, and the reliability test result can be generated through board card state monitoring, log monitoring, flow forwarding monitoring, configuration monitoring and the like.

In an optional implementation manner of this embodiment, the performance monitoring device may stop injection of the simulated flow in time when an operation abnormality occurs in the to-be-tested shunt device, and save each field parameter of the to-be-tested shunt device in time, so as to help a tester locate an abnormality cause accurately and efficiently, and improve efficiency of reliability test.

When the to-be-tested shunt equipment is subjected to reliability test, a large amount of simulated flow is generated through the flow simulation equipment, the total flow value of the simulated flow exceeds the maximum processing performance flow value which can be borne by the to-be-tested shunt equipment, meanwhile, the abnormal power failure condition of the to-be-tested shunt equipment is simulated through the hardware simulation equipment, the abnormality is injected into the to-be-tested shunt equipment, whether the to-be-tested shunt equipment is paralyzed or not, the abnormality is processed, whether the real-time running state of power supply can be recovered in the expected time is monitored through the performance monitoring equipment, and the reliability test result of the to-be-tested shunt equipment is generated.

After the flow simulation device generates the simulated flow matched with the simulated flow description information and sends the simulated flow to the to-be-tested flow distribution device, the to-be-tested flow distribution device returns the received simulated flow to the flow simulation device again, so that the difference of the receiving and transmitting simulated flows can be further compared by the flow simulation device, the message forwarding accuracy of the to-be-tested flow distribution device is verified, and further, the to-be-tested flow distribution device can be subjected to more comprehensive reliability test.

According to the technical scheme, the simulation flow description information matched with the to-be-detected flow distribution equipment is obtained, the simulation flow matched with the simulation flow description information is generated through the flow simulation equipment, and the simulation flow is sent to the to-be-detected flow distribution equipment; acquiring a reliability test script, and splitting the reliability test script into a software exception simulation script and a hardware exception simulation script; the software exception simulation script is executed by the software simulation equipment, and the hardware exception simulation script is executed by the hardware simulation equipment, so that software and hardware exceptions are injected into the to-be-tested shunt equipment to perform reliability test; and generating a reliability test result by the performance monitoring equipment according to the real-time running state of the to-be-tested shunt equipment in the reliability test process. The method is different from the technical scheme that the flow model is limited and the fault scene is relatively fixed in the traditional shunt equipment reliability test, improves the comprehensiveness of the reliability test, and increases the actual reference value of the reliability test result.

Example two

Fig. 2 is a flowchart of a reliability testing method for a shunt device according to a second embodiment of the present invention, where the present embodiment is further optimized and expanded based on the foregoing embodiments, and may be combined with each of the optional technical solutions in the foregoing embodiments. As shown in fig. 2, the method includes:

S210, collecting historical flow data of a user in a current network scene adapted to the to-be-detected shunt equipment.

In this embodiment, the present network scenario may be a campus network scenario, a backbone network scenario, a provincial local area network scenario, etc., and the historical traffic data may be understood as actual traffic data existing in the actual scenario.

Specifically, the real flow data of the user in the current network scene can be collected in the current network scene adapted to the to-be-detected shunt equipment.

S220, according to the historical flow data of the user, counting the flow distribution characteristics of the historical messages of different types, and taking the flow distribution characteristics as analog flow description information matched with the to-be-detected shunt equipment.

In this embodiment, the traffic distribution feature may be understood as a distribution feature such as a packet type in the traffic, a traffic ratio of various packets, a packet sending rate, and a byte length.

Specifically, according to the historical flow data collected in the current network scene, various message flow rate ratio, packet sending rate, byte length and other information of the historical messages of different types are analyzed and counted, the statistical information is used as simulation flow description information matched with the to-be-tested shunt equipment, and the simulation flow can be generated according to the simulation flow description information.

S230, determining message types matched with the simulated flow and message expected flow values of each message type according to the total expected flow value of the simulated flow and the description information of the simulated flow.

In this embodiment, the overall expected flow value may be understood as a flow value that the to-be-measured flow splitting device can carry the analog flow at most, and this flow value may be a maximum value desired by a user or a maximum value designed by the user, which is not particularly limited in the present invention. The message expected flow value can be understood as a flow value of any message type that the user wishes or the user designs.

Specifically, when the to-be-tested shunt device performs reliability test, the message type matched with the simulated flow and the flow value of each message type flow can be determined according to the overall expected flow value of the simulated flow and the simulated flow description information constructed based on the flow distribution characteristics of the different types of the historical messages of the historical flow data. The message types may include, for example, V4 normal message, V6 normal message, tunnel message, and fragment message.

In a specific example, if the packet flow rate of the V4 normal packet recorded in the analog flow description information is 40%, and the overall expected flow value of the analog flow is 1024GB, the packet expected flow value of the V4 normal packet is 1024gb×40%.

S240, acquiring byte length types matched with the analog traffic and the quantity duty ratio of each byte length type, wherein the byte length types comprise normal scene byte lengths and abnormal scene byte lengths.

Specifically, when the to-be-tested shunt device performs reliability test, obtaining a byte length type matched with the analog flow and the quantity ratio of each byte length type according to the analog flow description information, wherein the byte length type comprises a normal scene byte length and an abnormal scene byte length. By way of example, the normal scene byte length may be any one of a 64 byte to 1518 byte length or a mixed byte length of several different byte lengths, and the abnormal scene byte length may be a 64 byte burst, a 1518 byte burst, an ultra-short packet, and an ultra-long packet.

S250, determining the message quantity value of each message type under each byte length type according to the message type matched with the analog flow, the message expected flow value of each message type, the byte length type and the quantity ratio of each byte length type.

For example, the message types matched with the analog flow are a V4 normal message and a V6 normal message, wherein the expected flow value of the V4 normal message flow is 600, and the expected flow value of the V6 normal message is 400. Byte length types that match analog traffic include: 64 bytes, 512 bytes and 1518 bytes, wherein the duty ratio of 64 bytes is 56%, the duty ratio of 512 bytes is 20%, the duty ratio of 1518 bytes is 24%, the number of V4 normal messages of 64 bytes length is 336, the number of V6 normal messages of 64 bytes length is 224, the number of V4 normal messages of 512 bytes length is 120, the number of V6 normal messages of 512 bytes length is 80, the number of V4 normal messages of 1518 bytes length is 144, and the number of V6 normal messages of 1518 bytes length is 96.

S260, calling a simulated flow model to generate simulated flow through the flow simulation equipment according to the message quantity value of each message type under each byte length type, and sending the linear speed of the simulated flow to the to-be-tested shunt equipment.

In this embodiment, the simulated traffic model may be understood as a program or software for generating a simulated traffic, and specifically may be understood as a pre-trained machine learning model, where a simulated traffic model may correspond to a message type, and the input of the simulated traffic model of a certain message type is a byte length type and the number of messages, and the output is the number of messages of the message type under the byte length type.

Optionally, when the simulated flow matched with the simulated flow description information is generated by the flow simulation device and sent to the to-be-tested shunt device, the method further comprises the following steps:

Wherein a traffic playback device may be understood as a device that plays back historic real traffic.

Specifically, the flow sent to the to-be-measured shunt device can be an analog flow, or can be a set of an analog flow and a real flow.

Further, when the real playback flow generated by the flow playback device cannot meet the test requirement of the to-be-tested shunt device, a flow copying device can be added between the flow playback device and the to-be-tested shunt device so as to expand the real playback flow, and then the real playback flow is injected into the to-be-tested shunt device. Wherein the traffic playback device may be a server.

In the reliability test of the to-be-tested shunt device, if the meter port resources and the performance of the simulated flow are insufficient, the simulated flow can be copied; if the performance of the simulated flow and the real flow sent to the to-be-detected flow dividing device is insufficient, the two flows can be subjected to flow duplication so as to improve the performance of the flows.

In this embodiment, the real playback flow and the analog flow are synchronously transmitted, so that the diversity of the flow is increased, and the current network flow is simulated and restored as much as possible.

S270, acquiring a reliability test script, and splitting the reliability test script into a software exception simulation script and a hardware exception simulation script.

Optionally, splitting the reliability test script into a software exception simulation script and a hardware exception simulation script may further include:

Identifying a software exception simulation instruction and a hardware exception simulation instruction in each simulation instruction included in the reliability test script; determining instruction execution time of each software exception simulation instruction and each hardware exception simulation instruction according to the execution sequence of each simulation instruction in the reliability test script and the preset test script starting time; generating a software exception simulation script according to each software exception simulation instruction and the instruction execution time of each software exception simulation instruction; and generating a hardware exception simulation script according to each hardware exception simulation instruction and the instruction execution time of each hardware exception simulation instruction.

In the embodiment, the multi-scene coverage can be performed through the automatic script, and the related fault simulation control can be automatically configured according to scene requirements without human intervention, so that the working efficiency is improved, and the artificial labor force is saved.

S280, software and hardware anomalies are injected into the to-be-tested shunt device by means of executing a software anomaly simulation script by the software simulation device and executing a hardware anomaly simulation script by the hardware simulation device so as to perform reliability test.

S290, generating a reliability test result according to the real-time running state of the to-be-tested shunt device in the reliability test process through the performance monitoring device.

Optionally, fig. 3 is a flowchart of a method for generating a reliability test result according to a second embodiment of the present invention, as shown in fig. 3, including:

s2901, monitoring at least one item of running state information of the shunt equipment to be tested in the reliability test process in real time through performance monitoring equipment.

Specifically, in the reliability test process of the to-be-tested shunt device, at least one piece of running state information of the board card state, the log, the flow forwarding and the configuration of the to-be-tested shunt device is monitored in real time through the performance monitoring device.

S2902, when the running state abnormality of the to-be-tested shunt device is determined according to the running state information through the performance monitoring device, sending a test flow stopping sending instruction to the flow device, and synchronously recording the device information of the to-be-tested shunt device when the running state abnormality is taken as a reliability test result.

Specifically, the performance monitoring equipment monitors equipment state information in real time, if hardware system abnormality, flow forwarding abnormality, software module abnormality or log record abnormality and the like are found, a test flow stopping sending instruction is sent to the flow simulation equipment, the sending of the simulation flow to the to-be-tested flow distribution equipment is stopped, and running state information such as board card state, log, flow forwarding and configuration of the to-be-tested flow distribution equipment is synchronously recorded to serve as a reliability test result.

In this embodiment, unlike the common stability test method for the shunt device, which focuses on the calculation of the failover time, the performance monitoring device monitors the software and hardware states of the shunt device to be tested, determines whether the shunt device to be tested is abnormal, sends a test flow stop sending instruction to the flow device once the reliability test abnormality is found, immediately stops the flow input, and records and stores the state and information of the shunt device. The effectiveness and completeness of the reliability test result of the to-be-tested shunt equipment are improved.

According to the technical scheme of the embodiment, through collecting user historical flow data in an existing network scene, according to the flow distribution characteristics of the user historical flow data, the number proportion of message types matched with simulated flow, the expected flow value of each message type, the byte length type and each byte length type is determined, the message quantity value of each message type under each byte length type is obtained according to the information, and according to the message quantity value of each message type under each byte length type, a simulated flow model is called to generate simulated flow through flow simulation equipment, and the simulated flow linear speed is sent to the to-be-tested shunt equipment. By adopting the technical scheme, the problem that the flow model is fixed or limited in the prior art is solved, the flow model is enriched according to the real flow data of the historical user, the authenticity of the flow model is increased, and the real network scene is simulated and restored as much as possible by adding various combinations of message types.

Example III

Fig. 4 is a schematic structural diagram of a reliability testing device for a shunt device according to a third embodiment of the present invention. The embodiment is applicable to a scenario of performing a reliability test of the to-be-tested shunt device, and is not particularly limited. As shown in fig. 4, the reliability test apparatus of the shunt device includes: the system comprises a simulated flow sending module 31, a test script splitting module 32, a reliability test executing module 33 and a reliability result generating module 34.

The simulated flow sending module 31 is configured to obtain simulated flow description information matched with the to-be-detected flow distribution device, generate a simulated flow matched with the simulated flow description information through the flow simulation device, and send the simulated flow to the to-be-detected flow distribution device; the test script splitting module 32 is configured to obtain a reliability test script, and split the reliability test script into a software exception simulation script and a hardware exception simulation script; the reliability test execution module 33 is configured to inject software and hardware anomalies into the to-be-tested shunt device in a manner that the software simulation device executes the software anomaly simulation script and the hardware simulation device executes the hardware anomaly simulation script, so as to perform reliability test; the reliability result generating module 34 is configured to generate a reliability test result according to the real-time running state of the to-be-tested shunt device in the reliability test process through the performance monitoring device.

Optionally, the analog traffic sending module 31 includes:

and the historical flow data collection unit is used for collecting the historical flow data of the user in the current network scene adapted to the to-be-detected shunt equipment.

And the flow distribution characteristic statistics unit is used for counting the flow distribution characteristics of the historical messages of different types according to the historical flow data of the user and taking the flow distribution characteristics as simulated flow description information matched with the to-be-detected shunt equipment.

And the message expected flow value determining unit is used for determining the message type matched with the simulated flow and the message expected flow value of each message type according to the total expected flow value of the simulated flow and the description information of the simulated flow.

The byte acquisition unit is used for acquiring byte length types matched with the analog traffic and the quantity duty ratio of each byte length type, wherein the byte length types comprise normal scene byte lengths and abnormal scene byte lengths.

The message quantity value determining unit is used for determining the message quantity value of each message type under each byte length type according to the message type matched with the analog flow, the message expected flow value of each message type, the byte length type and the quantity ratio of each byte length type.

The simulated flow linear speed sending unit is used for calling a simulated flow model to generate simulated flow through the flow simulation equipment according to the message quantity value of each message type under each byte length type, and sending the simulated flow linear speed to the to-be-tested shunt equipment.

Optionally, the analog traffic sending module 31 may further include:

and the real playback flow sending unit is used for synchronously sending the real playback flow to the to-be-detected shunt equipment through the flow playback equipment.

Optionally, the test script splitting module 32 includes:

and the abnormality simulation instruction identification unit is used for identifying the software abnormality simulation instruction and the hardware abnormality simulation instruction in each simulation instruction included in the reliability test script.

The instruction execution time determining unit is used for determining the instruction execution time of each software exception simulation instruction and each hardware exception simulation instruction according to the execution sequence of each simulation instruction in the reliability test script and the preset test script starting time.

And the software exception simulation script generation unit is used for generating a software exception simulation script according to each software exception simulation instruction and the instruction execution time of each software exception simulation instruction.

The hardware exception simulation script generation unit is used for generating a hardware exception simulation script according to each hardware exception simulation instruction and the instruction execution time of each hardware exception simulation instruction.

Optionally, the reliability result generating module 34 includes:

the running state information monitoring unit is used for monitoring at least one item of running state information of the shunt equipment to be tested in the reliability testing process in real time through the performance monitoring equipment.

And the stop instruction sending unit is used for sending a test flow stop sending instruction to the flow equipment when the running state abnormality of the to-be-tested shunt equipment is determined according to the running state information through the performance monitoring equipment, and synchronously recording the equipment information of the to-be-tested shunt equipment when the running state abnormality is taken as a reliability test result.

The reliability testing device of the shunt equipment provided by the embodiment of the invention can execute the reliability testing method of the shunt equipment provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example IV

Fig. 5 shows a schematic diagram of an electronic device 40 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.

As shown in fig. 5, the electronic device 40 includes at least one processor 41, and a memory communicatively connected to the at least one processor 41, such as a Read Only Memory (ROM) 42, a Random Access Memory (RAM) 43, etc., in which the memory stores a computer program executable by the at least one processor, and the processor 41 may perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 42 or the computer program loaded from the storage unit 48 into the Random Access Memory (RAM) 43. In the RAM43, various programs and data required for the operation of the electronic device 40 may also be stored. The processor 41, the ROM 42 and the RAM43 are connected to each other via a bus 44. An input/output (I/O) interface 45 is also connected to bus 44.

Various components in electronic device 40 are connected to I/O interface 45, including: an input unit 46 such as a keyboard, a mouse, etc.; an output unit 47 such as various types of displays, speakers, and the like; a storage unit 48 such as a magnetic disk, an optical disk, or the like; and a communication unit 49 such as a network card, modem, wireless communication transceiver, etc. The communication unit 49 allows the electronic device 40 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The processor 41 may be various general and/or special purpose processing components with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 41 performs the various methods and processes described above, such as the reliability testing method of the shunt device described in the various embodiments of the present invention.

The method comprises the following steps:

In some embodiments, the reliability testing method of the shunt device may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 48. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 40 via the ROM 42 and/or the communication unit 49. When the computer program is loaded into RAM 43 and executed by processor 41, one or more steps of the above-described reliability testing method of the shunt device may be performed. Alternatively, in other embodiments, processor 41 may be configured by any other suitable means (e.g., by means of firmware) to perform the reliability test method of the shunt device as described in embodiments of the present invention.

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.

Example five

Fig. 6 is a schematic structural diagram of a reliability testing system of a shunt device according to a fifth embodiment of the present invention. As shown in fig. 6, the reliability test system of the shunt device includes: a main control device 50, and a flow simulation device 51, a software simulation device 52, a hardware simulation device 53 and a performance monitoring device 54 which are respectively connected with the main control device; the flow simulation device 51, the software simulation device 52, the hardware simulation device 53 and the performance monitoring device 54 are respectively connected with the to-be-tested shunt device 55.

The master control device 50 is configured to execute the reliability testing method of the shunt device according to any embodiment of the present invention.

The flow simulation device 51 is configured to generate a simulated flow and send the simulated flow to the to-be-tested shunt device 55 when the to-be-tested shunt device 55 is subjected to reliability test.

The software simulation device 52 is configured to inject a software exception into the to-be-tested shunt device 55 by executing a software exception simulation script when the reliability test is performed on the to-be-tested shunt device 55.

The hardware simulation device 53 is configured to inject a hardware exception into the to-be-tested shunt device 55 by executing a hardware exception simulation script when the reliability test is performed on the to-be-tested shunt device 55.

The performance monitoring device 54 is configured to generate a reliability test result according to a real-time running state of the to-be-tested shunt device 55 when the to-be-tested shunt device 55 is subjected to reliability test.

According to the technical scheme, by configuring the main control equipment, the flow simulation equipment, the software simulation equipment, the hardware simulation equipment and the performance monitoring equipment which are respectively connected with the main control equipment in the reliability test system of the flow distribution equipment, the reliability test result is generated under the conditions that the simulation flow equipment transmits simulation flow to the flow distribution equipment to be tested, the software simulation equipment injects software abnormality into the flow distribution equipment to be tested, the hardware simulation equipment injects hardware abnormality into the flow distribution equipment to be tested and the performance monitoring equipment monitors the running state of the flow distribution equipment to be tested in real time, the simulation of burst and abnormal scenes is increased, the diversification of the flow model is realized, and the effectiveness and completeness of the reliability test result are improved.

In a complete implementation manner that can be referred to in this embodiment, the method specifically may include:

the flow simulation device 51 is used for constructing simulated flow or replaying real flow or mixed flow of the simulated flow and the real flow, the maximum processing performance flow of the to-be-detected flow distribution device 55 is input to the to-be-detected flow distribution device 55, the to-be-detected flow distribution device 55 outputs the processed flow to the flow simulation device 51 after internal processing, and the flow simulation device 51 performs message quantity statistics and message correctness verification on the received flow. It should be noted that, the device for constructing the simulated flow may be a network instrument or a test instrument, a flow model may be preset in the instrument, and the flow content may be automatically changed by constructing an automation script, if the resources and performance of the instrument port for simulating the flow are insufficient, the flow replication device is used to replicate the flow; the device for constructing the real flow can be a server and is used for playing back the real flow, in a real scene, the real flow performance is lower, and the flow copying device is required to copy the flow, so that the performance of the real flow is improved; the device for constructing the mixed flow can be a small splitter, a beam splitter, a splitting device or the like, and is selected according to the actual networking environment, and the specific function is the copying of the analog flow and the actual flow. The method comprises the steps of constructing simulated traffic, enriching message types and byte lengths as much as possible, and transmitting at a linear speed, so as to simulate the actual scene of the current network.

Specifically, the flow model can be set according to the rate, the message content and the message length, the flow ratio of various messages in the message types can be set according to parameters, and one type can be selected to be sent independently or multiple types can be selected to be sent simultaneously. The packet sending rate defaults to the line speed, the byte length can be selected to be used alternatively in one or more types, the normal byte length is used for verifying the accuracy of the processing performance of the to-be-tested shunt device 55, and the abnormal byte length is used for testing the reliability of the to-be-tested shunt device 55.

The software simulation device 52 performs real-time configuration management on the to-be-tested shunt device 55 so as to simulate a fault scene of a real network. The software simulation device 52 may be a server, including a command line complete machine reboot restart, a single board card reboot restart, software module exception simulation, software process exception simulation, and the like, and is managed by an automation script.

The hardware simulation device 53 is a power supply controller, performs power-on and power-off management on the input power supply of the to-be-detected shunt device 55, performs fault simulation on power-on and power-off of the whole machine, and can perform automatic configuration according to scene requirements without human intervention by related control.

The performance monitoring device 54 is used for monitoring the to-be-tested shunt device 55 in real time, state information of the device is obtained through scripts, once the reliability test abnormality is found, the flow input of the to-be-tested shunt device 55 is immediately stopped, and the state, configuration, log and other information of the to-be-tested shunt device 55 are saved to wait for problem positioning and analysis.

It should be noted that, the software simulation device 52 and the performance monitoring device 54 may share a server, so as to achieve the purpose of saving resources.

Specifically, the execution content and execution time of the flow simulation device 51, the software simulation device 52, the hardware simulation device 53 and the performance monitoring device 54 are controlled by the main control device 50 according to the test requirements, so as to execute the reliability test of the to-be-tested shunt device 55.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.

The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims

1. A method for testing the reliability of a shunt device, comprising:

2. The method of claim 1, wherein obtaining analog flow description information matched to the to-be-measured distribution device comprises:

3. The method according to claim 2, wherein generating, by the flow simulation device, the simulated flow matched with the simulated flow description information and sending the simulated flow to the to-be-tested tapping device, includes:

4. The method of claim 3, wherein generating, by the flow simulation device, the simulated flow matching the simulated flow description information and sending the simulated flow to the to-be-tested tapping device, further comprises:

5. The method of any of claims 1-4, wherein splitting the reliability test script into a software exception simulation script and a hardware exception simulation script comprises:

6. The method according to any one of claims 1-4, wherein generating, by the performance monitoring device, a reliability test result according to a real-time operation state of the shunt device to be tested in the reliability test process, includes:

7. A reliability testing apparatus for a shunt device, comprising:

8. A reliability test apparatus of a shunt apparatus, characterized in that the reliability test apparatus of the shunt apparatus comprises:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the reliability testing method of the shunt device of any one of claims 1-6.

9. A computer readable storage medium storing computer instructions for causing a processor to perform the method of testing the reliability of the shunt device of any one of claims 1-6.

10. A reliability testing system for a shunt device, comprising: the system comprises a main control device, and flow simulation equipment, software simulation equipment, hardware simulation equipment and performance monitoring equipment which are respectively connected with the main control device; the flow simulation device, the software simulation device, the hardware simulation device and the performance monitoring device are respectively connected with the to-be-tested shunt device;

The master device for performing the method of any one of claims 1-6;

the flow simulation device is used for generating simulated flow and sending the simulated flow to the to-be-tested shunt device when the reliability of the to-be-tested shunt device is tested;

the software simulation equipment is used for injecting software abnormality into the to-be-tested shunt equipment by executing a software abnormality simulation script when the reliability test is carried out on the to-be-tested shunt equipment;

the hardware simulation equipment is used for injecting hardware abnormality into the to-be-tested shunt equipment by executing a hardware abnormality simulation script when the reliability test is carried out on the to-be-tested shunt equipment;