JP2011199706A - Network evaluation system, network evaluation apparatus, performance evaluation program, and network evaluation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently measure time required for switching a communication path and accurately evaluate network device performance for a network configured based on a redundancy protocol.SOLUTION: A network evaluation apparatus 1 and a test terminal 2 that are connected with each other are connected to a network 4. A program for instructing the test terminal 2 and network devices 6, 8, 10 to perform operations is stored in the network evaluation apparatus 1 in advance. The network evaluation apparatus 1 notifies the network devices 6, 8, 10 of initial setting information based on this program and makes them establish a redundancy network 4. Additionally, it makes the test terminal 2 start to transmit a frame 12 for test. Further, it makes the network devices 6, 8, 10 cause a pseudo-communication failure. In the network evaluation apparatus 1, the time required to switch the communication path is calculated.

Description

  The present invention relates to a network evaluation system, a network evaluation apparatus, a performance evaluation program, and a network evaluation method for measuring a time required for switching a communication path in a redundant network.

  Conventionally, with respect to a plurality of types of communication protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) and BSC (Binary Synchronous Control), there is known a prior art for evaluating the performance of a communication device in which these are implemented by protocol ( For example, see Patent Document 1.) In this prior art, a test is performed in a state where a single communication test apparatus corresponding to a plurality of types of communication protocols is connected to the communication apparatus, and an input / output device is connected to the single communication test apparatus. In particular, this input / output device has a function of converting a command unique to each communication protocol into a common command.

  For this reason, according to the above prior art, it is not necessary for the operator to input a unique command for each type of communication protocol, and only by inputting a common command to the input / output device, the type of communication protocol to be evaluated. A separate test could be performed.

JP-A-8-32649

  However, although the above-described prior art is advantageous in that the command according to the protocol is shared by the input / output device, the convenience obtained by this is only to reduce the input operation of the operator, and in the test. The accuracy of the obtained evaluation is not particularly improved. In other words, in the prior art method, the command input operation is still performed manually by the operator, so the conditions for performing the test are likely to vary depending on the experience and proficiency of the operator, and the accuracy of the evaluation obtained therefrom Is still unreliable.

  Specifically, various conditions such as the start timing, establishment of communication, and transmission / reception of test data when performing tests in the prior art are all determined by the operator entering commands one by one. Therefore, the evaluation based on the timing of the operation and the test result depends on the judgment of each worker. For this reason, even if the operability of the input / output device is improved, the test conditions vary depending on the experience and proficiency of individual workers. One thing must be scrutinized, and then the performance of the communication equipment must be finally evaluated. Therefore, the prior art method has a problem that the evaluation cannot always be performed with stable accuracy.

  Accordingly, an object of the present invention is to provide a technique capable of efficiently obtaining an evaluation result with high accuracy without depending on the experience and proficiency level of an operator.

  A first invention for achieving the above object is to form a logically redundant communication path by connecting a plurality of network devices that perform a relay operation using a predetermined redundancy protocol to each other. The test frame connected to at least two network devices in the network and continuously transmitted to one of the network devices from the other network device via the communication path. A test terminal for recording the number of frames transmitted and received, a network evaluation apparatus for instructing individual operations to a plurality of network devices and test terminals in a state connected to the network and the test terminal, and a plurality of Initial setting information required for the execution of relay operations using a redundancy protocol by network devices Initial setting means for establishing a communication path in the network by notifying each network device from the network evaluation apparatus, and the network evaluation apparatus to the test terminal in a state where the communication path is established in the network. Start instruction means for initiating recording of the number of test frames transmitted and received by the test terminal by instructing the start of the operation of continuously transmitting the test frames, and the number of test frames transmitted by the test terminal and In the process of recording the number of receptions, the network evaluation device instructs one of the network devices to generate a pseudo communication failure, thereby switching the communication path based on the redundancy protocol by a plurality of network devices. Occurrence indication means to start and the number of test frames transmitted recorded by the test terminal Characterized by comprising a measuring means for measuring the time switching of the communication path is required to complete based on the fine Received.

  According to the first invention, for example, STP (Spanning Tree Protocol) standardized by IEEE, RIP (Routing Information Protocol) standardized by RFC (Request For Comments), OSPF (Open Shortest Path), and OSPF (Open Short Path). Switching hub, layer 2 switch, layer 3 capable of implementing a redundant protocol such as a protocol originally developed by a communication device vendor such as Border Gateway Protocol (MMRP) or Multi Master Ring Protocol (MMRP) The performance of these network devices such as switches and routers can be evaluated efficiently. That is, the network evaluation device automatically notifies the initial setting information, the timing for starting the transmission of the test frame, and the timing for generating a pseudo communication failure, and the test terminal and each network device respond to this notification. Each operation is performed in conjunction. Therefore, during the measurement, they can realize an efficient operation as one system without human intervention. For this reason, for example, even if the measurement is performed a plurality of times for the redundancy protocol to be measured, this system always starts to operate at a constant timing and can efficiently measure the time required for switching the communication path. Thereby, the reliability of the evaluation obtained from the measurement result can be dramatically improved.

  According to a second aspect of the present invention, in the configuration of the first aspect, when the network device is compatible with a plurality of types of redundancy protocols, the initial setting means is provided for each type of redundancy protocol to be evaluated. The initial setting information is notified.

  According to the second invention, in addition to the operation of the first invention, in addition, for example, when a network device supports a plurality of types of redundancy protocols, initial setting information for each redundancy protocol to be evaluated is stored in advance. If stored in the network evaluation device, the network evaluation device can automatically install the initial setting information on the redundancy protocol to be evaluated on each network device. This makes it possible to automatically build a network based on the redundancy protocol to be evaluated without having to manually set each network device for each redundancy protocol to be evaluated. Can start. For this reason, even if it measures about the redundant protocol used as all the measuring objects, the work time as a whole can be reduced significantly.

  The network evaluation device may notify the initial setting information after each type of measurement is completed for each network device when performing measurement for a plurality of types of redundancy protocols.

  According to a third aspect of the present invention, there is provided a network for evaluating a network that forms a logically redundant communication path by connecting a plurality of network devices that perform a relay operation using a predetermined redundancy protocol. Evaluation device. The network evaluation apparatus issues an operation instruction to a test terminal connected to at least two network devices in the network, and continuously receives test frames from the test terminal toward one network device according to the instruction. Start instruction to start recording the number of test frames transmitted and received by the test terminal by causing the test terminal to receive the test frame from the other network device via the communication path By informing each network device of initial setting information necessary for executing a relay operation using a redundancy protocol by a plurality of network devices in advance prior to an instruction from the means and start instruction means for the test terminal, Initial setting means for establishing a communication path in the network and test using a test terminal In the process of recording the number of transmitted frames and the number of received frames, a failure occurrence instructing means for instructing any network device to generate a pseudo communication failure, and a test frame recorded by the test terminal. And measuring means for measuring the time required for switching the communication path due to the occurrence of a pseudo communication failure based on the number of transmissions and the number of receptions.

  According to the third invention, the network evaluation apparatus automatically notifies each condition of notification of initial setting information, timing for starting transmission of a test frame, and timing for generating a pseudo communication failure, and further measures From the result, it is possible to calculate the time required until the communication path is switched. Therefore, the operator does not need to input and operate a command for each of the above conditions, and it is only necessary to evaluate the performance of the network device from the calculated switching time. Therefore, the evaluation can be performed efficiently without depending on the skill level and experience of the worker.

  According to a fourth invention, in the configuration of the third invention, when the network device supports a plurality of types of redundancy protocols, the initial setting means is provided for each type of redundancy protocol to be evaluated. The initial setting information is notified.

  According to the fourth invention, in addition to the operation of the third invention, in addition, for example, when the network device supports a plurality of types of redundancy protocols, the initial setting information for each redundancy protocol to be evaluated is stored in advance. It can be stored in the network evaluation device. As a result, the initial setting information of the redundancy protocol necessary for the evaluation can be set in the network device. For this reason, it is not necessary for the operator to manually set the initial setting information about the redundancy protocol to be evaluated on the network device, so that the work time can be greatly reduced and the measurement can be performed efficiently. it can.

  The network evaluation device may notify the initial setting information after each type of measurement is completed for each network device when performing measurement for a plurality of types of redundancy protocols.

  According to a fifth aspect of the present invention, there is provided a network for evaluating a network that forms a logically redundant communication path by connecting a plurality of network devices that perform a relay operation using a predetermined redundancy protocol. It is a performance evaluation program executed by the evaluation device. The performance evaluation program includes a procedure for informing a network device of initial setting information necessary for executing a relay operation using a redundancy protocol by a plurality of network devices in advance, and a communication path in the network. In the state where is constructed, the test terminal connected to at least two network devices in the network is instructed to start the operation of continuously transmitting test frames to one of the network devices, and the test is performed. A procedure for instructing the test terminal to record the number of test frames transmitted and the number of test frames received from the other network device via the communication path, and the number of test frames transmitted by the test terminal, and In the process of recording the number of receptions, pseudo-communication to any network device A step of instructing the occurrence of a failure, to execute a step of measuring the time taken for the switching of the communication path is completed based on the transmission speed and the number of reception of the recorded test frames at the test terminal.

  According to the fifth aspect of the present invention, when the above-described performance evaluation program is used, each condition of the initial setting information, the timing for starting the transmission of the test frame, and the timing for generating the pseudo communication failure is automatically set. The time required until the communication path is switched based on the redundancy protocol can be efficiently measured. In addition, since the network evaluation apparatus executes each of the above conditions at a predetermined timing based on the program, for example, even if the measurement for the redundant protocol to be measured is performed a plurality of times, each of the above conditions is measured for each measurement. There is no variation in the timing of executing the. For this reason, it is possible to perform measurement with stable accuracy, and it is possible to dramatically improve the reliability of evaluation obtained from the result.

  According to a sixth aspect of the present invention, in the configuration of the fifth aspect of the invention, when the network device supports a plurality of types of redundancy protocols, the network evaluation apparatus is provided for each type of redundancy protocol to be evaluated. A procedure for notifying initial setting information is further executed.

  According to the sixth invention, in addition to the operation of the fifth invention, in addition, for example, when the network device supports a plurality of types of redundancy protocols, the initial setting information for each redundancy protocol to be evaluated is stored in advance. It can be stored in the network evaluation device. Thereby, it is possible to notify the network device of the initial setting information regarding the redundancy protocol necessary for the evaluation. For this reason, it is not necessary for the operator to manually set the initial setting information about the redundancy protocol to be evaluated on the network device, so that the work time can be greatly reduced and the measurement can be performed efficiently. it can.

  Note that, when measuring a plurality of types of redundancy protocols, the initial setting information may be notified to each network device after each type of measurement is completed.

  The seventh invention provides a network evaluation method. The network evaluation method of the present invention evaluates a network that forms a logically redundant communication path by connecting a plurality of communication devices that perform relay operations using a predetermined redundancy protocol. A network evaluation method to be performed, which includes the following steps [1] to [5].

[1] Step of installing a test terminal In this step, a test frame connected to at least two network devices in the network and continuously transmitted to one of the network devices is connected to the other via a communication path. A test terminal is provided for recording the number of test frames transmitted and received while receiving from the network device. Even if the test terminal is an existing one, the installation of the existing test terminal means that the step [1] is executed when the evaluation method is performed.

[2] Initial setting step In this step, a network evaluation device is connected to each of the network and the test terminal, and initial setting necessary for executing a relay operation using a redundancy protocol by a plurality of network devices by the network evaluation device. By notifying each network device of information, a communication path is constructed in the network.

[3] Start instruction step In this step, the test is performed by instructing the start of the operation of continuously transmitting test frames from the network evaluation apparatus to the test terminal in a state where the communication path is established in the network. Recording of the number of test frames transmitted and received by the terminal is started.

[4] Failure occurrence instruction step In this step, a pseudo communication failure is generated from a network evaluation device to any network device in the process of recording the number of transmissions and receptions of test frames by the test terminal. To start the communication path switching operation based on the redundancy protocol by a plurality of network devices.

[5] Measurement step In this step, the time required to complete the switching of the communication path is measured based on the number of transmissions and receptions of test frames recorded at the test terminal.

  According to the seventh invention, the network evaluation device automatically notifies the initial setting information, the timing for starting the transmission of the test frame, and the timing for generating the communication disconnection, and the test terminal and each network. The device can automatically execute each operation based on these conditions. Therefore, it is not necessary for the operator to input commands and give instructions to these devices during measurement, and the measurement can be performed efficiently.

  In addition, the timing at which each step is executed is always kept constant even when a plurality of measurements are performed, and the reliability of the evaluation obtained from the measurement results can be dramatically improved.

  According to an eighth aspect of the present invention, in the configuration of the seventh aspect, when the network device supports a plurality of types of redundancy protocols, the initial setting step is performed for each type of redundancy protocol to be evaluated in the network device. The initial setting information is notified.

  According to the eighth invention, in addition to the operation of the seventh invention, in addition, for example, when the network device supports a plurality of types of redundancy protocols, the initial setting information for each redundancy protocol to be evaluated is stored in advance. If stored in the network evaluation device, the network evaluation device can automatically install the initial setting information on the redundancy protocol to be evaluated on each network device. This makes it possible to automatically build a network based on the redundancy protocol to be evaluated without having to manually set each network device for each redundancy protocol to be evaluated. Can start. For this reason, even if it measures about the redundant protocol used as all the measuring objects, the work time as a whole can be reduced significantly.

  Note that, when measuring a plurality of types of redundancy protocols, the initial setting information may be notified to each network device after each type of measurement is completed.

  As described above, according to the network evaluation system, the network evaluation apparatus, the performance evaluation program, and the network evaluation method of the present invention, it is possible to automate the time required to switch the communication path based on the redundancy protocol, thereby improving the measurement efficiency. Improve network performance and evaluate network performance efficiently and accurately.

It is a figure which shows roughly the structural example of the network using the network evaluation apparatus in this embodiment. It is a figure which shows roughly the structure of the network at the time of performing a start instruction | indication and a failure generation instruction | indication with a network evaluation apparatus. It is a figure which shows the structure of the test frame schematically. It is a block diagram which shows roughly the functional structure of a network evaluation apparatus, a test terminal, and a network device. It is a flowchart which shows the process of the performance evaluation program performed by the network evaluation apparatus. It is a flowchart which shows the procedure of the initial setting process performed by a network device. It is a flowchart which shows the procedure of the communication failure generation process performed by a network device. It is a flowchart which shows the process which calculates the switching time of the communication path performed by the network evaluation apparatus. It is a figure showing the test result output to the file by the network evaluation apparatus.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following, the network evaluation apparatus and the performance evaluation program implemented in the network evaluation apparatus will be described with a focus on embodiments of the network device and the test terminal that are executed using the network evaluation apparatus and the test terminal. A combination of networks configured by network devices is an embodiment as a “network evaluation system”. The “network evaluation method” can be executed by using a network evaluation system and a network evaluation device, and at that time, the performance evaluation program is executed by the network evaluation device.

  FIG. 1 is a diagram schematically showing a configuration example of a network 4 using a network evaluation device 1 in the present embodiment. Here, the network evaluation apparatus 1 is used to configure a communication path based on the redundancy protocol to be evaluated with respect to the network 4, and the network evaluation system configuration using the network evaluation apparatus 1 and the test terminal 2 Will be described.

  The network evaluation device 1 and the test terminal 2 are each connected to the network 4. The network 4 includes a plurality of network devices 6, 8, and 10, which are connected to each other. The network evaluation apparatus 1 is also connected to the test terminal 2 and the network device 6, and the test terminal 2 is further connected to the network device 6 and the network device 8.

  Specifically, the network evaluation apparatus 1 is connected to the test terminal 2 via the transmission line 3 (network cable), and is connected to the port 6 a of the network device 6 via the transmission line 5. The test terminal 2 is connected to the port 6b of the network device 6 via the transmission line 7, and further connected to the port 8a of the network device 8 via the transmission line 9. In the network device 6, the port 6 c is connected to the port 8 b of the network device 8 via the transmission line 11, and the port 6 d is connected to the port 10 a of the network device 10 via the transmission line 13. In the network device 10, the port 10 b is connected to the port 8 c of the network device 8 through the transmission line 15.

  The network evaluation apparatus 1 is configured by a server, a PC (personal computer), or the like, for example. Further, the network evaluation apparatus 1 gives an instruction for each operation to the test terminal 2 and the network 4 in order to measure the time required for switching the communication path. The measured result is output to the storage device 26 as a measurement result file. In FIG. 1, for convenience, the storage device 26 is illustrated separately from the network evaluation device 1, but the storage device 26 may be a physical memory, a hard disk drive, or the like built in the network evaluation device 1. .

  The test terminal 2 is, for example, a dedicated device having a traffic generator function or a terminal such as a PC. The test terminal 2 transmits and receives the test frame 12 and records the number of transmissions and the number of receptions. The configuration of the test frame 12 will be described later in detail with reference to FIG.

  The network devices 6, 8, and 10 are network relay devices such as switching hubs, layer 2 switches, layer 3 switches, and routers, and are standardized by STP (Spanning Tree Protocol) and RFC (Request For Comments). Implementing a redundancy protocol such as RIP (Routing Information Protocol), OSPF (Open Shortest Path Fast), BGP (Border Gateway Protocol), or MMRP (Multi Master Ring Protocol) based on the network 4 A redundant communication path can be configured. In this embodiment, initial setting information is notified from the network evaluation apparatus 1 to the network devices 6, 8, and 10 in order to configure a communication path based on the redundancy protocol. The test frame 12 transmitted from the test terminal 2 is relayed by the network devices 6, 8, and 10 based on the redundancy protocol and transferred to the destination node. Hereinafter, the operation of the network evaluation system when notifying the initial setting information from the network evaluation apparatus 1 to the network devices 6, 8, and 10 will be described. The following description will also clarify an example of a network evaluation method.

[Installation of test terminals (installation process)]
Prior to the start of network evaluation, the network evaluation apparatus 1, the network 4, the test terminal 2, and the like are installed. These may be existing ones. In this case, the actual work to be installed can be omitted.

[Notification of initial setting (initial setting process)]
The network evaluation apparatus 1 stores in advance initial setting information for causing the network devices 6, 8, and 10 to execute frame relay based on the redundancy protocol to be evaluated. Specifically, the network device transmits a frame transmitted from the test terminal 2 such as setting information for causing each network device 6, 8, 10 to activate the redundancy protocol to be evaluated and an IP address (Internet Protocol address). Information necessary for transferring data 6, 8, and 10 is stored.

  The network evaluation apparatus 1 first transmits the above initial setting information to the port 6a of the network device 6 in order to measure the time required for switching the communication path. The initial setting information is also transmitted to the network device 8 and the network device 10 via the network device 6. Upon receiving the initial setting information, the network devices 6, 8, and 10 set necessary information for each port based on this information, and further construct a communication path based on the redundancy protocol.

  FIG. 2 is a diagram schematically showing a configuration of the network 4 when the network evaluation apparatus 1 executes a start instruction and a failure occurrence instruction. Based on the initial setting information notified from the network evaluation apparatus 1 shown in FIG. 1, a redundant communication path is configured in the network 4. Hereinafter, the configuration and operation of the network evaluation system when a start instruction and a failure generation instruction are notified from the network evaluation apparatus 1 to the test terminal 2 and the network 4 will be described.

[Start instruction (start instruction process)]
In FIG. 2, (A): Based on the initial setting information, a redundant communication path is configured in the network 4, and the frame transmitted from the test terminal 2 is received by the port 6 b of the network device 6. Then, the data is transferred from the port 6 c to the port 8 b of the network device 8. The test terminal 2 receives the test frame 12 from the port 8 a of the network device 8.

  When a redundant communication path is established in the network 4, the network evaluation device 1 transmits information for starting an operation of continuously transmitting the test frames 12 to the test terminal 2. Upon receiving the above information, the test terminal 2 starts transmitting the test frame 12 toward the port 6b. At this time, the test terminal 2 starts measuring the number of transmissions and receptions of the test frame 12. A white arrow shown in FIG. 2A indicates the direction in which the test frame 12 is transferred in the network 4.

[Failure occurrence instruction (Failure occurrence instruction process)]
2B: In the process in which the test terminal 2 continuously transmits the test frames 12, the network evaluation apparatus 1 causes the network device 6 to generate a pseudo communication failure at a predetermined timing. Send (instruct) information. This pseudo communication failure is, for example, information including a program for causing the network evaluation apparatus 1 to generate a communication failure in advance, and information on a target port (for example, port 6c) that causes the failure based on this program. Is stored. Specifically, the above information is transmitted to the port 6a of the network device 6 shown in FIG. Based on this information, the network device 6 causes a failure in the port 6c.

  When a communication failure occurs in the port 6c of the network device 6, the network devices 6, 8, and 10 execute switching of communication paths based on the redundancy protocol. At this time, the test frame 12 continuously transmitted from the test terminal 2 is discarded by the network device 6 that has received this until the switching of the communication path is completed. Therefore, the test terminal 2 cannot receive the test frame 12 until the switching of the communication path is completed. When the switching of the communication path is completed, the test frame 12 transmitted from the test terminal 2 is transferred from the port 6d of the network device 6 to the port 10a of the network device 10, and further from the port 10b of the network device 10 to the network device 8. Forwarded to port 8c. Then, the test terminal 2 receives the test frame 12 from the port 8a. A white arrow shown in FIG. 2B represents a communication path to which the test frame 12 is transferred after the switching of the communication path is completed.

[Measurement (measurement process)]
After the switching of the communication path is completed, the network evaluation device 1 records the test terminal 2 after the test terminal 2 starts transmitting the test frame 12 until the switching of the communication path is completed. The total number of discarded test frames 12 is calculated based on the number of transmissions and receptions of the test frames 12. Further, the time required until the communication path is switched is measured from the total number of discarded test frames 12. Note that the process of measuring the time required for the network evaluation device 1 to switch the communication path will be described in more detail later with reference to FIG.

[Test frame]
FIG. 3 is a diagram schematically showing the configuration of the test frame 12. The test frame 12 includes a MAC header, an IP header, and data, and is generated by the test terminal 2. The test terminal 2 measures the number of transmitted test frames 12 and the number of frames when it is received via the network 4. For convenience, the test frame 12 shown in FIG. 3 shows a part of the MAC header, a part of the IP header, and the data part.

  The test frame 12 can set a destination MAC address 12a and a source MAC address 12b in a part of the MAC header, and a source IP address 12c and a destination IP address 12d in a part of the IP header. Field. Furthermore, data for measurement of 64 bytes is set in the data 12e of the data portion.

  Further, the MAC address set in the transmission interface of the test terminal 2 is set in the source MAC address 12b, and the MAC address assigned to the port 6b of the network device 6 is set in the destination MAC address 12a. . In addition, the IP address set in the transmission interface of the test terminal 2 is set in the transmission source IP address, and the IP address set in the reception interface of the test terminal 2 is set in the destination IP address. Each network device 6, 8, and 10 transfers the test frame 12 by referring to the destination of each field based on the implemented redundancy protocol.

  FIG. 4 is a block diagram schematically showing a functional configuration of the network evaluation device 1, the test terminal 2, and the network devices 6, 8, and 10. Each functional configuration will be described below.

[Network evaluation equipment]
The network evaluation device 1 includes a control unit 14. The control unit 14 is an element that functions as a microcomputer, and includes a CPU 16 and a memory unit 18. The CPU 16 stores a program (performance evaluation program) for measuring the time required until the communication path in the network 4 is switched based on the redundancy protocol, and has an execution determination unit 20 and a performance measurement unit 22. is doing. The memory unit 18 has an initial setting information storage area 24. Further, the storage device 26 shown in FIG. 4 is shown separately from the network evaluation device 1 for convenience, but is stored in the control unit 14.

  The execution determination unit 20 holds information in which the number of times of measurement and the number of redundant protocols to be evaluated are set in executing this program. The performance measuring unit 22 also notifies the initial setting information, the procedure for notifying the test terminal 2 of the start of the operation of continuously transmitting the test frame 12, and the network devices 6, 8, and 10 The network evaluation apparatus 1 is caused to execute a procedure for notifying data that causes a general communication failure and a procedure for measuring the time taken to complete the switching of the communication path. Note that the processing of the program by the network evaluation apparatus 1 will be described in more detail later with reference to FIG.

  The memory unit 18 is configured by a memory device such as a hard disk, a ROM, or a RAM (not shown). The initial setting information storage area 24 stores setting information for starting the redundancy protocol for the network devices 6, 8, and 10, and IP addresses set for the respective ports of the network devices 6, 8, and 10. ing. Further, the storage device 26 stores information obtained by measurement such as the number of transmissions and receptions of the test frames 12 measured by the test terminal 2 and the calculated switching time in a file format, for example. The initial setting information storage area 24 stores setting information, an IP address, etc. for each type of redundancy protocol when the network devices 6, 8, and 10 are compatible with a plurality of types of redundancy protocols. Yes.

[Test terminal]
The test terminal 2 is configured by, for example, a PC (Personal Computer), and includes a control unit 28 as a component. The control unit 28 further includes a memory unit 30, a frame transmission unit 32, a frame reception unit 34, and a measurement unit 36.

  The memory unit 30 is configured by a memory device such as a ROM or a RAM (not shown), and stores the measured number of transmissions and receptions of the test frame 12. The frame transmission unit 32 includes a port (not shown), and transmits the test frame 12 to the port 6 b of the network device 6 connected to the port via the transmission line 7. When an instruction to start transmission of the test frame 12 is notified from the network evaluation device 1 to the test terminal 2, the test frame 12 is continuously transmitted from the frame transmission unit 32 toward the port 6b. A communication speed (for example, 2000 Frame / sec) is set in advance in the test terminal 2, and the test frame 12 is continuously transmitted at the communication speed described above. The frame receiving unit 34 includes a port (not shown), and receives the test frame 12 from the port 8 a of the network device 8. The recording unit 36 records the number of transmissions and receptions of the test frame 12 in, for example, a buffer memory.

[Network equipment]
The network devices 6, 8, and 10 are network relay devices such as a switching hub, L2 switch, L3 switch, and router, and include a control unit 38. The control unit 38 is computer hardware including a CPU (Central Processing Unit) (not shown), a memory device such as a ROM and a RAM, an input / output circuit, and the like, and transmits and receives frames based on various redundancy protocols. Do.

  The control unit 38 includes a memory unit 40, a frame reception unit 42, and a frame transmission unit 44. The memory unit 40 is a memory device such as a hard disk, ROM, or RAM (not shown), for example, and stores a program for executing a redundancy protocol in advance. In addition, when initial setting information is transmitted from the network evaluation device 1, the initial setting information is stored, or data transmitted from the network evaluation device 1 for causing a pseudo communication failure is stored. Based on the setting information included in the initial setting information stored in the memory unit 40, the control unit 38 activates a redundancy protocol to be evaluated and executes a process for establishing a communication path, or sets a specific port. For example, processing that causes a communication failure is executed. The memory unit 40 stores a program for executing each redundancy protocol when the network devices 6, 8, and 10 are compatible with a plurality of types of redundancy protocols.

  The frame reception unit 42 and the frame transmission unit 44 are interfaces of each port set based on the initial setting information in the network devices 6, 8, and 10. The frame receiving unit 42 receives the test frame 12 at the corresponding port. In addition, the initial setting information transmitted from the network evaluation device 1 and data for causing a communication failure are received. The frame transmission unit 44 transfers the test frame 12 from the corresponding port.

  As described above, when the processing of the command unit 20 programmed in the network evaluation apparatus 1 is executed, the network devices 6, 8, 10 and the test terminal 2 execute their respective operations. Therefore, since it is not necessary for the operator to directly input a command or the like to instruct the above operation, stable measurement can be performed without depending on the operator's experience and proficiency level.

[Performance evaluation program]
FIG. 5 is a flowchart showing the process of the performance evaluation program executed by the network evaluation apparatus 1. In the performance evaluation of a network device, the time required for switching the communication path is measured a predetermined number of times for one redundancy protocol, and is performed for the number of redundancy protocols that need to be evaluated. Hereinafter, it demonstrates along each procedure.

  Step S100: For example, the number of redundancy protocols to be evaluated is set in advance in the execution determination unit 20, and based on this, the execution determination unit 20 determines all the redundancy protocols to be evaluated. Determine whether the measurement is complete. When the measurement is completed for all the redundancy protocols (Yes), the performance evaluation program ends. When the above measurement is not completed (No), the network evaluation device 1 executes the next step S102.

  Step S102: The network evaluation device 1 notifies the initial setting information to the network devices 6, 8, and 10. When the network evaluation apparatus 1 notifies the initial setting information, the network evaluation apparatus 1 executes the next step S104.

  Step S104: The number of measurements to be performed for one redundancy protocol is set in advance in the performance measurement unit 22, and the network evaluation device 1 determines whether or not a predetermined number of measurements have been performed. When the test has been performed a predetermined number of times (Yes), the process returns to step S100 to sequentially start tests for the remaining redundant protocols to be evaluated. When the predetermined number of times have not been performed (No), the network evaluation device 1 determines the state of each port before the start of measurement for each of the network devices 6, 8, and 10 in a state where the communication path is switched. An instruction to restore the state is notified, the communication path in the network 4 is returned to the state before the start of measurement (initial state), and the next step S106 is executed.

  Step S106: The network evaluation device 1 notifies the test terminal 2 of an instruction to start transmission of the test frame 12. When executing the above notification, the network evaluation device 1 executes the next step S108. The test terminal 2 receives the notification and transmits the test frame 12 to the port 6b of the network device 6. At the same time, recording of the number of transmissions and the number of receptions of the test frame 12 is started.

  Step S108: The network evaluation device 1 executes a process of causing a pseudo communication failure to the network device 6 based on a predetermined timing. The communication failure occurrence processing in the network device 6 will be described in more detail later with reference to FIG. When the network evaluation apparatus 1 instructs the network device 6 to generate a failure, the network evaluation apparatus 1 executes the next step S110.

  Step S110: The network evaluation device 1 executes processing for measuring the time required for switching the communication path in the network 4. This process will be described later in more detail with reference to FIG. When the above time is measured, the network evaluation device 1 executes the next step S112.

  Step S112: The network evaluation device 1 stores the measured switching time in the storage device 26. Then, steps S104 to S112 are executed until a predetermined number of tests are completed for each type of redundancy protocol to be measured. The operator can browse the test results stored as a file in the storage device 26 using the network evaluation device 1 and can evaluate the performance of the network devices 6, 8, and 10 from the test results.

〔Initial setting〕
FIG. 6 is a flowchart showing a procedure of initial setting processing executed by the network devices 6, 8, and 10. When the initial setting information is notified from the network evaluation apparatus 1 to the network devices 6, 8, 10, the network devices 6, 8, 10 execute initial setting processing, respectively, A communication path based on the redundancy protocol is constructed. Hereinafter, it demonstrates along each procedure.

  Step S200: The network devices 6, 8, and 10 receive the initial setting information from the network evaluation device 1, and execute the next step S202.

  Step S202: The network devices 6, 8, and 10 start a program for executing the redundancy protocol to be evaluated stored in advance in the memory unit 30 based on the setting information included in the received initial setting information. . As a result, information for transferring the test frame 12 to each port of the network devices 6, 8, 10 is set (step S204).

  Step S206: When the network devices 6, 8, and 10 are ready to transfer the test frame 12 based on the above settings, the network devices 6, 8, and 10 end this processing.

[Failure occurrence instruction means]
FIG. 7 is a flowchart showing a procedure of communication failure occurrence processing executed by the network device 6. The processing of the test frame 12 by the network device 6 when the network device 6 is notified of a failure occurrence instruction from the network evaluation device 1 is shown. Hereinafter, it demonstrates along each procedure.

  Step S300: Upon receiving an instruction to generate a pseudo communication failure from the network evaluation apparatus 1, the network device 6 generates a communication failure at the port 6c based on this instruction. Moreover, the process which switches a communication path based on the redundancy protocol is performed. Note that the port for transferring the test frame 12 is switched from the port 6c to the port 6d for the network device 6 shown in FIG.

  Step S302: When the network device 6 receives the test frame 12 at the port 6b before the port is switched to 6d, the network device 6 discards the test frame 12 (step S404).

  Step S306: If the switching from the port 6c to the port 6d has not been completed (No), the network device 6 repeats the processing of Step S302 and Step S304 (No). When the switching of the communication path is completed (Yes), the network device 6 transfers the test frame 12 received at the port 6b from the port 6d to the port 10a of the network device 10 (step S308), and ends this process.

(Measuring means)
FIG. 8 is a flowchart showing a process for calculating a communication path switching time executed by the network evaluation apparatus 1. Hereinafter, it demonstrates along each procedure.

  Step S400: It is confirmed whether or not the recording of the test frame 12 is completed in the network evaluation device 1 and the test terminal 2. When the recording is completed (Yes), the next step S402 is executed. When the test is not completed (No), the network evaluation device 1 repeats this procedure. Regarding the procedure for confirming the completion, the time to be recorded in the network evaluation device 1 and the test terminal 2 is set in advance, and the number of frames recorded in the test terminal 2 is automatically uploaded when a predetermined time has elapsed. It may be measured from the information.

  Step S402: The network evaluation device 1 stores the total number of test frames 12 transmitted from the test terminal 2 in the memory unit 18.

  Step S404: The network evaluation apparatus 1 stores the total number of test frames 12 received by the test terminal 2 in the memory unit 18.

  Step S406: The network evaluation apparatus 1 calculates the total number of test frames 12 discarded by the network device 6 from the total number of the test frames 12 transmitted and received by the performance measuring unit 22. calculate.

  Step S408: The network evaluation apparatus 1 further calculates the time required until the communication path is switched based on the total number of the discarded test frames 12 and the communication speed in the performance measurement unit 22. And it returns to said measurement process (return) and outputs a calculation result to a file (step S112 in FIG. 5).

  FIG. 9 is a diagram illustrating a test result output to a file by the network evaluation device 1. For example, the operator can access the file from the test terminal 2 and display the test result on the display of the test terminal 2 to grasp the time required for switching the communication path for each redundancy protocol.

  The left column in FIG. 9 shows the type of redundancy protocol, and the second column from the left shows the number of tests for each redundancy protocol. Here, the test is performed three times for one redundancy protocol, and an average column is provided in the bottom row of the third row. The right column shows the transmission time of the test frame 12. Here, the transmission time is set to 60 sec for all tests.

  Further, the third and fourth columns from the left in FIG. 9 indicate the total number of test frames 12 transmitted by the test terminal 2 and the total number of received test frames 12, respectively. The sixth column from the left indicates the total number of test frames 12 discarded. Here, the difference between the number of transmitted test frames 12 and the number of received test frames 12 is calculated as the total number of discarded test frames 12.

  The fifth column from the left in FIG. 9 shows the communication speed of the test frame 12, which is set to 2000 Frame / sec. The seventh column from the left shows the switching time in the column. Here, a value obtained by dividing the total number of discarded test frames by the communication speed is calculated as the switching time.

  As described above, for all the redundant protocols to be measured, the total number of test frames 12 transmitted from the test terminal 2 while the test terminal 2 transmits the test frame and the communication speed are constant. Can be made constant. Therefore, the operator can easily grasp and evaluate the performance of the network devices 6, 8, and 10 for each redundancy protocol from the number of received frames, the number of discarded frames, and the switching time. Therefore, the test can always be performed under a certain condition without depending on the experience and proficiency level of the worker, so that the reliability of the test result can be improved.

  Further, for example, the operator does not need to operate the test terminal 2 while the test is being performed on the redundancy protocol that is the measurement target. For this reason, since the worker can browse and evaluate the test result of another redundant protocol that has already been performed, the overall work time can be greatly shortened.

  The present invention is not limited to the above-described embodiments, and can be implemented with various modifications without departing from the scope of the claims. For example, the test terminal 2 and the network devices 6, 8, 10 may communicate the test frame 12 not only in one direction but in both directions.

DESCRIPTION OF SYMBOLS 1 Network evaluation apparatus 2 Test terminal 4 Network 6, 8, 10 Network equipment 12 Test frame 14 (Network evaluation apparatus) Control part 28 (Test terminal) Control part 38 (Network equipment) Control part

Claims (8)

A network that forms a logically redundant communication path by connecting a plurality of network devices that perform a relay operation using a predetermined redundancy protocol, and
While receiving a test frame connected to at least two network devices in the network and continuously transmitted to one network device from the other network device via the communication path, the test frame A test terminal for recording the number of transmissions and the number of receptions respectively,
A network evaluation device that instructs each of the plurality of network devices and the test terminal in a state of being connected to the network and the test terminal;
The network evaluation device notifies the network devices of initial setting information necessary for executing a relay operation using the redundancy protocol by the plurality of network devices in advance, so that the communication path in the network Initial setting means for constructing
In the state where the communication path is established in the network, the network evaluation apparatus instructs the test terminal to start the operation of continuously transmitting the test frames, thereby the test by the test terminal. Start instruction means for starting recording of the number of transmissions and receptions of frames for use;
In the process of recording the number of transmissions and receptions of the test frame by the test terminal, the network evaluation device instructs any network device to generate a pseudo communication failure, A failure occurrence instruction means for starting a switching operation of the communication path based on the redundancy protocol by a plurality of network devices;
And a measuring means for measuring a time required until the switching of the communication path is completed based on the number of transmissions and receptions of the test frames recorded in the test terminal. Evaluation system. The network evaluation system according to claim 1,
The initial setting means includes
When the network device is compatible with a plurality of types of redundancy protocols, the network evaluation system notifies the initial setting information for each type of redundancy protocol to be evaluated. A network evaluation device that evaluates a network that forms a logically redundant communication path by connecting a plurality of network devices that perform a relay operation using a predetermined redundancy protocol,
An operation instruction is given to a test terminal connected to at least two network devices in the network, and a test frame is continuously transmitted from the test terminal to one of the network devices according to the instruction. Recording the number of transmissions and receptions of the test frames by the test terminal by causing the test terminal to receive the test frames from the other network device via the communication path. Start instruction means for starting;
Prior to instructing the test terminal from the start instructing means, notifying each network device of initial setting information necessary for executing a relay operation using the redundancy protocol by the plurality of network devices in advance. Initial setting means for constructing the communication path in the network,
In the process of recording the number of transmissions and receptions of the test frames by the test terminal, failure occurrence instructing means for instructing any of the network devices to generate a pseudo communication failure,
Measuring means for measuring the time required until the switching of the communication path is completed due to the occurrence of the pseudo communication failure based on the transmission number and the reception number of the test frames recorded in the test terminal; A network evaluation apparatus comprising: The network evaluation device according to claim 3,
The initial setting means includes
When the network device supports a plurality of types of redundancy protocols, the network evaluation apparatus notifies the initial setting information for each type of redundancy protocol to be evaluated. Executed by a network evaluation apparatus that evaluates a network that forms a logically redundant communication path by connecting a plurality of network devices that perform a relay operation using a predetermined redundancy protocol. A performance evaluation program,
In the network evaluation device,
A procedure for notifying the network device of the initial setting information necessary for executing a relay operation using the redundancy protocol by a plurality of network devices in advance;
In a state where the communication path is established in the network, a test frame is continuously transmitted to one of the network devices to a test terminal connected to at least two of the network devices in the network. Instructing the start of the operation to be performed and recording the number of test frames transmitted and the number of received test frames received from the other network device via the communication path at the test terminal, respectively. The steps to do
In the process of recording the number of transmissions and receptions of the test frames by the test terminal, a procedure for instructing any of the network devices to generate a pseudo communication failure;
A performance evaluation program that executes a procedure for measuring a time required to complete the switching of the communication path based on the number of transmissions and receptions of the test frames recorded in the test terminal. In the performance evaluation program according to claim 5,
In the network evaluation device,
A performance evaluation program for further executing a procedure for notifying the initial setting information for each type of redundancy protocol to be evaluated when the network device supports a plurality of types of redundancy protocols. A network evaluation method for evaluating a network that forms a logically redundant communication path by connecting a plurality of communication devices that perform a relay operation using a predetermined redundancy protocol,
While receiving a test frame connected to at least two network devices in the network and continuously transmitted to one of the network devices from the other network device via the communication path, Installing a test terminal for recording the number of test frames transmitted and received, respectively;
A network evaluation device is connected to each of the network and the test terminal, and initial setting information necessary for executing a relay operation using the redundancy protocol by the plurality of network devices is transmitted to each network device by the network evaluation device. An initial setting step for establishing the communication path in the network by notifying
In the state where the communication path is established in the network, the network evaluation apparatus instructs the test terminal to start the operation of continuously transmitting the test frames, thereby the test by the test terminal. A start instruction step for starting recording of the number of transmissions and receptions of frames for use;
In the process in which the number of transmissions and receptions of the test frames is recorded by the test terminal, the network evaluation apparatus instructs any of the network devices to generate a pseudo communication failure. A failure occurrence instruction step of starting a switching operation of the communication path based on the redundancy protocol by the network device;
A network evaluation step comprising: measuring a time required to complete the switching of the communication path based on the number of transmissions and receptions of the test frames recorded in the test terminal. Method. The network evaluation method according to claim 7,
The initial setting step includes
When the network device supports a plurality of types of redundancy protocols, the initial setting information is notified for each type of redundancy protocol to be evaluated in the network evaluation method.

Images