JP2002344448A - Device and method for testing network equipment, and program for making computer execute the same method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically execute highly precise verification, while conducting high-speed transmission and reception of mass data. SOLUTION: This network equipment testing device, having a transmission and reception interface connectable to equipment under test for testing the operation of the equipment under test, is provided with a test rule inputting means 1 for inputting a test rule, in which the matching elements of transmission data and reception data are preliminarily defined; a transmission data generating means 2 for generating transmission data according to a preliminarily defined transmission rule; a transmission means 3 for transmitting the transmission data to the equipment under test; a receiving means 4 for receiving and recording the reception data from the equipment to be asynchronously tested with the transmission of the transmission data; a verifying means 5 for verifying the reception data, by comparing the matching elements of the transmission data and the reception data in a prescribed retrieval range, and making the transmission data and the reception data correspond to each other; and a tested result outputting means 6 for outputting the verified result of the verifying means 5.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a network device testing apparatus, a network device testing method for testing network devices connected to a network and having a function of relaying communication, and a program for causing a computer to execute the method. It is about.

[0002]

2. Description of the Related Art The basic operation of a network relay device such as a router is such that a PDU (Protocol Data Unit) is received and a predetermined process such as distribution of an output path or rewriting of a PDU is performed according to the content of the received PDU. Thereafter, the PDU is transmitted again. In some cases, the network relay device may discard the received PDU or create a new PD to notify that the PDU has been discarded.
U may be created and returned to the sender. Where P
The DU is a group of data in a format defined by each communication protocol.

As a typical test method for a network relay device, a method of transmitting a PDU to a device under test using a protocol analyzer or the like and examining a response of the device under test has been generally known. Such a PDU
There are the following two methods for network device testing by transmission.

A first test method is a method of synchronizing the transmission and reception of PDUs. After transmitting one or several PDUs to a device under test, it waits for reception of a PDU from the device under test or a timeout to occur. After verifying the result, the next PDU is transmitted. This method has an advantage that the verification of the received PDU can be performed automatically and finely because the correspondence between the transmission and the result is clear. For example, Japanese Patent Application Laid-Open No. Hei 6-188952 discloses that a means for describing a test flow including transmission and reception of PDUs as a test scenario is provided, and a uniform means is provided for such a test.

[0005] A second test method does not synchronize transmission and reception of PDUs, and continuously transmits PDUs.
The reception process simply records a reception log, and verifies the log after all transmissions are completed. This method has the advantage that the transmission rate can be specified because the transmission and reception of PDUs are not synchronized.

[0006]

However, such a conventional method for testing network equipment has the following problems. The first test method is excellent in that verification can be performed automatically and finely, but since it is a method of synchronizing transmission and reception of PDUs, it must wait for reception for each transmission in a verifiable unit. Transmission speed is limited. For this reason, the first test method has a problem that a test for applying a speed load cannot be performed.

On the other hand, the second test method is excellent in that transmission and reception of PDUs are not synchronized, so that the transmission speed is not restricted. However, the PDU transmitted by the device under test is discarded or a PDU of a different form is transmitted. Since a reply may be made, it is difficult to make correspondence between the transmitted PDU and the log. If the data amount of the received PDU is small, the tester may verify the log visually, but if the data amount is large, the format inspection of the PDU that does not need to deal with the transmitted / received data in order to reduce the burden of visual verification There is a problem that must be stopped.

[0008] Depending on the type of test of the network relay device, there is a case where it is desired to transmit a large amount of PDUs at high speed and to correlate the received contents with the transmission data and to perform detailed verification. However, even with the first test method and the second test method, a large number of PDUs can be transmitted without being limited by the transmission rate.
There is a problem that automatic and detailed verification cannot be realized while transmitting and receiving.

[0009] The present invention has been made in view of the above,
An object of the present invention is to provide a network device test apparatus that can automatically perform high-accuracy verification while transmitting and receiving a large amount of data at high speed.

[0010]

In order to achieve the above object, a network device test apparatus according to the present invention has a transmission / reception interface connectable to a device under test and performs an operation test of the device under test. In the apparatus, a test rule input means for inputting a test rule in which a matching element between the transmission data and the reception data is defined in advance, transmission data generation means for generating transmission data in accordance with a predefined transmission rule, Transmitting means for transmitting to the device, receiving data from the device under test, receiving means for receiving and recording the data asynchronously with the transmission of the transmission data, and transmitting the transmission data within a predetermined search range and the matching element of the reception data. Receiving data verifying means for comparing the transmitted data with the received data by comparison and verifying the received data; A test result output means for outputting a verification result by the data verification unit, characterized by comprising a.

According to the present invention, the matching element between the transmission data and the reception data is defined in the test rule in advance. Here, the matching element is an element that can be a search key in the transmission data and the reception data, and is an element that is not changed by the device under test. According to the present invention, receiving reception data from a device under test asynchronously with transmission of transmission data,
Since the transmission data and the reception data are associated by comparing the matching elements, even when the data transmission and reception are asynchronous, highly accurate verification of the device under test can be automatically performed. Further, the transmission data to be associated with the reception data is searched only within a predetermined search range and is associated with the reception data. Therefore, even when the amount of data to be transmitted and received is large, the transmission order of the transmission data is not changed. By determining that the search range is based on the fact that the reception order of the received data is similar, automatic verification becomes possible. As described above, according to the present invention, even when a large amount of data is transmitted / received to / from the device under test, highly accurate verification of the device under test can be automatically performed.

[0012] In the network equipment test apparatus according to the next invention, in the above-mentioned invention, the received data verifying means, if the order of the received data is indeterminate, precedes the transmission data already associated with the received data. The transmitted data is set as a search range, and the transmitted data is associated with the received data.

According to the present invention, the transmission data transmitted before the transmission data already associated with the reception data is set as a search range, and the transmission data and the reception data are associated with each other. Even when the order of the received data is indefinite, the transmission data and the received data can be associated with each other, and a high-precision and automatic verification of the device under test can be performed using a large amount of transmitted / received data.

[0014] In a network device test apparatus according to the next invention, in the above invention, the transmission means transmits the transmission data at a predetermined transmission speed, and the reception data verification means transmits the transmission data. In parallel, the received data is verified.

According to the present invention, the received data verification means verifies the received data in parallel with the transmission of the transmission data, so that the processing performance of the network device test apparatus can be used efficiently and the test time can be reduced. Can be.

A network device test method according to the present invention is a network device test method for performing an operation test of a device under test connectable by a transmission / reception interface, wherein a test rule in which a matching element between transmission data and reception data is defined in advance is input. A test rule inputting step, and a transmitting step of transmitting the transmission data to the device under test,
A receiving step of receiving and recording the data received from the device under test asynchronously with the transmitting step, and comparing the matching elements of the transmitted data and the received data within a predetermined search range to determine the transmitted data and the received data. The method is characterized by including a reception data verification step of performing association and verification of reception data, and a test result output step of outputting a verification result by the reception data verification step.

According to the present invention, the received data is received from the device under test asynchronously with the transmission of the transmitted data, and the transmitted data and the received data are correlated by comparing matching elements. , The device under test can be automatically verified with high accuracy. Also,
The transmission data to be associated with the reception data is searched only within a predetermined search range and is associated with the reception data. Therefore, even if the amount of data to be transmitted and received is large, the transmission order of the transmission data and the reception data By determining that the search range is based on the fact that the order of reception is similar, automatic verification becomes possible. Therefore, according to the present invention, even when a large amount of data is transmitted / received to / from the device under test,
Highly accurate verification of the device under test can be performed automatically.

In the network device testing method according to the next invention, in the above-mentioned invention, the received data verifying step is performed before the transmitted data already associated with the received data when the order of the received data is not fixed. The transmitted data is set as a search range, and the transmitted data is associated with the received data.

According to the present invention, the transmission data transmitted before the transmission data already associated with the reception data is set as a search range, and the transmission data and the reception data are associated with each other. Even when the order of the received data is indefinite, the transmission data and the received data can be associated with each other, and a high-precision and automatic verification of the device under test can be performed using a large amount of transmitted / received data.

[0020] In a network device test method according to the next invention, in the above invention, the transmission step transmits transmission data at a predetermined transmission speed, and the reception data verification step is performed in parallel with the transmission step. Then, the received data is verified.

According to the present invention, since the received data verification step is performed in parallel with the transmission step, the processing time of the network device test apparatus can be efficiently used, and the test time can be reduced.

A program according to the next invention is a program for causing a computer to execute the network device test method according to any one of the above-described inventions,
The program becomes machine-readable, so that any one of the operations of the invention described above can be executed by a computer.

[0023]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of a network device test apparatus, a network device test method, and a program for causing a computer to execute the method according to the present invention will be described below in detail with reference to the accompanying drawings.

Embodiment 1 The network device test apparatus according to the first embodiment performs a test when the device under test does not change the order of received data with respect to transmitted data and does not change the format of transmitted / received data. FIG. 1 is a block diagram illustrating a configuration of a network device test apparatus according to Embodiment 1 of the present invention. As shown in FIG. 1, the network device test apparatus according to the first embodiment includes a test rule input unit 1, a transmission data generation unit 2, a transmission unit 3, a reception unit 4, a verification unit 5, and a test result output unit. Means 6.

The test rule input means 1 allows the test executor to specify a transmission rule, transmission data (PDU) and reception data (PDU).
, And input devices such as a keyboard and a mouse. The transmission rule, the association rule, and the verification rule are stored as test rules in a recording medium such as a hard disk in the network device test apparatus.

The transmission data generating means 2 generates transmission data (PDU) to be transmitted to the device under test according to a predetermined transmission rule. When the processing content of the device under test is mainly route distribution, there are a plurality of transmission routes from the test apparatus to the device under test. In this case, the transmission data generating means 2 transmits the transmission data as transmission data. The transmission path information is also generated.

The transmitting means 3 transmits the transmission data generated by the transmission data generating means 2 to the device under test. The receiving means 4 receives the transmission data (PDU) transmitted by the device under test and records the contents as a reception log on a recording medium such as a hard disk. When there are a plurality of reception paths from the device under test to the network device test apparatus, the reception path information is also included in the received data and recorded. Such transmitting means 3 and receiving means 4
Includes communication devices such as a LAN board and a modem.

The verification means (received data verification means) 5 associates the transmitted data with the received data according to the association rule in the test rules, verifies the data according to the verification rule, and records the result on a recording medium such as a hard disk. Things.

The test result output means 6 is for displaying the verification result recorded by the verification means 5 on a display or printing it on paper.

Next, a network device test method using the network device test apparatus configured as described above will be described. In the network device testing apparatus according to the first embodiment, the NUT on the IP network is used as the device under test.
We are testing AT equipment (network address translation equipment). It should be noted that the device under test is not limited to the NAT device, and another network relay device or another network device may be used as the device under test.

A PDU over IP is called a packet. FIG. 2 shows UD, a transport layer protocol over IP.
It is a data structure figure of the packet of P. As shown in FIG. 2, the UDP packet has a format in which an IP header is added at the beginning, a UDP header is added after the IP header, and data is stored at the end. The NAT device is located between two networks having different network address systems, and assigns an IP address and a port of a packet transmitted from one network to the other network.
It has the role of rewriting according to the sending network. Here, in the first embodiment, for the NAT device, the source address is 0x0A010000 to 0x0A0A.
When 655360 UDP packets are transmitted up to FFFF, the source addresses are respectively 0x8201000.
Suppose that it is expected to be converted from 0 to 0x820AFFFF.

The tester performs the test according to the following basic procedure. Hereinafter, the procedure of the network device test processing will be described along the flow of this procedure.

Step 1: Input test rules Step 2: Generate transmission data Step 3: Execute transmission / reception Step 4: Verify reception log Step 5: Output verification result

Procedure 1: Input of Test Rule FIG. 3 is an explanatory diagram showing an example of a test rule input by a tester in the network device test apparatus according to the first embodiment. As shown in FIG. 3, the test rule input to the network device test apparatus of the first embodiment includes a transmission rule (1), a transmission / reception data association rule (2), and a reception data verification rule (3). Is done.

The “transmission sequence” of the transmission rule (1) is as follows.
Indicates that the sequence with the specified name is transmitted. In the example of FIG. 3, a single sequence Seq1 is specified, but a plurality of sequences can be specified. The “sequence definition” of the transmission rule (1) includes a “sequence name” and a “number of transmissions”, and defines the contents of the sequence name and the number of transmissions. In the example of FIG. 3, the contents of the “sequence name” of Seq1 are defined, and the “number of transmissions” is S
The total number of packets transmitted as eq1 is 655360
It shows that it is an individual.

"IP / protocol" in transmission rule (1)
Specifies a packet transmission protocol.
In the example of FIG. 3, since the minimum value and the maximum value are both 17 (UDP) and the added value is 0, it means that the protocol of all the packets to be transmitted is 17.

The "IP / source address" of the transmission rule (1) indicates the range of the address of the source of the packet. The source address of the packet increases in order from the minimum value by the value specified by the added value and increases by the maximum value. Range up to the value. In the example of FIG. 3, the minimum value is 0x0A010000 and the maximum value is 0x0
A0AFFFF, the added value is +1. Therefore, the source address of the first packet is 0x0A0A0000, and the next packet is added to 0x0A0A0001 by one.
It means returning to 10,000. In this case, 0x0
Since 655,360 addresses equal to the number of transmissions are defined from A010000 to 0x0A0AFFFF, the last packet is 0x0A0AFFFF.
The “IP / destination address” indicates the destination address of the packet. Like the “source address”, the destination address of the packet is added in the range from the minimum value to the maximum value for each additional value. In the example of FIG. 3, 0x28010000 to 0x
Additions up to 280AFFFF are defined. This addition to the destination address is intended to use the destination address in an association rule described below. The “IP / source address” also differs among all PDUs, but since the source address is expected to be converted by the device under test, the “IP / destination address” that is not to be converted is searched using the search key. As the matching element in the present invention.

As described above, when the test apparatus according to the present invention is used, there must be at least one matching element which can be a search key. Therefore, in order to provide a search key, it is necessary to select an element that is not changed by the device under test from the transmission data (PDU) to be transmitted, and determine the value of the element to be different for all transmission data. is there. However, in many tests, it is not necessary to be able to freely define all elements of the data to be transmitted, and this is not a problem in practice. Default values are fixed for other elements for which rules are not defined.

The "transmission speed" of the transmission rule (1) is a transmission amount per unit time, and in the example of FIG. 3, specifies the number of packets to be transmitted per second. In addition, traffic characteristics and the like may be specified as transmission rules.

The "association condition" of the transmission / reception data association rule (2) expresses a condition to be satisfied between the corresponding transmission data and reception data using a packet element. In the example of FIG. 3, the packet elements are represented by connecting them with “•”, which has the following meaning. "Send",
"Receive" means "transmit packet" (transmit data),
Represents "received packet" (received data). A protocol name such as IP indicates a header of the protocol. The last element after the header is the "element name". For example, “reception / IP / destination address” indicates “destination address of IP header of received packet”. Therefore, in the example of FIG. 3, when the destination address of the IP header of the received packet and the destination address of the IP header of the transmitted packet match with the matching element as the destination address, the transmission data and the reception data are associated with each other. become.

The "condition for making the verification result OK" in the received data verification rule (3) expresses a condition that must be satisfied by correct received data using a packet element. FIG.
In the example, the route information is a predicted route, the source address of the received packet is the source address of the transmitted packet plus 0x78000000, and the checksum of the IP header is recalculated normally. Is specified as a condition.

Step 2: Generation of transmission data When the input of the test rule is completed, transmission data generation is executed. The transmission data generation means 2 generates packet data according to the transmission rules and stores the packet data in a recording medium such as a hard disk in the test apparatus.

Step 3: Execution of transmission / reception Transmission of the transmission data generated in step 2 and reception of traffic returned from the NAT device, which is the device under test, for transmission. The transmitting means 3 transmits the generated transmission data according to the traffic characteristics and speed specified as the transmission rule. Reception basically starts at the same time as transmission. When the reception is started, the receiving unit 4 waits for the reception of the packet, and records the received packets in the reception log in the order of reception.

Step 4: Verification of reception log When reception of the packet is completed, verification of the reception log is performed. FIG. 4 is a flowchart illustrating a procedure of a reception log verification process performed by the network device test apparatus according to the first embodiment.

The reception log verification processing is executed as a loop for all received packets (step 401). rx
Is the reception order of the received packet. The rx loop is in the order of reception in the first embodiment, but may be in the reverse order of the order of reception. However, in the case of the reverse order, it is necessary to search the transmission data in the reverse order by the association described later.

In the process for each received packet, a search range of the transmitted packet to be searched for the received packet is first determined in order to associate the received packet with the transmitted packet (step 402). FIG. 5 is an explanatory diagram illustrating an example of the correspondence between a transmission packet and a reception packet. In this embodiment, it is assumed that the order of the received data with respect to the transmitted data is not out of order.
The transmission order and the reception order have a very similar relationship, for example, as shown in “Actual correspondence” in FIG. The line connecting the received packet and the transmitted packet shown in FIG. 5 indicates that they are in a corresponding relationship. At t4, t7, and t12, there is no corresponding received packet because they were discarded by the NAT device. In this data, it is assumed that a transmission packet corresponding to r5 is being searched. Last search r4
If the position of the corresponding received packet is last, the reception order does not change.
The search may be started from st + 1, that is, from the sixth packet. In addition, since the difference between the reception order and the transmission order between the corresponding reception packet and the transmission packet is the difference between the transmission number and the reception number at the maximum, r5 is set to (reception order) 5 (transmission number and reception number). (Difference of 3) up to the eighth packet t8. As described above, the search target transmission packet range determination process (step 402) determines the search range based on the following criteria.

Search range minimum value: last + 1 Search range maximum value: Received packet order currently being processed + (transmission number−reception number)

Assuming that all transmission data (PDUs) are to be searched for all reception data (PDUs), the number of searches increases in proportion to the square of the number of data transmissions. However, by dividing the search range in this way, it is possible to suppress the number of searches substantially in proportion to the first power of the number of transmissions. The number of searches becomes enormous by this method when the number of discarded packets is close to one half of the number of transmissions and the probability of association failure is high. In such a case, it is considered that the association rule is not appropriate, so that it is not considered.

Then, it is determined whether or not the search range determined as described above is valid. Specifically, it is assumed that the search range is valid when the search start position of the transmission packet is equal to or less than the number of transmission packets. Next, the following association comparison processing is performed on transmission packets within the search range in order from the pocket having the minimum search range (step 404).

In the transmission / reception packet association comparison process, each transmission packet in the search range t6 to t8 is
In accordance with the transmission / reception data association rule (2) shown in (1), it is checked whether or not the destination address which is the matching element matches the destination address of the received packet r5 (steps 405 and 4).
06). As a result, when the transmission packet t6 satisfies the matching condition with respect to r5, the number of the reception packet (reception order) for the transmission packet is recorded as the verification result in the association result recording process. Also, in preparation for processing for the next received packet, last indicating the last transmitted packet matched
Is updated (step 407).

If none of the transmitted packets in the search range satisfy the corresponding condition, the received packet number is recorded as an unsupported received packet (step 413).

In the verification process, it is verified whether or not r5 is a received packet as expected with respect to t6 (steps 408 and 409). FIG. 6 is a data structure diagram showing the contents of the transmission packet t6 and the reception packet r5. When the received data verification rule (3) is defined as shown in FIG. 3, the first condition is that the source address of r5 and the source address of t6 match. Is determined to be satisfied.

Source address of r5 0x8201000
0 Source address of t6 0x0A010000 + 0x78
000000 = 0x8200000

The second condition of the received data verification rule (3) is that the IP header checksum of the received packet is correct. The checksum is recalculated from the contents of r5, and if it matches the checksum of r5, it is determined to be correct. When the verification processing is completed, if the verification results of all the conditions are OK, it is recorded as the verification result OK (step 410). Conversely, if there is even one NG, it is recorded as a verification result NG. If the verification result is NG, error information and the like are stored (step 411).

As a result of performing the above processing on all the received packets, r1 to r7 are normally associated with the transmitted packet, the verification result is OK, the verification result is r8, the verification result is NG, and the r9 is r9. Assume that the transmission packet could not be correlated. FIG. 7 shows an example of the verification result left in this case. The verification result is recorded for all the transmitted data regardless of the correspondence. In addition, the reception order of the received data that does not correspond to the transmission data is recorded.

Step 5: Verification Result Output The result in step 4, the transmission data and the reception log are combined, and the verification result information is output to the test result output means 6 according to the purpose and the data amount.

By using the verification result by the network device testing apparatus of the first embodiment, the tester can perform the correspondence between the transmitted and received data by the number recorded in the unsupported received packet. well,
As for the determination of the test result, only the NG portion of the verification result needs to be determined. Especially in the durability test,
Since the amount of transmitted data is large and verification NG does not occur in many cases, if only the verification result NG is extracted and the result is output, the test can be performed only by confirming that there is no output. Can greatly improve efficiency.

Embodiment 2 The network device test apparatus according to the first embodiment performs a test when the device under test does not change the order of the received data with respect to the transmitted data and does not change the format of the transmitted / received data. The network device test apparatus performs a test when the order of received data with respect to transmitted data is not fixed. The configuration of the network device test apparatus, the basic procedure of the test processing, and the procedure of the verification processing according to the second embodiment are the same as those of the apparatus according to the first embodiment, and thus detailed description is omitted.

FIG. 8 is an explanatory diagram showing an example of correspondence between a transmission packet and a reception packet transmitted and received by the network device test apparatus according to the second embodiment. In the present embodiment, since the order of the received data with respect to the transmitted data is undefined,
As shown in the “actual correspondence” of FIG. 8, the relationship between the transmitted and received packets does not always correspond to the order of reception of the received packets and the order of transmission of the transmitted packets.

In this data, it is assumed that a transmission packet corresponding to r5 is being searched. It is also assumed that the position of the corresponding received packet of r4 for which the search was completed last is last. In the first embodiment, the minimum value of the search range is l
In the second embodiment, last-1 needs to be within the search range in order to obtain the corresponding transmission packet of r5. Since the range of the delay of the received packet differs depending on the characteristics of the device under test, the network device test apparatus according to the present embodiment uses “the maximum number of received packet delays” as the association rule in the test rule.
Is defined. The maximum number of received packet delays may be specified by the number of packets that may be skipped in the transmission order of the transmitted packets and the corresponding packet is delayed. A search at the time of association is performed. FIG. 9 is an explanatory diagram illustrating an example of a test rule input to the network device test apparatus according to the second embodiment. Transmission / reception data association rule (2) in FIG.
As shown in (1), when the maximum number of received packets is designated as n, the search range in the association is as follows.

The minimum value of the search range: last-n The maximum value of the search range: the order of the received packets currently being processed + (the number of transmissions−the number of receptions) + n However, when the maximum delay number of the reception packet ≧ 1, the maximum delay number of the reception packets When = 0, the search range of the association is assumed to be the same as in the first embodiment.

FIG. 10 is an explanatory diagram showing a verification result when the transmission / reception packet shown in FIG. 8 is verified. FIG.
(2) is a verification result when the transmission / reception packet of FIG. 8 is associated with the search range in the test method of the second embodiment, and FIG. 10 (1) shows the transmission / reception packet of FIG. 9 is a verification result when association is performed within the search range according to the first embodiment. As can be seen from FIG. 10A, in the case where the association is performed within the search range in the first embodiment, r2 and r5 are received packets whose association is unknown. On the other hand, in the network device test apparatus according to the second embodiment, if the maximum delay number of the received packet is designated as 1, r2 and r5 can be associated with each other.
It can be seen that a more accurate verification result can be obtained as shown in FIG.

Embodiment 3 The network device test apparatus according to the first and second embodiments performs a test on a device under test that does not change the format of transmission data and reception data. The test is performed on a device under test that may change the format of the transmission data. The configuration of the network device test apparatus according to the third embodiment, the basic procedure of the test processing, and the procedure of the verification processing are the same as those of the apparatus according to the first embodiment, and thus detailed description will be omitted.

The network device test apparatus according to the third embodiment tests a router (a device that performs IP routing) as a device under test. FIG. 11 is a data structure diagram of a transmission packet (same as the transmission packet of FIG. 6) transmitted from the network device test apparatus to the router and a reception packet received from the router. When the routing of the transmission packet fails, the router notifies the network equipment test apparatus, which is the transmission source of the transmission packet, of the fact that the packet routing has failed.
There is a possibility that an MP packet (the received packet in FIG. 11) is returned. The ICMP packet is configured such that a transmission packet causing a routing failure is added after the ICMP header.

FIG. 12 is an explanatory diagram of a test rule input to the network device test apparatus according to the third embodiment. As described above, in the third embodiment, there is a possibility that the transmission data transmitted to the router receives the ICMP packet added as another element as reception data. Therefore, according to the test rule input to the network device test apparatus of the third embodiment, the same item of the transmission packet and the reception packet is not set as the matching element, but an element different from the element of the transmission packet is associated as the matching element. I have. That is, FIG.
2, the destination address of the received packet and the 65-7
The transmission data and the reception data are associated when the destination address and the data in the 65th to 72nd bytes of the ICPM packet match with each other by associating the data of the second byte with the corresponding element.

In a test for the same router, if the transmitted packet is either successfully routed and transmitted to another route, or if it fails and an ICMP packet is returned, Data validation rules (3)
In the above, a plurality of conditions for making the verification result OK may be provided, and each condition may be described by an OR condition. FIG. 13 shows an example of a test rule in this case.

As described above, in the network device testing apparatus according to the third embodiment, as a test rule, the element of the transmission data and the element of the reception data of a different format are described as matching elements and input, so that the equipment under test is Even when a PDU having a format different from that of the transmission data is returned, automatic verification can be performed with high accuracy.

Embodiment 4 The network device test apparatus according to the first to third embodiments tests a device under test that performs data transmission without depending on the reception order of transmission data. The apparatus performs a test on a device under test that changes reception data depending on the reception order of transmission data. The configuration of the network device test apparatus, the basic procedure of the test processing, and the procedure of the verification processing according to the fourth embodiment are the same as those of the apparatus according to the first embodiment, and a detailed description thereof will be omitted.
The network device test apparatus according to the fourth embodiment tests a NAT device as a device under test.

The conversion method of the NAT device to be tested by the network device test device of the fourth embodiment is such that the conversion method is statically determined for the IP address as in the device under test of the first embodiment. (For example, 0x0A0A00
00 is not always converted to 0x820A0000), but an IP address or the like is dynamically allocated sequentially in the order in which the device under test actually received. Therefore, the input test rules are different from the test rules input to the network device test apparatuses of the first to third embodiments.

FIG. 14 is an explanatory diagram showing an example of a test rule input to the network device test apparatus according to the fourth embodiment. As shown in FIG. 14, the following conditions are described in the received data verification rule of the test rule input to the network device test apparatus of the fourth embodiment as conditions for making the verification result OK.

Receive / IP / source address = 0x820
10000 + rx (rx: reception order) That is, 0x8201000
By adding the reception order rx of the transmission data from the network device test device in the NAT device to 0, N
Verification is performed in response to dynamic assignment of IP addresses and the like by AT devices. Here, instead of the transmission order tx of the transmission data from the network device test apparatus, the reception order r
The reason for using the condition x is that there is a possibility that the packet is discarded by the NAT device.

As described above, in the network device test apparatus according to the fourth embodiment, the test rule describes and inputs the verification rule using the reception order of the transmission data in the NAT device, so that the device under test depends on the reception order. In this case, automatic verification can be performed with high accuracy.

Embodiment 5 In the network device test apparatus of the first to fourth embodiments, it is expected that the analysis time of the reception log will be about the same as or longer than the transmission time of the data (PDU) to the device under test. In the network device test apparatus according to the fifth embodiment, since the processing load may not be applied to the data transmission depending on the contents of the test, the transmission of the transmission data and the verification processing of the reception log are performed in parallel. The configuration of the network device test apparatus, the basic procedure of the test process, and the input test rule of the fifth embodiment are the same as those of the first embodiment, and therefore detailed description is omitted.

In the network device test apparatus according to the fifth embodiment, the transmitting means 3 updates the “current number of transmissions” for each data transmission when transmitting data to the device under test,
When all data transmission is completed, the “transmission completion time” is recorded on a storage medium such as a hard disk. It is assumed that the current number of transmissions and the transmission completion time are recorded in a format and a method that can be referred to by the verification unit 5. Receiving means 4
Records the received packets as a received log on a storage medium such as a hard disk in the same manner as in the first embodiment.

FIG. 15 is a flowchart showing a procedure of a reception log verification process by the network device test apparatus according to the fifth embodiment. The reception log verification processing is executed as a loop for all received packets (step 1501,
1502). rx is the reception order of the received packet.

In the network device test apparatus according to the fifth embodiment, since the reception log is analyzed in a state where transmission is not completed, there is a possibility that a received packet to be verified has not been received. Therefore, before starting the processing of the next received packet, it is determined whether or not the packet has been received (step 1503). If the result of this determination is that the packet has not been received, it waits for reception.However, since there is a possibility that it takes time to receive the next packet and there is a possibility that transmission and reception of all packets have been completed, the transmission completion time is fixed. It is determined whether time has elapsed (step 1504). If the predetermined time has elapsed, it is determined that the reception has been completed, and if it cannot be determined that the reception has been completed,
After waiting for a predetermined time (step 1505), reception is confirmed again (step 1503). As a result, transmission of transmission data and verification of the reception log can be performed in parallel.

The subsequent steps 1506 to 1518, such as determination of the search range of transmission data, association processing of transmission data with received packets, and reception log verification processing, are performed by the network device test apparatus of the first embodiment. This is the same as the processing of steps 402 to 414 in FIG.

As described above, in the network device test apparatus according to the fifth embodiment, transmission of transmission data and verification of the reception log can be performed in parallel, so that the processing time of the apparatus is efficiently used and the test time is reduced. It becomes possible.

In the first to fifth embodiments, the NAT device and the router are used as the devices to be tested. However, the present invention is not limited to this. Can be tested.

[0080]

As described above, according to the present invention, even when a large amount of data is transmitted / received to / from the device under test, it is possible to automatically perform highly accurate verification of the device under test. Play.

According to the next invention, even when the order of the received data from the EUT to the transmitted data is not fixed, it is possible to associate the transmitted data with the received data, and to use a large amount of transmitted / received data. Thus, it is possible to perform highly accurate and automatic verification of the device under test.

According to the next invention, there is an effect that the test time can be shortened by efficiently using the processing performance of the network device test apparatus.

According to the next invention, even when a large amount of data is transmitted / received to / from the device under test, it is possible to automatically perform highly accurate verification of the device under test.

According to the next invention, even when the order of the received data from the device under test with respect to the transmitted data is uncertain, it is possible to associate the transmitted data with the received data, and to use a large amount of transmitted / received data. Thus, it is possible to perform highly accurate and automatic verification of the device under test.

According to the next invention, there is an effect that the test time can be shortened by efficiently using the processing performance of the network device test apparatus.

According to the next invention, there is an effect that any one of the operations of the above invention can be executed by a computer.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a network device test apparatus according to Embodiments 1 to 5 of the present invention.

FIG. 2 is a data structure diagram of a UDP packet used in the network device test apparatus of the first embodiment shown in FIG.

FIG. 3 is an explanatory diagram showing an example of a test rule input by a tester in the network device test apparatus according to the first embodiment shown in FIG.

FIG. 4 is a flowchart illustrating a procedure of a reception log verification process by the network device test apparatus according to the first to fourth embodiments illustrated in FIG. 1;

FIG. 5 is an explanatory diagram illustrating an example of correspondence between a transmission packet and a reception packet in the network device test apparatus according to the first embodiment illustrated in FIG. 1;

FIG. 6 is a data structure diagram showing contents of a transmission packet and a reception packet in the network device test apparatus of the first embodiment shown in FIG.

FIG. 7 is an explanatory diagram illustrating an example of a verification result by the network device test apparatus according to the first embodiment illustrated in FIG. 1;

FIG. 8 is an explanatory diagram showing an example of correspondence between a transmission packet and a reception packet transmitted and received by the network device test apparatus according to the second embodiment shown in FIG.

FIG. 9 is an explanatory diagram showing an example of a test rule input to the network device test apparatus according to the second embodiment shown in FIG.

FIG. 10A is an explanatory diagram illustrating a verification result when the transmission / reception packet of FIG. 8 is associated with a search range of the network device test apparatus according to the first embodiment;
FIG. 10B is an explanatory diagram illustrating a verification result when the transmission / reception packet in FIG. 8 is associated with a search range in the network device test apparatus according to the second embodiment.

FIG. 11 is a data structure diagram of a transmission packet transmitted from the network device test apparatus of the third embodiment shown in FIG. 1 to the router and a reception packet received from the router.

FIG. 12 is an explanatory diagram showing an example of a test rule input to the network device test apparatus according to the third embodiment shown in FIG.

FIG. 13 is an explanatory diagram illustrating another example of the test rule input to the network device test apparatus according to the third embodiment illustrated in FIG. 1;

FIG. 14 is an explanatory diagram showing an example of a test rule input to the network device test apparatus according to the fourth embodiment shown in FIG.

FIG. 15 is a flowchart illustrating a procedure of a reception log verification process performed by the network device test apparatus according to the fifth embodiment.

[Explanation of symbols]

1 test rule input means, 2 transmission data generation means, 3 transmission means, 4 reception means, 5 verification means, 6 test result output means.

Claims (7)

[Claims] 1. A network device test apparatus having a transmission / reception interface connectable to a device under test and performing an operation test of the device under test, comprising: a test for inputting a test rule in which matching elements of transmission data and reception data are defined in advance. Rule input means, transmission data generation means for generating transmission data according to a transmission rule defined in advance, transmission means for transmitting the transmission data to the device under test, reception data from the device under test, Receiving means for receiving and recording asynchronously with the transmission, and comparing the matching elements of the transmission data and the reception data within a predetermined search range to associate the transmission data with the reception data;
A network device test apparatus, comprising: reception data verification means for verifying reception data; and test result output means for outputting a verification result by the reception data verification means. 2. The reception data verification unit according to claim 2, wherein, when the order of the reception data is undefined, the transmission data transmitted before the transmission data already associated with the reception data is used as a search range. 2. The network device test apparatus according to claim 1, wherein the network device test apparatus associates the data with data. 3. The transmission means transmits the transmission data at a predetermined transmission speed, and the reception data verification means verifies the reception data in parallel with the transmission of the transmission data. The network device test apparatus according to claim 1, wherein: 4. A network device test method for performing an operation test of a device under test connectable by a transmission / reception interface, wherein: a test rule input step of inputting a test rule in which a matching element between transmission data and reception data is defined in advance; A transmitting step of transmitting data to the device under test; a receiving step of receiving and recording received data from the device under test asynchronously with the transmitting step; and a step of matching the transmitted data and the received data within a predetermined search range. Compare the elements and associate the transmitted data with the received data,
A network device test method, comprising: a received data verification step of verifying received data; and a test result output step of outputting a verification result of the received data verification step. 5. The received data verifying step, wherein when the order of the received data is indeterminate, the transmission data transmitted before the transmission data already associated with the received data is set as a search range and the transmission data and the reception data are checked. 5. The network device test method according to claim 4, wherein the network device test method is associated with data. 6. The transmission step of transmitting transmission data at a predetermined transmission speed, and the reception data verification step performs verification of reception data in parallel with the transmission step. The network device test method according to claim 4, wherein: 7. A program for causing a computer to execute the network device test method according to claim 4.