JP4500085B2 - Test support apparatus and test support method - Google Patents

Description

  The present invention relates to a test support apparatus and a test support method, and is particularly suitable for use in a system test in an application program development process.

  One of the system tests in the application program development process is that when the developed program is operated under the same conditions as the actual business environment, the development program itself operates normally, and there are no problems with other programs. There is a driving test to verify that it does not occur. As a result of the operation test, if it is determined that no particular problem occurs, the development program is incorporated into an actual business system that is already in operation (hereinafter referred to as a production system), or I was trying to replace it with a system.

  In recent years, since the importance of electronic information handled in business has increased, companies and the like transmit and receive the electronic information regardless of time. However, in the production system of the core system that processes basic business that supports daily corporate activities, there should be no temporary interruption or transmission / reception error. For this reason, the production system is generally configured so that electronic information is always exchanged smoothly between each department or each department.

  Therefore, when performing an operation test of the development program, it is required to minimize various influences on the production system. In order to meet such a demand, the operation test is performed without stopping the normal operation of the production system.

  That is, on the premise of the operation of the production system, a system that verifies that the developed program operates normally (hereinafter referred to as a test system) is operated in parallel with the so-called production system and the test system. The driving test (Parallan) was to be carried out.

  When performing the above parallel operation test, a message having the same content as the message sent from the existing computer of the production system to the other communication device is also sent to the test system, and the new computer and the pseudo partner device in the test system are sent. The above message is confirmed to be transmitted and received normally.

  As a result, in a test system, a transmission / reception test using data actually used in the production system can be performed, and a confirmation test in consideration of the operational status of the actual business in the production system should be performed in the test system. Is possible.

FIG. 4 is a block diagram showing a schematic configuration of a conventional test support system.
As shown in FIG. 4, the conventional test support system includes a production system 40 composed of an existing computer 41 and a counterpart communication device 42, and a test system 50 composed of a new computer 51 and a pseudo counterpart device 52. It is comprised by.

  In the conventional test support system configured as described above, when the production system 40 and the test system 50 are operated in parallel to perform an operation test for renewal of the old system, for example, the existing computer 41 The first transmission unit 413 for test system is provided to modify the transmission unit 411 and transmit to the test system 50. Further, the receiving means 412 of the existing computer 41 is modified, and a second test system transmission means 414 for transmitting to the test system 50 is provided.

  The first test system transmission means 413 duplicates a message (hereinafter referred to as a communication packet) transmitted from the transmission means 411 to the counterpart communication device 42, and passes the duplicated communication packet via the communication line 53. To the test system 50.

  Further, when the communication packet transmitted from the transmission unit 422 of the counterpart communication device 42 is received by the reception unit 412 of the existing computer 41, the second test system transmission unit 414 duplicates the communication packet. To the test system 50.

  On the other hand, the test system 50 is provided with a new computer 51 and a pseudo partner device 52. The new computer 51 has a receiving means 511 for receiving a communication packet, and for transmitting the communication packet to the pseudo partner device 52. Pseudo partner transmission means 512 is provided. Further, the simulated counterpart device 52 is provided with a receiving unit 521 for receiving a communication packet.

  The receiving unit 511 receives communication packets transmitted from the first test system transmission unit 413 and the second test system transmission unit 414, respectively. Further, the pseudo partner transmission unit 512 transmits the communication packet received by the reception unit 511 to the reception unit 521 of the pseudo partner device 52. By constructing such a configuration and executing parallel operation, the receiving means 511 and the pseudo-mate transmitting means 512 in the new computer 51 have the same functions as the transmitting means 411 and the receiving means 412 in the existing computer 41. Confirmation is being made.

  There are various techniques for duplicating and transferring a message (communication packet) addressed to a multicast group to all devices (nodes) participating in the multicast group connected to the network. It is disclosed (for example, Patent Document 1 or Patent Document 2).

JP 2002-314605 A JP 2002-118570 A

  However, in the parallel operation test between the production system and the test system, the message (communication packet) sent and received in the production system must be passed to the test system. There was a problem that had to be modified.

  In particular, when verifying that data transmission / reception is correctly performed between multiple transmission / reception devices, it is necessary to modify the data so that the corresponding data between each transmission / reception device can be transferred to a test system and a parallel operation test can be performed. In addition, there is a problem that the number of remodeling steps in the production system increases significantly.

  In addition, if a mistake occurs when modifying the production system, problems such as messages sent and received on the production system will not be transmitted and received normally, and this will have a significant impact on the performance of actual work. There was a problem.

  Furthermore, when performing a parallel operation test to replace the existing computer in the production system with the new computer in the test system, if the personnel are not assigned, the failure will occur in the new computer. There was a problem that it could not be detected reliably. That is, there has been a problem that the cause analysis of the trouble that has occurred in the newly installed computer cannot be performed efficiently unless a large number of human resources are invested.

Therefore, in view of the above-described problems, the present invention can perform a parallel operation test for replacing an existing computer in a production system with a new computer in a test system without much manpower. It is the first purpose to be.
A second object of the present invention is to perform the parallel operation test without changing the production system.

Test support apparatus of the present invention, between the existing computer running a production system system including a via a communication line connected existing computer and communication equipment, the new computer to operate by replacing the existing computer, a test support apparatus for supporting concurrent operation test under the same conditions as the actual business of production environment, is transmitted and received between the existing computer and the communication device via the communication line in the above production systems Capturing a communication packet and determining whether the communication packet is a transmission packet output from the existing computer or a reception packet input to the existing computer based on header information included in the communication packet When the captured communication packet is the transmission packet, the transmission packet is transmitted as a transmission packet storage medium. A first transfer unit that transfers to the network, and when the captured communication packet is the received packet, the header information included in the received packet is reset and copied, and the copied received packet is A capture means having a second transfer unit for transferring to a computer, a transmission packet captured by the capture means and stored in the transmission packet storage medium, and the duplicated reception packet by the new computer are processed and output. A comparison process for comparing the new communication packet with the operation result output from the existing computer and the operation result output from the new computer, and the comparison result by the comparison unit as a result of the comparison. When the operation result output from the computer differs from the operation result output from the new computer It is characterized by having an operation history storage means for storing operation history in the new computer.

The test support method of the present invention includes an existing computer that is operating in a production system composed of an existing computer and a communication device connected via a communication line, and a new computer that is operated in place of the existing computer. parallel operation test under the same conditions as the actual business operating environment a test support method executed by a computer in order to assist, and the existing computer and the communication device via the communication line in the above production systems Header information included in the communication packet whether the communication packet is a transmission packet output from the existing computer or a reception packet input to the existing computer Step based on the capture step and communication packets captured by the above capture step A first transfer step for transferring the transmission packet to a transmission packet storage medium when the packet is the transmission packet; and the header included in the reception packet when the communication packet captured by the capture step is the reception packet. A second transfer step for resetting and duplicating information, transferring the duplicated received packet to the new computer, the transmission packet captured in the capture step and stored in the transmission packet storage medium, and the new Comparison that compares the operation result output from the existing computer with the operation result output from the new computer by comparing the new received communication packet output by processing the received packet copied by the computer As a result of comparison between the step and the comparison step, If the operation result output from the operation result output from the computer and the new computer are different, it is characterized in that it has an operation history storing step of storing an operation history in the new computer.

  According to the present invention, as a result of comparing the operation result output from the existing computer operating in the production system with the operation result output from the new computer, the operation result output from each computer does not match. In this case, since the operation history of the new computer is stored, the trouble of the new computer can be reliably detected even if the parallel operation test is not always monitored manually. As a result, if a problem occurs, the cause can be pursued for all of them, and a parallel operation test between a production system and a test system that has been conducted with personnel (pararun). Can be performed unattended.

In addition, since a capture unit that captures information (communication packets) transmitted and received in the production system is provided, it is possible to perform an operation test on the new computer using the same information as that used in the production system. . This eliminates the need for preparing test data in the test system. In addition, since an operation test can be performed under the same conditions as the actual business operating environment, it is possible to check the operation (function) of the device with high accuracy.

  In addition, since it is possible to perform an operation test on a new computer without modifying the configuration of the production system, the production system can always be operated stably, and it is executed without being limited by time. Possible parallel operation test can be realized.

  Next, embodiments of the test support apparatus and the test support method of the present invention will be described with reference to the drawings.

  The present invention is applied to, for example, a test support apparatus 21 as shown in FIG. The test support apparatus 21 according to the present invention supports a parallel operation test between the production system 10 and the test system 20, and replaces the existing computer 11 of the production system 10 with the new computer 22 of the test system 20, and updates the old system. It is for performing. This will be described in detail below.

(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of a test support system including a test support apparatus 21 according to the first embodiment. As shown in FIG. 1, the test support system includes a production system 10 and a test system 20. The contents will be described below.

<Overall configuration of production system 10>
First, the production system 10 will be described.
As shown in FIG. 1, the production system 10 includes an existing computer 11 and a counterpart communication device 12 connected via a communication line 13 such as Ethernet (R). The existing computer 11 includes a first transmission unit 111 and a first reception unit 112, and the counterpart communication device 12 includes a second reception unit 121 and a second transmission unit 122. The communication packets are exchanged with each other.

  The communication packet generated by the existing computer 11 is transmitted from the first transmission unit 111 and is transmitted to the second reception unit 121 in the communication device 12 on the partner side via the communication line 13. On the other hand, a communication packet (for example, a reception response notification) generated by the communication device 12 on the other side is transmitted from the second transmission unit 122 and transmitted to the reception unit 112 of the existing computer 11 via the communication line 13. It is done.

<Overall configuration of test system 20>
Next, the test system 20 will be described.
As shown in FIG. 1, the test system 20 includes a test support apparatus 21 and a new computer 22 according to the present embodiment, which are connected to each other via a communication line. The test support apparatus 21 is connected to the production system 10 via a communication line 23 such as Ethernet (R).

-Configuration of the test support device 21-
The test support device 21 captures a communication packet transmitted and received between the existing computer 11 and the communication device 12 on the other side via the communication line 23 branched from the communication line 13 in the production system 10. 211, a transmission packet storage unit 212 for storing communication packets (transmission packets) output from the existing computer 11 to the counterpart communication device 12, communication packets (transmission packets) output from the existing computer 11, and the new computer 22 When the communication packet output from each computer is different as a result of the comparison by the output comparison unit 213 that compares the communication packet output from the computer and the output comparison unit 213, the operation history in the new computer 22 is stored. And an operation history storage unit 214 for controlling the operation. Here, the specific operation history includes a communication log, a task activation log / file input / output log, and the contents of an application file.

  The capture unit 211 also transmits a transmission packet capture unit 2111 that captures a communication packet (transmission packet) output from the existing computer 11 to the communication device 12 on the other side, and transfers the captured communication packet to the transmission packet storage unit 212. A transmission packet transfer unit 2113 that performs communication, a reception packet capture unit 2112 that captures a communication packet (reception packet) input from the communication device 12 on the other side to the existing computer 11, and transfers the captured communication packet to the new computer 22. A reception packet transfer unit 2114.

-Configuration of the new computer 22-
The new computer 22 receives the communication packet (received packet) transferred from the received packet transfer unit 2114 of the test support apparatus 21 via the communication line, and processes the received communication packet (received packet). Application 222, processing result output means 223 for outputting a communication packet newly generated by the application 222 to the test support apparatus 21, and an operation history storage instruction from the test support apparatus 21. An operation history acquisition unit 224 that acquires an operation history and an operation history storage unit 225 that stores the acquired operation history are provided.

<Operation of Test Support Device 21>
Next, the operation of the test support apparatus 21 according to this embodiment will be described.
FIG. 2 is a flowchart showing an operation procedure of the test system 20 including the test support apparatus 21 according to the embodiment of the present invention. In the following description, the operation procedure shown in FIG. 2 will be described in correspondence with each configuration of the test support system shown in FIG.

  First, as shown in FIG. 2, in the first step S201, transmission / reception is performed between the existing computer 11 of the production system 10 connected via the communication line 23 and the counterpart communication device 12 according to a predetermined communication protocol. The captured communication packet is captured by the capture unit 211.

  Subsequently, in step S202, the communication packet captured by the capture unit 211 is a communication packet (transmission packet) output from the existing computer 11 to the communication device 12 on the other side, or from the communication device 12 on the other side. It is determined whether it is a communication packet (received packet) input to the existing computer 11. As a result of the determination, if the communication packet captured in step S201 is a transmission packet, the process proceeds to step S203. On the other hand, if the result of determination in step S202 is that the communication packet captured in step S201 is a received packet, processing proceeds to step S205.

  Subsequently, in step S203, the transmission packet capture unit 2111 captures the communication packet (transmission packet) output from the existing computer 11. Subsequently, in step S204, the communication packet (transmission packet) captured in step S203 is stored and held in the transmission packet storage unit 212 via the transmission packet transfer unit 2113.

  On the other hand, in step S 205, the received packet capture unit 2112 captures the communication packet (received packet) input to the existing computer 11. Subsequently, in step S206, the communication packet (received packet) captured in step S205 is transferred to the new computer 22 via the received packet transfer unit 2114.

Here, a method for capturing a communication packet will be briefly described.
A communication packet transmitted from a certain device (for example, computer A) to another device (for example, computer B) via a communication line is first arranged in a form that facilitates communication according to a predetermined communication protocol. That is, a communication packet is generated by dividing data to be transmitted into an appropriate size and adding communication header information corresponding to a so-called parcel tag.

  At this time, header information for each protocol layer is added to the divided communication packet in a form preceding data to be actually exchanged. Specifically, for example, when an application program exchanges data (communication packets) using the TCP / IP protocol, the header information includes a TCP header, an IP header, and a data link layer header (for example, Ethernet ( R) header) is added.

  Normally, when a communication packet on the communication line 13 is transmitted to a destination specified by the header information, the communication packet is transmitted to all computers connected to the communication line 13. Then, the computer other than the destination considers that an unnecessary communication packet that is not addressed to itself has been sent, discards the received communication packet, and only the destination computer finally receives the communication packet. . As described above, based on the comparison of the header information, the communication packet is received only by the destination computer.

  Since communication packets are transmitted and received in this way, each computer receives all communication packets flowing through the communication line 13 if the destination address is not checked by comparing the header information added to the communication packets. It is possible. Further, if the header information of the communication packet is obtained, it is possible to check what kind of communication the communication packet flowing on the communication line 13 is communicating and to know the content of the communication packet.

The capture unit 211 uses a transmission method when obtaining the header information of the communication packet described above.
For example, in the present embodiment, header information (source address and destination address) for transmitting a communication packet from the existing computer 11 to the counterpart communication device 12 in the production system 10, and the counterpart communication device 12. Header information (a transmission source address and a destination address) for transmitting a communication packet to the existing computer 11 is notified to the capture unit 211 in advance.

  The capture unit 211 of this embodiment captures a communication packet when it is confirmed from the header information of the received communication packet that the communication packet is exchanged in the production system 10. Next, the capture unit 211 copies the captured communication packet, resets the destination address in the test support apparatus 21 and the new computer 22, and transfers the copied communication packet.

  Specifically, the transmission packet transfer unit 2113 adds the header information with the transmission packet storage unit 212 as the destination address to the transmission packet captured by the transmission packet capture unit 2111 and transfers the transmission packet. Similarly, the received packet transfer unit 2114 adds header information with the received packet receiving unit 221 as a destination address to the received packet captured by the received packet capture unit 2112 and transfers the received packet.

Here, the description will return to the flowchart of FIG. 2 again.
In step S206, the new computer 22 that has received the communication packet (received packet) transferred from the received packet transfer unit 2114 by the received packet receiving unit 221 continues to receive the received communication packet (received packet) in step S207. Processed by the application 222. Subsequently, in step S <b> 208, the new computer 22 outputs a communication packet newly generated as a result of processing by the application 222 to the test support apparatus 21 via the processing result output unit 223.

  In step S209, the output comparison unit 213 newly generates a communication packet (transmission packet) output from the existing computer 11 and stored in the transmission packet storage unit 212 and the application 222 of the new computer 22. Is compared with the transmitted communication packet.

  Subsequently, in step S210, it is determined whether or not the communication packet (transmission packet) output from the existing computer 11 matches the communication packet output from the new computer 22 as a result of comparison by the output comparison means 213. . If the communication packets output from the computers match as a result of this determination, the processing of this flowchart is terminated. On the other hand, as a result of the determination in step S210, if the communication packets output from the computers are different without matching, the process proceeds to step S211.

Subsequently, in step S211, the operation history storage unit 214 controls to store the operation history in the new computer 22.
Specifically, the operation history storage unit 214 instructs the new computer 22 to store the operation history. In response to this, the new computer 22 acquires the operation history of the device itself in the operation history acquisition unit 224 and stores the acquired operation history in the operation history storage unit 225.

  According to the test support apparatus 21 of the present embodiment, as a result of comparing the communication packet output from the existing computer 11 operating in the production system 10 with the communication packet output from the new computer 22, each computer 11 and 22 automatically saves the operation history of the new computer 22 when the communication packets output from the new computer 22 are different from each other. Therefore, the malfunction of the application 222 in the new computer 22 is reliably detected. At the same time, the cause of the problem can be pursued. As a result, it is possible to perform an unattended parallel operation test (pararun) between the production system and the test system, which could not be performed with a high degree of accuracy unless personnel are conventionally arranged.

  In addition, since the communication packet transmitted / received in the production system 10 is captured by the capture unit 211 via the communication line 23, the same communication packet (data) as that used in the production system 10 is used. An operation test of the new computer 22 can be performed. This eliminates the need for preparing test data in the test system 20. In addition, since an operation test can be performed under the same conditions as the actual business operating environment, it is possible to check the operation (function) of the device with high accuracy.

  In addition, since it is possible to perform an operation test of the new computer 22 without modifying the configuration of the production system 10, the production system 10 can always be operated stably and is limited in time. A parallel operation test that can be carried out without a failure can be realized.

(Second Embodiment)
FIG. 3 is a block diagram illustrating a schematic configuration of a test support system including the test support apparatus 31 according to the second embodiment. In addition, the same code | symbol is attached | subjected about the component which is common with respect to the test assistance apparatus 21 in 1st Embodiment, and detailed description is abbreviate | omitted.

  The test support system according to the present embodiment is provided with an operation history storage unit 215 for storing the operation history of the new computer 32 on the test support apparatus 31 side. Further, regarding the operation of the test support system in the present embodiment, the processing from step S201 to step S210 in FIG. 2 is the same as the processing of the test support system in the first embodiment, but the processing in step S211 is performed. The flow is different.

  Specifically, the new computer 32 that has received an instruction to save the operation history of the own device from the operation history storage unit 214 of the test support device 31 acquires the operation history of the own device in the operation history acquisition unit 224. . Then, the acquired operation history is transmitted to the test support apparatus 31. Upon receiving this, the test support apparatus 31 stores and holds the received operation history in the operation history storage unit 215.

  According to the test support apparatus 31 of the present embodiment, since the operation history of the new computer 32 is stored and held in its own device, in addition to the effects of the test support apparatus in the first embodiment described above, The load of the storage capacity due to the operation history being stored and held in the new computer 32 can be reduced.

  In the configuration of the test systems 20 and 30 in the first and second embodiments, the communication line 23 is configured as a separate line branched from the communication line 13, but the present invention is not limited to this. The same communication line 13 may be used.

(Another embodiment according to the present invention)
Each means constituting the test support apparatus in the first embodiment and the second embodiment described above, and each step of the test support method in the test system (step S201 to step S211 in FIG. 2) This can be realized by operating a program stored in a RAM, a ROM, or the like. This program and a computer-readable storage medium storing the program are included in the present invention.

  Specifically, the program is recorded on a recording medium such as a CD-ROM, or provided to a computer via various transmission media. As a recording medium for recording the program, a flexible disk, a hard disk, a magnetic tape, a magneto-optical disk, a nonvolatile memory card, and the like can be used in addition to the CD-ROM. On the other hand, as the transmission medium of the program, a communication medium (wired line such as an optical fiber, etc.) in a computer network (LAN, WAN such as the Internet, wireless communication network etc.) system for propagating and supplying program information as a carrier A wireless line or the like.

  Moreover, not only the functions in the first and second embodiments described above are realized by executing a program supplied by the computer, but also an OS (operating system) in which the program is running on the computer or When each function in the first and second embodiments described above is realized in cooperation with other application software, or all or a part of the processing of the supplied program is a function expansion board or function expansion of a computer Such a program is also included in the present invention when each function in the first and second embodiments described above is realized by a unit.

1 is a block diagram illustrating a schematic configuration of a test support system including a test support apparatus according to a first embodiment. It is a flowchart which shows the operation | movement procedure of the test type | system | group system containing the test assistance apparatus which concerns on embodiment of this invention. It is a block diagram which shows schematic structure of the test assistance system containing the test assistance apparatus in 2nd Embodiment. It is a block diagram which shows schematic structure of the conventional test assistance system.

Explanation of symbols

10 production system 11 existing computer 111 first transmission means 112 first reception means 12 partner communication device 121 second reception means 122 second transmission means 13 communication line 20, 30 test system 21, 31 test Support device 211 Capture means 2111 Transmission packet capture section 2112 Reception packet capture section 2113 Transmission packet transfer section 2114 Reception packet transfer section 212 Transmission packet storage section 213 Output comparison means 214 Operation history storage means 22 and 32 New computer 221 Reception packet reception means 222 Application 223 Processing result output means 224 Operation history acquisition means 215, 225 Operation history storage unit 23 Communication line

Claims (5)

The same conditions as the actual operating environment of the existing computer operating in the production system consisting of the existing computer and communication equipment connected via the communication line, and the new computer operating by replacing the existing computer A test support device for supporting a parallel driving test below,
Capture a communication packet transmitted and received between the existing computer and the communication device via the communication line in the production system, and the communication packet is a transmission packet output from the existing computer, or Whether the received packet is input to an existing computer is determined based on the header information included in the communication packet, and when the captured communication packet is the transmission packet, the transmission packet is transmitted as a transmission packet. A first transfer unit for transferring to a storage medium; and when the captured communication packet is the received packet, the header information included in the received packet is reset and copied, and the copied received packet is Capture means having a second transfer unit for transferring to the new computer;
A comparison is made between the transmission packet captured by the capture means and stored in the transmission packet storage medium, and the new communication packet output by processing the duplicated reception packet by the new computer, and the existing computer A comparison means for comparing the operation result output from the operation result output from the new computer,
As a result of comparison by the comparison means, when the operation result output from the existing computer and the operation result output from the new computer are different, operation history storage means for storing the operation history in the new computer;
A test support apparatus comprising:   The test support apparatus according to claim 1, wherein the operation history storage means stores the operation history in a storage medium provided in the new computer.   The test support apparatus according to claim 1, wherein the operation history storage unit stores the operation history in a storage medium provided in the test support apparatus itself. The same conditions as the actual operating environment of the existing computer operating in the production system consisting of the existing computer and communication equipment connected via the communication line, and the new computer operating by replacing the existing computer a test support method executed by a computer in order to assist the parallel operation test under,
Capture a communication packet transmitted and received between the existing computer and the communication device via the communication line in the production system, and the communication packet is a transmission packet output from the existing computer, or A capture step of determining whether the received packet is input to an existing computer based on header information included in the communication packet;
A first transfer step of transferring the transmission packet to a transmission packet storage medium when the communication packet captured by the capture step is the transmission packet;
When the communication packet captured by the capture step is the received packet, the header information included in the received packet is reset and copied, and the second transfer for transferring the copied received packet to the new computer Steps,
A comparison process is performed between the transmission packet captured in the capture step and stored in the transmission packet storage medium, and the new communication packet output by processing the received packet copied by the new computer, and the existing computer A comparison step for comparing the operation result output from the operation result output from the new computer,
As a result of comparison by the comparison step, when the operation result output from the existing computer is different from the operation result output from the new computer, an operation history storage step of storing the operation history in the new computer;
A test support method characterized by comprising:   5. The test support method according to claim 4, wherein the operation history storing step stores the operation history in a storage medium provided in the new computer.

Images