JP2007026360A - Test support method and device thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform support in order to efficiently or promptly perform operation verification of a computer system which at least performs processing based on input data. <P>SOLUTION: When verification results are considered as appropriate, input data this time is stored in an authorization data DB 88 as authorization data. Input data which can be an object in the computer system is collected by a coverage pattern generator 81 and stored in a coverage pattern DB 82. A coverage ratio calculator 89 calculates ratio of the number of pieces of authorized data to the number of pieces of input data which can be the object in the computer system as coverage ratio and uses the coverage ratio for excess and deficiency decision of a test case or test data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a test support method and apparatus capable of supporting efficient and prompt operation verification of a computer apparatus that performs at least processing based on input data, and these methods and The present invention relates to a computer program related to an apparatus.

  In general, when the validity of the operation of a computer system is verified, all possible value patterns of generated data are previously identified, test data corresponding to each pattern is created, and this is given to the computer system. Thus, verifying that all operating results are valid proves that the computer system operates normally in all cases.

  Here, it is very difficult to extract test data and test cases assuming all operation cases to be processed by the computer system. Therefore, conventionally, test data and cases are usually set and executed based on the experience of skilled workers who have a lot of operational experience. However, since it depends on experience, there is a high probability that test data and case leakage will occur. For this reason, after the system enters the actual operation stage, untested data and untested cases occur, and troubles due to program mistakes in the corresponding portions often occur.

  As this correspondence, in Patent Document 1, conventionally, an index called a test coverage corresponding to each step of a program is calculated instead of operation.

  Patent Document 2 adopts a method of using test data according to the operation screen as test data based on the operation.

JP 2000-339194 A JP-A-6-348542

  As described above, some data handled by a computer system may be difficult to identify all patterns before actual operation.

  In addition, order information, which is one of the input data handled by production management computers, has various requests from customers. In addition, new requests increase, and new data for computers increases daily. ing. For this reason, the pattern of values that can be taken when order information is expressed as data is enormous and may always vary. Therefore, it is extremely difficult to identify all patterns to be verified in advance as in the prior art and create data corresponding thereto.

  Even if data of such a pattern can be created temporarily, if the system does not cope with the fluctuations in the pattern that accompany the operation of the computer system, the validity of the operation of the computer system is maintained. Will not do.

  The cited document 1 described above is a test method focusing on the program step, and even one of a plurality of possible data is regarded as the test completion, and is an insufficient test.

  On the other hand, Cited Document 2 is based on operation and can be tested with operation data handled by a computer system, but only systems with a fixed operation pattern can be targeted.

  If it is going to cope with the change of the pattern, change information is obtained individually for each element that constitutes the order information, the influence on the past verification result is confirmed visually, and the validity of the computer system is newly confirmed. In order to make a decision, you must manually check whether the change covers all the patterns. For this purpose, enormous man-hours are required.

  The present invention has been made in order to solve the above-described conventional problems, and supports at least efficient processing and prompt operation of a computer apparatus that performs at least processing based on input data. It is an object of the present invention to provide a test support method and apparatus that can be used.

  First, according to the test support method of the first invention of the present application, the tested data input to the computer device, which is appropriate in the operation test, of the computer device to be subjected to the operation test is stored as authorization data in the database device. When it is determined that the data input to the computer device is the authorization data or by referring to the database device during the operation of the computer device and is the authorization data Adopts the operation of the computer device, and on the other hand, if it is determined that the data is not authorized, it verifies the current operation of the computer device or outputs a trigger signal for external verification, and If the verification result is appropriate, the current input data is stored as the certified data in the certified data database device. In addition, the ratio of the number of certified data to the number of input data that can be targeted in the computer apparatus is calculated as a coverage rate and provided for use in test case or test data excess / deficiency determination The above-mentioned problem is solved.

  Further, in the test support method, the new computer device that is replaced from the old computer device already in operation is the computer device to be tested, and is based on at least a part of the past input data of the old computer device. The input data that can be the target is collected, the collected data is stored in the coverage rate pattern database device, and the coverage rate calculation is performed using the information stored in the coverage rate pattern database device. The above-described problems are solved by performing the above.

  Next, the test support apparatus according to the second invention of the present application stores the tested data input to the computer apparatus, which has been judged appropriate in the operation test, of the computer apparatus to be subjected to the operation test as certification data. , And determining whether the data input to the computer device during the operation of the certified data database device is the certified data or by referring to the database device, and determining that the data is the certified data If this is the case, the current operation of the computer device is adopted. On the other hand, if it is determined that the data is not authorized data, the operation of the computer device is verified or a trigger signal for external verification is output. If the verification result is proper, the current input data is used as the certification data, and the certification data database is used. A comparison authorization processing device stored in the apparatus, and a coverage rate calculation device that calculates a ratio of the number of certified data to the number of input data that can be a target in the computer device as a coverage rate Thus, the problem is solved.

  Subsequently, the computer program of the third invention of the present application provides a computer program for implementing the test support method of the first invention or the test support device of the second invention, The problem is solved.

  The operation of the present invention will be briefly described below.

  In the present invention, the tested data input to the computer device, which is appropriate in the operation test of the computer device to be subjected to the operation test, is stored in the database device as authorized data. Further, it is determined by referring to the database device whether the data input to the computer device is the authorization data during the operation of the computer device.

  If it is determined that the data is authorized data, the operation of the computer device is adopted. On the other hand, if it is determined that the data is not certified data, the current operation of the computer device is verified, or a trigger signal for externally performing the verification is output, and the verification result is appropriate. In this case, the current input data is stored as the authorized data in the authorized data database device.

  In addition, a ratio of the number of certified data to the number of input data that can be a target in the computer apparatus is calculated as a coverage rate.

  According to the above coverage rate, as described above, it is possible to refer to and grasp how far the data pattern that is constantly changing has been verified. For example, by preparing a mechanism that requires users to verify when unverified data occurs, even computer systems that cannot guarantee normal operation with conventional technology can be safely put into actual operation. Can do.

  Here, as described above, if it is determined that the data is not authorized data, the input data can be said to be “first”. Therefore, it can be said that the determination of whether or not the input data is authorized data while referring to the authorized data database device is the first confirmation function. The first confirmation function can be made to function even after the computer device subject to the operation test actually starts operation, and the first input data can be verified after the operation is started. As a result, it is possible to appropriately perform operation tests on input data that cannot be taken in the past (input data that is not a possible value) and that may newly occur due to changes in the usage environment after the start of operation. It is possible to prevent adverse effects due to malfunctions.

  As described above, according to the present invention, a test support method and apparatus that can perform efficient and prompt operation verification of a computer apparatus that at least performs processing based on input data. Can be provided.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing an overall hardware configuration of an embodiment to which the present invention is applied. FIG. 2 is a block diagram showing a configuration of hardware used for each device of the present embodiment. FIG. 3 is a block diagram showing the configuration of each device.

  First, in the present embodiment, as an old computer system, an inquiry order is input from the old head office computer apparatus 10 installed in the head office 4 and information regarding the inquiry order is input. Then, the information is transmitted to the old branch computer device 14 installed in the branch office 5 which is a factory through a transmission path such as the network 1, and the products related to the inquiry order in the branch office 5 based on the information. Has been producing.

  In the present embodiment, a new computer system having the same functions as those of the old computer system as well as other new functions is newly developed, and an operation test of the new computer system is performed. It has become. In particular, the center of what is subject to the operation test is the inquiry order entry processing unit 30 and the order reception processing unit 60 based on the modified program, and the operation is verified to confirm that the modification is properly performed. The operation test is performed using the test computer devices 12 and 16 while applying the present invention.

  This new computer system also inputs an inquiry order from the head office new computer device 14 installed in the head office 4 and inputs information related to the inquiry order. Then, the information is transmitted to the new branch computer device 15 installed in the branch office 5 which is a factory through a transmission path such as the network 1, and the products related to the above inquiry order in the branch office 5 based on the information. Has been producing.

  The head office old computer device 10, the head office new computer device 11, the test computer device 12, the branch office old computer device 14, the branch office new computer device 15, and the test computer device 16 are, for example, as shown in FIG. It can be configured. FIG. 2 shows a hardware configuration of a certain kind of computer device that can be used as each device.

  These devices are appropriately connected by a wide area network 1, a network 2 in the head office 4, and a network 3 in the branch office 5, and can transmit information. These networks 1 to 3 are not specifically limited, and are WAN (Wide Area Network) or LAN (Local Area Network), and may use a public data communication network.

  In addition, each apparatus is not limited to the above. Also, two or more of these devices may be configured with the same hardware. For example, the test computer device 12 may be configured by the same new hardware as the head office new computer device 11 and the test computer device 16 may be configured by the new branch office computer device 15. Further, in the head office 4, the old head office computer device 10, the new head office computer device 11, and the test computer device 12 may be configured by a single hardware. The computer device 15 and the test computer device 16 may be configured by a single piece of hardware.

  The computer apparatus shown in FIG. 2 may be a general PC (Personal Computer) apparatus equipped with Windows (registered trademark) of US Microsoft Corporation as an example of the OS (Operating System), and is not particularly limited. Absent. Alternatively, hardware other than the PC device may be used, and hardware such as a so-called workstation such as EWS (Engineering Work Station) may be used. In this figure, the hardware configuration is partially abstracted for the sake of explanation.

  In this figure, a computer device includes a CPU (Central Processing Unit) 310, a RAM (Random Access Memory) 311, a ROM (Read Only Memory) 312, a LAN-I / F (Inter Face) 313, a MODEM (modulator). -demodulator) 314 and various I / Fs 320 to 322. These are interconnected by a bus 301.

  Further, a screen display device 330 is connected to the bus 301 via the I / F 320. A keyboard 331, a mouse 332, and a printer device 333 that are interconnected by the bus 303 are connected to the bus 301 via the I / F 321.

  Further, an HDD (Hard Disc Drive) device 340, a CD (Compact Disc) drive device 341, and an FDD (Floppy (registered trademark) Disc Drive) device 342 are connected to the bus 301 via the I / F 322. Has been. These are interconnected by a bus 302.

  In the hardware configuration as described above, the storage means and storage devices are RAM 311, ROM 312, HDD device 340, CD drive device 341, FDD device 342, and the like. In such storage means and storage devices, various programs executed by the CPU 310, databases and various files and data accessed in the present embodiment are stored, and can be accessed electronically. For example, an OS, a database, a program for providing an environment that uses software resources such as JAVA (registered trademark), JSP, an application program according to the present embodiment, and a web browser program are stored in the HDD device 340. The data is stored and read into the RAM 311 and executed by the CPU 310 at the time of execution. Note that the LAN-I / F 313 is used for connection to the network 3 or the network 1, and the application program executed by the CPU 310 is a JAVA (acquired via the network 1 in the client device 5). (Registered trademark) applet is also included.

  Further, when executing an OS, an application program, or the like, an operator performs character input and various operations with the keyboard 331 while referring to information displayed and output on the screen display device 330, and coordinate input and various operations with the mouse 332. Or input. Further, necessary information can be printed out from the printer device 333 as appropriate. Needless to say, these outputs and inputs are performed electronically by a program executed by the CPU 310.

  Note that the CD drive device 341 and the FDD device 342 are used for application program installation and other offline information exchange when the present invention is applied.

  Next, as shown in FIG. 3, the head office old computer device 10 has an old order file storage device 33 for storing old production request files related to orders that have been put in and operated in the past. The head office new computer device 11 includes an inquiry order entry processing unit 30 that inputs and updates information in response to the introduction of an inquiry order, and an old production instruction file in which information is stored and updated by the inquiry order entry processing unit 30. The old order file storage device 34 is stored.

  Next, the branch office old computer device 14 stores the old order file storage device 43 in which the information of the old order file storage device 33 is transmitted through the transmission line and the same information as the old order file storage device 33 is stored. Have. Further, based on the information, the production order input processing unit 50 that generates information necessary for product production in the branch office 5 and stores it in the old order DB 52 or outputs various lists 51, and the old order DB 52 are provided. is doing.

  The branch office new computer device 15 includes an order reception processing unit 60, an old order file storage device 61, a manufacturing order input processing unit 63, and an old order DB 65.

  In the branch office new computer device 15, first, the order reception processing unit 60 receives the information of the old order file storage device 34 transmitted through the transmission path. Furthermore, the order reception processing unit 60 generates old order file information equivalent to the information stored in the old order file storage device 43 based on the information, and the old order file storage device 61. To store. The production order input processing unit 63 generates information equivalent to the information stored in the old order DB 52 based on the information stored in the old order file storage device 61 and stores it in the old order DB 65. Further, the manufacturing order input processing unit 63 outputs various lists 64.

  Here, in FIG. 3, thick dashed-dotted arrows A <b> 1 to A <b> 3 indicate comparative verification processing in the operation test to which the present invention is applied. The comparison verification is mainly an operation verification of the inquiry order entry processing unit 30 and the order reception processing unit 60 by a modified program, and verifies whether the modification is appropriately performed.

  That is, the processing result (comparison source data) by the operation of the old computer system is compared with the processing result (verification destination data) by the operation of the new computer system, and the operation of the new computer system becomes the same as the operation of the old computer system. It shows the process to verify whether or not. This processing is performed by the test support device 80 configured in each of the test computer devices 12 and 16.

  FIG. 4 is a block diagram showing a configuration of the test support apparatus 80 of the present embodiment.

  As shown in the figure, the test support device 80 includes a comparison source data storage device 84, a verification data storage device 85, a comparison authorization processing device 86, a compare definition information DB device 87, an authorization data DB device 88, A coverage pattern generation device 81, a coverage pattern DB device 82, and a coverage rate calculation device 89 are included.

  First, the comparison source data, which is the processing result of the operation of the old computer system, is received from the old processing device portion 73, and the data is stored in the comparison source data storage device 84. The verification processing data, which is the processing result of the operation of the new computer system, is received from the new processing device portion 74, and the data is stored in the verification data storage device 85.

  The authorized data DB device 88 stores the tested comparison source data and verification destination data input to the computer device, which have been judged appropriate in the suitability determination in the operation of the computer device subject to the operation test. Save as.

  Further, the comparison authorization processing device 86 compares the above-mentioned comparison source data and verification destination data, and outputs a trigger for starting verification of whether the operation of the new computer system is the same as the operation of the old computer system. Or output information that supports the verification.

  Here, in FIG. 3, at arrow A1, the old processing device portion 73 related to the comparison source data is the old order file storage device 33, and the new processing device portion 74 related to the verification destination data is the old order file. A file storage device 34. In the arrow A 2, the old processing device portion 73 is the old order file storage device 43 and the new processing device portion 74 is the old order file storage device 61. In the arrow A3, the old processing device portion 73 is the old order DB 52, and the new processing device portion 74 is the old order DB 65.

  Specifically, the comparison / authorization processing device 86 first determines whether the comparison source data and the verification destination data are the above-described authorization data by referring to the authorization data DB device 88. If it is determined that the data is authorized, the comparative authorization processing device 86 outputs that the current operation of the computer device is correct. On the other hand, if it is determined that the data is not certified data, and if the operation result / mismatch indicates that the comparison source data and the verification destination data do not match, a trigger signal for verifying the operation of the current old computer system is output. In response to the verification trigger signal, the test support apparatus 80 outputs a request for verification judgment or information related to the judgment to the operator by displaying the screen or generating a request warning sound from a speaker. To do. Thereafter, when the operator inputs a determination that the result of the verification is “appropriate”, that is, the current operation is normal, the comparison and certification processing device 86 uses the current comparison source data and the verification destination data as certification data. Is stored in the authorized data DB device 88.

  If it is determined that the data is not certified data, and if the comparison result data and the verification target data match, the operation result / appropriate match results in the comparison source of this time being output without outputting the verification trigger signal. Data and verification destination data are stored in the authorized data DB device 88 as authorized data.

  Further, the comparison / authorization processing device 86 outputs various information such as a comparison list, an initial list, and a similar comparison list as shown in FIG.

  In FIG. 5, “1234567-001”, “1234567-002”, and “1234567-003”, which are called “orders”, are orders for one product. The information on the order of each product includes “HEAD”, that is, head information, and “BODY”, that is, body information. The head information includes item data such as item A to item E..., And the body information includes item data such as item A to item O. The comparison source data of the old computer device and the verification destination data of the new computer device are compared for each item data. The mismatched data is “NG” as shown, and the matched data is “OK”. In addition, when all item data matches in individual order information, the above-mentioned operation result / appropriate match is obtained. Further, the comparison list shown in FIG. 5 is information used by the operator to cope with the above-described operation result / mismatch.

  In such a comparison process, the compare definition information stored in the compare definition information DB device 87 is used. The compare definition information indicates the definition in the comparison processing, and includes the configuration of the order information and the definition information of the comparison mask. For example, for some item data, information on the definition of a comparison mask such as so-called “don't care” (inconsistency) is included.

  Next, the coverage pattern generation device 81 collects samples of the input data that can be the target based on at least a part of the input data in the past of the old computer system, and the collected pattern data is the coverage pattern DB device 82. To store. The various DB devices 72 are the sample collection targets. The DB devices 72 are, for example, the old order file storage device 33 and the old order file storage device 34. Moreover, what is collected by the sample collection is input data that can be processed in the computer device that is the target of the operation test, and is a set of values that can be taken by the input data of the computer device.

  The coverage rate calculation device 89 calculates the ratio of the number of certified data to the number of input data that can be processed in the computer device that is the target of the operation test as the coverage rate. At this time, the number of input data that can be processed is the number of corresponding data (the number of data) stored in the coverage pattern DB device 82 as described above. This is done by counting 89.

  The coverage rate calculation device 89 calculates such a coverage rate for each item data of the order information. Also, a coverage rate graph as shown in FIG. 6 is output. The coverage rate graph is for individual item data, and a white bar graph indicates the number of input data that can be processed, and indicates the number of input data that can be processed. In addition, the number of input data that has already been recognized data is indicated by a shaded bar graph. Further, the broken border line attached to the bar graph in the figure is the number of certified data that provides a coverage rate sufficient for an operation test of the new computer device.

  If the sample collection by the coverage pattern generation device 81 is not performed again, the input data that can be processed is fixed. In this case, in the operation test, the coverage rate can be grasped as the number of digests in the operation test.

  Alternatively, if the sample collection by the coverage pattern generation device 81 is performed as appropriate, for example, after actual operation, the coverage rate is a parameter for grasping past results and evaluating the degree of completion of the operation test. It becomes.

  In the operation test according to the present embodiment, input data serving as test data is collected based on at least a part of the past input data of the old computer system. At this time, it is necessary to take in a special order as indicated by reference numeral B in FIG.

  As described above, according to this embodiment, the present invention can be effectively applied.

  For example, FIG. 8 is a work flowchart of the operation test of the new computer system using this embodiment.

  First, an operation test is started at C1. In the initial stage of the operation test, a general operation verification of the entire system of the new computer system is first started as a system test operation.

  Next, for the same function as the old computer system, an operation test of the new computer system is performed as the current warranty confirmation test work. In this current warranty confirmation test work, an operation test is performed using the test support device 80 to determine whether the operation result of the new computer system is the same as the operation result of the old computer system. For functions that are not available in the old computer system, operation test work is performed.

  In these system test work, current warranty check test work, and operation test work, the comparison certification function and the coverage ratio function provided by the test support device 80 of the present embodiment are also utilized, so that the operation verification can be performed efficiently and We can help you to do it quickly.

  At reference C2, the operation of the new computer system is started. For example, the operation is started after reaching the border line in FIG. 6 and having a sufficient coverage rate. However, even at the beginning, the coverage rate of most item data is not 100%. In the present embodiment, when input data that is not authorized data is input, a function of notifying the operator as “first thing” (first confirmation function) is provided. Therefore, when the operation is started, this first confirmation function can be used to allow the operator to sufficiently verify unverified input data, and to prevent adverse effects due to malfunction of the new computer system.

  As described above, according to this embodiment, the present invention can be effectively applied.

  As described above, according to the present invention, there is provided a test support method capable of providing support for efficiently and promptly performing an operation verification of a computer device that performs at least processing based on input data. An apparatus can be provided.

The block diagram which shows the whole hardware constitutions of embodiment with which this invention was applied The block diagram which shows the structure of the hardware used for each apparatus of the said embodiment. Block diagram showing the configuration of each device The block diagram which shows the structure of the test assistance apparatus of the said embodiment. Diagram showing a comparison list of the embodiment Diagram showing the coverage graph of the embodiment Configuration diagram of target orders in the embodiment Work flow chart for testing a new computer system using the embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 1-3 ... Network 4 ... Head office 5 ... Branch office 10 ... Old computer apparatus of head office 11 ... New computer apparatus of head office 12, 16 ... Computer apparatus for test 14 ... Old computer apparatus of branch office 15 ... New computer apparatus of branch office 30 ... Inquiry order input processing part 33, 34, 43, 61 ... Old order file storage device 50 ... Manufacturing order input processing unit 51 ... Various lists 52 ... Old order DB
60 ... Order reception processing unit 63 ... Manufacturing order input processing unit 64 ... Various lists 65 ... Old order DB
72 ... Various DB devices 73 ... Old processing device portion 74 ... New processing device portion 80 ... Test support device 81 ... Cover pattern generation device 82 ... Cover pattern DB device 84 ... Comparison source data storage device 85 ... Verification data storage device 86 ... Comparison Authorized processing device 87 ... Compare definition information DB device 88 ... Authorized data DB device 89 ... Coverage rate calculating device 301-303 ... Bus 310 ... CPU
311 ... RAM
312 ... ROM
313 ... LAN-I / F
314 ... MODEM
320 to 322 ... I / F
330 ... Screen display device 331 ... Keyboard 332 ... Mouse 333 ... Printer device 340 ... HDD device 341 ... CD drive device 342 ... FDD device

Claims (4)

Tested data input to the computer device, which is appropriate in the operation test of the computer device subject to the operation test, is stored in the database device as authorized data,
During operation of the computer device, it is determined by referring to the database device whether the data input to the computer device is the authorization data,
If it is determined that the data is authorized, use the operation of the computer device,
On the other hand, if it is determined that the data is not certified data, the current operation of the computer device is verified, or a trigger signal is output for external verification, and if the verification result is appropriate, The current input data is saved as the authorized data in the authorized data database device,
A ratio of the number of certified data to the number of input data that can be targeted in the computer device is calculated as a coverage rate, and provided for use in a test case or test data excess / deficiency determination Test support method. The test support method according to claim 1,
A new computer device, which is replaced from an old computer device already in operation, is the computer device to be tested,
Based on at least a part of the input data in the past of the old computer device, perform sample collection of the input data that can be the target, and store the collected data in the coverage rate pattern database device,
A test support method characterized in that the coverage rate calculation is performed using information stored in the coverage rate pattern database device. An accredited data database device for storing, as accredited data, tested data input to the computer device that has been validated in the operational test of the computer device subject to the operation test;
When it is determined that the data input to the computer device is the authorization data or by referring to the database device during the operation of the computer device, and it is determined that the data is the authorization data, the computer device On the other hand, if it is determined that the data is not certified data, the operation of the computer apparatus is verified, or a trigger signal for external verification is output, and the result of the verification is appropriate. If this is the case, the input data of this time as the authorization data, the comparison authorization processing device that saves in the authorization data database device,
A coverage ratio calculation device that calculates a ratio of the number of certified data to the number of input data that can be targeted in the computer device as a coverage ratio;
A test support apparatus characterized by comprising:   A computer program for executing any one of the test support method according to claim 1 and the test support apparatus according to claim 3.

Images