JP4215255B2 - Degradation confirmation inspection method, degradation confirmation inspection system, and program therefor - Google Patents

Description

  The present invention relates to a software product inspection support technology, and in particular, when performing a degradation check by inputting a large amount of actual data (data that is actually input during the actual operation of the system), the software product inspection process is made more efficient and confirmed. In particular, the present invention relates to a degradation confirmation inspection method, a degradation confirmation inspection system, and a program therefor that are particularly suitable for improving the accuracy of the system.

  Conventionally, various confirmation methods have been used for so-called “degradation check” for confirming whether there is any problem in existing functions when a software program is changed. For example, there are the following patent documents as conventional known documents.

(1) Japanese Patent Application Laid-Open No. 5-94298, “Degrade Check Execution Device” (Patent Document 1) describes test data for testing the operation of an existing function for each program module in the host computer and the expected operation. Degradation check data storage means for storing the expected value indicating the result in advance is provided, and the degradation check execution control means is activated by command identification execution means provided in the host computer.

  When the command is identified, the test data in the degradation check data storage means is input to the designated program module to operate the target program module, and the execution result is stored in the execution result storage means together with the expected value.

  When the execution result editing means is activated by the command identification execution means, data obtained by editing the result in a predetermined format is output from the execution result storage means to the data display means of the terminal.

(2) Japanese Patent Laid-Open No. 11-259288, “Degrade Check Device” (Patent Document 2) describes input data and output data when an application program before correction is executed (that is, input data and output in an old data format) Data that can be converted in a short period of time to convert the data format into the format of input data and output data (that is, input data and output data in the new data format) when the modified application program is executed A degradation check device having a format conversion function is described.

(3) Japanese Patent Application Laid-Open No. 2001-84163 “Updating Process Influence Preliminary Investigation Device and Method, Update Processing Program Operation Test Device and Method” (Patent Document 3) includes the specified data in the update target data file. For each file, an extraction key file creation means for creating a file containing an extraction key for the update target data, and an update for extracting the update target data from the data file using the extraction key and storing it in the pre-update database of the verification environment Pre-database creation means, post-update database creation means for extracting update target data from the data file using the extraction key and storing it in the post-update database of the verification environment, and stored in the post-update database of the verification environment Start update process program for update target data and update process Update processing means for executing and storing in the post-update database of the verification environment, data stored in the pre-update database of the update environment, and in the post-update database of the verification environment after the update process A comparison verification unit that activates a comparison verification tool group and compares the stored data to create a verification result, and an update processing program update unit that updates the update processing program of the update processing unit An update program operation test apparatus characterized in that is described.

Japanese Patent Laid-Open No. 5-94298 JP 11-259288 A JP 2001-84163 A

  Degradation confirmation in a large-scale software system, that is, a system having multiple functions in which the total number of steps reaches several hundreds of thousands, requires an enormous amount of test data.

  Degradation confirmation in such a large-scale system is performed by the method of the check device described in Japanese Patent Laid-Open No. 5-94298 (Patent Document 1), which shows an enormous amount of test data and expected operation results. Expectation data must be prepared.

  When a huge amount of test data and its expected value are prepared for the degradation check in this way, there is a problem that checking and guaranteeing the validity of the prepared test data and the expected value also increases man-hours.

  The invention described in Japanese Patent Application Laid-Open No. 11-259288 (Patent Document 2) is an invention that is effective when the input data and the output data have different data formats before and after the application program is corrected. It cannot be said that the invention is effective for a degradation check when an application program is modified without changing the data format of data and output data.

  Further, in the invention described in claim 2 of Japanese Patent Application Laid-Open No. 2001-84163 (Patent Document 3), when the update processing program is modified, the verification result created by the update processing program before the modification, By comparing with the verification result created by the update processing program, it can be automatically tested whether there is an error in the modified update processing program.

  However, in the invention described in Patent Document 3, the comparison verification is performed after the update target data is extracted by the extraction key before comparing the new and old verification results. In other words, since only the update target data is verified, the remodeling work of the update processing program can confirm the target data that is originally changed by the remodeling work, but it must not be changed by the remodeling work. There is a problem that it cannot be said that an event in which non-target data is affected by the remodeling work to produce an incorrect result, so-called “degradation check” is functioning.

  An object of the present invention is to solve the above-mentioned problems of the prior art by using a large amount of actual data to efficiently verify and confirm the presence or absence of degradation of the program at the time of remodeling the data update program. A verification inspection system and a program therefor are provided.

In order to achieve the above object, the degradation confirmation inspection system of the present invention is:
Means for executing the pre-improvement program and the post-improvement program on the input data by the same device or different devices;
Means for storing the contents for each data item, which is the execution result of the pre-improvement program , and the journal, which is the message information input / output at the time of execution, in the pre-program improvement DB and the pre-improvement journal file, together with the data item name; Means for storing the contents of each data item that is the execution result by the improved program and the journal that is the message information input and output at the time of execution in the program improved DB and the improved journal file, together with the data item name; A means for creating an improvement item content DB that records data item names of data to be improved, a means for comparing the contents of the pre-program improvement DB and journal file, and the contents of the post-program improvement DB and journal file, and comparison As a result of processing, the data item name of the mismatched data is Means for determining whether or not there is an improvement item content DB, means for displaying a warning when the data item name of the mismatched data is in the improvement item content DB, and the data item name of the mismatched data Is displayed in the improvement item contents DB, an error is displayed, the data item name of the data before and after the program improvement, the contents for each data item that is the execution result before and after the program improvement, and the message information input and output at the time of execution And a means for outputting the journal to a degradation discrimination result file.

Also, in the above, by specifying whether or not the warning display is required, the warning display is not output, and when the warning is displayed by the warning display means, the data before and after the program improvement is displayed. The data item name, the contents of each data item that is the execution result before and after the program improvement , and the journal that is the message information that is input / output at the time of execution are provided to the degradation determination result file .

Further, the degradation confirmation inspection method of the present invention includes a step of executing the pre-improvement program and the post-improvement program on the input data by the same device or different devices , the contents for each data item that is the execution result of the pre-improvement program, and its The journal, which is the message information input / output at the time of execution , is stored in the pre-program improvement DB and the pre-improvement journal file together with the data item name, the contents for each data item that is the execution result of the post-improvement program, and its Steps for storing the journal, which is the message information input / output at the time of execution, in the post-improvement DB and post-improvement journal file together with the data item name, and the improvement item contents recording the data item name of the data to be improved A DB creation step, and the pre-program improvement DB And the journal file, the step of comparing the contents of the program-improved DB and the journal file, and the step of determining whether or not the data item name of the data that does not match as a result of the comparison process is in the improvement item contents DB And a step of displaying a warning when the data item name of the mismatched data is in the improvement item content DB, and an error display when the data item name of the mismatched data is not in the improvement item content DB. A step of outputting the data item name of the data before and after the program improvement, the contents of each data item that is the execution result before and after the program improvement , and the journal that is the message information input and output at the time of execution to the degradation determination result file It is characterized by that.

Also, in the above degradation confirmation inspection method, by specifying whether or not the warning display is required, the warning display is not output, and after the warning display step, the data before and after the program improvement is improved. It is also characterized by providing a step for outputting the data item name, the contents of each data item as the execution result before and after the program improvement , and the journal as the message information input / output at the time of execution to the degradation determination result file.

  Moreover, the program of this invention is a program for a degradation confirmation inspection for making a computer perform each step which implement | achieves the said degradation confirmation inspection method.

  According to the present invention, when performing a verification check by inputting a large amount of actual data in an inspection work of an online DB system, in the verification work of data items whose processing results before and after the program improvement are different, the processing result is the data item to be improved. Different data items can be distinguished by displaying warnings, and by specifying whether or not warning display output is required, warning display output can be disabled, supporting efficient and accurate degradation confirmation work. Is possible.

  Hereinafter, an embodiment of a degradation confirmation inspection system according to the present invention by inputting a large amount of actual data will be described with reference to the drawings.

  FIG. 1 is a configuration diagram of a degradation confirmation inspection system with a large amount of actual data input according to the present embodiment.

<Configuration of Degradation Confirmation Inspection System Based on Mass Data Input of this Embodiment>
First, reference numeral 100 in FIG. 1 is a terminal simulator that performs command input from a plurality of terminals at the time of inspection execution and performs message input / output, and reference numeral 201 indicates an improvement used for acquiring execution results before improvement. Reference numeral 202 denotes a pre-system, and reference numeral 202 denotes an post-improvement system used for obtaining an execution result after improvement.

  In FIG. 1, the pre-improvement system 201 and the post-improvement system 202 are shown as separate systems. However, the system when the pre-improvement program and the post-improvement program are executed in the same system and the pre-improvement program is executed is improved. A system in which the improved program is executed can also be regarded as an improved system, and the present invention includes both forms.

  Reference numeral 400 denotes a comparison processing program used for comparing the execution results of the pre-improvement system 201 and the post-improvement system 202 and outputting information on the data item in which the difference has occurred. Reference numeral 600 denotes a comparison processing result determination system 600 that is used for determination and deletion of items that are different depending on the data item to be improved among the outputs of the comparison processing program 400.

  In the present embodiment, the pre-improvement system 201 and the post-improvement system 202 are connected to the terminal simulator 100 via a network 71 such as a LAN (Local Area Network), for example, and are transmitted and received by messages from the terminal simulator 100. Operates as if there were inputs from multiple terminals.

  Next, configurations of the terminal simulator 100, the pre-improvement system 201, the post-improvement system 202, the comparison processing program 400, and the comparison processing result determination system 600 will be described below with reference to FIG.

  In the following description, it is assumed that the pre-improvement system 201, the post-improvement system 202, and the terminal simulator 100 are connected via the network 71.

<Configuration of terminal simulator>
The terminal simulator 100 in the degradation confirmation inspection system with a large amount of actual data input according to the present embodiment includes an input device 10 used by a person in charge to input various data, a display device 11 that displays various data on the screen, processing data, and the like. In addition to the output device 12 such as a printer that outputs the data, an input / output information processing unit 20, a terminal simulation unit 30, and a data transmission / reception control unit 40 are provided. Hereinafter, each part 20-40 is demonstrated.

  The input / output information processing unit 20 designates an execution command by the input device 10, reads the input journal 80 by the terminal simulation unit 30 and the data transmission / reception control unit 40, and the system 201 before improvement as a terminal input / output message, or It is transmitted to and received from the improved system 202. The execution result is received from the terminal simulation unit 30 and the data transmission / reception control unit 40 and displayed on the display device 11.

<System configuration before improvement>
The pre-improvement system 201 includes an input device 10 used by a person in charge for inputting various data, a display device 11 for displaying various data on the screen, and an output device 12 such as a printer for outputting processing data. An input / output information processing unit 220, a pre-improvement program execution unit 230, and a data transmission / reception control unit 240 are provided. Hereinafter, each part 220-240 is demonstrated.

  The data transmission / reception control unit 240 performs message input / output from the terminal simulator 100, transfers information to / from the pre-improvement program execution unit 230, and outputs message input / output information to the pre-improvement journal 280.

  Further, the pre-improvement DB 270 is read / written according to the designation from the pre-improvement program execution unit 230. System information such as an abnormal end message is displayed from the display device 11 by the pre-improvement program execution unit 230 and the input / output information processing unit 220.

<System configuration after improvement>
The improved system 202 includes an input device 10 used by a person in charge for inputting various data, a display device 11 for displaying various data on the screen, and an output device 12 such as a printer for outputting processing data. An input / output information processing unit 220, an improved program execution unit 250, and a data transmission / reception control unit 240 are provided. Hereinafter, each part 220-240 is demonstrated.

  The data transmission / reception control unit 240 performs message input / output from the terminal simulator 100, transfers information to and from the improved program execution unit 250, and outputs message input / output information to the improved journal 281.

  Further, the post-improvement DB 271 is read / written according to the designation from the post-improvement program execution unit 250. System information such as an abnormal termination message is displayed from the display device 11 by the improved program execution unit 250 and the input / output information processing unit 220.

<Composition of comparison processing program>
The comparison processing program 400 includes a processing result comparison processing unit 430 and a data transmission / reception control unit 440. Hereinafter, each part 430-440 is demonstrated.

  The data transmission / reception control unit 440 reads the pre-improvement DB 270, the post-improvement DB 271, the pre-improvement journal 280, and the post-improvement journal 281 as specified by the processing result comparison processing unit 430.

  The processing result comparison processing unit 430 compares the pre-improvement DB 270 and the post-improvement DB 271, and if there is a difference, outputs the DB key, the item name and content before and after the improvement to the comparison processing result file 490, and the improvement The previous journal 280 and the improved journal 281 are compared. If there is a difference, the message name, the data item name before and after the improvement, and the content are output to the comparison processing result file 490.

<Configuration of comparison processing result discrimination system>
The comparison processing result determination system 600 includes an input device 10 used by a person in charge for inputting various data, a display device 11 for displaying various data on the screen, and an output device 12 such as a printer for outputting processing data. In addition, an input / output information processing unit 620, a comparison processing result determination unit 630, and a data transmission / reception control unit 640 are provided. Hereinafter, each part 620-640 is demonstrated.

  The input / output information processing unit 620 delivers to the comparison processing result determination unit 630 the difference information output necessity of the data item to be improved input by the input device 10.

  The data transmission / reception control unit 640 reads the comparison processing result file 490 and the improvement item content DB 650 as specified by the comparison processing result determination unit 630.

  The comparison processing result determination unit 630 determines whether the data item name of the comparison processing result file 490 is a data item to be improved in the improvement item content DB 650, and displays an error if it is not a data item to be improved. And output to the degradation discrimination result file 660.

  If the data item to be improved and the difference information output necessity is “necessary”, a warning is displayed and the result is output to the degradation determination result file 660. If the data item to be improved and the difference information output necessity is “No”, the data is not output to the degradation determination result file 660.

FIG. 2 is a flowchart for explaining the processing described above, which is a feature of the present invention.
As shown in the figure, in the present invention, the pre-improvement program and the post-improvement program are executed on the input data by the same device or different devices (step S1).

  The execution result of the pre-improvement program and the input / output information (journal) at the time of execution are respectively stored in the DB before program improvement and the journal file before improvement (step S2). The output information (journal) is stored in the post-improvement DB and the pre-improvement journal file, respectively (step S3).

  Further, an improvement item content DB in which the data item name to be improved is recorded is created (step S4).

  Next, the contents of the pre-program improvement DB and journal file and the post-program improvement DB and journal file are compared (step S5).

  Next, it is determined whether or not there is a data item name that does not match as a result of the comparison process in the improvement item content DB (step S6).

  When the mismatched data item name is in the data item to be improved (step S7: Y), a warning is displayed (step S8).

  When the mismatched data item name is not included in the data item to be improved (step S7: N), an error is displayed and the DB key, the data item name before and after the program improvement, and the content before and after the program improvement are displayed as the degradation determination result. Output to a file (step S9).

  The output of the warning display may not be performed by designating whether or not the output is required in the case of the warning display.

  Further, a step of outputting the DB key, the data item name before and after the program improvement, and the content before and after the program improvement to the degradation determination result file may be provided after the step S8 for displaying the warning.

  Note that the processing steps described above in the present invention, that is, the step of executing the pre-improvement program and the post-improvement program on the input data by the same device or different devices, the execution result of the pre-improvement program and the input / output information at the time of execution , Step for storing in the pre-program improvement DB and pre-improvement journal file, respectively, step for storing the execution result of the post-improvement program and input / output information at the time of execution in the DB after program improvement and the journal file after improvement, respectively The step of creating the improvement item content DB in which the target data item name is recorded, the step of comparing the DB before the program improvement and the journal file, the content of the DB after the program improvement and the journal file, and the result of the comparison processing are inconsistent. Improved data item name A step of determining whether or not the contents are in the content DB, a step of displaying a warning when there is a mismatched data item name in the improvement target data item, and a case where the mismatched data item name is not in the improvement target data item Error display, DB key, data item name before and after program improvement, and contents before and after program improvement are output to a degradation discrimination result file. Further, in addition to the above steps, Specify whether or not output is required in the case of warning display, so that the warning display is not output, or after the step of warning display, DB key, data item name before and after program improvement, and contents before and after program improvement Each program such as a step to output to the degradation discrimination result file is converted into a program code, and the CPU or By executing the computer made of Li, it is possible to implement the present invention.

  In addition, this program can be widely distributed to the market by recording it on a computer-readable recording medium such as a CD-ROM, DVD, FD or the like, or downloading it to a user device via a network such as the Internet. Can do.

  The present invention is particularly effective when performing a degradation confirmation inspection by inputting a large amount of actual data for a system having a large number of terminals or a large number of users actually used, an instruction input from a terminal, or a system having a large number of input patterns. Is expensive. For example, bank ATM system, securities company's online transaction system, social insurance agency's pension information arbitration / inquiry / change terminal system, etc.

It is a block diagram of the degradation confirmation inspection method by mass real data input by one Embodiment of this invention. It is a flowchart for demonstrating the process characterized by this invention.

Explanation of symbols

10: input device 11: display device 12: output device 20: input / output information processing unit 30: terminal simulation unit 40: data transmission / reception control unit 71: network 80: journal for input 100: terminal simulator 201: system before improvement 202: Improved system 220: Input / output information control unit 230: Pre-improvement program execution unit 240: Data transmission / reception control unit 250: Improved program execution unit 270: DB before improvement
271: Improved DB
280: Journal before improvement 281: Journal after improvement 400: Comparison processing program 430: Processing result comparison processing unit 440: Data transmission / reception control unit 490: Comparison processing result file 600: Comparison processing result determination system 620: Input / output information processing unit 630: Comparison processing result determination unit 640: Data transmission / reception control unit 650: Improvement item content DB
660: Degradation discrimination result file

Claims (7)

Means for executing the pre-improvement program and the post-improvement program on the input data by the same device or different devices;
Means for storing the contents for each data item, which is the execution result of the pre-improvement program , and the journal, which is the message information input / output at the time of execution, in the pre-program improvement DB and the pre-improvement journal file, together with the data item name;
Means for storing the contents of each data item that is the execution result by the improved program and the journal that is the message information input and output at the time of execution in the program improved DB and the improved journal file, together with the data item name;
Means for creating an improvement item content DB in which data item names of data to be improved are recorded;
Means for comparing the contents of the pre-program improvement DB and journal file and the post-program improvement DB and journal file;
Means for determining whether or not the data item name of the mismatched data is found in the improvement item content DB as a result of the comparison process;
Means for displaying a warning when the data item name of the mismatched data is in the improvement item content DB;
When the data item name of the mismatched data is not in the improvement item content DB, an error is displayed, the data item name of the data before and after the program improvement , the content for each data item that is the execution result before and after the program improvement, and its And a means for outputting a journal, which is message information input / output at the time of execution, to the degradation determination result file. In the degradation confirmation inspection system according to claim 1,
The degradation confirmation inspection system according to claim 1, wherein the warning display is not output by designating whether the warning display is necessary or not. In the degradation confirmation inspection system according to claim 1,
When the warning is displayed by the warning display means, the data item name of the data before and after the program improvement, the contents of each data item that is the execution result before and after the program improvement, and the journal that is input and output at the time of the execution are determined as the degradation A degradation confirmation inspection system characterized by providing means for outputting to a result file. Executing the pre-improvement program and the post-improvement program on the input data by the same device or different devices;
Storing the contents of each data item, which is the execution result of the pre-improvement program, and the journal input / output at the time of execution in the pre-program improvement DB and the pre-improvement journal file, together with the data item name;
Storing the contents of each data item that is the execution result by the improved program and the journal that is the message information input and output at the time of execution in the post-improvement DB and the improved journal file together with the data item name;
Creating an improvement item content DB that records data item names of data to be improved;
Comparing the contents of the pre-program improvement DB and journal file with the post-program improvement DB and journal file;
A step of determining whether or not the data item name of the data that does not match as a result of the comparison processing is in the improvement item content DB;
Displaying a warning when the data item name of the mismatched data is in the improvement item content DB;
When the data item name of the mismatched data is not in the improvement item content DB, an error is displayed, the data item name of the data before and after the program improvement , the content for each data item that is the execution result before and after the program improvement, and its And a step of outputting a journal , which is message information input / output at the time of execution, to the degradation determination result file. In the degradation confirmation inspection method according to claim 4,
A degradation confirmation inspection method, wherein the output of the warning display is not performed by designating whether the warning display is necessary or not. In the degradation confirmation inspection method according to claim 4,
After the step of displaying the warning, the data item name of the data before and after the program improvement, the contents for each data item that is the execution result before and after the program improvement , and the journal that is the message information input and output at the time of the execution, the degradation determination result A degradation confirmation inspection method comprising a step of outputting to a file.   A program for degradation confirmation inspection for causing a computer to execute each step of realizing the degradation confirmation inspection method according to any one of claims 4 to 6.

Images