JP5670156B2 - Test result verification system, method, and program - Google Patents

Description

  The present invention relates to techniques such as verification and test result verification in system development such as software.

  In system development, programming is performed through specifications such as outline design, basic design, and detailed design, and execution verification for each program, execution verification for each task, and execution verification for the entire system are performed.

  In the verification process (test process) related to the above, it is confirmed whether the program has a function based on specifications such as basic design and detailed design. At that time, the confirmation (verification) of the validity of the input (input data) and the output (output result) is always performed. This confirmation (verification) includes test result verification (collation) in which input and output are matched (collation). In this confirmation (verification), input is performed based on input screen printing or input data for batch processing, and output is performed based on output result screen printing or output information. Most of these are visual checks that match the paper information.

  In addition, for the defects extracted in the above verification process, the location of occurrence is identified and countermeasures are taken, but it is difficult to identify the location of occurrence of the failure, particularly in operations using a large number of programs. It takes time, during which verification work is interrupted and progress is delayed.

  As a prior art example related to the above, there is JP-A-5-225209 (Patent Document 1).

JP-A-5-225209

  Prior art such as Patent Document 1 is a method of matching (collation) specialized in processing input data and generating output data, and is used for screen input / output and comparison / collation of input data and output forms. Is not applied.

  In the prior art, confirmation of a screen or a form is mainly performed by checking (matching) information output on paper. Therefore, there is a possibility of confirmation error and leakage. Moreover, since it is a visual check, it takes an enormous amount of time.

  In the above-described conventional technology, it is difficult to identify a defective part from the result of matching (collation). As a conventional countermeasure, the test operation is temporarily suspended, and the identification of the defective part is separated from the test work. It is carried out.

  In view of the above, the main objects of the present invention are as follows: (1) Mechanically performing verification work (test result collation work) that has conventionally been performed mainly by visually comparing and confirming paper information ( To realize a mechanism of automation using a computer), and to provide a technology capable of improving the efficiency of the work. (2) Further, compared with the verification work by visual confirmation of paper information, it is to eliminate (or reduce) confirmation errors and leaks and to realize a more accurate verification work. (3) Furthermore, it has become possible to mechanically carry out defect location identification (determination of defective location candidates), which was conventionally performed separately from test work, together with test work based on data items, It is possible to reduce the defect countermeasure time.

  In order to achieve the above object, a representative embodiment of the present invention is an information processing system (test result collation system) that performs processing for verification / test result collation related to system development, and has the following configuration: It is characterized by having.

  In the system of the present invention, input / output data for a program or the like to be verified / tested (including input and output verification) is input form such as key input (screen input) or direct data input (data reception / reading, etc.). Regardless of the output format such as screen output or form output (printer output), the processing function (input / output information acquisition unit) that acquires and retains it in the form of electronic data information (input information file, output information file) Have

  In this system, input / output data for the target program for verification / testing (including input and output verification), key input (screen input), form input, and direct data input (data reception, reading from recorded information, etc.) ) And other output forms such as screen output and form output (printer output) (at least forms such as screen, form, and direct input are applicable and are not limited to specific forms). The processing function (input / output information acquisition unit) extracts, acquires, and holds necessary information in the form of electronic data information (input information file, output information file).

  In this system, processing functions (related information registration unit, related information DB, etc.) for acquiring and registering correlation information (related information) in input / output data (input information file and output information file) by input and output to the target program etc. ). Furthermore, in this system, the correlation function (related information) of input / output data is accumulated in the database, and the related function can be referred to and updated at the next use (verification) (related information registration unit, related information). DB etc.).

  In addition, this system uses the above input / output data and its correlation information (related information) to mechanically collate (verify) these data information to create comparison result list information with normal / error categories. It has a processing function (input / output comparison unit) for outputting.

  In addition, when a defect or error in the target program or the like is found (detected) as a result of the matching (collation), the system stores program logic or the like (program storage area) corresponding to the target program or the like based on the data item. Search, search and extract the program and line (parts in the program) that are affected / affected by the location where the defect or error occurred, and the candidate for the location where the failure or error occurred It has a processing function (defective part candidate editing unit) that detects and determines, and creates and outputs the information (defective part candidate list).

  According to typical embodiments of the present invention, (1) mechanically performing verification work that has conventionally been performed mainly by visually comparing and confirming paper information to improve the efficiency of the work. be able to. (2) Compared with the verification work by visual confirmation of the paper information, it is possible to eliminate (or reduce) confirmation errors and leaks and realize a more accurate verification work. (3) Furthermore, it is possible to mechanically perform the defect location identification, which has been conventionally performed separately from the test work, based on the data items, and to reduce the defect countermeasure time.

It is a figure which shows typically the whole structure containing the test result collation system by one embodiment of this invention. It is a figure which shows the process outline | summary (example of processing operation) in the test result collation system (method) of this Embodiment. (A) is a schematic diagram showing an image for creating an external file (input) from a PC input screen, and (b) is an image for creating an external file (input) from MT recording information. (A) is a schematic diagram showing an image for creating an external file (output) from a PC output screen, and (b) is an image for creating an external file (output) from MT recording information. It is a schematic diagram which shows the image of the sample of a file specification. It is a flowchart which shows the processing operation example of an input-output information acquisition part. (A) is a data item definition of an input information file, (b) is a schematic diagram which shows the image of the sample of an input information file. (A) is a data item definition of an output information file, (b) is a schematic diagram which shows the image of the sample of an output information file. It is a flowchart which shows the processing operation example of a related information registration part. It is a schematic diagram which shows the sample of a related information file (A, B). It is a schematic diagram which shows the sample of an output value calculation file. It is a flowchart which shows the processing operation example of an input / output comparison part. (A) is the schematic diagram which shows the sample 1 of a calculation result file, (b) is the sample 2; It is a schematic diagram which shows the sample 1 of a comparison result list. It is a schematic diagram which shows the sample 2 of a comparison result list. It is a flowchart which shows the processing operation example of an influence location search part. (A) is a schematic diagram showing a sample 1 of a search result file, and (b) is a sample 2 of FIG. It is a schematic diagram which shows the sample of a program information file. It is a flowchart which shows the processing operation example of a defect location candidate edit part. (A) is the schematic diagram which shows the sample 1 of a defect location candidate list, (b) is the sample 2. FIG.

  Hereinafter, embodiments of the present invention (test result collation system and the like) will be described in detail with reference to the drawings. Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiment, and the repetitive description thereof will be omitted. Note that the test result collation method of the present embodiment comprehensively includes a corresponding system (information processing system), an apparatus (computer), a method, a program, and the like. In the following description, “input” and “output” simply indicate input and output to the verification target program.

  The test result collation method (test result collation system 100 or the like) of the present embodiment shown in FIG. 1 or the like is a screen (terminal input / output screen), tape recording information, or the like during a test (verification) of a target program or the like. The input information (input data) based on the output information (output data) based on the screen (terminal input / output screen), tape recording information, forms (printer output), etc., and the correlation between these inputs and outputs This is a method for confirming (verifying) whether or not the output with respect to the input is valid by using the correlation information (related information) to be held. This confirmation (verification) includes matching (collation) of input (input information) and output (output information). In addition, this method searches for a program based on the name of an item that causes an error, etc., when there is an error as a result of matching (matching) between input and output, and the program and line that use the corresponding item ( By extracting (affected location), it has a processing function of selecting a candidate for a defective location.

  Hereinafter, in the present embodiment, a test (verification) related to processing (corresponding program) for referring to and setting a zip code based on an address acquired from a screen input or an external file will be described as an example.

[system]
FIG. 1 shows an example of the entire configuration including a system (test result collating system) 100 of the present embodiment. As shown in FIG. 1, a system 100 according to the present embodiment is configured as an information processing system on a server 200 (computer). Outside the scope of the system 100, an external file 1, a terminal 2, a file specification 3, And a program storage area 16.

  The terminal 23 of the user (person who performs verification), the server 200, and the like are connected to the network 23. The terminal 2 is a computer such as a general PC, and a user inputs information using a keyboard or the like, and refers to information output to a display screen or a printer. The user accesses the server 200 from the terminal 2 via the network 23 and operates each process of the system 100. As a result, the user can verify (test) the target program and the like. The server 200 includes a control unit 201 (including a processor and the like), a storage unit 202 (memory and disk accessed and used by the control unit 201), a storage unit 203 (disk and tape, other data storage means and data input / output means) Or a paper / document and its capturing / holding means), a communication unit 204 (such as a network interface), and the like. The system 100 is realized in the server 200 when the control unit 201 executes a predetermined software program (including the program of the present embodiment).

  This system 100 includes each processing unit (4, 7, 12, 15, 19) realized on the control unit 201 and each data information (5, 6, 8, 9, 10) realized on the storage unit 202. 11, 13, 14, 17, 18, 20). That is, the system 100 includes processing units such as the input / output information acquisition unit 4, the related information registration unit 7, the input / output comparison unit 12, the affected part search unit 15, and the defective part candidate editing unit 19, the input information file 5, Output information file 6, related information file (A) 8, related information DB 9, related information file (B) 10, output value calculation file 11, calculation result file 13, comparison result list 14, search result file 17, program information file 18 And data information such as a defective part candidate list 20. The system 100 uses data information (external file 1, file specification 3, program storage area 16) in the external storage unit 203.

  The related information file (A) 8 and the related information file (B) 10 are both related information files (information on the correlation between input and output). In this example, they are distinguished by A and B. A shows the flow of data from the input information file 5 to the related information registration unit 7 (related information file (A) 8), and B shows the data flow from the output information file 6 to the related information registration unit 7 (related information file ( B) shows the data flow to 10).

[Outline of processing]
FIG. 2 shows a processing outline (processing operation example) in the system 100 of the present embodiment (the outside of the server 200 is omitted). First, information (terminal input data) input from the terminal 2 and information output to the terminal 2 are converted into data and prepared as an external file 1. In the external file 1, terminal input data and data to be input such as a verification target program are set.

  Next, the external file 1 is read into the input / output information acquisition unit 4. If the content is input (input information), the input information file 5 is generated. If the content is output (output information), the output information file 6 is generated.

  When the input / output data (5, 6) is prepared, the related information registration unit 7 sets the correlation between the input information file 5 and the output information file 6 from the terminal 2 or the like, and the related information file (A) 8 Create as. When the above related information is set, the set related information file (B) 10 can be stored and stored in the related information DB 9. That is, the related information file (A) 8 used for the current development (verification) can be created by utilizing the related information file (A) 8 used in the previous development (verification).

  When the above-mentioned files (5, 6, 8) are ready, the input information file 5, the output information file 6, the related information file (A) 8, and the output value calculation file 11 used for calculation of the output result. Is input to the input / output comparison unit 12. The input / output comparison unit 12 calculates the output result using the input information file 5 and the output value calculation file 11 and creates a calculation result file 13.

  Next, the input / output comparison unit 12 matches (collates) the calculation result file 13 with the output information file 6 to generate a comparison result list 14.

  Further, if an error or the like exists in the comparison result list 14, the influence location search unit 15 searches the program storage area 16 based on the item name of the item that has become the error or confirmation required, and the error or the like is searched. The name of the program that uses the item, the number of description lines, and the description location are output as a search result file 17.

  Next, using the search result file 17 and the program information file 18 which is a list of program types, tasks, and persons in charge, the defective part candidate editing unit 19 creates a defective part candidate list 20. create.

[External file (input)]
FIG. 3A shows an image when the input information (external file 1 (input)) is acquired and created from the input screen of the terminal 2 (PC or the like). The item name and setting value of each item are acquired as shown in the layout image of the external file 1. Similarly, FIG. 3B shows an image when input information (external file 1 (input)) is acquired and created from MT (magnetic tape) recording information.

  Various types of input forms (forms for acquiring input information) are possible, not limited to the example of FIG. 3, and the input / output information acquisition unit 4 has a configuration corresponding to these forms.

[External file (output)]
4A and 4B show an image of acquisition / creation of the external file 1 in the output information, as in the case of input information (FIG. 3).

  Various output forms (forms for acquiring output information) are possible, not limited to the example of FIG. 4, and the input / output information acquisition unit 4 has a configuration corresponding to those forms.

[File specifications]
FIG. 5 shows a specific sample image of the file specification 3. An attribute, the number of digits, an initial value, etc. are set for each item (item name). As shown in the figure, in this example, D_C is a unique serial number, NAME is a name kanji, N_KANA is a name kana, ZIP_C is a zip code, ADDRESS is an address, and TEL_NO is a telephone number.

[Obtain input / output information]
FIG. 6 shows the processing operation of the input / output information acquisition unit 4 (S represents a processing step). The input / output information acquisition unit 4 takes in the input / output data held as the external file 1 (S101), refers to the file specification 3 (matches with the file specification 3), necessary information, attributes and initial values for each item, etc. Is set (S102).

  Next, based on the file name of the external file 1, it is determined whether it is input information or output information (S103). In the case of input information, the input information file 5 is created and output (S104). In the case of output information, the output information file 6 is created and output (S105).

  As the file name of the external file 1, a name starting from “i” is set for input, and a name starting with “o” is set for output. In this example, the input file name is “in_clno001.txt” and the output file name is “out_clno001.txt”.

  Further, when the file specification 3 does not exist, it is possible to set an attribute or the like from the terminal 2 to the screen input.

[Input information file]
FIG. 7A shows the data item definition of the input information file 5. In this example, the input / output information acquisition unit 4 selects and acquires data shown in FIG. 7A from the external file 1 and sets attributes and the like. FIG. 7B shows a specific image of the input information file 5 obtained thereby.

[Output information file]
Similarly, FIG. 8A shows a data item definition of the output information file 6, and FIG. 8B shows a specific image of the output information file 6 obtained thereby.

[Related Information Registration Department]
FIG. 9 shows the processing operation of the related information registration unit 7. The related information registration unit 7 first takes in the input information file 5 and the output information file 6 (S201). Next, the user selects from the terminal 2 whether to use the accumulated file (related information file (B) 10) of the related information DB 9 (Y) or not (N) (S202). When the related information file (B) 10 is not used (N), a related information file (A) 8 is created based on the input information file 5 and the output information file 6 (S203). Next, the related information file (A) 8 is edited (S204). When the editing is completed, the related information file (A) 8 is output (S205).

  When using the related information file (B) in S202 (Y), the related information file (B) 10 to be used is selected from the related information DB 9, and the item difference between the input information file 5 and the output information file 6 is selected. Is created as a related information file (A) 8 (S206). Thereafter, the related information file (A) 8 is edited (S204) and output (S205), as in the case where the related information file (B) 10 is not used as in S203.

[Related information file]
FIG. 10 shows a specific image of the related information file (A) 8. The related information file (B) 10 has a similar format. In this file format, (a) matching type, (b) correlation information, and (c) output format between the items of the input information file 5 and the output information file 6 are set.

  (A) In the present embodiment, the “matching type” can be selected from three types of “complete match”, “correlation”, and “non-target”. Each is managed by a value indicating the type. “Completely matched” means that the setting values of the input information file 5 and the output information file 6 are the same (completely matched). “Correlation” is selected when matching is performed by specifying a correlation other than “perfect match”, such as when calculating an output value based on input information. When “Not applicable” is selected, input / output is not compared.

  (B) The “correlation information” can be set when the “matching type” of a is “correlation”, and a processing method for calculating an output value from an input value is set, or a calculation method The name of the output value calculation file 11 in which the calculation result and the like are set is set. Using this processing method, an output value is calculated based on the input information, and it is determined whether the calculated value and the value of the output information completely match.

  (C) “Output format” is a flag that defines how to output the matching result and determination. In the present embodiment, 0 = “not output”, 1 = {“normal: ○”, “error: ×”}, 2 = {“normal: ○”, “need confirmation: Δ”}, 3 = { An example will be described in which “normal: ○”, “confirmation required: Δ”}, and the like are output to the comparison result list 14. The “confirmation required: Δ” indicates that confirmation is necessary because it is not known whether an error has occurred. In the case of 2 = “required confirmation: Δ”, this indicates that the necessary confirmation is an object of the influence investigation search (affected location search). When 3 = “Confirmation required: Δ”, this indicates that the confirmation is excluded from the impact investigation search.

  As the case where 2 = {◯, Δ} is set, there may be a case where an error occurs under a certain condition or a case where it is predicted in advance that all cases are not normal under the correlation condition set due to data deficiency. For example, in this example, “2” is set as the output format for “TEL_NO”, and it has been found that there are cases where “-” exists and cases where there is no “-” in the data to be matched. Although there is no problem in the above, it is used to set “Δ” on the comparison result list 14 in order to detect a sample of how many data deficiencies without “-” exist in the data.

[Output value calculation file]
FIG. 11 shows a specific image created as the output value calculation file 11. The name of the file is set as a reference destination file in the “correlation information” column of the related information file (A) 8 described above. In this example, address_comp.txt indicating the correlation information of ZIP_C is shown. As shown in the figure, postal code information of output (OUT) is determined according to address information of input (IN).

[Input / output comparison section]
FIG. 12 shows the processing operation of the input / output comparison unit 12. The input / output comparison unit 12 first takes in the input information file 5, the output information file 6, the related information file (A) 8, and the output value calculation file 11 (S301). Next, the head record and head item of the input information file 5 and the related information file (A) 8 are read (S302), and it is determined what the “matching type” is (S303).

  If “completely match” in S303, the setting value of the input information file 5 is used as the calculation result, and accumulation (accumulation) is performed in the calculation result file 13 (S304).

  If “correlation” in S303, the processing method described in the “correlation information” column of the related information file (A) 8 or the designated output value calculation file 11 is read, and the processing result is calculated (S305). Then, the calculation result is accumulated in the calculation result file 13 (S306).

  If “not applicable” in S303, and after the processing of S304 and S306, it is determined whether the next item exists in the related information file (A) 8 (S307).

  If the next item exists (Y), the next item is stored (read) (S308), and the determination of S303 is repeated in the same manner. The processing of S303 to S307 is repeated until the next item does not exist in the determination of S307.

  If the next item does not exist in S307 (N), it is determined whether the next record exists (S309). If the next record exists (Y), the next record is read (S310), and the process returns to S303 to repeat the same process as the first record.

  If there is no next record in S309 (N), the calculation result file 13 is output (S311).

  When the creation of the calculation result file 13 is completed, based on the “matching type” of the related information file (A) 8, matching (collation) between the output information file 6 and the calculation result file 13 from the first item of the first record is performed. It performs (S312). After the matching, the “output format” (flag) of the related information file (A) 8 is determined (S313). If it is “1” or more, the matching result is output in the format specified for the flag, Accumulation for the comparison result list 14 is performed (S314). When the determination in S313 is “0” and when the processing in S314 is completed, it is determined whether there is a next item (S315).

  When the next item exists (Y), the next item is read (S316), and the processing of S313 to S315 is repeated. If the next item does not exist (N), it is determined whether the next record exists (S317). If the next record exists (Y), the next record is read (S318), and the process returns to S313 to repeat the same process as the first record. If there is no next record (N), the comparison result list 14 is output (S319).

[Calculation result file]
FIG. 13A shows a specific image 1 of the calculation result file 13. In the calculation result file 13, the values of the input information file 5, the output information file 6, and the related information file (A) 8 are not set. As described above (FIG. 12), the input information file 5 and the related information file (A) The calculation result acquired using 8 is set.

  FIG. 13B shows an example of the case where “Kana” is excluded from the case where the “matching type” of the related information file (A) 8 is “not applicable” as the image 2 of the calculation result file 13. Show.

[List of comparison results]
FIG. 14 shows an image 1 of an output example of the comparison result list 14. In this example, to express the difference, “ZIP_C” of “002” is an error (×) when “Output Format” = 1, and “TEL_NO” of “003” is “Output Format” = 2 “Confirmation required” (△).

  The comparison result of each item is output for each key. Comparison results such as outputting only normal (when all items match the comparison condition) and outputting only error (when any one item does not match the comparison condition) in the input / output comparison unit 12 The output conditions in the list 14 can be selected.

  FIG. 15 is an example of an output example 2 of the comparison result list 14 when the “matching type” of the related information file (A) 8 is “non-target” and “kana” is not the target. Show.

[Affected location search section]
FIG. 16 shows the processing operation of the affected part search unit 15. The total for each item in the comparison result list 14 is read (S401), and information on the first item in the comparison result list 14 is acquired (S402). With respect to the information of the first item, it is determined whether or not “Shrinking” (output format) is “0” (not subject to matching) (S403). If it is other than “0” (N), “Shrinking” It is determined whether or not “SHIKI” is “2” (confirmation is required for the impact investigation search) (S404).

  If it is other than "0" and other than "2" (N) (ie "1"), that is, if "Confirmation required" is not targeted for impact investigation, the number of errors is other than "0" ("1" or more) It is determined whether or not (S405). When it is other than “0” (Y), that is, when one or more errors have occurred in the corresponding item, the programs in the program storage area 16 are accessed in ascending order (S406). It is determined whether there is a data item name to be searched in the accessed program (S407). If it exists (Y), the program name or program ID (hereinafter referred to as P-ID) and the data item name are determined. The number of all the rows in which there exists is accumulated (S408). If the accumulation is completed or the data item name does not exist in the determination of S407 (N), it is determined whether the next program exists in the program storage area 16 (S409).

  When the next program exists (Y), the next program is read (S410), and the processes of S407 to S409 are repeated. If there is no next program (N), it is determined whether there is a next item in the tabulation by item of the comparison result list 14 (S411).

  When the next item exists (Y), the next item is read (S412), and the processes of S403 to S411 are repeated. When the next item does not exist (N), the search result file 17 is output (S413).

  Note that, in the process of S403, if “Shrinking” is “0” (excluded from matching) (Y), the process proceeds to S411.

  Also, if “Shrinking” is “2” in the processing of S404 (“required confirmation” is a search target) (Y), the process proceeds to S414, and the total number of errors and confirmations required for the item is displayed. Is not “0” (“1” or more) is checked (S414). If “0” (N), the process proceeds to S411. If it is “1” or more (Y), the process proceeds to S406.

[Search result file]
FIG. 17A shows a specific image 1 of the search result file 17. If there is no error for the data item, “***** Sensation *****” (all cases are normal) is output. If an error exists, the corresponding item is used. -Set the ID, the number of lines in which the item name is written, and the contents of each line.

  FIG. 17 (b) shows a case where “Yokakunin” is also included in the search condition as the image 2 in the search result file 17. Compared with FIG. 17 (a), “△” (requires confirmation) The search results for "TEL_NO" for which) was set are also output.

[Program information file]
FIG. 18 shows a specific image of the program information file 18. In the program information file 18, basic information (P-ID, program name, business name, subsystem name, (current) repair status, person in charge, etc.) of each program is set.

[Bad point candidate editing section]
FIG. 19 shows the processing operation of the defective part candidate editing unit 19. In the following, it is assumed that there is no duplicate P-ID in the program information file 18. First, the search result file 17 and the program information file 18 are read (S501), and the top item of the search result file 17 is read (S502).

  Next, it is determined whether or not a P-ID is set for the corresponding item (S503). If it is set (Y), the P-ID of the search result file 17 matches the P-ID of the program information file 18. Until this time, the program information file 18 is searched (S504). Detailed information set in the program information file 18 for the matched P-ID is set in the search result file 17 (S505).

  After the detailed information setting is completed, it is determined whether the next P-ID exists in the corresponding item (S506). If the next P-ID exists (Y), the next P-ID is read (S507). , S504 to S506 are repeated.

  When the P-ID is not set in the corresponding item in S503 (N), and when the next P-ID does not exist in the corresponding item in S506 (N), it is determined whether the next item exists (S508), When the next item exists (Y), the next item is read (S509), and the processes of S503 to S508 are repeated.

  If the next item does not exist in S508 (N), the comparison result file 17 in which the detailed information has been set is output as the defective part candidate list 20 (S510).

[Bad point candidate list]
FIG. 20A shows a specific image 1 of the defective part candidate list 20. The defect location candidate list 20 is compared from the search result file 17, and detailed information of each program is set.

  FIG. 20B shows a case where “yokakunin” is also included in the search condition as the second image 20 of the defective portion candidate list 20.

  The defective part candidate list 20 can also describe a list of candidate programs obtained by extracting only program information and program detailed information at the end of the list by setting.

[Effects]
As described above, according to the configuration of the present embodiment, data information (5, 6) that is input and output of processing is acquired, and mechanical information is obtained based on related information (8, 10) of input / output. It is possible to check the validity of the output information. As a result, highly efficient and reliable verification work can be performed.

  In addition, since it is processed mechanically, verification work can be easily performed even in existing locations that are not related to development. It is possible to efficiently confirm that no.

  By using this technology, it is possible to mechanically verify the correlation and validity between input data and output value in the verification process in system development, and to reduce the man-hours related to verification. In addition, when a possibility of a failure is detected by the matching check, the defective portion candidate (20) is automatically extracted, so that it is possible to reduce the time required for specifying the defective portion.

  As mentioned above, the invention made by the present inventor has been specifically described based on the embodiment. However, the present invention is not limited to the embodiment, and various modifications can be made without departing from the scope of the invention. Needless to say.

  The present invention can be used for a system development / verification tool and the like.

  DESCRIPTION OF SYMBOLS 1 ... External file, 2 ... Terminal, 3 ... File specification, 4 ... Input / output information acquisition part, 5 ... Input information file, 6 ... Output information file, 7 ... Related information registration part, 8 ... Related information file (A) , 9 ... Related information DB, 10 ... Related information file (B), 11 ... Output value calculation file, 12 ... Input / output comparison unit, 13 ... Calculation result file, 14 ... Comparison result list, 15 ... Influence location search unit, 16 DESCRIPTION OF SYMBOLS ... Program storage area, 17 ... Search result file, 18 ... Program information file, 19 ... Defect location candidate edit part, 20 ... Defect location candidate list, 23 ... Network, 100 ... Test result collation system, 200 ... Server, 201 ... Control , 202 ... storage unit, 203 ... storage unit, 204 ... communication unit.

Claims (6)

A test result verification system that supports execution of a test operation including verification of input and output of a target program using information processing of a computer,
In accordance with an input form including screen input and form input related to the input, processing for extracting the necessary information of the test as data information and holding it as an input information file, and an output form including screen output and form output related to the output In response, an input / output information acquisition unit that performs processing for extracting necessary information for the test as data information and holding it as an output information file;
An input / output comparison unit that performs processing of automatically comparing the input and output using the input information file and the output information file, and outputting comparison result list information including normal / error classification And a test result matching system characterized by comprising: The test result collating system according to claim 1 ,
A related information registration unit that performs processing for correlating input and output data information by the input / output information acquisition unit and registering them as a related information file;
The input / output comparison unit uses the input and output data information and the related information file to collate the input and output data information according to the contents of the related information file, A test result collating system characterized by outputting as comparison result list information. In the test result collation system according to claim 2 ,
The related information registration unit accumulates the related information file in a database, and refers to or updates the input / output comparison unit by using the related information file stored in the database at each test. A test result collation system characterized in that a related information file used for collation can be created. The test result collating system according to claim 1 ,
As a result of the collation by the input / output comparison unit, for the data item in which there is a defect or error, the target program is searched using the name or ID of the data item as a key, and the corresponding or affected program name or the data item is used An affected part search unit that outputs search result information including
Using the search result information and a program information file including basic information of the target program, a program and a line that are defective part candidates that are judged to have a possibility of a defect or an error are determined and A test result collating system comprising: a defective part candidate editing unit that creates and outputs list information. A test result collation method for supporting execution of test work including collation of input and output of a target program using information processing of a computer,
In accordance with an input form including screen input and form input related to the input, processing for extracting the necessary information of the test as data information and holding it as an input information file, and an output form including screen output and form output related to the output In response, an input / output information acquisition step for performing processing for extracting information necessary for the test as data information and holding it as an output information file;
An input / output comparison step of performing an automatic comparison process on the input / output collation using the input information file and the output information file, and outputting a comparison result list information including a normal / error classification And a test result collating method characterized by comprising: A test result collation program for causing a computer to execute information processing for supporting execution of test work including collation of input and output of a target program,
In accordance with an input form including screen input and form input related to the input, processing for extracting the necessary information of the test as data information and holding it as an input information file, and an output form including screen output and form output related to the output In response, input / output information acquisition processing including processing for extracting information necessary for the test as data information and holding it as an output information file;
An input / output comparison process including a process of automatically comparing the input and output using the input information file and the output information file and outputting comparison result list information including normal / error categories And causing a computer to execute the test result collation program.

Images