JP2018106398A - Test support program and test support device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a test support device capable of enhancing efficiency of a test.SOLUTION: A test support device 101 accepts an input of an input test case 100 that each of a plurality of workers is in charge, and a database (DB) 102 stores a test case (past test case) implemented in the past. The test support device, regarding the input test case that the plurality of workers are in charge, compares the input test cases with each other, and outputs a comparison result 110. The test support device outputs comment data 120 prompting streamlining of the work if the cases are similar in the comparison result. The test support device compares the input test case with the past test case, and outputs a comparison result. If the cases are similar, the test support device outputs a work log 130 of the similar past test case.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a test support program and a test support apparatus that support a test.

  Patent Document 1 discloses a test support technique for extracting test cases in consideration of past test results and priorities. Further, Patent Document 2 discloses a test support technology for specifying an individual test to be executed according to a changed part of a test target program.

JP 2007-102475 A Japanese Patent Laying-Open No. 2015-26222

  In a software development project, multiple people test the software under development in parallel during a limited time at the end of the project. Therefore, it is desired that the software development project as a whole be tested between the workers and with high work efficiency. However, the test support techniques described in the above technical documents 1 and 2 only support the extraction of test cases, and how to share and implement the extracted test cases in order to increase the work efficiency of the entire software development project. We cannot support it until it is good.

  An object of the present invention is to improve the efficiency of testing.

  A test support program and a test support apparatus according to one aspect of the invention disclosed in the present application are provided in accordance with a test case that defines conditions given to a test target, a process expected by the test, and a result of the process. A test support program and a test support apparatus for supporting a test on a computer, wherein the processor compares a first test case to be evaluated with a second test case to be compared, and a comparison process. A calculation process for calculating a degree of coincidence between the first test case and the second test case based on a comparison result; an output process for outputting identification information of the second test case and a calculation result by the calculation process; , Is executed.

  According to the representative embodiment of the present invention, it is possible to improve the efficiency of the test. Problems, configurations, and effects other than those described above will become apparent from the description of the following embodiments.

FIG. 1 is an explanatory diagram illustrating an example of test support. FIG. 2 is an explanatory diagram illustrating a system configuration example of the test support system. FIG. 3 is a block diagram illustrating a hardware configuration example of a computer (test support apparatus and terminal). FIG. 4 is an explanatory diagram illustrating an example of an input test case. FIG. 5 is an explanatory diagram showing an example of a past test case. FIG. 6 is an explanatory diagram showing an example of the contents stored in the DB. FIG. 7 is an explanatory diagram of an example of the contents stored in the weighting table. FIG. 8 is an explanatory diagram of an example of the contents stored in the comment determination table. FIG. 9 is a block diagram illustrating a functional configuration example of the test support apparatus. FIG. 10 is an explanatory diagram illustrating an example of comparison processing between a target record and a comparison record. FIG. 11 is an explanatory diagram illustrating an example of calculating the coincidence. FIG. 12 is an explanatory diagram showing a display screen example 1. FIG. 13 is an explanatory diagram illustrating a display screen example 2. FIG. 14 is an explanatory diagram showing a display screen example 3. FIG. 15 is an explanatory diagram illustrating a display screen example 4. FIG. 16 is a flowchart illustrating an example of test support processing. FIG. 17 is a flowchart showing a detailed processing procedure example of the first determination processing (step S1604) shown in FIG. FIG. 18 is a flowchart showing a detailed processing procedure example of the comparison processing (step S1705) shown in FIG. FIG. 19 is a flowchart illustrating a detailed processing procedure example of the comment determination processing (step S1708) illustrated in FIG. FIG. 20 is a flowchart showing a detailed processing procedure example of the second determination processing (step S1605) shown in FIG. FIG. 21 is a flowchart showing another processing procedure example of the second determination processing (step S1605) shown in FIG. FIG. 22 is a flowchart illustrating an example of a process for setting output information for the number of matching cases when the number is equal to or greater than the target number. FIG. 23 is a flowchart illustrating a processing example in which output information is set for the number of matches when the number is equal to or less than the target number.

  The test support apparatus according to the present embodiment is an apparatus that performs test support for a test target according to a test case that defines conditions given to the test target, a process expected by the test, and a result of the process. A test case is a condition given to the software under test, such as “This input is given under such conditions and such processing is performed and such an output result is obtained.” This data defines the process expected by the test and the result of the process. The test target is not limited to software, but may be hardware such as a circuit.

<Example of test support>
FIG. 1 is an explanatory diagram illustrating an example of test support. Each input test case 100 is a test case that is handled by each of a plurality of workers. The test support apparatus 101 receives input from the input test case 100. The test support apparatus 101 includes a database (DB 102) 102. The DB 102 stores test cases executed in the past (past test cases).

  The test support apparatus 101 (1) compares the input test cases 100 with respect to the input test cases 100 handled by a plurality of workers, and outputs a comparison result 110. If they are similar in the comparison result 110, the test support apparatus 101 outputs comment data 120 that promotes work efficiency. By referring to the comments in the comment data 120, a plurality of workers can collaboratively perform tests or omit duplicate tests.

  In addition, the test support apparatus 101 compares (2) the input test case 100 with the past test case, and outputs a comparison result 110. If the comparison results 110 are similar, the test support apparatus 101 outputs a work log 130 of similar past test cases. In addition, the test support apparatus 101 outputs detailed information 140 that defines in detail the content of the degree of similarity with similar past test cases.

  By referring to the work log 130 and the detailed information 140, the worker can predict test results and software improvement points, and can consult with a worker who has executed a past test case.

  In this way, the test support apparatus 101 compares the input test case 100 with another input test case 100 or a past test case that is a past input test case, so that the operator can determine whether the input test case 100 is another test case. Whether or not it is similar to the input test case 100 or the past test case, what kind of comment can be obtained if it is similar to the other input test case 100, and how much match is similar to the past test case You can check if you want to. In addition, it is possible to confirm which items of the input test case 100 match and which items do not match.

<System configuration example>
FIG. 2 is an explanatory diagram showing a system configuration example of the test support system 200. The test support system 200 includes a test support apparatus 101 and one or more terminals 201. The test support apparatus 101 and one or more terminals 201 are communicably connected via a network 210 such as the Internet, a LAN (Local Area Network), and a WAN (Wide Area Network).

<Hardware configuration example>
FIG. 3 is a block diagram illustrating a hardware configuration example of a computer (the test support apparatus 101 and the terminal 201). The computer 300 includes a processor 301, a storage device 302, an input device 303, an output device 304, and a communication interface (communication IF 305). The processor 301, the storage device 302, the input device 303, the output device 304, and the communication IF 305 are connected by a bus 306. The processor 301 controls the computer 300. The storage device 302 serves as a work area for the processor 301. The storage device 302 is a non-temporary or temporary recording medium that stores various programs and data including a test support program. Examples of the storage device 302 include a ROM (Read Only Memory), a RAM (Random Access Memory), an HDD (Hard Disk Drive), and a flash memory. The input device 303 inputs data. Examples of the input device 303 include a keyboard, a mouse, a touch panel, a numeric keypad, and a scanner. The output device 304 outputs data. Examples of the output device 304 include a display and a printer. The communication IF 305 is connected to the network 210 and transmits / receives data.

<Example of test case>
FIG. 4 is an explanatory diagram illustrating an example of an input test case. The input test case 100 is a test case that is input to the test support apparatus 101. The input test case 100 is, for example, a test case that has not yet been used for testing. The input test case 100 has items 401 and contents 402. The item 401 is detailed information that classifies the input test case 100, and includes, for example, an operator ID 411, a test ID 412, an environment 413, preparation 414, execution 415, and a result 416. The content 402 is specific data of each item 411-416.

  The worker ID 411 is identification information that uniquely identifies a worker who performs a test work using the input test case 100. Although not shown, it is assumed that the worker ID 411 is associated with the name and affiliation of the worker. The test ID 412 is identification information that uniquely identifies a test and a test case. The environment 413 is an environment for executing a test using a test case. Preparation 414 is a preparatory work required before the test execution. Execution 415 is a test execution content. A result 416 is a result to be confirmed after the test execution. The environment 413 and the preparation 414 correspond to the conditions given to the test target. The execution 415 corresponds to a process expected by the test. The result 416 corresponds to the result of the process.

  FIG. 5 is an explanatory diagram showing an example of a past test case. The past test case TC0 is a test case in which a test log 517 is given to the input test case 100 when the input test case 100 is used for the test. The past test case TC0 is stored in the DB 102 shown in FIG. Similar to the input test case 100, the past test case TC0 has items 401 and contents 402. The item 401 is detailed information that classifies the input test case 100. In the past test case TC0, for example, the worker ID 411, the test ID 412, the environment 413, the preparation 414, the execution 415, the result 416, and the test log 517 are included. . The content 402 is specific data of each item. The test log 517 is a file describing a test execution result using a test case. As the contents 402 of the test log 517, for example, a file path accessible to the test log 517 is described.

<Various DBs and tables>
The DB 102 and table will be described. In the description of the DB 102 or the table, the value of the AA field bbb (AA is a field name and bbb is a code) may be expressed as AAbbb. For example, the value of the test ID field 601 is expressed as a test ID 601.

  FIG. 6 is an explanatory diagram showing an example of the contents stored in the DB 102. The DB 102 stores test case information for each test case. The test case history information is information indicating a test case history. Specifically, for example, the DB 102 has a test ID field 601, a total number of contents field 602, and a match count field 603. One test case history information is composed of combinations of values of fields in the same row. The input test case 100 is stored in the DB 102 when the operator operates the test support apparatus 101. The DB 102 is configured by an external server (not shown) that can be accessed via the storage device 302 or the network 210 of FIG.

  The test ID field 601 is a storage area for storing a test ID. The test ID 601 is associated with the storage location of the past test case TC0 of the test. Therefore, when the test ID 601 is designated, the past test case TC0 is called.

  The total contents field 602 is the total number of contents corresponding to items included in the past test case TC0 specified by the test ID 601. However, the contents 402 of the worker ID 411, the test ID 412, and the test log 517 are out of scope. That is, the number of contents 402 corresponding to the condition 413, preparation 414, processing 415, and result 416 is counted. The condition 413, preparation 414, processing 415, and result 416 are referred to as specific items. When the input test case 100 is stored in the DB 102, the test support apparatus 101 counts the total content 602 of the input test case 100. In the example of FIG. 4, the total number of contents 602 is eight. In the case of the past test case TC0 in FIG. 5, the total number of contents 602 is six.

  The match count field 603 is a storage area for storing the match count. The coincidence count 603 is the number of times the past test case TC0 specified by the test ID 601 coincides with the input test case 100. Here, “number of coincidence 603” is the number of times that the overall coincidence M between the input test case 100 and the past test case TC0 specified by the test ID 601 is equal to or greater than a predetermined threshold Mth. A method for calculating the overall matching degree M will be described later.

  FIG. 7 is an explanatory diagram of an example of the contents stored in the weighting table. The weighting table 700 is a table for setting a weight for each item. The weight table 700 has an item field 701 and a weight field 702. The weighting table 700 is configured by an external server (not shown) accessible via the storage device 302 or the network 210 in FIG.

  The specific item field 701 includes an environment 413, a preparation 414, an execution 415, and a result 416 as values. The weight field 702 stores the weight for each specific item 701. The weight 702 is a value between 0 and 1. The weight 702 is a preset value and can be arbitrarily changed by the operator. Further, it may be automatically set according to the number of contents 402 of the specific item 701. For example, in the case of the input test case 100 shown in FIG. 4, the number of contents 402 of the environment 413, preparation 414, execution 415, and result 416 is 1, 4, 1, and 2, respectively. Therefore, the ratio of the weight 702 of the environment 413, preparation 414, execution 415, and result 416 is 1: 4: 1: 2. The sum of the weights 702 of each specific item 701 is normalized to be 1.

  FIG. 8 is an explanatory diagram of an example of the contents stored in the comment determination table. The comment determination table 800 is a table that stores comment determination information related to comments given to the input test case 100. The comment determination table 800 includes a priority field 801, a comment field 802, and a threshold field 803. One comment determination information is constituted by a combination of values of fields in the same row. The comment determination table 800 is configured by an external server (not shown) accessible via the storage device 302 or the network 210 in FIG.

  The priority field 801 is a storage area for storing the priority. The priority 801 is information indicating the order in which comments are adopted, and is expressed by a numerical value, for example. In the present embodiment, the smaller the numerical value, the higher the priority. The comment field 802 is a storage area for storing a comment corresponding to the priority 801. The comment 802 is a character string indicating how much the test case matches when compared with other test cases. The comment 802 is, for example, text data expressing a character string that prompts adjustment of the test execution method. The threshold value field 803 is a storage area for storing a threshold value serving as a reference for the degree of coincidence between the same specific items 701 of the two input test cases 100 and 100 for each specific item 701.

<Functional configuration example>
FIG. 9 is a block diagram illustrating a functional configuration example of the test support apparatus 101. The test support apparatus 101 includes, for example, a DB 102, a comment determination table 800, a comparison unit 901, a calculation unit 902, an output unit 903, a determination unit 904, and an acquisition unit 905. Specifically, the comparison unit 901 to the acquisition unit 905 are functions realized by causing the processor 301 to execute a program stored in the storage device 302 illustrated in FIG. 3, for example.

  The comparison unit 901 is a function realized by causing the processor 301 to execute comparison processing. The comparison process is a process of acquiring the first test case to be evaluated and the second test case to be compared and comparing them. The first test case is, for example, the input test case TC1. The second test case is another input test case TC2 different from the first test case, or a past test case TC0. In the comparison process, the processor 301 acquires the input test cases TC1 and TC2 and stores them in the storage device 302. Further, the processor 301 acquires the past test case TC0 from the DB 102 and stores it in the storage device 302. In the comparison process, the processor 301 compares the same specific item 701 between the first test case and the second test case. Here, a specific example of comparison processing between the same specific items 701 between the first test case and the second test case will be described in detail.

  FIG. 10 is an explanatory diagram illustrating an example of comparison processing between a target record and a comparison record. The target record is a record of the specific item 701 selected from the input test case TC1, which is the first test case. The comparison record is a record of the same specific item 701 selected from the second test case (input test case TC2 or past test case TC0). In the comparison process, the comparison unit 901 compares the first test case and the second test case based on whether or not the character strings that are the contents of the same specific item 701 match.

  Here, as an example, the input test case TC2 is described as being the second test case, but the past test case TC0 is also the same. The input test case TC1 that is the first test case has a comparison result field 1000. The comparison result field 1000 is a storage area for storing a comparison result by comparison processing (“◯” (OK) if they match, “×” (NG) if they do not match).

  For example, when the record of the environment 413 of the input test case TC1 is set as the target record, the record of the environment 413 of the input test case TC2 becomes a comparison record. Therefore, in the comparison process, the comparison unit 901 performs the character string “single” of the contents 402 of the environment 413 of the input test case TC1 that is the target record and the character strings of the contents 402 of the environment 413 of the input test case TC2 that is the comparison record. Compare with “Single”. Since both character strings match, the comparison unit 901 stores “◯” in the comparison result field of the input test case TC1.

  For example, when the record of the preparation 414 of the input test case TC1 is set as a target record, the record of the preparation 414 of the input test case TC2 becomes a comparison record. The record of the preparation 414 of the input test case TC1 has four contents 402, and the record of the preparation 414 of the input test case TC2 has three contents 402. In this case, in the comparison process, the comparison unit 901 compares both contents 402 with brute force. If there is even one matching content 402, the comparison unit 901 stores “◯” in the comparison result field 1000 of the input test case TC1, and if there is no matching content 402, the comparison unit 901 “×” is stored in the comparison result field 1000 of the input test case TC1.

  For example, the character string that matches the character string “HCP cooperation” in the contents 402 of the preparation 414 of the input test case TC1 exists in the contents 402 of the preparation 414 of the input test case TC2. Therefore, the comparison unit 901 stores “◯” indicating a match in the comparison result field 1000 of the preparation 414 of the input test case TC1 whose content 402 is “HCP cooperation”. The same applies to the character string “AD server setting” of the content 402.

  In addition, the character string that matches the character string “migrated” in the contents 402 of the preparation 414 of the input test case TC1 does not exist in the contents 402 of the preparation 414 of the input test case TC2. Accordingly, the comparison unit 901 stores “x” indicating a mismatch in the comparison result field 1000 of the preparation 414 of the input test case TC1 whose content 402 is “migrated”.

  Further, the character string “new file system creation” exists in the content 402 of the preparation 414 of the input test case TC1, and the character string “create new file system” exists in the content 402 of the preparation 414 of the input test case TC2. In the comparison process, an ambiguous match is adopted instead of an exact match. An existing search technique is adopted for the fuzzy match search. For example, in the fuzzy match search, the comparison unit 901 determines a match or mismatch based on the search results of the partial match search, the forward match search, and the backward match search, and the ratio of character strings that are completely matched.

  For example, when both character strings match forward, the comparison unit 901 performs a partial match search between the remaining subsequent character strings. When both character strings match backward, the comparing unit 901 performs a partial match search between the remaining preceding character strings. In addition, when both character strings are matched forward and backward, the comparison unit 901 performs a partial match search between the remaining intermediate character strings. If both character strings are in the middle, the comparing unit 901 performs a partial match search between the remaining preceding character string and the subsequent character string. In these searches, the comparison unit 901 determines that they match as a whole if the ratio of partial matching is equal to or greater than a predetermined ratio.

  In the above-described examples of “new file system creation” and “new file system creation”, both character strings are backward-matched with respect to the character string “creation”. The comparison unit 901 performs a partial match search between the remaining character strings “file system new” and “new file system”. In the partial match search, the character strings “file system” and “new” that constitute “file system new” both exist in “new file system”, and therefore partially match. Therefore, the partially matching ratio is 2/2 (= 100%). For example, when the predetermined ratio is 80%, 2/2 (= 100%) is equal to or greater than the predetermined ratio. Therefore, “create new file system” and “create new file system” match. Accordingly, the comparison unit 901 stores “◯” indicating a match in the comparison result field 1000 of the preparation 414 of the input test case TC1 whose content 402 is “create new file system”.

  Returning to FIG. 9, the calculation unit 902 is a function realized by causing the processor 301 to execute calculation processing. The calculation process is a process for calculating the degree of coincidence between the first test case and the second test case based on the comparison result of the comparison process. The comparison result by the comparison process is the value (◯ or ×) in the comparison result field 1000. Here, a calculation processing example will be specifically described.

  FIG. 11 is an explanatory diagram illustrating an example of calculating the degree of coincidence. The calculation result 1100 includes the item field 401, the content field 402, the comparison result field 1000, the specific item matching degree field 1111, and the overall matching degree field 1112 described above. The contents 402 and the comparison result 1000 correspond to FIG.

  The specific item matching degree field 1111 is a storage area for storing the specific item matching degree. The specific item matching degree 1111 indicates the degree to which the contents 402 of the same specific item 701 match between the first test case and the second test case. The specific item matching degree 1111 is calculated by the calculation unit 902 for each specific item 701. The specific item coincidence 1111 is a ratio of the number of contents 402 in the specific item 701 where the comparison result 1000 is “◯”. For example, the number of contents 402 of the preparation 414 is four, “HCP cooperation”, “AD server setting”, “Migrated”, and “Create new file system”. Further, there are three contents 402 with a comparison result 1000 of “◯”: “HCP cooperation”, “AD server setting”, and “New file system creation”. Therefore, the specific item coincidence 1111 of the preparation 414 is 3/4 (= 75%).

  The overall matching degree field 1112 is a storage area for storing the overall matching degree M. The overall matching degree M is calculated by the following equation (1) using the specific item matching degree 1111 and the weight of the specific item 701.

M = M1 × w1 + M2 × w2 + M3 × w3 + M4 × w4 (1)

  In the formula (1), M is the overall matching degree. M1 is the specific item matching degree 1111 of the environment 413, and w1 is the weight 702 of the environment 413. M2 is the specific item matching degree 1111 of preparation 414, and w2 is the weight 702 of preparation 414. M3 is the specific item matching degree 1111 of execution 415, and w3 is the weight 702 of execution 415. M4 is the specific item matching degree 1111 of the result 416, and w4 is the weight 702 of the result 416.

  Returning to FIG. 9, the output unit 903 is a function realized by causing the processor 301 to execute output processing. The output process is a process of outputting identification information of the second test case and a calculation result 1100 (hereinafter collectively referred to as “output information”) by the calculation process. When the second test case is the input test case TC2, the output unit 903 outputs the test ID 412 and the calculation result 1100. The output unit 903 transmits the output information to the terminal 201 via the network 210 by the communication IF 305, outputs it to the output device (display or printer) 304, or stores it in the storage device 302.

  The output unit 903 may output the comparison result 1000 of each of the plurality of specific items 701 as output information. Thereby, it is possible to confirm which specific item specifically matches. The output unit 903 may output identification information of the creator of the second test case as output information. The creator is an operator who creates a second test case and performs a test using the second test case. The creator identification information is the worker ID 411. Thereby, the operator of the input test case TC1 can adjust the test with the specified operator. Further, when the second test case is the past test case TC0, the output unit 903 may output the test log 517 or information indicating the storage location of the test log 517 (for example, a file path) as output information. Thereby, the operator of the input test case TC1 can check the specified test log 517.

  The determination unit 904 is a function realized by causing the processor 301 to execute determination processing. The determination process is a process for determining whether or not the overall matching degree M is greater than or equal to a threshold value Mth. In this case, the output unit 903 outputs the output information when it is determined by the determination process that the threshold value is greater than or equal to the threshold value Mth.

  The acquisition unit 905 is a function realized by causing the processor 301 to execute an acquisition process. The acquisition process is a process of acquiring a comment corresponding to the specific item matching degree calculated by the calculation process from the comment determination table 800. Specifically, for example, the acquisition unit 905 determines that each of the specific item matching degrees of the specific item 701 (environment 413, preparation 414, execution 415, result 416) is equal to or higher than the threshold value 803 of the comment determination table 800. The comment 802 with the highest priority 801 is output.

  For example, when all the specific item matching degrees are 90%, the acquisition unit 905 is a comment 802 having a priority 801 of “1”. It may be a duplicate. ”Is acquired. Further, when the degree of coincidence of each specific item is 90% (environment 413), 80% (preparation 414), 90% (execution 415), and 90% (result 416), the threshold of priority 801 is “1”. The value 803 is not satisfied. In this case, since the priority 801 satisfies the threshold value 803 with “2”, the acquisition unit 905 is a comment 802 with the priority 801 “2”. ”Is acquired. In this case, the output unit 903 outputs the comment 802 acquired by the acquisition unit 905 as output information.

  Next, another determination process by the determination unit 904 will be described. In the determination process described above, the number of past test cases TC0 in which the overall matching degree M is equal to or greater than the threshold value Mth may appear significantly below the target number assumed by the operator. If the target number is significantly below, the test case TC0 to be compared falls short, and the operator lowers the threshold value Mth by trial and error so that it becomes equal to or greater than the target number. Test assistance must be performed. Therefore, the adjustment burden on the worker increases, and work delay occurs due to re-execution of test support.

  For this reason, the determination unit 904 includes a first determination unit 941, a second determination unit 942, and an update unit 943. The first determination unit 941 is a function realized by causing the processor 301 to execute a first determination process. The first determination process is a process for determining whether or not the overall matching degree M is greater than or equal to a threshold value Mth.

  The second determination unit 942 is a function realized by causing the processor 301 to execute the second determination process. The second determination process is a process of determining whether or not the number of past test cases TC0 in which the overall matching degree M is equal to or greater than the threshold value Mth (hereinafter, the number of matches) is equal to or greater than the target number. The target number is the number (specified number) designated in advance by the operator by performing an operation input from the test support apparatus 101 (or terminal 201).

  The update unit 943 is a function realized by causing the processor 301 to execute update processing. The update process is a process for updating the threshold value Mth by reducing the threshold value Mth by a predetermined amount ΔMth. The update process is a process for updating the number of matches in which the overall match degree M is equal to or greater than the threshold value Mth.

  Thereby, the determination part 904 can set output information about the number of coincidence at the time when it becomes more than the target number. Therefore, the burden of adjusting the threshold value Mth by the operator is reduced, and work delay can be suppressed by re-execution of test support.

  Similarly, in the determination process described above, the number of past test cases TC0 in which the overall matching degree M is equal to or greater than the threshold value Mth may appear significantly greater than the target number assumed by the operator. When the target number is greatly exceeded, the past test cases TC0 to be compared become excessive, the check burden on the worker increases, and work delay occurs.

  For this reason, the determination unit 904 includes a first determination unit 941, a second determination unit 942, and an update unit 943. The first determination unit 941 is a function realized by causing the processor 301 to execute a first determination process. The first determination process is a process for determining whether or not the overall matching degree M is greater than or equal to a threshold value Mth.

  The second determination unit 942 is a function realized by causing the processor 301 to execute the second determination process. The second determination process is a process for determining whether or not the number of past test cases TC0 (hereinafter, the number of matching cases) in which the overall matching degree M is equal to or greater than the threshold value Mth is equal to or less than the target number. The target number is the number of cases designated in advance by the operator by performing an operation input from the test support apparatus 101 (or the terminal 201).

  The update unit 943 is a function realized by causing the processor 301 to execute update processing. The update process is a process for updating the threshold value Mth by increasing the threshold value Mth by a predetermined amount ΔMth. The update process is a process for updating the number of matches in which the overall match degree M is equal to or greater than the threshold value Mth.

  As a result, the determination unit 904 can set output information for the number of matching cases when the number is equal to or less than the target number. Therefore, an operator's check burden can be reduced and work delay can be suppressed.

<Example of output information display screen>
Next, a display screen example of output information output by the output unit 903 will be described. The display screen is displayed on the display of the test support apparatus 101 or the terminal 201, for example.

  FIG. 12 is an explanatory diagram showing a display screen example 1. The display screen 1200 displays the comparison result 110 shown in FIG. The display screen 1200 includes a test ID field 1201, an input test case analysis result field 1202, and a past test case analysis result field 1203. The test ID field 1201 displays the test ID 412 of the second test case whose overall matching degree M is equal to or greater than the threshold value Mth. The input test case analysis result field 1202 displays the input test case analysis result. The input test case analysis result 1202 is information indicating whether or not the input test case TC1 to be evaluated is similar to another input test case TC2. When it is similar, “◯” is displayed, and when it is not similar, “×” is displayed. A hyperlink is embedded in “○”.

  The operator can operate the cursor C and click “◯”. When the input test case analysis result 1202 of “◯” is clicked, the test ID 412 of another similar input test case TC2, the overall matching degree M with the other input test case TC2, and the determined comment 802 are displayed. Is done. For example, when the input test case analysis result 1720 of “◯” is clicked, the screen transitions to the display screen 1300 in FIG.

  When the past test case TC0 analysis result of “O” is clicked, the test ID of the similar past test case TC0, the overall matching degree M with the past test case TC0, and the storage location (file path) of the test log are displayed. Is done. For example, when the input test case analysis result 1730 of “◯” is clicked, the screen transitions to the display screen 1400 of FIG.

  FIG. 13 is an explanatory diagram illustrating a display screen example 2. FIG. 13 shows a display screen 1300 related to another input test case similar to the test case to be evaluated. The display screen 1300 displays the comment data 120 shown in FIG. Specifically, for example, this is a display screen that is transitioned by clicking the input test case analysis result 1720 of “◯” shown in FIG. The display screen 1300 includes a test ID field 1301, an overall matching degree field 1302, and a comment field 1303. The test ID field 1301 displays the test ID 412 of another input test case TC2 similar to the input test case TC1 to be evaluated. The overall coincidence field 1302 displays the overall coincidence M between the input test case TC1 to be evaluated and another input test case TC2 specified by the test ID 412. When the overall matching degree 1302 is clicked, the screen transitions to a display screen 1500 having the content 402 and the comparison result 1000 for each specific item 701 (see FIG. 15). The comment field 1303 displays the comment 802 acquired by the acquisition unit 905.

  FIG. 14 is an explanatory diagram showing a display screen example 3. FIG. 14 shows a display screen 1400 related to a past test case TC0 similar to the test case to be evaluated. The display screen 1400 displays the work log 130 shown in FIG. Specifically, for example, this is a display screen that is transitioned by clicking the past test case TC0 analysis result 1730 of “◯” shown in FIG. The display screen 1400 includes a test ID field 1401, an overall matching field 1402, and a test log field 1403. The test ID field 1401 displays the test ID 412 of the past test case TC0 similar to the input test case TC1 to be evaluated. The overall matching degree field 1402 displays the overall matching degree M between the input test case TC1 to be evaluated and the past test case TC0 specified by the test ID 412. When the overall matching degree 1402 is clicked, the screen transitions to a display screen 1500 having the contents 402 and the comparison result 1000 for each specific item 701 (see FIG. 15). The test log field 1403 displays the storage location (file path) of the test log 517 of the past test case TC0 specified by the test ID 412. By clicking the file path with the cursor C, the test log 517 can be accessed.

  FIG. 15 is an explanatory diagram illustrating a display screen example 4. FIG. 15 shows a display screen 1500 that transitions when the overall matching degree 1402 in FIG. 13 or 14 is clicked. The display screen 1500 displays the detailed information 140 shown in FIG. The display screen 1500 includes an item field 1501, a content field 1502, and a comparison result field 1503. The item field 1501 displays items 411 to 416. The content field 1502 displays the content 402 corresponding to the items 411 to 416 of the second test case similar to the first test case. The comparison result field 1503 displays the comparison result of the specific item 701 between the first test case and a similar second test case.

<Test support processing>
FIG. 16 is a flowchart illustrating an example of test support processing. The test support apparatus 101 acquires one or more input test cases 100 (input test case group) (step S1601). The acquired input test case 100 is stored in the storage device 302. The test support apparatus 101 determines whether there is an unselected input test case 100 in the input test case group (step S1602). When there is an unselected input test case 100 (step S1602: Yes), the test support apparatus 101 selects an unselected input test case 100 (step S1603). The selected input test case 100 is, for example, the input test case TC1.

  Then, the test support apparatus 101 executes the first determination process (step S1604) and the second determination process (step S1605), and returns to step S1602. When there is no unselected input test case 100 (step S1602: No), the test support apparatus 101 executes an output process (step S1606) and ends a series of processes.

  FIG. 17 is a flowchart showing a detailed processing procedure example of the first determination processing (step S1604) shown in FIG. The test support apparatus 101 determines whether there is another unselected input test case 100 (step S1701). When there is another unselected input test case 100 (step S1701: Yes), the test support apparatus 101 selects another unselected input test case 100 (input test case 100 to be compared) (step S1702). . The selected input test case 100 is, for example, the input test case TC2.

  The test support apparatus 101 determines whether there is an unselected specific item 701 in the input test case TC1 (evaluation target input test case) selected in step S1603 (step S1703). When there is an unselected specific item 701 (step S1703: Yes), the test support apparatus 101 selects a record of the unselected specific item 701 from the input test case TC1 to be evaluated and the input test case TC2 to be compared. (Step S1704). A record selected from the input test case TC1 to be evaluated is referred to as a target record. A record selected from the input test case TC2 to be compared is referred to as a comparison record.

  The test support apparatus 101 executes the comparison process (step S1705) and returns to step S1703. Details of the comparison process (step S1705) will be described later with reference to FIG. By the comparison process (step S1705), a comparison result for each specific item 701 is obtained.

  In step S1703, when there is no unselected specific item 701 (step S1703: No), the test support apparatus 101 performs a calculation process (step S1706). In the calculation process (step S1706), the test support apparatus 101 calculates the specific item coincidence degree, and uses the calculated specific item coincidence degree and the weight 702 for each specific item 701 to compare with the input test case TC1 to be evaluated and the comparison object. The total coincidence M with the input test case TC2 is calculated.

  The test support apparatus 101 determines whether or not the overall matching degree M is greater than or equal to the threshold value Mth (step S1707). If the overall matching degree M is equal to or greater than the threshold value Mth (step S1707: Yes), the test support apparatus 101 executes a comment determination process (step S1708). Details of the comment determination process (step S1708) will be described later with reference to FIG. In the comment determination process (step S1708), a comment 802 for the input test case TC1 to be evaluated and the input test case TC2 to be compared is determined.

  The test support apparatus 101 sets the test ID 412 of the input test case TC2 to be compared, the overall matching degree M, the comment 802, and the comparison result 1000 of the specific item 701 as output information (step S1709), and proceeds to step S1701. In step S1707, when the overall matching degree M is not equal to or greater than the threshold value Mth (step S1707: No), the process proceeds to step S1701.

  In step S1701, when there is no other input test case TC2 that has not been selected (step S1701: No), the test support apparatus 101 ends the first determination process (step S1604) and proceeds to the second determination process (step S1605). Transition. Details of the second determination process (step S1605) will be described later with reference to FIG.

  FIG. 18 is a flowchart showing a detailed processing procedure example of the comparison processing (step S1705) shown in FIG. The test support apparatus 101 determines whether there is an unselected character string in the content of the target record (step S1801). If there is an unselected character string (step S1801: Yes), the test support apparatus 101 selects an unselected character string from the contents of the target record (step S1802). The test support apparatus 101 determines whether the content of the comparison record includes a character string that matches the character string selected in step S1802 (selected character string) (step S1803).

  If there is a character string that matches the selected character string (step S1803: YES), the test support apparatus 101 stores “O” indicating a match in the comparison result 1000 (step S1804), and the process returns to step S1801. On the other hand, if there is no character string that matches the selected character string (step S1803: No), the test support apparatus 101 stores “x” indicating a mismatch in the comparison result 1000 (step S1805), and returns to step S1801. If there is no unselected character string in the content of the target record in step S1801 (step S1801: No), the test support apparatus 101 ends the comparison process (step S1705) and proceeds to step S1703.

  FIG. 19 is a flowchart illustrating a detailed processing procedure example of the comment determination processing (step S1708) illustrated in FIG. The test support apparatus 101 sets the priority variable P to P = 1 (step S1901). The test support apparatus 101 determines whether there is an unselected record with a priority corresponding to the priority variable P in the comment determination table 800 (step S1902). When there is an unselected record of priority 801 corresponding to the priority variable P (step S1902: Yes), the test support apparatus 101 selects an unselected record of priority 801 corresponding to the priority variable P from the comment determination table 800. Select (step S1903).

  The test support apparatus 101 determines whether the specific item matching degree of the target record is equal to or higher than the threshold value 803 of the record (selected record) selected in step S1903 (step S1904). If any one of the specific item matching degrees is not equal to or greater than the threshold value 803 (step S1904: No), the test support apparatus 101 increments the priority variable P and proceeds to step S1902. On the other hand, if the degree of coincidence of all the specific items is greater than or equal to the threshold value 803 (step S1904: Yes), the test support apparatus 101 acquires the comment of the selected record from the comment determination table 800 and sets it as the target record (step S1906). ). As a result, the test support apparatus 101 ends the comment determination process (step S1708). If there is no unselected record of priority 801 corresponding to the priority variable P in step S1902 (step S1902: No), the test support apparatus 101 ends the comment determination process (step S1708).

  FIG. 20 is a flowchart showing a detailed processing procedure example of the second determination processing (step S1605) shown in FIG. The test support apparatus 101 determines whether there is an unselected past test case TC0 (step S2001). When there is an unselected past test case TC0 (step S2001: Yes), the test support apparatus 101 selects an unselected past test case TC0 (step S2002).

  Here, the test support apparatus 101 may select the unselected past test cases TC0 in descending order of the total content 602 of the DB 102. As a result, the number of contents 402 of the past test case TC0 to be compared increases, and the number of trials whether or not the character string of the contents 402 of the input test case TC1 matches is increased. Therefore, the test support apparatus 101 can easily extract a similar past test case TC0.

  In addition, the test support apparatus 101 may select the past test cases TC0 in the descending order of the number of matches 603 that generally matches the input test case TC1. As a result, the test support apparatus 101 can extract the past test case TC0 with emphasis on past results.

  The test support apparatus 101 determines whether or not there is an unselected specific item 701 in the input test case (input test case to be evaluated) TC1 selected in step S1603 (step S2003). When there is an unselected specific item 701 (step S2003: Yes), the test support apparatus 101 selects a record of the unselected specific item 701 from the input test case TC1 and the past test case TC0 to be compared (step). S2004). A record selected from the input test case TC1 is referred to as a target record. A record selected from the past test case TC0 is referred to as a comparison record.

  The test support apparatus 101 executes the comparison process (step S2005) and returns to step S2003. The comparison process (step S2005) is the same process as the comparison process (step S1705). A comparison result for each specific item 701 is obtained by the comparison process (step S2005).

  In step S2003, when there is no unselected specific item 701 (step S2003: No), the test support apparatus 101 performs a calculation process (step S2006). In the calculation process (step S2006), the test support apparatus 101 calculates the specific item coincidence, and uses the calculated specific item coincidence and the weight 702 for each specific item 701 to determine the input test case TC1 and the past test case TC0. The overall matching degree M is calculated.

  The test support apparatus 101 determines whether or not the overall matching degree M is greater than or equal to the threshold value Mth (step S2007). When the overall matching degree M is equal to or greater than the threshold value Mth (step S2007: Yes), the test support apparatus 101 compares the test ID 402, the overall matching degree M, the test log 517, and the specific item 701 of the past test case TC0 1000. Is set as output information (step S2008), and the process proceeds to step S2001. In step S2007, when the overall matching degree M is not equal to or greater than the threshold value Mth (step S2007: No), the process proceeds to step S2001.

  In step S2001, when there is no unselected past test case TC0 (step S2001: No), the test support apparatus 101 ends the second determination process (step S1605) and returns to step S1602.

  Next, the second determination process (step S1605) using the first determination unit 941, the second determination unit 942, and the update unit 943 will be described.

  FIG. 21 is a flowchart showing another processing procedure example of the second determination processing (step S1605) shown in FIG. The same processes as those in FIG. 20 are denoted by the same step numbers and description thereof is omitted. In step S2007, when the overall matching degree M is greater than or equal to the threshold value Mth (step S2007: Yes), the test support apparatus 101 updates the number of matched matches (step S2100). Specifically, the test support apparatus 101 sets the initial value of the number of matches to 0, and increments the number of matches whenever the overall match degree M becomes equal to or greater than the threshold value Mth (step S2007: Yes). Then, the process returns to step S2001.

  In step S2001, when there is no unselected past test case TC0 (step S2001: No), the process proceeds to FIG. 22 or FIG. FIG. 22 is a processing example in which output information is set for the number of matches when the number is equal to or greater than the target number, and FIG. 23 is a processing example in which output information is set for the number of matches when the number is equal to or less than the target number. Which setting process is to be executed is set in advance in the test support apparatus 101 by the operator.

  FIG. 22 is a flowchart illustrating an example of a process for setting output information for the number of matching cases when the number is equal to or greater than the target number. The target number is the number of cases designated in advance by the operator in the test support apparatus 101. In step S2001, if there is no unselected past test case TC0 (step S2001: No), the test support apparatus 101 determines whether or not the number of matches is equal to or greater than the target number (step S2201).

  If the number of matches is not equal to or greater than the target number (step S2201: No), the test support apparatus 101 decreases the threshold value Mth by a predetermined amount ΔMth (step S2202). Then, the test support apparatus 101 identifies the number of matching cases where the overall matching degree M is equal to or greater than the threshold value Mth (step S2203), and returns to step S2201. As described above, the loop processing of steps S2201 to S2203 is executed until the number of matches reaches the target number or more. When the number of matches is equal to or greater than the target number (step S2201: No), the test support apparatus 101 sets output information as in step S2008 (step S2204).

  FIG. 23 is a flowchart illustrating a processing example in which output information is set for the number of matches when the number is equal to or less than the target number. The target number is the number of cases designated in advance by the operator in the test support apparatus 101. In step S2001, when there is no unselected past test case TC0 (step S2001: No), the test support apparatus 101 determines whether the number of matches is equal to or less than the target number (step S2301).

  If the number of matches is not less than the target number (step S2301: No), the test support apparatus 101 increases the threshold value Mth by a predetermined amount ΔMth (step S2302). Then, the test support apparatus 101 specifies the number of matching cases where the overall matching degree M is equal to or greater than the threshold value Mth (step S2303), and returns to step S2301. As described above, the loop processing of steps S2301 to S2303 is executed until the number of matches becomes equal to or less than the target number. When the number of matches is equal to or less than the target number (step S2301: No), the test support apparatus 101 sets output information as in step S2008 (step S2204).

  As described above, according to the present embodiment, it can be confirmed before the test whether it matches with other test cases. Thereby, the duplication work between workers can be suppressed and the work efficiency of the whole development project can be improved.

  The present invention is not limited to the above-described embodiments, and includes various modifications and equivalent configurations within the scope of the appended claims. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and the present invention is not necessarily limited to those having all the configurations described. A part of the configuration of one embodiment may be replaced with the configuration of another embodiment. Moreover, you may add the structure of another Example to the structure of a certain Example. Moreover, you may add, delete, or replace another structure about a part of structure of each Example.

  In addition, each of the above-described configurations, functions, processing units, processing means, etc. may be realized in hardware by designing a part or all of them, for example, with an integrated circuit, etc. It may be realized by software by interpreting and executing the program to be executed.

  Information such as programs, tables, and files for realizing each function is recorded on a memory, a hard disk, a storage device such as an SSD (Solid State Drive), or an IC (Integrated Circuit) card, an SD card, a DVD (Digital Versatile Disc). It can be stored on a medium.

  Further, the control lines and the information lines are those that are considered necessary for the explanation, and not all the control lines and the information lines that are necessary for the mounting are shown. In practice, it can be considered that almost all the components are connected to each other.

101 test support device 901 comparison unit 902 calculation unit 903 output unit 904 determination unit 905 acquisition unit 941 first determination unit 942 second determination unit 943 update unit

Claims (10)

A test support program for causing a processor to perform test support for a test target according to a test case that defines a condition given to the test target, a process expected by the test of the test target, and a result of the process,
In the processor,
A comparison process for comparing the first test case to be evaluated with the second test case to be compared;
A calculation process for calculating a degree of coincidence between the first test case and the second test case based on a comparison result by the comparison process;
An output process for outputting identification information of the second test case and a calculation result by the calculation process;
A test support program characterized in that The test support program according to claim 1,
In the processor,
A determination process for determining whether or not the degree of coincidence is a threshold value or more;
In the output process, the test support program causes the processor to output the identification information of the second test case and the calculation result when it is determined by the determination process that the threshold value is equal to or greater than the threshold value. . The test support program according to claim 1,
The test case has a plurality of items related to the condition, the process, and the result,
In the comparison process, the processor causes the same items to be compared between the first test case and the second test case,
In the calculation process, the test support program causes the processor to calculate a degree of coincidence between the first test case and the second test case based on a comparison result of each of the plurality of items. The test support program according to claim 3,
In the output process, the test support program causes the processor to output a comparison result of each of the plurality of items. The test support program according to claim 1,
The test case includes identification information of a creator of the test case,
In the output processing, the test support program causes the processor to output identification information of the creator of the second test case. The test support program according to claim 1,
The processor is accessible to a storage device that stores comment determination information that stores a comment according to a degree of coincidence indicating how much the test case is compared when compared with other test cases;
The first test case and the second test case are test cases input from the outside,
In the processor,
Executing an acquisition process for acquiring a comment according to the degree of coincidence calculated by the calculation process from the comment determination information;
In the output process, the test support program causes the processor to output a comment acquired by the acquisition process. The test support program according to claim 1,
The first test case is a test case input from the outside,
The second test case has a test log of the test and is stored in a storage device accessible by the processor;
In the output process, the test support program causes the processor to output the test log or information indicating a storage location of the test log. The test support program according to claim 7,
In the processor,
A first determination process for determining whether or not the degree of coincidence is greater than or equal to a threshold value;
A second determination process for determining whether the number of cases of the second test case determined to be equal to or greater than the threshold value by the first determination process is greater than or equal to a specified number;
If it is determined by the second determination process that the number is not equal to or greater than the specified number, an update process for updating the threshold value to a lower value is executed,
In the first determination process, the processor is caused to determine whether or not the degree of coincidence is equal to or higher than a threshold value after update by the update process,
In the second determination process, the processor determines whether or not the number of the second test cases determined to be greater than or equal to the updated threshold value by the first determination process is greater than or equal to the specified number. Let me judge
In the output process, the test support program causes the processor to output identification information of the second test case determined to be equal to or more than the specified number by the second determination process and a calculation result by the calculation process . The test support program according to claim 7,
In the processor,
A first determination process for determining whether or not the degree of coincidence is greater than or equal to a threshold value;
A second determination process for determining whether or not the number of the second test cases determined to be equal to or greater than the threshold value by the first determination process is equal to or less than a specified number;
If it is determined by the second determination process that the number is not less than the specified number, an update process for updating the threshold value to a higher value is executed,
In the first determination process, the processor is caused to determine whether or not the degree of coincidence is equal to or higher than a threshold value after update by the update process,
In the second determination process, the processor determines whether or not the number of the second test cases determined to be greater than or equal to the updated threshold value by the first determination process is equal to or less than the specified number. Let me judge
In the output process, the test support program causes the processor to output identification information of the second test case determined to be equal to or less than the specified number by the second determination process and a calculation result of the calculation process . A test support apparatus that performs test support for the test target according to a condition given to the test target, a process expected by the test of the test target, and a test case that defines the result of the process,
A processor that executes the program; and a storage device that stores the program;
The processor is
A comparison process for comparing the first test case to be evaluated with the second test case to be compared;
A calculation process for calculating a degree of coincidence between the first test case and the second test case based on a comparison result by the comparison process;
An output process for outputting identification information of the second test case and a calculation result by the calculation process;
A test support apparatus characterized in that

Images