JP7344521B1 - Program, method, information processing device, and system - Google Patents

Abstract

[Problem] To reduce the burden of test design while maintaining test quality. A program according to the present disclosure is a program to be executed by a computer including a processor and a memory. The program includes a step of receiving a designation of a test design document from the processor, and a step of receiving a designation for at least one test item among a plurality of test items included in a predetermined function in the test design document for which the designation has been accepted. , a step of storing information for carrying out a test of a specified test item as a test set so that any user can access it; and a step of reading out the stored test set in response to a request from any user and performing the read test. and inserting the set into a predetermined area of a test design document created by an arbitrary user. [Selection diagram] Figure 4

Description

The present disclosure relates to a program, a method, an information processing device, and a system.

An invention has been proposed that develops high-quality software by appropriately extracting test items before the start of a testing process to prevent extension of development period and additional costs (see Patent Document 1).

JP2018-018373A

In Patent Document 1, functional units developed in the past, tests conducted, and priorities indicating the priority level of each test are stored in association with each other. In Patent Document 1, for example, bug information about identified past functional units is referred to, bugs are identified in order of severity according to the feature values of past functional units, and test items corresponding to the bugs are implemented. It has been extracted as a test item. However, although Patent Document 1 extracts test items, it does not describe how to reduce the burden of test design while maintaining test quality.

The purpose of the present disclosure is to reduce the burden of test design while maintaining test quality.

In order to solve the above problems, a program of the present disclosure is a program to be executed by a computer including a processor and a memory. The program includes a step of receiving a designation of a test design document from the processor, and a step of receiving a designation for at least one test item among a plurality of test items included in a predetermined function in the test design document for which the designation has been accepted. , a step of storing information for carrying out a test of a specified test item as a test set so that it can be accessed by any user; and a step of reading out the stored test set in response to a request from any user and performing the read test. and inserting the set into a predetermined area of a test design document created by an arbitrary user.

According to the present disclosure, the burden of test design can be reduced while maintaining test quality.

1 is a diagram showing the overall configuration of a system 1 according to the present embodiment. 2 is a block diagram illustrating a configuration example of an information processing device 10 shown in FIG. 1. FIG. It is a block diagram showing the functional configuration of a server 20 included in the system 1 of this embodiment. 3 is a diagram showing the data structure of a test design document table 2021. FIG. 3 is a diagram showing the data structure of a test set table 2022. FIG. 3 is a diagram showing the data structure of a pattern table 2023. FIG. FIG. 3 is a diagram for explaining an example of the operation of the terminal device 10 and the server 20 when storing a test set. FIG. 3 is a schematic diagram showing an example of a screen for creating a test design document. FIG. 7 is a schematic diagram showing an example of a test design document creation screen when test items are specified. FIG. 3 is a schematic diagram showing an example of a screen for inputting an instruction to store a test set. 2 is a schematic diagram showing an example of a display screen of a test set stored in the server 20. FIG. FIG. 7 is a schematic diagram showing another example of a screen for inputting an instruction to store a test set. FIG. 3 is a schematic diagram showing an example of a screen for comparing test sets. 12 is a flowchart illustrating an example of the operation of the server 20 when performing analysis on a test set. FIG. 3 is a diagram for explaining an example of the operation of the terminal device 10 and the server 20 when using a test set in creating a test design document. FIG. 7 is a schematic diagram showing another example of the test design document creation screen. FIG. 3 is a schematic diagram showing an example of a test set selection screen. 2 is a block diagram showing the basic hardware configuration of a computer 90. FIG.

Embodiments will be described below with reference to the drawings. Note that the present embodiment described below does not unduly limit the content of the present disclosure described in the claims. Furthermore, not all of the configurations described in this embodiment are essential configuration requirements of the present disclosure.

<Summary>
The system 1 according to the present embodiment sets and accumulates test sets within a range specified by the user from past test design documents. When an arbitrary user creates a test design document, the system 1 receives a designation from the user regarding any one of the accumulated test sets, and inserts the designated test set into the test design document being created.

In this embodiment, the test design document is data in which a test for testing the functions of the test target is designed. The inspection target represents an inspection target, and is, for example, hardware, software, or the like developed in a predetermined project. Inspection targets include, for example, prototypes, intermediate products, and final products.

In this embodiment, a test set is a set of information for conducting tests related to a plurality of test items. Information for conducting a test related to a plurality of test items includes, for example, test viewpoints, confirmation items, expected values, factors, levels, patterns, and the like. The test perspective represents the perspective (way of thinking) on which the test is based. The confirmation items represent information for specifying the test to be performed. The expected value represents the behavior that is expected to occur during confirmation. Factors represent factors that can affect changes in the state of a computer. A level represents a specific element of a factor. Patterns represent information for which actual test cases are defined.

<1 Overall configuration>
FIG. 1 is a diagram showing the overall configuration of a system 1 of this embodiment. As shown in FIG. 1, the system 1 includes a terminal device 10 and a server 20. The terminal device 10 and the server 20 are connected to be able to communicate with each other via a network 80 using a wired or wireless communication standard. The network 80 is realized, for example, by the Internet and/or a communication network provided by a communication carrier. In the illustrated example, a plurality of terminal devices 10 are included in the system 1.

Note that although FIG. 1 shows a case where the server 20 is one computer, the server 20 may be realized by combining a plurality of computers.

The terminal device 10 is an information processing device used by a user who uses services provided by the server 20. For example, the terminal device 10 is an information processing device used by a test designer who creates a test design document. Further, for example, the terminal device 10 is an information processing device used by a developer who develops software. Further, the terminal device 10 is an information processing device used by a tester who conducts a test based on a test design document.

The terminal device 10 is realized by, for example, a stationary PC (Personal Computer), a laptop PC, a head-mounted display, or the like. Furthermore, the terminal device 10 may be a portable computer such as a smartphone or a tablet terminal.

As shown in FIG. 1, the terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19. The communication IF 12, input device 13, output device 14, memory 15, storage 16, and processor 19 are communicably connected to each other via a bus, for example.

The communication IF 12 is an interface for transmitting and receiving signals so that the terminal device 10 communicates with an external device. The input device 13 is an input device for receiving input operations from a user (employee). The input device 13 includes, for example, a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, and the like. The output device 14 is an output device for presenting information to the user. The output device 14 includes, for example, a display, a speaker, and the like.

The memory 15 is for temporarily storing programs, data processed by the programs, etc., and is realized by, for example, a volatile memory such as DRAM (Dynamic Random Access Memory). The storage 16 is a storage device for storing data, and is realized by, for example, a nonvolatile memory such as a flash memory or an HDD (Hard Disc Drive). The processor 19 is hardware for executing a set of instructions written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

The server 20 is an information processing device that supports creation of a test design document. Further, the server 20 is an information processing device that manages the implementation status and implementation results of tests defined based on the test design document. The server 20 is, for example, a computer connected to the network 80.

As shown in FIG. 1, the server 20 includes a communication IF 22, an input/output IF 23, a memory 25, a storage 26, and a processor 29. The communication IF 22, input/output IF 23, memory 25, storage 26, and processor 29 are communicably connected to each other via a bus, for example.

The communication IF 22 is an interface for transmitting and receiving signals so that the server 20 communicates with an external device. The input/output IF 23 functions as an interface with an input device for receiving input operations from a user and an output device for presenting information to the user. The memory 25 is for temporarily storing programs, data processed by the programs, etc., and is realized by, for example, volatile memory such as DRAM.

The storage 26 is a storage device for storing data, and is realized by, for example, a nonvolatile memory such as a flash memory or an HDD. Storage 26 does not necessarily have to be realized by a single circuit. The storage 26 may be realized by, for example, a plurality of storage circuits. The processor 29 is hardware for executing a set of instructions written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

<1.1 Terminal device configuration>
FIG. 2 is a block diagram showing a configuration example of the information processing device 10 shown in FIG. 1. As shown in FIG. As shown in FIG. 2, the information processing device 10 includes a communication unit 120, an input device 13, an output device 14, an audio processing unit 17, a microphone 171, a speaker 172, a camera 160, and a position information sensor 150. , a storage section 180 , and a control section 190 . Each block included in the information processing device 10 is electrically connected by, for example, a bus or the like.

The communication unit 120 performs processing for the terminal device 10 to communicate with other devices. The communication unit 120 performs transmission processing on the signal generated by the control unit 190, and transmits the signal to the outside (for example, the server 20). The communication unit 120 performs reception processing on a signal received from the outside, and outputs the signal to the control unit 190.

The input device 13 is a device for a user operating the terminal device 10 to input instructions or information. The input device 13 is realized, for example, by a touch-sensitive device 131, etc., into which an instruction is input by touching an operation surface. When the information processing device 10 is a PC or the like, the input device 13 may be realized by a reader, a keyboard, a mouse, or the like. The input device 13 converts an instruction input from a user into an electrical signal, and outputs the electrical signal to the control unit 190. Note that the input device 13 may include, for example, a reception port that receives electrical signals input from an external input device.

The output device 14 is a device for presenting information to a user operating the terminal device 10. The output device 14 is realized by, for example, a display 141 or the like. The display 141 displays data according to the control of the control unit 190. The display 141 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, or the like.

The audio processing unit 17 performs, for example, digital-to-analog conversion processing of audio signals. The audio processing unit 17 converts the signal provided from the microphone 171 into a digital signal, and provides the converted signal to the control unit 190. Furthermore, the audio processing section 17 provides an audio signal to the speaker 172. The audio processing unit 17 is realized, for example, by a processor for audio processing. The microphone 171 receives a voice input and provides a voice signal corresponding to the voice input to the voice processing unit 17. The speaker 172 converts the audio signal provided from the audio processing unit 17 into audio and outputs the audio to the outside of the terminal device 10 .

The camera 160 is a device that receives light with a light receiving element and outputs it as a photographic signal.

The position information sensor 150 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. A GPS module is a receiving device used in a satellite positioning system. The satellite positioning system receives signals from at least three or four satellites, and detects the current position of the terminal device 10 equipped with a GPS module based on the received signals. The location information sensor 150 may detect the current location of the terminal device 10 from the location of a wireless base station to which the terminal device 10 connects.

The storage unit 180 is realized by, for example, the memory 15, the storage 16, etc., and stores data and programs used by the information processing device 10. The storage unit 180 stores user information 181, for example. User information 181 includes information regarding a user who uses terminal device 10.

The control unit 190 is realized by the processor 19 reading a program stored in the storage unit 180 and executing instructions included in the program. The control unit 190 controls the operation of the terminal device 10. The control unit 190 functions as an operation reception unit 191, a transmission/reception unit 192, and a presentation control unit 193 by operating according to a program.

The operation reception unit 191 performs processing for accepting instructions or information input from the input device 13. Specifically, for example, the operation reception unit 191 receives instructions or information input from the touch-sensitive device 131 or the like.

Further, the operation reception unit 191 receives voice instructions input from the microphone 171. Specifically, for example, the operation reception unit 191 receives an audio signal input from the microphone 171 and converted into a digital signal by the audio processing unit 17. The operation reception unit 191 obtains an instruction from the user by, for example, analyzing the received audio signal and extracting a predetermined noun.

The transmitting/receiving unit 192 performs processing for the terminal device 10 to transmit and receive data with an external device such as the server 20 according to a communication protocol. Specifically, for example, the transmitting/receiving unit 192 transmits instructions or information input by the user to the server 20. Further, the transmitting/receiving unit 192 receives information provided from the server 20.

The presentation control unit 193 controls the output device 14 in order to present the information output from the server 20 to the user. Specifically, for example, the presentation control unit 193 causes the display 141 to display an image for a test designer to create a test design document. Further, for example, the presentation control unit 193 causes the display 141 to display an image for the tester to perform a test based on the test design document.

<1.2 Functional configuration of the server>
FIG. 3 is a block diagram showing the functional configuration of the server 20 included in the system 1 of this embodiment. As shown in FIG. 3, the server 20 functions as a communication section 201, a storage section 202, and a control section 203.

The communication unit 201 performs processing for the server 20 to communicate with external devices.

The storage unit 202 stores data and programs used by the server 20. For example, the storage unit 202 includes a test design table 2021, a test set table 2022, a pattern table 2023, and the like. The tables stored in the storage unit 202 are not limited to these.

The test design document table 2021 is a table for storing test design documents. Details will be described later.

Test set table 2022 is a table for storing test sets. Details will be described later.

Pattern table 2023 is a table for storing patterns. The test design document includes, for example, information that specifies the items whose behavior is to be confirmed in the test, and information that specifies the actual test cases that are set based on the content to be confirmed and the conditions of the behavior that will be expressed. include. Patterns represent information for which actual test cases are defined. Specifically, the pattern defines the content to be checked, the conditions for the behavior expressed by the confirmation process, and a specific test case that is a combination of the content to be checked and the conditions. Details of the pattern table 2023 will be described later.

The control unit 203 is realized by the processor 29 reading a program stored in the storage unit 202 and executing instructions included in the program. The control unit 203 controls the operation of the server 20. Specifically, for example, the control unit 203 performs functions shown as a reception control module 2031, a transmission control module 2032, a management module 2033, a support module 2034, an analysis module 2035, and a presentation control module 2036 by operating according to a program. Demonstrate.

The reception control module 2031 controls the process by which the server 20 receives signals from an external device according to a communication protocol.

The transmission control module 2032 controls the process by which the server 20 transmits a signal to an external device according to a communication protocol.

The management module 2033 manages information stored in the table of the storage unit 202. Specifically, for example, when the management module 2033 is requested to write information to the test design document table 2021, the management module 2033 writes the requested information to the test design document table 2021. When requested to read information from the test design table 2021, the management module 2033 reads the requested information from the test design table 2021. When requested to write information to the test set table 2022, the management module 2033 writes the requested information to the test set table 2022. When requested to read information from the test set table 2022, the management module 2033 reads the requested information from the test set table 2022. When requested to write information to the pattern table 2023, the management module 2033 writes the requested information to the pattern table 2023. When requested to read information from the pattern table 2023, the management module 2033 reads the requested information from the pattern table 2023.

The management module 2033 also manages the results of test cases executed by the tester. Specifically, for example, the management module 2033 stores the results of tests performed on test cases in the storage unit 202.

The support module 2034 supports creation of a test design document. Specifically, for example, the support module 2034 outputs information that can reduce the burden of creating a test design document when the test designer creates the test design document. More specifically, the support module 2034 outputs a test set required by the test designer when the test designer creates a test design document. The support module 2034 also supports storage of test sets.

The analysis module 2035 analyzes test results of test cases related to the test set. For example, analysis module 2035 analyzes test results for a test set. Specifically, for example, the analysis module 2035 analyzes the test results stored in the storage unit 202 and calculates the bug occurrence rate in the test set.

Analysis module 2035 may analyze test results for test cases included in the test set. For example, the analysis module 2035 analyzes test results and extracts test cases that are likely to cause defects.

The analysis module 2035 also counts the number of times the test set has been used.

The presentation control module 2036 presents information regarding the creation of the test design document to the test designer. Specifically, for example, the presentation control module 2036 displays an image containing information for creating a test design document to the test designer via the terminal device 10. Information for creating a test design document includes, for example, information stored in a test design document table 2021, a test set table 2022, and a pattern table 2023.

The presentation control module 2036 also presents information for conducting a test to the tester. Specifically, for example, the presentation control module 2036 displays an image containing information for conducting a test to the tester via the terminal device 10. Information for implementing the test includes, for example, information stored in the test design document table 2021.

<2 Data structure>
4 to 6 are diagrams showing data structures of tables stored in the server 20. Note that FIGS. 4 to 6 are examples, and do not exclude data not described. Further, even data written in the same table may be stored in separate storage areas in the storage unit 202.

FIG. 4 is a diagram showing the data structure of the test design document table 2021. The test design table 2021 shown in FIG. 4 is a table that uses the file name as a key and has columns such as status, version, update date and time, person in charge, and test set ID.

The file name is an item that stores the name of the test design document. Status is an item that stores the current state of the test design document. The item "Status" stores, for example, one of "Working" indicating that the task is under way, "Reviewing" indicating that the task is being confirmed, and "Done" indicating that the task is completed. The version is an item that stores the updated or revised version of the test design document. The update date and time is an item that stores the date and time when the test design document was updated. Person in charge is an item for storing the person who creates the test design document. The information stored in the item "person in charge" may be the name of the person in charge or a predetermined ID for identifying the person in charge. The test set ID is an item that stores the test set ID of the test set used when creating the test design document.

FIG. 5 is a diagram showing the data structure of the test set table 2022. The test set table 2022 shown in FIG. 5 is a table that uses the test set ID as a key and has columns of test set name, creator, creation date, number of diversions, bug occurrence rate, tag, and information regarding test items included in the test set. It is. In addition to these, the test set table 2022 may have, for example, a column that stores explanatory text input by the test designer about the test set. Further, in addition to these, the test set table 2022 may have a column for storing notes (comments) input by the tester regarding the test set, for example.

The test set ID is an item that stores an ID for uniquely identifying a test set. The test set name is an item that stores the name of the test set. The creator is an item that stores the person who created the test set. The information stored in the item "Creator" may be the name of the creator or a predetermined ID for identifying the creator. The creation date is an item that stores the date and time when the test set was created. The number of diversions is an item that stores the number of times the test design document has been diversioned. In place of or in addition to the number of diversions, there may be a column that stores the number of views representing the number of times the contents of the test set have been confirmed. The bug occurrence rate is an item that stores the probability that a defect (bug) occurs in a test case related to a test set. The item “bug occurrence rate” stores, for example, the results analyzed by the analysis module 2035. A tag is, for example, an item that stores information that simply or conceptually represents the characteristics of a test set. The tag can be set, for example, by the creator of the test set.

Information regarding test items included in the test set includes, for example, test classification, classification 1, classification 2, test target, pattern, test viewpoint, confirmation item, and the like. The test category, category 1, and category 2 are items for storing, for example, the category to which the test item belongs. As for the range of the divisions, for example, the test division is the widest and the division 2 is the narrowest. The test target is an item that stores the test target. The test target can be expressed as, for example, storing a function to be tested. The pattern is an item that stores an ID for identifying the pattern. The test viewpoint is an item that stores the viewpoint (way of thinking) on which the test is based. The confirmation items are items for storing contents to be confirmed in the test to be performed. The information stored in the item "Test viewpoint" and the information stored in the item "Confirmation item" are associated with each other.

In the example shown in Figure 5, item "Test category": Front login, item "Category 1": Login screen, item "Category 2": Authentication, item "Test target": ID/PW authentication, item "Pattern": P1 , item "test perspective": normal authentication, item "confirmation item": behavior verification at normal time, etc. are stored.

FIG. 6 is a diagram showing the data structure of the pattern table 2023. The pattern table 2023 shown in FIG. 6 is a table that uses a pattern number as a key and has columns such as pattern name, factor, level, confirmation item, and expected value. The pattern table 2023 includes a pattern table (not shown) in which actual test cases are defined.

The pattern number is an item that stores an ID for identifying a pattern. The pattern name is an item that stores the name of the pattern. A factor is an item that stores factors that can affect changes in the state of the computer. The level is an item for storing specific elements of a factor. The confirmation items are items for storing contents to be confirmed in the test to be performed. The expected value is an item that stores the behavior that is expected to be discovered during confirmation.

<3 Operation>
The operation of the terminal device 10 and the server 20 will be explained.

(memory of test set)
FIG. 7 is a diagram for explaining an example of the operation of the terminal device 10 and the server 20 when storing a test set. First, the test designer creates a test design document. The test designer determines that a set of predetermined test items in the test design document being created can be used in other test design documents, or that reusing it will be effective in creating other test design documents. do. The test designer specifies information related to predetermined test items in the test design document being created. Note that the person who creates the test set is not limited to the test designer, but may be any user related to the test.

In step S11, the control unit 190 of the terminal device 10 receives, through the operation reception unit 191, an instruction to store the test set from the test designer.

FIG. 8 is a schematic diagram showing an example of a test design document creation screen. The control unit 190 causes the presentation control unit 193 to display a test design document creation screen 1411 on the display 141. The creation screen 1411 includes, for example, an area 14111 that displays a list of confirmation items, and an area 14112 that displays a list of patterns. The creation screen 1411 shown in FIG. 8 is displayed in a tree format. The creation screen 1411 may be displayed in a table format.

The test designer specifies, via the input device 13, in area 14111 test items that are considered to be applicable to other test design documents. A test item group that can be used in other test design documents is, for example, a test item for testing a predetermined function.

FIG. 9 is a schematic diagram showing an example of a test design document creation screen when test items are specified. In Figure 9, in the test design document, item "Test category": Front login, item "Category 1": Login screen, item "Category 2": Authentication, item "Test target": ID/PW authentication, item "Pattern" :P1, item "test perspective": normal authentication, item "confirmation item": behavior verification under normal conditions, etc. are specified by the test designer.

After specifying a test item, the test designer presses button 14113. Button 14113 is a button for inputting an instruction to store a test set.

When the button 14113 is pressed, the presentation control unit 193 causes the display 141 to display a screen for inputting an instruction to memorize the test set.

FIG. 10 is a schematic diagram showing an example of a screen for inputting an instruction to store a test set. In FIG. 10, the presentation control unit 193 displays a window 14114 on the display 141, for example. Window 14114 is a window for inputting an instruction to confirm test set registration. The window 14114 includes an area 141141 for inputting a test set name and a button 141142 for inputting an instruction to confirm test set registration.

When registering a test set, the test designer inputs the test set name in area 141141 and presses button 141142. Test designers may add tags to test sets. For example, the test designer may set tags from an indicator for setting tags, an input screen for inputting tags, or the like.

Further, the test designer may input a description of the test set to the test set. For example, the test designer may input the description of the test set from an input screen for inputting the description of the test set. The input description includes, for example, points to be noted about the test set, characteristics of the tests included in the test set, etc. that cannot be expressed by the test set name.

When the button 141142 is pressed, the control unit 190 causes the transmitting/receiving unit 192 to transmit the test set name, information regarding the test items specified by the test designer, etc. to the server 20.

In step S12, the server 20 stores the test set specified by the test designer. Specifically, the control unit 203 of the server 20 receives, for example, the test set name, information regarding test items specified by the test designer, etc. through the reception control module 2031. For example, the control unit 203 creates a new record in the test set table 2022 using the management module 2033. The management module 2033 stores information regarding the test set name, creator, creation date, tag, and test items included in the test set in the created record. This allows any user, including any test designer, to use the test set.

FIG. 11 is a schematic diagram showing an example of a display screen of a test set stored in the server 20. In FIG. 11, the presentation control unit 193 causes the display 141 to display a display screen 1412 that displays the test sets stored in the test set table 2022 in response to an instruction from a user such as a test designer. The user can edit the test set from the display screen 1412. The operation reception unit 191 receives a press of a button 14121 for starting editing from the user. The transmitting/receiving unit 192 transmits the received edited content to the server 20. The server 20 updates the test set table 2022 based on the edited content.

In step S12, the management module 2033 may determine whether a test set similar to the test set to be registered exists. Specifically, for example, the presentation control unit 193 displays an indicator for inputting an instruction to check a similar test set on a screen for inputting an instruction to store a test set.

FIG. 12 is a schematic diagram showing another example of a screen for inputting an instruction to store a test set. In FIG. 12, the presentation control unit 193 displays, for example, a button 141143 in a window 14114 for inputting an instruction to confirm the existence of a similar test set.

When confirming the existence of a similar test set, the test designer enters the test set name in area 141141 and presses button 141143. When the button 141143 is pressed, the control unit 190 causes the transmitting/receiving unit 192 to transmit the test set name, information regarding the test items specified by the test designer, etc. to the server 20.

The management module 2033 refers to the input information and determines whether a similar test set exists. Specifically, for example, the management module 2033 extracts test set names similar to the input test set name from the test set table 2022. Any existing method may be used to extract similar test set names. For example, the management module 2033 uses a predetermined method to calculate the degree of similarity between the test set name of the test set that is desired to be registered and the test set name of the test set stored in the test set table 2022, and Test sets that exceed the set similarity are read from the test set table 2022. The transmission control module 2032 transmits the read information to the terminal device 10. The presentation control module 2036 causes the terminal device 10 to display the test set that the test designer wishes to register and the test set for which information has been received so that they can be compared.

The presentation control unit 193 causes the display 141 to display the test set that the test designer wishes to register and the test set for which information has been received so that they can be compared. If there are multiple test sets with similar test set names, the presentation control unit 193 displays the test sets on the display 141 in descending order of similarity, for example. The presentation control unit 193 receives a selection of a test set from the test designer, and causes the display 141 to display a comparison image of the test set selected by the test designer with the test set desired to be registered.

FIG. 13 is a schematic diagram showing an example of a screen for comparing test sets. In FIG. 13, the presentation control unit 193 causes the display 141 to display an area 14131 and an area 14132, for example. Area 14131 is an area for displaying information regarding the test set that the test designer desires to register. Area 14132 is an area for displaying information regarding the received test set. In FIG. 13, the presentation control unit 193 causes the display 141 to display, for example, a button 14133 for inputting an instruction to change the test set name, and a button 14134 for inputting an instruction to confirm the registration of the test set. . Note that the presentation control unit 193 may display a button for inputting to cancel registration of the test set.

The test designer compares the test sets displayed in area 14131 and area 14132 and confirms the contents of the test set to be registered and the test set name. If it is necessary to change the test set name, the test designer presses button 14133, for example. When the button 14133 is pressed, the presentation control unit 193 displays, for example, an area for accepting input of a new test set name. The test designer enters a new test set name in the displayed area.

The presentation control unit 193 may display a button for inputting an instruction to reset the test set. If it is necessary to change the contents of the test set, the test set name, or both, the test designer presses this button, for example. When the button is pressed, the presentation control unit 193 causes the display 141 to display the screen shown in FIG. 8, for example. The test designer specifies the test items again and gives a new test set name to the test set consisting of the specified test items.

That is, if a similar test set is already stored, the management module 2033 accepts the setting of the test set name, the designation of the test item, or both of these again.

The presentation control module 2036 may cause the terminal device 10 to display a message suggesting changing the test set name when the test set name is higher than a preset degree of similarity and the contents of the test sets are different.

If there is no need to change the contents of the test set or the test set name, the test designer presses button 14134. When the button 14134 is pressed, the transmitting/receiving unit 192 transmits the test set name, information regarding the test items specified by the test designer, etc. to the server 20.

Searching for similar test sets is not limited to searching based on test set names. The management module 2033 may search for similar test sets based on information other than the test set name stored in the test set table 2022, such as test viewpoints and confirmation items. The management module 2033 uses a predetermined method to calculate the similarity between the content of the test set that is desired to be registered and the content of the test set stored in the test set table 2022, and calculates the similarity based on the preset similarity. The test set exceeding the limit is read from the test set table 2022. The transmission control module 2032 transmits information regarding the read test set to the terminal device 10. The presentation control module 2036 causes the terminal device 10 to display the test set that the test designer wishes to register and the test set for which information has been received so that they can be compared.

The presentation control unit 193 causes the display 141 to display the test set that the test designer wishes to register and the test set for which information has been received so that they can be compared. If there are multiple test sets with similar content, the presentation control unit 193 displays the test sets on the display 141 in descending order of similarity, for example. The presentation control unit 193 receives a selection of a test set from the test designer, and causes the display 141 to display a comparison image of the test set selected by the test designer with the test set desired to be registered.

(Analysis and aggregation of test set)
FIG. 14 is a flowchart illustrating an example of the operation of the server 20 when performing analysis on a test set.

First, the management module 2033 manages test results of tests performed by testers. Tests performed by testers are defined based on test design documents created by test designers. When a test set stored in the test set table 2022 is used to create a test design document, test items derived from the test set can be identified in the created test design document. For example, when a test is performed based on this test design document, the management module 2033 manages the test results in association with the test set.

In step S21, the analysis module 2035 obtains test results related to the test set. Specifically, the analysis module 2035 obtains test results related to the test set at predetermined timing. The analysis module 2035 obtains test results, for example, at the following timings.
・When the test for the corresponding test case specified in the specified test design document is completed ・When the test up to the specified test case specified in the specified test design document is completed ・In the specified period/predetermined time・When an instruction from the user is input

In step S22, the analysis module 2035 analyzes the test results obtained for the test set. Specifically, the analysis module 2035 analyzes the obtained test results and calculates the bug occurrence rate (failure rate) of the test set, for example. Note that the information obtained through analysis is not limited to the bug occurrence rate. Parameters other than the bug occurrence rate may be calculated. The management module 2033 stores the calculated bug occurrence rate in the item “bug occurrence rate” of the test set table 2022.

The management module 2033 also manages the number of times the test set has been used in the test design document. When a test set stored in the test set table 2022 is used to create a test design document, the management module 2033 increments, for example, the number of times the test set has been used (the number of times the test set has been used). For example, the analysis module 2035 analyzes the number of diversions of the test set at a predetermined timing. For example, the predetermined timing is as follows.
・When a predetermined cycle/time is reached・When an instruction from the user is input

Specifically, the analysis module 2035 analyzes the number of diversions and calculates the number of diversions in a predetermined period (the most recent one week), for example. Note that the information acquired through analysis is not limited to the number of times of diversion in a predetermined period. In addition to the number of times of diversion during a predetermined period, other parameters such as the average number of times of diversion may be calculated. For example, the management module 2033 stores the calculated analysis results in the test set table 2022.

(Utilization of test set)
FIG. 15 is a diagram for explaining an example of the operation of the terminal device 10 and the server 20 when using a test set in creating a test design document.

First, the test designer inputs an instruction to create a test design document and starts creating the test design document. If there is a test design document in progress, the test designer may select the test design document in progress and resume creation of the selected test design document.

In step S31, the terminal device 10 receives a test set presentation request. Specifically, the test designer inputs information regarding test items into a predetermined area on, for example, a test design document creation screen. The transmitter/receiver 192 transmits information regarding test items to the server 20 as a test set presentation request. The transmitting/receiving unit 192 may transmit a test set presentation request to the server 20 in response to an instruction requesting presentation of a test set after the information regarding the test item is input. Further, the test designer inputs an instruction to request presentation of a test set, for example, on the test design creation screen. The transmitter/receiver 192 transmits a test set presentation request to the server 20 .

FIG. 16 is a schematic diagram showing another example of the test design document creation screen. The presentation control unit 193 displays, for example, a button 14115 for inputting an instruction to insert a test set on the creation screen 1411. Presentation control unit 193 displays area 14116 for inputting information regarding test items. Note that the position where area 14116 is displayed is not limited to that shown in FIG. 16.

The test designer inputs information regarding the test item, for example, "certification test" into area 14116. The transmitting/receiving unit 192 transmits to the server 20 a request to present a test set related to the “authentication test”.

Further, the test designer selects the insertion position of the test set on the test design document creation screen 1411, and presses a button 14115, for example. When button 14115 is pressed, transmitter/receiver 192 transmits a request to present a test set to server 20. Note that a box may be provided near the button 14115 for accepting input of a search keyword related to the test set. The test designer may press button 14115 after inputting the search keyword into the box. As a result, a request for a test set corresponding to the search keyword is sent.

In step S32, the server 20 reads the requested test set from the test set table 2022. Specifically, when there is a request to present a test set regarding information entered in area 14116, support module 2034 retrieves the corresponding test set from test set table 2022. For example, the support module 2034 reads test sets that include the input information in the test set name or test set contents (information regarding test items, test description) from the test set table 2022. The support module 2034 may search for a test set using, for example, a trained model.

Further, when the support module 2034 receives a request transmitted by pressing the button 14115, the support module 2034 reads out the test set stored in the test set table 2022.

The transmission control module 2032 transmits information regarding the read test set to the terminal device 10. The presentation control module 2036 causes the terminal device 10 to display information regarding the read test set.

In step S33, the terminal device 10 presents information regarding the test set to the test designer. Specifically, for example, the presentation control unit 193 causes the display 141 to display information regarding the test set based on the information received from the server 20.

FIG. 17 is a schematic diagram showing an example of a test set selection screen. The presentation control unit 193 causes the display 141 to display a test set selection screen 1414. The selection screen 1414 includes, for example, an area 14141 that displays a list of test sets, and an area 14142 that displays the contents of the test sets.

For example, the presentation control unit 193 displays the test sets in the area 14141 in an order based on a predetermined priority. The presentation control unit 193 sets priorities based on, for example, the following information.
・Newness of creation date ・Many test items included ・High bug occurrence rate ・Many times of reuse ・Word order of test set name

The presentation control module 2036 displays the creator of the test set, the date of creation of the test set, the number of times the test set has been reused, the bug occurrence rate of the test set, the description of the test set, comments from testers, or a combination of at least two of these. It may also be displayed on the terminal device 10. For example, the presentation control unit 193 may display in the area 14142 the creator of the test set, the date of creation of the test set, the number of times the test set has been reused, the bug occurrence rate of the test set, the description of the test set, comments from testers, or any of these information. At least two of the combinations are displayed on the display 141. Specifically, the presentation control unit 193 may display boxes for displaying the creator, creation date, number of reuses, bug occurrence rate, test set description, comments from testers, etc. in the area 14142, or display these information. Display a button to display.

The test designer selects a test set in area 14141 via the input device 13 while displaying the contents of the test set in area 14142. The test designer presses a button 14143 for registering the test set for the test set whose contents are displayed in the area 14142.

When the button 14143 is pressed, the transmitting/receiving unit 192 transmits information regarding the test set selected by the test designer to the server 20.

The support module 2034 inserts information regarding the test set selected by the test designer into the test design document being created. For example, the support module 2034 inserts information regarding test items included in the test set into a record regarding the test design document being created in the test design document table 2021.

As described above, in the embodiment described above, the control unit 203 of the server 20 receives the designation of a test design document using the reception control module 2031. The reception control module 2031 receives a designation for at least one test item among a plurality of test items included in a predetermined function in the test design document that has received the designation. The control unit 203 uses the management module 2033 to store information for testing specified test items as a test set so that any user can access it. The management module 2033 reads the stored test set in response to a request from an arbitrary user, and inserts the read test set into a predetermined area of a test design document created by an arbitrary user. This allows the server 20 to set test items for a predetermined task that the user considers useful, within the range desired by the user, and store (register) them as a test set. Further, the server 20 can store a test set suitable for each client. Furthermore, the server 20 can make the stored test set available to the user in response to a user's request.

Therefore, according to the program, server 20, and system 1 according to this embodiment, it is possible to reduce the burden of test design while maintaining test quality.

Further, in the embodiment described above, the management module 2033 includes a test viewpoint, confirmation items, expected values, factors, levels, and patterns as information for testing test items. This allows the server 20 to store the test set so that it can be reused in the test design document.

Further, in the embodiment described above, the management module 2033 stores sentences related to the test set in association with the test set. This allows the server 20 to improve convenience when reusing test sets.

Further, in the embodiment described above, the management module 2033 stores, as text related to the test set, an explanation about the test set or a comment from a tester who conducted a test based on the test set. This reduces the burden on the user when finding a desired test set. In addition, the user can understand precautions regarding the test set when reusing the test set.

Furthermore, in the above embodiment, if a similar test set is already stored, the management module 2033 accepts the designation of the test item, the setting of the name of the test set, or both of these again. This allows the server 20 to prevent similar test sets from being stored.

Furthermore, in the above embodiment, when a similar test set is already stored, the presentation control module 2036 compares the contents of the test set related to the specified test item with the contents of the already stored test set. If possible, the test item is presented to the specified user. This allows the server 20 to prevent similar test sets from being stored.

Further, in the above embodiment, the presentation control module 2036 controls the case where the content of the test set related to the specified test item is different from the content of the already stored test set, but the names of these test sets are similar. , we suggest storing the test set under a different name than the already stored test set. This allows the server 20 to prevent similar test sets from being stored.

Further, in the above embodiment, when the support module 2034 receives a character input from an arbitrary user in the area for inputting information when creating a test design document, the support module 2034 inputs a test set related to the input character. , present to any user. This allows the server 20 to reduce the burden on the user of searching for test sets.

In the above embodiment, if there are multiple test sets related to the input characters, the support module 2034 also includes information such as the creation date of the test design document, the number of test items included, the high failure rate, and the number of diversions. A plurality of test sets are presented in an order based on the number of test sets or the word order of the test set names. This allows the server 20 to further reduce the burden on the user of searching for test sets.

Further, in the embodiment described above, the management module 2033 stores test results of test cases based on test design documents created using test sets. The analysis module 2035 analyzes test results of test cases related to the test set. When an arbitrary user creates a test design document, the presentation control module 2036 presents test sets available to the arbitrary user together with the results of analyzing test results of test cases related to the test set. This allows the server 20 to allow the user to select a test set in consideration of the analysis results. Therefore, the user can grasp the amount of man-hours required when reusing the test set. Furthermore, since the user can select a test set based on the bug occurrence rate, it is possible to adjust the quality of the test design document.

Furthermore, in the above embodiment, when there are multiple test sets available, the presentation control module 2036 presents the multiple test sets in an order based on the analyzed results. This allows the server 20 to further reduce the burden on the user of selecting a test set.

Furthermore, in the embodiment described above, the management module 2033 totals the number of times the test set is used. Analysis module 2035 analyzes the tally results. When an arbitrary user creates a test design document, the presentation control module 2036 presents test sets available to the arbitrary user along with the results of analyzing the number of times the test sets have been used. This allows the server 20 to allow the user to select a test set in consideration of the number of times of diversion. Therefore, the user can select a test set while grasping how much of the test set has been used. This makes it easier to select an excellent test set, contributing to uniformity of the quality of test design documents.

Furthermore, in the above embodiment, when there are multiple test sets available, the presentation control module 2036 presents the multiple test sets in an order based on the analyzed results. This allows the server 20 to further reduce the burden on the user of selecting a test set.

<Modified example>
The above embodiment describes an example in which any user can access the test set. However, restrictions may be placed on users who can access the test set. For example, access privileges may be set for each test set. Alternatively, a plurality of databases (tables) with different access privileges may be set, and usable test sets may be stored for each database. Examples of databases with different access privileges include a database for each project, a database for each company, a database for each predetermined business type, and a database that covers the entire business.

Further, in the embodiment described above, a benefit may be given to the creator of a test set that is frequently used.

Furthermore, in the higher-level embodiment, it is also possible to create test items in advance for test items that are expected to be used frequently. For example, in a predetermined field such as the entertainment field, defined test items may be similar. In such fields, if test sets related to test items to be used as standard are registered in advance, it is possible to reduce the effort of the test designer when creating a test design document.

Further, in the embodiment described above, the server 20 may extract the test design document created using the test set. For example, when a predetermined function is upgraded, the upgraded function may need to be retested, for example. Further, for example, when a defect in a predetermined function is corrected, the corrected function may need to be retested, for example. The test design document is managed in association with the test set used when creating it. Furthermore, in the test set, text related to the target function is stored in the test set name, test set description, test set comment, or the like. The server 20 searches for a test set based on the wording related to the function, and searches for a test design document created using this test set. If a test set has been created for a function that was not updated and there is a test design document created using this test set, the user can retest by searching for the relevant test set. It becomes possible to understand the target test design document. Therefore, it becomes possible to easily discover targets that require retesting.

Also, for example, additional tests may be required in a given test set. Based on the test set that requires additional testing, the server 20 searches for a test design document created using the test set. By searching for the relevant test set, the user can understand which test design documents require additional testing. Therefore, it becomes possible to easily discover targets that require additional testing.

Further, in the embodiment described above, the server 20 may classify the test set by any category such as industry, usage scene, or device used, and store, use, and provide the test set as a test knowledge database. For example, the server 20 stores test sets specific to the game industry in a game industry database, and provides the stored test sets in response to a user's request. This makes the knowledge accumulated in a given industry useful when creating test designs for other projects in the same industry. In other words, it is possible to reduce the burden on test designers.

Further, for example, the server 20 stores test sets that are often performed in usage situations where map functions are linked in a database related to map function linkage, and provides the stored test sets in response to a user's request. . As a result, the knowledge accumulated in a predetermined usage situation becomes useful when creating test design documents for other projects related to similar situations. In other words, it is possible to reduce the burden on test designers.

Further, for example, the server 20 accumulates test sets specific to the device used, such as iPhone (registered trademark) and provide a set. As a result, the knowledge accumulated in a given device becomes useful when creating a test design document for another project related to a similar device (a new version of the device). In other words, it is possible to reduce the burden on test designers.

<4 Basic hardware configuration of the computer>
FIG. 18 is a block diagram showing the basic hardware configuration of the computer 90. The computer 90 includes at least a processor 91, a main storage device 92, an auxiliary storage device 93, and a communication IF 99 (interface). These are electrically connected to each other by a bus.

The processor 91 is hardware for executing a set of instructions written in a program. The processor 91 includes an arithmetic unit, registers, peripheral circuits, and the like.

The main storage device 92 is for temporarily storing programs and data processed by the programs. For example, it is a volatile memory such as DRAM (Dynamic Random Access Memory).

The auxiliary storage device 93 is a storage device for storing data and programs. Examples include flash memory, HDD (Hard Disc Drive), magneto-optical disk, CD-ROM, DVD-ROM, semiconductor memory, and the like.

The communication IF 99 is an interface for inputting and outputting signals for communicating with other computers via a network using a wired or wireless communication standard.
The network is composed of various mobile communication systems constructed using the Internet, LAN, wireless base stations, and the like. For example, the network includes 3G, 4G, 5G mobile communication systems, LTE (Long Term Evolution), a wireless network (for example, Wi-Fi (registered trademark)) that can be connected to the Internet through a predetermined access point, and the like. When connecting wirelessly, communication protocols include, for example, Z-Wave (registered trademark), ZigBee (registered trademark), Bluetooth (registered trademark), and the like. In the case of a wired connection, the network includes a network that is directly connected using a USB (Universal Serial Bus) cable or the like.

Note that the computer 90 can be virtually realized by distributing all or part of each hardware configuration to a plurality of computers 90 and interconnecting them via a network. In this way, the concept of the computer 90 includes not only the computer 90 housed in a single housing or case, but also a virtualized computer system.

<Basic functional configuration of computer 90>
The functional configuration of the computer realized by the basic hardware configuration of the computer 90 shown in FIG. 18 will be described. The computer includes at least functional units of a control section, a storage section, and a communication section.

Note that the functional units included in the computer 90 can also be implemented by distributing all or part of each functional unit to a plurality of computers 90 interconnected via a network. The computer 90 is a concept that includes not only a single computer 90 but also a virtualized computer system.

The control unit is realized by the processor 91 reading out various programs stored in the auxiliary storage device 93, loading them into the main storage device 92, and executing processing according to the programs. The control unit can implement a functional unit that performs various information processing depending on the type of program. Thereby, the computer is realized as an information processing device that performs information processing.

The storage unit is realized by a main storage device 92 and an auxiliary storage device 93. The storage unit stores data, various programs, and various databases. Further, the processor 91 can secure a storage area corresponding to the storage section in the main storage device 92 or the auxiliary storage device 93 according to the program. Further, the control unit can cause the processor 91 to execute processing for adding, updating, and deleting data stored in the storage unit according to various programs.

A database refers to a relational database, which is used to manage data sets called tabular tables, which are structurally defined by rows and columns, in relation to each other. In a database, a table is called a table, a table column is called a column, and a table row is called a record. In a relational database, you can set and associate relationships between tables.
Usually, each table has a column set as a key to uniquely identify a record, but setting a key to a column is not essential. The control unit can cause the processor 91 to add, delete, or update records to a specific table stored in the storage unit according to various programs.

The communication unit is realized by a communication IF 99. The communication unit realizes a function of communicating with other computers 90 via a network. The communication unit can receive information transmitted from other computers 90 and input it to the control unit. The control unit can cause the processor 91 to execute information processing on the received information according to various programs. Further, the communication unit can transmit information output from the control unit to another computer 90.

Although several embodiments of the present disclosure have been described above, these embodiments can be implemented in various other forms, and various omissions, substitutions, and changes can be made without departing from the gist of the invention. It can be performed. These embodiments and their modifications are included within the scope and gist of the invention as well as within the scope of the invention described in the claims and its equivalents.

<Additional notes>
The matters explained in each of the above embodiments are additionally described below.

(Additional note 1)
A program for causing a computer including a processor and a memory to execute the program, the program includes the steps of: receiving a specification of a test design document; a step of accepting a specification for at least one of the test items of the test items; a step of storing information for conducting a test of the specified test item as a test set so that any user can access it; A program that reads a stored test set in response to a request from a user, and inserts the read test set into a predetermined area of a test design document created by an arbitrary user.
(Additional note 2)
In the storing step, the information for testing the test items includes a test viewpoint, confirmation items, expected values, factors, levels, and patterns (Appendix 1).
(Additional note 3)
In the storing step, the program according to (Appendix 1) or (Appendix 2) stores a sentence related to the test set in association with the test set.
(Additional note 4)
In the program according to appendix 3, in the storing step, the text regarding the test set is an explanation about the test set or a comment from a tester who conducted a test based on the test set.
(Appendix 5)
In the step of storing, if a similar test set is already stored, specifying the test item, setting the name of the test set, or accepting both of these again (Appendix 1) to (Appendix 4) program.
(Appendix 6)
In the storing step, if a similar test set is already stored, the test item is specified so that the contents of the test set related to the specified test item can be compared with the contents of the already stored test set. The program according to any one of (Appendix 1) to (Appendix 5) to be presented to a user.
(Appendix 7)
In the storing step, if the contents of the test set related to the specified test item are different from the contents of the already stored test set, but the names of these test sets are similar, the already stored test set is used. The program according to any one of (Appendix 1) to (Appendix 6) that proposes storage under a name different from .
(Appendix 8)
When inputting characters from any user in the area for inputting information when creating a test design document, the processor executes a step of presenting the test set related to the input characters to the arbitrary user. The program according to any one of (Appendix 1) to (Appendix 7).
(Appendix 9)
In the step to present, if there are multiple test sets related to the input characters, the creation date of the test design document, the number of test items included, the high failure rate, the high number of times the test set is used, or the test set. The program according to appendix 8, which presents a plurality of test sets in an order based on the word order of first names.
(Appendix 10)
A step of storing the test results of test cases based on the test design document created using the test set, a step of analyzing the test results of the test case related to the test set, and a step when any user creates the test design document. , causing the processor to execute the step of presenting a test set available to any user together with the results of analyzing test results of test cases related to the test set (Appendix 1) to (Appendix 9). program.
(Appendix 11)
In the presenting step, if there are multiple test sets available, the program according to appendix 10 presents the multiple test sets in an order based on the analyzed results.
(Appendix 12)
A step of aggregating the number of times a test set has been used, a step of analyzing the aggregation results, and a step of aggregating the number of times a test set has been used, and a step of analyzing the aggregation results. The program according to any one of (Appendix 1) to (Appendix 11), which causes the processor to execute the step of presenting the analysis results together with the results of the analysis.
(Appendix 13)
In the presenting step, if there are multiple test sets available, the program according to appendix 12 presents the multiple test sets in an order based on the analyzed results.
(Appendix 14)
A method executed by a computer comprising a processor and a memory, the processor receiving a specification of a test design, and in the accepted test design, specifying a plurality of test viewpoints included in a predetermined function. The steps include a step of accepting a designation for at least one of the test viewpoints, a step of storing information for implementing a test of the specified test viewpoint as a test set so that it can be accessed by any user, and a step of receiving a designation from any user. A method of reading a stored test set in response to a request and inserting the read test set into a predetermined area of a test design document created by an arbitrary user.
(Appendix 15)
An information processing device comprising a control unit and a storage unit, wherein the control unit receives a designation of a test design document, and in the test design document for which the designation is accepted, a plurality of test viewpoints included in a predetermined function are specified. The steps include a step of accepting a designation for at least one of the test viewpoints, a step of storing information for implementing a test of the specified test viewpoint as a test set so that it can be accessed by any user, and a step of receiving a designation from any user. An information processing apparatus that reads a stored test set in response to a request, and inserts the read test set into a predetermined area of a test design document created by an arbitrary user.
(Appendix 16)
a means for accepting the specification of a test design document; a means for accepting the specification of at least one test perspective among a plurality of test perspectives included in a predetermined function in the test design document for which the specification has been accepted; A means for storing information for carrying out a test as a test set so that any user can access it; and a means for inserting the test design into a predetermined area of the test design document created by the system.

1...System 10...Terminal device 121...Communication unit 13...Input device 131...Mouse 132...Keyboard 133...Touch sensitive device 14...Output device 141...Display 15...Memory 16...Storage 180...Storage unit 190...Control unit 191 …Operation reception unit 192…Transmission/reception unit 193…Presentation control unit 19…Processor 20…Server 201…Communication unit 202…Storage unit 203…Control unit 25…Memory 26…Storage 29…Processor 80…Network

Claims (16)

A program for causing a computer including a processor and a memory to execute, the program causing the processor to:
a step of accepting specification of a test design document;
a step of receiving specifications for two or more test items among a plurality of test items for testing a predetermined function in the test design document for which specifications have been accepted;
storing information for carrying out a test of two or more specified test items as a test set so that any user can access it;
A program that reads a stored test set in response to a request from any of the users, and inserts the read test set into a predetermined area of a test design document created by any of the users. 2. The program according to claim 1, wherein in the storing step, the information for testing the test items includes a test viewpoint, confirmation items, expected values, factors, levels, and patterns. 2. The program according to claim 1, wherein, in the storing step, a sentence regarding the test set is stored in association with the test set. 4. The program according to claim 3, wherein in the storing step, the text regarding the test set is an explanation about the test set or a comment from a tester who conducted a test based on the test set. 2. The program according to claim 1, wherein in the storing step, if a similar test set is already stored, the designation of the test item, the setting of the name of the test set, or both of these are accepted again. In the storing step, if a similar test set is already stored, the content of the test set related to the specified test item can be compared with the content of the already stored test set. 2. The program according to claim 1, wherein the program presents test items to a specified user. In the storing step, if the contents of the test set related to the specified test item are different from the contents of the already stored test set, but the names of these test sets are similar, 3. The program according to claim 2 , wherein the program proposes storage under a name different from that of the test set. When inputting characters from an arbitrary user in an area for inputting information when creating the test design document, a test set associated with the input characters is presented to the arbitrary user. The program according to claim 1, which causes the processor to execute. In the presenting step, if there are multiple test sets related to the input characters, the creation date of the test design document, the number of test items included, the high failure rate, the high number of diversions, 9. The program according to claim 8, wherein the plurality of test sets are presented in an order based on the word order of test set names. a step of storing test results of test cases based on the test design document created using the test set;
analyzing test results of test cases related to the test set and calculating a failure rate ;
When the arbitrary user creates a test design document, the step of presenting the test set available to the arbitrary user along with the failure rate calculated based on the test result of the test case related to the test set. The program according to claim 1, which is executed by a processor. 11. The program according to claim 10, wherein in the presenting step, if there are a plurality of test sets available, the plurality of test sets are presented in an order based on the failure rate . aggregating the number of times the test set has been used;
analyzing the aggregation results and calculating parameters related to the number of diversions ;
2. The processor according to claim 1, wherein when an arbitrary user creates a test design document, the processor executes the step of presenting a test set available to the arbitrary user together with the parameter regarding the number of times the test set is used. program. 13. The program according to claim 12, wherein in the presenting step, if there are a plurality of test sets available, the plurality of test sets are presented in an order based on the parameter . A method implemented in a computer comprising a processor and a memory, the processor comprising:
a step of accepting specification of a test design document;
a step of receiving specifications for two or more test items among a plurality of test items for testing a predetermined function in the test design document for which specifications have been accepted;
storing information for carrying out a test of two or more specified test items as a test set so that any user can access it;
The method includes the steps of: reading out a stored test set in response to a request from any of the users; and inserting the read test set into a predetermined area of a test design document created by any of the users. An information processing device comprising a control section and a storage section, the control section comprising:
a step of accepting specification of a test design document;
a step of receiving specifications for two or more test items among a plurality of test items for testing a predetermined function in the test design document for which specifications have been accepted;
storing information for carrying out a test of two or more specified test items as a test set so that any user can access it;
An information processing apparatus that reads a stored test set in response to a request from any of the users, and inserts the read test set into a predetermined area of a test design document created by any of the users. A means for accepting the specification of a test design document;
means for accepting designations for two or more test items among a plurality of test items for testing a predetermined function in the test design document for which designations have been accepted;
means for storing information for carrying out a test of two or more specified test items as a test set so that any user can access it;
A system comprising means for reading a stored test set in response to a request from any of the users and inserting the read test set into a predetermined area of a test design document created by any of the users.