JP7012968B2 - Program inspection equipment, program inspection method and program inspection program - Google Patents

Description

The present invention relates to a program inspection device, a program inspection method, and a program inspection program.

Conventionally, for example, electronic devices and programs such as games and applications have been inspected to confirm their operation before shipping. Patent Document 1 discloses an inspection device for electronic devices and the like. The inspection device described in Patent Document 1 is a device for inspecting a television receiver, and sequentially executes the procedure of a command for operating the television receiver, and the television receiver determines in advance a normal normal procedure accordingly. It is detected as an error when no operation is performed or when a predetermined abnormal operation is performed.

Japanese Unexamined Patent Publication No. 2009-277060

By the way, since the processing contents of the program are becoming complicated, the labor and work time of the personnel for performing the inspection tend to increase, and the development cost of the program including the inspection cost increases accordingly. It has become. In addition, even if a dedicated inspection program for inspecting a program is developed, the inspection program can only perform a dedicated inspection for one type of program, and inspect other types of programs. I couldn't.

It is an object of the present invention to provide a program inspection device, a program inspection method, and a program inspection program capable of inspecting various programs.

The program inspection device of one aspect is arranged in a storage unit in which the program to be inspected is stored, a screen displayed on the display unit when the program stored in the storage unit is executed, and the screen thereof. When the program is executed based on the extraction unit that extracts the buttons, the screen extracted by the extraction unit, the buttons arranged in the screen, and the transition screen that transitions when the button is operated. Based on the acquisition unit that acquires the transition structure of the program and the transition structure acquired by the acquisition unit, a behavior model is created according to the expected behavior when the user advances the contents of the program when the program is executed. The screen is sequentially transitioned by the creation unit and the inspection unit that executes the program and sequentially transitions the screen by operating the buttons arranged in the screen according to the behavior model created by the creation unit. If there is a problem in the program at the time of making the program, it is provided with a report generation unit that generates a report on the problem.

In the inspection device of one aspect of the program, as an action model, the creation unit preliminarily sets an action when the user advances the contents of the other program when a plurality of other programs different from the program to be inspected are executed. One or more of the buttons arranged on the screen when the program to be inspected is executed is operated based on the learning and the result of the learning and the transition structure acquired by the acquisition unit. It may be to generate the content of the action of the thing.

In the inspection device of the program of one aspect, the extraction unit is at least one of a hash value acquired based on the screen, a feature vector acquired based on the screen, and position information of a button arranged in the screen. It may be possible to avoid extracting the same screen by determining the identity of the screen based on the above.

In the program inspection device of one aspect, the program stored in the storage unit may be a game program.

In one aspect of the program inspection method, a storage step in which the computer stores the program to be inspected in the storage unit, a screen displayed on the display unit when the program stored in the storage unit is executed, and a screen thereof. Based on the extraction step that extracts the buttons arranged inside, the screen extracted by the extraction step, the types of buttons arranged in the screen, and the transition screen that transitions when the button is operated. , The acquisition step to acquire the transition structure when the program is executed, and the expected behavior when the user advances the contents of the program when the program is executed based on the transition structure acquired in the acquisition step. A creation step that creates a behavior model according to the above, an inspection step that executes a program and sequentially transitions the screen by operating buttons arranged on the screen according to the behavior model created by the creation step. If there is a problem in the program when the screens are sequentially transitioned by the inspection step, a report generation step for generating a report on the problem is executed.

The inspection program of one aspect of the program includes a storage function in which the program to be inspected is stored in the computer, a screen displayed on the display unit when the program stored in the storage function is executed, and a screen in the screen. A program based on the extraction function that extracts the buttons to be arranged, the screen extracted by the extraction function, the types of buttons arranged in the screen, and the transition screen that transitions when the button is operated. Based on the acquisition function that acquires the transition structure when is executed and the transition structure acquired by the acquisition function, depending on the expected behavior when the user advances the contents of the program when the program is executed. A creation function that creates a behavioral model, an inspection function that executes a program, and an inspection function that sequentially transitions the screen by operating buttons arranged on the screen according to the behavioral model created by the creation function, and an inspection function. If there is a problem in the program when the screens are sequentially transitioned by, a report generation function that generates a report on the problem is realized.

One aspect of the program inspection device is an acquisition unit that acquires a transition structure when the program to be inspected is executed, and when the user advances the contents of the program when the program is executed based on the transition structure. A creation unit that creates a behavior model according to the expected behavior of, and an inspection department that executes a program and sequentially transitions the screen by operating buttons arranged on the screen according to the behavior model. If there is a problem in the program when the screens are sequentially changed by the unit, a report generation unit for generating a report on the problem is provided, so that various programs can be inspected.
Further, the inspection method of the program of one aspect and the inspection program of the program can have the same effect as the inspection device of the program of one aspect described above.

It is a block diagram for demonstrating the inspection apparatus which concerns on one Embodiment. It is a figure for demonstrating the 1st example of the screen which is displayed on the display part. It is a figure for demonstrating the 2nd example of the screen displayed on the display part. It is a figure for demonstrating the 3rd example of the screen displayed on the display part. It is a figure for demonstrating the 4th example of the screen displayed on the display part. It is a figure for demonstrating the 5th example of the screen displayed on the display part. It is a figure for demonstrating the sixth example of the screen displayed on the display part. It is a flowchart for demonstrating the inspection method of the program which concerns on one Embodiment.

Hereinafter, an embodiment of the present invention will be described.
FIG. 1 is a block diagram for explaining the inspection device 1 according to the embodiment.
The program inspection device 1 is used for debugging performed when developing a program. The inspection device 1 extracts a button in each screen displayed on the display unit 18 when the program is executed, and identifies a screen to be transitioned when the button is operated, whereby the screen is transitioned. Get the transition structure of the time. Next, the inspection device 1 actually executes the program and sequentially operates the buttons according to the transition structure to advance the story executed by the program. At this time, the inspection device 1 inspects whether a defect (bug) related to the program such as a screen transition does not occur, the program crashes, or the screen display is not normal occurs. When a defect occurs, the inspection device 1 outputs a report on the defect to the program, including an action history such as a button operation immediately before. Such an inspection device 1 can inspect various programs. The program can receive input from the user and change the processing content of the program and the screen displayed on the display unit 18 according to the input. The inspection device 1 can inspect a game program as a program, for example, and as a specific example, can inspect a game program having a story in which the screen changes according to a button operation. As a more specific example, the inspection device 1 can inspect a game program executed on a mobile terminal such as a smartphone.

Next, the inspection device 1 of the program according to the embodiment will be described in detail.
The inspection device 1 includes an extraction unit 12, an acquisition unit 13, a creation unit 14, an inspection unit 15, a report generation unit 16, a storage unit 17, and a display unit 18. The extraction unit 12, the acquisition unit 13, the creation unit 14, the inspection unit 15, and the report generation unit 16 may be realized as one function of the control unit 11 of the inspection device 1.

The storage unit 17 stores the program to be inspected. The program stored in the storage unit 17 may be a game program as in the above-mentioned example. The storage unit 17 may be a storage unit arranged in the inspection device 1 or an external storage unit arranged outside the inspection device 1. In this embodiment, the storage unit 17 will be described with an example of being arranged in the inspection device 1. A person who wishes to inspect the program (for example, an employee of a company that develops the program) can have the inspection device 1 inspect the program by uploading the program to be inspected to the storage unit 17.

As an example, the display unit 18 is a display device such as a liquid crystal display and an organic EL (Electro-Luminescence) display. The display unit 18 displays an image on the display unit 18 and outputs a sound to a speaker (shown) based on the control of the control unit 11 (for example, the display control unit (not shown) arranged in the inspection device 1). Output from).

The extraction unit 12 extracts a screen displayed on the display unit 18 when the program stored in the storage unit 17 is executed, and a button arranged in the screen. The screen of the program changes according to the progress of the contents of the program. Buttons may be arranged on each screen. For example, when a button arranged on the screen is tapped or clicked, the program transitions to another screen different from that screen. When transitioning from one screen to another, when screen A completely switches to another screen B, or when a new button C is displayed when the button B displayed on the screen A is operated () (When a part of screen A is switched) and the like are also included. The extraction unit 12 extracts the screen and all the buttons arranged in the screen based on, for example, operating the program to be inspected. That is, the extraction unit 12 sequentially extracts the screen and the button by sequentially transitioning the screen. The extraction unit 12 may extract the screen and store, for example, screen image data (for example, a screenshot or the like) in the storage unit 17. Further, the extraction unit 12 may extract the button, for example, to acquire the position information of the button in the screen.

When the screen is changed, the extraction unit 12 needs to determine which screen (which screen (position) in the screen transition by a plurality of screens) the screen displayed on the display unit 18 is currently. Therefore, the extraction unit 12 may use the neural network to determine which screen (position) the transition destination screen is from among the plurality of screens provided by the program. For example, the extraction unit 12 assigns information indicating which position (at which position when a plurality of screens transitions) the extraction is to the screen, and simultaneously captures the features of the screen and the connection between the plurality of screens. Thereby, from a relatively small amount of images, it is possible to relatively accurately determine which screen the extracted screen is in the screen transition by a plurality of screens (screen identity).

Further, when the extraction unit 12 detects the button, the button may be detected from the image data (for example, a screenshot) of the screen by using, for example, an object detection technique. The object detection detects an object (a button in this embodiment) existing in one image, and detects the position and what the object is. The object detection (button detection model) of the present embodiment is a function that detects only a button in the screen and outputs the position. More specifically, the object detection (button detection model) of the present embodiment detects a button included in the screen by inputting a screen (image data), and determines its position and coordinates in the screen. It is an input / output function to output.

When the extraction unit 12 sequentially transitions a plurality of screens, it is necessary to determine whether or not the screens have transitioned. For example, the extraction unit 12 compares the screen in which the button is detected with the screen extracted after a certain period of time has elapsed by operating the button after detecting the button, and if it is determined whether they are the same, the screen transitions. Can be determined. The fixed time can be set as appropriate. In this case, the extraction unit 12 needs to determine whether the screens are the same. Therefore, the extraction unit 12 has, for example, the feature amount of the image using the image comparison model which is the result of learning the image in advance, the RGB pixel value of the image, and the coordinates of the buttons in the screen detected by the button detection model described above. Judge the identity of the screen based on. The image comparison model is an input / output function that receives two screens as inputs and outputs the similarity indicating whether the images are the same. The extraction unit 12 determines that the two images are the same if the similarity output from the image comparison model is equal to or higher than a preset threshold value.

The screens displayed on the display unit 18 based on the program are similar. Also, depending on the progress of the program, it may return to the original screen (home screen as an example). Therefore, the extraction unit 12 screens based on at least one of the hash value acquired based on the screen, the feature vector acquired based on the screen, and the position information of the buttons arranged in the screen. It may be possible to avoid extracting the same screen by determining the identity of the above. For example, the extraction unit 12 inputs a screen to a hash function and acquires a hash value as an output of the hash function. As for the hash value, the same value can be obtained from the same data. Therefore, the extraction unit 12 can determine the identity of the screen based on the hash value. Further, the extraction unit 12 extracts, for example, the feature points of the image and extracts the feature vector of the feature points. If the feature vectors of the feature points of the two images to be contrasted are the same, it can be considered that both images are the same. The extraction unit 12 can determine the identity of the screen based on the feature vector. Further, in a plurality of images, even if the background and the like are the same, the positions of the buttons may be different. Therefore, the extraction unit 12 can determine the identity of the image based on the position information of the button on the screen.

If the screen or button cannot be automatically extracted, the extraction unit 12 may extract the screen or button based on the operation of the user who uses the inspection device 1.
Further, if the plurality of automatically extracted buttons are erroneously recognized as buttons, that is, the plurality of automatically extracted buttons (objects) include those that are not buttons. If so, the object mistakenly recognized as a button may be deleted based on the user's operation.

The acquisition unit 13 has a transition structure when the program is executed based on the screen extracted by the extraction unit 12, the buttons arranged in the screen, and the transition screen that transitions when the button is operated. To get. As an example, when the button B is arranged on the screen A, when the button B is operated and the transition to the transition screen C, the acquisition unit 13 operates the button B arranged on the screen A. Acquire the structure (transition structure) of transitioning to the transition screen C. That is, the acquisition unit 13 acquires the transition structure by registering the screen, the button, and the transition screen in association with each other. In this case, the acquisition unit 13 may register the screen (transition screen) for each function of the program.

Based on the transition structure acquired by the acquisition unit 13, the creation unit 14 creates an action model according to the expected behavior when the user advances the contents of the program when the program is executed. As a behavior model, the creating unit 14 learns in advance the behavior when the user advances the contents of the other program when a plurality of other programs different from the program to be inspected are executed, and the learning result and the result of the learning. , The content of the action that one of one or a plurality of buttons arranged on the screen is operated when the program to be inspected is executed based on the transition structure acquired by the acquisition unit 13. It may be generated.

Specifically, first, the creating unit 14 learns the behavior of the user who operates the program. As a specific example, when the program to be inspected is a game program, the creating unit 14 learns the behavior (how to proceed with the game) of the user who plays with the game program as another program. Learning can be done from multiple perspectives.

First, the creating unit 14 learns actions (how to proceed with the contents of the program by the user) according to the action purpose (tactical action) when the user operates a plurality of other programs different from the program to be inspected. Specifically, the creating unit 14 learns the order of user actions by deep learning. As an example, when the creation unit 14 learns the behaviors of a plurality of cases (for example, about 10 cases) and generates a behavior model, the inspection unit 15 described later may then (for example,) based on the behavior model. , 11th) Estimate the probability of action of the selected user.

Further, the creating unit 14 learns detailed actions (strategic actions) for accomplishing the action purpose in the program based on the transition screen of the program to be inspected. That is, the creating unit 14 sets in advance a screen that is a condition for achieving the purpose for each tactical action. The screen is regarded as a "destination" and the other screens are regarded as a "road", and the transition action is repeated until the destination screen is reached while searching for a route. In this case, the creating unit 14 has various irregularities such as when searching for a route, when the route to the destination screen cannot be found due to improper settings, or when the button to be operated cannot be found in the screen. By performing route search according to the case, detailed actions (strategic actions) are learned. When the creation unit 14 reaches the destination screen and achieves the strategic action (learning), the creating unit 14 selects a new strategic action again by using the behavior model generated as described later.

Next, the creating unit 14 automatically generates a behavior model based on the learning result after understanding the transition structure. That is, the creation unit 14 determines how the user operates in the transition structure acquired by the acquisition unit 13 (how the user advances the contents of the program to be inspected) based on the learning model (learning result). A behavioral model is generated by estimating. The behavior model is a model that estimates the behavior of the user (how the user advances the contents of the program to be inspected).

Further, when the creating unit 14 reaches a specific screen when the inspection unit 15 described later advances the contents of the program according to the behavior model, the user wants to separately specify a later action from the specific screen. It may be possible to generate the content (behavioral regulation content) that defines the behavior based on the operation. The content of the action regulation may be described by, for example, a flowchart for designating the flow of action.

The inspection unit 15 executes the program and sequentially transitions the screen by operating the buttons arranged in the screen according to the behavior model created by the creation unit 14. That is, the inspection unit 15 executes the program to be inspected, advances the contents of the program according to the behavior model and the behavior regulation contents (flow chart), and performs debugging. At this time, the inspection unit 15 inspects whether or not there is a defect (bug) in the program, for example, the screen does not transition, the button is not displayed, or the screen to be transitioned does not transition.

If there is a problem in the program when the inspection unit 15 sequentially transitions the screen, the report generation unit 16 generates a report on the problem. The report generation unit 16 generates a report on the problem even if a program defect (bug) such as a screen transition does not occur when the program to be inspected is executed by the extraction unit 12. You may do it. The report may include, for example, the situation in which the defect has occurred, the content in which the defect has occurred, the screen in which the defect has occurred, and the like. For example, the report generation unit 16 may store the generated report in the storage unit 17, or may display the report on the display unit 18 after the inspection by the inspection unit 15 is completed.

Next, an example of the screen displayed on the display unit 18 will be described.
FIG. 2 is a diagram for explaining a first example of a screen displayed on the display unit 18.
The inspection device 1 (control unit 11 (display control unit)) displays a list of programs stored in the storage unit 17 on the display unit 18 as illustrated in FIG. Further, when the user wants the inspection device 1 to inspect the program, the user can upload the program to be inspected to the inspection device 1 by operating the "upload" button. Further, the user can have the inspection device 1 inspect the program by selecting one of the plurality of programs displayed in the program list.

FIG. 3 is a diagram for explaining a second example of the screen displayed on the display unit 18.
When the inspection device 1 (control unit 11 (display control unit)) extracts the screen and the button by the extraction unit 12, the inspection device 1 (control unit 11 (display control unit)) displays the screen illustrated in FIG. 3 on the display unit 18. The inspection device 1 has, for example, the number of screens acquired by operating the program to be inspected (35 screens in the case of FIG. 3), and when the number of screens is the number of screens, the behavior model is determined by the creating unit 14. The time required for generation and the like are displayed on the display unit 18.

FIG. 4 is a diagram for explaining a third example of the screen displayed on the display unit 18.
The inspection device 1 (control unit 11 (display control unit)) displays a list of extracted screens on the display unit 18 as illustrated in FIG. 4, for example, when the extraction of screens is completed by the extraction unit 12. ..

FIG. 5 is a diagram for explaining a fourth example of the screen displayed on the display unit 18.
The inspection device 1 (control unit 11 (display control unit)) displays a list of buttons extracted by the extraction unit 12 on the display unit 18. For example, the inspection device 1 displays a list of buttons extracted for each screen and a screen (transition destination) that transitions when the buttons are operated on the display unit 18.

FIG. 6 is a diagram for explaining a fifth example of the screen displayed on the display unit 18.
When the inspection device 1 (control unit 11 (display control unit)) generates the action regulation content by the generation unit, the inspection device 1 (control unit 11 (display control unit)) displays a flowchart for designating the flow of the action on the display unit 18.

FIG. 7 is a diagram for explaining a sixth example of the screen displayed on the display unit 18.
When the report is generated by the report generation unit 16, the inspection device 1 (control unit 11 (display control unit)) displays a list of defects as the report on the display unit 18.

Next, the inspection method of the program according to one embodiment will be described.
FIG. 8 is a flowchart for explaining an inspection method of the program according to the embodiment.

In step ST1, the storage unit 17 stores the program to be inspected uploaded to the inspection device 1. For example, the inspection device 1 receives a program to be inspected transmitted from a terminal (not shown) or the like operated by the user, and stores the program in the storage unit 17.

In step ST2, the extraction unit 12 executes the program stored in the storage unit 17 in step ST1, and the screen displayed on the display unit 18 according to the progress of the contents of the program and the screen are arranged in the screen. Extract the button and. The extraction unit 12 sequentially extracts screens and buttons according to the progress of the contents of the program.

In step ST3, the acquisition unit 13 acquires a structure (transition structure) when the contents of the program progresses based on the screen and the button extracted in step ST2. The acquisition unit 13 generates a transition structure at any time according to the sequential extraction of screens and buttons in step ST3.

In step ST4, the creating unit 14 generates a behavior model based on the transition structure acquired in step ST3. The behavior model is a model that estimates the behavior of the user (how the user advances the contents of the program to be inspected).
Further, when the creating unit 14 wants to separately specify a subsequent action from the specific screen when the content of the program is advanced (when inspecting) according to the behavior model in step ST5 described later. In the case of, the content that regulates the behavior (contents of the behavior regulation) may be generated separately.

In step ST5, the inspection unit 15 executes the program to be inspected stored in the storage unit 17 in step ST1 based on the behavior model and the behavior regulation contents generated in step ST4, and inspects whether the program has a defect. do.

In step ST6, when the program has a defect in the inspection in step ST5, the report generation unit 16 generates a report regarding the defect. Further, the report generation unit 16 may generate a report on the defect even if there is a defect in the program when extracting the screen and the button in step ST2.

Next, the effect of this embodiment will be described.
The inspection device 1 has an extraction unit 12 that extracts a screen displayed on the display unit 18 when a program to be inspected is executed, a button arranged in the screen, and a screen extracted by the extraction unit 12. And the acquisition unit 13 that acquires the transition structure when the program is executed based on the buttons arranged in the screen and the transition screen that transitions when the button is operated, and the acquisition unit 13. Based on the transition structure, the creation unit 14 that creates an action model according to the expected behavior when the user advances the contents of the program when the program is executed, and the creation unit 14 that executes the program and creates the program. When there is a problem in the program when the inspection unit 15 sequentially transitions the screen by operating the buttons arranged in the screen according to the behavior model created by the inspection unit 15 and when the screen is sequentially transitioned by the inspection unit 15. , A report generation unit 16 that generates a report on the defect.
The inspection device 1 acquires the transition structure of the screen in the program to be inspected, generates a behavior model based on the transition structure, and inspects the program according to the behavior model. Therefore, the inspection device 1 can inspect whether or not a defect occurs in the program by acquiring the transition structure of the program stored in the storage unit 17. Therefore, the inspection device 1 can automatically inspect various programs.
Further, the inspection device 1 generates a behavior model or the like based on the transition structure. As a result, the inspection device 1 can advance the contents of the program with a certain degree of intention in the same manner as the user who operates the contents of the program, and can efficiently execute the inspection of the program. When the program is automatically inspected without generating the behavior model, a screen (transition) that has not been inspected may occur, but in this embodiment, all screens (transition) are performed according to the behavior model. ) Is inspected, so it is possible to prevent omission of inspection and the like.

In addition to the extraction unit 12 executing the program to be inspected, the inspection device 1 executes the program in the inspection unit 15 to perform the inspection. This is because there is a possibility that all screens (transitions) cannot be reliably acquired by executing the program by the extraction unit 12, and the user intentionally advances the program (as well). It is possible that the program will fail for the first time (if the program progresses according to a behavioral model). Therefore, the inspection device 1 executes the program to be inspected by the extraction unit 12 to extract screens and buttons, and the inspection unit 15 executes the program to be inspected to inspect the program. Further, in the inspection device 1, if a problem occurs when the extraction unit 12 executes the program, the acquisition unit 13 cannot acquire the transition structure. In this case, in the inspection device 1, after the defect of the program is corrected, the screen and the button are extracted again by the extraction unit 12, and the transition structure is acquired by the acquisition unit 13.
The inspection device 1 may extract only the screen and the button when the screen and the button are extracted again as described above, for example, when there is a difference between the previously extracted screen and the re-extracted screen. .. The inspection device 1 may recognize a difference (difference) in the screen based on learning results such as machine learning and deep learning, and automatically detect a different part such as a layout.

In the inspection device 1, the creating unit 14 learns in advance the behavior when the user advances the contents of the other program when a plurality of other programs different from the program to be inspected are executed as the behavior model. Based on the learning result and the transition structure acquired by the acquisition unit 13, one or a plurality of buttons arranged on the screen when the program to be inspected is executed is operated. It may be to generate the content of the action of.
As a result, the inspection device 1 can generate a behavior model by the creating unit 14. When the inspection unit 15 inspects the program to be inspected, the inspection device 1 can advance the contents of the program according to the behavior model.

In the inspection device 1, the extraction unit 12 is based on at least one of a hash value acquired based on the screen, a feature vector acquired based on the screen, and position information of buttons arranged in the screen. By determining the identity of the screens, it may be possible to avoid extracting the same screens.
As a result, the inspection device 1 can avoid extracting the same screen by the extraction unit 12, and the acquisition unit 13 can generate an appropriate transition structure.

In the inspection device 1, the program stored in the storage unit 17 may be a game program.
In particular, the game program may be a program that can be executed on a mobile terminal such as a smartphone. In such a game program, a button is displayed on the display unit 18, and the content of the program is advanced according to the operation of the button. Therefore, the inspection device 1 can inspect whether or not a problem occurs in a program (for example, a game program) that advances the contents according to the operation of the button.

In the inspection method, the computer extracts the screen displayed on the display unit 18 when the program to be inspected is executed, the buttons arranged in the screen, and the screen extracted by the extraction step. And, based on the type of button arranged in the screen and the transition screen that transitions when the button is operated, the acquisition step to acquire the transition structure when the program is executed and the acquisition step to acquire it. Based on the transition structure that was created, a creation step that creates a behavior model according to the expected behavior when the user advances the contents of the program when the program is executed, and a creation step that executes the program and creates it by the creation step. If there is a problem in the program when the screen is sequentially transitioned by operating the buttons arranged in the screen according to the behavior model, and the screen is sequentially transitioned by the inspection step, the problem is related to the problem. Perform the report generation steps and the report generation steps to generate the report.
The inspection method acquires the transition structure of the screen in the program to be inspected, generates a behavior model based on the transition structure, and inspects the program according to the behavior model. Therefore, in the inspection method, by acquiring the transition structure of the program stored in the storage unit 17, it is possible to inspect whether or not a defect occurs in the program. Therefore, the inspection method can automatically inspect various programs.
In addition, the inspection method generates a behavior model or the like based on the transition structure. As a result, the inspection method can proceed with the contents of the program with a certain degree of intention in the same manner as the user who operates the contents of the program, and the inspection of the program can be executed efficiently. If the program is automatically inspected without generating a behavior model, a screen (transition) that has not been inspected may occur, but in this embodiment, all screens are in accordance with the behavior model. Since (transition) is inspected, it is possible to prevent omission of inspection and the like.

The inspection program has a storage function in which the program to be inspected is stored in the computer, a screen displayed on the display unit 18 when the program stored in the storage function is executed, and a button arranged in the screen. The program was executed based on the extraction function that extracts and, the screen extracted by the extraction function, the types of buttons arranged in the screen, and the transition screen that transitions when the button is operated. Based on the acquisition function that acquires the transition structure at the time and the transition structure acquired by the acquisition function, a behavior model according to the expected behavior when the user advances the contents of the program when the program is executed The creation function to be created, the inspection function to execute the program and sequentially transition the screen by operating the buttons arranged on the screen according to the behavior model created by the creation step, and the inspection function to sequentially change the screen. If there is a problem in the program at the time of transition, a report generation function that generates a report on the problem is realized.
The inspection program acquires the transition structure of the screen in the program to be inspected, generates a behavior model based on the transition structure, and inspects the program according to the behavior model. Therefore, the inspection program can inspect whether or not a defect occurs in the program by acquiring the transition structure of the program stored in the storage unit 17. Therefore, the inspection program can automatically inspect various programs.
In addition, the inspection program generates a behavior model or the like based on the transition structure. As a result, the inspection program can proceed with the contents of the program with a certain degree of intention in the same manner as the user who operates the contents of the program, and can efficiently execute the inspection of the program. If the program is automatically inspected without generating a behavior model, a screen (transition) that has not been inspected may occur, but in this embodiment, all screens are in accordance with the behavior model. Since (transition) is inspected, it is possible to prevent omission of inspection and the like.

The above-mentioned inspection device 1 (inspection method and inspection program) can perform a hybrid inspection together with a person (tester) who inspects the program. That is, the inspection device 1 may intensively perform a pattern repetition inspection on the program, and the tester may estimate the range of influence of the defect according to the result of the inspection and determine the content of the next test.

Further, since the inspection device 1 (inspection method and inspection program) inspects the program according to the behavior model, the load inspection of the program can also be performed. That is, since the inspection device 1 can autonomously advance the contents of the program, the load inspection can be performed in the same situation as the actual environment.

Further, since the inspection device 1 (inspection method and inspection program) inspects the program according to the behavior model, the inspection according to the preference of the user who actually operates the program (depending on which part of the program content is to be emphasized). Inspection) can be performed.

Further, the inspection device 1 (inspection method and inspection program) stores, for example, stores the program to be inspected in the storage unit 17 and acquires the transition structure by the acquisition unit 13, and in addition, performs the inspection according to the behavior model. Charges can be made according to what is done and the number of inspection hours (number of inspections). The billing may be either a monthly billing system or a pay-as-you-go billing system.

Each part of the inspection device 1 of the above-mentioned program may be realized as a function of a computer arithmetic processing unit or the like. That is, the extraction unit 12, the acquisition unit 13, the creation unit 14, the inspection unit 15, and the report generation unit 16 of the inspection device 1 have an extraction function, an acquisition function, a creation function, an inspection function, and a report generation by a computer arithmetic processing unit or the like. Each may be realized as a function.
The inspection program can realize each of the above-mentioned functions in the computer. The inspection program may be recorded on a computer-readable non-temporary recording medium such as an external memory or an optical disc.
Further, as described above, each part of the inspection device 1 may be realized by a computer arithmetic processing unit or the like. The arithmetic processing unit or the like is configured by, for example, an integrated circuit or the like. Therefore, each part of the inspection device 1 may be realized as a circuit constituting an arithmetic processing unit or the like. That is, the extraction unit 12, the acquisition unit 13, the creation unit 14, the inspection unit 15, and the report generation unit 16 of the inspection device 1 constitute an extraction circuit, an acquisition circuit, a creation circuit, an inspection circuit, and a report generation unit 16 constituting a computer arithmetic processing device and the like. It may be realized as a report generation circuit.
Further, the storage unit 17 and the display unit 18 of the inspection device 1 may be realized as a storage circuit and a display circuit by being configured by, for example, an integrated circuit or the like. Further, the storage unit 17 and the display unit 18 of the inspection device 1 may be configured as a storage device and a display device, for example, by being configured by a plurality of devices.

1 Inspection device 11 Control unit 12 Acquisition unit 13 Acquisition unit 14 Creation unit 15 Inspection unit 16 Report generation unit 17 Storage unit 18 Display unit

Claims (6)

A storage unit in which the program to be inspected is stored, and
A screen displayed on the display unit when the program stored in the storage unit is executed, an extraction unit for extracting buttons arranged in the screen, and an extraction unit.
Based on the screen extracted by the extraction unit, the button arranged in the screen, and the transition screen that transitions when the button is operated, the transition structure when the program is executed is acquired. Acquisition department and
Based on the transition structure acquired by the acquisition unit, a creation unit that creates a behavior model according to the expected behavior when the user advances the contents of the program when the program is executed, and a creation unit.
An inspection unit that executes the program and sequentially transitions the screen by operating the buttons arranged in the screen according to the behavior model created by the creation unit.
If there is a problem with the program when the screens are sequentially transitioned by the inspection unit, a report generation unit that generates a report on the problem and a report generation unit.
Program inspection equipment. As the behavior model, the creating unit learns in advance the behavior when the user advances the contents of the other program when a plurality of other programs different from the program to be inspected are executed, and the learning thereof. One or a plurality of buttons arranged on the screen when the program to be inspected is executed based on the result of the above and the transition structure acquired by the acquisition unit. The inspection device of the program according to claim 1, which generates the content of the action of. The extraction unit has the sameness of the screen based on at least one of the hash value acquired based on the screen, the feature vector acquired based on the screen, and the position information of the buttons arranged in the screen. The inspection device of the program according to claim 1 or 2, which avoids extracting the same screen by determining. The program stored in the storage unit is an inspection device for the program according to any one of claims 1 to 3, which is a game program. The computer
A storage step to store the program to be inspected in the storage unit,
An extraction step for extracting a screen displayed on the display unit when the program stored in the storage unit is executed and a button arranged in the screen unit.
A transition structure when the program is executed based on the screen extracted by the extraction step, the type of the button arranged in the screen, and the transition screen that transitions when the button is operated. To get the get steps and
Based on the transition structure acquired in the acquisition step, a creation step of creating a behavior model according to an expected behavior when the user advances the contents of the program when the program is executed, and a creation step.
An inspection step in which the screen is sequentially changed by executing the program and operating the buttons arranged in the screen according to the behavior model created by the creation step.
If there is a problem in the program when the screens are sequentially transitioned by the inspection step, a report generation step for generating a report on the problem and a report generation step.
How to inspect the program to run. On the computer
A memory function that stores the program to be inspected, and
An extraction function that extracts a screen displayed on the display unit when the program stored in the storage function is executed and a button arranged in the screen, and an extraction function.
A transition structure when the program is executed based on the screen extracted by the extraction function, the type of the button arranged in the screen, and the transition screen that transitions when the button is operated. And the get function to get
Based on the transition structure acquired by the acquisition function, a creation function that creates a behavior model according to the expected behavior when the user advances the contents of the program when the program is executed, and a creation function.
An inspection function that executes the program and sequentially transitions the screen by operating the buttons arranged in the screen according to the behavior model created by the creation function.
If there is a problem in the program when the screens are sequentially transitioned by the inspection function, a report generation function that generates a report on the problem and a report generation function
The inspection program of the program that realizes.

Images