JP7296152B2 - Program inspection device, program inspection method and program inspection program - Google Patents

Description

The present invention relates to a program inspection device, a program inspection method, and a program inspection program.

2. Description of the Related Art Conventionally, for example, electronic devices, programs such as games and applications, and the like are inspected to confirm their operation before shipment. Japanese Patent Laid-Open No. 2002-201001 discloses an inspection apparatus for electronic equipment and the like. The inspection apparatus described in Patent Document 1 is an apparatus for inspecting a television receiver, and sequentially executes a procedure of commands for operating the television receiver, and according to the commands, the television receiver determines a predetermined normal state. An error is detected when no operation is performed or when a predetermined abnormal operation is performed.

JP 2009-277060 A

By the way, since the processing contents of programs are becoming more complex, there is a tendency for personnel labor and work time to increase when performing inspections, which is a factor in increasing program development costs including inspection costs. It has become. In addition, even if a special inspection program or the like for program inspection is developed, the inspection program can only carry out exclusive inspection for one type of program, and other types of programs cannot be inspected. I couldn't do it.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a program inspection device, a program inspection method, and a program inspection program that can inspect various programs.

A program inspection apparatus according to one aspect includes a storage unit storing a program to be inspected, a screen displayed on a display unit when the program stored in the storage unit is executed, and a When the program is executed based on an extraction unit that extracts buttons, screens extracted by the extraction unit, buttons arranged in the screens, and transition screens that transition when the buttons are operated An acquisition unit that acquires the transition structure of and based on the transition structure acquired by the acquisition unit, creates a behavior model that corresponds to the expected behavior of the user when the content of the program is advanced when the program is executed. an inspection unit that executes a program and sequentially transitions screens by operating buttons arranged in the screen according to the behavior model created by the creation unit; and a screen that is sequentially transitioned by the inspection unit. and a report generation unit for generating a report about the problem if there is a problem in the program when executing the program.

In one aspect of the program inspection device, the creation unit preliminarily describes, as a behavior model, the behavior of the user when the contents of the other programs are executed when a plurality of other programs different from the program to be inspected are executed. One of the one or more buttons arranged on the screen when the program to be inspected is executed is operated based on the result of the learning and the transition structure acquired by the acquiring unit. It is also possible to generate the content of the action of the thing.

In one aspect of the program inspection device, the extraction unit includes at least one of a hash value acquired based on the screen, a feature vector acquired based on the screen, and position information of buttons arranged in the screen. It is possible to avoid extracting the same screen by judging the identity of the screen based on the same number.

In one aspect of the program inspection device, the program stored in the storage unit may be a game program.

In one aspect of a program inspection method, a computer stores a program to be inspected in a storage unit, a screen displayed on a display unit when the program stored in the storage unit is executed, and Based on the extraction step of extracting the buttons arranged in the screen, the screen extracted by the extraction step, the type of button arranged in the screen, and the transition screen to which the button is operated , an obtaining step of obtaining the transition structure when the program is executed, and an expected behavior when the program is executed by the user, based on the transition structure obtained by the obtaining step. a creation step of creating a behavior model according to the above; an inspection step of executing a program and sequentially transitioning screens by operating buttons arranged in the screen according to the behavior model created by the creation step; and a report generation step for generating a report on the defect if there is a defect in the program when the screens are sequentially transitioned by the inspection step.

According to one aspect of the program inspection program, the computer has a storage function for storing a program to be inspected, a screen displayed on the display unit when the program stored in the storage function is executed, and A program based on an extraction function for extracting buttons to be arranged, screens extracted by the extraction function, types of buttons arranged in the screens, and transition screens to which transitions are made when the buttons are operated. is executed, and based on the transition structure obtained by the obtain function, when the program is executed, depending on the expected behavior when the user advances the contents of the program a creation function that creates a behavior model created by the creation function; an inspection function that executes a program and sequentially transitions screens by operating buttons arranged in the screen according to the behavior model created by the creation function; and a report generating function for generating a report about the problem when there is a problem in the program when sequentially transitioning screens by.

A program inspection apparatus according to one aspect includes an acquisition unit that acquires a transition structure when a program to be inspected is executed, and a transition structure that, when the program is executed based on the transition structure, causes a user to proceed with the contents of the program. A creation unit that creates a behavior model according to the expected behavior of the program, an inspection unit that executes a program and operates buttons arranged in the screen according to the behavior model to sequentially transition the screen, and an inspection If there is a problem in the program when the screen is sequentially transitioned by the unit, the report generation unit generates a report about the problem, so various programs can be inspected.
Further, the program checking method and the program checking program of one aspect can achieve the same effect as the program checking device of one aspect described above.

1 is a block diagram for explaining an inspection device according to one embodiment; FIG. FIG. 4 is a diagram for explaining a first example of a screen displayed on a display unit; FIG. FIG. 10 is a diagram for explaining a second example of a screen displayed on the display unit; FIG. FIG. 12 is a diagram for explaining a third example of a screen displayed on the display unit; FIG. FIG. 12 is a diagram for explaining a fourth example of a screen displayed on the display unit; FIG. FIG. 14 is a diagram for explaining a fifth example of a screen displayed on the display unit; FIG. FIG. 14 is a diagram for explaining a sixth example of a screen displayed on the display unit; FIG. 4 is a flowchart for explaining a program inspection method according to an embodiment;

An embodiment of the present invention will be described below.
FIG. 1 is a block diagram for explaining an inspection device 1 according to one embodiment.
The program inspection device 1 is used for debugging during program development. The inspection apparatus 1 extracts a button in each screen displayed on the display unit 18 when the program is executed, and identifies the screen to which the screen transitions when the button is operated, thereby transitioning the screen. Get the current transition structure. Next, the inspection apparatus 1 actually executes the program and advances the story executed by the program by sequentially operating the buttons according to the transition structure. At this time, the inspection device 1 inspects whether or not there is a problem (bug) related to the program, such as no screen transition, program crash, or abnormal screen display. When a problem occurs, the inspection device 1 outputs a report about the problem including the action history of the last button operation, etc. to the program. Such an inspection device 1 can inspect various programs. The program can receive input from the user and change the processing contents of the program and the screen displayed on the display unit 18 according to the input. For example, the inspection device 1 can inspect a game program as a program, and as a specific example, it can inspect a game program with a storyline in which screens transition according to button operations. As a more specific example, the inspection device 1 can inspect a game program executed on a mobile terminal such as a smart phone.

Next, the program inspection device 1 according to one embodiment will be described in detail.
The inspection device 1 includes an extraction unit 12 , an acquisition unit 13 , a creation unit 14 , an inspection unit 15 , a report generation unit 16 , a storage unit 17 and a display unit 18 . The extraction unit 12 , the acquisition unit 13 , the creation unit 14 , the inspection unit 15 and the report generation unit 16 may be implemented as one function of the control unit 11 of the inspection device 1 .

The storage unit 17 stores programs to be inspected. The program stored in the storage unit 17 may be a game program as in the example described above. The storage unit 17 may be a storage unit arranged in the inspection device 1 or may be an external storage unit arranged outside the inspection device 1 . In this embodiment, an example in which the storage unit 17 is arranged in the inspection apparatus 1 will be described. A person who wishes to inspect a program (e.g., an employee of a company that develops a program) can upload the program to be inspected to the storage unit 17 and have the inspection apparatus 1 inspect the program.

The display unit 18 is, for example, a display device such as a liquid crystal display and an organic EL (Electro-Luminescence) display. The display unit 18 displays an image on the display unit 18 based on the control of the control unit 11 (for example, a display control unit (not shown) arranged in the inspection apparatus 1), and outputs sound to a speaker (not shown). output from

The extraction unit 12 extracts the screen displayed on the display unit 18 when the program stored in the storage unit 17 is executed, and the buttons arranged in the screen. In the program, the screen transitions according to the progress of the contents of the program. Buttons may be arranged on each screen. For example, when an operation such as tapping or clicking a button arranged on the screen is performed, the program transitions to another screen different from that screen. When transitioning from a screen to another screen, when screen A is completely switched to another screen B, and when button B displayed on screen A is operated, new button C is displayed ( A case where a part of the screen A is switched), etc. are also included. The extraction unit 12 extracts the screen and all the buttons arranged in the screen, for example, based on running the program to be inspected. That is, the extraction unit 12 sequentially extracts screens and buttons by sequentially transitioning screens. Note that the extracting unit 12 may extract the screen, for example, by storing image data of the screen (for example, a screen shot or the like) in the storage unit 17 . Further, the extracting unit 12 may, for example, acquire position information of the button within the screen as extracting the button.

When making a screen transition, the extracting unit 12 needs to determine which screen the screen currently displayed on the display unit 18 is (which screen (position) in the screen transition of a plurality of screens). Therefore, the extracting unit 12 may use a neural network to determine which screen (position) is the transition destination screen from among the plurality of screens provided by the program. For example, the extracting unit 12 attaches information indicating at which position (at which position when a plurality of screens transition) the screen is extracted, and captures the characteristics of the screen and the connection between the plurality of screens at the same time. Thus, it is possible to determine with relatively high accuracy which screen in screen transitions among a plurality of screens the extracted screen is (identity of screens) from a relatively small amount of images.

Further, when detecting a button, the extraction unit 12 may detect the button from image data of the screen (for example, a screenshot) by using object detection technology, for example. Object detection detects an object (a button in this embodiment) existing in one image, and detects its position and what the object is. The object detection (button detection model) of this embodiment is a function that detects only buttons in the screen and outputs their positions. More specifically, in the object detection (button detection model) of this embodiment, a screen (image data) is input, buttons included in the screen are detected, and their positions and coordinates within the screen are determined. It is an input/output function that outputs.

The extracting unit 12 needs to determine whether the screens have transitioned in the case of sequentially transitioning a plurality of screens. For example, the extracting unit 12 compares the screen on which the button is detected with the screen extracted after a certain period of time has passed after the button is operated after detecting the button, and determines whether the screens are the same. You can judge whether The certain period of time can be set as appropriate. In this case, the extraction unit 12 needs to determine whether the screens are the same. For this reason, the extraction unit 12 extracts, for example, image feature values using an image comparison model that is a result of pre-learning images, RGB pixel values of the image, and coordinates of buttons in the screen detected by the above-described button detection model. screen identity is determined based on The image comparison model is an input/output function that takes two screens as input and outputs a similarity score indicating whether the images are identical. The extraction unit 12 determines that the two images are the same if the degree of similarity output from the image comparison model is equal to or greater than a preset threshold.

Some of the screens displayed on the display unit 18 based on the program are similar. In addition, depending on the progress of the program, it may return to the original screen (home screen as an example). For this reason, the extracting unit 12 extracts the screen image based on at least one of the hash value acquired based on the screen, the feature vector acquired based on the screen, and the position information of the button arranged in the screen. Extraction of the same screen may be avoided by judging the identity of the screens. The extraction unit 12, for example, inputs the screen to a hash function and obtains a hash value as the output of the hash function. The same hash value is obtained from the same data. Therefore, the extraction unit 12 can determine the identity of the screen based on the hash value. For example, the extraction unit 12 extracts feature points of the image and extracts feature vectors of the feature points. If the feature vectors of the feature points of the two images to be compared are the same, it can be considered that the two images are the same. The extraction unit 12 can determine the identity of the screens based on the feature vectors. Moreover, even if the background and the like are the same in a plurality of images, the positions of the buttons may be different. Therefore, the extracting unit 12 can determine the identity of the images based on the positional information of the buttons within the screen.

Note that the extraction unit 12 may extract the screen or the button based on the operation of the user who uses the inspection apparatus 1 when the screen or the button cannot be automatically extracted.
Further, the extracting unit 12 detects a plurality of automatically extracted buttons that are erroneously recognized as buttons, that is, if the plurality of automatically extracted buttons (objects) includes non-button If so, the object erroneously recognized as the button may be deleted based on the user's operation.

The acquisition unit 13 obtains a transition structure when the program is executed based on the screen extracted by the extraction unit 12, the buttons arranged in the screen, and the transition screen to which the transition screen transitions when the button is operated. to get As an example, when a button B is placed on the screen A, the acquisition unit 13 changes to the transition screen C when the button B is operated. A structure (transition structure) for transitioning to the transition screen C is acquired. That is, the acquisition unit 13 acquires the transition structure by associating and registering the screen, the button, and the transition screen. In this case, the acquisition unit 13 may register screens (transition screens) for each program function.

Based on the transition structure acquired by the acquisition unit 13, the creation unit 14 creates a behavior model corresponding to the expected behavior of the user when the program is executed. As a behavior model, the creation unit 14 learns in advance the behavior of the user when executing the contents of the other programs when a plurality of other programs different from the program to be inspected is executed, and the results of the learning and the , and the transition structure acquired by the acquiring unit 13, the content of the action of operating one or more buttons arranged on the screen when the program to be inspected is executed. may be generated.

Specifically, first, the creating unit 14 learns the behavior of the user who operates the program. As a specific example, when the program to be inspected is a game program, the creation unit 14 learns the behavior (how to proceed with the game) of the user who plays the game program as another program. Learning can be done in multiple ways.

First, the creating unit 14 learns actions (how to proceed with the content of the program by the user) according to the action purpose (tactical action) when the user operates a plurality of programs different from the program to be inspected. Specifically, the creation unit 14 learns the order of user actions by deep learning. As an example, when the creation unit 14 learns a plurality of user behaviors (for example, about 10 cases) and generates a behavior model, the inspection unit 15, which will be described later, based on the behavior model, next (for example , 11th) estimate the probability of the user's action to select.

Also, based on the transition screen of the program to be inspected, the creation unit 14 learns detailed actions (strategic actions) for achieving the action purpose in the program. That is, the creating unit 14 presets a screen that serves as a condition for achieving the objective for each tactical action. This screen is regarded as the "destination", and the other screens are regarded as "paths". In this case, when performing a route search, the creating unit 14 may cause various irregularities such as when a route to the destination screen cannot be found due to inadequate settings, or when a button to be operated cannot be found on the screen. Detailed actions (strategic actions) are learned by performing route searches depending on the case. When the destination screen is reached and the strategic action is achieved (learned), the creation unit 14 uses the action model generated as described later to select a new strategic action again.

Next, the creating unit 14 understands the transition structure and automatically creates a behavior model based on the learning result. That is, the creation unit 14 determines how the user operates the transition structure acquired by the acquisition unit 13 (how the user proceeds with the content of the program to be inspected) based on the learning model (learning result). Behavior model is generated by estimating A behavioral model is a model that estimates a user's behavior (how the user proceeds with the contents of the program to be inspected).

Further, when the content of the program is advanced according to the behavior model in the inspection unit 15, which will be described later, and when a specific screen is reached, the creation unit 14, if the user wants to separately specify the action after the specific screen, It is also possible to generate the content (behavior regulation content) that regulates the behavior based on the operation. The content of the action regulation may be described by, for example, a flow chart or the like that specifies the flow of action.

The inspection unit 15 executes the program, and according to the behavior model created by the creation unit 14, the screens are sequentially changed by operating the buttons arranged in the screen. That is, the inspection unit 15 executes the program to be inspected, advances the contents of the program according to the behavior model and the contents of the behavior regulation (flowchart), and performs debugging. At this time, the inspection unit 15 inspects whether or not there is a bug in the program, such as a screen not transitioning, a button not being displayed, or a screen not transitioning to a scheduled screen.

If there is a problem in the program when the inspection unit 15 sequentially transitions the screens, the report generation unit 16 generates a report about the problem. Note that the report generating unit 16 generates a report regarding the problem even if a problem (bug) in the program such as a screen not transitioning occurs when the program to be inspected is executed by the extracting unit 12. It is also possible to The report may include, for example, the situation where the problem occurred, the content of the problem, the screen where the problem occurred, and the like. For example, the report generation unit 16 may store the generated report in the storage unit 17, and may display the report on the display unit 18 after the inspection by the inspection unit 15 is completed.

Next, an example of a screen displayed on the display unit 18 will be described.
FIG. 2 is a diagram for explaining a first example of a screen displayed on the display unit 18. As shown in FIG.
The inspection apparatus 1 (control unit 11 (display control unit)) displays a list of programs stored in the storage unit 17 on the display unit 18 as illustrated in FIG. Further, when the user wants to have the program inspected by the inspection apparatus 1, the user can upload the program to be inspected to the inspection apparatus 1 by operating the "upload" button. Further, the user can cause the inspection apparatus 1 to inspect the program by selecting one program from the plurality of programs displayed in the program list.

FIG. 3 is a diagram for explaining a second example of the screen displayed on the display unit 18. As shown in FIG.
The inspection apparatus 1 (control unit 11 (display control unit)) displays the screen illustrated in FIG. For example, the inspection apparatus 1 acquires the number of screens acquired by operating the program to be inspected (35 screens in the example shown in FIG. The time required for generation and the like are displayed on the display unit 18 .

FIG. 4 is a diagram for explaining a third example of the screen displayed on the display unit 18. As shown in FIG.
The inspection apparatus 1 (control unit 11 (display control unit)) displays a list of extracted screens on the display unit 18 as illustrated in FIG. .

FIG. 5 is a diagram for explaining a fourth example of the screen displayed on the display unit 18. As shown in FIG.
The inspection apparatus 1 (control unit 11 (display control unit)) displays a list of buttons extracted by the extraction unit 12 on the display unit 18 . For example, the inspection apparatus 1 displays on the display unit 18 a list of buttons extracted for each screen and screens (transition destinations) to which transitions are made when the buttons are operated.

FIG. 6 is a diagram for explaining a fifth example of the screen displayed on the display unit 18. As shown in FIG.
The inspection apparatus 1 (control unit 11 (display control unit)) displays a flow chart designating the flow of actions on the display unit 18 when the content of action regulation is generated by the generation unit.

FIG. 7 is a diagram for explaining a sixth example of the screen displayed on the display unit 18. As shown in FIG.
When the report generation unit 16 generates a report, the inspection apparatus 1 (control unit 11 (display control unit)) displays a list of defects as the report on the display unit 18 .

Next, a program inspection method according to an embodiment will be described.
FIG. 8 is a flowchart for explaining a program inspection method according to an embodiment.

In step ST<b>1 , the storage unit 17 stores the inspection target program uploaded to the inspection apparatus 1 . For example, the inspection apparatus 1 receives a program to be inspected transmitted from a terminal (not shown) or the like operated by a user, and stores the program in the storage unit 17 .

In step ST2, the extracting unit 12 executes the program stored in the storage unit 17 in step ST1. Extract button and . The extraction unit 12 sequentially extracts screens and buttons according to the progress of the contents of the program.

In step ST3, the acquiring unit 13 acquires a structure (transition structure) when the content of the program progresses based on the screens and buttons extracted in step ST2. The acquisition unit 13 generates a transition structure as needed in accordance with the successive extraction of screens and buttons in step ST3.

In step ST4, the creation unit 14 creates a behavior model based on the transition structure acquired in step ST3. A behavioral model is a model that estimates a user's behavior (how the user proceeds with the contents of the program to be inspected).
Further, when the creation unit 14 reaches a specific screen when proceeding with the contents of the program according to the behavior model in step ST5 (to be examined) in step ST5, which will be described later, the creation unit 14 may separately designate an action after the specific screen. In this case, it is also possible to separately generate the content (behavior regulation content) that defines the behavior.

In step ST5, the inspection unit 15 executes the program to be inspected stored in the storage unit 17 in step ST1 based on the behavior model and behavior regulation content generated in step ST4, and inspects whether the program has a problem. do.

In step ST6, the report generation unit 16 generates a report regarding the defect if the program has a defect in the inspection of step ST5. In addition, the report generation unit 16 may generate a report regarding the problem even if there is a problem in the program when extracting the screen and the button in step ST2.

Next, the effects of this embodiment will be described.
The inspection apparatus 1 includes an extraction unit 12 for extracting a screen displayed on a display unit 18 when a program to be inspected is executed and buttons arranged in the screen, and a screen extracted by the extraction unit 12. and an acquisition unit 13 for acquiring the transition structure when the program is executed based on the buttons arranged in the screen and the transition screen that transitions when the button is operated, and the acquisition unit 13 acquires a creation unit 14 for creating a behavior model according to the expected behavior of the user when the program is executed, based on the transition structure thus determined; and a creation unit 14 for executing the program. If there is a problem in the inspection unit 15 that sequentially transitions the screen by operating the buttons arranged in the screen according to the behavior model created by and the program when the screen is sequentially transitioned by the inspection unit 15 , and a report generator 16 that generates a report about the defect.
The inspection apparatus 1 acquires the screen transition structure in the program to be inspected, generates a behavior model based on the transition structure, and inspects the program according to the behavior model. Therefore, by acquiring the transition structure of the program stored in the storage unit 17, the inspection apparatus 1 can inspect whether the program has a problem. Therefore, the inspection apparatus 1 can automatically inspect various programs.
Also, the inspection device 1 generates a behavior model and the like based on the transition structure. As a result, the inspection apparatus 1 can advance the contents of the program with a certain degree of intention in the same way as the user who operates the contents of the program, and can efficiently inspect the program. If a program is automatically inspected without generating a behavior model, screens (transitions) that have not been inspected may occur. ) is inspected, it is possible to prevent inspection omissions.

In addition to executing the program to be inspected by the extraction unit 12, the inspection apparatus 1 executes the program by the inspection unit 15 to perform inspection. This is because there is a possibility that all the screens (transitions) cannot be reliably acquired in the execution of the program by the extraction unit 12, and if the user intentionally advances the program ( There is also a possibility that the program will malfunction for the first time (when the program is advanced according to the behavior model). For this reason, the inspection apparatus 1 executes a program to be inspected by the extraction unit 12 to extract screens and buttons, and executes the program to be inspected by the inspection unit 15 to inspect the program. Further, in the inspection apparatus 1, if a problem occurs when the extraction unit 12 executes the program, the acquisition unit 13 cannot acquire the transition structure. In this case, in the inspection apparatus 1, after the program defect is corrected, the extraction unit 12 extracts screens and buttons again, and the acquisition unit 13 acquires the transition structure.
When extracting the screen and the button again as described above, for example, if there is a difference between the previously extracted screen and the re-extracted screen, the inspection apparatus 1 may extract only that screen. . The inspection apparatus 1 may, for example, recognize differences (differences) between screens based on learning results such as machine learning and deep learning, and automatically detect different locations such as layouts.

In the inspection apparatus 1, the creating unit 14 learns in advance, as a behavior model, the behavior of the user when executing other programs different from the program to be inspected, and Based on the result of the learning and the transition structure acquired by the acquiring unit 13, one of one or more buttons arranged on the screen is operated when the program to be inspected is executed. It is also possible to generate the content of the action of
Thereby, the inspection apparatus 1 can generate a behavior model by the generating unit 14 . When inspecting a program to be inspected by the inspecting unit 15, the inspection apparatus 1 can advance the content of the program according to the behavior model.

In the inspection device 1, the extracting unit 12 extracts a value based on at least one of a hash value obtained based on the screen, a feature vector obtained based on the screen, and position information of buttons arranged in the screen. It is possible to avoid extracting the same screen by judging the identity of the screen by using the
As a result, the inspection apparatus 1 can prevent the extraction unit 12 from extracting the same screen, and the acquisition unit 13 can generate an appropriate transition structure.

In the inspection device 1, the program stored in the storage unit 17 may be a game program.
In particular, the game program may be a program executable by a mobile terminal such as a smart phone. In such a game program, buttons are displayed on the display unit 18, and the contents of the program progress according to the operation of the buttons. Therefore, the inspection device 1 can inspect whether a problem occurs in a program (for example, a game program) that progresses according to button operations.

In the inspection method, the computer extracts the screen displayed on the display unit 18 when the program to be inspected is executed and the buttons arranged in the screen, and the screen extracted by the extraction step. and an acquisition step for acquiring the transition structure when the program is executed based on the type of button arranged in the screen and the transition screen that transitions when the button is operated, and the acquisition step a creation step of creating a behavior model according to the behavior expected by the user when the program is executed based on the determined transition structure, and a creation step of executing the program; An inspection step that sequentially transitions screens by operating buttons arranged in the screen according to the behavior model provided, and if there is a problem in the program when sequentially transitioning the screens by the inspection step, related to the problem and a report generation step to generate a report.
The inspection method acquires a screen transition structure in a program to be inspected, generates a behavior model based on the transition structure, and inspects the program according to the behavior model. Therefore, in the inspection method, by acquiring the transition structure of the program stored in the storage unit 17, it is possible to inspect whether the program has a problem. Thus, the checking method can automatically check various programs.
Also, the inspection method generates a behavior model and the like based on the transition structure. As a result, the inspection method can proceed with the contents of the program with a certain degree of intention in the same way as the user who operates the contents of the program, and the inspection of the program can be executed efficiently. Note that if the program is automatically inspected without generating a behavior model, there is a possibility that some screens (transitions) will not be inspected. Since (transition) is inspected, it is possible to prevent omission of inspection and the like.

The inspection program includes a storage function in which a program to be inspected is stored in the computer, a screen displayed on the display unit 18 when the program stored in the storage function is executed, and buttons arranged in the screen. A program is executed based on an extracting function that extracts , screens extracted by the extracting function, types of buttons arranged in the screens, and transition screens that transition when the buttons are operated. An acquisition function that acquires the transition structure of the program, and based on the transition structure acquired by the acquisition function, a behavior model corresponding to the expected behavior of the user when the program is executed is created. A creation function to create, an inspection function that executes a program and sequentially transitions screens by operating buttons arranged in the screen according to the behavior model created by the creation step, and a screen that is sequentially changed by the inspection function. and a report generation function for generating a report on the defect if there is a defect in the program during transition.
The inspection program acquires the screen transition structure in the program to be inspected, generates a behavior model based on the transition structure, and inspects the program according to the behavior model. Therefore, by acquiring the transition structure of the program stored in the storage unit 17, the inspection program can inspect whether the program has a problem. Therefore, the inspection program can automatically inspect various programs.
Also, the inspection program generates a behavior model and the like based on the transition structure. As a result, the inspection program can proceed with the contents of the program with a certain degree of intention in the same way as the user who operates the contents of the program, and the inspection of the program can be executed efficiently. Note that if the program is automatically inspected without generating a behavior model, there is a possibility that some screens (transitions) will not be inspected. Since (transition) is inspected, it is possible to prevent omission of inspection and the like.

The inspection apparatus 1 (inspection method and inspection program) described above can perform hybrid inspection together with a person (tester) who inspects the program. That is, the tester 1 may intensively perform a pattern repetition test on the program, and the tester may estimate the range of influence of the defect based on the test results to determine the next test content.

Moreover, since the inspection apparatus 1 (inspection method and inspection program) inspects the program according to the behavior model, it is possible to perform load inspection of the program. That is, since the inspection apparatus 1 can autonomously proceed with the contents of the program, the load inspection can be performed in a situation similar to the actual environment.

In addition, since the inspection apparatus 1 (inspection method and inspection program) inspects the program according to the behavior model, inspection according to the preferences of the user who actually operates the program (in accordance with which part of the contents of the program is emphasized) inspection) can be performed.

Further, the inspection apparatus 1 (inspection method and inspection program) stores, for example, a program to be inspected in the storage unit 17 and acquires the transition structure by the acquisition unit 13. In addition, the inspection according to the behavior model is performed. It is possible to charge according to what is done and the number of hours of inspection (the number of inspections). The billing may be either monthly or pay-as-you-go.

Each unit of the program inspection device 1 described above may be realized as a function of an arithmetic processing unit of a computer or the like. That is, the extraction unit 12, the acquisition unit 13, the creation unit 14, the inspection unit 15, and the report generation unit 16 of the inspection apparatus 1 have an extraction function, an acquisition function, a creation function, an inspection function, and a report generation function by an arithmetic processing unit of a computer. Each may be implemented as a function.
The inspection program can cause the computer to implement each function described above. The inspection program may be recorded in a computer-readable non-temporary recording medium such as an external memory or an optical disc.
Further, as described above, each part of the inspection apparatus 1 may be realized by an arithmetic processing unit of a computer or the like. The arithmetic processing unit or the like is configured by an integrated circuit or the like, for example. Therefore, each unit of the inspection apparatus 1 may be implemented as a circuit that constitutes an arithmetic processing unit or the like. That is, the extraction unit 12, the acquisition unit 13, the creation unit 14, the inspection unit 15, and the report generation unit 16 of the inspection device 1 are an extraction circuit, acquisition circuit, creation circuit, inspection circuit, and It may be implemented as a report generation circuit.
Also, the storage unit 17 and the display unit 18 of the inspection apparatus 1 may be realized as a storage circuit and a display circuit by being configured by an integrated circuit or the like, for example. Also, the storage unit 17 and the display unit 18 of the inspection apparatus 1 may be configured as a storage device and a display device, for example, by being configured by a plurality of devices.

1 inspection device 11 control unit 12 acquisition unit 13 acquisition unit 14 creation unit 15 inspection unit 16 report generation unit 17 storage unit 18 display unit

Claims (6)

a storage unit storing a program to be inspected;
an extraction unit that extracts a screen displayed on a display unit when the program stored in the storage unit is executed, and a button arranged in the screen;
Obtaining a transition structure when the program is executed based on the screen extracted by the extracting unit, the button arranged in the screen, and the transition screen to which the button is operated. an acquisition unit that
a creation unit for creating a behavior model and behavior regulation content according to expected behavior of a user when the program is executed, based on the transition structure obtained by the obtaining unit; ,
a display control unit for displaying, on the display unit, a flowchart showing a flow of actions based on the content of the rules of conduct created by the creation unit;
an inspection unit that executes the program and sequentially transitions screens by operating the buttons arranged in the screen according to the behavior model created by the creation unit;
A program inspection device comprising: The creation unit learns in advance, as the behavior model, behavior when a user proceeds with the contents of the other programs when a plurality of other programs different from the program to be inspected is executed, and learns the behavior. and one of a plurality of buttons arranged on a screen when the program to be inspected is executed based on the result of and the transition structure acquired by the acquisition unit. 2. The program inspection device according to claim 1, wherein the content of the action of the program is generated. The extraction unit extracts screen identity based on at least one of a hash value acquired based on the screen, a feature vector acquired based on the screen, and position information of buttons arranged in the screen. 3. The program inspection device according to claim 1, wherein extraction of the same screen is avoided by judging . 2. The program inspection device according to claim 1 , wherein the program stored in the storage unit is a game program. the computer
a storage step of storing a program to be inspected in a storage unit;
an extracting step of extracting a screen displayed on a display unit when the program stored in the storage unit is executed, and a button arranged in the screen;
Transition structure when the program is executed based on the screen extracted by the extracting step, the type of the button arranged in the screen, and the transition screen transitioned when the button is operated. a obtaining step that obtains
a creation step of creating, based on the transition structure acquired in the acquisition step, a behavior model and behavior regulation content corresponding to the expected behavior of a user when the program is executed when the content of the program progresses; ,
a display control step of displaying, on the display unit, a flowchart showing a flow of actions based on the content of the rules of conduct created in the creating step;
an inspection step of executing the program and sequentially transitioning screens by operating the buttons arranged in the screen according to the behavior model created in the creating step;
How to inspect programs that run to the computer,
a storage function in which a program to be inspected is stored;
an extraction function for extracting a screen displayed on a display unit when the program stored in the storage function is executed, and a button arranged in the screen;
The screen extracted by the extraction function, the types of the buttons arranged in the screen,
an acquisition function for acquiring a transition structure when the program is executed based on a transition screen that transitions when the button is operated;
a creation function for creating a behavior model and behavior regulation content according to expected behavior of a user when the program is executed, based on the transition structure obtained by the obtaining function; ,
a display control function for displaying, on the display unit, a flow chart showing a flow of actions based on the content of the rules of conduct created by the creation function;
an inspection function that executes the program and sequentially transitions screens by operating the buttons arranged in the screen according to the behavior model created by the creation function;
A program inspection program that realizes.

Images