JP2016173619A - Application test device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an application test device capable of accurately determining acceptance of a test result, even in a case where display is different by difference between execution environments at the time of operation recording and of reproducing.SOLUTION: An image matching processing unit 104, in a case where a component image, matching an image of a component in which difference occurs in display when an execution environment varies, exists in a capture image of an operation screen recorded in a capture image recording memory 103, records a position of the component image in the operation screen in a component position recording memory 105. A point position correction calculation unit 106 calculates a correction amount of a pointer position in reproducing, based on the difference between component image positions in the operation screen at the time of operation command recording and of reproducing. A collation tool 400 obtains a test result by using the operation screen in a case of reproducing an operation command where the pointer position has been corrected.SELECTED DRAWING: Figure 2

Description

  The present invention records the contents and acquisition time of GUI (Graphical User Interface) operations such as pointer position, click information, key press information, etc. at the time of the first test, and tests in the GUI operation recording / reproducing technology for reproducing the operation by the recording The present invention relates to an application test apparatus that performs pass / fail judgment of results.

In recent years, testing in software development has been automated. In the automation of tests, reduction of man-hours for test operation and verification work, improvement of accuracy, etc. are required. In addition, there are an increasing number of tests for checking screens in GUI applications, and there is a method for improving the efficiency of test automation by comparing patterns of images on these screens (see, for example, Patent Document 1). In this system, various image patterns of GUI are prepared, the behavior of the GUI when the test script is executed and the image pattern are compared, the result is recorded as log information, and the log information is analyzed The test script is automatically corrected for the error log.
Further, in a system having a client and a server, there has been a method of recording an operation log and an operation screen on the client terminal side and associating the log with a display (for example, see Patent Document 2).

JP 2006-268666 A JP 2009-237659 A

  However, in GUI operation recording and playback in which operation commands are recorded and operations are recorded and played back by re-transmission, when the execution environment is different between operation recording and playback, the pointer position during operation is different and normal during operation playback. There was a problem of not being regenerated. In addition, when collating the captured images on the screen at the time of operation recording and playback for the purpose of verifying the test result, there is a problem that the result cannot be accurately determined due to a difference in display.

  The present invention has been made to solve the above-described problems, and is an application that can accurately perform pass / fail determination of test results even when the display differs depending on the execution environment during operation recording and during playback. The purpose is to obtain test equipment.

  In the application test apparatus according to the present invention, when there is a part image that matches a part image that causes a difference in display when the execution environment is different in the operation screen obtained by an operation command to the application, If the image matching processing unit that records the position of the image and the operation command is recorded and reproduced, and there is a component image that matches the component image in the operation screen during operation command reproduction, the component image position in the operation screen during reproduction And a pointer position correction amount calculation unit that corrects the pointer position of the operation command at the time of reproduction, and the pointer position is corrected based on the difference between the component image position in the operation screen recorded by the image matching processing unit when the operation command is recorded Check the operation screen that was played and executed in the state and the operation screen when recording the operation command to obtain the test result. It is obtained by a tool.

  In the application test apparatus according to the present invention, in the operation screen obtained by the operation command to the application, when there is a component image that matches the image of the component that causes a difference in display when the execution environment is different, Since the position is recorded and the pointer position at the time of playback is corrected based on the difference in the part image position on the operation screen between when the operation command is recorded and when it is played back Even if the display is different due to the difference in the test results, it is possible to accurately determine whether the test results are acceptable.

BRIEF DESCRIPTION OF THE DRAWINGS It is a block diagram of the system for comprising the application test apparatus by Embodiment 1 of this invention. It is a block diagram which shows the detail of the application test apparatus by Embodiment 1 of this invention. It is a flowchart which shows operation | movement of the application test apparatus by Embodiment 1 of this invention. It is explanatory drawing of the operation | movement content of the application test apparatus by Embodiment 1 of this invention. It is a block diagram which shows the detail of the application test apparatus by Embodiment 2 of this invention. It is a flowchart which shows operation | movement of the application test apparatus by Embodiment 2 of this invention. It is explanatory drawing of the operation | movement content of the application test apparatus by Embodiment 2 of this invention. It is a block diagram which shows the detail of the application test apparatus by Embodiment 3 of this invention. It is a flowchart which shows operation | movement of the application test apparatus by Embodiment 3 of this invention. It is explanatory drawing of the operation | movement content of the application test apparatus by Embodiment 3 of this invention.

Embodiment 1 FIG.
FIG. 1 is a diagram showing a system configuration for configuring an application test apparatus according to Embodiment 1 of the present invention.
The application test apparatus according to the first embodiment is configured by connecting a client 100, a server 200, a test tool 300, and a verification tool 400 via a LAN (local area network) 500. The client 100 is a computer terminal that performs remote operation on the server 200 to acquire data from the server 200 and displays the screen. The server 200 is a computer terminal that performs various processes based on the input content from the client 100 and sends the processing results to the client 100. The test tool 300 has a function of reading a recorded operation command from the client 100 and retransmitting it to the server 200 when recording a GUI operation command for recording and ending recording, and reproducing the recorded GUI operation. Is a computer terminal. The collation tool 400 is a computer terminal that performs test result determination by collating images during recording and reproduction.

  In the first embodiment, Virtual Network Computing (hereinafter referred to as VNC) is used as the remote operation system. Since VNC commands are described in the RFB (Remote Framebuffer) protocol, if VNC is used as a remote control system, Windows (registered trademark: description omitted below), Linux (registered trademark: description omitted below), etc. Can be used on multiple platforms.

  The server 200 activates the VNC server, activates the VNC viewer on the client 100, and performs remote operation from the client 100 to the server 200. When a remote operation is performed from the client 100 to the server 200, the updated frame buffer data of the screen of the server 200 is transmitted to the client 100, and the screen of the client 100 is updated. The screen at this time is captured, and the test result is obtained by collating the captured image with the collation tool 400. The present invention uses this remote operation system to record and play back GUI operations, and to automatically determine pass / fail of a test result by collating a capture screen.

  FIG. 2 is a configuration diagram showing details of the application test apparatus according to the first embodiment. The client 100 includes a remote operation command recording unit 101, a remote operation command recording memory 102, a captured image recording memory 103, an image matching processing unit 104, a component position recording memory 105, and a pointer position correction amount calculation unit 106. The component image database 600 is a database that stores images of components that are displayed differently in different environments. In the illustrated example, the component image database 600 is installed independently of the server 200, the client 100, and the collation tool 400, but may be built in the client 100 or the server 200.

  The remote operation command recording unit 101 of the client 100 is a processing unit that records the remote operation command sent from the client 100 to the server 200, and the remote operation command recording memory 102 is for recording the remote operation command. It is a storage unit. The captured image recording memory 103 is a memory that captures an operation screen processed by the server 200 by a remote operation command from the client 100. The image matching processing unit 104 performs matching between the screen recorded in the captured image recording memory 103 and the part image stored in the part image database 600. If there is a matching part image, the part image A processing unit that records a position on the screen in the component position recording memory 105. The component position recording memory 105 is a memory for recording the position in the screen of the component image obtained by the image matching processing unit 104. The pointer position correction amount calculation unit 106 corrects the pointer position based on the positional deviation between the remote operation command recording and the reproduction of the component image position recorded in the component position recording memory 105 when the remote operation command is reproduced. It is a processing unit for calculating the quantity.

Next, the operation of the application test apparatus according to the first embodiment configured as described above will be described.
As a process before performing GUI operation recording / reproduction, an image of a GUI component that causes a display difference when the environment is different, such as a dialog or a toolbar, is registered in the component image database 600.
When remote operation is performed from the client 100 to the server 200, the server 200 receives a VNC command (pointer position information, click information, key press information, frame buffer update request, etc.) transmitted from the client 100. In each embodiment, a pointing device that performs a pointer movement or click operation is described as a mouse, and information when the mouse button is pressed is described as click information. However, the pointing device is not limited to a mouse. . In the client 100, the VNC command is recorded by the remote operation command recording unit 101 and stored as operation data in the remote operation command recording memory 102. Further, the captured image of the operation screen at this time is stored in the captured image recording memory 103. Here, the image matching processing unit 104 performs template matching with the component image stored in the component image database 600, and if there is a matching component image in the captured image, the coordinates of the component image are stored in the component position recording memory 105. To store. The above is the operation when recording a remote operation command.

Next, the operation at the time of remote operation command reproduction will be described.
When the test tool 300 reads an operation command from the remote operation command recording memory 102 of the client 100 and retransmits the operation command to the server 200 to reproduce the GUI operation, the image matching processing unit 104 immediately before transmitting the mouse operation command. A captured image of the operation screen is acquired from the captured image recording memory 103, and template matching is performed with a component image stored in the component image database 600. If there is a matching part image in the captured image, the coordinates of the matching part image are stored in the part position recording memory 105 as in the case of recording a remote operation command. The pointer position correction amount calculation unit 106 calculates the amount of deviation of the same component image position during remote operation command recording and playback as the pointer position correction amount. The captured image of the operation screen at this time is stored in the captured image recording memory 103.

FIG. 3 is a flowchart showing operation recording / reproduction processing of the application test apparatus according to the first embodiment. In the flowchart, step ST100 indicates a GUI operation recording process, and step ST200 indicates a GUI operation reproduction process.
FIG. 4 is an explanatory diagram of the operation recording / reproducing process of the application test apparatus in the first embodiment, and the step numbers in the figure correspond to the step numbers in FIG.

First, prior to the operation recording process, component images such as dialogs and toolbars are registered in the component image database 600 (step ST1).
In the GUI operation recording process of step ST100, until the client 100 receives a recording end message from the test tool 300 (step ST101: No), the remote operation command recording unit 101 of the client 100 records the VNC command and records the remote operation command. Save in the memory 102 (step ST102). In addition, the captured image of the operation screen is stored in the captured image recording memory 103, and the image matching processing unit 104 acquires the captured image (step ST103), and stores the component image stored in the component image database 600 and the capture screen. The template matching is performed at, and the coordinates of the matching part image are calculated and recorded (step ST104). When the client 100 receives the recording end message from the test tool 300 (step ST101: Yes), the client 100 outputs the VNC command record stored in the remote operation command recording memory 102 to the test tool 300 (step ST105).

  In the GUI operation reproduction process in step ST200, the test tool 300 performs operation reproduction by retransmitting the VNC command (step ST203) until the operation command reaches the end after the operation reproduction process is started (step ST201: No). Do. At this time, if the mouse operation is a click command (step ST202: Yes), the image matching processing unit 104 performs template matching on the component image and the capture screen, calculates the coordinates of the matching component image, and calculates the component position recording memory. 105 (step ST204). Further, the pointer position correction amount calculation unit 106 reads the coordinates of the corresponding component images at the time of recording and reproduction from the component position recording memory 105, and uses the deviation amount of the component images at the time of recording and reproduction as the correction amount of the pointer position. Calculate (step ST205). Thereby, the test tool 300 corrects the pointer position based on the calculated correction amount, retransmits the VNC command (step ST203), returns to step ST201, and performs this to the end of the operation command (step ST201: Yes).

  The collation tool 400 collates the captured image of the operation screen by the command with the corrected pointer position with the captured image of the operation screen at the time of recording, and obtains a test result (step ST300).

  As described above, in the application test apparatus of the first embodiment, in software development, the initial GUI operation of the regression test or the test at the time of environmental replacement is recorded and automatically played back, so that the operation procedure can be reduced and changed. It is possible to reduce the number of test steps for the subsequent GUI operation. Since VNC operates on a multi-platform, it can be applied to an OS such as Windows, Linux, and Android (registered trademark).

  As described above, according to the application test apparatus of the first embodiment, in the operation screen obtained by the operation command to the application, there is a component image that matches the image of the component that causes a difference in display when the execution environment is different. If the image matching processing unit that records the position of the part image on the operation screen and the operation command is recorded and played back, playback is performed when there is a part image that matches the part image on the operation screen when the operation command is played back. Position correction amount to correct the pointer position of the operation command during playback based on the difference between the part image position in the operation screen at the time and the part image position in the operation screen recorded by the image matching processing unit when the operation command is recorded A calculation unit, an operation screen that is played back and executed with the pointer position corrected, and an operation screen when the operation command is recorded. A collation tool that collates and obtains test results, so that even if the display differs depending on the execution environment during operation recording and playback, operation playback can be performed normally. Judgment can be made accurately.

  In addition, according to the application test apparatus of the first embodiment, a client that sends a remote operation command as an operation command to an application, and a server that performs processing corresponding to the remote operation command and sends operation screen data to the client. Since the image matching processing unit and the pointer position correction amount calculation unit are provided on the client, even if the display differs depending on the execution environment in operation recording and playback in a system consisting of a client and a server, the test results It is possible to accurately perform the pass / fail determination.

Embodiment 2. FIG.
In the application test apparatus according to the second embodiment, a test is performed by masking an image of a part whose display is different when the environment is different during recording and reproduction.

  FIG. 5 is a configuration diagram illustrating details of the application test apparatus according to the second embodiment. The application test apparatus of the second embodiment is the same as that of the first embodiment with respect to the client 100, the server 200, the test tool 300, and the component image database 600. To do.

  A collation tool 400a according to the second embodiment includes a mask image generation unit 401, an edited image recording memory 402, and an image collation processing unit 403. The mask image generation unit 401 reads the captured images at the time of recording and playback from the captured image recording memory 103 of the client 100, and also reads the component images from the component image database 600, and among the captured images at the time of recording and playback. When there is a part that matches the part image stored in the part image database 600, the processing unit generates an operation screen masking the part image. The edited image recording memory 402 is a memory for recording an operation screen at the time of recording and reproduction generated by the mask image generation unit 401. The image collation processing unit 403 is a processing unit that collates the recording operation screen and the reproduction operation screen stored in the edited image recording memory 402 to determine a test result.

FIG. 6 is a flowchart showing an operation recording / reproducing process and a collating process of the application test apparatus according to the second embodiment. In the flowchart, step ST100a indicates a GUI operation recording process, step ST200a indicates a GUI operation reproduction process, and step ST300a indicates a capture screen collation process. In the second embodiment, the pointer position correction amount calculation process described in the first embodiment is performed in the same manner. However, in the flowchart of FIG. 6, the GUI operation recording process (step ST100a) and the correction amount calculation process are performed. Steps in the GUI operation reproduction process (step ST200a) are omitted.
FIG. 7 is an explanatory diagram of the operation recording / playback processing of the application test apparatus in the second embodiment, and the step numbers in the figure correspond to the step numbers in FIG.

First, prior to the operation recording process, component images such as dialogs and toolbars are registered in the component image database 600 (step ST1). This is the same as in the first embodiment.
Next, in the GUI operation recording process in step ST100a, until the client 100 receives a recording end message from the test tool 300 (step ST101: No), the remote operation command recording unit 101 of the client 100 records the VNC command and remotely It is stored in the operation command recording memory 102 (step ST102). Further, until the recording end message is received, the captured image of the operation screen is stored in the captured image recording memory 103 (step ST106). When the client 100 receives the recording end message from the test tool 300 (step ST101: Yes), the client 100 outputs the VNC command record stored in the remote operation command recording memory 102 (step ST105).

  In the GUI operation reproduction process in step ST200a, operation reproduction is performed by retransmitting the VNC command (step ST203) until the operation command reaches the end after the operation reproduction process is started (step ST201: No). When the operation command reaches the end (step ST201: Yes), the process proceeds to the next collation process.

  In the collation process of step ST300a, the mask image generation unit 401 of the collation tool 400a reads the images at the time of operation recording and reproduction from the captured image recording memory 103 of the client 100, and the component images registered in the component image database 600, respectively. Template matching is performed (step ST302), mask processing is performed on the matching area, and the mask image is stored in the edited image recording memory 402 (step ST303). Next, the image collation processing unit 403 reads the respective images at the time of recording and reproduction after the mask processing from the edited image recording memory 402, and performs collation (step ST304). These processes are performed until the last pair of collation images is completed (step ST301: Yes).

  As described above, according to the application test apparatus of the second embodiment, in the operation screen at the time of operation command recording and operation command playback, the component image that matches the image of the component that causes a difference in display when the execution environment is different The mask image generation unit that generates an operation screen that masks the component image in the operation screen, the operation screen that is generated by the mask image generation unit, and the operation screen that is displayed when the operation command is reproduced. Since the image collation processing unit for collating and obtaining the test result is provided, it is possible to accurately perform the pass / fail judgment of the test result even when the display differs depending on the execution environment during operation recording and during reproduction.

  Further, according to the application test apparatus of the second embodiment, a client that sends a remote operation command as an operation command to the application, a server that performs processing corresponding to the remote operation command and sends operation screen data to the client, A collation tool for performing a test when recording and reproducing a remote operation command, and a mask image generation unit and an image collation processing unit are provided in the collation tool. Even when the display differs depending on the execution environment at the time of reproduction, the pass / fail judgment of the test result can be performed accurately.

Embodiment 3 FIG.
The application test apparatus according to the third embodiment generates a prediction image corresponding to a different environment at the time of recording or reproduction, for an operation screen including an image of a component whose display is different when the environment is different. It is intended to test using.

  FIG. 8 is a configuration diagram illustrating details of the application test apparatus according to the third embodiment. Here, since the client 100, the server 200, the test tool 300, and the component image database 600 are the same as those in the first and second embodiments, the corresponding parts are denoted by the same reference numerals and description thereof is omitted.

  A collation tool 400b according to Embodiment 3 includes a predicted image generation unit 404, an edited image recording memory 402a, and an image collation processing unit 403a. The predicted image generation unit 404 reads a captured image at the time of recording or reproduction from the captured image recording memory 103 of the client 100, and also reads out a component image from the component image database 600, and among the captured images at the time of recording or reproduction. When a component image that matches the component image stored in the component image database 600 is included, a predicted image is generated on the operation screen at the time of recording or the operation screen at the time of reproduction, and the predicted image is edited. A processing unit stored in the recording memory 402a. In the component image database 600, it is assumed that component images corresponding to the recording and reproduction environments are registered.

  The edited image recording memory 402 a is a memory for storing operation screen data including the predicted image generated by the predicted image generation unit 404. The image matching processing unit 403a compares the operation screen including the predicted image stored in the edited image recording memory 402a with the operation screen on which the predicted image stored in the captured image recording memory 103 has not been generated. A processing unit that performs test result determination.

  That is, in the third embodiment, the predicted image generation unit 404 detects a part where a difference in display of a dialog, a toolbar, or the like is detected in an operation recording or playback image, and synthesizes a component image corresponding to the part. Thus, a predicted image is generated. And the image collation process part 403a collates with the image which did not produce | generate a prediction image. Therefore, when the predicted image is generated for the image at the time of recording, the predicted image of the image at the time of recording is compared with the original image at the time of reproduction, while the predicted image is generated for the image at the time of reproduction. Verifies the original image at the time of recording with the predicted image of the image at the time of reproduction.

FIG. 9 is a flowchart showing operation recording / reproduction processing and collation processing of the application test apparatus according to the third embodiment. In the flowchart, step ST100a indicates a GUI operation recording process, step ST200a indicates a GUI operation reproduction process, and step ST300b indicates a capture screen collation process. Also in the third embodiment, when a predicted image is generated at the time of operation recording and collated with an operation screen at the time of reproduction, the pointer amount correction amount calculation processing described in the first embodiment is performed in the same manner. In the flowchart of FIG. 9, the steps in the GUI operation recording process (step ST100a) and the GUI operation reproduction process (step ST200a) related to the correction amount calculation process are omitted.
FIG. 10 is an explanatory diagram of the operation recording / reproducing process of the application test apparatus in the third embodiment, and the step numbers in the figure correspond to the step numbers in FIG. Further, the process of FIG. 10 shows an example in which a predicted image is generated during operation recording and collated with an operation screen during reproduction.

  In the flowchart of FIG. 9, first, prior to the operation recording process, component images such as dialogs and toolbars are registered in the component image database 600 (step ST1). This is the same as in the first and second embodiments. Further, the GUI operation recording process in the next step ST100a and the GUI operation reproduction process in step ST200a are the same as those in the second embodiment.

  In the collation processing in step ST300b, the predicted image generation unit 404 of the collation tool 400b reads the operation recording image from the captured image recording memory 103 of the client 100, and performs template matching with the component image registered in the component image database 600. (Step ST302) By synthesizing corresponding parts in the part image database 600 for the matching portion, a predicted image is generated, and the operation screen of the predicted image is stored in the edited image recording memory 402a (step ST305). Next, the image collation processing unit 403a reads the operation screen for the predicted image from the edited image recording memory 402a, and also reads the operation screen for reproduction from the captured image recording memory 103, and collates these operation screens (step ST304). . These processes are performed until the last pair of collation images is completed (step ST301: Yes).

  When the predicted image generation unit 404 generates a predicted image for the operation screen at the time of reproduction, the image matching processing unit 403a reads the operation screen at the time of operation from the captured image recording memory 103 which is an image storage unit, and edits it. The same effect can be obtained by performing collation with the operation screen that generated the predicted image at the time of reproduction read from the image recording memory 402a. In this case, it is not necessary to perform the pointer position correction amount calculation processing and the pointer position correction processing based on the pointer position correction processing described in the first embodiment.

  In the third embodiment, when a predicted image is generated at the time of operation recording and collated with an operation screen at the time of reproduction, the predicted position of the predicted image in the predicted image generation unit 404 is used to correct the pointer position. May be.

  As described above, according to the application test apparatus of the third embodiment, when there is a part image that matches a part image that causes a difference in display when the execution environment is different, the position of the part image on the operation screen is determined. A test image is obtained by collating a predicted image generation unit that generates a predicted screen corresponding to a different execution environment as a predicted operation screen, an operation screen during operation command playback, and a predicted operation screen generated during operation command recording. Since the image collation processing unit is provided, it is possible to accurately determine whether or not the test result is acceptable even when the display differs depending on the execution environment during operation recording and during reproduction.

  In addition, according to the application test apparatus of the third embodiment, when there is a part image that matches a part image that causes a display difference when the execution environment is different in an operation screen obtained by an operation command to the application, When the image storage unit that records the screen and the operation command is recorded and played back, if there is a part image that matches the part image in the operation screen when the operation command is played back, the position of the part image in the operation screen at the time of playback is displayed. A predicted image generation unit that generates a predicted operation screen corresponding to a different execution environment as a predicted operation screen, an image verification processing unit that obtains test results by comparing the predicted operation screen and the operation screen recorded in the image storage unit Therefore, even if the display differs depending on the execution environment during operation recording and during reproduction, the pass / fail judgment of the test result can be performed accurately.

  Further, according to the application test apparatus of the third embodiment, a client that sends a remote operation command as an operation command to the application, a server that performs processing corresponding to the remote operation command and sends operation screen data to the client, A collation tool for performing a test when recording and reproducing a remote operation command, and the collation tool is provided with a predicted image generation unit and an image collation processing unit. Even when the display differs depending on the execution environment at the time of reproduction, the pass / fail judgment of the test result can be performed accurately.

  In the second and third embodiments, the component image database 600 may be provided in the client 100 or the server 200 or the collation tool 400.

  In the present invention, within the scope of the invention, any combination of the embodiments, or any modification of any component in each embodiment, or omission of any component in each embodiment is possible. .

  100, 100a Client, 101 Remote operation command recording unit, 102 Remote operation command recording memory, 103 Capture image recording memory, 104 Image matching processing unit, 105 Component position recording memory, 106 Pointer position correction amount calculation unit, 200 server, 300 test Tool, 400, 400a, 400b Collation tool, 401 Mask image generation unit, 402, 402a Edit image recording memory, 403, 403a Image collation processing unit, 404 Predictive image generation unit, 500 LAN, 600 Component image database.

Claims (7)

Image matching that records the position of the part image in the operation screen when there is a part image that matches the image of the part that is displayed differently when the execution environment is different. A processing unit;
When the operation command is recorded and reproduced, if there is a component image that matches the component image in the operation screen at the time of reproducing the operation command, the position of the component image in the operation screen at the time of reproduction and the image at the time of recording the operation command A pointer position correction amount calculation unit that corrects the pointer position of the operation command at the time of reproduction based on the difference from the component image position in the operation screen recorded by the matching processing unit;
An application comprising: an operation screen obtained by reproducing and executing the operation command in a state where the pointer position is corrected; and a collation tool for obtaining a test result by collating the operation screen at the time of recording the operation command. Test equipment. A client that sends a remote operation command as an operation command to the application, and a server that performs processing corresponding to the remote operation command and sends operation screen data to the client.
The application test apparatus according to claim 1, wherein the image matching processing unit and the pointer position correction amount calculation unit are provided in the client. If there is a part image that matches the image of a part that causes a difference in display in the operation screen at the time of recording the operation command and at the time of reproducing the operation command, the part image on the operation screen is masked. A mask image generation unit for generating the operation screen
The image collation processing unit that obtains a test result by collating the operation screen at the time of recording the operation command generated by the mask image generation unit with the operation screen at the time of reproducing the operation command. The application test apparatus according to claim 1 or 2. A client that sends a remote operation command as an operation command to the application, a server that performs processing corresponding to the remote operation command and sends operation screen data to the client, and a test when recording and reproducing the remote operation command And a collation tool that performs
The application test apparatus according to claim 3, wherein the mask image generation unit and the image collation processing unit are provided in a collation tool. When there is a component image that matches the image of a component that causes a difference in display when the execution environment is different, a predicted operation screen is obtained by predicting the position of the component image in the operation screen corresponding to the different execution environment. A predicted image generation unit to generate as
3. An image collation processing unit that collates an operation screen at the time of reproducing the operation command and a predicted operation screen generated at the time of recording the operation command to obtain a test result. Application testing equipment. In the operation screen obtained by the operation command to the application, when there is a component image that matches the image of the component that causes a difference in display when the execution environment is different, an image storage unit that records the operation screen;
When the operation command is recorded and reproduced, if there is a component image that matches the component image in the operation screen at the time of reproducing the operation command, the position of the component image in the operation screen at the time of reproduction is set to the different execution environment. A predicted image generation unit that generates a predicted operation screen as a predicted operation screen;
An application test apparatus comprising: an image collation processing unit that collates the prediction operation screen with an operation screen recorded in the image storage unit to obtain a test result. A client that sends a remote operation command as an operation command to the application, a server that performs processing corresponding to the remote operation command and sends operation screen data to the client, and a test when recording and reproducing the remote operation command And a collation tool that performs
The application test apparatus according to claim 5, wherein the predicted image generation unit and the image collation processing unit are provided in a collation tool.

Images