JP5591072B2 - Software automatic test apparatus and software automatic test method - Google Patents

Description

  The present invention relates to a software automatic test apparatus and software automatic test method for testing man-machine software, and more particularly to a load endurance test by continuous operation.

  Conventionally, as an automatic test method for man-machine software, the operator's operation procedure on the operation screen of the man-machine software is reproduced by automatic operation, and the input operation and the image data of the operation screen at that time are sequentially saved in separate files. However, the test result was determined by checking the stored operation contents in correspondence with the operation screen.

  Furthermore, in order to efficiently check the test results, Patent Document 1 includes a means for automatically operating man-machine software and a means for automatically recording automatic operation and the corresponding screen log output at an arbitrary timing. An automatic software testing apparatus has been proposed in which operations and screen log outputs corresponding to the operations are listed and recorded in a one-to-one correspondence.

JP 2010-102446 A

  In the conventional software automatic test equipment as described above, if the screen update is delayed due to the load status of the system during the execution of the automatic test, the input by the automatic operation is shifted from the operation screen, the timing is not matched, and the input fails. There was a thing. Similarly, when the playback speed of automatic operation is increased in order to shorten the test time, input of automatic operation may fail due to a delay in screen update. In either case, subsequent tests continue normally. There was a problem of not being. On the other hand, when the test is performed with the slowdown of the reproduction speed of the automatic operation in consideration of the delay of the screen update, there is a problem that the test time becomes long and the efficiency is poor.

  The present invention has been made to solve the above-described problems, and performs an automatic test that reproduces the operation procedure of the operator on the operation screen of the man-machine software to the end, and shortens the test time. An object of the present invention is to provide a software automatic test apparatus and a software automatic test method.

A software automatic test apparatus according to the present invention includes a computer for starting man-machine software to be tested, display means for displaying an operation screen of the man-machine software, and an input for an operator to input the operation screen. An automatic software testing apparatus comprising means for calculating an operation procedure data storage unit in which an operation procedure of an operator on an operation screen of the man-machine software is recorded, and an operation procedure recorded in the operation procedure data storage unit. Based on an automatic operation means for automatically operating the man-machine software at an arbitrary reproduction speed and number of repetitions, a reproduction speed adjustment means for adjusting a reproduction speed of automatic operation by the automatic operation means, and the man displayed on the display means. The screen image of the machine software operation screen is captured as image data at a predetermined timing. Image data acquisition means, an image data storage unit for storing the image data acquired by the image data acquisition means, and the latest image data acquired by the image data acquisition means, the image data acquired at the previous timing, comparison, have a image data comparing means determines the presence or absence of updating of the man-machine software operation screen, the image data comparison means, the latest image data obtained by the image data acquisition means, acquires the previous timing If the image data is different from the acquired image data, the latest image data is stored in the image data storage unit, and the latest image data acquired by the image data acquisition unit is the same as the image data acquired at the previous timing. The latest image data is discarded, the screen non-update count is incremented by 1, and this screen non-update count is set in advance. If the value exceeds the specified value, the automatic operation by the automatic operation means is forcibly terminated, the reproduction speed of the automatic operation is adjusted by the reproduction speed adjustment means, the man-machine software is restarted, and the automatic operation means automatically Starts the operation .

  In addition, the software automatic test method according to the present invention activates the man-machine software to be tested, and the man-machine software at an arbitrary reproduction speed and number of repetitions based on the operation procedure of the operator on the operation screen of the man-machine software. The first step of automatically operating the second and the second step of acquiring and storing the screen image of the operation screen of the man-machine software displayed on the display means at a predetermined timing in parallel with the first step A third step of comparing the latest image data acquired in the step and the second step with the image data acquired at the previous timing and determining whether or not the operation screen of the man-machine software is updated; In the third step, the operation screen of the man-machine software is not updated for a predetermined period. If it is determined that, the automatic operation of the man-machine software is forcibly terminated, and the first step to the fourth step are repeated, including a fourth step of adjusting the reproduction speed of the automatic operation. The test is terminated when the automatic operation in is completed any number of repetitions.

  According to the software automatic test apparatus according to the present invention, automatic operation means for automatically operating man-machine software, image data acquisition means for acquiring a screen image of the operation screen of the man-machine software as image data at a predetermined timing, By providing image data comparison means that compares the latest image data acquired by the image data acquisition means with image data acquired at the previous timing and determines whether or not the operation screen of the man-machine software is updated, automatic It is possible to detect at an early stage that the automatic operation is not continued normally due to the input failure of the operation, and it is possible to reliably carry out the automatic test to the end and shorten the test time.

  In addition, according to the software automatic test method of the present invention, the man-machine software is automatically operated, and the screen image of the operation screen of the man-machine software is acquired as image data at a predetermined timing to determine whether the operation screen is updated. If it is determined that there is no update of the operation screen for a predetermined period, the automatic operation of the man-machine software is forcibly terminated, and the automatic operation is started by adjusting the reproduction speed of the automatic operation. It is possible to detect early that the automatic operation is not continued normally due to the input failure of the automatic operation, and it is possible to carry out the automatic test surely to the end, and to shorten the test time.

It is the schematic which shows the structure of the software automatic test apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows the example of an operation screen of the application program tested with the software automatic test apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows the example of an operation screen of the application program tested with the software automatic test apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows operation | movement of the automatic operation program of the software automatic test apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows operation | movement of the screen capture program of the software automatic test apparatus which concerns on Embodiment 1 of this invention.

Embodiment 1 FIG.
Hereinafter, an automatic software testing apparatus according to Embodiment 1 of the present invention will be described with reference to the drawings. FIG. 1 shows the configuration of the software automatic test apparatus according to the first embodiment. As shown in FIG. 1, a computer 1 of a software automatic test apparatus includes a processing device 2, an application program 3, an automatic operation program 4 and a screen capture program 5, which are started by the processing device 2, and operation procedure data as a storage area. A storage unit 6 and a screen capture data storage unit 7 are provided. Also connected to the computer 1 are a display device 8 which is a display means for displaying an operation screen of the application program 3, and a keyboard 9 and a pointing mouse 10 which are input means for an operator to input operations on the operation screen. Has been.

  The application program 3 to be tested is man-machine software, and is activated by the computer 1 in substantially the same state as in actual operation. The operation procedure of the operator on the operation screen of the application program 3 is recorded in advance in the operation procedure data storage unit 6. The automatic operation program 4, which is an automatic operation means, automatically operates the application program 3 at an arbitrary reproduction speed and number of repetitions based on the operation procedure recorded in the operation procedure data storage unit 6 (About the operation of the automatic operation program 4) Will be described in detail with reference to the flowchart of FIG.

  The screen capture program 5 including the image data acquisition unit and the image data comparison unit acquires a screen image of the operation screen of the application program 3 displayed on the display device 8 as image data at a predetermined timing. The acquired image data (hereinafter referred to as screen capture) is stored in the screen capture data storage unit 7 which is an image data storage unit.

  Further, the screen capture program 5 compares the acquired latest screen capture with the screen capture acquired at the previous timing, and determines whether or not the operation screen of the application program 3 has been updated. Furthermore, the screen capture program 5 includes a playback speed adjusting means for adjusting the playback speed of the automatic operation by the automatic operation program 4 (the operation of the screen capture program 5 will be described in detail with reference to the flowchart of FIG. 5). ).

  When the application program 3 is actually operated, the computer 1 is activated by the operator, and the processing device 2 reads the application program 3 and starts processing. As a result of this processing, for example, an operation screen as shown in FIGS. 2 and 3 is displayed on the display device 8. The operator inputs an operation using the keyboard 9 or the pointing mouse 10 according to the content of the operation screen displayed on the display device 8.

  In the example shown in FIG. 2, the operation screen is updated by touching (clicking) the operation start button 12 on the initial screen 11, and the instructed process is executed. In the example shown in FIG. 3, the operation screen is updated by selecting the control 1 button 14 of the facility A on the operation method selection screen 13 and touching the confirmation button 15, and the instructed process is executed. As described above, in the man-machine software, the process is executed while updating the operation screen by the operation input of the operator.

  For this reason, in software automatic test equipment that reproduces the operator's operation procedure by automatic operation, when the reproduction speed of automatic operation is increased, the update of the operation screen is delayed due to the system load condition, and the automatic operation input is The timing may not match and the input may fail. This will be described by taking as an example an operation of pressing the operation start button 12 on the initial screen 11 in FIG. 2, pressing the control 1 button 14 on the operation method selection screen 13 in FIG. 3, and further pressing the confirmation button 15. .

  In the automatic operation input by the automatic operation program 4, before the operation screen is updated from the initial screen 11 of FIG. 2 to the operation method selection screen 13 of FIG. 3, the pressing operation of the control 1 button 14 or the pressing operation of the confirmation button 15 is input. If this is done, this operation will not be entered correctly and the intended screen update will not be performed. For this reason, the subsequent input fails because it does not correspond to the operation screen. The software automatic test apparatus according to the first embodiment detects the input failure of the automatic operation as described above at an early stage, thereby reliably performing the automatic test to the end and reducing the test time.

  Hereinafter, a test method using the software automatic test apparatus according to the first embodiment will be described. First, as the first step, the application program 3 is started, and the automatic operation program 4 reads out the operator's operation procedure on the operation screen of the application program 3 from the operation procedure data storage unit 6, and based on this, any reproduction is performed. The application program 3 is automatically operated at the speed and the number of repetitions.

  In parallel with the first step, in the second step, the screen image of the operation screen of the application program 3 displayed on the display device 8 is acquired as a screen capture at a predetermined timing, and the screen capture data storage unit 7 Save to. Subsequently, in the third step, the latest screen capture acquired in the second step is compared with the screen capture acquired at the previous timing to determine whether or not the operation screen of the application program 3 has been updated.

  Further, in the fourth step, when it is determined in the third step that the operation screen of the application program 3 is not updated for a predetermined period, the automatic operation of the application program 3 is forcibly terminated and the reproduction speed of the automatic operation is adjusted. . The above first to fourth steps are repeated, and the test is terminated when the automatic operation in the first step is completed any number of times.

  The automatic operation reproduction speed adjustment in the fourth step will be described. The automatic operation program 4 starts an automatic operation at an arbitrary reproduction speed set in advance, and the slower the reproduction speed, the longer it takes to complete the automatic operation. For this reason, in order to shorten the test time, it is desirable that the reproduction speed of the automatic operation is higher.

  Therefore, the reproduction speed of the first automatic operation in the first step is set to the highest speed within the feasible range. Further, when adjusting the reproduction speed of the automatic operation in the fourth step, the reproduction speed is slightly lower than the reproduction speed of the previous automatic operation. As described above, by reducing the reproduction speed of the automatic operation step by step, the automatic test can be performed at the maximum speed within a range where the automatic test can be completed.

  Next, the operation of the automatic operation program 4 will be described using the flowchart of FIG. Note that the computer 1 is assumed to display the initial screen of the application program 3 on the display device 8 after being started, and the automatic operation program 4 is started from this state. After starting the automatic operation program 4, in step 1 (S1), the initial reproduction speed is read from the file as a set value (operation parameter), and then in step 2 (S2) the number of repetitions is read.

  The operation parameters read in S1 and S2 are set by the operator via the input means (for example, with the keyboard 9) and saved in a predetermined file. The predetermined file is a storage folder having a file name determined in advance as a file to be read by the automatic operation program 4.

  Next, in step 3 (S3), the automatic operation program 4 reads the operation procedure data from the operation procedure data storage unit 6. The operation procedure data records operation contents to be performed in time series. Subsequently, in step 4 (S4), the playback speed is set by the automatic operation timer. When the automatic operation timer expires in step 5 (S5) (Yes), the process proceeds to step 6 (S6), based on the operation procedure data. Simulated operation input, that is, automatic operation input is executed. If the automatic operation timer has not expired in S5 (No), input is waited until it expires.

  After S6, if all the operation procedure data has not been input in Step 7 (S7) (No), the procedure returns to S4 and the automatic operation input of the operation procedure data is continued at the reproduction speed set by the automatic operation timer. On the other hand, if all the operation procedure data has been input in S7 (Yes), the process proceeds to Step 8 (S8), where it is confirmed whether all the repetition counts read in S2 have been completed. ), The automatic operation program ends. If all the repetition counts are not completed in S8 (No), the process returns to S4.

  Next, the operation of the screen capture program 5 will be described using the flowchart of FIG. After being started, the screen capture program 5 sets the capture timer time in step 11 (S11). The capture timer is a timer that controls the timing for acquiring and storing the operation screen of the display device 8 as a screen capture. In S11, the capture timer is set (for example, 5 seconds), and the capture timer is started.

  Subsequently, when the capture timer expires in step 12 (S12) (Yes), the process proceeds to step 13 (S13), and a screen capture of the operation screen displayed on the display device 8 is acquired. Next, in step 14 (S14), the latest screen capture acquired this time is compared with the screen capture acquired at the previous timing.

  In S14, when the latest screen capture acquired this time and the screen capture acquired at the previous timing are the same, the process proceeds to step 15 (S15), the latest screen capture is discarded, and the screen non-update count is incremented by 1. . Furthermore, in step 16 (S16), when the screen non-update count becomes larger than a preset numerical value (here, 5), automatic operation by the automatic operation program 4 is not continued normally (operation input failed). Resource information is acquired and stored in step 17 (S17). The resource information is information including a CPU usage rate, a memory usage amount, and the like.

  Subsequently, in step 18 (S18), the automatic operation program 4 is forcibly terminated. Further, after the reproduction speed of the automatic operation program 4 is lowered from the previous time by the reproduction speed adjusting means in step 19 (S19), the program under test (application program 3) and the automatic operation program 4 are changed in step 20 (S20). restart. As a result, automatic operation with a lower reproduction speed than the previous time is newly started.

  On the other hand, if the latest screen capture acquired this time and the screen capture acquired at the previous timing are not the same in S14, the process proceeds to step 21 (S21), and the latest screen capture is stored in the screen capture data storage unit 7. . In S21, the screen non-update count is not counted. Further, the process proceeds to step 22 (S22), the capture timer is started, and the processes of S12, S13,. In S16, if the screen non-update count is equal to or smaller than a preset numerical value (here, 5), the process proceeds to S22, the capture timer is started, and the processes of S12, S13,.

  According to the software automatic test apparatus and the test method according to the first embodiment, the application program 3 is automatically operated by the automatic operation program 4, and in parallel with this, whether or not the operation screen of the application program 3 is updated is screened. Since the monitoring is performed by the capture program 5, it is possible to detect at an early stage that the input of the automatic operation has failed and the automatic operation is not normally continued. As a result, the automatic test can be reliably performed to the end, and the test time can be shortened.

  In addition, the playback speed of the first automatic operation should be set to the highest possible speed, and after automatic input failure is detected, the automatic operation playback speed should be adjusted slightly lower than the previous playback speed. Therefore, the test can be performed under the optimum condition as the maximum speed within a range where the automatic test can be completed, that is, as a continuous load test.

  The screen capture program 5 is independent of the automatic operation program 4 except that it has a forced termination / restart I / F when an automatic operation input failure is detected. And is working. For this reason, for example, even if it takes time for the screen capture comparison processing in the screen capture program 5, it does not hinder the speeding up of the automatic operation.

  Further, since the automatic operation program 4 and the screen capture program 5 do not need to communicate or share data with the application program 3, the application program 3 does not need to be modified for testing, and is close to actual operation. And can perform highly reliable automatic tests.

  The present invention can be used as a software automatic test apparatus for performing a man-machine software test.

  1 computer, 2 processing device, 3 application program, 4 automatic operation program, 5 screen capture program, 6 operation procedure data storage unit, 7 screen capture data storage unit, 8 display device, 9 keyboard, 10 pointing mouse, 11 initial screen, 12 operation start button, 13 operation method selection screen, 14 control 1 button, 15 confirmation button.

Claims (7)

An automatic software testing apparatus comprising a computer for starting a man-machine software to be tested, a display means for displaying an operation screen of the man-machine software, and an input means for an operator to input an operation on the operation screen. And
The calculator is
An operation procedure data storage unit in which an operator's operation procedure is recorded on the man-machine software operation screen;
Based on the operation procedure recorded in the operation procedure data storage unit, automatic operation means for automatically operating the man-machine software at an arbitrary reproduction speed and number of repetitions;
A reproduction speed adjusting means for adjusting a reproduction speed of automatic operation by the automatic operation means;
Image data acquisition means for acquiring a screen image of the operation screen of the man-machine software displayed on the display means as image data at a predetermined timing;
An image data storage unit for storing the image data acquired by the image data acquisition unit;
The latest image data obtained by the image data acquisition unit, as compared to the image data acquired in the previous timing, have a image data comparing means determines the presence or absence of updating of the man-machine software operation screen,
The image data comparison unit stores the latest image data in the image data storage unit when the latest image data acquired by the image data acquisition unit is different from the image data acquired at the previous timing. If the latest image data acquired by the image data acquisition means is the same as the image data acquired at the previous timing, the latest image data is discarded and the screen non-update count is incremented by one. When the non-update count becomes larger than a preset value, the automatic operation by the automatic operation means is forcibly terminated, the reproduction speed of the automatic operation is adjusted by the reproduction speed adjustment means, and the man-machine software is restarted. And an automatic software testing apparatus , wherein automatic operation by the automatic operation means is started .   2. The software automatic test apparatus according to claim 1, wherein an initial reproduction speed of the automatic operation by the automatic operation means is set by the operator via the input means.   2. The software automatic test apparatus according to claim 1, wherein the number of repetitions of the automatic operation by the automatic operation means is set by the operator via the input means. 2. The software automatic test apparatus according to claim 1 , wherein the reproduction speed adjusting unit lowers the reproduction speed of the newly started automatic operation from the reproduction speed of the previous automatic operation. 3. Automatic test equipment. A first step of starting the man-machine software to be tested and automatically operating the man-machine software at an arbitrary reproduction speed and number of repetitions based on an operation procedure of an operator on the operation screen of the man-machine software;
In parallel with the first step, a second step of acquiring and storing a screen image of the operation screen of the man-machine software displayed on the display means as image data at a predetermined timing;
A third step of comparing the latest image data acquired in the second step with the image data acquired at the previous timing and determining whether or not the operation screen of the man-machine software is updated;
If it is determined in the third step that the man-machine software operation screen has not been updated for a predetermined period, a fourth step of forcibly terminating the automatic operation of the man-machine software and adjusting the playback speed of the automatic operation is performed. Including
An automatic software testing method characterized in that the first step to the fourth step are repeated, and the test is terminated when the automatic operation in the first step is completed an arbitrary number of repetitions. 6. The software automatic test method according to claim 5 , wherein a reproduction speed of the first automatic operation in the first step is set to a maximum speed within a feasible range. . 6. The software automatic test method according to claim 5 , wherein when the reproduction speed of the automatic operation is adjusted in the fourth step, the software automatic test is made lower than the reproduction speed of the previous automatic speed. Method.

Images