JP2012038162A - Automatic test tool program and automatic test method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an automatic test tool program and an automatic test method capable of efficiently performing an operation test of a screen display accompanied by an operation.SOLUTION: An automatic test tool program related to the present invention makes a computer comprising at least an input part, a display part and a storage part function as: operation signal acquisition means for acquiring an operation signal input into the input part; first screen image acquisition means for acquiring a first screen image displayed on the display part after the operation signal is input into the input part; storage instruction means for storing the operation signal and the first screen image in the storage part; operation signal input means for inputting the operation signal stored in the storage part into the input part; second screen image acquisition means for acquiring a second screen image displayed on the display part after the operation signal is input into the input part; and comparison determination means for comparing the first and second screen images to determine whether they are coincident.

Description

  The present invention relates to the field of automated test tool programs and automated test methods.

  In the software development process, it is necessary to ensure the quality of software by repeatedly performing operation tests. However, the man-hours required for the operation test are limited, and in order to increase the development speed, the efficiency of the operation test is required. As a method of performing a test with a small number of man-hours, an automatic test tool is known in which an operation test is performed and the result is reported without the assistance of a human tester (tester).

  With regard to the automatic test tool, for example, Patent Document 1 discloses a method for creating a test scenario by recording operation timing in a test scenario for the purpose of improving the efficiency of creating a test scenario used in an automatic test.

  On the other hand, an image forming apparatus (hereinafter referred to as MFP: Multi-Function Peripheral) in which functions of each apparatus such as a fax machine, a printer, a copy machine, and a scanner are housed in a single housing has come to be known. This MFP is provided with a display unit, a printing unit, an imaging unit, and the like in one casing, and four types of applications corresponding to a fax, a printer, a copy, and a scanner, respectively. And operate as a copy and scanner.

  In recent years, with the multifunctionalization of MFP, the liquid crystal panel (touch panel) on the operation panel of the image forming apparatus has been enlarged, and the display content has been enhanced. For example, a user-friendly user interface is provided by displaying various display screens using icons or the like based on software control.

  Here, the user interface displayed on the liquid crystal panel (touch panel) of the MFP is also displayed based on the control of the software. In the software development process of the MFP, the operation test of the screen display software is repeatedly performed, It is necessary to ensure that software quality. For example, a tester (tester) operates the hard keys and touch panel on the operation panel with various operation patterns, and in particular, in the case of an operation test of screen display software, the display screen transitions correctly to the screen intended by the operation. Check repeatedly whether or not.

  In addition, it is desired that such an operation test be automated from the viewpoint of efficiency as described above. However, the above-described conventional automatic test tool is a command-level sequence that represents an exchange between software components. Is the test target, and is not the test target for the correctness of the display screen displayed on the liquid crystal panel (touch panel). Therefore, in the operation test of the screen display software, these test data cannot be automatically created, and it actually takes man-hours for the operation test, and there is a problem in its efficiency.

  In view of the above problems, an object of the present invention is to provide an automatic test tool program and an automatic test method that can efficiently perform an operation test of a screen display accompanying an operation. More specifically, for example, the present invention provides an automatic test tool for screen display software including whether or not a transition to a display screen intended in the specification is correctly performed according to a predetermined operation in an operation unit of the MFP.

  In order to solve the above problems, the automatic test tool program according to the present invention creates a test case, causes the test target software to execute the test case, and confirms the reliability of the display screen displayed in accordance with the operation instruction. An automatic test tool program to be tested, comprising at least an input unit, a display unit, and a storage unit, an operation signal acquisition means for acquiring an operation signal input to the input unit, and the operation signal input to the input unit After that, the first screen image acquisition means for acquiring the first screen image displayed on the display section, the storage instruction means for storing the operation signal and the first screen image in the storage section, and the storage in the storage section An operation signal input means for inputting the operated signal to the input section; and after the operation signal is input to the input section by the operation signal input means, the operation signal is displayed on the display section. And the second screen image acquisition means for acquiring a second screen image, and the first screen image and the second screen image is made to function as a comparison determines the comparison determination unit configured to determine whether to match.

  In order to solve the above problems, the automatic test tool program according to the present invention creates a test case, causes the test target software to execute the test case, and confirms the reliability of the display screen displayed in accordance with the operation instruction. An automatic test tool program to be tested, comprising at least an input unit, a display unit, and a storage unit, an operation signal acquisition means for acquiring an operation signal input to the input unit, and the operation signal input to the input unit After that, the first screen image acquisition means for acquiring the first screen image displayed on the display unit, the operation signal is interpreted as the operation content associated with the operation signal, and the first screen image is First interpretation means for interpreting the first screen content indicated by the screen image, storage instruction means for storing the operation content and the first screen content in the storage section, and a storage section An operation signal input unit that inputs the stored operation content to the input unit, and a second screen image that is displayed on the display unit is acquired after the operation content is input to the input unit by the operation signal input unit. A comparison is made between the two-screen image acquisition means, the second interpretation means for interpreting the second screen image into the second screen content indicated by the screen image, and whether the first screen content and the second screen content match. It functions as a comparison / determination means.

  In addition, what applied the arbitrary combination of the component of this invention, expression, or a component to a method, an apparatus, a system, a computer program, a recording medium, etc. is also effective as an aspect of this invention.

  ADVANTAGE OF THE INVENTION According to this invention, the automatic test tool program and automatic test method which can perform the operation test of the screen display accompanying operation efficiently can be provided.

2 is a diagram illustrating an example of a hardware configuration of an MFP 1 according to the embodiment of the present invention. FIG. 3 is a diagram illustrating an example of an appearance of an operation panel 11 of the MFP 1. FIG. 2 is a functional block diagram showing a main functional configuration of MFP 1 according to the present embodiment. FIG. An example of a test case creation screen of the automatic test tool according to the present embodiment is shown. An example of an operation flow by a tester is shown. It is a sequence diagram which shows the creation process of a test case. A test case and a screen image example are shown. The example of a test implementation screen of the automatic test tool concerning this embodiment is shown. It is a sequence diagram which shows a test implementation process. A screen image comparison example (part 1) is shown. A screen image comparison example (part 2) is shown. It is a functional block diagram which shows the function structure of the automatic test execution part 20 which concerns on this embodiment. It is a functional block diagram which shows the function structure of the automatic test execution part 30 which concerns on this Embodiment 2. FIG. An example of an information table in which operation contents are defined is shown. It is a sequence diagram which shows the creation process of a test case. An example of the created test case is shown. It is a sequence diagram which shows a test implementation process. An example of screen content comparison is shown.

  DESCRIPTION OF EMBODIMENTS Embodiments for carrying out the present invention will be described in each embodiment with reference to the drawings. In describing the present invention, an example in which an operation test using the automatic test tool according to the present invention is applied to an image forming apparatus (MFP) will be described below.

[Embodiment 1]
(hardware)
FIG. 1 is a diagram illustrating an example of a hardware configuration of the MFP 1 according to the embodiment of the present invention. The MFP 1 according to the present embodiment includes an operation panel 11, a storage medium I / F 12, a controller 13, a data communication I / F 14, a scanner 15, a plotter 16, and an HDD (Hard Disk Drive) 17. Are connected to each other.

  The operation panel 11 includes an input device 11a and a display device 11b. The input device 11a includes hard keys and the like, and is used to input each operation signal to the MFP 1. Further, the display device 11b is configured by a display or the like, and displays, for example, various types of information regarding the image forming operation. The data communication I / F 14 includes an interface device 14a, and is an interface that connects the MFP 1 to a data transmission path such as a network or a fax machine. The HDD 17 stores various data such as received document data and read image data handled by the MFP 1. Further, the HDD 17 manages these various data by a predetermined file system or DB (Data Base).

  Various data stored in the HDD 17 includes data input from the recording medium 12b. The recording medium 12b is set in the drive device 12a included in the storage medium I / F 12, and various data are stored in the HDD 17 from the recording medium 12b via the drive device 12a.

  The controller 13 includes a ROM (Read Only Memory) 13a, a RAM (Random Access Memory) 13b, and a CPU (Central Processing Unit) 13c. The ROM 13a is a program executed when the MFP 1 is activated. Stores various data. The RAM 13b temporarily stores various programs and data read from the ROM 13a and the HDD 17. Further, the CPU 13c executes a program temporarily stored in the RAM 13b. For example, when the print data is received via the data communication I / F 14, the controller 13 reads a program (PDL parser) that can read PDL (Page Description Language) read from the ROM 13a onto the RAM 13b by the CPU 13c. Execute and interpret the print data to generate a bitmap image.

  The scanner 15 includes an image reading device 15a, and optically reads a document placed on a reading surface and generates image data. The plotter 16 has a printing device 16a and prints a bitmap image on a recording sheet by, for example, an electrophotographic process method.

  FIG. 2 is a diagram showing an example of the appearance of the operation panel 11 of the MFP 1. As described above, the operation panel 11 includes the input device 11a and the display device 11b. More specifically, the operation panel 11 includes, for example, a display 18 that displays various types of information related to an image forming operation, and a hard key 19 such as a physical button or a dial for a user to give an operation instruction. . In addition, since the display 18 of this embodiment is a touch panel type display by a tactile sensor, it is possible to perform an operation instruction related to an image forming operation by a contact operation on the display.

  As described above, the MFP 1 according to the present embodiment realizes a plurality of functions such as a copy, a printer, a facsimile, and a scanner by the above hardware configuration.

(function)
FIG. 3 is a functional block diagram showing the main functional configuration of the MFP 1 according to this embodiment. The MFP 1 includes an operation unit (operation panel) 11, a controller unit 13, a storage unit (HDD) 17, various MFP engines 15 and 16, and an automatic test execution unit 20.

  An operation unit (operation panel) 11 and a storage unit (HDD) 17 are the operation panel and HDD of the MFP 1 described above, respectively. The controller unit 13 is a control unit that controls the MFP operation. The main body software of the MFP 1 is held, and the operation control of the MFP 1 is realized by executing the main body software. Since this operation control includes control of screen display on the operation unit 11, the main body software is software to be tested by the automatic test tool according to the present embodiment. The various MFP engines 15 and 16 are engines related to various image formations mounted on the MFP 1, such as a scanner device and a plotter device.

  The automatic test execution unit 20 is regarded as a function provided in the MFP 1 as a result of installing the automatic test tool program according to the present embodiment in the MFP 1. By executing this automatic test tool program, the automatic test execution unit 20 functions and a test operation is realized on the MFP 1.

(Overall operation)
Before describing the functional details of the automatic test execution unit 20, the overall flow of the operation test using the automatic test tool according to the present embodiment will be described first. This test flow includes steps of (1) test case creation and (2) test execution.

(1) Test Case Creation FIG. 4 shows an example of a test case creation screen of the automatic test tool according to the present embodiment. First, a tester (user) activates an automatic test tool and creates a test case to be tested when performing an operation test of the main body software. Test cases can be created using an automated test tool. The created test case serves as a model for the subsequent test execution. In performing the test, when the main body software to be tested is operated according to the test case, it is determined whether or not the main body software outputs the expected result (display screen).

  Now, on the automatic test tool, the tester can start creating a test case by pressing the “measurement start” button. After “start measurement”, the tester operates the operation panel 11. When the operation is finished, the “measurement end” button is pressed to finish the test case creation.

  Specifically, for example, as shown in FIG. 5, the tester operates the operation panel 11 and operates (presses) the operation button “3” on the screen A on the screen A after “start measurement”. And It is assumed that the operation “3” is received and the screen is changed to the screen B, and the tester subsequently operates (presses) the operation button “5” on the screen B to change to the screen C. In addition, it is assumed that the operation button “OFF” on the screen is operated (pressed) on the screen C and the setting is changed to “ON” (the screen D remains). Here, it is assumed that the tester finishes the operation, and presses the “end measurement” button to finish the creation of the test case.

  Here, the tester operates “3” from screen A → transition to screen B → operation from screen B to “5” → transition to screen C → operation from screen C to “OFF” to “ON”. Therefore, since the purpose is to perform an operation test of the main software, it means that such a test case has been created.

  FIG. 6 is a sequence diagram illustrating a test case creation process. Information processing from when the “measurement start” button is pressed by the tester until the “measurement end” button is pressed will be described below with reference to the drawings.

  When the “measurement start” button is pressed by the tester on the automatic test tool (S601), the automatic test execution unit 20 starts a test case creation process. When the operation unit 11 is operated by the tester (S602), an operation signal is transmitted to the controller unit 13 (S604). At this time, the automatic test execution unit 20 acquires this operation signal (S604). Examples of the contents of the operation signal include the type of the operated hard key 19 and coordinate information on the operated touch panel 18.

  On the other hand, when the operation signal is transmitted to the controller unit 13, the controller unit 13 transmits screen data to the operation unit 11 (S605). This is screen data for screen display. When the display screen of the operation unit 11 (more precisely, the touch panel 18) is switched, the automatic test execution unit 20 acquires (captures) a screen image (S606). The automatic test execution unit 20 may acquire the screen image after a certain time after acquiring the operation signal. This is because the display screen switching time is taken into consideration.

  Then, the automatic test execution unit 20 instructs the storage unit (HDD) 17 to store the acquired operation signal and screen image, and stores the information (S607). When the “end measurement” button is pressed by the tester on the automatic test tool (S608), the automatic test execution unit 20 ends the acquisition of the operation signal and the screen image.

  Note that until the “end measurement” button is pressed, when the tester operates again (S602), the processing of S602 to S607 is repeated. That is, a plurality of operation signals and screen images can be acquired even within one test case. In this case, the information is stored in the storage unit (HDD) 17 including the acquisition order information. The information stored here is used as test case data during test execution.

  Specifically, as shown in FIG. 5, the tester operates “3” from screen A → transitions to screen B → operations from screen B to “5” → transitions to screen C → “OFF from screen C” It is assumed that the test case has been created in the flow of “ON” to “ON”. Then, as shown in FIG. 7, (a) a test case is created, and (b) a screen image of screen B (for example, BMP format), (c) a screen image of screen C (part 1), (d ) A screen image (part 2) of screen C is acquired and saved. In the test case, an operation signal (key event) is associated with a screen image corresponding to the operation signal.

  In the above description, the controller unit 13 transmits screen data to the operation unit 11 when an operation signal is transmitted to the controller unit 13, and the display screen is switched. However, not all operations involve display screen switching. There is a case where an operation is performed on one display screen without switching the display screen (screen transition) (for example, screen C “OFF” → “ON” in FIG. 5). Even in such a case, the automatic test execution unit 20 acquires one screen image for one operation signal according to the above-described sequence. This is because even if the display screen itself is the same, some parameters and display contents may be changed depending on the operation in the same screen, and this change can be tested (for example, (c) in FIG. 7). ), (D)).

(2) Test Execution FIG. 8 shows an example of a test execution screen of the automatic test tool according to the present embodiment. The tester (user) designates a test case to be tested on the automatic test tool and presses “Start Test” when performing an operation test of the main body software. As described above, the test case can be created using an automatic test tool in advance. In performing the test, when the main body software to be tested is operated according to a specified test case, it is determined whether or not the main body software outputs an expected result (display screen).

  In the automatic test tool in the figure, the number of test executions can be set as an option to repeat the test. In general, in the operation test, it is not necessary to confirm the operation once, but it is necessary to confirm the certainty of the operation without fail by repeatedly performing the same operation test.

  FIG. 9 is a sequence diagram illustrating the test execution process. The test execution process started by pressing the “Start Test” button by the tester will be described below with reference to the drawings.

  When the “test start” button is pressed by the tester on the automatic test tool (S901), the automatic test execution unit 20 starts a test execution process. First, the automatic test execution unit 20 acquires a designated test case and a screen image related to the test case from the storage unit (HDD) 17 (S902). The screen image acquired at this time is referred to as a first screen image.

  Since the test case includes the instruction signal as described above (for example, the key event in FIG. 7A), the automatic test execution unit 20 transmits the instruction signal to the operation unit 11 (S903). ). The operation unit 11 receives the operation signal and transmits the operation signal to the controller unit 13 in the same manner as when the operation unit 11 is operated by the tester (S904). If the design is possible, the automatic test execution unit 20 may transmit the operation signal directly to the controller unit 13.

  On the other hand, when the operation signal is transmitted to the controller unit 13, the controller unit 13 transmits screen data to the operation unit 11 (S905). When the display screen is switched, the automatic test execution unit 20 also acquires (captures) a screen image (S906). The screen image acquired at this time is called a second screen image.

  Here, the automatic test execution unit 20 compares the first screen image previously acquired from the storage unit (HDD) 17 in S902 with the second screen image captured in S906, and the two screen images match. It is determined whether or not to perform (S907). If the two screen images match, it means that the operation unit 11 of the MFP 1 is performing the same behavior as the test case. That is, according to a predetermined operation, it has been confirmed whether or not the correct display screen intended by the specification is displayed, and the test result can be said to be successful. On the other hand, if the two screen images do not match, it means that the display screen intended for the specification is not displayed in accordance with a predetermined operation in the operation unit of the MFP 1, and the test result can be said to be a failure. Note that the determination method here only needs to be able to determine matching or mismatching. For example, it is possible to determine whether or not both screen images match by pixel comparison.

  The automatic test execution unit 20 creates a test result report based on the determination result and reports this to the tester (S908, S909).

  FIG. 10 shows a screen image comparison example (part 1). The screen image on the left in the figure is a screen image at the time of test data creation (first screen image), which is a screen image according to the intended specification. The screen image on the right in the figure is a screen image (second screen image) when test data is executed. The test result can be determined to be successful if both images match. On the other hand, if the two images do not match, it can be determined that there is a problem with the main body software because it differs from the intended specification. In the case of this example, the time display location in the image has a different acquired time, so that it may be processed out of the comparison determination target.

  FIG. 11 shows a screen image comparison example (part 2). Specifically, in accordance with the example of FIG. 7, the screen image on the left in the figure is a screen image (first screen image) after the key event “3” is pressed at the time of test data creation, and as per intended specifications. It is a screen image. The screen image on the right in the figure is a screen image (second screen image) after the key event “3” is pressed during test data reproduction. When the key event “3” is operated on the operation unit 11 of the MFP 1, the specification transitions to the screen B (test case). When the test is performed, the test case is executed and the key event “3” is operated. If a signal is input, if it conforms to the specification, it should transition to the screen B, and this can be confirmed by the coincidence of the first screen B image and the second screen B image. On the other hand, if the two images do not match, it can be determined that there is a problem with the main body software because it differs from the intended specification.

In the test case creation, not only the screen image when the display screen is switched, but also one screen image is acquired for each operation signal on the same screen without switching the display screen. Even in this case, the first screen image and the second screen image are compared and determined for one operation signal.
This is because even if the display screen itself is the same, some parameters and display contents may be changed by the operation on the screen (for example, (c) and (d) in FIG. 7).

  The above is the entire test flow using the automatic test tool according to the present embodiment. As a specific application, for example, in the main body software of the MFP 1, it is assumed that a part of the program has not been corrected and the version has been upgraded. The developer thinks that the modification or version upgrade of this program will not affect the behavior of the test case, but it is necessary to confirm that there is no problem with the actual behavior test. There is. Therefore, using the automatic test tool according to the present embodiment, it is possible to perform a test on the main software after the program correction using the test case created before the program correction (or version upgrade). If the test succeeds due to the matching of both screens as described above, the result as intended by the developer is obtained. On the other hand, if the test fails due to a mismatch between the two screens, this program can be modified or upgraded. The developer again checks the main body software program as a problem such as a bug has occurred in the program.

  As described above, according to the automatic test tool according to the first embodiment, a test case is efficiently created based on key operation and display screen capture (screen image). An operation test can be performed on the correctness of the display screen of the operation panel 11. In addition, there is an effect of performing an automatic test with higher accuracy including timing. In addition, human errors (test case creation mistakes by testers, test execution omissions) can be reduced.

(Function of the automatic test execution unit 20)
FIG. 12 is a functional block diagram showing a functional configuration of the automatic test execution unit 20 according to the present embodiment. The processing operation of the automatic test execution unit 20 has already been described with reference to the above-described sequence. Here, the functional configuration of the automatic test execution unit 20 will be described again. The automatic test unit 20 includes an operation signal acquisition unit 21, a screen image acquisition unit 22, a storage instruction unit 23, an operation signal input unit 24, a comparison determination unit 25, and a test result report unit 26.

  The operation signal acquisition unit 21 has a function of acquiring the operation signal input to the input unit 11a. When a tester (user) gives an operation instruction from the operation panel 11 of the MFP 1, the operation signal is transmitted to the controller unit 13 of the MPA 1 main body. The operation signal acquisition unit 21 acquires this operation signal.

  The screen image acquisition unit 22 has a function of acquiring (capturing) the screen image displayed on the display unit 11b after the operation signal is input to the input unit. As the tester (user) issues an operation instruction from the operation panel 11 of the MFP 1, the controller unit 13 transmits screen data to the display unit 11b when switching the display screen. The display unit 11b receives the screen data and displays it on the screen. The screen image acquisition unit 22 acquires (captures) the screen image of the display screen that is switched and displayed when the screen data is transmitted from the controller unit 13 to the display unit 11b. The screen image acquired by the screen image acquisition unit 22 includes the first screen image and the second screen image described above.

  The storage instruction unit 23 has a function of storing the acquired operation signal and screen image in the storage unit (HDD) 17. Here, the tester (user) continuously gives a plurality of operation instructions to cause the MFP 1 to execute a series of certain operations from the operation panel 11 of the MFP 1. For example, even when copying is performed, the printing conditions (paper size, scaling, etc.) are specified, and the copy button is finally operated, so multiple operation signals are acquired, and multiple display screens are displayed as a result of the operation. Therefore, a plurality of screen images are also acquired and stored in the storage unit (HDD) 17. A specific example is as shown in FIG.

  The operation signal input unit 24 has a function of inputting the operation signal stored in the storage unit (HDD) 17 to the input unit 11a. This means reproduction of the test case, and causes the main body software of the MFP 1 to execute an operation according to the test case. Thereby, the operation based on the test case can be executed by the main body software.

  The comparison determination unit 25 has a function of comparing and determining whether or not the first screen image and the second screen image match. Specific examples are as described above.

  These functions are actually realized in the computer (for example, MFP 1) by the automatic test tool program executed by the CPU 13c of the apparatus.

[Embodiment 2]
In the first embodiment described above, the automatic test execution unit 20 acquires an operation signal (for example, coordinate information on the hard key 19 or the touch panel 18), acquires a screen image (for example, BMP format), and stores the storage unit. (HDD) 17 is assumed to be stored. However, in the second embodiment, the acquired operation signal and screen image are not stored in the storage unit (HDD) 17 as they are, but are stored after being converted into information (referred to as operation contents) meaningful in the MFP 1. .

  For example, when the “copy” hard key which is the hard key 19 provided on the operation panel 11 of FIG. 2 (left in the figure) is pressed, the operation signal of the “copy” hard key is simply stored. Rather, the “copy” hard key pressing operation is interpreted as a request to shift to the copy mode (screen transition request to the copy application screen), and the information given to the operation signal is “ “Migration request” is stored in the storage unit (HDD) 17. Similarly, for example, on the copy application screen, the numerical key pressing operation saves the meaningful information “number of copies to be specified” in the storage unit (HDD) 17.

  In this way, the information given to the operation signal is stored as a test case, and when the test is performed (when the test case is reproduced), the automatic test execution unit 30 according to the second embodiment issues an operation instruction to the controller unit 13. When giving, enter this meaningful information. In this way, the main body software to be tested is a program whose operation signal (hard key change, button coordinate position change on the touch panel, etc.) has been changed due to program correction, etc. Even the main body software is useful in that it can use a test case that has been created once, since the meaning information is generally common as long as it is a multifunction peripheral.

  Also, the acquired screen image is not stored as it is with respect to the image data in the BMP format, but the information (referred to as screen contents) that gives meaning to the screen image is stored. Examples are “top screen”, “copy idle screen”, “copy idle screen: number of sheets”, “energy saving mode screen”, and the like.

  In this way, the screen image is also stored as meaningful information, and the meaningful information is compared and determined at the time of test execution (test case reproduction) and at the time of comparison determination of screen images. In this way, even if the main software to be tested is a display screen that has been changed by a program modification, etc., or even main body software for a different MFP model, Since it is almost common, it is useful in that a test case that has already been created can be used. This will be specifically described below. The hardware of the MFP 1 (FIGS. 1 and 2) is the same in this embodiment. In the functional block diagram of FIG. 3, the automatic test execution unit 20 is replaced with the automatic test execution unit 30.

(Function of the automatic test execution unit 30)
FIG. 13 is a functional block diagram illustrating a functional configuration of the automatic test execution unit 30 according to the second embodiment. Compared with the automatic test execution unit 20 (FIG. 12) according to the first embodiment, the processing is performed in terms of an operation signal interpretation unit 31, a screen image interpretation unit 32, an operation content input unit 33, a storage instruction unit 34, and a comparison determination unit 35. Is different. The same applies to the operation signal acquisition unit 21, the screen image acquisition unit 22, and the test result report unit 26. The following description will focus on the differences.

  The operation signal interpretation unit 31 has a function of interpreting the operation signal acquired by the operation signal acquisition unit 21 into operation content (operation content information) associated with the operation signal.

  The screen image interpretation unit 32 has a function of interpreting the screen image acquired by the screen image acquisition unit 22 into the screen content (screen content information) indicated by the screen image. A specific interpretation method for these operation signals and screen images will be described later.

  The storage instruction unit 34 has a function of storing the operation content and the screen content after interpretation in the storage unit (HDD) 17. This is different from the storage instruction unit 23 (first embodiment) that stores operation signals and screen images.

  The operation content input unit 33 has a function of inputting the operation content stored in the storage unit (HDD) 17 to the input unit 11a. This means reproduction of the test case, and causes the main body software of the MFP 1 to execute an operation according to the test case. Note that the input unit 11a of the present embodiment can input an operation not only according to an operation signal but also according to a meaningful operation content.

  The comparison determination unit 35 has a function of comparing and determining whether or not the first screen content matches the second screen content. As the test case is reproduced by inputting the operation content by the operation content input unit 33, the screen image acquisition unit 22 acquires (captures) the screen image as in the first embodiment. In the second embodiment, the acquired screen image is interpreted (converted) into the second screen content indicated by the screen image by the screen image interpretation unit 32, and the comparison determination unit 35 compares the screen contents after interpretation with each other. Make a decision. This point will be described later again.

(About interpretation processing)
The operation signal interpretation unit 31 interprets the operation signal acquired by the operation signal acquisition unit 21 into the operation content indicated by the operation signal. In the first place, the operation signal is generated when the user operates a certain position on the hard key 19 or the touch panel 18 with some operation intention on the operation panel 11. Therefore, the operation content that the operation signal means is uniquely defined and associated in advance.

  FIG. 14 shows an example of an information table in which operation details are defined. For example, a “copy” key that is a hard key is defined as an event (operation content) associated with “copy application screen transition”. Therefore, when the “copy” key is operated, this operation means “copy application screen transition”. Therefore, the main body software of the MFP 1 interprets that the operation command “copy application screen transition” has been performed, and copies. Perform application screen transition.

  Similarly, a predetermined coordinate position (coordinate range) on the touch panel 18 is defined in association with “initial setting screen transition” as an event (operation content). Therefore, when this operation is performed, the main body software of the MFP 1 interprets that an operation command “initial setting screen transition” has been performed, and performs an operation of initial setting screen transition. Note that an operation button such as an “initial setting screen” is arranged at this coordinate position (coordinate range) on the touch panel 18 so that the user can recognize it on the touch panel 18.

  The information table as shown in the figure may be inquired by the automatic test execution unit 30 (automatic test tool) to the operation panel 11 or the controller unit 13 or may be held in advance by the automatic test execution unit 30. Good.

  The screen image interpretation unit 32 has a function of interpreting the screen image acquired by the screen image acquisition unit 22 into the screen content indicated by the screen image. In the MFP 1, various display screens are prepared for each display screen with some significance (purpose). The acquired screen image is merely data in the BMP format, but the screen image interpretation unit 32 interprets this screen image and determines and discriminates what kind of screen the on-MFP screen image is. An example is shown below.

  The screen image interpretation unit 32 obtains a screen image acquired by screen capture as input data. However, since the display screen of the operation panel 11 has a different screen configuration for each application, the configuration features (features) for each screen. To determine the type of app. In the case of the MFP, the application types include copy, scanner, and printer.

  If it is determined that the screen is a copy screen, whether it is a copy-ready screen (ready status screen), a setting screen (monochrome / color, single-sided / double-sided, consolidation, scaling, etc.), The copy number designation or the like is determined from the screen image data bitmap (BMP), and is determined as the screen state.

  Similarly, when it is determined that the screen is the scanner screen or the printer screen, the screen state is determined by determining the ready state screen, the input state of the scan transmission destination, the number of printed pages, and the like from the bitmap of the image data.

  As a result of the screen image being determined and discriminated as described above, for example, “top screen”, “copy idle screen”, “copy idle screen: copy number designation”, “copy start screen: copy number designation”, “print start screen” ”,“ Scanner start screen ”,“ energy saving mode screen ”, etc., the screen image is interpreted as the screen content indicating what the screen image is in the MFP.

(Overall operation)
The overall flow of the operation test using the automatic test tool according to the second embodiment will be described. This test flow includes the steps of (1) test case creation and (2) test execution, as described above. When the same processing steps as those in FIGS. 6 and 9 are shown, the same numbering is kept.

(1) Creation of Test Case First, a tester (user) activates an automatic test tool (FIG. 4) and creates a test case to be tested when performing an operation test of the main body software. On the automatic test tool, the tester can start creating a test case by pressing a “measurement start” button. After “start measurement”, the tester operates the operation panel 11. When the operation is finished, the “measurement end” button is pressed to finish the test case creation.

  FIG. 15 is a sequence diagram illustrating a test case creation process. Information processing from when the “measurement start” button is pressed by the tester until the “measurement end” button is pressed will be described below with reference to the drawings.

  When the “measurement start” button is pressed by the tester on the automatic test tool (S601), the automatic test execution unit 20 starts a test case creation process. When the operation unit 11 is operated by the tester (S602), an operation signal is transmitted to the controller unit 13 (S604). At this time, the automatic test execution unit 20 acquires this operation signal (S604). Examples of the contents of the operation signal include the type of the operated hard key 19 and coordinate information on the operated touch panel 18.

  On the other hand, when the operation signal is transmitted to the controller unit 13, the controller unit 13 transmits screen data to the operation unit 11 (S605). This is screen data for screen transition. When the display screen is switched, the automatic test execution unit 20 acquires (captures) a screen image (S606).

  Next, the automatic test execution unit 20 interprets the acquired operation signal into the operation content indicated by the operation signal, and interprets the acquired screen image as the screen content indicated by the screen image (S610).

  Then, the automatic test execution unit 20 instructs the storage unit (HDD) 17 to store the acquired operation content (information) and screen content (information), and stores the information (S611). When the “end measurement” button is pressed by the tester on the automatic test tool (S608), the automatic test execution unit 20 ends the acquisition of the operation signal and the screen image.

  As described above, when the operation is performed again by the tester until the “measurement end” button is pressed (S602), the processes of S602 to S606, S610, and S611 are repeated. The information stored here is used as test case data during test execution.

  FIG. 16 shows an example of the created test case. The difference from the first embodiment (FIG. 7) is that the operation content is stored in the storage unit (HDD) 17 instead of the operation signal (key event) and the screen content (and the screen state) instead of the screen image. .

  For example, in the test procedure 1, when the “copy” hard key is pressed as an operation signal, the event content “copy application screen transition request” meaning that the “copy” hard key is pressed is converted into the test by the above-described interpretation. It is recorded as a case. At this time, the screen content corresponding to the event content “copy application screen transition request” is interpreted based on the screen image, and as a result, the screen content “copy idle screen” is associated.

  Subsequently, in test procedure 2, when a coordinate (x, y) on the touch panel is pressed as an operation signal, the event content “original size designation A4” meaning that the coordinate is pressed is converted as a test case by the above-described interpretation. It is recorded. At this time, the screen content corresponding to the event content “original size specification A4” is interpreted based on the screen image, and as a result, the screen content “copy idle screen: original size specification A4” is associated.

  Subsequently, in the test procedure 3, when the “3” hard key is pressed as the operation signal, the test content is converted into the event content “three copies designated” meaning that the “3” hard key is pressed by the above-described interpretation. It is recorded as a case. At this time, the screen content corresponding to the event content “copy number designation 3” is interpreted based on the screen image, and as a result, the screen content “copy idle screen: original size designation A4, copy number designation 3” corresponds. Attached.

  Subsequently, in the test procedure 4, when the “start” hard key is pressed as the operation signal, the event content “copy start request” meaning that the “start” hard key is pressed is converted as a test case by the above-described interpretation. It is recorded. At this time, the screen content corresponding to the event content “copy start request” is interpreted based on the screen image, and as a result, the screen content “copy idle screen” is associated. In this case, copying is executed according to the printing conditions of the document size designation A4 and the copy number designation 3 sheets, and then the screen transits to the “copy idle screen” (copy application initial screen).

(2) Test execution The tester (user) specifies a test case to be tested on the automatic test tool (FIG. 8) and presses “Start Test” when performing an operation test of the main body software. As described above, the test case can be created using an automatic test tool in advance.

  FIG. 17 is a sequence diagram illustrating test execution processing. The test execution process started by pressing the “Start Test” button by the tester will be described below with reference to the drawings.

  When the “test start” button is pressed by the tester on the automatic test tool (S901), the automatic test execution unit 20 starts a test execution process. First, the automatic test execution unit 20 acquires the designated test case and screen content (information) related to the test case from the storage unit (HDD) 17 (S910). The screen content acquired at this time is called the first screen content.

  Since the test case includes the instruction content interpreted as described above (for example, the event content in FIG. 16), the automatic test execution unit 20 transmits the instruction content to the operation unit 11 (S911). ). The operation unit 11 receives the operation content and transmits the operation content to the controller unit 13 (S912). If the design is possible, the automatic test execution unit 20 may transmit the operation content directly to the controller unit 13.

  On the other hand, when the operation content is transmitted to the controller unit 13, the controller unit 13 transmits screen data to the operation unit 11 (S905). This is screen data for screen transition. When the display screen is switched, the automatic test execution unit 20 acquires (captures) a screen image (S906).

  Here, the automatic test execution unit 20 interprets the screen image acquired here into the screen content indicated by the screen image (S913). This is because the comparison determination target is set to the same screen content level. The screen content interpreted at this time is referred to as second screen content.

  Then, the automatic test execution unit 20 compares the first screen content previously acquired from the storage unit (HDD) 17 in S910 with the second screen content interpreted in S913, and whether both screen contents match. Is determined (S914). If both screen contents match, it means that the operation unit 11 of the MFP 1 is performing the same behavior as the test case. That is, according to a predetermined operation, it is confirmed whether or not the display screen intended by the specification is displayed, and the test result can be said to be successful. On the other hand, if the contents of the two screens do not match, the operation unit of the MFP 1 does not display a display screen intended for the contents of the screen according to the specification according to a certain predetermined operation, and the test result is a failure. I can say that. Note that the determination method here is not limited to the completely identical character string of the screen content as long as the screen content can be substantially matched or mismatched.

  The automatic test execution unit 20 creates a test result report based on the determination result and reports this to the tester (S908, S909).

  FIG. 18 shows a screen content comparison example. For example, a comparative example of screen contents in the test procedure 1 of FIG. 16 is shown. Here, when the test content (when the test case is played back), when the event content “Copy application screen transition request”, which means pressing the “Copy” hard key, is input, it is actually “Copy idle screen” (Copy application initial screen). Is displayed on the operation panel 11 and the screen content is interpreted as a “copy idle screen” based on the screen image of the display screen. Then, a comparison judgment is made between the “copy idle screen” (first screen content) and the “copy idle screen” (second screen content), and both screen contents (information) match, so the test result is successful. .

  On the other hand, if the event content “Copy application screen transition request”, which means that the “Copy” hard key is pressed, is input during test execution (test case playback), the “fax idle screen” (fax application initial stage) Screen) is displayed on the operation panel 11, and based on the screen image of the display screen, the screen content is interpreted as a “fax idle screen”. In this case, the comparison result is compared with the “copy idle screen” (first screen content) and the “fax idle screen” (second screen content), and both screen contents (information) do not match, so the test result is unsuccessful. It becomes. The main body software at the time of the test execution assumes that there is a problem in the program such as a bug, and the developer checks the main body software program again.

  As described above, in the second embodiment, the automatic test execution unit 20 stores information after converting it into information (operation contents) meaningful in the MFP 1 when creating a test case. Also, the acquired screen image is not stored as it is for the image data in the BMP format, but information (screen content) that gives meaning to the screen image is stored.

  When the test case is played back, the meaning of the operation is input. As a result, the main body software to be tested is a software whose operation signal (hard key change, button coordinate position change on the touch panel, etc.) has been changed due to program correction, etc. Even so, it is useful in that the test cases that are created can be used because it is possible to input common operation contents that have been given meaning.

  In addition, since the comparison is made between meaningful information even during test execution (test case playback) and screen image comparison determination, the display screen of the main software to be tested has been changed due to program modifications, etc. Even if the main body software is for different MFP models, it is possible to determine whether the display images match or not by comparing the common screen contents (information) with the meaning of the display screen. Useful.

  As described above, according to the present invention, it is possible to provide an automatic test tool program and an automatic test method that can efficiently perform an operation test of a screen display accompanying an operation.

  The present invention is not limited to such specific embodiments, and various modifications and changes can be made within the scope of the gist of the present invention described in the claims. For example, in the present embodiment, the present invention is applied to an image forming apparatus as an example of an information processing apparatus, and can be widely applied to other systems and apparatuses.

  In the first and second embodiments, the actual MFP 1 is used as the test environment. Needless to say, the test can be performed in an actual machine-less environment in the PC environment instead of the actual machine. For example, in a PC environment, an emulator that functions as a device equivalent to an engine or memory constituting the MFP is used. The engine emulator is software that emulates devices such as MFP scanners and plotters, and emulates command level sequence exchanges via the engine I / F. In addition, various device emulators such as a video driver that emulates image transfer, a memory driver that emulates the RAM memory possessed by the MFP, and an HDD driver that emulates the HDD can be mounted.

1 MFP
11 Operation unit (operation panel)
11a Input device 11b Display device 12 Storage media I / F
12a Drive device 12b Recording medium 13 Controller (part)
13a ROM
13b RAM
13c CPU
14 Data communication I / F
14a Interface device 15 Scanner 15a Image reading device 16 Plotter 16a Printing device 17 HDD
DESCRIPTION OF SYMBOLS 20 Automatic test execution part 21 Operation signal acquisition part 22 Screen image acquisition part 23 Storage instruction | indication part 24 Operation signal input part 25 Comparison determination part 26 Test result report part 31 Operation signal interpretation part 32 Screen image interpretation part 33 Operation content input part 34 Storage Instructing section 35 Comparison determining section

JP 2009-116535 A

Claims (4)

An automatic test tool program that creates a test case, causes the test target software to execute the test case, and tests the reliability of the display screen displayed in accordance with the operation instruction.
A computer including at least an input unit, a display unit, and a storage unit,
An operation signal acquisition means for acquiring an operation signal input to the input unit;
First screen image acquisition means for acquiring a first screen image displayed on the display unit after the operation signal is input to the input unit;
Storage instruction means for storing the operation signal and the first screen image in a storage unit;
Also,
Operation signal input means for inputting the operation signal stored in the storage unit to the input unit;
A second screen image obtaining unit for obtaining a second screen image displayed on the display unit after an operation signal is input to the input unit by the operation signal input unit;
An automatic test tool program for functioning as comparison determination means for comparing and determining whether or not the first screen image and the second screen image match. An automatic test tool program that creates a test case, causes the test target software to execute the test case, and tests the reliability of the display screen displayed in accordance with the operation instruction.
A computer including at least an input unit, a display unit, and a storage unit,
An operation signal acquisition means for acquiring an operation signal input to the input unit;
First screen image acquisition means for acquiring a first screen image displayed on the display unit after the operation signal is input to the input unit;
First interpretation means for interpreting the operation signal into an operation content associated with the operation signal, and interpreting the first screen image into a first screen content indicated by the screen image;
Storage instruction means for storing the operation content and the first screen content in a storage unit;
Also,
Operation signal input means for inputting the operation content stored in the storage unit to the input unit;
A second screen image obtaining unit for obtaining a second screen image displayed on the display unit after an operation content is input to the input unit by the operation signal input unit;
Second interpretation means for interpreting the second screen image into the second screen content indicated by the screen image;
An automatic test tool program for functioning as a comparison determination means for comparing and determining whether or not the first screen content matches the second screen content. An automatic test method that creates a test case, executes the test case for the software to be tested, and tests the reliability of the display screen displayed in accordance with the operation instruction.
A computer including at least an input unit, a display unit, and a storage unit,
An operation signal acquisition procedure for acquiring an operation signal input to the input unit;
A first screen image acquisition procedure for acquiring a first screen image displayed on the display unit after the operation signal is input to the input unit;
A storage instruction procedure for storing the operation signal and the first screen image in a storage unit;
Also,
An operation signal input procedure for inputting the operation signal stored in the storage unit to the input unit;
A second screen image acquisition procedure for acquiring a second screen image displayed on the display unit after an operation signal is input to the input unit by the operation signal input procedure;
A comparison determination procedure for comparing and determining whether or not the first screen image and the second screen image match;
An automatic test method characterized by comprising: An automatic test method that creates a test case, executes the test case for the software to be tested, and tests the reliability of the display screen displayed in accordance with the operation instruction.
A computer including at least an input unit, a display unit, and a storage unit,
An operation signal acquisition procedure for acquiring an operation signal input to the input unit;
A first screen image acquisition procedure for acquiring a first screen image displayed on the display unit after the operation signal is input to the input unit;
A first interpretation procedure for interpreting the operation signal into an operation content associated with the operation signal, and interpreting the first screen image into a first screen content indicated by the screen image;
A storage instruction procedure for storing the operation content and the first screen content in a storage unit;
Also,
An operation signal input procedure for inputting the operation content stored in the storage unit to the input unit;
A second screen image acquisition procedure for acquiring a second screen image displayed on the display unit after the operation content is input to the input unit by the operation signal input procedure;
A second interpretation procedure for interpreting the second screen image into the second screen content indicated by the screen image;
A comparison determination procedure for comparing and determining whether or not the first screen content matches the second screen content.

Images