JP2011113491A - Evaluation system for screen transition, evaluation device and device to be inspected - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an evaluation system for a screen transition which can precisely evaluate a transition of a plurality of setting screens for setting functions, an evaluation device and a device to be inspected. <P>SOLUTION: The evaluation device transmits coordinate information of a pressed position on a display screen to the device to be inspected in accordance with an order of evaluation. When the device to be inspected receives the coordinate information of the pressed position on the display screen, the device to be inspected obtains identifying information of a third display screen to be shifted next from operating button information corresponding to the coordinate information of the pressed position and second display screen identifying information. Then, the device to be inspected transmits displaying screen information corresponding to the third display screen identifying information to the evaluation device. When the evaluation device receives the displaying screen information, the evaluation device compares and evaluates screen information for evaluation of the display screen to be shifted correspondingly to the transmitted coordinate information of the pressed position with the displaying screen information received from the device to be inspected. Then, the evaluation device stores the compared and evaluated result. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a screen transition evaluation system that evaluates transition of an operation screen displayed on a display device equipped with a touch panel.

  In recent years, various devices have been proposed in which a mode selection screen and various function setting screens are switched by pressing on an operation screen displayed on a display device equipped with a touch panel.

  For example, there is an image forming apparatus configured to detect a finger size pressed on a touch panel and set a reaction area size within an input range displayed on a display screen according to the detection result (for example, (See Patent Document 1). In such an image forming apparatus, even when a plurality of input ranges are displayed adjacent to each other on the display screen, the user can perform an intended input operation.

JP 2000-357045 A

  However, in the image forming apparatus described in Patent Document 1 described above, when evaluating a mode selection screen or a switching screen of various function setting screens in the development design stage, the evaluator visually checks based on a checklist. It is necessary to confirm by pressing the touch panel with a finger. For this reason, there is a problem that the evaluator may miss a display screen or overlook a defect.

  Therefore, the present invention has been made to solve the above-described problems, and a screen transition evaluation system, an evaluation apparatus, and a device that can accurately evaluate transitions of a plurality of setting screens for function setting and the like. An object is to provide an apparatus to be inspected.

  In order to achieve the object, the screen transition evaluation system according to claim 1 includes a display means for switching and displaying a display screen, a pressed position detecting means for detecting a pressed position on the display screen of the display means, and the pressed position. A coordinate information acquisition unit that acquires coordinate information of a pressed position detected by the detection unit; and an evaluation device connected to the device to be inspected so as to be capable of two-way communication. Includes an evaluation procedure storage unit that stores a predetermined order of evaluation, an operation coordinate storage unit that stores coordinate information of a pressed position corresponding to the first display screen identification information stored in the evaluation procedure storage unit, Screen information storage means for storing evaluation screen information corresponding to the first display screen identification information; and coordinate information transmission means for transmitting the coordinate information of the pressed position to the device to be inspected. The apparatus to be inspected receives the image information storage means for storing display screen information corresponding to the second display screen identification information and the coordinate information of the pressed position from the coordinate information transmission means. Coordinate information specifying means for specifying both the operation button information corresponding to the coordinate information and the second display screen identification information, the operation button information specified by the coordinate information specifying means, and the second display screen identification information Screen information acquisition means for acquiring the transitional third display screen identification information, and acquiring the display screen information stored in the image information storage means from the acquired third display screen identification information; and the screen information Screen information transmission means for transmitting the display screen information acquired by the acquisition means to the evaluation device, and the evaluation device, when receiving the display screen information, Evaluation means for comparing and evaluating the evaluation screen information of the display screen that changes in response to the coordinate information of the pressed position transmitted via the coordinate information transmission means and the received display screen information, and evaluation by the evaluation means And an evaluation result storage means for storing the evaluated result.

  In the screen transition evaluation system according to the first aspect, the evaluation device transmits the coordinate information of the pressed position on the display screen to the device under test according to the order of evaluation. In addition, when receiving the coordinate information of the pressed position on the display screen, the device under test receives the first transition from the operation button information corresponding to the coordinate information of the pressed position and the second display screen identification information. 3. Acquire display screen identification information. Then, the inspected device transmits display screen information corresponding to the third display screen identification information to the evaluation device.

  When the display device receives the display screen information, the evaluation device displays the evaluation screen information of the display screen that transitions in accordance with the coordinate information of the transmitted pressed position and the display screen information received from the device under test. Compare and evaluate. Then, the evaluation device stores the evaluation result of the comparative evaluation.

  Accordingly, it is possible to accurately evaluate the transition of the display screen of the device under test by the evaluation device instead of the evaluation method in which the evaluator visually confirms the transition of the setting screen by pressing the touch panel with a finger. At the same time, the evaluation time can be shortened. In addition, the developer of the inspected device can easily analyze the display screen switching operation failure by examining the evaluation result stored in the evaluation device, and the development design period of the inspected device Can be shortened.

It is the block diagram which showed the screen transition evaluation system which concerns on a present Example. It is a figure which shows an example of the evaluation scenario table stored in evaluation scenario DB. It is a figure which shows an example of the operation coordinate table stored in operation coordinate DB. It is a figure which shows an example of the evaluation apparatus side components table stored in image component DB for evaluation. It is a figure which shows an example of the evaluation result table stored in evaluation result DB. It is a figure which shows an example of the operation button table stored in operation button DB. It is a figure which shows an example of the transition screen table stored in transition screen DB. It is a figure which shows an example of the MFP side components table stored in image component DB. 5 is a flowchart showing a “screen transition evaluation process” executed by the CPU of the evaluation apparatus and a “setting screen switching process” executed by the CPU of the MFP. 10 is a sub-flowchart showing a sub-process of “image component comparison process” in FIG. 9. It is a figure which shows an example of the image components of a setting screen, and its arrangement position. It is a figure which shows an example of the evaluation result displayed on the liquid crystal display of an evaluation apparatus.

  Hereinafter, based on one Example which actualized the transition screen evaluation system concerning the present invention, it explains in detail, referring to drawings.

[Schematic configuration of transition screen evaluation system]
A schematic configuration of the transition screen evaluation system 1 according to the present embodiment will be described with reference to FIG.
As shown in FIG. 1, a transition screen evaluation system 1 according to the present embodiment includes an evaluation device 2 composed of a personal computer or the like, and a multiplicity of devices as an example of an inspection device connected to the evaluation device 2 via a USB cable. And a functional peripheral device (hereinafter referred to as “MFP (Multi Function Peripheral)”) 3.

  The MFP 3 has various functions such as a telephone function, a facsimile function, a PC print function, a media print function, a scanner function, and a copy function. It is connected to the line network 55.

First, a schematic configuration of the evaluation device 2 constituting the transition screen evaluation system 1 will be described.
The evaluation device 2 is used to connect external devices such as the CPU 11, RAM 12, ROM 13, timer 14 for measuring time, input / output port 15, liquid crystal display (LCD) 21, operation unit 22, data recording unit 23, and MFP 3. A USB interface 25 and the like are provided.

  The CPU 11, RAM 12, ROM 13, timer 14, and input / output port 15 are connected to each other via a bus line 17 and exchange data with each other. Further, the liquid crystal display 21, the operation unit 22, the data recording unit 23, and the USB interface 25 are connected to the bus line 17 via the input / output port 15.

  The ROM 13 stores various programs, and a “screen transition evaluation process” for evaluating transitions of a plurality of setting screens for function setting displayed on a liquid crystal display (LCD) 43 of the MFP 3 described later (FIG. 9) is stored. The CPU 11 performs various calculations and controls based on various programs stored in the ROM 13.

  The RAM 12 is for temporarily storing various calculation results and parameters calculated by the CPU 11. Further, the RAM 12 is provided with a scenario ID storage area 12A for storing a “scenario ID” described later and an execution order storage area 12B for storing an “execution order” described later (see FIG. 9).

  The operation unit 22 includes a keyboard, a mouse, and the like, and starts execution of “screen transition evaluation processing” that evaluates transitions of a plurality of setting screens for setting functions of the MFP 3, and performs analysis of evaluation results. Operated. Then, the CPU 11 performs control to execute various corresponding operations based on the signal input from the operation unit 22. The operation unit 22 can also be configured by a touch panel provided on the front surface of the liquid crystal display 21.

  The data recording unit 23 includes an external storage device and a hard disk (not shown) as a storage medium, and a driver for reading a predetermined program stored in the hard disk and writing predetermined data to the hard disk. The hard disk also includes an evaluation scenario database (evaluation scenario DB) 23A, an operation coordinate database (operation coordinate DB) 23B, an evaluation image component database (evaluation image component DB) 23C, and an evaluation result database (evaluation result DB) 23D. Is stored. Also, the hard disk stores in advance the bitmap data of each of a plurality of image parts constituting the setting screen for setting each function.

  This evaluation scenario DB 23A stores an evaluation scenario table 61 (see FIG. 2) described later. The operation coordinate DB 23B stores an operation coordinate table 62 (see FIG. 3) described later. The evaluation image component DB 23C stores an evaluation device side component table 63 (see FIG. 4) described later. The evaluation result DB 23D stores an evaluation result table 64 (see FIG. 5) described later.

  The data recording unit 23 transmits and receives data to and from the MFP 3 and external electronic devices in addition to various operating systems (OS) such as MS-DOS (registered trademark) and Windows (registered trademark) systems. A communication protocol, a browser, word processor software executable by the OS, and various application software are stored as necessary.

Next, a schematic configuration of the MFP 3 constituting the transition screen evaluation system 1 will be described.
The MFP 3 includes a CPU 31, a RAM 32, a ROM 33, an input / output port 35, a memory card slot 41, operation keys 42, a liquid crystal display (LCD) 43, a touch panel 44 mounted on the surface of the liquid crystal display 43, a clock circuit 45, a scanner 46, and a printer. 47, a USB interface 48 for connecting an external device such as the evaluation device 2, a transmitter / receiver 51, an NCU 52, a modem 53, and the like.

  The CPU 31, RAM 32, ROM 33, and input / output port 35 are connected to each other by a bus line 37 to exchange data with each other. Further, the memory card slot 41, the operation key 42, the liquid crystal display 43, the touch panel 44, the clock circuit 45, the scanner 46, the printer 47, the USB interface 48, the handset 51, the NCU 52, and the modem 53 are input / output with respect to the bus line 37. They are connected to each other via a port 35.

  The ROM 33 stores various programs, and stores various programs such as a “setting screen switching process” (see FIG. 9) executed when coordinate information is received from the evaluation apparatus 2 described later. . The CPU 11 performs various calculations and controls based on various programs stored in the ROM 33. The RAM 32 is for temporarily storing various calculation results and parameters calculated by the CPU 31. Further, the RAM 32 is provided with a screen ID storage area 32A for storing a “screen ID” described later (see FIG. 9).

  The ROM 33 stores an operation button database (operation button DB) 33A, a transition screen database (transition screen DB) 33B, and an image component database (image component DB) 33C. This operation button DB 33A stores an operation button table 71 (see FIG. 6) described later. The transition screen DB 33B stores a transition screen table 72 (see FIG. 7) described later.

  The image component DB 33C stores an MFP-side component table 73 (see FIG. 8) described later. Further, the setting screen for setting each function displayed on the liquid crystal display 43 is composed of a plurality of image parts. In the ROM 33, bitmap data of each of the plurality of image parts constituting each setting screen is stored. Stored in advance.

The ROM 33 stores a real-time OS and control program for controlling the MFP 3 as necessary.
The memory card slot 41 is configured such that a memory card 41A such as an SD card (registered trademark) or a memory stick (registered trademark) can be inserted. The user can also select the image data stored in the memory card 41A inserted in the memory card slot 41, print it by the printer 47, and store the image data read by the scanner 46.

  The operation key 42 is provided with various buttons such as a numeric button for inputting a telephone number when the telephone function or the facsimile function is used, and a power button for turning on / off the MFP 3. On the liquid crystal display 43, a setting screen (see FIG. 11) for setting a function to be executed by the user is displayed, an operation procedure and a status of a process being executed are displayed, and a setting screen for function setting is displayed. In response to the touch panel 44 being pressed, the screen is switched to the next setting screen.

  The touch panel 44 is a transparent panel-like touch switch mounted on the surface of the liquid crystal display 43, and inputs various instruction commands by pressing an operation button or the like displayed on the screen of the liquid crystal display 43. Is configured to be possible. Note that the touch panel 44 may be configured by an optical sensor liquid crystal system that directly presses the screen of the liquid crystal display 43.

  The clock circuit 45 is a known circuit having a clock function for marking the current date and time. The scanner 46 reads an image on a document paper surface placed on a placement glass plate (not shown) by a document reading sensor (not shown) disposed below the placement glass plate. Further, the read image data is stored in a predetermined storage area in the RAM 32.

  The printer 47 is configured by a so-called ink jet printer disposed inside the casing, and includes a print head that uses four colors of ink of C (cyan), M (magenta), Y (yellow), and K (black), and paper feed. Device, and a recovery device, which performs color printing of images on recording paper. The handset 51 is used when the user uses the telephone function to make a call with an external device connected via the telephone line network 55. When not talking, the handset 51 is placed on a mounting table (not shown) provided with a hook (not shown), and is picked up from the mounting table and used during a call.

  The NCU 52 is connected to the telephone line network 55 and controls the transmission of a dial signal to the telephone line network 55 and the response of a call signal from the telephone line network 55. The modem 53 modulates the image data instructed to be transmitted by the facsimile function into a signal that can be transmitted to the telephone line network 55 and transmits it via the NCU 52, or a signal input from the telephone line network 55 via the NCU 52. Is demodulated into image data that can be displayed on the liquid crystal display 43 and image data that can be recorded by the printer 47.

  Next, an example of the evaluation scenario table 61 stored in the evaluation scenario DB 23A of the evaluation device 2 will be described with reference to FIG. The evaluation scenario table 61 stores the order in which a plurality of setting screens for function setting displayed on the liquid crystal display 43 of the MFP 3 are evaluated.

As shown in FIG. 2, the evaluation scenario table 61 includes “scenario ID”, “execution order”, “screen ID”, and “operation button”.
This “scenario ID” is an identification number assigned for each series of operations for setting one function by pressing on each operation button on the setting screen displayed on the liquid crystal display 43 of the MFP 3. Identification numbers are stored in accordance with the evaluation order of a series of operations.

  For example, when first evaluating a setting screen (see FIG. 11) for initial setting of parameters such as “date and time”, “language used”, and “document style” to be printed, “date and time” An identification number of “1” is assigned as a “scenario ID” to a series of operations for setting “.”. Further, an identification number “2” is assigned as a “scenario ID” to a series of operations for setting “use language”, and “3” is set as a “scenario ID” for a series of operations for setting “document style”. Identification numbers are assigned and stored in order.

  The “execution order” is an order in which each operation of a series of operations for setting the function is executed for each “scenario ID”, and an execution order number is stored. For example, an execution order from “1” to “5” is stored in a series of operations for setting “date and time” assigned “1” as “scenario ID”. That is, the setting of “date and time” can be set by operating the setting screen in five stages.

  The “screen ID” is an identification number assigned to the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3. The screen of the setting screen displayed on the liquid crystal display 43 corresponding to each execution order. ID is stored. The “operation button” is an operation button to be pressed on the setting screen for setting each function, and stores an operation button to be pressed on the setting screen corresponding to each execution order.

  Next, an example of the operation coordinate table 62 stored in the operation coordinate DB 23B of the evaluation device 2 will be described with reference to FIG. In the operation coordinate table 62, coordinate information representing the pressed position on the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 is stored. As shown in FIG. 3, the operation coordinate table 62 is composed of “screen ID”, “operation button”, and “pressed coordinate position”.

  In this “screen ID”, an identification number assigned to the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 is stored. The “operation button” stores an operation button to be pressed on the setting screen for function setting corresponding to “screen ID”. In the “pressed coordinate position”, coordinate information of the pressed position on the display screen of the liquid crystal display 43 of the MFP 3, that is, coordinate information of the pressed position on the touch panel is stored. The origin (0, 0) is set in the upper left corner of the display screen of the liquid crystal display 43, the X axis is set in the right direction, and the Y axis is set in the lower direction.

  Next, an example of the evaluation device side component table 63 stored in the evaluation image component DB 23C of the evaluation device 2 will be described with reference to FIG. The evaluation device side component table 63 has the same configuration as the MFP side component table 73 described later, and information on the image components constituting each setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 and the arrangement position thereof. The coordinate information to represent is stored.

  As illustrated in FIG. 4, the evaluation device side component table 63 stores “screen ID” and a plurality of combinations of “component ID” and “display position” corresponding to each “screen ID”. In this “screen ID”, an identification number assigned to the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 is stored. Further, the “component ID” stores an identification number assigned to each image component constituting the function setting setting screen corresponding to the “screen ID”.

  Further, the “display position” stores coordinate information indicating an arrangement position on the display screen of the liquid crystal display 43 of the image component to which the “component ID” is assigned. The “display position” is stored as coordinate information in which any one of the four corners of each image component or a center position of each image component is arranged.

Next, an example of the evaluation result table 64 stored in the evaluation result DB 23D of the evaluation device 2 will be described with reference to FIG. The evaluation result table 64 stores the evaluation result of the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3.
As shown in FIG. 5, the evaluation result table 64 includes “scenario ID”, “execution order”, “result”, and “received data”.

  The “scenario ID” and “execution order” correspond to the “scenario ID” and “execution order” constituting the evaluation scenario table 61. The “result” includes the evaluation result of the image component information (see FIG. 9) received from the MFP 3 as described later corresponding to the “scenario ID” and “execution order” constituting the evaluation scenario table 61. Pass / fail is stored. That is, in “Result”, “◯” is stored when the evaluation result of the image component information received from the MFP 3 is acceptable, and “X” is stored when the evaluation result is unacceptable.

  Further, the received image component information is stored in the “reception data” only when the evaluation result of the image component information received from the MFP 3 fails. Thereby, the data capacity of the evaluation result table 64 can be reduced. Regardless of the evaluation result of the image component information received from the MFP 3, the image component information received from the MFP 3 corresponding to the “scenario ID” and “execution order” constituting the evaluation scenario table 61 is “received data”. You may make it memorize | store in each.

Next, an example of the operation button table 71 stored in the operation button DB 33A of the MFP 3 will be described with reference to FIG. In this operation button table 71, the touch panel 44 on the display screen set in advance can be detected for each operation button provided on each setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3. An area is stored.
As shown in FIG. 6, the operation button table 71 includes “screen ID”, “lower left coordinates”, “upper left coordinates”, “lower right coordinates”, “upper right coordinates”, and “operation buttons”. It is configured.

  In this “screen ID”, an identification number assigned to the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 is stored. In addition, for “lower left coordinates”, “upper left coordinates”, “lower right coordinates”, and “upper right coordinates”, a display screen set in advance for each operation button on the setting screen corresponding to “screen ID”. The coordinate information of the lower left corner, the upper left corner, the lower right corner, and the upper right corner of the rectangular detectable region of the upper touch panel 44 is stored. The “operation button” includes a rectangular detectable region of the touch panel 44 on the display screen determined by each coordinate information of “lower left coordinates”, “upper left coordinates”, “lower right coordinates”, and “upper right coordinates”. The type of operation button corresponding to is stored.

Next, an example of the transition screen table 72 stored in the transition screen DB 33B of the MFP 3 will be described with reference to FIG. This transition screen table 72 stores a setting screen for function setting that transitions when each operation button provided on each setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 is pressed. Has been.
As shown in FIG. 7, the transition screen table 72 includes “screen ID”, “operation button”, and “transition screen ID”.

  In this “screen ID”, an identification number assigned to the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 is stored. The “operation button” stores the type of operation button on the setting screen for function setting corresponding to “screen ID”. In addition, the “transition screen ID” includes an identification number given to the setting screen for the function transition that transitions next when the operation button on the setting screen displayed on the liquid crystal display 43 of the MFP 3 is pressed. It is remembered.

  Next, an example of the MFP-side component table 73 stored in the image component DB 33C of the MFP 3 will be described with reference to FIG. The MFP-side component table 73 has the same configuration as the evaluation device-side component table 63 described above, and information on the image components constituting each setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 and the arrangement position thereof. The coordinate information to represent is stored.

  As illustrated in FIG. 8, the MFP-side component table 73 stores “screen ID” and a plurality of combinations of “component ID” and “display position” corresponding to each “screen ID”. In this “screen ID”, an identification number assigned to the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 is stored. Further, the “component ID” stores an identification number assigned to each image component constituting the function setting setting screen corresponding to the “screen ID”.

  Further, the “display position” stores coordinate information indicating an arrangement position on the display screen of the liquid crystal display 43 of the image component to which the “component ID” is assigned. The “display position” is stored as coordinate information in which any one of the four corners of each image component or a center position of each image component is arranged.

  Next, in the screen transition evaluation system 1 configured as described above, “screen transition evaluation processing” executed by the CPU 11 of the evaluation apparatus 2 and “setting screen switching processing” executed by the CPU 31 of the MFP 3 are shown in FIGS. 12 will be described.

[Screen transition evaluation process]
First, the “screen transition evaluation process” executed by the CPU 11 of the evaluation device 2 will be described with reference to FIG.
As shown in FIG. 9, in step (hereinafter abbreviated as S) 11, the CPU 11 waits for an instruction to start evaluation (S11: NO). Specifically, the CPU 11 waits for the pointer to move on an evaluation start button (not shown) displayed on the display screen of the liquid crystal display 21 and the left button of the mouse constituting the operation unit 22 to be clicked. When an instruction to start evaluation is input (S11: YES), the CPU 11 proceeds to the process of S12.

In S12, the CPU 11 reads the scenario ID from the scenario ID storage area 12A, substitutes “1” for this scenario ID, and stores it again in the scenario ID storage area 12A. That is, the CPU 11 initializes the scenario ID.
Subsequently, in S <b> 13, the CPU 11 reads the execution order from the execution order storage area 12 </ b> B, assigns “1” to the execution order, and stores it in the RAM 12 again. That is, the CPU 11 initializes the execution order.

  In S <b> 14, the CPU 11 reads out the scenario ID and the execution order from the storage areas 12 </ b> A and 12 </ b> B of the RAM 12, and sets the corresponding “screen ID” as “scenario ID” and “execution order” in the evaluation scenario table 61. And “operation button” data. Then, the CPU 11 stores each data of “screen ID” and “operation button” read from the evaluation scenario table 61 in the RAM 12 as data for acquiring the pressed coordinate position.

  After that, in S15, the CPU 11 reads out the “screen ID” and “operation button” data stored as the pressed coordinate position acquisition data from the RAM 12, and stores them as “screen ID” and “operation button” in the operation coordinate table 62, respectively. As a result, the corresponding “pressed coordinate position” data is read out. Then, the CPU 11 stores the “pressed coordinate position” data read from the operation coordinate table 62 in the RAM 12 as coordinate information to be transmitted to the MFP 3.

  In step S <b> 16, the CPU 11 reads the “pressed coordinate position” data stored as coordinate information to be transmitted to the MFP 3 from the RAM 12 and transmits the data to the MFP 3 via the USB interface 25.

  Subsequently, in S <b> 17, the CPU 11 waits to receive image component information as display screen information from the MFP 3 via the USB interface 25 (S <b> 17: NO). As will be described later, the image component information includes each image of the setting screen for function setting displayed on the liquid crystal display 43 of the MFP 3 in response to the “pressed coordinate position” data transmitted by the CPU 11. It is composed of a component ID of the component and arrangement position coordinate information indicating the display position of each image component.

  If image component information as display screen information is received from the MFP 3 via the USB interface 25 (S17: YES), the CPU 11 proceeds to the process of S18. In S <b> 18, the CPU 11 executes a sub-process (see FIG. 10) of “image part comparison process” described later.

  After that, in S19, the CPU 11 reads the execution order from the execution order storage area 12B, adds “1” to the execution order, and stores it again in the execution order storage area 12B. That is, the CPU 11 updates the execution order. Subsequently, in S20, the CPU 11 reads out the scenario ID and the execution order from each of the storage areas 12A and 12B of the RAM 12, and sets them as “scenario ID” and “execution order” in the evaluation scenario table 61, respectively. ”And“ execution order ”are determined.

If it is determined that the scenario ID read from each storage area 12A, 12B of the RAM 12 and the “scenario ID” and “execution order” corresponding to the execution order are in the evaluation scenario table 61 (S20: YES), the CPU 11 Performs again the processing after S14.
On the other hand, if it is determined that the scenario ID read from each storage area 12A, 12B of the RAM 12 and the “scenario ID” and “execution order” corresponding to the execution order are not in the evaluation scenario table 61 (S20: NO), the CPU 11 Shifts to the processing of S21.

In S21, the CPU 11 reads the scenario ID from the scenario ID storage area 12A, adds “1” to the scenario ID, and stores it again in the scenario ID storage area 12A. That is, the CPU 11 updates the scenario ID.
Subsequently, in S <b> 22, the CPU 11 reads out the scenario ID from the scenario ID storage area 12 </ b> A, and determines whether there is a corresponding “scenario ID” using this scenario ID as the “scenario ID” of the evaluation scenario table 61. Execute.

If it is determined that the “scenario ID” corresponding to the scenario ID read from the scenario ID storage area 12A is in the evaluation scenario table 61 (S22: YES), the CPU 11 executes the processes after S13 again. .
On the other hand, when it is determined that the “scenario ID” corresponding to the scenario ID read from the scenario ID storage area 12A does not exist in the evaluation scenario table 61 (S22: NO), the CPU 11 proceeds to the process of S23.

  In S <b> 23, the CPU 11 displays the evaluation results of the transition of a plurality of setting screens for function setting displayed on the liquid crystal display 43 of the MFP 3 on the liquid crystal display 21 (see FIG. 12), and ends the processing.

[Setting screen switching process]
Next, the “setting screen switching process” executed when the CPU 31 of the MFP 3 is activated will be described with reference to FIG.
As shown in FIG. 9, in S111, the CPU 31 reads the screen ID from the screen ID storage area 32A, substitutes “1” for this screen ID, and stores it again in the screen ID storage area 32A. That is, the CPU 31 initializes the screen ID. Then, the CPU 31 reads the screen ID from the screen ID storage area 32 </ b> A and sets this screen ID as “screen ID” in the MFP-side component table 73.

  Then, the CPU 31 reads a plurality of combinations of “component ID” and “display position” corresponding to this “screen ID” from the MFP-side component table 73. Thereafter, the CPU 31 reads out the bitmap data of the image component corresponding to each “component ID” from the ROM 33, arranges them at the coordinate position of “display position” on the display screen, and displays them on the liquid crystal display 43. That is, the CPU 31 displays on the liquid crystal display 43 an initial setting screen at startup, that is, a function setting setting screen with “screen ID” “1” (see FIG. 11).

  Subsequently, in S112, the CPU 31 waits to receive coordinate information, that is, data of “pressed coordinate position” from the evaluation apparatus 2 via the USB interface 48 (S112: NO). When coordinate information, that is, data of “pressed coordinate position” is received from the evaluation device 2 via the USB interface 48 (S112: YES), the CPU 31 stores the received coordinate information in the RAM 32, and then performs S113. Move on to processing.

In S113, the CPU 31 reads the screen ID from the screen ID storage area 32A. That is, the CPU 31 reads the “screen ID” of the setting screen for function setting currently displayed on the liquid crystal display 43 from the screen ID storage area 32A.
In S114, the CPU 31 sets the screen ID read from the screen ID storage area 32A as the “screen ID” of the operation button table 71. Further, the CPU 31 reads out the coordinate information received from the evaluation device 2 from the RAM 32.

  Subsequently, the CPU 31 detects each rectangular detectable area determined by “lower left coordinates”, “upper left coordinates”, “lower right coordinates”, and “upper right coordinates” of the operation button table 71 corresponding to the “screen ID”. Then, a detectable region including the coordinate position specified by the received coordinate information is extracted. Then, the CPU 31 reads out “operation button” data corresponding to the extracted detectable region from the operation button table 71 and stores it in the RAM 32 as the type of operation button on which the touch panel 44 on the display screen is pressed.

  Subsequently, in S115, the CPU 31 reads out the screen ID from the screen ID storage area 32A, and also reads out the type of the operation button on which the touch panel 44 is pressed from the RAM 32, and stores them as “screen ID”, “ Operation button ". Then, the CPU 31 reads the corresponding “transition screen ID” data and stores it in the RAM 32 as “transition setting screen ID”. That is, the CPU 31 obtains the screen ID of the function setting setting screen to be changed next.

  In S 116, the CPU 31 reads “screen ID of the transition setting screen” from the RAM 32 and sets it as “screen ID” in the MFP-side component table 73. Then, the CPU 31 reads out a plurality of combinations of “component ID” and “display position” corresponding to this “screen ID” from the MFP-side component table 73 and stores them in the RAM 32 as image component information of the setting screen to be changed next. To do.

  Subsequently, in S <b> 117, the CPU 31 reads out the image component information of the setting screen to be next transitioned from the RAM 32. Then, the CPU 31 reads out the bitmap data of the image component corresponding to each “component ID” constituting the image component information of the setting screen to be transitioned next from the ROM 33, and sets them to the coordinate position of “display position” on the display screen. It is arranged and displayed on the liquid crystal display 43.

Here, an example of a function setting screen displayed on the liquid crystal display 43 will be described with reference to FIG.
As shown in FIG. 11, the setting screen whose “screen ID” is “1” is a setting screen for initial setting of various parameters. The image component 81 for the “Date & Time button” and the image component 82 for the “Local Language button”. , An image component 83 of “Initial Set button”, an image component 84 of “scroll button”, an image component 85 of “return button”, and the like.

  The “Date & Time button” is an operation button for instructing start of setting “date and time”. The “Local Language button” is an operation button for instructing start of setting of the “use language”. The “Initial Set button” is an operation button for instructing start of setting of a “document style” to be printed. The “scroll button” allows the user to input an instruction to scroll down and scroll up each operation button displayed in the upper and lower three tiers by pressing the upper button or the lower button. In addition, when the “return button” is pressed, the state before the last operation can be restored.

  In addition, the setting screen with “screen ID” “2” has an image component 91 of “Back button”, an image component 92 of “Year display column” for displaying the year input from the numeric keypad, and “1” constituting the numeric keypad. ~ "0" button image parts 93 to 102, "correction button" image part 103 that deletes the last input number of the number displayed in the "year display column" one character at a time, "OK button to confirm the input" The image part 104 of “.

  In addition, the setting screen with “screen ID” “3” has almost the same configuration as the setting screen with “screen ID” “2”, but it is input from the numeric keypad instead of the image component 92 in the “year display column”. The image part 106 of the “month display column” for displaying the calendar month is displayed. The setting screen with “screen ID” “4” has almost the same configuration as the setting screen with “screen ID” “3”, but it is input from the numeric keypad instead of the image part 106 of “month display column”. An image part 107 of a “date display field” for displaying the date of the calendar is displayed.

  In addition, the setting screen with “screen ID” “5” has almost the same configuration as the setting screen with “screen ID” “4”, but it is input from the numeric keypad instead of the image part 107 of “date display field”. An image component 108 in the “time display field” for displaying the displayed time is displayed.

  Then, as shown in FIG. 9, in S118, the CPU 31 reads out the screen ID from the screen ID storage area 32A, reads out the “screen ID of the transition setting screen” from the RAM 32, and sets “transition setting” to this screen ID. The “screen ID of the screen” is substituted and stored again in the screen ID storage area 32A. That is, the CPU 31 stores the “screen ID” given to the setting screen for function setting currently displayed on the liquid crystal display 43 in the screen ID storage area 32A.

  After that, in S119, the CPU 31 reads again the image part information of the setting screen that transitions next from the RAM 32, transmits the image part information of the setting screen that transitions next to the evaluation device 2 via the USB interface 48, and then again. , S112 and subsequent processes are executed. That is, the CPU 31 transmits the image component information on the setting screen for function setting currently displayed on the liquid crystal display 43 to the evaluation device 2 through the USB interface 48, and then executes the processing from S112 again.

[Image parts comparison processing]
Next, sub processing of “image component comparison processing” executed by the CPU 11 in S18 will be described with reference to FIG.
As shown in FIG. 10, in S <b> 211, the CPU 11 stores image component information received from the MFP 3 via the USB interface 25 in the RAM 12 as MFP-side image component information.

  In S212, the CPU 11 reads the scenario ID and the execution order from the storage areas 12A and 12B of the RAM 12. Then, the CPU 11 sets this scenario ID as the “scenario ID” of the evaluation scenario table 61, and sets the numerical value obtained by adding “1” to the execution order as the “execution order” of the evaluation scenario table 61. Is stored in the RAM 12 as the “screen ID” in the next execution order.

  Thereafter, in S <b> 213, the CPU 11 reads the “screen ID” in the next execution order from the RAM 12. Then, the CPU 11 uses this “screen ID” as the “screen ID” in the evaluation device side component table 63, reads out a plurality of combinations of “component ID” and “display position” corresponding to this “screen ID”, and evaluates them. It is stored in the RAM 12 as device-side image component information.

  Subsequently, in S214, the CPU 11 reads out the MFP-side image component information and the evaluation device-side image component information from the RAM 12, and determines whether the MFP-side image component information matches the evaluation device-side image component information. Execute. If it is determined that the MFP-side image component information matches the evaluation-device-side image component information (S214: YES), the CPU 11 proceeds to the process of S215.

  In S215, the CPU 11 reads the scenario ID and the execution order from the storage areas 12A and 12B of the RAM 12. Then, the CPU 11 stores the read scenario ID in “scenario ID” of the evaluation result table 64 and stores the read execution order in “execution order” of the evaluation result table 64. Further, the CPU 11 stores in the “result” of the evaluation result table 64 “◯” indicating that the MFP-side image component information and the evaluation apparatus-side image component information match, that is, that the evaluation result has passed.

  Thereafter, the CPU 11 returns to the main flowchart and proceeds to the process of S19. Therefore, the CPU 11 stores nothing in the “reception data” of the evaluation result table 64. The CPU 11 may store “0” in “reception data” of the evaluation result table 64.

  On the other hand, when it is determined that the MFP-side image component information and the evaluation apparatus-side image component information do not match (S214: NO), the CPU 11 proceeds to the process of S216. In S216, the CPU 11 reads the scenario ID and the execution order from the storage areas 12A and 12B of the RAM 12. Then, the CPU 11 stores the read scenario ID in “scenario ID” of the evaluation result table 64 and stores the read execution order in “execution order” of the evaluation result table 64.

  In addition, the CPU 11 stores “x” indicating that the MFP-side image component information and the evaluation apparatus-side image component information do not match, that is, that the evaluation result is unacceptable, in the “result” of the evaluation result table 64. . In addition, the CPU 11 reads MFP-side image component information from the RAM 12 and stores it in “reception data” of the evaluation result table 64. Thereafter, the CPU 11 returns to the main flowchart and proceeds to the process of S19.

  Here, an example in which the rejected evaluation result is displayed on the liquid crystal display 21 in S23 will be described with reference to FIG. If all the evaluation results of the transition of the plurality of setting screens for function setting are acceptable, the CPU 11 may display “pass” on the liquid crystal display 21.

  First, the CPU 11 sequentially reads the “result” data stored in the evaluation result table 64. As shown in FIG. 5, when “x” data indicating failure is stored in “result”, “scenario ID” corresponding to “failure” “result” is “1”, Each data of “execution order” is “5” and “reception data” is “112, (X91, Y91), 18, (X72, Y72), 20,... Store in the RAM 12.

  Further, the CPU 11 sets the “scenario ID” as “1” and the “execution order” as “5” as the “scenario ID” and “execution order” in the evaluation scenario table 61, and the corresponding “screen ID” and “operation button”. "5" and "OK button" are read out and stored in the RAM 12 as rejected image part information. Further, the CPU 11 sets “5” of the “screen ID” as the “screen ID” of the evaluation device side component table 63, and a plurality of combinations of “component ID” and “display position” corresponding to this “screen ID”. Are stored in the RAM 12 as evaluation screen information.

  Then, the CPU 11 reads the evaluation screen information and the rejected image component information from the RAM 12. Then, the CPU 11 reads out the bitmap data of the image component corresponding to each “component ID” constituting the evaluation screen information from the data recording unit 23 and arranges each at the coordinate position of “display position” on the display screen. The setting screen for “time” setting with “screen ID” “5” is displayed as “correct answer screen”.

  Further, the CPU 11 reads out the bitmap data of the image component corresponding to each “component ID” constituting the rejected image component information from the data recording unit 23 and arranges each at the coordinate position of “display position” on the display screen. Then, a setting screen for “date” setting is displayed as an “MFP display screen”. That is, the CPU 11 displays a setting screen with “screen ID” “4” as an “MFP display screen”. Further, the CPU 11 displays “Scenario ID” as “1”, “Execution Order” as “5”, “Screen ID” as “5”, “Operation Procedure” as “OK Button”, and “Result” column. “Fail” is displayed on the screen.

  As described above in detail, in the screen transition evaluation system 1 according to the present embodiment, the CPU 11 of the evaluation apparatus 2 coordinates the pressed position on the display screen of the liquid crystal display 43 according to the evaluation order stored in the evaluation scenario table 61. Information is transmitted to the MFP 3. Further, the CPU 31 of the MFP 3 obtains “transition screen ID” next from the received coordinate information of the pressed position and “screen ID” of the setting screen displayed on the liquid crystal display 43.

  Then, the CPU 31 of the MFP 3 uses the “transition screen ID” as the “screen ID” in the MFP-side component table 73 and sequentially reads out the “component ID” and the “display position” corresponding to the “screen ID”. Then, the CPU 31 transmits the read combination data of “component ID” and “display position” to the evaluation apparatus 2 as image component information of the setting screen to be next transitioned. On the other hand, the CPU 11 of the evaluation device 2 sets the “screen ID” in the next execution order as the “screen ID” of the evaluation device-side component table 63 and sets the “component ID” and “display position” corresponding to this “screen ID”. Read sequentially.

  Then, the CPU 11 uses the combination data of the read “component ID” and “display position” as image device information on the evaluation apparatus side, and executes a comparative evaluation process for determining whether or not it matches the image component information received from the MFP 3. Then, the evaluation result is stored in the evaluation result table 64. Further, the CPU 11 displays the evaluation result on the liquid crystal display 21.

  As a result, instead of the evaluation method of confirming the transition of the setting screen displayed on the liquid crystal display 43 of the MFP 3 by visually pressing the touch panel 44 with a finger by the evaluator, the display screen of the liquid crystal display 43 is displayed by the evaluation device 2. As a result, it is possible to accurately evaluate the transition of the above and shorten the evaluation time. Further, a developer who develops a setting screen display program of the MFP 3 can examine the evaluation results stored in the evaluation result table 64 of the evaluation device 2. Accordingly, the developer can easily analyze the setting screen switching operation failure of the MFP 3 and the like, and the development design period of the setting screen display program of the MFP 3 can be shortened.

  The CPU 11 of the evaluation device 2 evaluates whether the combination data of “component ID” and “display position” read from the evaluation device-side component table 63 matches the image component information received from the MFP 3. As a result, the CPU 11 can accurately and quickly evaluate the transition of the setting screen displayed on the liquid crystal display 43 of the MFP 3, and can improve the accuracy of the evaluation and further shorten the evaluation time.

  In addition, this invention is not limited to the said Example, Of course, various improvement and deformation | transformation are possible within the range which does not deviate from the summary of this invention. For example, the following may be used.

  (A) For example, in S119, the CPU 31 may transmit bitmap data of the setting screen displayed on the liquid crystal display 43 in S117 to the evaluation device 2. In S <b> 214, the CPU 11 determines whether or not the bitmap data of the setting screen created by the evaluation device side image component information matches the bitmap data of the setting screen received from the MFP 3. Also good.

  (B) For example, the CPU 11 may return to the main flowchart after executing the process of S215 and shift to the process of S21. As a result, when the CPU 11 detects an unacceptable evaluation result, the CPU 11 can shift to the evaluation of the next “scenario ID”, and the evaluation time can be shortened.

  (C) For example, in S214, a determination process is executed only to determine whether or not the “component ID” of the MFP-side image component information matches the “component ID” of the evaluation-device-side image component information. May be. Thereby, it is possible to shorten the evaluation time.

  (D) For example, the evaluation device-side component table 63 may not be stored in advance in the evaluation image component DB 23C of the data recording unit 23 of the evaluation device 2. In S11, when an instruction to start evaluation is input (S11: YES), the CPU 11 instructs the MFP 3 to transmit the MFP-side component table 73 via the USB interface 25. Then, the CPU 11 receives the MFP-side component table 73 from the MFP 3, stores the MFP-side component table 73 as the evaluation device-side component table 63 in the evaluation image component DB 23C of the data recording unit 23, and then proceeds to the processing of S12. You may make it do.

  As a result, the evaluation device 2 does not need to store the evaluation device side component table 63 for each model of the MFP 3 in the evaluation image component DB 23C of the data recording unit 23, thereby reducing the storage capacity of the data recording unit 23. Can do.

  (E) For example, the evaluation apparatus 2 and a plurality of MFPs 3 are connected by a communication line network such as a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, a cellular phone line network, a telephone line network 55, etc. The two CPUs 11 may simultaneously evaluate a plurality of MFPs 3 in parallel.

  (F) For example, the CPU 11 of the evaluation device 2 fails if the “result” in the evaluation result table 64 indicates “failure” indicating a failure or not (for example, 3 or more). The “scenario ID”, “execution order”, “result”, and “reception data” may be transmitted to the MFP 3.

  When the CPU 31 of the MFP 3 receives the rejected “scenario ID”, “execution order”, “result”, and “reception data”, the printer 47 prints out the data. Good. Accordingly, the developer can quickly analyze the setting screen switching failure of the MFP 3 and the like, and can shorten the development design period of the display program for the setting screen of the MFP 3.

  (G) For example, coordinate information of a plurality of pressed positions on the operation button may be stored in “pressed coordinate position” of the operation coordinate table 62. And CPU11 may be made to perform the process of S16-S18, respectively with respect to each coordinate information of a pressing position. As a result, the CPU 11 can acquire an evaluation result with respect to variation in the pressed position of each operation button on the setting screen displayed on the liquid crystal display 43.

1 Screen transition evaluation system 2 Evaluation device 3 MFP
11, 31 CPU
12, 32 RAM
13, 33 ROM
23 Data recording unit 21, 43 Liquid crystal display 44 Touch panel 25, 48 USB interface 61 Evaluation scenario table 62 Operation coordinate table 63 Evaluation device side component table 64 Evaluation result table 71 Operation button table 72 Transition screen table 73 MFP side component table

Claims (7)

Display means for switching and displaying the display screen, a pressed position detecting means for detecting a pressed position on the display screen of the display means, and coordinate information acquisition for acquiring coordinate information of the pressed position detected by the pressed position detecting means Means to be inspected, and
An evaluation device connected to the device under test so as to be capable of bidirectional communication;
With
The evaluation device is
Evaluation procedure storage means for storing a predetermined order of evaluation;
Operation coordinate storage means for storing coordinate information of a pressed position corresponding to the first display screen identification information stored in the evaluation procedure storage means;
Screen information storage means for storing screen information for evaluation corresponding to the first display screen identification information;
Coordinate information transmitting means for transmitting coordinate information of the pressed position to the inspected device;
Have
The inspected device is:
Image information storage means for storing display screen information corresponding to the second display screen identification information;
When the coordinate information of the pressed position is received from the coordinate information transmission means, coordinate information specifying means for specifying both the operation button information according to the received coordinate information and the second display screen identification information;
From the operation button information specified by the coordinate information specifying means and the second display screen identification information, third transition display screen identification information is acquired, and the image information is obtained from the acquired third display screen identification information. Screen information acquisition means for acquiring the display screen information stored in the storage means;
Screen information transmitting means for transmitting the display screen information acquired by the screen information acquiring means to the evaluation device;
Have
The evaluation device is:
When the display screen information is received, the evaluation screen information of the display screen that changes in response to the coordinate information of the pressed position transmitted via the coordinate information transmission unit, and the received display screen information An evaluation means for comparing and evaluating
Evaluation result storage means for storing the evaluation result evaluated by the evaluation means;
A screen transition evaluation system characterized by comprising:   The apparatus to be inspected has switching display control means for controlling the display screen to be switched to the display screen of the display screen information when the display screen information is acquired by the screen information acquisition means. The screen transition evaluation system according to claim 1.   3. The inspected apparatus has storage control means for controlling to store the third display screen identification information when the display screen is switched and displayed by the switching display control means. Screen transition evaluation system described in 1. The evaluation screen information and the display screen information are composed of an identification number of an image part constituting the display screen and arrangement position coordinate information of the image part,
The evaluation unit evaluates whether or not the evaluation screen information of the display screen that transitions in correspondence with the coordinate information of the pressed position transmitted via the coordinate information transmission unit matches the received display screen information. The screen transition evaluation system according to claim 1, wherein the screen transition evaluation system is a screen transition evaluation system.   If it is evaluated that the evaluation screen information of the display screen that transitions in correspondence with the coordinate information of the pressed position transmitted via the coordinate information transmission means and the received display screen information do not match, the evaluation 5. The screen transition evaluation system according to claim 4, wherein the result storage means stores the display screen information together with the evaluation result. Evaluation procedure storage means for storing a predetermined order of evaluation;
Operation coordinate storage means for storing coordinate information of a pressed position on the display screen of the inspected apparatus according to the first display screen identification information stored in the evaluation procedure storage means;
Screen information storage means for storing screen information for evaluation corresponding to the first display screen identification information;
Coordinate information transmitting means for transmitting coordinate information of the pressed position to the inspected device;
Screen information receiving means for receiving display screen information corresponding to the coordinate information of the pressed position transmitted from the device under test;
When the display screen information is received, the evaluation screen information of the display screen that changes in response to the coordinate information of the pressed position transmitted via the coordinate information transmission unit, and the received display screen information An evaluation means for comparing and evaluating
Evaluation result storage means for storing the evaluation result evaluated by the evaluation means;
An evaluation apparatus comprising: Display means for switching and displaying the display screen;
A pressed position detecting means for detecting a pressed position on the display screen of the display means;
Coordinate information acquisition means for acquiring coordinate information of the pressed position detected by the pressed position detection means;
Image information storage means for storing display screen information corresponding to the second display screen identification information;
Coordinate information receiving means for receiving coordinate information of the pressed position of the display screen transmitted from the evaluation device;
Coordinate information specifying means for specifying both the operation button information corresponding to the received coordinate information and the second display screen identification information when the coordinate information of the pressed position is received via the coordinate information receiving means; ,
From the operation button information specified by the coordinate information specifying means and the second display screen identification information, third transition display screen identification information is acquired, and the image information is obtained from the acquired third display screen identification information. Screen information acquisition means for acquiring the display screen information stored in the storage means;
Screen information transmitting means for transmitting the display screen information acquired by the screen information acquiring means to the evaluation device;
A device to be inspected, comprising:

Images