JP6409285B2 - Display control apparatus, image forming apparatus, display method, and display program - Google Patents

Description

  The present invention relates to a display control apparatus, an image forming apparatus, a display method, and a display program, and more particularly to a display control apparatus, an image forming apparatus, a display method, and a display program for displaying an operation screen.

  As touch panels become more sophisticated, touch panels mounted on image forming apparatuses such as MFPs (Multi-Functional Peripherals) that can accept gesture operations on operation screens have come out. For example, an image forming apparatus that can accept gesture operations such as a pinch-out gesture for instructing enlargement of a preview image and a pinch-in gesture for instructing reduction has been proposed.

  When the image forming apparatus is equipped with a touch panel that can accept gesture operations, it is not necessary to display many operation buttons such as enlargement and reduction on the operation screen.

JP2013-125242A JP 2007-166259 A JP 2007-043515 A

  However, from the viewpoint of cost and the like, there may be a case where a touch panel that is difficult to detect movement of a touch position such as a resistive film panel or two or more touches is mounted on the image forming apparatus. Alternatively, the touch panel itself may not be mounted on the image forming apparatus. In this case, even if an operation screen that does not include the operation buttons as described above is displayed, an operation button that can be operated with a single touch or a hard key is not provided because an instruction for enlargement or reduction cannot be performed by a gesture operation. It is necessary to display on the operation screen.

  Since the display device of the image forming apparatus can be replaced during maintenance, the displayed operation screen may not be appropriate when a touch panel that can accept gesture operations is replaced with a panel that is not.

  In addition, recently, information on the operation screen of the image forming apparatus is transmitted to a terminal device including a display device, and information on the operation position with respect to the operation screen is transferred from the terminal device to the image forming apparatus. It is also used as a so-called remote panel that transitions. It can be said that this is a concept including a display device mounted on another accessible device without being limited to the display device of the image forming apparatus. In this case, since the gesture operation differs depending on the display device of the terminal device, the operation screen may not be appropriate.

  SUMMARY An advantage of some aspects of the invention is that it provides a display control device, an image forming apparatus, a display method, and a display program capable of displaying an appropriate operation screen.

In order to achieve the above object, according to one aspect of the present invention, a display control device is a display control device that performs control to display an operation screen of an image forming device on a display device, and the characteristics of the display device include gesture operation. A first determination unit for determining whether or not it is acceptable, and a switching unit for switching an operation screen to be displayed on the display device in accordance with the characteristics of the display device. From the memory storing the screen information of the first operation screen capable of accepting an instruction by the gesture operation and the screen information of the second operation screen capable of accepting an instruction by the operation replacing the gesture operation as screen information of the screen, When the first determination means determines that the display device can accept the gesture operation, the screen information of the first operation screen is read and the display device When the first determination unit determines that the gesture operation cannot be accepted, the screen information of the second operation screen is read and output to the display device, thereby switching the operation screen displayed on the display device, The second operation screen is a screen including an operation image for receiving an instruction by an operation in place of the gesture operation, which is displayed so as to overlap the first operation screen, and the switching unit is configured according to the characteristics of the display device. When the first determination unit determines that the display device can accept the gesture operation, the second operation screen is hidden, and the first determination unit determines that the display device cannot accept the gesture operation. If it is determined, when the operation screen displayed on the display device is capable of accepting the gesture operation by touching two or more points, di by 2 points or more touches of the first operation screen Some of the plurality of images to be Sucha operation, displays superimposed second operation screen. When the first determination unit determines that the display device cannot accept the gesture operation, the first operation is performed when the operation screen displayed on the display device can accept the gesture operation involving the movement of the touch position. The operation screen is switched by overlaying and displaying the second operation screen outside the display range of a plurality of images to be subjected to gesture operation with movement of the touch position on the screen.

Preferably, the first determination means further determines whether or not a gesture operation including touches of two or more points can be accepted at the same time. When the first operation screen is an operation screen capable of accepting a gesture operation including two or more touches, the switching unit is configured to accept the gesture operation including the two or more touches as the first operation screen . When the determination means determines, the screen information of the first operation screen is read and displayed on the display device, and the first determination means indicates that the display device cannot accept a gesture operation including two or more touches. If it is determined, the screen information of the second operation screen is read and displayed on the display device. When the first operation screen is an operation screen that cannot accept a gesture operation including two or more touches and can accept a gesture operation by one point touch, the switching device has two or more display devices. When the first determination means determines that a gesture operation including touch cannot be accepted and a gesture operation by one point touch can be accepted, the screen information of the first operation screen is read and displayed on the display device. When the first determination unit determines that the display device cannot accept the gesture operation, the screen information of the second operation screen is read and displayed on the display device.

Preferably, the display control device further includes a second determination unit for determining a characteristic of an operation on the display device. The switching means switches the second operation screen when the second determination means determines that a gesture operation has been performed on the second operation screen while the second operation screen is displayed on the display device. Switch to the first operation screen.

More preferably, when the second determination unit determines that a predetermined operation has been performed on the first operation screen when the first operation screen is displayed on the display device, the switching unit may The operation screen of 1 is switched to the second operation screen.

  Preferably, the display device is a display device mounted on a terminal device capable of communicating with the image forming apparatus.

According to another aspect of the present invention, an image forming apparatus includes an image reading unit, an image forming unit, and a display device, and includes the display control device.

According to still another aspect of the present invention, the display method is a method of displaying an operation screen of the image forming apparatus on the display device, and a step of determining whether or not the characteristic of the display device can accept a gesture operation; And a step of switching an operation screen to be displayed on the display device in accordance with the characteristics of the display device. In the switching step, a screen of the first operation screen that can accept an instruction by a gesture operation as screen information of the same operation screen When it is determined in the step of determining that the display device can accept the gesture operation from the memory storing the information and the screen information of the second operation screen that can accept the instruction by the operation replacing the gesture operation The screen information of the first operation screen is read, and it is determined that the display device cannot accept the gesture operation. When it is determined in step, the screen information of the second operation screen is read out and output to the display device, thereby switching the operation screen displayed on the display device. The second operation screen is the first operation screen. The screen includes an operation image for receiving an instruction by an operation that replaces the gesture operation, and is displayed on the screen, and the step of switching can accept the gesture operation according to the characteristics of the display device. and hide when it is determined in the second operation screen in the step of determining that, when the display device is determined in the step of determining that the not accept gesture operation, an operation screen displayed on the display device When a gesture operation with two or more touches can be accepted, a gesture with two or more touches on the first operation screen can be accepted. Some of the plurality of images to be char operation, displays superimposed second operation screen. When it is determined in the step of determining that the display device cannot accept the gesture operation, the first operation screen is displayed when the operation screen displayed on the display device can accept the gesture operation involving the movement of the touch position. Switching the operation screen by displaying the second operation screen in an overlapping manner outside the display range of the plurality of images that are the target of the gesture operation involving the movement of the touch position .

According to still another aspect of the present invention, the display program is a program for causing a computer to execute a process of displaying an operation screen of the image forming apparatus on the display device, and whether or not the characteristics of the display device can accept a gesture operation. And a step of switching the operation screen displayed on the display device in accordance with characteristics of the display device. In the switching step, as the screen information of the same operation screen, the screen information of the first operation screen that can accept an instruction by a gesture operation and the screen information of a second operation screen that can accept an instruction by an operation that replaces the gesture operation Is determined in the step of determining that the display device can accept the gesture operation from the memory storing the information, the screen information of the first operation screen is read, and the display device cannot accept the gesture operation. When it is determined in the determining step, the screen information of the second operation screen is read out and output to the display device, thereby switching the operation screen to be displayed on the display device. Operation image that is displayed on the operation screen and that accepts instructions from operations that replace gesture operations The switching step is to display the second operation screen in a non-display state when it is determined in the step of determining that the display device can accept a gesture operation according to the characteristics of the display device. If the operation screen displayed on the display device can accept a gesture operation with two or more touches when it is determined in the step of determining that the device cannot accept a gesture operation, the first operation screen The second operation screen is displayed so as to overlap a part of a plurality of images that are targets of gesture operation by two or more touches. When it is determined in the step of determining that the display device cannot accept the gesture operation, the first operation screen is displayed when the operation screen displayed on the display device can accept the gesture operation involving the movement of the touch position. Switching the operation screen by displaying the second operation screen in an overlapping manner outside the display range of the plurality of images that are the target of the gesture operation involving the movement of the touch position .

  According to the present invention, an appropriate operation screen can be displayed according to the characteristics of the display device.

1 is a diagram illustrating a specific example of a configuration of an image forming system according to an embodiment. 1 is a schematic diagram illustrating a schematic hardware configuration of an image forming apparatus included in an image forming system. FIG. 2 is a schematic diagram illustrating a schematic hardware configuration of a terminal device capable of communicating with an image forming apparatus. 6 is a diagram illustrating a specific example of an operation screen displayed on an operation panel 17 of the image forming apparatus. FIG. 6 is a diagram illustrating a specific example of an operation screen displayed on an operation panel 17 of the image forming apparatus. FIG. 3 is a block diagram illustrating a specific example of a functional configuration of the image forming apparatus. FIG. 6 is a flowchart illustrating a specific example of a flow of display control of an operation screen in the image forming apparatus. 12 is a flowchart showing another specific example of the flow of display control of the operation screen in the image forming apparatus.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

  In the following example, a display control device for controlling display on a touch panel mounted on an image forming apparatus or display on a touch panel mounted on a terminal device capable of communicating with the image forming apparatus is an image forming apparatus. However, the display control device may be a separate device connected to the image forming apparatus and may control display on the touch panel of the image forming apparatus. That is, the display on the touch panel may be controlled by being included in a device different from the touch panel and a display control device for controlling the display and communicating with each other.

<System configuration>
FIG. 1 is a diagram showing a specific example of the configuration of the image forming system according to the present embodiment. Referring to FIG. 1, in the image forming system, a plurality of image forming apparatuses 1-1A,... 1-1N and a plurality of information processing apparatuses 3-1A,. 4-1 is connected to a plurality of image forming apparatuses 1-2A, ... 1-2N and a plurality of information processing apparatuses 3-2A, ... 3-2M via a network 4-2. The second system is connected via the external network 5.

  The image forming apparatus 1-1A,... 1-1N, 1-2A,... 1-2N is represented by the image forming apparatus 1, the information processing apparatuses 3-1A,... 3-1M, 3-2A,. The information processing device 3 will be referred to as a representative.

  The network 4 may be any one of a network using a dedicated line such as a LAN (Local Area Network), a network using a general line such as the Internet, and a network using wireless communication. Also, the external network 5 may be any of a network using a dedicated line such as a LAN, a network using a general line such as the Internet, a network by wireless communication, and the like. Further, the image system may be connected to another system via the external network 5.

  In the present embodiment, it is assumed that the image forming apparatus 1 is a so-called MFP (Multi Function Peripherals) having a function as a digital composite bag having a scanner, a copy, and a printer function. However, the image forming apparatus 1 is not limited to an MFP as long as the apparatus has a touch panel as an operation unit and a display unit, and may be another device such as a scanner or a copy.

  The image forming apparatus 1 is an apparatus that forms on a sheet a copy image of a document image obtained by scanning and an image generated from print data transmitted from the information processing apparatus 3. Here, the print data is a drawing instruction in a page description language obtained by converting a drawing instruction issued by the operating system or application program of the information processing apparatus 3 into a page description language that can be processed by the image forming apparatus 1 by a printer driver. This is document data described in a file format such as PDF (Portable Document Format), TIFF (Tagged Image File Format), JPEG (Joint Photographic Experts Group), XPS (XML Paper Specification).

  The original image obtained by scanning may be subjected to various settings (file format, layout setting, resolution setting, etc.) in the image forming apparatus and transmitted to the information processing apparatus 3 or the like via the network 4.

  The information processing apparatus 3 may be a general personal computer or the like. The information processing apparatus 3 generates print data according to a user instruction and transmits the generated print data to the image forming apparatus 1.

  The image forming apparatus 1 may be able to communicate with the terminal device 7 using wireless communication. Examples of the wireless communication include Bluetooth (registered trademark) and IrDA (registered trademark).

<Device configuration>
FIG. 2 is a schematic diagram illustrating a schematic hardware configuration of the image forming apparatus 1. Referring to FIG. 2, image forming apparatus 1 includes a control unit 10. The control unit 10 includes a CPU (Central Processing Unit) 10a for controlling the entire apparatus, a ROM (Read Only Memory) 11 which is a memory for storing a control program, and an S- memory which is a working storage area. A RAM (Static Random Access Memory) 12, a battery-backed NV-RAM (nonvolatile memory) 13 for storing various settings related to image formation, and a clock IC (Integrated Circuit) 14 are included.

  The control unit 10 includes a key switch group such as a display unit, which is a touch panel, a numeric key, a print key, and a logout key, which includes an image reading device 16 and keys and display units for performing various inputs via a bus. For transmitting and receiving various types of information to and from an external device such as the information processing device 3 connected via the operation panel 17 and the networks 4-1, 4-2, and 5 as an example of a display device having A network I / F (interface) 20, a printer controller 19 for generating a copy image from print data received by the network I / F 20, an image output device 18 for forming a copy image on paper, a network 4-1. , 4-2 and wireless I / F 21 for communication with terminal device 7 and short-range wireless I / F 22 for communication with terminal device 7 are connected. It has been.

  A fixed storage device 15 is connected to the control unit 10 via a bus. The fixed storage device 15 corresponds to a hard disk device, for example.

  FIG. 3 is a schematic diagram illustrating a schematic hardware configuration of the terminal device 7. Referring to FIG. 3, terminal device 7 includes a control unit 70. The control unit 70 includes a CPU 70a for controlling the entire apparatus, a ROM 71 which is a memory for storing a control program, and a RAM 72 which is a memory serving as a working storage area.

  A fixed storage device 74 for storing various data such as a hard disk device, a touch panel 75, a wireless I / F 76, and a short-range wireless I / F 77 are connected to the control unit 70 via a bus.

<Overview of operation>
FIGS. 4A and 4B and FIGS. 5A and 5B are diagrams for explaining screen display in the image forming apparatus 1. As an example, FIGS. 4A and 4B show a preview screen. On the preview screen, the user can instruct display size change (enlargement, reduction), display rotation, and the like. 5A and 5B show a widget arrangement position setting screen. On the widget arrangement position setting screen, the user can instruct the position where the widget is arranged.

  When the operation panel 17 of the image forming apparatus 1 is a panel capable of accepting a gesture operation, for example, an electrostatic panel, the image forming apparatus 1 is a first operation screen shown in FIG. Display the preview screen. That is, when the operation panel 17 is a panel that can accept a gesture operation, the operation panel 17 of the image forming apparatus 1 accepts an instruction such as a display size change (enlargement or reduction) or a display rotation by a gesture operation. A preview screen is displayed. This screen does not include a menu area to be described later (closed state). For this reason, the area which displays a preview image can be enlarged. Note that, by accepting a predetermined operation (for example, touching a tab), the image forming apparatus 1 may display a menu area on the preview screen even if the operation panel 17 is a panel capable of a gesture operation. . The first operation screen can accept instructions such as changing the display size (enlarging or reducing) or rotating the display, for example, by a gesture operation such as a pinch operation or a rotation operation.

  When the operation panel 17 of the image forming apparatus 1 is a panel that cannot accept a gesture operation, for example, a resistive film panel, the image forming apparatus 1 is a second operation screen shown in FIG. 4B. Display the preview screen. That is, when the operation panel 17 is a panel that cannot accept a gesture operation, the operation panel 17 of the image forming apparatus 1 has an alternative means that is an operation image (key) for accepting an instruction by an operation replacing the gesture operation. A preview screen including a menu area for displaying keys is displayed.

  Similarly, when the operation panel 17 of the image forming apparatus 1 is a panel that can accept a gesture operation, the image forming apparatus 1 displays the widget arrangement position setting screen in FIG. 5A that is the first operation screen. To do. That is, when the operation panel 17 is a panel that can accept a gesture operation, the operation panel 17 of the image forming apparatus 1 can receive a widget arrangement position setting screen that can accept an instruction of a position where a widget is arranged by a gesture operation. Is displayed. The first operation screen can accept an instruction of a position where the widget is arranged by a gesture operation such as a slide operation. The second operation screen includes, for example, a menu area that presents an operation image (key) that can be selected by one point of touch on the operation panel 17 without moving the touch position. The selection of the operation image (key) may be performed by a hard key or a mouse (not shown) instead of touching the operation panel 17.

  In the above example, the second operation screen itself indicates the menu area, and the image forming apparatus 1 superimposes the menu area that is the second operation screen on the first operation screen according to the characteristics of the display device. This is the same as switching between display and non-display. That is, the image forming apparatus 1 holds and displays the operation screen including the menu area on the first operation screen separately from the screen information of the first operation screen as the screen information of the second operation screen. Alternatively, the screen information of the menu area is held as the screen information of the second operation screen, and the second operation screen is switched between being displayed and hidden with respect to the first operation screen. May be.

  When the operation panel 17 of the image forming apparatus 1 is a panel that cannot accept a gesture operation, the image forming apparatus 1 displays a widget arrangement position setting screen in FIG. 5B that is a second operation screen. That is, when the operation panel 17 is a panel that cannot accept a gesture operation, the operation panel 17 of the image forming apparatus 1 has an alternative means that is an operation image (key) for accepting an instruction by an operation replacing the gesture operation. A widget arrangement position setting screen including a menu area for displaying keys is displayed.

  When the operation screen is an operation screen that can accept an operation instruction by a gesture operation such as the preview screen or the widget arrangement position setting screen, the image forming apparatus 1 further includes two or more gesture operations at the same time. Processing may be divided into those for recognizing gesture operations including touch and those for recognizing gesture operations with only one touch. For example, in the case of a preview screen, a gesture operation including two or more touches at the same time, such as a pinch operation and a rotation operation, is recognized. On the other hand, since the instruction operation may be a gesture operation with only one touch such as a slide operation on the widget arrangement position setting screen, a gesture operation including two or more touches is not recognized.

  Therefore, preferably, in the case of an operation screen that recognizes a gesture operation including two or more touches at the same time, such as a preview screen, the image forming apparatus 1 may be a panel that can accept a gesture operation. Furthermore, it is determined whether or not the panel is capable of accepting a gesture operation including two or more touches at the same time, and the operation screen is displayed separately. That is, when the operation panel 17 of the image forming apparatus 1 is a panel that can accept a gesture operation including two or more touches at the same time, the image forming apparatus 1 is a first operation screen. A preview screen shown in FIG. 4A is displayed in which a gesture operation including a touch can be accepted. On the other hand, even if the operation panel 17 of the image forming apparatus 1 is a panel capable of accepting a gesture operation, it is not possible to detect two or more touches at the same time and accept a gesture operation including two or more touches at the same time. In the case of a panel that cannot be displayed, the image forming apparatus 1 displays the preview screen in FIG. 4B that does not accept a gesture operation including two or more touches, which is the second operation screen at the same time.

In the operation panel, only one touch point can be detected, and the touch position cannot be detected continuously at an extremely short interval, and the gesture operation with the movement of the touch position is accepted. Some panels are not possible. Therefore, the operation screen of the display target, such as widgets position setting screen, even recognize screen gesture operation involving movement of the touch position, such as the sliding operation, images forming apparatus 1 includes an operation panel 17 is touched It is determined whether or not the panel is capable of accepting a gesture operation involving a movement of the position, and the operation screen is displayed separately. That is, when the operation panel 17 of the image forming apparatus 1 is a panel that can accept a gesture operation with a movement of a touch position, the image forming apparatus 1 is a gesture operation with a movement of a touch position, which is a first operation screen. Is displayed. The widget arrangement position setting screen shown in FIG. On the other hand, even if the operation panel 17 of the image forming apparatus 1 is a panel that can accept a gesture operation, the image forming apparatus 1 does not accept a gesture operation that involves movement of the touch position. The widget arrangement position setting screen shown in FIG. 5B that does not accept a gesture operation involving movement of the touch position, which is an operation screen, is displayed.

  4 and 5 each illustrate an operation screen displayed on the operation panel 17 of the image forming apparatus 1. FIG. However, the operation screen may be displayed on the touch panel 75 of the terminal device 7 in addition to being displayed on the operation panel 17 of the image forming apparatus 1. That is, information on the operation screen is transferred from the image forming apparatus 1 to the terminal device 7 and displayed on the touch panel 75 of the terminal device 7, and information representing a touch position on the operation screen is transferred from the terminal device 7 to the image forming apparatus 1. There is a remote operation method of the image forming apparatus 1 using a terminal device 7 called a so-called remote panel in which an operation screen is updated according to the operation. In this case, the image forming apparatus 1 determines whether or not the characteristic of the touch panel 75 of the terminal device 7 can accept a gesture operation, preferably whether or not a gesture operation including two or more touches can be accepted, Alternatively, the operation screen is displayed separately as described above depending on whether or not a gesture operation involving the movement of the touch position can be accepted.

  Accordingly, in the following description, the display device that is a target for displaying the operation screen by the image forming apparatus 1 includes the touch panel 75 mounted on the terminal device 7 in addition to the operation panel 17 mounted on itself.

<Functional configuration>
FIG. 6 is a block diagram illustrating a specific example of a functional configuration of the image forming apparatus 1 for performing the above-described display control. Each function of FIG. 6 is mainly realized by the CPU 10a when the CPU 10a of the image forming apparatus 1 reads the program stored in the ROM 11 onto the S-RAM 12 and executes it. However, at least a part of the functions may be realized by another hardware configuration shown in FIG. 2 or another configuration such as an electric circuit (not shown), or by cooperation of the other configuration and the CPU 10a.

  Referring to FIG. 6, CPU 10 a functioning as a display control device determines whether or not the characteristics of touch panel 75 mounted on operation panel 17 or terminal device 7 that is a display device can accept a gesture operation. The first determination unit 102 and a display processing unit 103 for performing a process of displaying an operation screen on the display device. The display processing unit 103 includes a switching unit 104 for switching an operation screen displayed on the display device according to the characteristics of the display device.

  The memory (for example, NV-RAM 13) of the image forming apparatus 1 accepts the screen information of the first operation screen that can accept an instruction by a gesture operation as the screen information of the same operation screen, and the instruction by an operation that replaces the gesture operation. It includes a screen storage unit 132 that is a storage area for storing screen information of possible second operation screens.

  Preferably, the second operation screen is a screen including an operation image for receiving an instruction by an operation in place of the gesture operation, which is displayed so as to overlap the first operation screen. According to the characteristics of the display device, the switching unit 104 hides the second operation screen when the display device can accept the gesture operation, and displays the second operation screen when the display device cannot accept the gesture operation. The operation screen is switched by displaying the second operation screen superimposed on the one operation screen.

  As an example, characteristics for each display device are registered in the NV-RAM 13 as an example of a memory of the image forming apparatus 1. Then, the first determination unit 102 may determine the characteristics of the display target display device by referring to the memory registration. Therefore, for example, the memory such as the NV-RAM 13 includes a characteristic storage unit 131 that is a storage area for storing the specification of the display device. The CPU 10 a further includes a characteristic reading unit 101 for reading out the characteristics of the display device to be displayed from the characteristic storage unit 131. The characteristics of the display device may be registered or changed by a specific user such as an administrator. For example, a service person who replaces the operation panel 17 as a specific user may set whether or not the operation panel 17 can accept a gesture operation on a setting screen (not shown) and register it in the memory. Good.

  As another example, the characteristics storage unit 131 of the image forming apparatus 1 registers the characteristics of the display device for each specific information such as the serial number and model of the display device. You may determine the characteristic of the display apparatus of display object by acquiring the specific information of a display apparatus, and comparing with the said registration. Acquisition of display device specific information by the first determination unit 102 may be, for example, from an OS (operating system) installed in the image forming apparatus 1.

  When the display device can accept the gesture operation, the switching unit 104 reads the screen information of the first operation screen from the screen storage unit 132 and outputs the screen information to the display device. When the display device cannot accept the gesture operation, the switching unit 104 reads the screen information of the second operation screen from the screen storage unit 132 and outputs the screen information to the display device. Thereby, the switching unit 104 switches the operation screen displayed on the display device.

  Preferably, the first determination unit 102 further determines whether or not a gesture operation including touches of two or more points can be accepted at the same time. In this case, when the first operation screen is an operation screen that can accept a gesture operation including two or more touches, the switching unit 104 can accept a gesture operation including two or more touches. In some cases, the screen information of the first operation screen is read and displayed on the display device. When the display device cannot accept a gesture operation including two or more touches, the switching unit 104 reads the screen information of the second operation screen and displays it on the display device. When the first operation screen is an operation screen that cannot accept a gesture operation including two or more touches and can accept a gesture operation by one point touch, the switching unit 104 has two or more display devices. If the gesture operation including the touch is not accepted and the gesture operation by a single touch can be accepted, the screen information of the first operation screen is read and displayed on the display device. When the display device cannot accept the gesture operation, the switching unit 104 reads out the screen information of the second operation screen and displays it on the display device.

<Operation flow>
FIG. 7 is a flowchart showing a specific example of the flow of display control of the operation screen in the image forming apparatus 1. The operation shown in the flowchart of FIG. 7 is realized by the CPU 10a of the image forming apparatus 1 reading the program stored in the ROM 11 onto the S-RAM 12 and executing it, and exhibiting the functions of FIG. . The operation in FIG. 7 is started when the CPU 10a of the image forming apparatus 1 specifies the next operation screen to be displayed by receiving an operation instruction for the operation screen being displayed.

  Referring to FIG. 7, CPU 10a checks whether or not the operation screen to be displayed is an operation screen that can recognize a gesture operation, such as a preview screen or a widget arrangement position setting screen (step S101). . When the operation screen to be displayed is an operation screen that can recognize the gesture operation (YES in step S101), the CPU 10a determines whether or not the display device can accept the gesture operation (step S103). As an example, the CPU 10a reads information on the characteristics of the display device registered in the memory, and checks whether or not the characteristics of the display device to be displayed are registered as being capable of accepting a gesture operation.

  When the characteristic of the display device can accept a gesture operation (YES in step S103), the CPU 10a displays a first operation screen for the operation screen to be displayed. That is, the CPU 10a determines to display an operation screen that does not display the menu area that is the second operation screen, as shown in FIG. 4A or FIG. 5A (step S105). ), A process for displaying the operation screen on the operation panel 17 as a display device or the touch panel 75 of the terminal device 7 is performed (step S109).

  On the other hand, when the characteristic of the display device cannot accept the gesture operation (NO in step S103), the CPU 10a displays a second operation screen for the operation screen to be displayed. That is, the CPU 10a displays an operation screen in which the menu area, which is the second operation screen, is displayed on the first operation screen as shown in FIG. 4B or 5B. Is determined (step S107), and processing for displaying the operation screen on the operation panel 17 as a display device or the touch panel 75 of the terminal device 7 is performed (step S109).

  Preferably, as described above, the image forming apparatus 1 performs processing separately for a gesture operation that simultaneously recognizes a gesture operation including two or more touches and a gesture operation that recognizes a gesture operation with only one touch. To do. FIG. 8 is a flowchart showing another specific example of the flow of display control of the operation screen in the image forming apparatus 1.

  Referring to FIG. 8, when the operation screen to be displayed is an operation screen that can recognize a gesture operation (YES in step S <b> 101), the CPU 10 a can further recognize two or more gesture operations. It is confirmed whether it is an operation screen (step S102).

  When the operation screen to be displayed is an operation screen capable of recognizing two or more gesture operations (YES in step S102), and the display device can accept a gesture operation having two or more points (step S103). The CPU 10a decides to display the first operation screen that is the operation screen in which the menu area that is the second operation screen is not displayed (step S105-1), and executes the display process. (Step S109).

  When the operation screen to be displayed is an operation screen capable of recognizing two or more gesture operations (YES in step S102), and the display device has a characteristic of not being able to accept two or more gesture operations (step S103). The CPU 10a determines to display the operation screen that is displayed by superimposing the menu area that is the second operation screen on the first operation screen (step S107-1), and executes the display process. (Step S109).

  When the operation screen to be displayed is an operation screen capable of recognizing only one point of gesture operation (NO in step S102) and the characteristic of the display device can accept one point of gesture operation (step S103- 2), the CPU 10a determines that the first operation screen, which is an operation screen in which the menu area that is the second operation screen is not displayed, is displayed (step S105-2), and executes display processing. (Step S109).

  When the operation screen to be displayed is an operation screen capable of recognizing only one gesture operation (NO in step S102), and the display device has a characteristic that cannot accept one gesture operation, that is, the gesture operation is performed. If it cannot be accepted (NO in step S103-2), the CPU 10a determines to display an operation screen in which the menu area, which is the second operation screen, is superimposed on the first operation screen (step S107). -2) The display process is executed (step S109).

<Effect of Embodiment>
By performing the above display control in the image forming apparatus 1, for example, even when the operation panel 17 is replaced from the electrostatic panel to the resistance film panel or vice versa, the operation screen display software is installed. The operation screen can be automatically switched without switching and a suitable operation screen can be displayed. That is, the image forming apparatus 1 automatically displays a suitable operation screen according to the characteristics of the operation panel 17 without preparing special software or requiring a special operation by the user. Can do.

  Further, even when the remote operation using the terminal device 7 called a so-called remote panel is performed, the image forming apparatus 1 displays an operation screen suitable for the characteristics of the touch panel 75 of the terminal device 7. can do.

  Thereby, the program amount of the image forming apparatus 1 can be suppressed and the configuration can be facilitated. In addition, user convenience can be improved.

<Other example 1>
Preferably, as shown in FIG. 4A, even when an operation screen in which the menu screen as the second operation screen is hidden is displayed as the first operation screen. The image forming apparatus 1 may display the menu screen, which is the second operation screen, by receiving a specific operation. This makes it possible to meet the needs of users who have higher operability in operations different from gesture operations.

  Preferably, when the image forming apparatus 1 displays the second operation screen by performing the above-described operation on a display device capable of accepting a gesture operation, the image forming apparatus 1 And switching to the first operation screen by accepting the gesture operation.

  In this case, the CPU 10a of the image forming apparatus 1 further includes a second determination unit 105 for determining the characteristics of the operation on the display device shown in FIG. When a gesture operation is performed on the second operation screen while the second operation screen is displayed on the display device, the switching unit 104 switches the second operation screen to the first operation screen.

  By performing the above display control in the image forming apparatus 1, the operation screen is switched to an appropriate operation screen according to the user's operation, and the convenience for the user can be further improved.

<Other example 2>
In the above example, the image forming apparatus 1 switches the operation screen based on the characteristics of the display device, that is, the menu screen that is the second operation screen is displayed over the first operation screen or not displayed. It is supposed to switch between.

  However, even if the characteristics of the display device are capable of accepting a gesture operation, depending on the user, an operation different from the gesture operation may be more operable. As described above, the user can also display the menu screen, which is the second operation screen, by a specific operation. However, if the user always wants to perform an operation different from the gesture operation, the screen is displayed for each operation screen. It may be complicated to perform the switching operation. Therefore, as another example, it may be possible to set whether to display the first operation screen or the second operation screen as the user setting.

  In this case, the characteristic reading unit 101 reads out the characteristic of the display device from the characteristic storage unit 131 and reads out the setting included in the user information of the login user from the memory. The first determination unit 102 determines the characteristics of the display device and the user settings. The switching unit 104 displays the second operation screen, that is, the menu screen if the user setting does not perform the gesture operation even if the characteristics of the display device can accept the gesture operation. The operation screen is displayed as the status. Conversely, even if the user setting is for performing a gesture operation, if the characteristics of the display device cannot accept the gesture operation, the first operation screen, that is, the menu screen is hidden. Display the operation screen.

  By performing the above display control in the image forming apparatus 1, the operation screen is switched to an appropriate operation screen according to the user's settings, and the convenience for the user can be further improved.

<Other example 3>
Furthermore, a program for causing the CPU of the image forming apparatus to execute the above-described display control can be provided. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  By providing the program, it is possible to cause the existing image forming apparatus to perform the display control.

  A program according to the present invention is a program module that is provided as a part of an operating system (OS) of a computer and that executes necessary processes by calling necessary modules in a predetermined arrangement at a predetermined timing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  DESCRIPTION OF SYMBOLS 1 Image forming apparatus, 3 Information processing apparatus, 4 Network, 5 External network, 7 Terminal device, 10, 70 Control part, 10a, 70a CPU, 11, 71 ROM, 12 S-RAM, 13 NV-RAM, 15, 74 Fixed storage device, 16 image reading device, 17 operation panel, 18 image output device, 19 printer controller, 20 network I / F, 21,76 wireless I / F, 22, 77 short-range wireless I / F, 72 RAM, 75 Touch panel, 101 characteristic reading unit, 102 first determination unit, 103 display processing unit, 104 switching unit, 105 second determination unit, 131 characteristic storage unit, 132 screen storage unit.

Claims (8)

A display control device that performs control to display an operation screen of an image forming apparatus on a display device,
First determination means for determining whether or not the characteristic of the display device is capable of accepting a gesture operation;
Switching means for switching the operation screen to be displayed on the display device according to the characteristics of the display device,
The switching means includes, as screen information of the same operation screen, screen information of a first operation screen that can accept an instruction by a gesture operation, and a screen of a second operation screen that can accept an instruction by an operation that replaces the gesture operation When the first determination means determines that the display device can accept a gesture operation from a memory storing information, the screen information of the first operation screen is read, and the display device performs the gesture operation. When the first determination unit determines that the operation screen cannot be received, the screen information on the second operation screen is read and output to the display device, whereby the operation screen displayed on the display device is displayed. switching,
The second operation screen is a screen including an operation image for receiving an instruction by an operation in place of a gesture operation, which is displayed so as to overlap the first operation screen.
The switching means hides the second operation screen when the first determination means determines that the display device can accept a gesture operation according to the characteristics of the display device, When the first determination unit determines that the display device cannot accept a gesture operation, when the operation screen displayed on the display device can accept a gesture operation with two or more touches, The second operation screen is superimposed on a part of a plurality of images to be subjected to gesture operation by touching two or more points on one operation screen, and the display device cannot accept the gesture operation. When the operation screen displayed on the display device is capable of accepting a gesture operation with a movement of a touch position when the first determination means determines, Switch the operation screen by the display range of the plurality of images to be of the gesture involving a movement of the touch position operation of the operation screen overlapping the second operation screen, the display control device. The first determination unit further determines whether or not the display device can accept a gesture operation including touches of two or more points at the same time,
The switching means is
When the first operation screen is an operation screen that can accept a gesture operation including two or more touches, the first operation screen can accept a gesture operation including two or more touches. When the determination means determines, the screen information of the first operation screen is read out and displayed on the display device. If the display device cannot accept a gesture operation including two or more touches, the first operation screen is displayed. When the determination means determines, the screen information of the second operation screen is read and displayed on the display device,
When the first operation screen is an operation screen that cannot accept a gesture operation including two or more touches and can accept a gesture operation by one point touch, the display device performs two or more touches. If the first determination unit determines that the gesture operation including the first operation screen cannot be received and the gesture operation by one point touch can be received, the screen information of the first operation screen is read out to the display device. 2. When the first determination means determines that the display device cannot accept a gesture operation, the screen information of the second operation screen is read out and displayed on the display device. The display control apparatus described. A second determining means for determining a characteristic of an operation on the display device;
When the second determination unit determines that a gesture operation has been performed on the second operation screen while the second operation screen is displayed on the display device, The display control apparatus according to claim 1, wherein a second operation screen is switched to the first operation screen.   When the second determination unit determines that a predetermined operation has been performed on the first operation screen when the first operation screen is displayed on the display device, The display control apparatus according to claim 3, wherein the first operation screen is switched to the second operation screen.   The display control device according to claim 1, wherein the display device is a display device mounted on a terminal device capable of communicating with the image forming apparatus.   An image forming apparatus having an image reading device, an image output device, and a display device, wherein the display control device according to claim 1 is mounted. A method for displaying an operation screen of an image forming apparatus on a display device,
Determining whether the characteristic of the display device is capable of accepting a gesture operation;
Switching the operation screen displayed on the display device according to the characteristics of the display device,
In the switching step, as the screen information of the same operation screen, the screen information of the first operation screen that can accept an instruction by a gesture operation and the screen of a second operation screen that can accept an instruction by an operation that replaces the gesture operation When it is determined in the determining step that the display device can accept a gesture operation from a memory storing information, the screen information of the first operation screen is read, and the display device performs a gesture operation. When it is determined in the step of determining that it is not acceptable, the screen information of the second operation screen is read and output to the display device, thereby switching the operation screen to be displayed on the display device,
The second operation screen is a screen including an operation image for receiving an instruction by an operation in place of a gesture operation, which is displayed so as to overlap the first operation screen.
In the switching step, the second operation screen is hidden when the display device determines that the display device can accept a gesture operation according to the characteristics of the display device, and the display When it is determined in the determining step that the device cannot accept a gesture operation, when the operation screen displayed on the display device can accept a gesture operation by two or more touches, the first operation is performed. The second operation screen is superimposed on a part of a plurality of images to be subjected to gesture operation by touching the two or more points on the operation screen, and the determination is made that the display device cannot accept the gesture operation. The operation screen displayed on the display device is a gesture that involves a movement of the touch position. When you can accept catcher over operation by displaying overlapping the first operation screen the touch position and the second operation screen moves outside the display range of the plurality of images to be a gesture operation with of A display method including switching operation screens. A program for causing a computer to execute processing for displaying an operation screen of an image forming apparatus on a display device,
Determining whether the characteristic of the display device is capable of accepting a gesture operation;
Causing the computer to execute a step of switching an operation screen displayed on the display device in accordance with characteristics of the display device,
In the switching step, as the screen information of the same operation screen, the screen information of the first operation screen that can accept an instruction by a gesture operation and the screen of a second operation screen that can accept an instruction by an operation that replaces the gesture operation When it is determined in the determining step that the display device can accept a gesture operation from a memory storing information, the screen information of the first operation screen is read, and the display device performs a gesture operation. When it is determined in the determining step that it is not acceptable, the screen information of the second operation screen is read and output to the display device, thereby switching the operation screen to be displayed on the display device. The second operation screen is replaced with a gesture operation that is displayed over the first operation screen. A screen including an operation image for receiving an instruction by the operation,
In the switching step, the second operation screen is hidden when the display device determines that the display device can accept a gesture operation according to the characteristics of the display device, and the display When it is determined in the determining step that the device cannot accept a gesture operation, when the operation screen displayed on the display device can accept a gesture operation by two or more touches, the first operation is performed. The second operation screen is superimposed on a part of a plurality of images to be subjected to gesture operation by touching the two or more points on the operation screen, and the determination is made that the display device cannot accept the gesture operation. The operation screen displayed on the display device is a gesture that involves a movement of the touch position. When you can accept catcher over operation by displaying overlapping the first operation screen the touch position and the second operation screen moves outside the display range of the plurality of images to be a gesture operation with of A display program that includes switching operation screens.

Images