JP2014138235A - Display control device, image forming apparatus, terminal device, display method, and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display control device capable of displaying, on a terminal device, an operation screen with good operability for remote control of an image forming apparatus.SOLUTION: A display control device detects a holding state as to whether a terminal device is held with one hand or held with both hands (step S103), determines whether or not an operation screen to be displayed is a specific operation screen in which a first screen is associated with a second screen (step S105), and when the operation screen to be displayed is the specific operation screen, reads out display data of any one of the first screen and the second screen to display the display data on the terminal device according to the holding state of the terminal device (step S107).

Description

  The present invention relates to a display control device, an image forming device, a terminal device, a display method, and a display control program, and in particular, a display control device and an image forming device for displaying an operation screen for remote operation of the image forming device on the terminal device. The present invention relates to a terminal device, a display method, and a display control program.

  An operation panel displayed on a display provided in an image forming apparatus such as an MFP (Multi-Functional Peripheral) such as a printer, a copier, or a combination of these is transmitted as an image to the terminal device to display the operation panel. A function that enables an image forming apparatus to be operated remotely from the apparatus is known. This function is called a remote panel function.

  As the terminal device, a device of a size that can be carried by a user, such as a mobile phone or a dedicated device, is used. The operability of a portable terminal device may be related to how the terminal device is held.

  For example, Japanese Patent Laid-Open No. 2012-128652 (hereinafter referred to as Patent Document 1) arranges keys in an arc shape on a display of a mobile terminal having a touch panel, and operates with the one hand while holding the terminal device with one hand. A technique for facilitating the disclosure is disclosed. Japanese Patent Laid-Open No. 2012-58910 (hereinafter referred to as Patent Document 2) discloses a one-hand operation mode for detecting a method of grasping a terminal device and performing an operation while grasping with one hand, and grasping with one hand. A technique for switching between a two-hand operation mode for an operation using both hands that are operated with the other hand is disclosed. Japanese Patent Laid-Open No. 2011-28603 (hereinafter referred to as Patent Document 3) detects how to hold a terminal device having a touch panel, and invalidates the touch operation when it is detected that the terminal device is held with one hand. The technology to secure the area is disclosed.

JP 2012-128652 A JP 2012-58910 A JP 2011-28603 A

  In the remote panel function, since the image forming apparatus is remotely operated using the terminal device, a terminal device that is larger in size and weight than the mobile phone may be used. For this reason, the remote panel function may be used in such a manner that it is grasped with one hand when an operation is required and is grasped with both hands when confirming display contents. At this time, if an operation for switching the displayed screen according to the way of holding is required, the operability may be impaired.

  The present invention has been made in view of such a problem, and is a display control device that is an operation screen for remote operation of an image forming apparatus and can display an operation screen with good operability on another device. An object of the present invention is to provide an image forming apparatus, a terminal device, a display method, and a display control program.

  In order to achieve the above object, according to one aspect of the present invention, the display control device is a display control device that performs control for causing the terminal device to display an operation screen of the image forming device, and the operation screen of the image forming device. Reading means for reading display data from the storage device for storing the display data, display means for displaying the operation screen on the terminal device using the display data, and holding the terminal device with one hand or both hands Whether or not the operation means is a specific operation screen in which the associated first screen and second screen are stored in the storage device. First determining means for determining When the operation screen is a specific operation screen, the reading unit displays the display data of one of the first screen and the second screen associated with each other according to the gripping state of the terminal device. Is read.

  Preferably, the first screen is an operation screen for the image forming apparatus and includes an operation input item, and the second screen is a screen for displaying contents related to the first screen. The reading means has a smaller number of items for operation input than the first screen, and the reading means reads the display data of the first screen when the terminal device is held with one hand, and the second means when the terminal device is held with both hands. Read the screen display data.

  More preferably, the display unit switches the display of the terminal device between the first screen and the second screen according to the gripping state when the gripping state changes while displaying the specific operation screen.

  Preferably, the display control device further includes second determination means for determining whether or not the image forming apparatus is in a predetermined state, and the reading means has the image forming apparatus specified in advance. If it is in a state, it is stored in the storage device in association with one of the first screen and the second screen, or in a predefined state, depending on the gripping status of the terminal device The display data of any one of the third screens is read out.

  More preferably, the third screen is a screen for informing the state of the image forming apparatus, and the reading unit is configured such that when the terminal device is held with both hands and the image forming apparatus is in a predetermined state, The display data of the second screen or the third screen is read out.

  Preferably, when the terminal device is held with both hands and the image forming apparatus is in a predetermined state, the reading unit is set in advance between the second screen and the third screen. Read the display data on one of the screens according to the rules.

  Preferably, when the state of the image forming apparatus changes while the operation screen is displayed, the display unit displays the image on the terminal device between the first screen or the second screen and the third screen. Switch according to the state of the device.

  Preferably, the display control device further includes setting means for receiving a setting as to whether or not to switch display of the terminal device on the display means.

  More preferably, the setting unit accepts a setting as to whether or not to switch display of the terminal device on the display unit for each operation screen of the image forming apparatus.

  Preferably, the display means does not switch the display of the terminal device even when the gripping state changes within a prescribed time from the switching of the display destination of the terminal device.

  Preferably, the combination of the first screen and the second screen includes (1) a document preview screen and a full screen preview screen, (2) a job setting screen and a job setting content display screen, and (3) a destination setting screen and Address setting content display screen, (4) Job list screen and selected job content display screen, (5) Job history screen and selected job history content display screen, (6) Storage area document screen and selected document One of a setting content display screen, (7) a destination selection screen and a selected destination display screen, and (8) a maintenance screen and a maintenance information content display screen.

  Preferably, the combination of the predetermined state and the third screen is any one of (1) a document reading state and a scanned document preview screen, and (2) a trouble occurrence state and a trouble handling screen. It is.

  According to another aspect of the present invention, an image forming apparatus is an image forming apparatus equipped with the above-described display control device, and includes a transmission unit for transmitting display data of an operation screen to the terminal device, and a terminal device. A processing means for receiving information related to an operation on the displayed operation screen and updating the operation screen by executing a process specified from the displayed operation screen and the operation; When the updated operation screen is a specific operation screen, the display data of the associated first screen and second screen is transmitted to the terminal device as display data of the specific operation screen.

  Preferably, the transmission unit transmits the display data of the third screen stored in association with the state to the terminal device when the state is set in advance.

  According to still another aspect of the present invention, a terminal device is a terminal device equipped with the above-described display control device, and receives an operation screen display data from the image forming device and stores it in a storage device; And an instruction means for receiving an operation input for the operation screen displayed on the terminal device, and a transmission means for transmitting information related to the operation input to the image forming apparatus, the first means displayed by the display means. Display data of the other screen stored in the storage device in association with one screen when one screen is updated in accordance with an operation input to one of the second screen and the second screen. The updated image data corresponding to the update is requested to the image forming apparatus.

  According to still another aspect of the present invention, the display method is a method for displaying an operation screen of the image forming apparatus on the terminal device, and detects a gripping state of whether the terminal device is gripped with one hand or both hands. And a storage device that stores display data of the operation screen of the image forming apparatus, and the associated first screen and second screen are stored in the operation screen to be displayed on the image forming apparatus. The step of determining whether or not the operation screen is a specific operation screen, and when the operation screen to be displayed is the specific operation screen, the first screen and the second screen associated with each other according to the gripping status of the terminal device And reading the display data of one of the screens from the storage device and displaying it on the terminal device.

  According to still another aspect of the present invention, a display control program is a program for causing a computer to execute a process of displaying an operation screen of an image forming apparatus on a terminal device, and causing the computer to function as a display control device. The step of detecting the holding state of holding with one hand or holding with both hands and the operation screen to be displayed on the image forming apparatus are associated with a storage device that stores display data of the operation screen of the image forming apparatus. A terminal device that determines whether the first screen and the second screen are stored and is a specific operation screen, and the operation screen to be displayed is the specific operation screen. The display data of one of the first screen and the second screen associated with each other is read from the storage device and displayed on the terminal device according to the gripping state of the screen. To execute the door to the computer.

  According to the present invention, an operation screen for remote operation of the image forming apparatus with good operability can be displayed on a control device such as a terminal device, and the operation efficiency of the user can be significantly improved.

It is a figure which shows the specific example of a structure of the image processing system concerning embodiment. FIG. 3 is a diagram illustrating a specific example of a hardware configuration of an MFP (Multi-Functional Peripheral) included in the image processing system. It is a figure which shows the specific example of the hardware constitutions of the terminal device contained in an image processing system. It is a figure showing the flow of the remote panel operation | movement in an image processing system. It is a figure for demonstrating the display control concerning 1st Embodiment. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a figure showing the specific example of the combination of the screen A which is a 1st screen, and the screen a which is a 2nd screen. It is a block diagram which shows the specific example of a function structure of the terminal device as a display control apparatus. It is a flowchart showing the flow of the display control concerning 1st Embodiment. It is a flowchart showing the flow of the display control concerning 2nd Embodiment. It is a flowchart showing the other example of the flow of the display control concerning 2nd Embodiment. It is a figure showing the specific example of the 3rd screen. It is a figure showing the specific example of the 3rd screen. It is a flowchart showing the flow of the display control concerning 3rd Embodiment. It is a flowchart showing the flow of the display control concerning 3rd Embodiment. It is a flowchart showing the flow of the display control concerning 3rd Embodiment. It is a figure showing the specific example of the setting screen for setting whether the display screen can be switched. It is a flowchart showing the other example of the flow of display control. It is a figure showing the specific example of the setting screen for setting whether the display screen can be switched. It is a flowchart showing the other example of the flow of display control. 3 is a flowchart showing a flow of an operation of transmitting display data in the MFP. 3 is a flowchart showing a flow of an operation of transmitting display data in the MFP. 10 is a flowchart showing another example of the flow of operations for transmitting display data in the MFP. It is a flowchart showing the flow of the operation | movement which switches the display of a terminal device. It is a figure showing the specific example of the setting screen for setting the switching interval of a display. It is a figure for demonstrating the switching interval of a display. It is a flowchart showing the flow of the operation | movement which switches the display of a terminal device. It is a flowchart showing the flow of the operation | movement for updating display data in an image processing system.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

<System configuration>
FIG. 1 is a diagram showing a specific example of the configuration of the image processing system according to the present embodiment.

  Referring to FIG. 1, the image processing system includes an MFP (Multi-Functional Peripheral) 100 as an example of an image forming apparatus, and a terminal device 200. These are electrically connected via a network.

  The terminal device 200 can be any device as long as it is communicable with the MFP 100, can display an operation screen, and can input an instruction from the user, and has a portable size. The terminal device 200 corresponds to, for example, a mobile phone, a tablet-type terminal device, a small computer, or the like.

  The image processing apparatus is not limited to the MFP, and may be other apparatuses such as a printer, a facsimile transceiver, and a copier. The MFP 100 is an image processing apparatus having a combination of these functions.

  An example of the network is a LAN (Local Area Network). As an example, terminal device 200 is wirelessly connected to the network, and MFP 100 is wirelessly or wiredly connected to the network.

<Device configuration>
FIG. 2 is a diagram illustrating a specific example of the hardware configuration of the MFP 100.

  Referring to FIG. 2, MFP 100 includes a CPU (Central Processing Unit) 10 that is an arithmetic device for controlling the whole, and a ROM (Read Only) that stores a program executed by CPU 10 that functions as a memory. (Memory) 11, a RAM (Random Access Memory) 12 for functioning as a work area when the CPU 10 executes a program, an HD (Hard Disk) 16 for storing image data and the like, and a document table (not shown). A scanner 13 for optically reading the original document and obtaining image data; a printer 14 for fixing the image data on the printing paper; and for displaying information and receiving an operation input to the MFP 100 Control of communication via the operation panel 15 including the touch panel and the network 300 Of and a network controller 17.

FIG. 3 is a diagram illustrating a specific example of the hardware configuration of the terminal device 200.
Referring to FIG. 3, terminal device 200 includes CPU 20 that is an arithmetic device for overall control, ROM 21 that functions as a memory, stores a program executed by CPU 20, various information, and the like, and CPU 20. A RAM 22 for functioning as a work area when executing the program, a sensor 23, an operation panel 25 including a touch panel for displaying information and receiving an operation input to the terminal device 200, and a network 300 And a network controller 27 for controlling communication via the network.

  Operation panel 25 may have the same configuration as operation panel 15 of MFP 100. That is, as an example, a touch panel configured by overlapping a display device such as a liquid crystal display device and a position indicating device such as an optical touch panel or a capacitive touch panel, and an operation key are included.

  The operation panel 25 of the terminal device 200 is a specific example of a device that serves as both a display device and an input device. For example, when the terminal device is a mobile phone, a display and a key group may be provided instead of the operation panel 25.

  As will be described later, the sensor 23 is a sensor used to detect whether the terminal device 200 is gripped with one hand or both hands. For example, an electrostatic touch sensor, a strain sensor, a temperature sensor, an electrode, a button, or the like disposed at both ends of the terminal device 200 is applicable. The sensor 23 inputs a sensor signal to the CPU 20 when detecting contact with a hand or the like. The CPU 20 analyzes the sensor signal from the sensor 23 to detect a gripping state whether the terminal device 200 is gripped with one hand or both hands.

  Further, the CPU 20 displays an operation screen on the touch panel based on data for displaying a screen stored in advance. On the touch panel, an indicated position on the operation screen is specified, and an operation signal indicating the position is input to the CPU 20. An operation signal indicating the pressed key is input to the CPU 20. The CPU 20 specifies the operation content from the pressed key or the displayed operation screen and the indicated position, and executes processing based on the specified operation content.

[First Embodiment]
<Overview of operation>
In the image processing system according to the present embodiment, the user can remotely operate MFP 100 using terminal device 200. At this time, the operation screen of MFP 100 is displayed on terminal device 200. The user can issue an instruction command to MFP 100 by operating the operation screen in the same manner as the operation on MFP 100. This function is also referred to as a remote panel function, and in the following description, an operation in the image processing system for remotely operating MFP 100 using terminal device 200 is also referred to as a remote panel operation. Requesting and connecting to the MFP 100 from the terminal device 200 is also referred to as remote panel connection.

(Remote panel operation)
FIG. 4 is a diagram showing a flow of remote panel operation in the image processing system.

  Referring to FIG. 4, when a remote panel connection is made in step S1, the terminal device makes a connection request to MFP. When the MFP confirms the request and determines that the connection is possible, for example, it is a terminal device for which connection is permitted in advance, the MFP notifies the terminal device of connection completion in step S2.

  Subsequently, in step S3, the MFP generates screen data for displaying an operation screen on the terminal device (hereinafter also referred to as display data), and transmits the display data to the terminal device in step S4.

  In step S5, the terminal device displays an operation screen of the MFP using the received display data. When the terminal device accepts the user's operation input on the operation screen, in step S6, the terminal device specifies information (touch event) related to the operation input such as coordinates indicating the instructed position, and in step S7, the information is sent to the MFP. Send to.

  In step S8, the MFP updates (recreates) the operation screen based on the received information such as the touch event. That is, in step S8, the MFP specifies the processing contents when the operation specified by the information related to the operation input from the terminal device is performed on the previously transmitted operation screen, executes the processing, and performs the processing. The operation screen is updated accordingly. In step S9, the MFP transmits the updated display data to the terminal device. Thereafter, this operation is repeated and the remote panel operation proceeds.

(Display control)
In the image processing system, in the above-described remote panel operation, the operation screen displayed on the terminal device is a display for making the screen different depending on whether the terminal device is held with one hand or both hands. Control is performed.

  FIG. 5 is a diagram for explaining the display control according to the first embodiment. It is assumed that a screen (first screen) represented by “A” and a screen (second screen) represented by “a” are associated with a certain operation screen. Screen A, which is the first screen, is an operation screen including an operation input screen of the MFP or a screen close to the display of the MFP. The screen a, which is the second screen, is a screen that displays the contents related to the screen A, and has fewer items to perform operation input than the screen A or does not include items to perform operation input. .

  Referring to FIG. 5, when the terminal device is held with one hand, screen A is displayed on the terminal device. In this case, since the operation can be performed with one hand that does not hold the terminal device, the remote control of the MFP can be performed using an operation screen that is similar to or close to the operation screen of the MFP including items for performing operation input. It is desirable to operate.

  On the other hand, when the terminal device is held with both hands, the screen a is displayed. In this case, since it is difficult to perform a free operation with any hand, it is desirable that the screen does not include items for performing operation input, or has a display screen as few as possible and confirms the setting contents.

  Further, when the terminal device is held with one hand and the screen a is displayed, the display screen is switched to the screen A when the terminal device is held with both hands. On the contrary, when the terminal device is held with both hands and the screen A is displayed, when the terminal device is held with one hand, the display screen is switched to the screen a.

  Among the operation screens of the MFP, on the operation screen in which the first screen and the second screen are associated, the display is switched according to the gripping state as described above. A specific operation screen in which the first screen and the second screen are associated is also referred to as a “specific screen”. In other words, if the operation screen to be displayed in the remote panel operation is a specific screen, either the first screen or the second screen is determined depending on the gripping state of the terminal device. Will be displayed. Further, when the specific screen is displayed on the terminal device, when the gripping state is changed, the display of the terminal device is switched between the first screen and the second screen according to the gripping state.

  6 to 16 are diagrams illustrating specific examples of combinations of the screen A that is the first screen and the screen a that is the second screen.

  Referring to FIG. 6, as a first example, a combination of screen A and screen a includes a document preview screen and a full screen preview screen. That is, a document preview screen is displayed when gripping with one hand, and a full screen preview screen is displayed when gripping with both hands.

  The document preview screen is almost the same as the document preview screen on the MFP, and displays a preview of each page of a document consisting of multiple pages in order according to operations such as page forward and page backward, and enlargement and reduction operations. This is a screen for enlarging the preview display according to. The full screen preview screen is a screen that displays a preview of one page of the document on almost the entire display screen. As shown in FIG. 6, a button for instructing enlargement or reduction or closing of the screen may be included. Preferably, the operation item is displayed as shown in FIG. Is placed at a position where the finger can reach with both hands.

  Referring to FIG. 7, as a second example, a combination of screen A and screen a includes a job setting screen and a job setting content display screen. That is, the job setting screen is displayed when holding with one hand, and the job setting content display screen is displayed when holding with both hands.

  The job setting screen is substantially the same as the job setting screen in the MFP, and is a screen for setting the paper size, document size, printing method, post-processing, and the like for each job. The job setting content display screen is a screen for displaying the setting content of the job being set. As shown in FIG. 7, a button for instructing job switching or closing the screen may be included. Preferably, as shown in FIG. Is placed at a position where the finger can reach with both hands.

  Referring to FIG. 8, as a third example, a combination of screen A and screen a includes a destination setting screen and a destination setting content display screen. In other words, the destination setting screen is displayed when holding with one hand, and the destination setting content display screen is displayed when holding with both hands.

  The destination setting screen is substantially the same as the destination setting screen in the MFP, and is a screen for setting a destination such as a facsimile using numeric keys or character keys. The destination setting content display screen is a screen for displaying the set destination list and the setting content. As shown in FIG. 8, a button for instructing to display or delete details for each destination may be included, but preferably, as shown in FIG. The operation item is arranged at a position where the finger can reach while being held with both hands.

  As a modification of the example of FIG. 8, the screen a may be a destination detail screen as shown in FIG. That is, the destination detail screen may be displayed when grasping with both hands. The destination detail screen is a screen that displays details about the set destination.

  Referring to FIG. 10, as a fourth example, a combination of screen A and screen a includes a job list screen and a content display (job details) screen of a selected job. That is, the job list screen is displayed when holding with one hand, and the content display (job details) screen of the selected job is displayed when holding with both hands.

  The job list screen is substantially the same as the job list screen in the MFP, and is a screen for performing a list of jobs being processed or waiting for processing in the MFP, and instructing and setting processing for each job. The content display (job details) screen of the selected job is a screen that displays the content of the selected job.

  Referring to FIG. 11, as a fifth example, a combination of screen A and screen a includes a job history screen and a content display screen of selected job history. That is, the job history screen is displayed when gripping with one hand, and the content display screen of the selected job history is displayed when gripping with both hands.

  The job history screen is almost the same as the job history screen on the MFP, and is used to give a list of job histories that have been processed by the MFP, and to instruct job reprocessing or deletion for each job history. This is the screen. The content display screen of the selected job history is a screen that displays the content of the selected job history.

  Referring to FIG. 12, as a sixth example, a combination of screen A and screen a includes a storage area document (box document) screen and a selected document setting content display screen. In other words, the box document screen is displayed when gripping with one hand, and the setting content display screen of the selected document is displayed when gripping with both hands.

  The document (box document) screen in the storage area is substantially the same as the box document screen in the MFP, and is stored in a specific storage area associated with a user or user group called a box prepared in the MFP. This is a screen for performing a list of existing document data, an instruction for processing such as printing and transmission, and an instruction for deletion for each document data. The setting content display screen of the selected document is a screen that displays the setting content of the selected document data.

  As a modification of the example of FIG. 12, the screen a may be a detailed screen of the selected document, as shown in FIG. That is, when holding with both hands, a detailed screen of the selected document may be displayed. The selected document details screen is a screen that displays details about the selected document data.

  Referring to FIG. 14, as a seventh example, a combination of screen A and screen a includes a destination selection screen and a destination setting content display screen. That is, a destination selection screen is displayed when gripping with one hand, and a destination setting content display screen is displayed when gripping with both hands.

  The destination selection screen is substantially the same as the destination selection screen in the MFP, and is a screen for selecting a destination to be used from a destination list registered in the MFP. The destination setting content display screen is the same as the screen represented by screen a in FIG.

  As a modification of the example of FIG. 14, as shown in FIG. 15, the screen a may be a selected destination detail screen. That is, the selected destination detail screen may be displayed when grasping with both hands. The destination detail screen is a screen that displays details about the selected destination.

  Referring to FIG. 16, as an eighth example, a combination of screen A and screen a includes a maintenance screen and a maintenance information content display screen. That is, a maintenance screen is displayed when gripping with one hand, and a maintenance information content display screen is displayed when gripping with both hands.

  The maintenance screen is generally the same as the maintenance screen in the MFP, and is a screen for displaying a remaining amount counter for each consumable mounted in the MFP and printing the contents. The maintenance information content display screen is a screen that visualizes and displays maintenance information such as counter data, such as a counter-speaking time series display screen for a selected consumable item.

<Functional configuration>
In the image processing system according to the present embodiment, the display control is performed in the terminal device 200. That is, the terminal device 200 functions as a display control device that performs the display control, or is equipped with a display control device. The same applies to the following description.

  FIG. 17 is a block diagram illustrating a specific example of a functional configuration for the terminal device 200 as a display control device or a display control device mounted on the terminal device 200 to perform the above operation. Each function of FIG. 17 is mainly realized by the CPU 20 when the CPU 20 of the terminal device 200 reads out and executes a program, which is an application for performing display control in the remote panel operation, stored in the ROM 21 on the RAM 22. Is done. However, at least a part may be realized by the hardware configuration shown in FIG. 3 or other electric circuits.

  Referring to FIG. 17, ROM 21 functioning as a memory is provided with a display data storage unit 211 that is a storage area for storing display data that is data for displaying an operation screen.

  Further, referring to FIG. 17, the CPU 20 detects the gripping state of whether the terminal device 200 is gripped with one hand or with both hands, and as a first determination, operates the display target. Via the network controller 27, a determination unit 202 for determining whether the screen is a specific screen in which the associated first screen and second screen are stored in the display data storage unit 211. A data input unit 203 for receiving display data input from the MFP 100 and storing the input display data in the display data storage unit 211, and a readout for reading display data of an operation screen to be displayed from the display data storage unit 211. A display unit 205, a display processing unit 205 for displaying an operation screen on the operation panel 25, which is a display device, using display data, and an input device An instruction input unit 206 for receiving an input of an operation signal in accordance with a user operation input to the operation panel 25, and a transmission unit for transmitting information related to the operation input such as coordinate information to the MFP 100 via the network controller 27. 207.

  When the operation screen to be displayed is a specific screen, the reading unit 204 displays display data of one of the associated first screen and second screen according to the gripping state. Reading from the display data storage unit 211. That is, the reading unit 204 reads the display data of the first screen when it is detected that the terminal device 200 is held with one hand, and the reading unit 204 displays the second screen when it is detected that the terminal device 200 is held with both hands. Read the display data. The display data is transferred to the display processing unit 205, and display processing is performed. Therefore, when the gripping state changes while the specific screen is displayed, the display processing unit 205 switches the display of the terminal device 200 between the first screen and the second screen according to the gripping state.

<Operation flow>
FIG. 18 is a flowchart showing the flow of display control according to the first embodiment. The CPU 20 of the terminal device 200 activates an application for performing display control stored in the ROM 21 of the terminal device 200, thereby reading and executing the control program, which is the application, on the RAM 22 and executing each function shown in FIG. By realizing the above, the operation shown in the flowchart of FIG. 18 is executed.

  Referring to FIG. 18, CPU 20 activates the application and starts a remote panel operation (step S101). Next, the CPU 20 detects the gripping state of the terminal device 200 and determines whether it is gripped with one hand or with both hands (step S103).

  When terminal device 200 is held with both hands (YES in step S103), CPU 20 determines whether or not the displayed operation screen is a specific screen (step S105). Here, CPU20 judges whether it is a specific screen based on whether the 1st screen and the 2nd screen are linked | related and memorize | stored.

  As a result, when the displayed operation screen is a specific screen (YES in step S105), the CPU 20 determines a second screen (screen a) when the displayed operation screen is held with both hands. (Step S107). CPU20 receives the operation input from the user with respect to the displayed screen (step S109).

  While the remote panel operation is continued (NO in step S111), the CPU 20 repeats the above steps S103 to S109. Then, when the remote panel operation ends (YES in step S111), the CPU 20 ends the series of operations.

<Effect of the first embodiment>
By performing the above display control in the terminal device 200 as a display control device, the display screen is automatically switched according to the gripping state of the terminal device 200 when the specific screen is displayed in the remote panel operation. In other words, an operation screen is displayed when holding with one hand, and when switching to gripping with both hands, the screen automatically switches to a confirmation screen that does not include input items or has few. Thereby, natural operability can be provided to the user, and the operation efficiency can be remarkably improved.

<Modification>
In the above description, the display control device is mounted on the terminal device 200, or the terminal device 200 functions as a display control device. However, the display control apparatus may be present in any image processing system. That is, the MFP 100 may be equipped with a display control device, or the MFP 100 may function as a display control device, or the image processing device may be included in the image processing device as a device different from the MFP 100 and the terminal device 200. This modification is the same in the following embodiments.

[Second Embodiment]
<Overview of operation>
In the remote panel operation, when the MFP enters a predetermined state, a screen (third screen) for notifying the state is displayed. A state defined in advance is also referred to as a “specific state”.

  “Specific status” includes statuses that require notification, such as when the MFP is operating such as reading, printing, transmission, or reception, or when a problem such as a paper jam or out of toner has occurred. Applicable. The third screen is a screen for informing the state of the MFP, and is prepared in advance in association with the state of the MFP. Specifically, the third screen corresponds to a preview screen of an image to be read or printed or a screen to display a transmission / reception destination when a specific state is in operation as described above. In addition, when the specific state is a state in which the above trouble has occurred, the third screen corresponds to a screen for presenting information for solving the trouble.

  In the display control according to the second embodiment, when the terminal device is held with one hand in the above-described remote panel operation, the operation screen of the MFP is displayed on the terminal device. On the other hand, when the terminal device is held with both hands and in the above specific state, the third screen is displayed.

  Further, when the terminal device is held with one hand and the operation screen is displayed, when the MFP is in the above-described specific state when the operation screen is displayed, the display screen is the third screen. Switch to On the contrary, when the MFP is in the specific state and the terminal device is held with both hands and the third screen is displayed, the display screen is switched to the operation screen.

<Functional configuration>
The functional configuration for the terminal device 200 as the display control device or the display control device mounted on the terminal device 200 to perform the above operation is the same as the functional configuration shown in the block diagram of FIG.

  In the terminal device 200 according to the second embodiment, the display data storage unit 211 stores display data of a third screen that is associated with a specific state of the MFP 100 and is a screen for informing the state. ing. The display data of the third screen may be stored in advance in the display data storage unit 211, or when the terminal device 200 requests the MFP 100, the data input unit 203 receives from the MFP 100, It may be stored in the display data storage unit 211. Further, it may be transmitted from MFP 100 according to its own state.

  Determination unit 202 determines whether MFP 100 is in a specific state as a second determination. The result of this determination may be obtained by the terminal device 200 inquiring the MFP 100 at a predetermined timing such as a fixed interval and analyzing the response. Alternatively, the result of this determination can be obtained by detecting the reception of the display data as a notification of a specific state when display data is sent from MFP 100 according to its own state as described above. Also good.

  When the MFP 100 is in a specific state, the reading unit 204 displays display data on one of the operation screen and the third screen in accordance with the gripping state of the terminal device 200. The display data storage unit Read from 211. That is, reading unit 204 reads the operation screen display data when it is detected that terminal device 200 is held with one hand, and when terminal device 200 is held with both hands and MFP 100 is in a specific state. Read the display data of the third screen. The display data is transferred to the display processing unit 205, and display processing is performed. Therefore, display processing unit 205 displays the operation screen of MFP 100 on terminal device 200, and when the gripping state changes while MFP 100 is in a specific state, display of terminal device 200 is displayed on the operation screen of MFP 100. And the third screen according to the gripping state.

<Operation flow>
FIG. 19 is a flowchart showing the flow of display control according to the second embodiment. The CPU 20 of the terminal device 200 activates an application for performing display control stored in the ROM 21 of the terminal device 200, thereby reading and executing the control program, which is the application, on the RAM 22 and executing each function shown in FIG. By realizing the above, the operation shown in the flowchart of FIG. 19 is executed.

  Referring to FIG. 19, CPU 20 activates the application and starts a remote panel operation (step S201). Next, the CPU 20 detects the gripping state of the terminal device 200 and determines whether it is gripped with one hand or with both hands (step S203).

  When terminal device 200 is held with both hands (YES in step S203), CPU 20 determines whether MFP 100 is in a specific state (step S205). Here, the CPU 20 may inquire about the state of the MFP 100, or may determine by analyzing the notification from the MFP 100.

  As a result, when MFP 100 is in a specific state (YES in step S205), CPU 20 switches the operation screen being displayed to a third screen that is a screen for notifying the state of MFP 100 (step S207). CPU20 receives the operation input from the user with respect to the displayed screen (step S209).

  The CPU 20 repeats the above steps S203 to S209 while the remote panel operation is continued (NO in step S211). Then, when the remote panel operation ends (YES in step S211), the CPU 20 ends the series of operations.

  After the above operation, when the specific state of MFP 100 returns to the normal state, the display of terminal device 200 may be returned to the original display. The operation flow in this case is shown in FIG.

  That is, referring to FIG. 20, after the display of terminal device 200 is switched to the third screen in step S207, it is determined whether MFP 100 is no longer in the specific state (step S213). As a result, when MFP 100 is no longer in a specific state (YES in step S213), CPU 20 returns the third screen being displayed to the original operation screen (step S215). Thereafter, similarly, the CPU 20 receives an operation input from the user for the displayed screen (step S217), and repeats the above steps S203 to S217 while the remote panel operation is continued (NO in step S219). And CPU20 will complete | finish a series of operation | movement, if remote panel operation | movement is complete | finished (it is YES at step S219).

<Effects of Second Embodiment>
When the display control is performed in the terminal device 200 as a display control device, when the MFP 100 enters a specific state requiring notification in the remote panel operation, the display screen is displayed according to the gripping state of the terminal device 200. Switch automatically. That is, an operation screen is displayed when gripping with one hand, and when switching to gripping with both hands, the screen is automatically switched to a screen for informing the above state.

  For example, when the user performs an operation of instructing a reading operation by holding the terminal device 200 with one hand and then switching to holding with both hands, the MFP 100 starts the document reading operation and is in a reading operation state. The terminal device 200 displays a third screen for informing the reading operation of previewing the read original as shown in FIG.

  Further, when the user grips the terminal device 200 with one hand and performs some operation and then switches to gripping with both hands, there is a problem that the MFP 100 has a shortage of consumables (staple needles in the illustrated example). As shown in FIG. 22, a third screen for displaying that fact and the solution procedure is displayed. As shown in FIG. 22, the third screen may be a screen that notifies the trouble solving procedure by animation.

  Thereby, natural operability can be provided to the user, and the operation efficiency can be remarkably improved.

[Third Embodiment]
<Overview of operation>
The display control according to the first embodiment and the display control according to the second embodiment described above may be combined. That is, as display control according to the third embodiment, whether or not the operation screen to be displayed is a specific screen and whether or not the MFP is in a specific state according to the gripping state of the terminal device. Or the display screen may be switched according to the above.

<Functional configuration>
As a functional configuration for performing display control according to the third embodiment, the determination unit 202 of the terminal device 200 determines whether the operation screen to be displayed is a specific screen, which is the first determination described above. Both determination and determination as to whether the state of MFP 100 is a specific state, which is the second determination, are performed.

  When the operation screen to be displayed is a specific screen, the reading unit 204 reads the display data of the first screen when it is detected that the terminal device 200 is held with one hand, and is read with both hands When is detected, the display data of the second screen is read out. Further, when the MFP 100 is in a specific state, the reading unit 204 reads the display data of the third screen when the terminal device 200 is held with both hands.

  When the operation screen to be displayed is a specific screen and the MFP 100 is in a specific state, when it is detected that the terminal device 200 is held with both hands, the reading unit 204 displays the second screen. It is conceivable to read out either the display data or the display data of the third screen. In this case, it is set in advance which screen is to be preferentially read, that is, whether priority is given to switching to a screen display corresponding to a specific screen or switching to a screen display corresponding to a specific state. Alternatively, a rule for determining which to prioritize may be set in advance, and may be determined each time according to the rule.

<Operation flow>
23 to 25 are flowcharts showing the flow of display control according to the third embodiment, respectively. FIG. 23 shows a flow of operation when priority is given to switching to a screen display corresponding to a specific screen, and FIG. 24 shows a flow of operation when priority is given to switching to screen display corresponding to a specific state. Reference numeral 25 represents the flow of operation when deciding which one has priority each time.

  That is, when priority is given to switching to a screen display corresponding to a specific screen, with reference to FIG. 23, the CPU 20 activates the application and starts a remote panel operation (step S301). Next, the CPU 20 detects the gripping state of the terminal device 200 and determines whether it is gripped with one hand or with both hands (step S303).

  When terminal device 200 is held with both hands (YES in step S303), CPU 20 determines whether or not the displayed operation screen is a specific screen (step S305). Further, CPU 20 further determines whether MFP 100 is in a specific state (steps S307 and S311).

  As a result, if the displayed operation screen is a specific screen (YES in step S305), whether or not MFP 100 is in a specific state (YES in step S307, NO) is being displayed. The operation screen is switched to the second screen which is a screen displayed when both hands are gripped (step S309).

  On the other hand, if the displayed operation screen is not a specific screen (NO in step S305), if MFP 100 is in a specific state (YES in step S311), CPU 20 displays the displayed operation screen as MFP 100. The screen is switched to a third screen that is a screen for notifying the state (step S313). If MFP 100 is not in a specific state (NO in step S311), CPU 20 continues the displayed screen without switching the display.

  Thereafter, similarly, the CPU 20 receives an operation input from the user on the displayed screen (step S315), and repeats the above steps S303 to S315 while the remote panel operation is continued (NO in step S317). And CPU20 will complete | finish a series of operation | movement, if remote panel operation | movement is complete | finished (it is YES at step S317).

  When priority is given to switching to a screen display corresponding to a specific state, referring to FIG. 24, if MFP 100 is in a specific state (YES in step S307, YES in step S311), the display is displayed. Whether or not the operation screen is a specific screen (YES or NO in step S305), CPU 20 switches the displayed operation screen to a third screen that is a screen for notifying the state of MFP 100 ( Step S309 ′, Step S313).

  On the other hand, when MFP 100 is not in a specific state, if the displayed operation screen is the specific screen (YES in step S305 and NO in step S307), CPU 20 holds the displayed operation screen with both hands. If the operation screen being displayed is not a specific screen (NO in step S305 and NO in step S311), the CPU 20 switches the display. Continue the displayed screen without performing.

  When determining which to give priority each time, with reference to FIG. 25, the displayed operation screen is a specific screen (YES in step S305), and MFP 100 is in a specific state ( CPU20 confirms the set rule and determines whether to switch to the screen display corresponding to the specific screen or to switch to the screen display corresponding to the specific state (step S401).

  As a result, when it is determined that switching to the screen display corresponding to the specific screen is set (YES in step S401), the CPU 20 is the screen when the currently displayed operation screen is held with both hands. Is switched to the second screen (step S403). When that is not right (it is NO at step S401), CPU20 switches the operation screen in display to the 3rd screen which is a screen for notifying the state of MFP100 (step S405).

  Note that whether or not to switch the display screen according to the gripping status of the terminal device 200 may be set for each operation screen. For example, as shown in FIG. 26, this setting may be made on the basis of a user operation input by providing means such as a setting button 251 for setting ON / OFF of switching for each operation screen. . When switching OFF is set by the above means for the displayed operation screen, the CPU 20 stores the switching OFF in association with the operation screen (for example, using a flag) and displays the operation screen. Even if the condition for switching is satisfied, the display is not switched.

  FIG. 27 is a flowchart showing the flow of display control in this case. That is, referring to FIG. 27, in this case, the PCU 20 starts the remote panel operation (step S501), and even when it is detected that the gripping state of the terminal device 200 is gripped with both hands (step S501). If switching OFF is not set (NO in step S505), the CPU 20 switches the display (step S507), and if switching OFF is set for the displayed operation screen (step S505). The display is continued without switching the display screen (step S507).

  Alternatively, whether or not to switch the display screen according to the gripping status of the terminal device 200 may be set collectively. Furthermore, switching to screen display corresponding to a specific screen and switching to screen display corresponding to a specific state may be individually settable. For example, as shown in FIG. 28, this setting includes switching between screen display corresponding to a specific screen and switching to screen display corresponding to a specific state in a screen for setting screen display switching. You may make it set ON / OFF about each. The CPU 20 stores the setting for each switching, and does not switch the display when the switching is set to OFF even when the switching condition is satisfied during the operation screen display.

  FIG. 29 is a flowchart showing the flow of display control in this case. That is, referring to FIG. 29, in this case, PCU 20 starts the remote panel operation (step S601), and even when it is detected that the gripping state of terminal device 200 is gripped with both hands (step S601). If the switching is not set to OFF all at once (NO in step S605), the CPU 20 switches the display (step S607), and if the switching is set to OFF collectively (step S607). The display is continued without switching the display screen (step S607). In this case, the CPU 20 may not detect the gripping state itself.

<Effect of the third embodiment>
When the display control is performed in terminal device 200 as a display control device, a specific screen is displayed in the remote panel operation, and / or when MFP 100 enters a specific state that requires notification. The display screen is automatically switched according to the gripping status of the terminal device 200. Thereby, natural operability can be provided to the user, and the operation efficiency can be remarkably improved.

[Other description]
(MFP operation)
For example, the display data is generated by MFP 100 at the display timing and transmitted to terminal device 200. 30 and 31 are flowcharts showing the flow of operations for transmitting display data in MFP 100. FIG. FIG. 30 shows an operation for transmitting display data for a specific screen, and FIG. 31 shows an operation for transmitting screen display data for notifying a specific state. The operations shown in these flowcharts are mainly realized by the CPU 10 when the CPU 10 of the MFP 100 reads a program, which is an application for performing a remote panel operation stored in the ROM 21, onto the RAM 12 and executes it. However, at least a part may be realized by the hardware configuration shown in FIG. 2 or other electric circuits.

  Referring to FIG. 30, when the remote panel operation is started in step S701, CPU 10 determines whether or not it is necessary to update the operation screen by performing processing based on information related to operation input from terminal device 200. (Step S703).

  As a result, when a screen transition is necessary (YES in step S703), the CPU 10 determines whether or not the transition destination operation screen is a specific screen (step S705). When the transition destination operation screen is the specific screen (YES in step S705), the CPU 10 generates display data of the first screen for the specific screen (step S707), and also displays the associated second screen. Display data is also generated (step S709).

  The first screen and the second screen are stored in advance in a memory such as the ROM 11, and the CPU 10 may generate display data of the terminal device 200 from the screen by using the specification of the terminal device 200. Good. Alternatively, the first screen is generated using the data of the operation screen (specific screen) to be displayed on the operation panel 15, the display data is generated, and the first screen is simplified. The display data may be generated after the second screen is generated.

  The CPU 10 associates both display data and transmits them to the terminal device 200 (steps S711 and S713).

  If the transition destination operation screen is not a specific screen (NO in step S705), the CPU 10 generates display data of the operation screen (step S715) and transmits it to the terminal device 200 (step S717).

  The CPU 10 repeats the above operation until the remote panel operation is completed, whereby display data of the operation screen is transmitted from the MFP 100 to the terminal device 200 along with the remote panel operation.

  Referring to FIG. 31, when the remote panel operation starts in step S801, CPU 10 determines whether or not MFP 100 is in a specific state (step S803). If MFP 100 is in a specific state (YES in step S803), display data for a third screen, which is a screen for informing the state, is generated (step S805) and transmitted to terminal device 200 (step S805). S807).

  When the CPU 10 repeats the above operation until the remote panel operation ends, when a specific state is reached during the remote panel operation, display data of the third screen for notifying the state is transferred from the MFP 100 to the terminal device. 200 will be transmitted. Further, as shown in this example, when the MFP 100 enters a specific state, the display data of the third screen is transmitted to the terminal device 200, so that the MFP 100 can identify the terminal device 200. It is also notified that the state has been reached.

  As in the third embodiment, MFP 100 may combine the operations of FIG. 30 and FIG. That is, referring to FIG. 32, when the remote panel operation starts in step S901, CPU 10 determines whether or not it is necessary to perform processing based on information related to operation input from terminal device 200 to update the operation screen. Judgment is made (step S903).

  As a result, when a screen transition is necessary (YES in step S903), the CPU 10 determines whether or not the transition destination operation screen is a specific screen (step S905). Further, the CPU 10 determines whether or not the MFP 100 is in a specific state (step S907).

  When the transition destination operation screen is a specific screen and MFP 100 is not in a specific state (YES in step S905 and NO in step S907), CPU 10 displays display data of the first screen for the specific screen. In addition to the generation (step S909), the display data of the associated second screen is also generated (step S911). Then, the CPU 10 associates both display data and transmits them to the terminal device 200 (steps S913 and S915).

  If the transition destination operation screen is a specific screen and MFP 100 is in a specific state (YES in step S905 and YES in step S907), CPU 10 displays the display data of the first screen for the specific screen, and Display data for the second screen is generated (steps S917 and S919), and display data for the third screen is generated (step S921). Then, the CPU 10 transmits these display data to the terminal device 200 (steps S923 to S927).

  When the transition destination operation screen is not a specific screen and MFP 100 is in a specific state (NO in step S905 and YES in step S929), CPU 10 displays the display data of the operation screen and the third screen. Data is generated (step S931, step S933). And CPU10 transmits these display data with respect to the terminal device 200 (step S935, step S937).

  When the transition destination operation screen is not a specific screen and MFP 100 is not in a specific state (NO in step S905 and NO in step S929), CPU 10 generates display data of the operation screen (step S939). And transmitted to the terminal device 200 (step S941).

(Switching display on terminal device)
As described above, the CPU 20 of the terminal device 200 switches the display screen according to the gripping state or the MFP state while the specific screen is being displayed. FIG. 33 is a flowchart showing a flow of an operation in which the CPU 20 switches the display of the terminal device 200.

  Referring to FIG. 33, when the remote panel operation is started in step S1101, CPU 20 detects the gripping state, and when it is gripped with one hand (YES in step S1103), the display data of the second screen Is read and the second screen is displayed (step S1105).

  If the MFP 100 is in a specific state when held by both hands (NO in step S1103 and YES in step S1107), the CPU 20 displays the first screen display data or the third screen. The display data is read out and one of the screens is displayed (step S1109).

  If the MFP 100 is not in a specific state when it is held with both hands (NO in step S1103 and NO in step S1107), the CPU 20 reads the display data of the first screen, Is displayed (step S1111).

  At this time, the CPU 20 may determine whether or not it is necessary to switch the display depending on the gripping state based on the passage of time since the previous switching. That is, the CPU 20 stores the shortest time interval for performing the switching operation shown in FIG. 33 as a fixed time, and switches the operation (determination when the elapsed time from the previous switching is longer than the predetermined time. ), And if it is short, the switching operation (determination) may not be performed.

  The predetermined time may be set according to a user operation input on a setting screen as shown in FIG. 34, for example. Or you may prescribe | regulate.

  Referring to FIG. 35, when the gripping state is switched from gripping with one hand to gripping with both hands and then switching to gripping with one hand after a certain time has elapsed, the CPU 20 displays at the timing when switching to gripping with one hand is performed. It is determined whether or not switching is necessary.

  On the other hand, when the gripping state is switched before a certain time has elapsed since the gripping state is switched from gripping with one hand to gripping with both hands, the CPU 20 does not determine whether or not display switching is necessary due to the switching. This is because, for example, a case where an object hits or the grip state is changed for an extremely short time is assumed, and if the display is switched each time, it becomes difficult for the user to visually recognize the display, which may hinder operability. is there. Therefore, in this case, the CPU 20 determines whether or not display switching is necessary in the gripping state after the predetermined time has elapsed. In the case of the example in FIG. 35, after a predetermined time has elapsed, the display changes from the previous gripping state, and the display is switched at that timing.

  FIG. 36 is a flowchart showing the flow of operations for switching the display of the terminal device 200 in this case. That is, referring to FIG. 36, CPU 20 first detects a change in the gripping state (YES in step S1201) and switches the display screen according to the gripping state (step S1203). To start. Then, when the next change in the gripping state is detected (step S1205), the CPU 20 determines whether or not a certain time has elapsed since the previous display switching (step S1207). As a result, when the predetermined time has not elapsed (NO in step S1207), the CPU 20 does not switch the display screen, and only when the predetermined time has elapsed (YES in step S1207), the display screen is changed. Switching (step S1209).

(Updating display data on the terminal device)
As described above, MFP 100 transmits the display data of the first screen and the display data of the second screen to terminal device 200 when the screen is the specific screen at the timing of updating the operation screen. The terminal device 200 stores (accumulates) the display data, and the display is switched using the display data according to the gripping state.

  When the user inputs an operation to the first screen including the operation item and the display on the screen is updated, the associated second screen may also need to be updated. However, since the update is not reflected in the stored display data of the second screen, it is stored when the grip state changes during the operation of the first screen and the screen is switched to the second screen. If the displayed data is used, the display may not match between the first screen and the second screen.

  In view of this, the terminal device 200 may request the MFP 100 to update the stored display data of the second screen when there is an operation input by the user on the first screen. FIG. 37 is a flowchart showing the flow of operations in the image processing system in that case.

  Referring to FIG. 37, CPU 20 of terminal apparatus 200 receives display data from MFP 100 in step S1301, and displays a first screen based on the display data in step S1303. When the user's operation input for the first screen is received in step S1305, if the MFP 100 is not in a specific state such as a trouble occurrence state (NO in step S1307), the CPU 20 of the terminal device 200 displays information related to the operation input by the user. Is sent to the MFP 100, and the update of the first screen is requested (step S1309). At this time, if the display data of the second screen is already stored (accumulated) in terminal device 200 (YES in step S1311), CPU 20 requests MFP 100 to update the second screen as well (step S1311). S1313).

  In response to this request, CPU 10 of MFP 100 creates display data for the updated first screen and second screen (step S1315), and transmits the display data to terminal device 200 (step S1317). . At this time, if there is no need to update at least one of the first screen and the second screen, the CPU 10 may not create and transmit display data.

(Other examples)
Furthermore, it is possible to provide a program (application) for causing the CPU 20 of the terminal device 200, the CPU 10 of the MFP 100, or a CPU of another device (not shown) to function as a display control device. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  A program according to the present invention is a program module that is provided as a part of an operating system (OS) of a computer and that executes necessary processes by calling necessary modules in a predetermined arrangement at a predetermined timing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program such as a remote panel operation execution program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  10, 20 CPU, 11, 21 ROM, 12, 22 RAM, 13 scanner, 14 printer, 15, 25 operation panel, 17, 27 network controller, 23 sensor, 100 MFP, 200 terminal device, 201 detection unit, 202 determination unit , 203 data input unit, 204 reading unit, 205 display processing unit, 206 instruction input unit, 207 transmission unit, 211 display data storage unit, 251 setting button, 300 network.

Claims (17)

A display control device that performs control for displaying an operation screen of an image forming apparatus on a terminal device,
A reading means for reading out the display data from a storage device for storing display data of the operation screen of the image forming apparatus;
Display means for displaying an operation screen on the terminal device using the display data;
Detection means for detecting whether the terminal device is held with one hand or with both hands;
The operation screen includes first determination means for determining whether or not the associated first screen and second screen are specific operation screens stored in the storage device. ,
In the case where the operation screen is the specific operation screen, the reading unit selects one of the first screen and the second screen associated with each other in accordance with a gripping state of the terminal device. A display control device that reads display data of one screen. The first screen is an operation screen of the image forming apparatus and includes an operation input item, and the second screen is a screen that displays contents related to the first screen. A screen with fewer items for operation input than the first screen;
The reading means reads the display data of the first screen when the terminal device is held with one hand, and reads the display data of the second screen when the terminal device is held with both hands. Display control device.   The display means displays the terminal device according to the gripping state between the first screen and the second screen when the gripping state changes while the specific operation screen is displayed. The display control device according to claim 2, wherein the display control device is switched. The image forming apparatus further includes a second determination unit for determining whether or not the image forming apparatus is in a predetermined state.
When the image forming apparatus is in the predetermined state, the reading unit is configured to select either the first screen or the second screen according to a gripping state of the terminal device. The display data of any one screen of one screen or the third screen stored in the storage device in association with the predetermined state is read out. The display control apparatus described. The third screen is a screen for informing a state of the image forming apparatus,
The reading unit reads display data of the second screen or the third screen when the terminal device is held with both hands and the image forming apparatus is in the predetermined state. The display control apparatus according to claim 4.   When the terminal device is gripped with both hands and the image forming apparatus is in the pre-defined state, the reading unit is preliminarily selected from the second screen and the third screen. The display control device according to claim 4 or 5, wherein display data of one of the screens is read out in a method according to a set rule.   The display unit displays the display of the terminal device between the first screen or the second screen and the third screen when the state of the image forming apparatus changes while the operation screen is displayed. The display control device according to claim 5, wherein the display control device switches between them according to the state of the image forming apparatus.   The display control device according to claim 3, further comprising setting means for receiving a setting as to whether or not to switch display of the terminal device on the display means.   The display control apparatus according to claim 8, wherein the setting unit accepts a setting as to whether or not to switch display of the terminal device on the display unit for each operation screen of the image forming apparatus.   4. The display unit according to claim 3, wherein the display unit does not switch the display of the terminal device even when the gripping state changes within a prescribed time after switching the display destination of the terminal device. Display control device. The combination of the first screen and the second screen is:
Document preview screen and full screen preview screen,
Job setting screen and job setting content display screen,
Address setting screen and address setting details display screen,
Job list screen and selected job content display screen,
Job history screen and selected job history content display screen,
A storage area document screen and a selected document setting content display screen;
Address selection screen and selected address display screen,
The display control apparatus according to claim 1, which is one of a maintenance screen and a maintenance information content display screen. The combination of the predefined state and the third screen is:
Document scanning status and scanned document preview screen,
The display control device according to claim 4, wherein the display control device is one of a trouble occurrence state and a trouble handling screen. An image forming apparatus equipped with the display control device according to claim 1,
Transmitting means for transmitting operation screen display data to the terminal device;
Processing means for receiving information relating to an operation on the displayed operation screen from the terminal device, and updating the operation screen by executing a process specified from the displayed operation screen and the operation; In addition,
When the updated operation screen is the specific operation screen, the transmission unit displays display data of the associated first screen and the second screen as display data of the specific operation screen. An image forming apparatus that transmits to the terminal device.   The said transmission means transmits the display data of the 3rd screen memorize | stored in relation to the said state with respect to the said terminal device, when it will be in the state prescribed | regulated previously. Image forming apparatus. A terminal device equipped with the display control device according to claim 1,
Receiving means for receiving display data of an operation screen from the image forming apparatus and storing it in the storage device;
Instruction means for accepting an operation input to the operation screen displayed on the terminal device;
A transmission means for transmitting information related to the operation input to the image forming apparatus;
When the one screen is updated according to the operation input on one of the first screen and the second screen displayed by the display means, the one screen is associated with the one screen and the A terminal device that requests display data of the other screen stored in the storage device and updated display data corresponding to the update to the image forming apparatus. A method for displaying an operation screen of an image forming apparatus on a terminal device,
Detecting the gripping state of whether the terminal device is gripped with one hand or with both hands;
The operation screen to be displayed on the image forming apparatus stores a first screen and a second screen associated with each other in a storage device that stores display data on the operation screen of the image forming apparatus. Determining whether it is an operation screen;
When the operation screen to be displayed is the specific operation screen, one of the first screen and the second screen associated with each other according to the gripping state of the terminal device Reading display data of the screen from the storage device and displaying it on the terminal device. A program for causing a computer to execute a process of displaying an operation screen of an image forming apparatus on a terminal device and causing the computer to function as a display control device,
Detecting the gripping state of whether the terminal device is gripped with one hand or with both hands;
The operation screen to be displayed on the image forming apparatus stores a first screen and a second screen associated with each other in a storage device that stores display data on the operation screen of the image forming apparatus. Determining whether it is an operation screen;
When the operation screen to be displayed is the specific operation screen, one of the first screen and the second screen associated with each other according to the gripping state of the terminal device A display control program that causes the computer to execute display of screen display data from the storage device and display on the terminal device.

Images