JP6233582B2 - Interlocking display system, image processing apparatus and program thereof, and interlocking display method - Google Patents

Description

  The present invention relates to a linked display system that links a screen of a portable terminal and a screen of an image processing apparatus, an image processing apparatus, a program thereof, and a linked display method.

  In recent years, MFPs (Multi Function Peripherals) such as image forming apparatuses having functions such as printers, scanners, and facsimiles have been designed to save power consumption of the MFP with less power consumption than usual from the viewpoint of energy saving. It often has a function to shift to the power mode. For example, MFPs that shift to a power saving mode when a specified time (for example, one minute) has elapsed in a standby state, such as a state in which an operation is not accepted or a job is not being executed, are generally widely used.

  However, when the MFP frequently shifts to the power saving mode, the user must return the MFP from the power saving mode every time the MFP is used. Therefore, a plurality of techniques for limiting the transition to the power saving mode have been proposed.

  For example, Patent Document 1 discloses a method for preventing an MFP from entering a sleep mode while a setting input is being performed by a PC (Personal Computer) printer driver (see Patent Document 1). ).

  Further, Patent Document 2 discloses that an MFP shifts to a power saving mode without impairing the user's convenience by confirming whether or not the client device that transmits the job is permitted to shift to the power saving mode. A method is disclosed.

JP 2006-221427 A JP 2012-085091 A

  By the way, a user may use a portable terminal such as an MFP and a tablet at the same time. For example, the user arranges the display unit of the MFP and the portable terminal side by side, and uses the two display units to display one large screen, or an explanation (guidance) screen for operations on the screen displayed by the MFP. On your mobile device. In the above-described example, when one of the screens is switched, the display contents of both devices are linked so that the other screen is switched.

  When the user uses the MFP and the portable terminal at the same time and links the display contents of both apparatuses, if the operation on the MFP is not performed for a certain period of time, such as by slowly checking the contents displayed on the portable terminal, the MFP Will shift to power saving mode. In that case, the user needs to release the power saving mode and wait until the operation becomes possible. Further, when resetting the setting contents that have been performed when the MFP shifts to the power saving mode, the user has to redo the setting. Therefore, even in such a case, it is necessary to limit the transition to the power saving mode.

  The method disclosed in Patent Document 1 does not support the case where the display contents of the screen displayed by the PC and the screen displayed by the MFP are linked.

  Note that if the display mode of the MFP and the portable terminal is shifted to a display mode in which the display contents of both screens are linked (referred to as a linked display mode), regardless of whether both devices are in use, the power saving mode Although a method of prohibiting the transition to is assumed, power is wasted if both devices are not used during the interlocking display mode.

  Further, in the method described in Patent Document 2, before the MFP shifts to the power saving mode, it is asked whether or not to shift to the power saving mode. Therefore, when the user operates only on the mobile terminal side while the display contents of the MFP and the mobile terminal are linked, the mobile terminal is often asked whether the MFP is allowed to enter the power saving mode. The convenience of the user who operates a portable terminal will be impaired.

  The present invention is intended to solve the above problem, and when using an image processing device and a portable terminal, while the display contents of the screens of both devices are linked, An object of the present invention is to provide an interlocking display system, an image processing apparatus, a program thereof, and an interlocking display method that prevent the transition of the image processing apparatus to the power saving mode and ensure user convenience even if the image processing apparatus is not used.

  The gist of the present invention for achieving the object lies in the inventions of the following items.

[1] an image processing apparatus;
A mobile device,
A power saving control unit that switches the power mode of the image processing apparatus between a normal mode and a power saving mode that consumes less power than the normal mode;
When any one of the screens displayed by the image processing device and the mobile terminal is switched, a linked display control unit that performs linked display control for switching the other screen;
A monitoring unit that determines whether each of the image processing device and the mobile terminal is in use;
With
The power saving control unit determines that the linked display control unit is executing the linked display control, and the monitoring unit determines that at least one of the image processing apparatus and the portable terminal is in use. In the case of the power processing mode of the image processing apparatus, switching from the normal mode to the power saving mode is prohibited, and the monitoring unit is configured to execute the interlocking display control while the interlocking display control unit is executing the interlocking display control. And the image processing apparatus, the power display mode of the image processing apparatus is switched from the normal mode to the power saving mode .

  In the invention according to the above [1] and the following [10] and [20], either the display of the image processing apparatus capable of switching the power mode between the normal power mode and the power saving mode, or the display of the portable terminal is selected. When the screen is switched, linked display control is performed so that the other screen is switched. When the interlocking display control is being executed and at least one of the image processing apparatus and the portable terminal is in use, the power mode of the image processing apparatus is changed from the normal power mode to the power saving mode. Do not switch. As a result, when the linked display control is being executed and only one of the image processing device and the portable terminal is in a long time, the image processing device shifts to the power saving mode. Can be prevented from occurring.

  In linked display control, for example, one large screen is displayed using two display units, or another screen related to one screen is displayed on the other.

[2] The power saving control unit can switch the power mode of the mobile terminal between a normal mode and a power saving mode with less power consumption than the normal mode,
When the interlocking display control unit is executing the interlocking display control and the monitoring unit determines that at least one of the image processing device and the portable terminal is in use, the image processing For both power modes of the device and the portable terminal, switching from the normal mode to the power saving mode is prohibited, and the monitoring unit is connected to the portable terminal while the linked display control unit is executing the linked display control. The linked display system according to [1] , wherein when it is determined that both of the image processing apparatuses are not used, the power mode of the mobile terminal is switched from the normal mode to the power saving mode .

  In the invention according to the above [2] and the following [11] and [21], the portable terminal can also be switched between the normal power mode and the power saving mode. When the interlock display control is being executed and at least one of the image processing apparatus and the portable terminal is in use, the power mode of the image processing apparatus and the portable terminal is omitted from the normal power mode. Do not switch to power mode. Thereby, when only one of the image processing apparatus and the portable terminal is used for a long time, it is possible to prevent a situation in which the other shifts to the power saving mode.

[3] The linked display control unit performs the linked display control on a setting screen displayed on the image processing apparatus and a guidance screen displayed on the mobile terminal and corresponding to the setting screen. The interlocking display system according to [1] or [2], which is characterized.

  In the inventions according to [3] and [12] and [22] below, when linked display control is performed, the image processing apparatus displays a setting screen, and the portable terminal displays a guidance screen corresponding to the setting screen. For example, while the image processing apparatus is displaying a setting screen related to copying, the portable terminal displays a guidance screen related to copying.

[4] When the linked display control unit executes the linked display control when at least one of the image processing apparatus and the mobile terminal receives a setting operation from a user, the linked display control unit When the operation is completed, the execution of the interlocked display control is terminated. The interlocked display system according to any one of [1] to [3].

  In the invention according to the above [4] and the following [13] and [23], when the display processing is being executed when the image processing apparatus is receiving a setting operation from the user, when the setting operation is completed, Ends the execution of linked display control. For example, when the setting completion button is pressed or when a job start instruction related to the setting operation is received, it is recognized that the setting operation has been completed.

[5] The monitoring unit includes a detection result of a gaze detection unit that detects a user's gaze, a detection result of a tilt sensor unit that detects a tilt of the mobile terminal, and a situation of an operation that the mobile terminal receives from the user. The linked display system according to any one of [1] to [4], wherein whether or not the portable terminal is in use is determined based on at least one.

  In the inventions according to the above [5] and the following [14] and [24], the detection result of the gaze detection unit that detects the user's gaze, the detection result of the tilt sensor unit that detects the tilt of the mobile terminal, and the mobile terminal from the user Based on at least one of the received operation statuses, it is determined whether or not the mobile terminal is in use. For example, when it is recognized that the user's line of sight is directed toward the mobile terminal, or when the display surface of the mobile terminal is recognized as being upward, a predetermined time has elapsed since the last operation was received. If the mobile terminal is not in use, it is determined that the mobile terminal is in use.

[6] The monitoring unit is used by the image processing apparatus based on at least one of a detection result of a line-of-sight detection unit that detects a user's line of sight or an operation state received by the image processing apparatus from the user. It is determined whether or not it is medium. The interlocking display system according to any one of [1] to [5].

  In the invention according to the above [6] and the following [15] and [25], at least one of a detection result of a line-of-sight detection unit that detects a user's line of sight or an operation state received by the image processing apparatus from the user. Based on this, it is determined whether or not the image processing apparatus is in use. For example, the image processing apparatus is in use when it is recognized that the user's line of sight is directed toward the image processing apparatus or when a predetermined time has not elapsed since the last operation was received. Judge.

[7] The power saving control unit independently sets a power mode of the image processing device based on whether the image processing device is in use or not, if the interlocking display control unit is not executing the interlocking display control. [2] or [2] cited in [3] to [6], wherein the power mode of the mobile terminal is controlled independently based on whether the mobile terminal is in use or not The interlocking display system as described in any one.

  In the invention according to the above [7] and the following [16] and [26], when the interlocking display control is not executed, the power mode of the image processing device is independently set based on whether or not the image processing device is in use. And the power mode of the mobile terminal is independently controlled based on whether the mobile terminal is in use. That is, when the interlocking display control is not executed, the unused device shifts to the power saving mode.

[8] When the linked display control unit determines that both the portable terminal and the image processing apparatus are not used while the linked display control unit is executing the linked display control, Switching the power mode of both the portable terminal and the image processing device from the normal mode to the power saving mode,
Thereafter, when returning to the normal mode, the power saving control unit returns both the portable terminal and the image processing device to the normal mode, and the interlocking display control unit executes the interlocking display control. The interlocking display system according to any one of [3] to [6], or [7], in which [2] or [2] is cited.

  In the invention according to the above [8] and the following [17] and [27], when both the image processing apparatus and the portable terminal are not used during the execution of the interlocking display control, both are shifted to the power saving mode. Thereafter, when returning to the normal mode, both the portable terminal and the image processing apparatus are returned to the normal mode, and the execution of the interlocked display control is resumed. That is, during the execution of the interlocked display control, the image processing apparatus and the portable terminal are shifted to the power saving mode together or returned from the power saving mode.

[9] A distance determination unit that determines whether a distance between the portable terminal and the image processing apparatus is equal to or greater than a predetermined value,
The interlocking display control unit prohibits execution of the interlocking display control when the distance determination unit determines that the distance between the portable terminal and the image processing apparatus is equal to or greater than a predetermined value. The interlocking display system according to any one of [1] to [8].

  In the invention according to the above [9] and the following [18] and [28], when it is determined that the distance between the mobile terminal and the image processing apparatus is equal to or greater than a predetermined value, execution of the interlocked display control is prohibited. The predetermined value is, for example, a distance that allows the user to use the portable terminal and the image processing apparatus at the same time.

[10] a display unit;
An operation unit;
An image processing unit for performing predetermined image processing;
A communication unit that transmits and receives data to and from the mobile terminal;
A power saving control unit that switches the power mode of the device to a normal mode and a power saving mode that consumes less power than the normal mode;
When any one of the screens displayed on the display unit and the mobile terminal is switched, a linked display control unit that performs linked display control for switching the other screen;
A monitoring unit that determines whether each of the device and the mobile terminal is in use;
With
The power saving control unit, when the linked display control unit is executing the linked display control, and the monitoring unit determines that at least one of the own device and the portable terminal is in use Prohibits switching from the normal mode to the power saving mode for the power mode of the own device, and the monitoring unit controls the mobile terminal and the own device while the linked display control unit is executing the linked display control. An image processing apparatus , wherein when it is determined that both are not used, the power mode of the own apparatus is switched from the normal mode to the power saving mode .

[11] The mobile terminal can switch the power mode between a normal mode and a power saving mode with less power consumption than the normal mode,
The power saving control unit, when the linked display control unit is executing the linked display control, and the monitoring unit determines that at least one of the own device and the portable terminal is in use , for the power mode of the apparatus, from said normal mode with prohibits switching to the power saving mode, and instructs the prohibition of the switching of the from the normal mode to the mobile terminal to the power saving mode, the interlocking display control When the monitoring unit determines that both the mobile terminal and its own device are not used during execution of the interlocking display control, the mobile terminal instructs the mobile terminal to switch from the normal mode to the power saving mode. The image processing apparatus according to [10], wherein:

[12] The linked display control unit performs the linked display control on a setting screen displayed on the display unit and a guidance screen displayed on the mobile terminal and corresponding to the setting screen. The image processing apparatus according to [10] or [11].

[13] When the interlocking display control unit is executing the interlocking display control when at least one of the device and the mobile terminal is receiving a setting operation from a user, the setting operation is performed. When completed, the execution of the interlocked display control is terminated. The image processing apparatus according to any one of [10] to [12],

[14] The monitoring unit includes: a detection result of a gaze detection unit that detects a gaze of the user; a detection result of a tilt sensor unit that detects a tilt of the mobile terminal; and a situation of an operation that the mobile terminal has received from the user. The image processing apparatus according to any one of [10] to [13], wherein whether or not the portable terminal is in use is determined based on at least one.

[15] The monitoring unit determines whether or not the own device is in use based on at least one of a detection result of the gaze detection unit that detects a user's gaze or an operation state received by the own device from the user. The image processing apparatus according to any one of [10] to [14], wherein:

[16] The power saving control unit independently controls the power mode of the own device based on whether or not the own device is in use unless the interlocked display control unit is executing the interlocked display control. The image processing apparatus according to any one of [12] to [15], wherein [11] or [11] is cited, wherein the power mode of the mobile terminal is controlled independently by the mobile terminal.

[17] When the linked display control unit determines that both the mobile terminal and the own device are not used while the linked display control unit is executing the linked display control, And switching the power mode from the normal mode to the power saving mode, and switching the power mode of the mobile terminal from the normal mode to the power saving mode,
Thereafter, when returning to the normal mode, the power saving control unit returns both the mobile terminal and the own device to the normal mode, and the interlocked display control unit resumes execution of the interlocked display control. The image processing apparatus according to any one of [12] to [15], or [16], in which [11] or [11] is cited.

[18] A distance determination unit that determines whether or not a distance between the mobile terminal and the device itself is a predetermined value or more,
The interlocking display control unit prohibits execution of the interlocking display control when the distance determination unit determines that the distance between the mobile terminal and the device itself is a predetermined value or more. ] To [17] The image processing apparatus according to any one of [17].

[19] A program that causes an information processing apparatus to operate as the image processing apparatus according to any one of [10] to [18].

[20] Either one of a screen displayed by the image processing apparatus that can switch the power mode between the normal mode and the power saving mode that consumes less power than the normal mode, and a screen displayed by the portable terminal. When switching, during the execution of the linked display control for switching the other screen, it is determined whether or not each of the image processing device and the portable terminal is in use, and at least one of the image processing device and the portable terminal When one of them is determined to be in use, the power mode of the image processing apparatus is prohibited from switching from the normal mode to the power saving mode, and both the portable terminal and the image processing apparatus are used. If it is determined that there is no interlocking display, characterized in that switching to the power saving mode the power mode of the image processing apparatus from the normal mode Law.

[21] The mobile terminal can switch the power mode of the mobile terminal between a normal mode and a power saving mode with less power consumption than the normal mode,
When it is determined that at least one of the image processing apparatus and the portable terminal is in use during the execution of the interlocked display control, the power mode of the portable terminal is further changed from the normal mode to the saving mode. When switching to the power mode is prohibited and it is determined that both the mobile terminal and the image processing apparatus are not used, the power mode of the mobile terminal is further switched from the normal mode to the power saving mode. The interlocking display method according to [20], which is characterized.

[22] The linked display control is performed on a setting screen displayed on the image processing apparatus and a guidance screen corresponding to the setting screen displayed on the portable terminal. [20] or [20] 21].

[23] When at least one of the image processing device and the mobile terminal is receiving the setting operation from the user and performing the interlocking display control, when the setting operation is completed, the interlocking is performed. Execution of display control is terminated. The interlocking display method according to any one of [20] to [22].

[24] At least one of detection of a user's line of sight, detection of the tilt of the mobile terminal, and detection of an operation received by the mobile terminal from the user during execution of the interlocked display control, and based on the detection result The linked display method according to any one of [20] to [23], wherein it is determined whether or not the mobile terminal is in use.

[25] At least one of detection of a user's line of sight and detection of an operation received by the image processing apparatus from the user during execution of the interlocked display control, and based on the detection result, the image processing apparatus The interlocking display method according to any one of [20] to [24], wherein the usage status is determined.

[26] When the interlocking display control is not being executed, the power mode of the image processing apparatus is independently controlled based on whether the image processing apparatus is in use, and whether the portable terminal is in use. The power display mode of the portable terminal is independently controlled based on [21] or [22] to [25], which is cited in [21].

[27] When it is determined that both the portable terminal and the image processing apparatus are not used during execution of the interlocking display control, the power modes of both the portable terminal and the image processing apparatus are changed from the normal mode. Switch to the power saving mode,
Thereafter, when returning to the normal mode, both the portable terminal and the image processing apparatus are returned to the normal mode, and execution of the interlocking display control is resumed [21], 21], the interlocking display method according to any one of [22] to [25] or [26].

[28] It is determined whether or not a distance between the portable terminal and the image processing apparatus is equal to or greater than a predetermined value. If the distance is equal to or greater than a predetermined value, execution of the interlocked display control is prohibited. [20] The linked display method according to any one of [27].

  According to the interlocking display system, the image processing apparatus and the program thereof, and the interlocking display method according to the present invention, when using the image processing apparatus and the portable terminal, while the display contents of the screens of both apparatuses are interlocked, Even if either one of the apparatuses is not used, it is possible to prevent the image processing apparatus from shifting to the power saving mode and to ensure the convenience for the user.

It is explanatory drawing which shows the interlocking display system which concerns on embodiment of this invention. 1 is a block diagram illustrating a schematic configuration of an image forming apparatus according to an embodiment of the present invention. It is a block diagram which shows schematic structure of the portable terminal which concerns on embodiment of this invention. 6 is a diagram illustrating an example of a setting screen displayed by the image forming apparatus in a linked display mode. FIG. It is a figure which shows the screen of the lower hierarchy of the setting screen of FIG. FIG. 5 is a diagram illustrating an example of a screen displayed in conjunction with the mobile terminal in correspondence with the screen of FIG. 4 displayed by the image forming apparatus. It is a figure which shows a mode that the item of binding is selected on the screen of FIG. FIG. 6 is a diagram illustrating an example of a screen displayed in conjunction with the mobile terminal in correspondence with the screen of FIG. 5 displayed by the image forming apparatus. 10 is a flowchart illustrating processing performed after the image forming apparatus starts execution of interlocking display control in the interlocking display mode and before shifting to the power saving mode. It is a flowchart which shows the process performed after a portable terminal starts execution of interlocking display control in interlocking display mode, and transfers to power saving mode. 6 is a flowchart illustrating processing performed after the image forming apparatus starts execution of interlocked display control in the interlocked display mode until the interlocked display mode is canceled. 10 is a flowchart illustrating processing performed when the image forming apparatus returns from the power saving mode after shifting to the power saving mode while maintaining the interlocking display mode.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows an interlocking display system 5 according to an embodiment of the present invention. The interlocking display system 5 includes an image forming apparatus 10 that functions as an image processing apparatus of the present invention and a portable terminal 40.

  The portable terminal 40 is a portable terminal such as a tablet, and includes an operation display unit 50 including a display unit 51 and an operation unit 52 (see FIG. 3).

  The image forming apparatus 10 is a copy job that optically reads a document and prints a duplicate image on a recording sheet, a scan job that saves the image data of the read document as a file, or transmits it to an external device, from a PC This is a so-called multi-function machine having a function of executing a job such as a print job for printing an image relating to the transmitted data on a recording sheet and outputting the image. The image forming apparatus 10 includes an operation panel 30 that includes a display unit 31 and an operation unit 32 to operate the apparatus main body, and the user can perform various settings using the operation panel 30. (See FIG. 2).

  The portable terminal 40 and the image forming apparatus 10 can be switched between a normal power mode (hereinafter referred to as a normal power mode) and a power saving mode that consumes less power than the normal power mode. Basically, the portable terminal 40 and the image forming apparatus 10 are in use in a normal power mode when a certain time elapses in a so-called standby state such as a state where no operation is performed or a job is not executed. If not, switch to the power saving mode. Note that neither the portable terminal 40 nor the image forming apparatus 10 displays a screen on the display unit (31, 51) when in the power saving mode.

  The interlocking display system 5 switches the display mode of the image forming apparatus 10 and the portable terminal 40 when the image forming apparatus 10 and the portable terminal 40 are connected by wireless communication, and switches the other screen when one screen is switched. Switch to the linked display mode that links the display contents (performs linked display control). In the embodiment of the present invention, when linked display control is executed in the linked display mode, the image forming apparatus 10 displays a predetermined setting screen, and the portable terminal 40 displays a guidance screen for the setting screen.

  The interlocking display system 5 according to the present embodiment saves power to both apparatuses if the image forming apparatus 10 or the portable terminal 40 is used during the interlocking display control in the interlocking display mode. Do not enter mode. Thereby, for example, when only one of the image forming apparatus 10 and the portable terminal 40 is used during the execution of the interlocked display control, the situation in which the other shifts to the power saving mode is prevented. Can do.

  Next, the configuration of the image forming apparatus 10 according to the embodiment of the present invention will be described.

  FIG. 2 is a block diagram showing a schematic configuration of the image forming apparatus 10 according to the embodiment of the present invention. The image forming apparatus 10 includes a CPU (Central Processing Unit) 11 that comprehensively controls the operation of the image forming apparatus 10. The CPU 11 has a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a nonvolatile memory 14, a hard disk device 15, an image processing unit 16, an image reading unit 17, a printer unit 18, A facsimile communication unit 19, a network communication unit 20, a line-of-sight detection unit 21, and an operation panel 30 are provided.

  The CPU 11 is based on an OS (Operating System) program, and executes middleware, application programs, and the like. The CPU 11 also functions as a control unit that controls the display content of the operation panel 30.

  Various programs are stored in the ROM 12, and each function of the image forming apparatus 10 is realized by the CPU 11 executing various processes according to these programs. The ROM 12 stores a program for the CPU 11 to execute a series of controls of the image forming apparatus 10.

  The RAM 13 is used as a work memory for temporarily storing various data when the CPU 11 executes processing based on a program, an image memory for storing image data, and the like.

  The nonvolatile memory 14 is a memory (flash memory) whose stored contents are not destroyed even when the power is turned off, and is used for storing various setting information. The hard disk device 15 is a large-capacity nonvolatile storage device, and stores an OS program, various application programs, print data, image data, an information history related to a job, and the like.

  The image processing unit 16 performs processing such as image enlargement / reduction, rotation, rasterization processing for converting print data into image data, image data compression / decompression processing, and the like.

  The image reading unit 17 performs a function of optically reading a document and acquiring image data. The image reading unit 17 sequentially, for example, a light source that irradiates light on the document, a line image sensor that receives the reflected light for one line in the width direction, and a line-by-line reading position in the length direction of the document. An optical path composed of a moving unit for moving, a lens, a mirror, and the like for guiding reflected light from the document to the line image sensor to form an image, and a conversion unit for converting an analog image signal output from the line image sensor into digital image data And so on.

  The printer unit 18 has a function of forming an image corresponding to image data on a recording sheet. Here, it has a recording paper transport device, a photosensitive drum, a charging device, a laser unit, a developing device, a transfer separation device, a cleaning device, and a fixing device, and forms an image by an electrophotographic process. It is configured as a so-called laser printer. Other methods may be used for image formation.

  The facsimile communication unit 19 performs a function of transmitting / receiving image data to / from an external device having a facsimile function through a public line.

  The network communication unit 20 performs a function of communicating data with the mobile terminal 40 and other external devices through a network such as a LAN (Local Area Network). In the present embodiment, it is assumed that wireless communication is performed using a wireless LAN, but the communication means is not limited to these.

  The operation panel 30 includes a display unit 31 and an operation unit 32. Among these, the operation unit 32 includes a switch unit 33 such as a start button and a touch panel unit 34. The display unit 31 is composed of a liquid crystal display (LCD) and the like, and has a function of displaying various operation screens, setting screens, and the like. In the present embodiment, the CPU 11 performs control of display contents displayed on the operation panel 30 and control related to reception of operations by the operation panel 30.

  The touch panel unit 34 is provided on the display unit 31. The touch panel unit 34 detects a coordinate position on the display unit 31 pressed by a touch pen or a finger, a flick operation, a drag operation, and the like.

  The line-of-sight detection unit 21 detects the user's line of sight. The line-of-sight detection method may be arbitrary. For example, a detection camera is provided at the center of the upper edge of the operation panel 30, and an image captured by the detection camera is analyzed to detect the user's line of sight from the face orientation, the position of the pupil in the eyes, and the like. The image forming apparatus 10 detects whether the user is looking at the display unit 31 on the operation panel 30 by detecting the user's line of sight with the line-of-sight detection unit 21.

  In the present embodiment, the CPU 11 determines whether or not the own device is in use. The determination method will be described later.

  In the present embodiment, during the execution of the interlocked display control, when the CPU 11 receives information indicating the operation content performed on the operation display unit 50 of the mobile terminal 40 from the mobile terminal 40, the CPU 11 analyzes the operation content. Recognize and reflect on your device. In addition, the CPU 11 transmits information related to a predetermined setting screen being displayed on the display unit 31 to the mobile terminal 40 using the network communication unit 20. The portable terminal 40 displays a guidance screen corresponding to the setting screen based on the information.

  FIG. 3 is a block diagram illustrating a schematic configuration of the mobile terminal 40. The mobile terminal 40 has a CPU 41 that controls the operation of the mobile terminal 40 in an integrated manner. The CPU 41 includes a ROM 42, a RAM 43, a nonvolatile memory 44, a hard disk device 45, a network communication unit 46, and an operation display unit 50 through a bus.

  The CPU 41 is based on the OS program, and executes middleware, application programs, and the like. In addition, the CPU 41 functions as a control unit that controls the display content of the operation display unit 50.

  Various programs are stored in the ROM 42, and each function of the portable terminal 40 is realized by the CPU 41 executing various processes according to these programs. The ROM 42 stores a program for the CPU 41 to execute a series of controls of the mobile terminal 40 and user information.

  The RAM 43 is used as a work memory for temporarily storing various data when the CPU 41 executes processing based on a program, an image memory for storing image data, and the like.

  The nonvolatile memory 44 is a memory (flash memory) whose stored contents are not destroyed even when the power is turned off, and is used for storing various setting information. The hard disk device 45 is a large-capacity nonvolatile storage device, and stores an OS program, various application programs, and the like. A program for operating the mobile terminal 40 in the above-described linked display mode (this is called a linked display application) is also stored.

  The network communication unit 46 has a function of communicating data with the image forming apparatus 10 and other external devices through a network such as a LAN. In this embodiment, wireless communication by wireless LAN is performed, but the communication means is not limited to these.

  The operation display unit 50 includes a display unit 51 and an operation unit 52. Among these, the operation unit 52 includes a switch unit 53 such as a start button and a touch panel unit 54. The display unit 51 is configured by a liquid crystal display or the like, and fulfills a function of displaying various operation screens, setting screens, and the like.

  The touch panel unit 54 is provided on the display unit 51. The touch panel unit 54 detects a coordinate position on the display unit 51 pressed by a touch pen or a finger, a flick operation, a drag operation, and the like.

  The tilt sensor 47 detects the direction in which the display surface of the display unit 51 of the mobile terminal 40 faces. The method for detecting the tilt may be arbitrary. For example, the detection is performed using a sensor such as a gyro sensor or an electronic compass provided in the tilt sensor 47. The portable terminal 40 recognizes whether the display surface of the display unit 51 is upward or downward by detecting the inclination of the own device by the inclination sensor 47.

  The line-of-sight detection unit 48 detects the user's line of sight. The line-of-sight detection method may be arbitrary. For example, a detection camera is provided at the center of the upper edge of the operation display unit 50, an image captured by the detection camera is analyzed, and the user's line of sight is detected from the face orientation, the position of the pupil in the eye, and the like. The portable terminal 40 recognizes whether or not the user is looking at the display unit 51 by detecting the user's line of sight with the line-of-sight detection unit 48.

  In the present embodiment, the CPU 41 determines whether or not the own device is in use. The determination method will be described later.

  In the present embodiment, during execution of the interlocking display control, the CPU 41 causes the operation display unit 50 to display various guidance screens based on information received from the image forming apparatus 10 by the network communication unit 46. Further, the CPU 41 transmits the operation content received by the operation display unit 50 to the image forming apparatus 10 using the network communication unit 46.

  Next, a flow until the image forming apparatus 10 and the portable terminal 40 shift to the interlock display mode will be described.

  Next, a procedure for establishing communication between the image forming apparatus 10 and the portable terminal 40 will be described. When communication between the image forming apparatus 10 and the portable terminal 40 is established, the display mode of the own apparatus is shifted to the interlocked display mode, and the interlocked display control is started.

(1. When entering linked display mode from the image forming apparatus 10 side)
When entering the linked display mode from the image forming apparatus 10 side, first, it is determined whether or not the image forming apparatus 10 enters the linked display mode. The determination method will be described later. When it is determined that the interlock display mode is entered, it is checked whether or not there is a device (mobile terminal 40) that can communicate with the surroundings, and if there is a mobile terminal 40 that can communicate, communication with the mobile terminal 40 is established. For example, when it is determined that the linked display mode is entered and it is checked whether there is a device that can communicate with the surroundings, a list of devices that can communicate is displayed, and the user communicates with the device selected from the list. May be established. And if communication is established, it will enter into an interlocking display mode and an interlocking display control will be started with this portable terminal 40. FIG.

  If there is no device (portable terminal 40) that can communicate with the surroundings, it is determined that the interlocked display mode cannot be entered, and the check ends.

  In determining whether to enter the interlocked display mode, it is determined that the interlocked display mode is entered when an instruction to enter the interlocked display mode is received from the user or when a specific condition is satisfied.

  For example, when setting multiple items, it is necessary to set a certain item after or before other items (first priority, second priority, etc.) In this way, the setting is considered to be confusing for the user, or the user determines that he / she is in trouble because he / she does not know the setting operation method, such as going back and forth on the same screen. In addition, when the operation is not performed for a certain period of time on a specific screen, the user determines that the user does not know the setting operation method and is in trouble.

(2. When entering the interlocked display mode from the mobile terminal 40 side)
When communication is established from the mobile terminal 40 side, first, a linked display application is started on the mobile terminal 40, the application issues a communication establishment request to the image forming apparatus 10, and the image forming apparatus 10 that has received the communication establishment request. Communication is established. When communication is established, the display mode is switched to the linked display mode, and linked display control is started together with the image forming apparatus 10.

  In the interlocking display system 5, the portable terminal 40 and the image forming apparatus 10 determine whether or not the distance from the other device is equal to or greater than a predetermined value by exchanging position information before entering the interlocking display mode. To do. Then, only when it is determined that the distance is less than the predetermined value, the interlock display mode is entered, and execution of the interlock display control is started. When it is determined that the distance is greater than or equal to the predetermined value, the interlock display mode is not entered.

  For example, the predetermined value is a distance that allows the user to use the portable terminal 40 and the image forming apparatus 10 at the same time. Any method may be used for determining whether the distance between the portable terminal 40 and the image forming apparatus 10 is equal to or greater than a predetermined value.

  Next, a setting screen displayed by the image forming apparatus 10 that is executing the interlock display control in the interlock display mode will be described.

  FIG. 4 shows a copy setting screen 60 that is an example of a setting screen displayed by the image forming apparatus 10 that is executing the interlock display control in the interlock display mode.

  On the copy setting screen 60, a plurality of item buttons (61 to 67) for performing various settings relating to copying are displayed. Specifically, an item button 61 relating to the binding setting for stapling the output paper, an item button 62 relating to the single-sided / double-sided printing setting, an item button 63 relating to the (enlargement / reduction ratio) scale setting, and the paper to be used An item button 64 relating to selection (paper setting), an item button 65 relating to density setting, an item button 66 relating to monochrome / color setting, and an item button 67 relating to image quality setting are displayed.

  When any one of the item buttons 61 to 67 is selected, a screen of a lower hierarchy related to the selected item button is popped up and displayed on the copy setting screen 60 in an overlapping manner.

  FIG. 5 shows a binding setting screen 70 popped up when the item button 61 is selected. The binding setting screen 70 includes various setting items relating to stapling, punching, paper folding, and the like, an OK button 71 for confirming the setting relating to the setting item, and a cancel button 72 for canceling the setting. Has been placed. When the OK button 71 is pressed while a setting item in the binding setting screen 70 is selected, the image forming apparatus 10 confirms the setting contents in the selected state. When the cancel button 72 is pressed, the setting content selected in the binding setting screen 70 is canceled and the binding setting screen 70 is bound.

  As described above, the user displays the screen of the lower hierarchy related to each of the item buttons 61 to 67 and performs detailed settings on the screen.

  However, since the image forming apparatus 10 has a variety of functions, the user may not know what setting operation to perform in order to obtain the desired print result. In such a case, the user confirms each function and effect of the image forming apparatus 10 on the guidance screen displayed by the portable terminal 40 that is executing the interlocked display control together with the image forming apparatus 10, while checking the functions of the image forming apparatus 10. A setting operation is performed on the forming apparatus 10. Next, a guidance screen displayed by the portable terminal 40 that is executing the interlock display control in the interlock display mode will be described.

  FIG. 6 shows a copy guidance screen 80 which is an example of a guidance screen displayed on the mobile terminal 40 during execution of the interlocked display control. The copy guidance screen 80 is a screen corresponding to the copy setting screen 60 shown in FIG. 4. The copy guidance screen 80 is an operation procedure for copying, what settings should be performed to obtain a print result desired by the user, and copy settings. Items corresponding to the item buttons 61 to 67 on the screen 60 are displayed. The user can confirm the setting operation method and the like on the copy setting screen 60 on the copy guidance screen 80.

  When any item in the copy guidance screen 80 is selected, a transition is made to a screen showing a detailed description of the item. FIG. 7 shows a state in which the user selects an item relating to binding setting on the copy guidance screen 80.

  FIG. 8 shows a binding guidance screen 90 which is an example of a screen after transition when an item relating to binding setting is selected on the copy guidance screen 80. The binding guidance screen 90 displays detailed contents of each item relating to binding, such as stapling and punching. The user confirms the detailed content of each function related to binding on the binding guidance screen 90 and performs a setting operation on the image forming apparatus 10.

  The binding guidance screen 90 is a screen corresponding to the binding setting screen 70. When the image forming apparatus 10 receives the user's operation and displays the binding setting screen 70, the portable terminal 40 automatically displays the binding guidance screen 90. When the portable terminal 40 receives an operation and displays the binding guidance screen 90, the image forming apparatus 10 automatically displays the binding setting screen 70.

  Thus, in the interlocking display system 5, the image forming apparatus 10 and the mobile terminal 40 display a screen corresponding to the screen displayed by the other apparatus by interlocking display control. When one screen is switched, the other screen is also switched.

  In the interlocking display system 5, while the interlocking display control is being performed in the interlocking display mode, if either one of the image forming apparatus 10 and the portable terminal 40 is in use, both do not shift to the power saving mode. Next, a method for determining whether or not the image forming apparatus 10 and the portable terminal 40 are in use will be described.

  The image forming apparatus 10 determines whether or not the image forming apparatus 10 is in use based on at least one of the user's line of sight detected by the line-of-sight detection unit 21 or the operation status received by the apparatus from the user. Specifically, when the user's line of sight detected by the line-of-sight detection unit 21 is directed on the operation panel 30 or until a predetermined time has elapsed since the last operation was received, the own apparatus is in use. It is judged that.

  Whether or not the mobile terminal 40 is in use based on at least one of the user's line of sight detected by the line-of-sight detection unit 48, the detection result of the tilt sensor 47, and the status of the operation received by the self-device from the user. Judging. Specifically, when the user's line of sight detected by the line-of-sight detection unit 48 is pointed on the operation display unit, or until a certain time has elapsed since the last operation was received, the own apparatus is in use. Recognize that there is. Further, while the display unit 51 recognizes that the display surface of the display unit 51 is facing downward based on the detection result of the tilt sensor 47, it is determined that the own device is not being used.

  In the interlocking display system 5, during execution of interlocking display control in the interlocking display mode, the image forming apparatus 10 and the mobile terminal 40 repeatedly report to the other whether or not their own apparatus is in use. When either one of the image forming apparatus 10 and the portable terminal 40 is in use, the image forming apparatus 10 and the portable terminal 40 do not shift to the power saving mode. When both the devices are not used, the mode is shifted to the power saving mode. When the mode is shifted to the power saving mode, the communication between the image forming apparatus 10 and the portable terminal 40 is disconnected.

  In the interlocking display system 5, if the interlocking display control is not being executed, the power mode of the image forming apparatus 10 is independently controlled based on whether the image forming apparatus 10 is in use. Further, the power mode of the mobile terminal 40 is independently controlled based on whether or not the mobile terminal 40 is in use. That is, when the interlocking display control is not executed, a device that is in use does not shift to the power saving mode, and a device that is not used shifts to the power saving mode.

  Next, processing performed after the image forming apparatus 10 and the portable terminal 40 start interlocking display control in the interlocking display mode and before shifting to the power saving mode will be described.

  FIG. 9 shows processing performed by the image forming apparatus 10 after starting linked display control in the linked display mode until shifting to the power saving mode. First, communication with the portable terminal 40 is established, the mode is shifted to the linked display mode, and linked display control is started (step S101).

  Whether or not the device itself is in use is checked by the above-described method. If the device is in use (step S102; Yes), the process returns to step S102 to continue the processing. If the own device is not used (step S102; No), it is determined whether the portable terminal 40 is in use based on information received from the portable terminal 40 (step S103).

  If the portable terminal 40 is used (step S103; Yes), it will return to step S102 and will continue a process. If it is not in use (step S103; No), it shifts to the power saving mode while keeping the interlocking display mode (step S104), and this process is terminated.

  FIG. 10 shows processing that is performed from when the mobile terminal 40 starts linked display control in the linked display mode to when the portable terminal 40 shifts to the power saving mode. First, communication with the image forming apparatus 10 is established, the mode is shifted to the linked display mode, and linked display control is started (step S201).

  Whether or not the device itself is in use is checked by the above-described method. If the device is in use (step S202; Yes), the process returns to step S202 and continues. If the image forming apparatus 10 is not in use (step S202; No), it is determined whether the image forming apparatus 10 is in use based on information received from the image forming apparatus 10 (step S203).

  If the image forming apparatus 10 is being used (step S203; Yes), the process returns to step S202 and continues. If it is not in use (step S203; No), it shifts to the power saving mode while keeping the interlocking display mode (step S204), and this process is terminated.

  Next, a case where the interlocking display mode is terminated will be described. When the linked display system 5 is in the linked display mode and receives a setting operation from the user, the linked display mode 5 ends when the setting operation is completed.

  For example, when the setting completion button is pressed or when an operation for starting a job related to the setting operation received during the interlocking display mode is received, it is determined that the setting operation is completed, and the interlocking display mode is ended. .

  FIG. 11 shows processing performed after the image forming apparatus 10 starts executing the interlocked display control in the interlocked display mode until the interlocked display mode is canceled. First, communication with the portable terminal 40 is established, and interlocked display control is started in the interlocked display mode (step S301).

  When an operation for starting a job related to the setting operation is received, it is determined that the setting operation from the user has been completed (step S302; Yes), the interlocked display mode is canceled, and communication with the mobile terminal is disconnected ( Step S303), the process is terminated. Until it is determined that the setting operation has been completed (step S302; No), the process returns to step S302 and continues.

Note that the image forming apparatus 10 also determines that the setting operation has been completed and cancels the interlocked display mode even when at least one of the following two conditions is satisfied during the interlocked display mode.
When the setting completion button is pressed on the operation panel 30 When the setting completion button is pressed on the mobile terminal 40

  Next, a case where the image forming apparatus 10 and the portable terminal 40 shift to the power saving mode and return from the power saving mode while the linked display control is being executed in the linked display mode will be described.

  In the interlocking display system 5, when both the image forming apparatus 10 and the portable terminal 40 are not in use in the interlocking display mode, the image forming apparatus 10 and the portable terminal 40 recognize that fact, and perform the respective controls. Both of them shift to the power saving mode while keeping the interlocking display mode. And when it transfers to a power saving mode with an interlocking display mode, when either one returns from a power saving mode, the other is also returned from a power saving mode. That is, during the interlocking display mode, the image forming apparatus 10 and the portable terminal 40 are shifted to the power saving mode together or returned from the power saving mode together.

  For example, when the portable terminal 40 is returned from the power saving mode after both the image forming apparatus 10 and the portable terminal 40 are shifted to the power saving mode in the interlocking display mode, the portable terminal 40 is connected to the image forming apparatus 10. A request to return from the power saving mode is transmitted, and after receiving the request, the image forming apparatus 10 resumes the linked display control together with the portable terminal 40 that has transmitted the request.

  Next, referring to FIG. 12, a case will be described in which the image forming apparatus 10 is returned to the power saving mode after being shifted to the power saving mode while being in the interlocked display mode.

  FIG. 12 shows processing performed when the image forming apparatus 10 returns to the power saving mode after shifting to the power saving mode while maintaining the interlocking display mode. First, after the image forming apparatus 10 shifts to the power saving mode in the interlocked display mode and then returns from the power saving mode in response to an operation or the like (step S401), the image forming apparatus 10 is moved to the vicinity to shift to the power saving mode. At the same time, it is checked whether or not there is a portable terminal 40 that has performed the interlocking display control (step S402).

  Specifically, a communicable device in the vicinity is examined, and it is determined whether or not there is a mobile terminal 40 that has performed the interlock display control. When the portable terminal 40 is in the vicinity (step S402; Yes), a request for returning from the power saving mode is transmitted to the portable terminal 40 (step S403), and the portable terminal 40 returns from the power saving mode. Then, the interlocking display control is resumed and this process is terminated.

  When the portable terminal 40 that has performed the interlocking display control is not in the vicinity (step S402; No), the interlocking display mode is canceled (step S404), and this process ends. Note that when the image forming apparatus 10 returns from the power saving mode that has been switched to the linked display mode, even if there is a terminal other than the portable terminal 40 that has performed linked display control until the shift to the power saving mode is performed nearby. The linked display mode is canceled without performing linked display control with the terminal.

  Thus, in the interlocking display system 5, the display contents of the image forming apparatus 10 and the portable terminal 40 are interlocked by interlocking display control. While the interlocked display control is being executed in the interlocked display mode, if either the image forming apparatus 10 or the portable terminal 40 is in use, control is performed so that both the apparatuses are not shifted to the power saving mode. Thus, for example, even when the operation of the image forming apparatus 10 is not performed for a certain period of time by slowly confirming the content of the guidance screen displayed on the mobile terminal 40 during the interlocked display mode, the image forming apparatus It is possible to prevent the occurrence of a situation in which 10 shifts to the power saving mode and the setting contents that have been performed are canceled.

  In addition, when both devices are not in use, even in the linked display mode, the mode is shifted to the power saving mode. Can be suppressed.

  The embodiment of the present invention has been described with reference to the drawings. However, the specific configuration is not limited to that shown in the embodiment, and there are changes and additions within the scope of the present invention. Are also included in the present invention.

  In the embodiment of the present invention, the user's setting operation is received only by the image forming apparatus 10, but the mobile terminal 40 may receive the setting operation. Specifically, the portable terminal 40 displays a guidance screen on which settings similar to the setting screen displayed on the image forming apparatus 10 can be performed, and the contents of the setting operation received on the guidance screen are displayed on the image forming apparatus 10. Send. Then, the image forming apparatus 10 reflects the contents of the setting operation received by the mobile terminal 40 on the own apparatus.

  In the embodiment of the present invention, the portable terminal 40 can shift to the power saving mode, but the portable terminal 40 may not be able to shift to the power saving mode. In this case, in the interlocking display mode, if either one of the image forming apparatus 10 and the portable terminal 40 is in use, the transition to the power saving mode may be prohibited in the power mode of the image forming apparatus 10. .

  In the embodiment of the present invention, the image forming apparatus 10 in the interlocking display system 5 has been described as an example of the image processing apparatus, but the image processing apparatus is not limited to this. The image processing apparatus may be configured by extracting the CPU 11, the ROM 12, the RAM 13, the nonvolatile memory 14, the network communication unit 20, and the image processing unit 16 from the image forming apparatus 10. The present invention also relates to a program for operating the above-described image processing apparatus, information processing apparatus as in the embodiment, and a linked display method for causing the image processing apparatus and the mobile terminal to perform linked display control in the embodiment. May be.

  A case where the image processing apparatus is operated alone instead of the interlocking display system 5 will be described. The image processing apparatus transmits information (display data and the like) for displaying the guidance screen to the portable terminal while performing the interlock display control in the interlock display mode.

  During the linked display mode, information related to the usage status of the mobile terminal is received, and if either the image processing device or the mobile terminal is in use, the mobile terminal is prohibited from entering the power saving mode. Send instructions to do. When shifting to the power saving mode or returning from the power saving mode with the interlocking display mode, an instruction to shift to the power saving mode and an instruction to return from the power saving mode are transmitted to the portable terminal. When the display mode is not the interlocking display mode, the mobile terminal is caused to control the power mode of the mobile terminal independently.

  In the embodiment of the present invention, each of the image forming apparatus 10 and the portable terminal 40 determines whether or not to prohibit the transition to the power saving mode for the power mode of the own apparatus in the interlocking display mode. However, for example, a server is provided as the power saving control unit of the present invention, and the server determines whether or not the image forming apparatus 10 and the portable terminal 40 in the interlocking display mode are prohibited from entering the power saving mode. May be. Specifically, the server acquires information related to the usage status of the image forming apparatus 10 and the portable terminal 40 in the linked display mode, and based on the information, the image forming apparatus 10 and the portable terminal 40 are in the power saving mode. An instruction to prohibit the transition to is sent.

  In the embodiment of the present invention, each of the image forming apparatus 10 and the portable terminal 40 controls the power mode of the own apparatus. However, an external device such as a server is provided, and the server is connected to the image forming apparatus 10. The power mode of the mobile terminal 40 may be controlled. Specifically, the server acquires information related to the usage status of the image forming apparatus 10 and the portable terminal 40, and based on the information, instructs the image forming apparatus 10 and the portable terminal 40 to enter the power saving mode. Then, an instruction to return from the power saving mode is transmitted.

  In the embodiment of the present invention, while linked display control is being executed, the image forming apparatus 10 displays a predetermined setting screen, and the portable terminal 40 displays a guidance screen corresponding to the setting screen. It may be displayed. For example, a part of one large screen may be displayed on the image forming apparatus 10 and the subsequent part may be displayed on the mobile terminal 40. In that case, when an operation for scrolling the screen is received in one of the image forming apparatus 10 and the portable terminal 40, the other screen is also scrolled.

  Note that a method for displaying a screen for performing print settings on the mobile terminal 40 and transmitting and reflecting the setting content set on the mobile terminal 40 to the image forming apparatus 10 is merely a remote operation and interlocked. Not applicable to display control. To the last, when one screen is switched, the control for interlocking the display contents so that the other screen is also switched is referred to as interlocking display control.

  In the embodiment of the present invention, the interlock display mode is not entered when the distance between the image forming apparatus 10 and the portable terminal 40 is equal to or greater than the predetermined distance, but the interlock display mode is entered regardless of the distance. Good.

... Interlocking display system 10 ... Image forming apparatus 11 ... CPU
12 ... ROM
13 ... RAM
DESCRIPTION OF SYMBOLS 14 ... Non-volatile memory 15 ... Hard disk device 16 ... Image processing part 17 ... Image reading part 18 ... Printer part 19 ... Facsimile communication part 20 ... Network communication part 21 ... Line-of-sight detection part 30 ... Operation panel 31 ... Display part 32 ... Operation part 33 ... Switch part 34 ... Touch panel part 40 ... Portable terminal 41 ... CPU
42 ... ROM
43 ... RAM
44 ... Non-volatile memory 45 ... Hard disk device 46 ... Network communication part 47 ... Tilt sensor 48 ... Gaze detection part 50 ... Operation display part 51 ... Display part 52 ... Operation part 53 ... Switch part 54 ... Touch panel part 60 ... Copy setting screen 61 ... Item button 62 ... Item button 63 ... Item button 64 ... Item button 65 ... Item button 66 ... Item button 67 ... Item button 70 ... Binding setting screen 71 ... OK button 72 ... Cancel button 80 ... Copy guidance screen 90 ... Binding guidance screen

Claims (28)

An image processing device;
A mobile device,
A power saving control unit that switches the power mode of the image processing apparatus between a normal mode and a power saving mode that consumes less power than the normal mode;
When any one of the screens displayed by the image processing device and the mobile terminal is switched, a linked display control unit that performs linked display control for switching the other screen;
A monitoring unit that determines whether each of the image processing device and the mobile terminal is in use;
With
The power saving control unit determines that the linked display control unit is executing the linked display control, and the monitoring unit determines that at least one of the image processing apparatus and the portable terminal is in use. In the case of the power processing mode of the image processing apparatus, switching from the normal mode to the power saving mode is prohibited, and the monitoring unit is configured to execute the interlocking display control while the interlocking display control unit is executing the interlocking display control. And the image processing apparatus, the power display mode of the image processing apparatus is switched from the normal mode to the power saving mode . The power saving control unit can switch the power mode of the mobile terminal between a normal mode and a power saving mode with less power consumption than the normal mode,
When the interlocking display control unit is executing the interlocking display control and the monitoring unit determines that at least one of the image processing device and the portable terminal is in use, the image processing For both power modes of the device and the portable terminal, switching from the normal mode to the power saving mode is prohibited, and the monitoring unit is connected to the portable terminal while the linked display control unit is executing the linked display control. The interlocking display system according to claim 1 , wherein when it is determined that both of the image processing apparatuses are not used, the power mode of the mobile terminal is switched from the normal mode to the power saving mode . The linked display control unit performs the linked display control on a setting screen displayed on the image processing device and a guidance screen displayed on the portable terminal and corresponding to the setting screen. The interlocking display system according to claim 1 or 2. The interlocking display control unit completes the setting operation when executing the interlocking display control when at least one of the image processing apparatus and the mobile terminal receives a setting operation from a user. Then, the execution of the interlocking display control is terminated. The interlocking display system according to any one of claims 1 to 3. The monitoring unit includes at least one of a detection result of a gaze detection unit that detects a user's gaze, a detection result of a tilt sensor unit that detects a tilt of the mobile terminal, and a situation of an operation that the mobile terminal receives from the user. The interlocking display system according to claim 1, wherein it is determined whether or not the mobile terminal is in use based on the above. The monitoring unit determines whether the image processing apparatus is in use based on at least one of a detection result of a line-of-sight detection unit that detects a user's line of sight or an operation state received by the image processing apparatus from the user. The interlocking display system according to any one of claims 1 to 5, wherein: The power saving control unit independently controls the power mode of the image processing device based on whether the image processing device is in use or not when the interlocking display control unit is not executing the interlocking display control. The power mode of the mobile terminal is independently controlled based on whether or not the mobile terminal is in use. The claim 2 or any one of claims 3 to 6 quoting the claim 2 The linked display system described. When the linked display control unit determines that both the portable terminal and the image processing apparatus are not used while the linked display control unit is executing the linked display control, the power saving control unit And switching the power mode of both the image processing apparatus from the normal mode to the power saving mode,
Thereafter, when returning to the normal mode, the power saving control unit returns both the portable terminal and the image processing device to the normal mode, and the interlocking display control unit executes the interlocking display control. The interlocking display system according to claim 2, wherein the system is restarted, or any one of claims 3 to 6 that cites claim 2, or claim 7. A distance determination unit that determines whether a distance between the portable terminal and the image processing apparatus is equal to or greater than a predetermined value;
The interlocking display control unit prohibits execution of the interlocking display control when the distance determination unit determines that the distance between the portable terminal and the image processing apparatus is equal to or greater than a predetermined value. The interlocking display system according to any one of claims 1 to 8. A display unit;
An operation unit;
An image processing unit for performing predetermined image processing;
A communication unit that transmits and receives data to and from the mobile terminal
A power saving control unit that switches the power mode of the device to a normal mode and a power saving mode that consumes less power than the normal mode;
When any one of the screens displayed on the display unit and the mobile terminal is switched, a linked display control unit that performs linked display control for switching the other screen;
A monitoring unit that determines whether each of the device and the mobile terminal is in use;
With
The power saving control unit, when the linked display control unit is executing the linked display control, and the monitoring unit determines that at least one of the own device and the portable terminal is in use Prohibits switching from the normal mode to the power saving mode for the power mode of the own device, and the monitoring unit controls the mobile terminal and the own device while the linked display control unit is executing the linked display control. An image processing apparatus , wherein when it is determined that both are not used, the power mode of the own apparatus is switched from the normal mode to the power saving mode . The mobile terminal can switch the power mode between a normal mode and a power saving mode with less power consumption than the normal mode,
The power saving control unit, when the linked display control unit is executing the linked display control, and the monitoring unit determines that at least one of the own device and the portable terminal is in use , for the power mode of the apparatus, from said normal mode with prohibits switching to the power saving mode, and instructs the prohibition of the switching of the from the normal mode to the mobile terminal to the power saving mode, the interlocking display control When the monitoring unit determines that both the mobile terminal and its own device are not used during execution of the interlocking display control, the mobile terminal instructs the mobile terminal to switch from the normal mode to the power saving mode. The image processing apparatus according to claim 10. The linked display control unit performs the linked display control on a setting screen displayed on the display unit and a guidance screen displayed on the mobile terminal and corresponding to the setting screen. Item 12. The image processing apparatus according to Item 10 or 11. When the interlocking display control unit is executing the interlocking display control when at least one of the device and the mobile terminal is receiving a setting operation from a user, the setting operation is completed, The image processing apparatus according to claim 10, wherein execution of the interlocking display control is terminated. The monitoring unit includes at least one of a detection result of a gaze detection unit that detects a user's gaze, a detection result of a tilt sensor unit that detects a tilt of the mobile terminal, and a situation of an operation that the mobile terminal receives from the user. The image processing apparatus according to claim 10, wherein it is determined whether or not the mobile terminal is in use based on the above. The monitoring unit determines whether or not the own device is in use based on at least one of a detection result of the gaze detection unit that detects a user's gaze or an operation state received by the own device from the user. The image processing apparatus according to claim 10, wherein the image processing apparatus is an image processing apparatus. The power saving control unit independently controls the power mode of the own device based on whether or not the own device is in use unless the interlocked display control unit is executing the interlocked display control. The image processing apparatus according to claim 11, wherein the power mode is controlled independently by the portable terminal. The power saving control unit, when the interlocking display control unit is executing the interlocking display control, when the monitoring unit determines that both the portable terminal and the own device are not used, the power mode of the own device Switching from the normal mode to the power saving mode, and switching the power mode of the mobile terminal from the normal mode to the power saving mode,
Thereafter, when returning to the normal mode, the power saving control unit returns both the mobile terminal and the own device to the normal mode, and the interlocked display control unit resumes execution of the interlocked display control. The image processing apparatus according to claim 11, or any one of claims 12 to 15, or claim 16 quoting claim 11. A distance determination unit that determines whether the distance between the mobile terminal and the device is a predetermined value or more;
The interlocked display control unit prohibits execution of the interlocked display control when the distance determining unit determines that the distance between the mobile terminal and the device is a predetermined value or more. The image processing apparatus according to any one of 10 to 17. A program for causing an information processing apparatus to operate as the image processing apparatus according to any one of claims 10 to 18. When one of the screen displayed by the image processing apparatus that can switch the power mode between the normal mode and the power saving mode that consumes less power than the normal mode and the screen displayed by the mobile terminal is switched, During execution of linked display control for switching the other screen, it is determined whether or not each of the image processing device and the portable terminal is in use, and at least one of the image processing device and the portable terminal is used. If it is determined that the image processing apparatus is in the middle, the switching from the normal mode to the power saving mode is prohibited for the power mode of the image processing apparatus, and it is determined that both the portable terminal and the image processing apparatus are not used. In such a case, the linked display method is characterized in that the power mode of the image processing apparatus is switched from the normal mode to the power saving mode . The mobile terminal can switch the power mode of the mobile terminal between a normal mode and a power saving mode with less power consumption than the normal mode,
When it is determined that at least one of the image processing apparatus and the portable terminal is in use during the execution of the interlocked display control, the power mode of the portable terminal is further changed from the normal mode to the saving mode. When switching to the power mode is prohibited and it is determined that both the mobile terminal and the image processing apparatus are not used, the power mode of the mobile terminal is further switched from the normal mode to the power saving mode. 21. The interlocking display method according to claim 20, wherein The linked display control is performed on a setting screen displayed on the image processing apparatus and a guidance screen corresponding to the setting screen displayed on the mobile terminal. Linked display method. When at least one of the image processing apparatus and the mobile terminal is receiving the setting operation from the user and performing the interlocking display control, when the setting operation is completed, the interlocking display control The linked display method according to any one of claims 20 to 22, wherein the execution is terminated. During the execution of the interlocking display control, at least one of detection of the user's line of sight, detection of the tilt of the mobile terminal, detection of the operation received by the mobile terminal from the user, and based on the detection result, The linked display method according to any one of claims 20 to 23, wherein it is determined whether or not the mobile terminal is in use. At least one of detection of a user's line of sight and detection of an operation received by the image processing apparatus from the user during execution of the interlocking display control is performed, and the usage status of the image processing apparatus is determined based on the detection result. The interlocking display method according to any one of claims 20 to 24, wherein the determination is performed. When the linked display control is not being executed, the power mode of the image processing apparatus is independently controlled based on whether the image processing apparatus is in use, and based on whether the mobile terminal is in use. 26. The linked display method according to claim 21, wherein the power mode of the mobile terminal is controlled independently. When it is determined that both the portable terminal and the image processing apparatus are not used during the execution of the interlocking display control, the power mode of both the portable terminal and the image processing apparatus is changed from the normal mode to the power saving. Switch to mode,
Thereafter, when returning to the normal mode, both the portable terminal and the image processing apparatus are returned to the normal mode, and the execution of the interlocking display control is resumed. The interlocking display method according to any one of claims 22 to 25 or claim 26, wherein the item 21 is cited. 21. It is determined whether or not a distance between the portable terminal and the image processing apparatus is equal to or greater than a predetermined value. If the distance is equal to or greater than a predetermined value, execution of the interlocking display control is prohibited. The interlocking display method as described in any one of thru | or 27.