JP6182870B2 - Image forming apparatus, image forming apparatus control method, image forming apparatus control program, and image forming system - Google Patents

Description

  The present invention relates to an image forming apparatus, an image forming apparatus control method, an image forming apparatus control program, and an image forming system, and more specifically, communicates with a terminal and operates through a remote operation screen displayed on the terminal. The present invention relates to an image forming apparatus that receives image data, a control method for the image forming apparatus, a control program for the image forming apparatus, and an image forming system.

  The electrophotographic image forming apparatus includes a scanner function, a facsimile function, a copying function, a function as a printer, a data communication function, and a server function, an MFP (Multi Function Peripheral), a facsimile apparatus, a copying machine, a printer, and the like. is there.

  In recent years, remote panel functions have been proposed for image forming apparatuses such as MFPs. The remote panel function communicates with a mobile terminal connected to the image forming apparatus via a network, displays a remote operation screen (screen of the operation panel of the image forming apparatus) on the mobile terminal, and displays an image through the remote operation screen. This is a function for receiving an operation of the forming apparatus. According to the remote panel function, the operation panel of the image forming apparatus can be remotely operated.

  A technique for displaying a remote operation screen on a portable terminal is disclosed in, for example, Patent Document 1 below. In Patent Document 1 below, the same definition data as data defining information displayed on the display unit of the image forming apparatus is transferred from the image forming apparatus to the external device, and the external device is caused to draw an image based on the definition data. A technique for displaying the same image as the image displayed on the display unit on the screen is disclosed.

  The following patent documents 2 to 4 disclose conventional drawing techniques. In the following Patent Document 2, processing of a predetermined phase (for example, a phase from when ADF (Auto Document Feeder) starts sending a sheet to the scanner until the scanner finishes compressing image data read from the sheet) is executed. If not, a technique for displaying the screen by applying the animation effect and displaying the screen without applying the animation effect when the processing of the predetermined phase is not executed is disclosed. .

  In Patent Document 3 below, based on the number of continuous display lists that can be processed by a hardware accelerator and the total data size, the hardware processing for a display list that can be processed by hardware is more time-consuming than the software processing. Is a technique for determining whether or not the display list is short, and determining whether to cause the hardware processing of the display list by the hardware accelerator or the software processing of the display list based on the determination result.

  In Patent Document 4 below, display print data in which an operation screen of a multifunction peripheral is described in a page description language is generated and output to an external storage medium, and another multifunction peripheral reads the display print data read from the external storage medium. A technique is disclosed in which the screen description part is rasterized to generate and display a bitmap image of the operation screen, and the function of the operation screen is reproduced from the information of the function description part.

JP 2009-224963 A JP 2012-114703 A Japanese Patent Application Laid-Open No. 2011-165022 JP 2010-22214 A

  However, the conventional technique has a problem that the remote operation screen cannot be displayed on the terminal by an appropriate method. In particular, in the method of Patent Document 1, since the mobile terminal (external device) always draws an image based on the definition data, the load on the mobile terminal increases, and the driving time is shortened when the mobile terminal is driven by a battery. It was.

  On the other hand, a method in which the image forming apparatus draws a remote operation screen and transmits the drawn data to the portable terminal is also conceivable. However, with this method, the load on the CPU (Central Processing Unit) of the image forming apparatus increases, and the performance of the image forming apparatus may deteriorate when the image forming apparatus executes a job by a plurality of users.

  SUMMARY An advantage of some aspects of the invention is that it provides an image forming apparatus capable of displaying a remote operation screen on a terminal by an appropriate method, a control method for the image forming apparatus, and control of the image forming apparatus. A program and an image forming system are provided.

An image forming apparatus according to an aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Based on the layout information generated by the layout information generation means using the layout information generation means and the accelerator, the drawing means for drawing the remote operation screen and the remote operation screen drawn by the drawing means are transmitted to the terminal The operation screen transmission means , the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the layout when the determination means determines to draw the remote operation screen on the terminal. Layout information transmitting means for transmitting the layout information generated by the information generating means to the terminal, If the means determines that the remote operation screen is to be drawn on the terminal, the drawing means does not draw the remote operation screen, and after the remote operation screen is drawn on the image forming apparatus, the image forming apparatus When a job execution instruction that uses a computer is newly received, a change unit that changes the execution destination of the drawing on the remote operation screen to a terminal is further provided.
An image forming apparatus according to another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Based on the layout information generated by the layout information generation means using the layout information generation means and the accelerator, the drawing means for drawing the remote operation screen and the remote operation screen drawn by the drawing means are transmitted to the terminal The operation screen transmission means, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the layout when the determination means determines to draw the remote operation screen on the terminal. Layout information transmitting means for transmitting the layout information generated by the information generating means to the terminal, If it is determined that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen, and the image forming apparatus saves after drawing the remote operation screen on the image forming apparatus. When a condition for shifting to the power mode is satisfied, the information processing apparatus further includes a changing unit that changes the execution destination of drawing on the remote operation screen to the terminal.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal When it is determined that the operation screen transmission means to transmit, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the determination means to perform the drawing of the remote operation screen on the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal. When the determination unit determines to draw the remote operation screen on the terminal, the drawing unit does not draw the remote operation screen and the image forming apparatus is in the power saving mode when starting communication with the terminal. In this case, the determining means determines that the remote operation screen is drawn on the terminal.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal When it is determined that the operation screen transmission means to transmit, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the determination means to perform the drawing of the remote operation screen on the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal. When the determination means decides to draw the remote operation screen on the terminal, the drawing means does not draw the remote operation screen, and the remaining battery level of the terminal after drawing the remote operation screen on the terminal is determined. When the battery remaining amount received by the first remaining amount receiving unit is less than or equal to a threshold value, the determining unit draws the remote operation screen with the image forming apparatus. Decide to do.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal When it is determined that the operation screen transmission means to transmit, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the determination means to perform the drawing of the remote operation screen on the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal. When the determination means determines that the remote operation screen is to be drawn on the terminal, the drawing means does not draw the remote operation screen, and the remaining battery level of the terminal when starting communication with the image forming apparatus is And a second remaining amount receiving means for receiving from the second remaining amount receiving means, and when the remaining battery amount received by the second remaining amount receiving means is less than or equal to the threshold, the determining means draws the remote operation screen on the image forming apparatus. Decide to do.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal When it is determined that the operation screen transmission means to transmit, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the determination means to perform the drawing of the remote operation screen on the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal. When the determination unit determines to draw the remote operation screen on the terminal, the drawing unit does not draw the remote operation screen, and the terminal after the remote operation screen is drawn on the terminal is being charged. A first charging information receiving means for receiving information on whether or not the terminal is charging, and when the first charging information receiving means receives information that the terminal is charging, execution of drawing of the remote operation screen It further comprises changing means for changing the destination to a terminal.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal When it is determined that the operation screen transmission means to transmit, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the determination means to perform the drawing of the remote operation screen on the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal. When the determination unit determines to draw the remote operation screen on the terminal, the drawing unit does not draw the remote operation screen and the terminal at the start of communication with the image forming apparatus is being charged. A second charging information receiving means for receiving the information from the terminal, and when the second charging information receiving means receives the information that the terminal is charging, the determining means It is determined that drawing will be performed on the terminal.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal When it is determined that the operation screen transmission means to transmit, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the determination means to perform the drawing of the remote operation screen on the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal. When the determination means determines that the remote operation screen is to be drawn on the terminal, the drawing means does not draw the remote operation screen, and when starting communication with the terminal, image formation is performed with a terminal different from the terminal. When the apparatus is in communication, the determining unit determines to draw the remote operation screen on the terminal.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal When it is determined that the operation screen transmission means to transmit, the determination means for determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and the determination means to perform the drawing of the remote operation screen on the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal. The drawing means further includes priority order receiving means for receiving the setting of the priority order of the plurality of determination conditions without drawing the remote operation screen when the determining means determines to draw the remote operation screen on the terminal. The determination unit determines whether the remote operation screen is to be drawn by either the image forming apparatus or the terminal by preferentially adopting a determination condition having a high priority received by the priority reception unit.
An image forming apparatus according to still another aspect of the present invention is an image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal, and generates an accelerator and layout information of the remote operation screen Using the layout information generating means, the accelerator, the drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means, and the remote operation screen drawn by the drawing means to the terminal An operation screen transmitting means for transmitting, further comprising an application status receiving means for receiving information from the terminal whether or not an application for displaying the remote operation screen is activated in the background. Information that it is running in the background Is received, further comprising a stop means for stopping the updating and drawing of the remote operation screen.

  Preferably, in the image forming apparatus, when it is determined that the remote operation screen is drawn by the image forming apparatus or the terminal, and when the determination means determines that the remote operation screen is drawn by the terminal, Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal, and when the determining means determines to draw the remote operation screen on the terminal, the drawing means Do not draw.

Preferably, in the image forming apparatus, when the remote operation screen is drawn on the image forming apparatus and the image forming apparatus newly receives an instruction to execute a job using an accelerator, the remote operation screen is drawn . It further comprises changing means for changing the destination to a terminal.

  Preferably, in the image forming apparatus, when the image forming apparatus is executing a job that uses an accelerator when communication with the terminal is started, the determining unit determines to draw the remote operation screen on the terminal. .

  Preferably, in the image forming apparatus, the job in which the image forming apparatus uses an accelerator is a job including a drawing process for analyzing a page description language.

  Preferably, in the image forming apparatus, the layout information transmitting unit transmits information on items whose display state can be switched between display and non-display to the terminal together with the layout information.

  Preferably, in the image forming apparatus, the item information is at least one information selected from the group consisting of a user name, an address, a history list, and information on a tray that stores sheets used by the image forming apparatus.

  Preferably, the image forming apparatus further includes operation information receiving means for receiving operation information on the remote operation screen from the terminal.

An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmission step for transmitting layout information to the terminal. When it is determined that the remote operation screen is drawn on the terminal in the determination step, the remote operation screen is not drawn in the drawing step. When the image forming apparatus newly receives an execution instruction of a job using an accelerator after the drawing is performed by the image forming apparatus, the image forming apparatus further includes a change step of changing the execution destination of the drawing on the remote operation screen to the terminal.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmission step for transmitting layout information to the terminal. When it is determined that the remote operation screen is drawn on the terminal in the determination step, the remote operation screen is not drawn in the drawing step. After drawing is performed by the image forming apparatus, the image forming apparatus further includes a changing step of changing the execution destination of drawing on the remote operation screen to the terminal when the condition for shifting to the power saving mode is satisfied.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmission step for transmitting layout information to the terminal, and when it is determined in the determination step that the remote operation screen is rendered on the terminal, the remote operation screen is not rendered in the rendering step and communication with the terminal is performed. When the image forming apparatus is in the power saving mode when starting the operation, it is determined in the determining step that the remote operation screen is drawn on the terminal.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmission step for transmitting layout information to the terminal. When it is determined that the remote operation screen is drawn on the terminal in the determination step, the remote operation screen is not drawn in the drawing step. In the case of further comprising a first remaining amount receiving step of receiving from the terminal the remaining battery level of the terminal after the drawing is performed on the terminal, and the remaining battery level received in the first remaining amount receiving step is equal to or less than a threshold value, In the determination step, it is determined that drawing of the remote operation screen is performed by the image forming apparatus.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmitting step for transmitting layout information to the terminal, and when determining that the remote operation screen is drawn on the terminal in the determination step, the remote control screen is not drawn in the drawing step, and the image forming apparatus A second remaining amount receiving step of receiving from the terminal the remaining battery level of the terminal when starting the communication, and when the remaining battery level received in the second remaining amount receiving step is less than or equal to the threshold value, In the determination step, it is determined that drawing of the remote operation screen is performed by the image forming apparatus.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmission step for transmitting layout information to the terminal. When it is determined that the remote operation screen is drawn on the terminal in the determination step, the remote operation screen is not drawn in the drawing step. The device further includes a first charging information receiving step for receiving from the terminal information indicating whether or not the terminal is being charged after the drawing has been performed at the terminal, and the terminal is being charged in the first charging information receiving step. When the information is received, a change step of changing the execution destination of the drawing on the remote operation screen to the terminal is further provided.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmitting step for transmitting layout information to the terminal, and when determining that the remote operation screen is drawn on the terminal in the determination step, the remote control screen is not drawn in the drawing step, and the image forming apparatus It is further provided with a second charging information receiving step for receiving information from the terminal whether or not the terminal at the time of starting the communication is being charged, and the terminal was charging in the second charging information receiving step When the information is received, it is determined in the determination step that the remote operation screen is drawn on the terminal.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmission step for transmitting layout information to the terminal, and when it is determined in the determination step that the remote operation screen is rendered on the terminal, the remote operation screen is not rendered in the rendering step and communication with the terminal is performed. When the image forming apparatus is communicating with a terminal other than the terminal at the start time, it is determined in the determining step that the remote operation screen is drawn on the terminal.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen transmission step for transmitting the remote operation screen drawn to the terminal, a determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen, and a drawing of the remote operation screen at the determination step If it is decided to do it on the terminal, it is generated at the layout information generation step. A layout information transmission step for transmitting layout information to the terminal, and when determining that the remote operation screen is to be drawn on the terminal in the determination step, the drawing is not performed on the remote operation screen in the drawing step, and a plurality of determination conditions A priority order accepting step for accepting the setting of the priority order, and in the determining step, drawing the remote operation screen by preferentially adopting the determination condition having the high priority order received in the priority order accepting step. It is determined which of the image forming apparatus and the terminal is used.
An image forming apparatus control method according to still another aspect of the present invention is a method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator. A layout information generation step for generating layout information of the remote operation screen, a drawing step for drawing the remote operation screen based on the layout information generated in the layout information generation step using an accelerator, and a drawing step An operation screen sending step for sending the remote operation screen drawn in this way to the terminal, and further comprising an application status receiving step for receiving information from the terminal whether or not an application for displaying the remote operation screen is activated in the background In the application status reception step If the application has received information that are running in the background, further comprising a stop step of stopping the update and the drawing of the remote operation screen.
Preferably, in the above control method, when determining whether to draw the remote operation screen on the image forming apparatus or the terminal, and determining whether to draw the remote operation screen on the terminal in the determination step, the layout A layout information transmission step for transmitting the layout information generated in the information generation step to the terminal, and when it is determined in the determination step that the remote operation screen is rendered on the terminal, the remote operation screen is rendered in the rendering step Do not do.
Preferably, in the above control method, when the image forming apparatus newly receives a job execution instruction using an accelerator after drawing the remote operation screen on the image forming apparatus, the execution destination of the remote operation screen drawing A change step of changing to a terminal.
Preferably, in the above control method, when the image forming apparatus is executing a job using an accelerator when communication with the terminal is started, it is determined in the determining step that the remote operation screen is drawn on the terminal.
Preferably, in the above control method, the job in which the image forming apparatus uses an accelerator is a job including a drawing process for analyzing a page description language .
Preferably, in the control method, in the layout information transmission step, information on items whose display state can be switched between display and non-display is transmitted to the terminal together with the layout information.
Preferably, in the above control method, the item information is at least one information selected from the group consisting of a user name, an address, a history list, and information on a tray for storing sheets used by the image forming apparatus .
Preferably, the control method further includes an operation information receiving step of receiving operation information on the remote operation screen from the terminal.

According to still another aspect of the present invention, an image forming apparatus control program causes a computer to execute the above-described image forming apparatus control method .

Further, the image forming system according to still another aspect of the present invention is an image forming system including a terminal and the above-described image forming apparatus, the edge end receives the remote operation screen transmitted by the operation screen transmission means Operation screen receiving means and display means for displaying the remote operation screen received by the operation screen receiving means on the display unit of the terminal.

  According to the present invention, it is possible to provide an image forming apparatus, an image forming apparatus control method, an image forming apparatus control program, and an image forming system capable of displaying a remote operation screen on a terminal by an appropriate method.

1 is a conceptual diagram of an image forming system according to an embodiment of the present invention. 1 is a block diagram schematically showing a configuration of an image forming system in an embodiment of the present invention. FIG. 5 is a block diagram schematically showing the operation of the image forming system when MFP 100 performs drawing of a remote operation screen in an embodiment of the present invention. FIG. 5 is a block diagram schematically showing the operation of the image forming system when the terminal 200 performs drawing of a remote operation screen in an embodiment of the present invention. 3 is a flowchart illustrating an operation of the image forming system according to the embodiment of the present invention. This is a subroutine of the drawing method determination process in step S7 shown in FIG. FIG. 6 is a diagram schematically showing a setting reception screen that is displayed on the display unit 103 of the operation panel 101 and accepts the setting of the priority order of the drawing method determination conditions. It is a subroutine of job execution state determination processing that employs a first determination condition. It is a subroutine of a power saving state determination process adopting the second determination condition. It is a subroutine of terminal power supply state determination processing that employs a third determination condition. It is a subroutine of a multiple connection state determination process that employs a fourth determination condition. It is a subroutine of the drawing method determination process in step S7 shown in FIG. 5 when the first to third determination conditions are employed. It is a flowchart of the update and drawing process of a remote operation screen. It is a figure which shows an example of the remote operation screen displayed on the terminal. FIG. 11 is a diagram schematically showing a configuration of information transmitted by MFP 100 when MFP 100 transmits layout information of remote operation screen RD1 to terminal 200 in a modification of the present invention. It is a flowchart which shows operation | movement of the image forming system in the modification of this invention.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  The image forming system according to the present embodiment includes an image forming apparatus and a terminal. The image forming apparatus may be, for example, an MFP, a facsimile machine, a copier, or a printer. The terminal is a device that can display various types of information and communicates with the image forming apparatus. The terminal may be, for example, a tablet, a PC (Personal Computer), or a mobile phone.

  [Configuration of image forming system]

  First, the configuration of the image forming system in the present embodiment will be described.

  FIG. 1 is a conceptual diagram of an image forming system according to an embodiment of the present invention.

  Referring to FIG. 1, the image forming system in the present embodiment includes an MFP 100 (an example of an image forming apparatus) and a terminal 200. MFP 100 and terminal 200 can communicate with each other through network 300.

  MFP 100 includes an operation panel 101. The operation panel 101 includes various hardware keys HK and a display unit 103. The display unit 103 is a touch panel. MFP 100 displays various information through display unit 103 to the user of MFP 100. The MFP 100 receives an operation from the user of the MFP 100 through the hardware key HK or the software key SK1 displayed on the display unit 103. MFP 100 has a remote panel function, displays a remote operation screen on terminal 200, and accepts an operation of MFP 100 through the remote operation screen.

  The terminal 200 includes a touch panel 201 (an example of a display unit). The terminal 200 displays various information such as a remote operation screen through the touch panel 201 to the user of the terminal 200. The terminal 200 receives an operation from the user of the terminal 200 through the touch panel 201. In a predetermined case, terminal 200 displays a remote operation screen on touch panel 201 and accepts an operation of MFP 100 through the remote operation screen. This remote operation screen includes, for example, a software key SK2. The software key SK2 is a software key corresponding to each of the software key SK1 and the hardware key HK of the operation panel 101.

  The network 300 is a wired or wireless LAN (Local Area Network). The network 300 is connected using a TCP / IP (Transmission Control Protocol / Internet Protocol) protocol. Devices connected to the network 300 can exchange various data with each other. Instead of the network 300, each device may be connected using a wide area network such as the Internet or a dedicated line.

  Specifically, MFP 100 is connected to network 300 by, for example, a wired LAN. Terminal 200 is connected to network 300 wirelessly through, for example, a wireless LAN access point (not shown).

  Note that the image forming system may further include devices other than the MFP 100 and the terminal 200, or may include a plurality of terminals 200 that communicate with the MFP 100. MFP 100 and terminal 200 may communicate with each other using short-range wireless communication such as Bluetooth (registered trademark).

  FIG. 2 is a block diagram schematically showing the configuration of the image forming system in one embodiment of the present invention.

  Referring to FIG. 2, MFP 100 includes a main controller 110, an image processing unit 120, a print engine 130, a storage unit 140, an operation display unit 150, and a communication unit 160. The main controller 110 and each of the image processing unit 120, the print engine 130, the storage unit 140, the operation display unit 150, and the communication unit 160 are connected to each other by, for example, a bus.

  The main controller 110 includes a CPU, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The CPU of the main controller reads a necessary program from the ROM and performs overall control of the MFP 100 according to the program.

  The image processing unit 120 creates data related to the remote operation screen. When receiving a print job from the terminal 200, the image processing unit 120 converts the received data into a raster image under the control of the main controller 110.

  The image processing unit 120 includes a layout generation unit 121, a drawing method determination unit 123, and a drawing unit 125. The layout generation unit 121 generates layout information of the remote operation screen. The drawing method determination unit 123 determines which of the MFP 100 and the terminal 200 is used to draw the remote operation screen (hereinafter, this determination process may be referred to as a drawing method determination process). The drawing unit 125 draws the remote operation screen based on the layout information. The drawing unit 125 converts print job data into print data that is a raster image.

  The layout information is information related to the layout of each object arranged on the remote operation screen described in a printer language such as PJL (Print Job language). Objects include images and text. The layout information includes information such as object identification information, size, coordinates, character code, and font. Drawing the remote operation screen means creating a raster image of the remote operation screen.

  The drawing unit 125 includes an accelerator 127. The accelerator 127 is dedicated hardware for the drawing unit 125. The accelerator 127 is used for processing for drawing a remote operation screen (screen display processing) and processing for converting print job data into print data that is a raster image (RIP (Raster Image Processing) processing).

  The print engine 130 performs a printing process on a sheet or the like based on the print data created by the image processing unit 120. The print engine 130 is roughly composed of a toner image forming unit, a fixing device, a paper transport unit, and the like. The print engine 130 forms an image on a sheet by, for example, electrophotography. The toner image forming unit combines four color images by a so-called tandem method, and forms a color image on a sheet (recording medium). The toner image forming unit includes a photoconductor provided for each color of C (cyan), M (magenta), Y (yellow), and K (black), and an intermediate in which a toner image is transferred (primary transfer) from the photoconductor. The image forming apparatus includes a transfer belt and a transfer unit that transfers an image from the intermediate transfer belt to a sheet (secondary transfer). The fixing device has a heating roller and a pressure roller. The fixing device conveys the sheet on which the toner image is formed between the heating roller and the pressure roller, and heats and presses the sheet. As a result, the fixing device melts the toner adhering to the paper and fixes it on the paper to form an image on the paper. The paper transport unit includes a paper feed roller, a transport roller, and a motor that drives them. The paper transport unit feeds paper from the paper feed cassette and transports the paper inside the housing of MFP 100. The paper transport unit discharges the paper on which the image has been formed from the housing of the MFP 100 to a paper discharge tray or the like.

  Storage unit 140 includes, for example, an HDD (Hard Disk Drive), and stores various data related to the operation of MFP 100 such as an application program.

  The operation display unit 150 receives various operations from the user through the operation panel 101. The operation display unit 150 displays various information on the operation panel 101.

  The communication unit 160 communicates with the terminal 200. The communication unit 160 includes a remote operation screen transmission unit 161 that transmits data related to the remote operation screen, and a reception unit 163 that receives various types of information such as operation information received by the terminal 200 on the remote operation screen.

  The terminal 200 includes a control unit 210, a communication unit 220, an image processing unit 230, a storage unit 240, and an operation display unit 250.

  The control unit 210 controls the entire terminal 200. The control unit 210 includes a CPU, a ROM, a RAM, and the like. The CPU executes a control program stored in the ROM. The ROM stores various programs for operating the terminal 200 and various fixed data. The control unit 210 reads data from the storage unit 240 and writes data to the storage unit 240 by performing predetermined processing.

  Communication unit 220 communicates with MFP 100. The communication unit 220 includes a remote operation screen receiving unit 221 that receives data related to the remote operation screen, and a transmission unit 223 that transmits various types of information such as operation information received by the terminal 200 on the remote operation screen.

  The image processing unit 230 creates data related to the remote operation screen. The image processing unit 230 includes a reception data determination unit 231 and a drawing unit 233. Reception data determination unit 231 determines whether the data regarding the remote operation screen received from MFP 100 is layout information or a remote operation screen. The drawing unit 233 draws a remote operation screen that is a raster image based on the layout information. The drawing unit 233 draws various screens to be displayed on the touch panel 201.

  The storage unit 240 is an HDD, for example, and stores various data related to the operation of the terminal 200. The storage unit 240 stores a remote panel application program that is an application for displaying a remote operation screen.

  The operation display unit 250 receives various operations from the user through the touch panel 201. The operation display unit 250 displays various information on the touch panel 201. The operation display unit 250 includes a remote operation screen display unit 251 that displays a remote operation screen on the touch panel 201.

  [Operation of image forming system]

  Next, the operation of the image forming system will be described.

  In the present embodiment, MFP 100 determines which of MFP 100 and terminal 200 is used to draw a remote operation screen (hereinafter may be referred to as a remote operation screen drawing method), and the remote operation screen is displayed at the determined location. Draw. The remote operation screen drawing method may be determined under any conditions.

  FIG. 3 is a block diagram schematically showing the operation of the image forming system when MFP 100 performs drawing of the remote operation screen in the embodiment of the present invention. 3 and 4 show only the configuration of the part related to the drawing of the remote operation screen.

  Referring to FIG. 3, when the remote panel application is activated, terminal 200 transmits a communication request (remote operation screen generation request) to MFP 100. When MFP 100 receives a communication request from terminal 200, layout generation unit 121 generates layout information for the remote operation screen. Next, in MFP 100, drawing method determination unit 123 determines a drawing method for the remote operation screen. If MFP 100 determines to perform drawing on the remote operation screen, MFP 100 transmits layout information from layout generation unit 121 to drawing unit 125 as indicated by arrow AR1. Subsequently, the MFP 100 draws the remote operation screen in the drawing unit 125 based on the layout information. An accelerator 127 is used for this drawing. Next, MFP 100 transmits the drawn remote operation screen to terminal 200 through remote operation screen transmission unit 161, as indicated by arrow AR2.

  The terminal 200 receives the remote operation screen at the remote operation screen receiving unit 221. Subsequently, the terminal 200 determines in the reception data determination unit 231 whether the received data is a remote operation screen or layout information. When the received data is a remote operation screen, MFP 100 transmits the remote operation screen from remote operation screen receiving unit 221 to remote operation screen display unit 251 as indicated by arrow AR3. In this case, the terminal 200 does not transmit the remote operation screen to the drawing unit 233. The remote operation screen display unit 251 displays the received remote operation screen on the touch panel 201 (display) of the terminal 200.

  FIG. 4 is a block diagram schematically showing the operation of the image forming system when the terminal 200 draws the remote operation screen in the embodiment of the present invention.

  Referring to FIG. 4, when MFP 100 receives a communication request (remote operation screen generation request) from terminal 200, layout generation unit 121 generates layout information of the remote operation screen. Next, in MFP 100, drawing method determination unit 123 determines a drawing method for the remote operation screen. If the MFP 100 determines to draw the remote operation screen on the terminal 200, the MFP 100 transmits layout information from the layout generation unit 121 to the remote operation screen transmission unit 161 as indicated by an arrow AR11. In this case, the MFP 100 does not transmit the layout information to the drawing unit 125, and the drawing unit 125 does not draw the remote operation screen. Next, MFP 100 transmits the layout information to terminal 200 through remote operation screen transmission unit 161 as indicated by arrow AR12.

  The terminal 200 receives the remote operation screen at the remote operation screen receiving unit 221. Subsequently, the terminal 200 determines in the reception data determination unit 231 whether the received data is a remote operation screen or layout information. When the received data is layout information, MFP 100 transmits the layout information from remote operation screen receiving unit 221 to drawing unit 233 as indicated by arrow AR13. Next, the terminal 200 causes the drawing unit 233 to draw a remote operation screen based on the layout information. Subsequently, the terminal 200 transmits the drawn remote operation screen to the remote operation screen display unit 251 as indicated by an arrow AR14. The remote operation screen display unit 251 displays the received remote operation screen on the touch panel 201 (display) of the terminal 200.

  FIG. 5 is a flowchart showing the operation of the image forming system according to the embodiment of the present invention.

  Referring to FIG. 5, upon receiving a communication start request from terminal 200 (S1), main controller 110 of MFP 100 starts communication with terminal 200 (S3) and generates layout information of the remote operation screen (S5). ). Next, the main controller 110 determines a drawing method by performing a drawing method determination process described below (S7). Subsequently, the main controller 110 determines whether or not the MFP 100 has decided to draw the remote operation screen (S9).

  If it is determined in step S9 that the MFP 100 has decided to draw the remote operation screen (YES in S9), the main controller 110 draws the remote operation screen based on the layout information (S11), and the drawn remote operation The screen is transmitted to terminal 200 (S13), and the process proceeds to step S17.

  If it is determined in step S9 that the terminal 200 has decided to draw the remote operation screen (NO in S9), the main controller 110 transmits layout information to the terminal 200 (S15), and proceeds to the process of step S17. .

  In step S17, control unit 210 of terminal 200 receives a remote operation screen or layout information from MFP 100 (S17), and determines whether or not a remote operation screen has been received (S19).

  If it is determined in step S19 that the remote operation screen has been received (YES in S19), the control unit 210 displays the remote operation screen on the touch panel 201 (S23).

  If it is determined in step S19 that layout information has been received (NO in S19), control unit 210 renders a remote operation screen based on the layout information (S21), and proceeds to the process of step S23.

  In step S23, the control unit 210 displays a remote operation screen (S23). Next, control unit 210 accepts a user operation on the remote operation screen (S25), and transmits information of the accepted operation to MFP 100 (S27). When the main controller 110 of the MFP 100 receives operation information from the terminal 00, the main controller 110 determines whether the operation ends communication with the MFP 100 (S29). For example, when receiving information about an operation for closing the remote operation screen, main controller 110 determines that the operation ends communication with MFP 100.

  If it is determined in step S29 that communication is to be ended (YES in S29), the main controller 110 ends the process.

  If it is determined in step S29 that the communication is not terminated (NO in S29), the main controller 110 creates updated layout information of the remote operation screen based on the operation information (updates the layout information). ) (S25), the process proceeds to step S7.

  [Drawing method decision processing]

  Next, the drawing method determination process will be described.

MFP 100 accepts, for example, the setting of the priority order of the determination conditions for a plurality of drawing methods,
The drawing method of the remote operation screen is determined by adopting the determination condition having a high priority order of accepting the setting with priority. Here, the drawing method determination process when there are four drawing method determination conditions will be described.

  FIG. 6 is a subroutine of the drawing method determination process in step S7 shown in FIG. In FIG. 6 and subsequent drawings and the description thereof, the drawing method in which the MFP 100 draws the remote operation screen may be referred to as a drawing method D1, and the drawing method in which the terminal 200 draws the remote operation screen may be referred to as a drawing method D2. .

  Referring to FIG. 6, in the drawing method determination process, main controller 110 sets the drawing method to default drawing method D1 (S101). Subsequently, the main controller 110 performs a determination process using the drawing method determination condition having the lowest priority (priority 1) (S103). Next, the main controller 110 performs a determination process using the drawing method determination condition having the second lowest priority (priority level 2) (S105). Next, the main controller 110 performs a determination process using the drawing method determination condition having the third lowest priority (priority level 3) (S107). Next, the main controller 110 performs determination processing using the drawing method determination condition with the highest priority (priority level 4) (S109), and returns.

  In each determination process, a drawing method is determined based on whether or not a drawing method determination condition is satisfied. In the flowchart of FIG. 6, the drawing method determined in the determination process with low priority may be changed in the determination process with high priority executed later. The number of conditions for determining the drawing method is arbitrary and may be one. When the number of drawing method determination conditions is one, MFP 100 does not accept priority order settings.

  For example, the MFP 100 accepts setting of priority orders of determination conditions for a plurality of drawing methods through a setting acceptance screen shown in FIG. The setting reception screen is displayed when an operation for changing to the setting reception screen (for example, a long press of a specific hardware key HK or the like) is received.

  FIG. 7 is a diagram schematically illustrating a setting reception screen that is displayed on the display unit 103 of the operation panel 101 and receives the setting of the priority order of the drawing method determination conditions.

  Referring to FIG. 7, on the setting reception screen, four keys K1 to K4, an “OK” key K5, and a “cancel” key K6 are displayed. Each of the keys K1 to K4 is a key corresponding to various determination conditions. Each of the keys K1 to K4 has a higher priority as it is displayed in the upper part of FIG. When MFP 100 accepts an operation for switching the display positions of keys K1 to K4 (for example, a drag operation of any key) from the user, MFP 100 switches the display positions of the keys. When the “OK” key K5 is pressed, the priority order of the determination conditions is determined in the order of the keys displayed at that time. The determined priority order is stored in the storage unit 140, for example. When the “cancel” key K6 is pressed, the replacement of the key display position performed so far is discarded.

  Note that the MFP 100 may add or delete a drawing method determination condition according to a user operation.

  [Specific examples of drawing method determination conditions]

  Subsequently, the first to fourth determination conditions, which are specific examples of the determination method for the drawing method of the remote operation screen, will be described in order.

  The first determination condition is that when the MFP 100 starts communication with the terminal 200 and the job using the accelerator 127 is being executed, the terminal 200 determines that the remote operation screen is drawn. When the accelerator 127 is used in another job, the processing speed of the accelerator 127 is reduced. Therefore, the terminal 200 performs drawing of the remote operation screen, so that the reduction of the drawing speed can be suppressed. .

  Note that the job in which the MFP 100 uses the accelerator 127 is preferably a job including a drawing process for analyzing a page description language, such as a print job.

  FIG. 8 is a subroutine of job execution state determination processing that employs the first determination condition. This job execution state determination process is executed as a subroutine of the determination process in step S103, S105, S107, or S109 shown in FIG.

  Referring to FIG. 8, main controller 110 determines whether or not the job (job using accelerator 127) is being executed when MFP 100 starts communication with terminal 200 (S <b> 201).

  If it is determined in step S201 that the job is being executed (YES in S201), the main controller 110 sets the drawing method to the drawing method D2 (S203) and returns.

  If it is determined in step S201 that the job is not being executed (NO in S201), the main controller 110 does not change the drawing method (S205) and returns.

  As a determination condition similar to the first determination condition, when the MFP 100 newly draws a job execution instruction using the accelerator 127 after the MFP 100 has drawn the remote operation screen, the MFP 100 performs the remote operation. The screen drawing may be changed (determined) so that the terminal 200 performs the drawing.

  The second determination condition is that when the MFP 100 starts communication with the terminal 200 and the MFP 100 is in the power saving mode, the terminal 200 determines to draw the remote operation screen. The power saving mode is a mode in which power consumption is reduced by turning off power to some members in the MFP 100 while maintaining the activation state of the MFP 100. When the MFP 100 is in the power saving mode, the power consumption of the MFP 100 can be reduced by reducing the processing performed by the MFP 100 as much as possible and allowing the MFP 100 to maintain the power saving mode.

  FIG. 9 is a subroutine of a power saving state determination process that employs the second determination condition. This power saving state determination process is executed as a subroutine of the determination process in step S103, S105, S107, or S109 shown in FIG.

  Referring to FIG. 9, main controller 110 determines whether MFP 100 is in the power saving mode when MFP 100 starts communication with terminal 200 (S211).

  If it is determined in step S211 that the current mode is the power saving mode (YES in S211), the main controller 110 sets the drawing method to the drawing method D2 (S213) and returns.

  If it is determined in step S211 that the power saving mode has not been set (NO in S211), the main controller 110 does not change the drawing method (S215) and returns.

  Note that as a determination condition similar to the second determination condition, when the MFP 100 performs drawing of the remote operation screen and then satisfies the condition for the MFP 100 to shift to the power saving mode, the MFP 100 draws the remote operation screen. 200 may be changed (determined). The condition for shifting to the power saving mode is arbitrary. For example, the MFP 100 may not accept an operation for a certain period of time, or the MFP 100 may not execute a job for a certain period of time.

  The third determination condition is that the power state of terminal 200 when the communication with MFP 100 is started (the battery remaining amount of terminal 200 and information about whether terminal 200 is being charged), MFP 100 from terminal 200 The drawing method is determined based on the received power state of the terminal 200. Thereby, when the terminal 200 is driven by a battery, it is possible to prevent the drive time from being shortened.

  FIG. 10 is a subroutine of a terminal power supply state determination process that employs the third determination condition. This terminal power state determination process is executed as a subroutine of the determination process in step S103, S105, S107, or S109 shown in FIG.

  Referring to FIG. 10, the main controller 110 obtains the power state of the terminal 200 (S221). Here, as the power state of terminal 200, main controller 110 obtains the remaining battery level of terminal 200 when communication with MFP 100 is started and information on whether terminal 200 is being charged. Subsequently, the main controller 110 determines whether or not the terminal 200 is being charged based on the obtained information (S223).

  If it is determined in step S223 that charging is not in progress (NO in S223), the main controller 110 determines whether or not the remaining battery level of the terminal 200 is equal to or less than a threshold value (whether or not the battery is low) (S225). ).

  If it is determined in step S225 that the remaining battery level is equal to or less than the threshold (YES in S225), the main controller 110 sets the drawing method to the drawing method D1 (S227) and returns.

  If it is determined in step S223 that charging is in progress (YES in S223), or if it is determined in step S225 that the remaining battery level exceeds the threshold (NO in S225), the main controller 110 changes the drawing method. No change is made (or the drawing method is set to the drawing method D2) (S229), and the process returns.

  In the subroutine shown in FIG. 10, the execution order of the determination process in step S223 and the determination process in step S225 may be switched. In the process of step S229, the drawing method may be set to the drawing method D2.

  As a determination condition similar to the third determination condition, when the MFP 100 receives the remaining battery level of the terminal 200 when starting communication with the MFP 100 from the terminal 200 and the remaining battery level is equal to or less than the threshold value, MFP 100 may determine that MFP 100 is to draw the remote operation screen.

  As a determination condition similar to the third determination condition, the MFP 100 receives from the terminal 200 information indicating whether or not the terminal 200 at the time of starting communication with the MFP 100 is being charged, and the information is being charged. In this case, the MFP 100 may determine that the terminal 200 draws the remote operation screen.

  As a determination condition similar to the third determination condition, the MFP 100 receives from the terminal 200 the remaining battery level of the terminal 200 after the terminal 200 has drawn the remote operation screen, and the remaining battery level is equal to or less than the threshold value. In this case, the MFP 100 may be changed (determined) to draw the remote operation screen.

  Further, as a determination condition similar to the third determination condition, the MFP 100 receives from the terminal 200 information indicating whether or not the terminal 200 is being charged after the terminal 200 has drawn the remote operation screen. If the information indicates that charging is in progress, the MFP 100 may change (determine) the terminal 200 to draw the remote operation screen.

  The fourth determination condition is that when the MFP 100 starts communication with the terminal 200 and the MFP 100 is communicating with a terminal different from the terminal 200, the MFP 100 determines to draw the remote operation screen on the terminal 200. To do. Thereby, it is possible to prevent a reduction in drawing speed due to the accelerator 127 drawing the remote operation screens of a plurality of terminals.

  FIG. 11 is a subroutine of a multiple connection state determination process that employs the fourth determination condition. The multiple connection state determination process is executed as a subroutine of the determination process in step S103, S105, S107, or S109 shown in FIG.

  Referring to FIG. 11, main controller 110 determines whether or not a terminal different from terminal 200 is connected to MFP 100 (S231).

  If it is determined in step S231 that another terminal is connected (YES in S231), the main controller 110 determines whether or not the drawing method of the other terminal being connected is the drawing method D1 ( S233).

  If it is determined in step S233 that the drawing method of another terminal is the drawing method D1 (YES in S233), the main controller 110 sets the drawing method to the drawing method D2 (S235) and returns.

  If it is determined in step S231 that another terminal is not connected (NO in S231), or if it is determined in step S233 that the drawing method of another terminal is not the drawing method D1 (NO in S233), the main controller 110 The drawing method is not changed (S237), and the process returns.

  As a determination condition similar to the fourth determination condition, when the MFP 100 starts communication with the terminal 200 and there are more than a predetermined number of other terminals communicating with the MFP 100, the MFP 100 displays the remote operation screen. It may be determined that drawing is performed on the terminal 200.

  FIG. 12 is a subroutine of the drawing method determination process in step S7 shown in FIG. 5 when the first to third determination conditions are employed. The determination process illustrated in FIG. 12 is a specific example of the determination process illustrated in FIG. In the determination process shown in FIG. 12, the priority of the first determination condition is the highest, and the priority of the third determination condition is the lowest.

  Referring to FIG. 12, in the drawing method determination process, main controller 110 sets the drawing method to default drawing method D1 (S251). Next, the main controller 110 obtains the power state of the terminal 200 (S253). Subsequently, the main controller 110 determines whether or not the terminal 200 is being charged based on the obtained information (S255).

  If it is determined in step S255 that charging is not in progress (NO in S255), the main controller 110 determines whether or not the remaining battery level of the terminal 200 is equal to or less than a threshold value (whether or not the battery is low) (S257). ).

  If it is determined in step S257 that the remaining battery level is less than or equal to the threshold (YES in S257), the main controller 110 sets the drawing method to the drawing method D1 (S259), and proceeds to the process of step S263.

  If it is determined in step S255 that charging is in progress (YES in S255), or if it is determined in step S257 that the remaining battery level exceeds the threshold (NO in S257), the main controller 110 changes the drawing method. No change is made (S261), and the process proceeds to step S263.

  In step S263, the main controller 110 determines whether or not the MFP 100 is in the power saving mode when the MFP 100 starts communication with the terminal 200 (S263).

  If it is determined in step S263 that the current mode is the power saving mode (YES in S263), the main controller 110 sets the drawing method to the drawing method D2 (S265), and the process proceeds to step S269.

  If it is determined in step S263 that the current mode is not the power saving mode (NO in S263), the main controller 110 does not change the drawing method (S267) and proceeds to the process in step S269.

  In step S269, the main controller 110 determines whether or not the job (a job using the accelerator 127) is being executed when the MFP 100 starts communication with the terminal 200 (S269).

  If it is determined in step S269 that the job is being executed (YES in S269), the main controller 110 sets the drawing method to the drawing method D2 (S271) and returns.

  If it is determined in step S269 that the job is not being executed (NO in S269), the main controller 110 does not change the drawing method (S273) and returns.

  The drawing method determination process may be performed when communication with the terminal 200 is started, when a job is input to the MFP 100, when the MFP 100 shifts to a power saving state, or when the power state of the terminal 200 changes. Good.

  [Stop drawing remote operation screen]

  The MFP 100 may stop updating and drawing the remote operation screen when the remote panel application is activated in the background on the terminal 200. When the remote panel application is activated in the background, it is assumed that the user of the terminal 200 is not looking at the remote operation screen but is looking at the screen of another application. In such a case, by stopping the update and drawing of the remote operation screen, the load on the MFP 100 can be reduced and the performance of the MFP 100 can be improved.

  FIG. 13 is a flowchart of a remote operation screen update and drawing process.

  Referring to FIG. 13, when the main controller 110 starts communication with the terminal 200 (S303), the remote panel application is activated (executed) (information on whether or not the remote panel application is activated in the background). Is obtained (received) from the terminal 200 (S305). Subsequently, the main controller 110 determines whether the remote panel application is activated in the background based on the obtained activation state of the remote panel application (S307).

  If it is determined in step S307 that the system is activated in the background (YES in S307), the main controller 110 stops updating the layout information and drawing (S309), and proceeds to the process in step S311.

  If it is determined in step S307 that the system is not activated in the background (NO in S307), the main controller 110 determines whether layout information updating and drawing are stopped (S313).

  If it is determined in step S313 that the updating and drawing of the layout information is stopped (YES in S313), the main controller 110 restarts the updating and drawing of the layout information (S315), and proceeds to the process of step S311. On the other hand, if it is determined in step S313 that the updating and drawing of the layout information is not stopped (NO in S313), the main controller 110 proceeds to the process of step S311.

  In step S311, the main controller 110 determines whether or not communication with the terminal 200 has ended (S311).

  If it is determined in step S311 that the communication with the terminal 200 is not completed (NO in S311), the main controller 110 proceeds to the process of step S303. On the other hand, if it is determined in step S311 that the communication with the terminal 200 has ended (YES in S311), the main controller 110 ends the process.

  [Modification]

  FIG. 14 is a diagram illustrating an example of a remote operation screen displayed on the terminal 200. (A) shows the remote operation screen RD1, and (b) shows the remote operation screen RD2.

  Referring to FIG. 14, remote operation screen RD1 and remote operation screen RD2 differ only in the display state (display or non-display) of the paper size candidate items, and the other screen configurations are the same.

  The remote operation screen RD1 is an initial screen regarding print settings, and includes an object OB1. The object OB1 is a combo box that displays a candidate item for paper size (an item indicating information on a tray that stores paper used by the MFP 100) and accepts a selection from the displayed items. The paper size candidate item may be switchable between display and non-display in the object OB1.

  In the remote operation screen RD1, only the currently selected item “A4” (paper size information) among the paper size candidate items is displayed in the object OB1, and other items are not displayed.

  When the inverted triangle key KY1 on the right side of the object OB1 is pressed, a remote operation screen RD2 is displayed as shown in FIG. In the object OB1 of the remote operation screen RD2, all items “A3”, “A4”, “A5”, and “B5”, which are paper size candidates (list of selectable papers), are displayed. The item “B5” can be displayed by moving the key KY2, which is a scroll key.

  Note that the object OB1 may be a combo box or an area in which a specific item is scrollably displayed by a scroll bar. The item whose display state can be switched between display and non-display includes at least one information selected from the group consisting of a user name, an address, a history list, and information on a tray that stores sheets used by the MFP 100. It is preferable that the item is shown. These pieces of information do not fit on one screen when the remote operation screen is displayed.

  As described above, when the display screen of the terminal 200 transitions between the remote operation screen RD1 and the remote operation screen RD2, the paper size candidate items (here, “A3”, “A5”, and “B5”) are displayed. The display state of the item is switched between display and non-display, and the display state of the other parts does not change. The paper size candidate item is an item whose display state can be switched between display and non-display.

  In this modification, when the MFP 100 transmits layout information of the remote operation screen to the terminal 200 (arrow AR12 in FIG. 4), the MFP 100 displays display and non-display included in the remote operation screen together with the layout information of the remote operation screen. Information of items whose display state can be switched between the terminals 200 is transmitted to the terminal 200. When terminal 200 accepts an operation on the remote operation screen to switch the display state of an item whose display state can be switched between display and non-display, terminal 200 receives information on the accepted operation to MFP 100. The remote operation screen is drawn after switching the display state of the item.

  FIG. 15 is a diagram schematically showing a configuration of information transmitted by MFP 100 when MFP 100 transmits layout information of remote operation screen RD1 to terminal 200 in a modification of the present invention.

  Referring to FIG. 15, when MFP 100 transmits the layout information of remote operation screen RD1 shown in (a) to terminal 200, MFP 100 has the paper size shown in (b) together with the layout information of remote operation screen RD1. Information on candidate items (paper size information) is transmitted to the terminal 200. As described above, by transmitting the paper size information in advance when transmitting the layout information, the terminal 200 can update without performing communication with the MFP 100 within the drawing range based on the received paper size information. Screen drawing can be performed. As a result, the load on MFP 100 and terminal 200 can be reduced.

  FIG. 16 is a flowchart showing the operation of the image forming system in the modification of the present invention.

  Referring to FIG. 16, in the present modification, the same processing as in the flowchart shown in FIG. 5 is performed except for the following points.

  In the determination process of step S9, when it is determined that the terminal 200 has determined to draw the remote operation screen (NO in S9), the control unit 210 displays the display state between display and non-display together with the layout information. The switchable item information is transmitted to the terminal (S51), and the process proceeds to step S17.

  In step S25, after receiving a user operation on the remote operation screen (S25), the control unit 210 determines whether the received operation is an operation for switching the display state of the item between display and non-display. Is discriminated (S53).

  If it is determined in step S53 that the display state of the item is an operation for switching between display and non-display (YES in S53), the control unit 210 draws an update screen of the remote operation screen on the terminal 200 side ( S55), the process proceeds to step S25.

  If it is determined in step S53 that the display state of the item is not an operation for switching between display and non-display (NO in S53), the control unit 210 proceeds to the process of step S27.

  [Effect of the embodiment]

  According to the present embodiment, since the remote operation screen is drawn using the drawing accelerator installed in the MFP, it is possible to prevent degradation of the MFP performance during remote operation (remote connection). When the portable terminal is driven by a battery, the driving time can be extended. As a result, the remote operation screen can be displayed on the terminal by an appropriate method. In addition, since the MFP can accept both an operation on the MFP body and a remote operation on the terminal, the convenience of using the MFP can be improved.

  When the MFP determines whether to draw the remote operation screen on the MFP or the terminal, the remote operation screen can be drawn on the terminal side as necessary, reducing the load on the accelerator of the MFP. can do.

  [Others]

  The image forming apparatus may always draw the remote operation screen using an accelerator without performing the drawing method determination process, and may send the drawn remote operation screen to the terminal.

  The image forming apparatus may receive a setting as to whether the drawing of the remote operation screen is performed by the image forming apparatus or the terminal from the user, and may determine a drawing method according to the setting.

  The processing in the above-described embodiment may be performed by software or may be performed using a hardware circuit. It is also possible to provide a program for executing the processing in the above-described embodiment, and record the program on a recording medium such as a CD-ROM, a flexible disk, a hard disk, a ROM, a RAM, or a memory card and provide it to the user. You may decide to do it. The program is executed by a computer such as a CPU. The program may be downloaded to the apparatus via a communication line such as the Internet.

  The above-described embodiment is to be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

100 MFP
DESCRIPTION OF SYMBOLS 101 Operation panel 103 Display part 110 Main controller 120 Image processing part 121 Layout production | generation part 123 Drawing method determination part 125 Drawing part 127 Accelerator 130 Print engine 140 Storage part 150 Operation display part 160 Communication part 161 Remote operation screen transmission part 163 Reception part 200 terminal 201 touch panel 210 control unit 220 communication unit 221 remote operation screen reception unit 223 transmission unit 230 image processing unit 231 reception data determination unit 233 drawing unit 240 storage unit 250 operation display unit 251 remote operation screen display unit 300 network HK hardware key K1 to K6, KY1, KY2 key OB1 object RD1, RD2 Remote operation screen SK1, SK2 Software key

Claims (36)

An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
After drawing the remote operation screen by the image forming apparatus, when the image forming apparatus newly receives an execution instruction of a job using the accelerator, the execution destination of the drawing of the remote operation screen is set as the execution destination. further comprising changing means for changing the terminal, images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
Changing the execution destination of drawing of the remote operation screen to the terminal when the image forming device satisfies a condition for shifting to the power saving mode after drawing of the remote operation screen on the image forming device further comprising means, images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
When starting the communication with the terminal, when the image forming apparatus was in the power saving mode, said determining means, said determining that performs rendering of the remote operation screen at the terminal, images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
A first remaining amount receiving unit configured to receive from the terminal a remaining battery level of the terminal after the remote operation screen is drawn on the terminal;
If the battery remaining amount received by the first remaining receiving means is below a threshold, said determining means to determine for drawing the remote operation screen by the image forming apparatus, images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
A second remaining amount receiving unit configured to receive from the terminal a remaining battery level of the terminal when starting communication with the image forming apparatus;
If the battery remaining amount received by the second remaining receiving means is equal to or less than the threshold value, the determining means, and determines for drawing the remote operation screen by the image forming apparatus, images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
Further comprising first charging information receiving means for receiving, from the terminal, information indicating whether or not the terminal is being charged after drawing the remote operation screen on the terminal;
If the terminal in the first charging information receiving means receives the information that is being charged, further comprising a changing means for changing the execution destination drawing of the remote operation screen to the terminal, images forming device . An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
A second charging information receiving means for receiving from the terminal information indicating whether or not the terminal was charging when starting communication with the image forming apparatus;
If the terminal in the second charging information receiving means receives the information that was being charged, the determining means determines to perform the drawing of the remote operation screen at the terminal, images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
When starting communication with the terminal, if the terminal other than the terminal is in communication with the image forming apparatus, the determining unit determines to draw the remote operation screen on the terminal . images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
Operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
When it is determined by the determining means that the remote operation screen is drawn on the terminal, the drawing means does not draw the remote operation screen,
Priority order receiving means for receiving priority order settings of a plurality of decision conditions is further provided,
Which of the image forming apparatus and the terminal performs the drawing of the remote operation screen by preferentially adopting a determination condition having a high priority received by the priority order receiving means, the determination means determining, images forming device. An image forming apparatus that communicates with a terminal and receives an operation through a remote operation screen displayed on the terminal,
An accelerator,
Layout information generating means for generating layout information of the remote operation screen;
Using the accelerator, drawing means for drawing the remote operation screen based on the layout information generated by the layout information generating means;
An operation screen transmission means for transmitting the remote operation screen drawn by the drawing means to the terminal;
Further comprising application status receiving means for receiving information from the terminal whether or not an application for displaying the remote operation screen is activated in the background,
Wherein when the application in the application state receiving unit receives information that are running in the background, further comprising a stop means for stopping the updating and drawing of the remote operation screen images forming device. Determining means for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
Layout information transmitting means for transmitting the layout information generated by the layout information generating means to the terminal when the determining means determines to draw the remote operation screen on the terminal;
The image forming apparatus according to claim 10 , wherein when the determination unit determines to draw the remote operation screen on the terminal, the drawing unit does not draw the remote operation screen. After drawing the remote operation screen by the image forming apparatus, when the image forming apparatus newly receives an execution instruction of a job using the accelerator, the execution destination of the drawing of the remote operation screen is set as the execution destination. further comprising changing means for changing the terminal, the image forming apparatus according to any of claims 2-9 and 11. When the communication with the terminal is started and the image forming apparatus is executing a job using the accelerator, the determining unit determines to draw the remote operation screen on the terminal. Item 13. The image forming apparatus according to any one of Items 1 to 9, 11 , and 12 . The image forming apparatus according to claim 1, wherein the job that uses the accelerator by the image forming apparatus is a job including a drawing process for analyzing a page description language. The layout information transmission means, together with the layout information, the display and transmits the information items that can switch the display state to the terminal between the non-display, according to any one of claims 1 to 9 and 11 to 14 Image forming apparatus. The image formation according to claim 15 , wherein the information of the item is at least one information selected from the group consisting of a user name, an address, a history list, and information on a tray that stores paper used by the image forming apparatus. apparatus.   The image forming apparatus according to claim 1, further comprising an operation information receiving unit configured to receive operation information on the remote operation screen from the terminal. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
After drawing the remote operation screen by the image forming apparatus, when the image forming apparatus newly receives an execution instruction of a job using the accelerator, the execution destination of the drawing of the remote operation screen is set as the execution destination. further comprising a changing step of changing the terminal, the control method of the images forming apparatus. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
Changing the execution destination of drawing of the remote operation screen to the terminal when the image forming device satisfies a condition for shifting to the power saving mode after drawing of the remote operation screen on the image forming device step further comprising a method of controlling an image imaging apparatus. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
When starting the communication with the terminal, when the image forming apparatus was in the power saving mode, in said determining step, said determining and for drawing a remote operation screen in the terminal, the control method of the images forming apparatus . A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
A first remaining amount receiving step of receiving from the terminal a battery remaining amount of the terminal after drawing the remote operation screen on the terminal;
If the battery remaining amount received by the first remaining amount receiving step is equal to or less than the threshold, in the determining step, the determining to perform the drawing of the remote operation screen by the image forming apparatus, the control of the images forming apparatus Method. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
A second remaining amount receiving step of receiving from the terminal the remaining battery level of the terminal at the start of communication with the image forming apparatus;
If the battery remaining amount received by the second remaining amount receiving step is equal to or less than the threshold value, in the determination step, it determines to perform the drawing of the remote operation screen by the image forming apparatus, the images forming apparatus Control method. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
A first charging information receiving step of receiving, from the terminal, information indicating whether or not the terminal is being charged after drawing the remote operation screen on the terminal;
If the terminal in the first charging information receiving step receives the information that is being charged, further comprising a changing step of changing the execution destination drawing of the remote operation screen to the terminal, images forming device Control method. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
A second charging information receiving step of receiving from the terminal information on whether or not the terminal was charging when starting communication with the image forming apparatus;
If the terminal in the second charging information receiving step receives the information that was being charged, in the determination step, it determines to perform the drawing of the remote operation screen at the terminal, the images forming apparatus Control method. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
When starting communication with the terminal, if a terminal different from the terminal is communicating with the image forming apparatus, in the determining step, it is determined that the remote operation screen is drawn on the terminal . the method of images forming apparatus. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal;
A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined in the determination step that drawing of the remote operation screen is performed on the terminal;
When it is determined in the determination step that the drawing of the remote operation screen is performed on the terminal, the drawing of the remote operation screen is not performed in the drawing step.
A priority order receiving step for receiving priority order settings of a plurality of decision conditions;
In the determination step, the image forming apparatus or the terminal is used to draw the remote operation screen by preferentially adopting a determination condition having a high priority received in the priority reception step. determining the method of controlling the images forming apparatus. A method for controlling an image forming apparatus that communicates with a terminal, receives an operation through a remote operation screen displayed on the terminal, and includes an accelerator,
A layout information generating step for generating layout information of the remote operation screen;
A drawing step of drawing the remote operation screen based on the layout information generated in the layout information generation step using the accelerator;
An operation screen transmission step of transmitting the remote operation screen drawn in the drawing step to the terminal,
An application state receiving step of receiving information from the terminal whether or not an application for displaying the remote operation screen is activated in the background,
If the application in the application condition receiving step receives the information that are running in the background, the further comprising a stop step of stopping the update and the drawing of the remote operation screen, the control method of the images forming apparatus. A determination step for determining which of the image forming apparatus and the terminal to draw the remote operation screen;
A layout information transmission step for transmitting the layout information generated in the layout information generation step to the terminal when it is determined that the drawing of the remote operation screen is performed in the terminal in the determination step;
28. The method of controlling an image forming apparatus according to claim 27 , wherein when the drawing of the remote operation screen is determined to be performed by the terminal in the determining step, the drawing of the remote operation screen is not performed in the drawing step. After drawing the remote operation screen by the image forming apparatus, when the image forming apparatus newly receives an execution instruction of a job using the accelerator, the execution destination of the drawing of the remote operation screen is set as the execution destination. 30. The method of controlling an image forming apparatus according to claim 19, further comprising a changing step of changing to a terminal. When the communication with the terminal is started and the image forming apparatus is executing a job using the accelerator, it is determined in the determining step that the remote operation screen is drawn on the terminal. Item 30. A method for controlling an image forming apparatus according to any one of Items 18 to 26, 28, and 29 . 31. The method of controlling an image forming apparatus according to claim 18, wherein the job that uses the accelerator by the image forming apparatus includes a drawing process that analyzes a page description language. In the layout information transmission step, together with the layout information, the display and transmits the information items that can switch the display state to the terminal between the non-display, according to any one of claims 18 to 26 and 28 to 31 Image forming apparatus control method. The image formation according to claim 32 , wherein the information of the item is at least one information selected from the group consisting of a user name, an address, a history list, and information on a tray that stores a sheet used by the image forming apparatus. Control method of the device.   34. The method of controlling an image forming apparatus according to claim 18, further comprising an operation information receiving step of receiving operation information on the remote operation screen from the terminal.   An image forming apparatus control program causing a computer to execute the image forming apparatus control method according to any one of claims 18 to 34. An image forming system comprising a terminal and the image forming apparatus according to claim 1,
The terminal
Operation screen receiving means for receiving the remote operation screen transmitted by the operation screen transmitting means;
An image forming system including: a display unit configured to display the remote operation screen received by the operation screen receiving unit on a display unit of the terminal.

Images