JP2014016941A - Image forming apparatus, image forming system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image forming apparatus which communicates with an external display device which is in close proximity, wherein the image forming apparatus's screens to receive operations by a user of the image forming apparatus are extended to an external display device, and to provide an image forming system and a program.SOLUTION: An image forming apparatus comprises: communication means for communicating with an external display device when the external display device is in close proximity; operation display means for receiving operations by a user and displaying screens to the user; and display control means which, after the communication with the external display device is started, acquires main screen information related to a main screen to be displayed on the operation display means and sub-screen information related to a sub-screen to be displayed on the external display device, and displays the main screen on the operation display means, while transmitting the sub-screen information via the communication means and displaying the sub-screen on the external display device.

Description

  The present invention relates to an image forming apparatus, an image forming system, and a program.

  Patent Document 1 discloses an image forming apparatus having a communication unit that communicates with a mobile terminal, the acquisition unit that acquires information corresponding to the display content displayed on the mobile terminal via the communication unit, and the acquisition unit. There is disclosed an image forming apparatus comprising: a transmission unit configured to transmit information indicating a screen to be displayed on a portable terminal to a portable terminal via a communication unit based on the acquired information.

JP 2007-79039 A

  An object of the present invention is to provide an image forming apparatus, an image forming system, and a program in which a screen for accepting an operation from a user of the image forming apparatus is extended to the external display apparatus in an image forming apparatus that communicates with a nearby external display apparatus. It is to provide.

  In order to achieve the above object, the invention described in claim 1 is a communication means for communicating with the external display device when the external display device is in close proximity, accepting an operation by the user and displaying a screen to the user. After the communication between the operation display means and the external display device is started, main screen information related to the main screen displayed on the operation display means and sub screen information related to the sub screen displayed on the external display device Display control means for acquiring and displaying the main screen on the operation display means, and transmitting the sub-screen information via the communication means to display the sub-screen on the external display device. Device.

  Invention of Claim 2 acquires the attitude | position information of the said external display apparatus via the said communication means, and acquires the said main screen information and the said subscreen information based on the acquired attitude | position information. The image forming apparatus according to 1.

  According to a third aspect of the present invention, when the display control unit accepts a user operation by the operation display unit, the display control unit acquires update main screen information for updating the main screen and updates the operation display unit. When the display of the external display device needs to be updated based on the operation content received by the operation display unit, the main screen is displayed, and update subscreen information for updating the subscreen is acquired, and the communication unit 3. The image forming apparatus according to claim 1, wherein the updated sub-screen information is transmitted via the external display device to display the updated sub-screen on the external display device.

  The invention according to claim 4 is an update subscreen that updates the subscreen when the display control means is notified via the communication means that the user's operation has been accepted by the external display device. Information is acquired, the updated sub-screen information is transmitted via the communication means, the updated sub-screen is displayed on the external display device, and the operation display means displays based on the operation content received by the external display device The update main screen information for updating the main screen is acquired when the update is necessary, and the update main screen is displayed on the operation display means. This is an image forming apparatus.

  According to a fifth aspect of the present invention, there is provided an image forming system comprising the image forming apparatus according to any one of the first to fourth aspects and an external display device having a communication function.

  The invention according to claim 6 is a control program for controlling the operation display means of the image forming apparatus, wherein the computer exchanges information with the external display device when the external display device is in proximity. Means for accepting user operation on the operation display unit, main screen information relating to the main screen displayed on the operation display means after communication with the external display device is started, and sub-screen displayed on the external display device Means for obtaining the sub-screen information, and means for causing the operation display means to display the main screen, passing the sub-screen information to the external display device, and causing the external display device to display the sub-screen. It is a program that makes it work.

  According to the first, fifth, and sixth aspects of the present invention, in an image forming apparatus that communicates with a nearby external display device, a screen that accepts an operation from a user of the image forming device is extended to the external display device.

  According to the second and fifth aspects of the present invention, the screen for accepting an operation from the user of the image forming apparatus is extended to the external display device by a display method according to the attitude of the external display device.

  According to the third and fifth aspects of the invention, the sub-screen displayed on the external display device is updated in conjunction with the update of the main screen displayed on the image forming apparatus.

  According to the fourth and fifth aspects of the present invention, the main screen displayed on the image forming apparatus is updated in conjunction with the update of the sub-screen displayed on the external display device.

1 is a schematic diagram illustrating a configuration of an image forming system according to an embodiment of the present invention. 1 is a block diagram illustrating an example of a configuration of an image forming apparatus according to an embodiment of the present invention. It is a block diagram which shows an example of a structure of the operation display part which concerns on embodiment of this invention. It is a block diagram which shows an example of a structure of the external display apparatus which concerns on embodiment of this invention. 3 is a plan view illustrating an example of an arrangement of an operation panel of an external display device and an operation panel of an image forming apparatus. FIG. FIG. 10 is a plan view showing another example of the arrangement of the operation panel of the external display device and the operation panel of the image forming apparatus. It is a sequence which shows an example of operation | movement from a connection establishment to a screen display. It is a schematic diagram which shows an example of the screen displayed before proximity detection of an external display apparatus. (A) shows the main screen and (B) shows the sub-screen. It is a schematic diagram which shows an example of the screen displayed after proximity detection. (A) shows the main screen and (B) shows the sub-screen. It is a schematic diagram which shows an example of the screen displayed according to display information. (A) shows the main screen and (B) shows the sub-screen. It is a schematic diagram which shows another example of the screen displayed according to display information. (A) shows the main screen and (B) shows the sub-screen. 10 is a sequence showing an example of a display update operation on the external display device side in conjunction with an operation on the image forming apparatus side. 10 is a sequence showing an example of a display update operation on the image forming apparatus side in conjunction with an operation on the external display device side. FIG. 3 is a schematic diagram illustrating a state in which an operation is performed on the image forming apparatus side. (A) shows the main screen before operation, (B) shows the sub-screen before operation, and (C) shows the main screen at the time of operation. It is a schematic diagram which shows a mode that operation is performed by the external display apparatus side after display update is performed. (A) shows the main screen after display update, (B) shows the sub screen after display update, and (C) shows the sub screen at the time of operation. It is a schematic diagram which shows an example of the screen displayed after display update. (A) shows the main screen after display update, and (B) shows the sub-screen after display update. It is a schematic diagram which shows the modification of a display screen. (A) shows the main screen and (B) shows the sub-screen. It is a schematic diagram which shows the modification of a display screen. (A) shows the main screen and (B) shows the sub-screen. It is a schematic diagram which shows the modification of a display screen. (A) shows the main screen and (B) shows the sub-screen. It is a schematic diagram which shows the modification of a display screen. (A) shows the main screen, (B) shows the sub-screen, and (C) shows the screen when the sub-screen is not displayed.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings.

<Image forming system>
First, an image forming system according to an embodiment of the present invention will be described.
As shown in FIG. 1, the image forming system according to the present embodiment includes an image forming apparatus 10 and an external display device 100 disposed outside the image forming apparatus 10. The image forming apparatus 10 detects an external display device 100 within a predetermined distance range (hereinafter referred to as “close”), establishes a wireless connection with the detected external display device 100, and connects the connected external device Information is exchanged with the display device 100 by wireless communication. The wireless communication may be performed by a short-range wireless communication method such as Bluetooth (registered trademark).

  As will be described later, the external display device 100 is a terminal device having an operation panel that accepts an operation from a user and displays various information to the user. In the external display device 100, the operation panel is mainly composed of a touch panel. In the present embodiment, the touch panel of external display device 100 has a larger display area than the touch panel of a general mobile phone. The touch panel of the external display device 100 may be approximately the same size (display area) as the touch panel of the image forming apparatus 10. For example, a tablet terminal such as an iPad (registered trademark) may be used as the external display device 100. The detailed configuration of the external display device 100 will be described later.

  The image forming apparatus 10 is a multifunction machine that provides a plurality of service processes. In this embodiment, a plurality of service processes including at least a copying process, a printing process, an image reading process, and a facsimile process are provided. In the following, copying may be referred to as “copy”, printing as “print”, image reading as “scanner”, and facsimile as “fax”. The service process may be abbreviated as “service”, such as abbreviated as “copy”. The detailed configuration of the image forming apparatus 10 will be described next.

(Overall configuration of image forming apparatus)
Next, the configuration of the image forming apparatus 10 will be described.
FIG. 2 is a block diagram showing an example of the configuration of the image forming apparatus according to the embodiment of the present invention. As illustrated in FIG. 2, the image forming apparatus 10 includes a control unit 12, an operation display unit 14, an image reading unit 16, an image forming unit 18, a paper transport unit 20, a communication unit 22, and a storage unit 24. Note that the configuration of the image forming apparatus 10 is merely an example, and unnecessary functional units may be deleted, new functional units may be added, and the configuration and arrangement of each unit may be changed.

  The control unit 12 is configured as a computer that controls the entire apparatus and performs various calculations. That is, the control unit 12 includes a CPU (Central Processing Unit) 12A, a ROM (Read Only Memory) 12B storing various programs, a RAM (Random Access Memory) 12C used as a work area when executing the programs, A nonvolatile memory 12D for storing various information and an input / output interface (I / O) 12E are provided. Each of the CPU 12A, ROM 12B, RAM 12C, nonvolatile memory 12D, and I / O 12E is connected via a bus 12F.

  The operation display unit 14, the image reading unit 16, the image forming unit 18, the paper transport unit 20, the communication unit 22, and the storage unit 24 are connected to the I / O 12 E of the control unit 12. The control unit 12 exchanges information with the operation display unit 14, the image reading unit 16, the image forming unit 18, the paper transport unit 20, the communication unit 22, and the storage unit 24, and controls each unit.

  The operation display unit 14 includes various buttons, an operation panel that displays various screens, and the like. With the above configuration, the operation display unit 14 receives operations from the user and displays various information to the user. The detailed configuration of the operation display unit 14 will be described later.

  The image reading unit 16 includes an image reading device that optically reads an image formed on a sheet, such as an image sensor, and a scanning mechanism for scanning the sheet. With the above configuration, the image reading unit 16 reads an image on a document sheet placed on the image reading unit 16 and generates image information.

  The image forming unit 18 is an apparatus that forms an image on a sheet. For example, when an image is formed by electrophotography, the image forming unit 18 includes an image forming unit, a fixing device, and the like. The image forming unit includes a photosensitive drum, a charging device, an exposure device, a developing device, a transfer device, a cleaning device, and the like.

  Here, the image forming operation by the electrophotographic method will be briefly described. The photosensitive drum is charged by a charging device. The exposure apparatus exposes the charged photosensitive drum with light corresponding to the image. As a result, an electrostatic latent image corresponding to the image is formed on the photosensitive drum. The developing device develops the electrostatic latent image formed on the photosensitive drum with toner. The transfer device transfers the toner image formed on the photosensitive drum to a sheet. The fixing device fixes the toner image transferred on the paper.

  The paper transport unit 20 includes a paper storage unit that stores paper, a take-out roller that takes out the paper from the paper storage unit, a transport roller that transports the taken-out paper, and the like. With the above configuration, the paper transport unit 20 transports the paper taken out from the paper storage unit and supplies it to the image forming unit 18. Further, the sheet on which the image is formed by the image forming unit 18 is conveyed to the sheet discharge unit.

  The communication unit 22 is an interface for communicating with an external device via a wired or wireless communication line. For example, it functions as an interface for communicating with an external device such as a computer connected to a network such as a LAN (Local Area Network) or the Internet. In the present embodiment, wireless communication is performed with the external display device 100 via the communication unit 22.

  For example, the communication unit 22 acquires posture information representing the posture of the external display device 100 from the external display device 100. Further, the communication unit 22 transmits screen information to be displayed on the external display device 100 to the external display device 100. The communication unit 22 may acquire various programs such as image information, image formation information required for image formation, and application programs from an external device such as a computer.

  The storage unit 24 includes a storage device such as a hard disk. The storage unit 24 stores various data such as log data, various programs, and the like.

  Various drives may be connected to the control unit 12. Various drives read data from a computer-readable portable recording medium such as a flexible disk, a magneto-optical disk, a CD-ROM, or a USB (Universal Serial Bus) memory, and write data to the recording medium. It is. When various drives are provided, the program may be recorded on a portable recording medium and read and executed by the corresponding drive.

(Configuration of operation display)
Next, the configuration of the operation display unit 14 will be described.
FIG. 3 is a block diagram showing an example of the configuration of the operation display unit according to the embodiment of the present invention. As shown in FIG. 3, the operation display unit 14 includes a display control unit 30, an operation panel 40, a display generation unit 42, an input reception unit 44, and a storage unit 46. Further, as described with reference to FIG. 2, the operation display unit 14 is connected to the control unit 12 and the communication unit 22 of the image forming apparatus 10 via the I / O 12E. The configuration of the operation display unit 14 is an example, and unnecessary functional units may be deleted, new functional units may be added, and the configuration and arrangement of each unit may be changed.

  The display control unit 30 is configured as a computer that controls the entire operation display unit 14 and performs various calculations. That is, the display control unit 30 includes a CPU 32, a ROM 34, and a RAM 36. In the present embodiment, a control program for executing a “display control process” to be described later is stored in the ROM 34. The CPU 32 reads the stored program from the ROM 34 and executes the program using the RAM 36 as a work area. Note that the display control unit 30 may acquire the program via the communication unit 22 and various drives in the same manner as the control unit 12.

  Each of the CPU 32, ROM 34, and RAM 36 of the display control unit 30, the display generation unit 42, the input reception unit 44, and the storage unit 46 are connected to each other via a bus 48. The display control unit 30 exchanges information with each unit of the display generation unit 42, the input reception unit 44, and the storage unit 46, and controls these units.

  The operation panel 40 includes a touch panel 60 including a liquid crystal display for displaying various screens, various buttons 70 such as a start button and a numeric keypad, and the like (see FIGS. 5 and 6). The operation panel 40 is connected to each of the display generation unit 42 and the input reception unit 44. A detailed configuration of the operation panel 40 will be described later.

  The display generation unit 42 acquires screen data based on an instruction from the display control unit 30, and displays a screen corresponding to the acquired screen data on the operation panel 40. The screen data is stored in the storage unit 46. The input receiving unit 44 receives a user operation on the operation panel 40, specifies a setting function, a setting value, a pressed button, and the like, and notifies the display control unit 30 of the specified function.

  Here, when receiving an instruction to start service processing, the display control unit 30 instructs the control unit 12 of the image forming apparatus 10 to execute service processing. The control unit 12 controls each unit of the image reading unit 16, the image forming unit 18, the paper transport unit 20, the communication unit 22, and the storage unit 24 according to the contents of the service processing, and executes the service processing.

  The storage unit 46 stores various data and the like. In the present embodiment, the storage unit 46 stores screen data 50 for an image forming apparatus, screen data 52 for an external display device, a combination table 54, and control data 56. The screen data 50 for the image forming apparatus is data corresponding to various screens displayed on the operation panel 40. On the operation panel 40, a service selection screen for displaying a list of services to be provided, a setting screen for hierarchically dividing a settable function into a plurality of screens, and the like are displayed as a “main screen”.

  The screen data 52 for the external display device is data corresponding to various screens displayed on the external display device 100. On the external display device 100 connected to the image forming apparatus 10, the above-described service selection screen, setting screen, and the like are displayed as sub-screens.

  The combination table 54 is a table that defines “a combination of the main screen and the sub screen” according to the selection function and the attitude of the external display device. Based on the combination table 54, the combination of the main screen and the sub screen is determined from the selection function and the attitude of the external display device. That is, which “main screen” and which “sub-screen” are to be displayed are determined. Further, as will be described later, different combinations may be prepared corresponding to the postures of the external display device (horizontal orientation / vertical orientation).

  The control data 56 is various data used when the display control unit 30 executes the display control process. Various data may be represented by setting values, tables, graphs, and the like. Examples of the control data 56 include “initial value of each function” used when initializing a set value.

(External display device)
Next, the configuration of the external display device 100 will be described.
FIG. 4 is a block diagram showing an example of the configuration of the external display device according to the embodiment of the present invention. As illustrated in FIG. 4, the external display device 100 includes a control unit 110, a communication unit 120, an attitude detection unit 130, an operation panel 140, a display generation unit 142, an input reception unit 144, and a storage unit 150. The configuration of the external display device 100 is merely an example, and unnecessary function units may be deleted, new function units may be added, and the configuration and arrangement of each unit may be changed.

  The control unit 110 is configured as a computer that controls the entire external display device 100 and performs various calculations. That is, the control unit 110 includes a CPU 112, a ROM 114, and a RAM 116. In the present embodiment, a control program for executing a “display control process” to be described later is stored in the ROM 114. The CPU 112 reads the stored program from the ROM 114 and executes the program using the RAM 116 as a work area. Note that, similarly to the control unit 12, the control unit 110 may acquire a program from another storage device or may acquire a program via the communication unit 120.

  Each of the CPU 112, the ROM 114, and the RAM 116 of the control unit 110, the display generation unit 142, the input reception unit 144, and the storage unit 150 are connected to each other via a bus 160. The control unit 110 exchanges information with each unit of the communication unit 120, the posture detection unit 130, the display generation unit 142, the input reception unit 144, and the storage unit 150, and controls these units.

  The posture detection unit 130 includes an acceleration sensor and the like, and detects the posture of the external display device 100. Here, “posture” means the direction of the external display device 100. Specifically, the case where the length direction of the external display device 100 is substantially orthogonal to the gravity direction is defined as “lateral”, the length direction of the external display device 100 is substantially parallel to the gravity direction, and the top and bottom of the external display device 100 are The case where the direction is the normal position (the vertical direction is correct) is defined as “vertical direction”. The position where a button 146 described later is disposed is the lower side. Note that “substantially orthogonal” means a case closer to orthogonal than parallel, and “substantially parallel” means a case closer to parallel than orthogonal.

  The operation panel 140 includes a touch panel 148 including a liquid crystal display for displaying various screens, and buttons 146 (see FIGS. 5 and 6). The operation panel 140 is connected to each of the display generation unit 142 and the input reception unit 144.

  The display generation unit 142 acquires screen data based on an instruction from the control unit 110 and displays a screen corresponding to the acquired screen data on the operation panel 140. Note that screen data unique to the external display device 100 is stored in the storage unit 150. The input receiving unit 144 receives a user operation on the operation panel 140, specifies a setting function, a setting value, a pressed button, and the like, and notifies the control unit 110 of the specified function.

  The storage unit 150 stores various data and the like. In the present embodiment, the storage unit 150 stores screen data 152 and control data 154 unique to the external display device. The screen data 152 unique to the external display device is data corresponding to various screens displayed on the operation panel 140. When connected to the image forming apparatus 10, “screen data for an external display device” is acquired from the image forming apparatus 10 by communication in order to display a setting screen of the image forming apparatus 10 on the operation panel 140. .

  The control data 154 is various data used when the control unit 110 executes display control processing. Various data may be represented by setting values, tables, graphs, and the like. Examples of the control data 154 include “initial values of each function” used when initializing setting values.

(control panel)
Here, an example of the configuration of the operation panel will be specifically described with reference to FIGS. 5 and 6. FIG. 5 is a plan view showing an example of the arrangement of the operation panel 140 of the external display device and the operation panel 40 of the image forming apparatus. The operation panel 40 of the image forming apparatus is disposed at a position where the user can easily operate, such as the upper surface of the main body of the image forming apparatus 10. The external display device 100 is arranged close to the image forming apparatus 10. In addition, the external display device 100 is arranged in “landscape” so that the operation panel 140 and the operation panel 40 are aligned.

  The operation panel 40 of the image forming apparatus 10 includes a touch panel 60 and a button group 70. Each button of the button group 70 is arranged around the touch panel 60. The touch panel 60 also has a function as a liquid crystal display. A screen such as a setting screen is displayed on the touch panel 60 by the function of the liquid crystal display. When the user touches the image (button) displayed on the touch panel 60, the function corresponding to the image is specified from the position information of the area where the contact is detected.

  The button group 70 includes a numeric keypad 72, a start button 74, a reset button 76, a clear button 78, and the like. The numeric keypad 72 is used for the user to set a number such as setting the number of copies such as copying. The start button 74 is used to start execution of each service. The reset button 76 is used for selecting a service and resetting setting values of each function. The clear button 78 is used for clearing the setting value of each function. The configuration of the operation panel 40 is merely an example, and unnecessary buttons may be deleted, new buttons may be added, and the configuration and arrangement of each unit may be changed.

  The operation panel 140 of the external display device 100 has a touch panel 148 and buttons 146. The button 146 is a button for performing on / off or the like. As described above, the operation panel 140 is mainly configured by the touch panel 148. Since the function of the touch panel 148 is the same as that of the touch panel 60, the description thereof is omitted. In this example, the touch panel 148 of the operation panel 140 is substantially the same size as the touch panel 60 of the image forming apparatus 10. In the example shown in FIG. 5, the touch panel 148 and the touch panel 60 are arranged vertically.

  When the external display device 100 is connected to the image forming apparatus 10, a screen that accepts an operation from a user of the image forming apparatus (hereinafter referred to as an “image forming apparatus operation screen”) is a main screen and a sub screen. Are displayed separately. A main screen is displayed on the touch panel 60 of the image forming apparatus 10, and a sub screen is displayed on the touch panel 148 of the external display device 100. In other words, the display area for displaying the operation screen of the image forming apparatus is extended to the touch panel 148 of the external display device 100.

  When the display area is expanded, the number of screens and functions displayed in a list increases. For example, an upper layer screen may be displayed on the main screen, and a lower layer screen may be displayed on the sub screen. Different parallel layer screens may be displayed on the main screen and the sub screen. As a result, the number of times the screen is switched during the setting operation is reduced, and the setting contents can be easily confirmed. For example, it is easy to check whether or not automatic adjustment has been performed due to a conflict between functions.

  In the above description, the example in which the external display device 100 is arranged horizontally has been described. However, as shown in FIG. 6, the external display device 100 may be arranged vertically. In the example illustrated in FIG. 6, the external display device 100 is disposed in the vicinity of the image forming apparatus 10. Further, the external display device 100 is arranged in the “vertical direction” so that the operation panel 140 overlaps the operation panel 40. In the example shown in FIG. 6, the touch panel 148 and the touch panel 60 are arranged side by side.

<Display control processing>
Next, the “display control processing operation” executed in the image system will be described.

(From connection establishment to screen display)
First, the operation from connection establishment to screen display will be described.
FIG. 7 is a sequence showing an example of operations from connection establishment to screen display. Here, the operation of the “external display device” is acquired as a program and executed by the CPU 112 of the control unit 110 of the external display device 100. The operation of the “image forming apparatus” is acquired as a program and executed by the CPU 32 of the display control unit 30 of the operation display unit 14. The “information generation unit” is a functional unit that executes “information generation processing” of the display control unit 30. The operation of the “information generator” is acquired as a subroutine of the program and executed by the CPU 32. Note that communication between the image forming apparatus 10 and the external display device 100 is performed via the communication unit 22 and the communication unit 120.

  FIGS. 8A and 8B are schematic diagrams illustrating an example of a screen displayed before proximity detection of the external display device. FIGS. 9A and 9B are schematic diagrams illustrating an example of a screen displayed after proximity detection. FIGS. 10A and 10B are schematic diagrams illustrating an example of a screen displayed according to display information. FIGS. 11A and 11B are schematic diagrams illustrating another example of a screen displayed according to display information.

  As shown in FIG. 7, in step 100, the image forming apparatus displays a screen on the operation panel in accordance with a user operation. For example, as shown in FIG. 8A, a setting screen similar to the conventional one is displayed as a “main screen” on the touch panel of the image forming apparatus. As shown in FIG. 8B, a notification screen for notifying the user of the proximity to the image forming apparatus is displayed as a “sub-screen” on the touch panel of the external display device.

  In the next step 102, a nearby external display device is detected. In the next step 104, a signal requesting wireless connection is transmitted to the external display device. In step 200, the external display device responds to a request for wireless connection from the image forming apparatus. Thereby, a wireless connection is established. Next, in step 106, the image forming apparatus transmits a signal requesting posture information to the external display device. In step 202, the external display device transmits posture information in response to a request from the image forming apparatus.

  For example, as shown in FIG. 9A, on the touch panel of the image forming apparatus, a notification screen for notifying that the communication with the detected external display device is in progress is displayed as a “main screen”. As shown in FIG. 9B, a notification screen for notifying that display information is acquired from the image forming apparatus is displayed as a “sub-screen” on the touch panel of the external display device.

  Next, in step 108, the image forming apparatus instructs the information generation unit to generate display information corresponding to the posture information. Next, in step 110, the information generation unit executes “information generation processing” for generating display information. In the “information generation process”, screen data relating to the main screen is identified from the screen data 50 for the image forming apparatus based on the combination table 54 stored in the storage unit 46, and the sub-data is derived from the screen data 52 for the external display device. The screen data related to the screen is specified (see FIG. 3). Next, in step 112, the image forming apparatus acquires screen data related to the main screen and screen data related to the sub screen as “display information”.

  Next, in step 114, the image forming apparatus transmits display information to the external display device. In step 204, the external display device notifies that display information has been received from the image forming apparatus. Upon receiving the notification, the image forming apparatus displays a main screen on the touch panel in accordance with the acquired display information in step 116. Similarly, in step 206, the external display device displays a sub screen on the touch panel according to the acquired display information.

  For example, as shown in FIG. 10A, a part of a setting screen for displaying a plurality of functions is displayed as a “main screen” on the touch panel of the image forming apparatus. Further, as shown in FIG. 10B, the other part of the setting screen is displayed as a “sub-screen” on the touch panel of the external display device. In this example, the posture of the external display device is “vertical”.

  In the conventional image forming apparatus, a screen corresponding to the tab 1 is displayed on the touch panel (see FIG. 11A). Functions 1 to 5 are displayed on the screen corresponding to the tab 1, and functions 4 and 5 are displayed in a compressed manner. In the present embodiment, the display area for displaying the operation screen of the image forming apparatus is extended to the touch panel of the external display device, and the number of functions displayed as a list increases. A main screen displaying functions 1 to 4 corresponding to tab 1 is displayed on the touch panel of the image forming apparatus. In addition, on the touch panel of the external display device, a sub-screen displaying functions 5 to 10 corresponding to tab 1 is displayed. Further, by arranging the external display device in the vertical direction, the compression capacities 4 and 5 that have been displayed in a compressed manner are expanded and displayed in the vertical direction.

  In the above description, the example in which one setting screen is divided into the main screen and the sub screen has been described, but the relationship between the main screen and the sub screen may be arbitrarily set. For example, as shown in FIG. 11A, a specific parallel layer screen is displayed as a “main screen” on the touch panel of the image forming apparatus. Also, as shown in FIG. 11B, another parallel layer screen is displayed as a “sub-screen” on the touch panel of the external display device. In this example, the posture of the external display device is “landscape”.

  In the conventional image forming apparatus, a screen corresponding to the tab 1 is displayed on the touch panel (see FIG. 11A). In the present embodiment, by arranging the external display devices close to each other in the horizontal direction, the display area for displaying the operation screen of the image forming apparatus is expanded, and the number of screens displayed in a list increases. For example, on the touch panel of the image forming apparatus, a screen corresponding to the tab 1 is displayed as the main screen. Further, the screen corresponding to the tab 2 is displayed as a sub-screen on the touch panel of the external display device.

(Display update)
Next, the display update operation will be described.
FIG. 12 is a sequence showing an example of the display update operation on the external display device side in conjunction with the operation on the image forming apparatus side. FIG. 13 is a sequence showing an example of a display update operation on the image forming apparatus side in conjunction with an operation on the external display device side. As in the example illustrated in FIG. 7, the operation of the “external display device” is executed by the CPU 112, and the operations of the “image forming apparatus” and the “information generation unit” are executed by the CPU 32. The communication is the same as in the example shown in FIG.

  FIGS. 14A and 14B are schematic diagrams illustrating a state in which an operation is performed on the image forming apparatus side. FIGS. 15A and 15B are schematic diagrams illustrating a state in which an operation is performed on the external display device side after the display update is performed. FIGS. 16A and 16B are schematic diagrams illustrating an example of a screen displayed after display update.

(Display update on the external display device side)
As shown in FIG. 12, in step 300, the image forming apparatus displays a main screen on the touch panel according to the display information acquired from the information generation unit. Similarly, in step 400, the external display device also displays the sub screen on the touch panel according to the acquired display information acquired from the information generation unit. In the next step 302, the image forming apparatus detects a panel operation. That is, an operation from the user is accepted.

  In the next step 304, the information generation unit is requested to determine whether or not the sub screen needs to be updated. Next, in step 306, the information generation unit determines whether or not the sub screen needs to be updated. In “determination of necessity of updating”, it is determined whether it is necessary to update the screen displayed on the touch panel of the external display device in accordance with the panel operation on the image forming apparatus side. Based on the combination table 54 stored in the storage unit 46, it is determined whether or not another screen is to be displayed based on the selection function, posture information, and the like.

  In the next step 308, display information is generated according to the determination result. Based on the combination table 54, the screen data relating to the main screen is specified from the screen data 50 for the image forming apparatus, and the screen data relating to the sub-screen is specified from the screen data 52 for the external display device to generate display information. (See FIG. 3). Next, in step 310, the image forming apparatus acquires screen data relating to the main screen and screen data relating to the sub screen as “display information”.

  Next, in step 312, the image forming apparatus transmits display information together with the update request to the external display device. In step 402, the external display device notifies that an update request and display information have been received from the image forming apparatus. Upon receiving the notification, the image forming apparatus updates the main screen displayed on the touch panel according to the acquired display information in step 314. In step 404, the external display device updates the sub-screen displayed on the touch panel according to the acquired display information in conjunction with the operation on the image forming apparatus side.

  If it is determined in step 306 that no update is necessary, only screen data relating to the main screen is acquired in step 310. Also, step 312, step 402, and step 404 are omitted, and only the main screen displayed on the touch panel of the image forming apparatus is updated.

(Display update on the image forming device side)
As shown in FIG. 13, in step 500, the external display device displays a main screen on the touch panel according to the display information acquired from the information generation unit. Similarly, in step 600, the external display device also displays the sub screen on the touch panel according to the acquired display information acquired from the information generation unit. In the next step 502, the external display device detects a panel operation. That is, an operation from the user is accepted.

  In the next step 504, the information generation unit is requested to determine whether or not the main screen needs to be updated. Next, in step 602, the information generation unit determines whether update is necessary. In “determination of necessity of updating”, it is determined whether or not the screen displayed on the touch panel of the image forming apparatus needs to be updated according to the panel operation on the external display device side. In the next step 604, display information is generated according to the determination result.

  Next, in step 606, the image forming apparatus acquires display information together with the update request. In the next step 608, the display information is transmitted to the external display device. In step 506, the external display device notifies that display information has been received from the image forming apparatus. Upon receiving the notification, in step 614, the image forming apparatus updates the main screen displayed on the touch panel according to the acquired display information in conjunction with the operation on the external display device side. In step 508, the external display device updates the sub-screen displayed on the touch panel according to the acquired display information.

  If it is determined in step 604 that no update is necessary, only the screen data related to the sub-screen is acquired in step 310. Further, step 610 is omitted, and only the sub-screen displayed on the touch panel of the external display device is updated.

(Screen transition during display update)
Here, a specific example is given and demonstrated about the screen transition at the time of a display update.
For example, as shown in FIG. 14A, a specific parallel layer screen is displayed as a “main screen” on the touch panel of the image forming apparatus. Corresponding to tab 2, a main screen displaying functions 1 to 9 is displayed. As shown in FIG. 14B, the specific parallel layer screen is displayed as a “sub-screen” on the touch panel of the external display device. A sub-screen displaying functions (not shown) corresponding to the tab 2 is displayed. Here, as shown in FIG. 14C, an operation for selecting a function is performed on the main screen displayed on the touch panel of the image forming apparatus. In this example, the function 5 corresponding to the tab 2 is selected.

  As shown in FIG. 15A, a specific parallel layer screen updated according to an operation on the main screen is displayed as a “main screen” on the touch panel of the image forming apparatus. A screen on which the function 5 corresponding to the tab 2 is highlighted is displayed. As shown in FIG. 15B, a screen corresponding to the selection function of the parallel layer screen is displayed as a “sub-screen” on the touch panel of the external display device. A sub-screen displaying selection 1 to selection 4 as options of function 5 corresponding to tab 2 is displayed. That is, the display on the sub screen is updated in conjunction with the operation on the main screen shown in FIG. Here, as shown in FIG. 15C, an operation for selecting a function is performed on the sub-screen displayed on the touch panel of the external display device. In this example, selection 3 is selected from the choices of function 5.

  As shown in FIG. 16A, the specific parallel layer screen updated in accordance with the operation on the sub screen is displayed as the “main screen” on the touch panel of the image forming apparatus. A screen with the function 5 and the selection 3 corresponding to the tab 2 highlighted is displayed. As shown in FIG. 16B, the specific parallel layer screen is displayed as a “sub-screen” on the touch panel of the external display device. A sub-screen displaying functions (not shown) corresponding to the tab 2 is displayed. That is, the display on the main screen is updated in conjunction with the operation on the sub screen shown in FIG.

<Modification>
Note that the configurations of the image forming apparatus, the image forming system, and the program described in the above embodiments are merely examples, and it goes without saying that the configurations may be changed without departing from the gist of the present invention.

  For example, the relationship between the main screen and the sub-screen may be arbitrarily set such as the same screen, parallel layer, upper layer, lower layer, option display, and independent. Here, “independent” means that there is no relationship such as parallel, higher order, and lower order. An example of the main screen and the sub screen is given below. Each of FIGS. 17A and 17B, FIGS. 18A and 18B, FIGS. 19A and 20B, and FIGS. 20A to 20C is a modification of the display screen. It is a schematic diagram shown.

  As shown in FIG. 17A, a specific parallel layer screen is displayed as a “main screen” on the touch panel of the image forming apparatus. A main screen displaying functions 1 to 5 corresponding to tab 1 is displayed. As shown in FIG. 17B, the service selection screen is independently displayed as a “sub-screen” on the touch panel of the external display device.

  As shown in FIG. 18A, a specific parallel layer screen is displayed as a “main screen” on the touch panel of the image forming apparatus. A main screen displaying functions 1 to 5 corresponding to tab 1 is displayed. As shown in FIG. 18B, the service processing list screen is independently displayed as a “sub-screen” on the touch panel of the external display device.

  As shown in FIG. 19A, a specific parallel layer screen is displayed as a “main screen” on the touch panel of the image forming apparatus. A main screen displaying functions 1 to 5 corresponding to tab 1 is displayed. As shown in FIG. 19B, on the touch panel of the external display device, a screen indicating that the service process is being executed is independently displayed as a “sub-screen”.

  As shown in FIG. 20A, a specific parallel layer screen is displayed as a “main screen” on the touch panel of the image forming apparatus. Corresponding to tab 1, a main screen displaying functions 1 to 4 is displayed together with a message field. The message column displays that a list of destinations such as faxes can be confirmed on the external display device. As shown in FIG. 20B, a screen showing the destination list is independently displayed as a “sub-screen” on the touch panel of the external display device. As shown in FIG. 20C, when the sub screen is not displayed, a specific parallel layer screen including a destination list is displayed on the touch panel of the image forming apparatus.

  In the above embodiment, the “information generation unit” is described as a functional unit that executes “information generation processing” in the display control unit of the image forming apparatus. However, the “information generation unit” is included in the external display device. Both the image forming apparatus and the external display device may be included. Alternatively, a terminal device arranged outside the image forming apparatus may have an “information generation unit”. In these cases, the screen data for the image forming apparatus, the screen data for the external display device, and the combination table may be arranged together with the “information generation unit”.

  In the above embodiment, an example in which screen data is acquired and display information is generated has been described. However, screen data may be generated dynamically. For example, screen data generation conditions (partial image, layout, etc.) may be stored in a table or the like, and screen data may be generated dynamically.

DESCRIPTION OF SYMBOLS 10 Image forming apparatus 12 Control part 14 Operation display part 16 Image reading part 18 Image formation part 20 Paper conveyance part 22 Communication part 24 Storage part 30 Display control part 40 Operation panel 42 Display generation part 44 Input reception part 46 Storage part 48 Bus 50 Screen data for image forming apparatus 52 Screen data for external display apparatus 54 Combination table 56 Control data 60 Touch panel 70 Button group 100 External display device 110 Control unit 120 Communication unit 130 Attitude detection unit 140 Operation panel 142 Display generation unit 144 Input Reception unit 146 Button 146 Storage unit 148 Touch panel 150 Storage unit 152 Screen data 154 Control data 160 Bus

Claims (6)

A communication means for communicating with the external display device when the external display device is in proximity;
An operation display means for accepting an operation by the user and displaying a screen to the user;
After the communication with the external display device is started, the main screen information related to the main screen displayed on the operation display means and the sub screen information related to the sub screen displayed on the external display device are acquired, and the operation display Display control means for displaying the main screen on a means and transmitting the sub-screen information via the communication means to display the sub-screen on the external display device;
An image forming apparatus.   The image forming apparatus according to claim 1, wherein posture information of the external display device is acquired through the communication unit, and the main screen information and the sub screen information are acquired based on the acquired posture information. The display control means is
When an operation of the user is received by the operation display means, the update main screen information for updating the main screen is acquired, and the update main screen is displayed on the operation display means,
When it is necessary to update the display of the external display device based on the operation content received by the operation display means, update subscreen information for updating the subscreen is acquired, and the update subscreen information is acquired via the communication means. Sending screen information to display an update subscreen on the external display device;
The image forming apparatus according to claim 1. The display control means is
When the external display device notifies that the user's operation has been received via the communication unit, the update sub-screen information for updating the sub-screen is acquired, and the update sub-screen is acquired via the communication unit. Send information to display the update subscreen on the external display device,
When the display update of the operation display means is necessary based on the operation content received by the external display device, the update main screen information for updating the main screen is acquired, and the update main screen is displayed on the operation display means. Display,
The image forming apparatus according to any one of claims 1 to 3. An image forming apparatus according to any one of claims 1 to 4,
An external display device with a communication function;
An image forming system. A control program for controlling operation display means of the image forming apparatus,
Computer
Means for exchanging information with the external display device when the external display device is in close proximity;
Means for accepting user operation on the operation display unit;
Means for obtaining main screen information relating to a main screen displayed on the operation display means and sub-screen information relating to a sub-screen displayed on the external display device after communication with the external display device is started;
Means for displaying the main screen on the operation display means, and passing the sub-screen information to the external display device to display the sub-screen on the external display device;
Program to function as.