JP2013162387A - Image processing system, image processor, image processor cooperation method, and image processor cooperation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To determine a device to be operated by a user between multiple devices.SOLUTION: An MFP includes: a first server part 59 functioning as a server to be remotely controlled by a client; a first client part 61 functioning as a client to remotely control the server; a first selection part 63 for selecting one of a first state where the first server part 59 communicates with the client and a second state where the first client part 61 communicates with the server; a first display control part 55 for displaying its own device operation screen and a remote control screen simultaneously when the second state is selected; and a position detection part 67 for detecting the existence of a portable information device within a predetermined range from its own device. The first selection part 63 selects the second state on condition that the existence of the portable information device within the predetermined range is detected.

Description

  The present invention relates to an image processing system, an image processing device, an image processing device cooperation method, and an image processing device cooperation program, and in particular, an image processing system including a portable information device and an image processing device, the image processing device, and the image processing The present invention relates to an image processing apparatus cooperation method and an image processing apparatus cooperation program executed by the apparatus.

  In recent years, PDAs (Personal Digital Assistants) such as electronic paper or portable information devices such as smartphones can store electronic documents, and can view and edit documents regardless of time and place. . Further, a document stored in the portable information device can be transmitted to an image processing device such as a multifunction peripheral (hereinafter referred to as “MFP”), and the image processing device can execute processing such as printing or storage. However, there is a problem that the portable information device and the image processing device need to be operated separately, and the operation becomes complicated.

  Japanese Patent Application Laid-Open No. 2011-103572 discloses an image processing apparatus having a short-range wireless communication unit, a storage area for storing a program for controlling an operation panel control unit, and a control unit for controlling the operation panel control unit according to the program. When the mobile device is linked to the image processing device via the short-range wireless communication unit, the fact that the link is requested and the approval is requested is displayed on the operation panel of both the image processing device and the mobile device, and the approval operation is performed first. Confirm that the common user interface program or common user interface script has already been read in the storage unit of the device that has been used, and if not, transfer the common user interface program from the other device to the device that performed the approval operation first. Or, transfer the common user interface script via the short-range wireless communication unit, There is a or release operation is canceled or until the cancellation notice from the other party, the user interface program or printing system for implementing the control of the operation panel in a user interface script is described.

However, after the user performs an approval operation, the operated device cannot be changed. For example, when the specified data is to be processed by the image processing apparatus after the portable device is operated to specify the data to be processed, the operation for specifying the data is input to the portable device and processed by the image processing apparatus. It is convenient if the above operation can be input to the image processing apparatus. In the conventional print system, there is a problem that the user has to input an operation for selecting a device for inputting the operation, and the operation becomes complicated.
JP 2011-103572 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to perform image processing capable of determining a device operated by a user from among a portable information device and an image processing device. Is to provide a system.

  Another object of the present invention is to provide an image processing device capable of determining a device operated by a user from among a portable information device and an image processing device.

  Still another object of the present invention is to provide an image processing device cooperation method and an image processing device cooperation program capable of determining a device operated by a user from a portable information device and an image processing device.

  In order to achieve the above-described object, according to one aspect of the present invention, an image processing system is configured such that either one of an image processing device and a portable information device is remotely operated as a client, and the other is remotely operated as a server. An image processing system capable of being remotely operated, wherein each of the image processing device and the portable information device communicates with a display means for displaying an image and a device functioning as a client, and is remotely operated by a device functioning as a client Server means that functions as a server, client means that functions as a client that remotely operates the server, a first state in which the server means communicates with an apparatus that functions as a client, and the client means is a server A second state of communicating with the device functioning as A selection means for selecting one of the states, and when the second state is selected by the selection means, the own apparatus operation screen for operating the own apparatus, and the remote operation for remotely operating the server Display control means for simultaneously displaying a screen on the display means, and the image processing device further comprises position detection means for detecting that the portable information device is within a predetermined range determined by the distance from the device. The selecting means included in the image processing apparatus selects the second state on condition that the position detecting means detects that the portable information device is within a predetermined range.

  According to this aspect, when the second state is selected, the image forming apparatus or the portable information apparatus displays the own apparatus operation screen and the remote operation screen on the display unit at the same time, so that the apparatus functions as a client. , The device and the server can be operated. The image processing apparatus becomes a client of the portable information device on condition that the portable information device is detected to be within a predetermined range. For this reason, if the portable information device is within the predetermined range, the user of the portable information device can operate the image processing device. Therefore, the image can be displayed only when the operation user can operate the image processing device. The portable information device can be remotely controlled by the forming device. As a result, it is possible to provide an image processing system capable of determining a device operated by the user from among the portable information device and the image processing device.

  Preferably, the image processing apparatus further includes mode switching means for switching the operation mode between a normal mode and a power saving mode with lower power consumption than the normal mode, and the selection means included in the image processing apparatus includes mode switching means. The second state is selected on the condition that the operation mode is not switched to the power saving mode.

  According to this aspect, in the image processing device, when the operation mode is switched to the power saving mode, the portable information device is selected as a device operated by the user. For this reason, since the power saving mode continues in the image processing apparatus, the power consumption of the image processing apparatus can be reduced.

  Preferably, the image processing apparatus further includes an operation receiving unit that receives an operation by the user, and an authentication unit that authenticates a user who operates the operation receiving unit, and the selection unit included in the image processing apparatus is portable by the authentication unit. The second state is selected on the condition that a user different from the user associated with the information device is not authenticated.

  According to this aspect, when the user who is different from the user associated with the portable information device is not authenticated in the image forming device, the image forming device is selected as the device operated by the user. Therefore, even when the image forming apparatus is used by another user, the image forming apparatus can be remotely operated by operating the portable information device.

  Preferably, the selection unit included in the image processing apparatus selects the second state when the user associated with the portable information device is authenticated by the authentication unit while the first state is selected. .

  According to this aspect, in the image forming apparatus, when the user associated with the portable information apparatus is authenticated, the image forming apparatus is selected as the apparatus operated by the user. For this reason, the operating user can easily change the device operated from the portable information device to the image forming apparatus.

  Preferably, the selection unit included in the portable information device selects the first state when the user can select data to be processed by the portable information device.

  According to this aspect, when the user selects data using the portable information device, the user can continue to remotely operate the image processing device using the portable information device.

  Preferably, the selection unit included in the portable information device selects the second state when the first state is selected by the selection unit included in the image processing device, and the second is selected by the selection unit included in the image processing device. When the state is selected, the first state is selected.

  According to this aspect, one of the portable information device and the image processing device can be remotely operated.

  According to another aspect of the present invention, an image processing device is a display unit that displays an image, a communication unit that communicates with a portable information device, and a server that communicates with the portable information device and is remotely operated by the portable information device. A functioning server means, a client means for communicating with the portable information device and functioning as a client for remotely operating the portable information device; a first state in which the server means communicates with a device functioning as a client; and the client means as a server Selection means for selecting one of the second state communicating with the functioning device, and position detection means for detecting that the portable information device is within a predetermined range determined by the distance from the own device When the second state is selected by the selection means, the own apparatus operation screen for operating the own apparatus and the server are operated remotely. Display control means for simultaneously displaying on the display means, and the selection means is provided on the condition that the position detection means detects that the portable information device is within a predetermined range. The second state is selected.

  If this aspect is followed, the image processing apparatus which can determine the apparatus which a user operates among a portable information device and an own apparatus can be provided.

  Preferably, the apparatus further includes mode switching means for switching the operation mode to a normal mode and a power saving mode with lower power consumption than the normal mode, and the selection means included in the image processing apparatus has a power saving operation mode by the mode switching means. The second state is selected on condition that the mode has not been switched.

  Preferably, the image processing apparatus further includes an operation accepting unit that accepts an operation by a user, and an authentication unit that authenticates a user who operates the operation accepting unit, and the selection unit is configured to authenticate the portable information device by the authentication unit. The second state is selected on the condition that a user different from the associated user is not authenticated.

  Preferably, the selection unit selects the second state when the user associated with the portable information device is authenticated by the authentication unit while the first state is selected.

  Preferably, the selection unit selects the first state when the user can select data to be processed by the portable information device.

  According to still another aspect of the present invention, the image processing apparatus cooperation method is an image processing apparatus cooperation method executed by an image processing apparatus that receives an operation in cooperation with a portable information device, and the image processing apparatus Display means for displaying, communication means for communicating with the portable information device, server means for communicating with the portable information device and functioning as a server remotely operated by the portable information device, communication with the portable information device, and portable information device A first state in which the server means communicates with a device functioning as a client, and a second state in which the client means communicates with a device functioning as a server. The selection step for selecting one of the states, and the portable information device being within a predetermined range determined by the distance from the device. When the second state is selected in the selection step and the selection step, the own device operation screen for operating the own device and the remote operation screen for remotely operating the server are displayed on the display means. A display control step for simultaneously displaying the image processing device, and the selection step selects the second state on the condition that the detection step detects that the portable information device is within a predetermined range. Including the steps of:

  If this aspect is followed, the image processing apparatus cooperation method which can determine the apparatus which a user operates among a portable information device and an image processing apparatus can be provided.

  According to still another aspect of the present invention, the image processing device cooperation program is an image processing device cooperation program that is executed by a computer that controls an image processing device that receives an operation in cooperation with a portable information device. The apparatus communicates with the portable information device, display means for displaying an image, communication means for communicating with the portable information device, server means for communicating with the portable information device and functioning as a server remotely operated by the portable information device. A client unit that functions as a client for remotely operating the portable information device, and a second state in which the server unit communicates with a device that functions as a server, and a second state in which the server unit communicates with a device that functions as a server. A selection step of selecting one of the states and the state of the portable information device from its own device. When the second state is selected in the detection step for detecting the presence within the predetermined range determined by the step S2 and the selection step, the own device operation screen for operating the own device, and the server for remote operation A remote control screen and a display control step for simultaneously displaying the remote control screen on the display means, and the selection step is performed on the condition that the detection step detects that the portable information device is within a predetermined range. The step of selecting a second state.

  If this aspect is followed, the image processing apparatus cooperation program which can determine the apparatus which a user operates among a portable information device and an image processing apparatus can be provided.

1 is a diagram showing an overall outline of an image processing system in an embodiment of the present invention. 2 is a block diagram illustrating an outline of a hardware configuration of an MFP. FIG. It is a top view which shows an example of an operation panel. It is a block diagram which shows the outline | summary of the hardware constitutions of a portable information device. FIG. 3 is a diagram illustrating an example of functions of a CPU included in an MFP. It is a figure which shows an example of the function which CPU with which a portable information device is provided has. 6 is a diagram illustrating an example of a screen displayed on an MFP functioning as a client. FIG. It is a figure which shows an example of the screen displayed on the portable information device which functions as a client. It is a figure which shows an example of copy and paste operation. It is a flowchart which shows an example of the flow of an image processing apparatus cooperation process. It is a flowchart which shows an example of the flow of a 1st operating device determination process. It is a flowchart which shows an example of the flow of a 1st operation reception process. It is a flowchart which shows an example of the flow of a portable information device cooperation process. It is a flowchart which shows an example of the flow of a 2nd operating device determination process. It is a flowchart which shows an example of the flow of a 2nd operation reception process.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an overall outline of an image processing system according to an embodiment of the present invention. Referring to FIG. 1, image processing system 1 includes multifunction peripherals (hereinafter referred to as “MFPs”) 100, 100A, 100B, portable information device 200, and wireless station 5, each connected to network 3. Including. Therefore, MFPs 100, 100 A, and 100 C can communicate with each other via network 3.

  In the figure, an example is shown in which three MFPs (Multi Function Peripherals) 100, 100A, and 100B are connected to the network 3 as image processing apparatuses. However, the number of MFPs is not limited to this. What is necessary is just one or more. Further, instead of the MFPs 100, 100A, 100B, any apparatus having a function of processing data may be used, for example, a computer, a facsimile, a printer, or the like.

  The network 3 is a local area network (LAN), and the connection form may be wired or wireless. The network 3 is not limited to the LAN, and may be a network using a wide area network (WAN), a public switched telephone network, or the like. Furthermore, the network 3 is connected to the Internet. Therefore, each of MFPs 100, 100A, and 100B can communicate with a computer such as a server connected to the Internet.

  The portable information device 200 is a PDA (Personal Digital Assistant) having a communication function such as electronic paper or a smart phone. Here, a case where portable information device 200 is a smartphone will be described as an example. The portable information device 200 is connected to a cellular phone network by wirelessly communicating with a cellular phone base station, and can make a call. In addition, the portable information device 200 has a wireless LAN function.

  A wireless station 5 is further connected to the network 3. The wireless station 5 is a relay device of the network 3 and communicates with the portable information device 200 having a wireless LAN communication function to connect the portable information device 200 to the network 3. For this reason, portable information device 200 can transmit and receive data to and from MFPs 100, 100 </ b> A, 100 </ b> B connected to network 3.

  In image processing system 1 in the present embodiment, portable information device 200 communicates with one of MFPs 100, 100A, and 100B, and data is transmitted and received. The protocol for transmitting and receiving data is not particularly limited, and any protocol can be used. Portable information device 200 transmits data stored therein to any of MFPs 100, 100A, and 100B, and causes MFPs 100, 100A, and 100B to perform processing such as storage, display, transmission, and image formation. Can do. In addition, portable information device 200 can receive data stored in any of MFPs 100, 100A, and 100B and perform processing such as storage, display, and transmission. Data stored in portable information device 200 or MFPs 100, 100A, 100B may be application data downloaded from a personal computer (PC) or the like connected to network 3, or portable information device 200 or MFPs 100, 100A, 100B. When an Internet browser program is installed in each, data downloaded from a server connected to the Internet may be used. The data includes Web data described in a markup language.

  In the following description, a case where portable information device 200 communicates with MFP 100 will be described as an example. When portable information device 200 and MFP 100 communicate with each other, one of portable information device 200 and MFP 100 serves as a server and the other serves as a client, and remotely operates the server side device from the client side device. When portable information device 200 functions as a server and MFP 100 functions as a client, an operation screen for remotely operating portable information device 200 and an operation screen for operating MFP 100 are simultaneously displayed on the operation panel of MFP 100. Is displayed. Hereinafter, an operation screen displayed on the operation panel of MFP 100 for remotely operating portable information device 200 is referred to as a second remote operation screen, and an operation screen for operating MFP 100 is referred to as the first self-operation screen. This is called a device operation screen. When MFP 100 functions as a server and portable information device 200 functions as a client, a liquid crystal display (LCD) of portable information device 200 includes an operation screen for remotely controlling MFP 100 and portable information device 200. An operation screen for operation is displayed at the same time. Hereinafter, an operation screen displayed on the LCD of portable information device 200, which is an operation screen for remotely operating MFP 100, is referred to as a first remote operation screen, and an operation screen for operating portable information device 200 is a second. This is called its own device operation screen. In this case, the first remote operation screen is the same as the first own device operation screen, and the second remote operation screen is the same as the second own device operation screen. The first remote operation screen may not be the same as the first own device operation screen as long as it corresponds to the first own device operation screen. The second remote operation screen may not be the same as the second operation screen as long as it corresponds to the second operation screen.

  MFPs 100, 100A, and 100B may have the same or different hardware configurations, but include an image forming unit for forming an image on a sheet such as paper based on at least image data. Although the MFPs 100, 100A, and 100B may not have the same hardware configuration, the MFP 100 is assumed to have a configuration that at least one of the other MFPs 100A and 100B has, and the MFP 100 is an example unless otherwise specified. Explained.

  FIG. 2 is a block diagram showing an outline of the hardware configuration of the MFP. Referring to FIG. 2, MFP 100 includes a main circuit 110, a document reading unit 130 for reading a document, an automatic document feeder 120 for transporting a document to document reading unit 130, and a document reading unit 130. An image forming unit 140 for forming an image on a sheet or the like based on image data output by reading the image, a sheet feeding unit 150 for supplying the sheet to the image forming unit 140, an operation panel 160 as a user interface, Short-range wireless communication unit 170.

  The main circuit 110 includes a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, an EEPROM (Electrically Erasable and Programmable ROM) 115, a hard disk drive (HDD) 116 as a mass storage device, A facsimile unit 117 and an external storage device 119 on which a CD-ROM (Compact Disc-Read Only Memory) 119A is mounted are included. CPU 111 is connected to automatic document feeder 120, document reading unit 130, image forming unit 140, sheet feeding unit 150 and operation panel 160, and short-range wireless communication unit 170, and controls the entire MFP 100.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. The RAM 114 temporarily stores read data (image data) continuously sent from the document reading unit 130.

  Operation panel 160 is provided on the upper surface of MFP 100. FIG. 3 is a plan view showing an example of the operation panel. Referring to FIG. 3, operation panel 160 includes a display unit 161 and an operation unit 163. The display unit 161 is a display device such as a liquid crystal display (LCD) or an organic ELD (Electro-Luminescence Display), and displays an instruction menu for the user, information about acquired image data, and the like. The operation unit 163 includes a plurality of keys and accepts input of various instructions, data such as characters and numbers, by user operations corresponding to the keys. The operation unit 163 further includes a touch panel 165 that detects the position of the display surface of the display unit 161. The touch panel 165 is provided on the upper surface or the lower surface of the display unit 161, and outputs the coordinates of the position instructed by the user to the CPU 111.

  Returning to FIG. 2, the communication I / F unit 112 is an interface for connecting the MFP 100 to the network 3. The CPU 111 communicates with other MFPs 100A and 100B or the wireless station 5 connected to the network 3 via the communication I / F unit 112, and transmits and receives data. The communication I / F unit 112 can communicate with a computer connected to the Internet via the network 3.

  The facsimile unit 117 is connected to a public switched telephone network (PSTN) and transmits / receives facsimile data. The facsimile unit 117 converts image data read by the document reading unit 130 or data stored in the HDD 116 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN. In addition, the facsimile unit 117 stores the received facsimile data in the HDD 116 or causes the image forming unit 140 to form an image of the facsimile data on a sheet.

  The external storage device 119 is loaded with a CD-ROM 119A. The CPU 111 can access the CD-ROM 119A via the external storage device 119. The CPU 111 loads the program recorded on the CD-ROM 119A attached to the external storage device 119 into the RAM 114 and executes it. Note that the program executed by the CPU 111 is not limited to the program recorded on the CD-ROM 119A, and the program stored in the HDD 116 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network may rewrite the program stored in HDD 116 of MFP 100 or may write a new program. Further, MFP 100 may download a program from another computer connected to the network and store the program in HDD 116. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  The short-range wireless communication unit 170 wirelessly communicates with the short-range wireless communication unit 220 (see FIG. 4) of the portable information device 200 when the portable information device 200 exists within a communicable range. The communicable distance of the short-range wireless communication unit 170 is limited to a predetermined distance and is not particularly limited, but is preferably within a few meters. More preferably, the range in which the short-range wireless communication unit 170 can communicate is preferably within 1 m, and more preferably within 0.5 m. When the portable information device 200 exists within a communicable distance range, the short-range wireless communication unit 170 detects the portable information device 200 and enters a communicable state. The short-range wireless communication unit 170 is not limited to a communication medium. For example, the short-range wireless communication unit 170 performs wireless communication using a communication standard such as IrDA (Infrared Data Association) or a communication standard such as Bluetooth (registered trademark).

  FIG. 4 is a block diagram showing an outline of the hardware configuration of the portable information device. Referring to FIG. 4, portable information device 200 includes a CPU 211 for controlling the entire portable information device 200, a camera 212, a flash memory 213 for storing data in a nonvolatile manner, a calling unit 215, and a calling unit. 215, a wireless communication unit 214 connected to 215, a display unit 216 that displays information, an operation unit 217 that receives an input of a user operation, a wireless LAN interface (I / F) 218, and a short-range wireless communication unit 220 ,including.

  The wireless communication unit 214 performs wireless communication with a mobile phone base station connected to a telephone communication network. The wireless communication unit 214 connects the portable information device 200 to the telephone communication network and enables a call using the call unit 215. The radio communication unit 214 decodes a voice signal obtained by demodulating the radio signal received from the mobile phone base station, and outputs the decoded signal to the call unit 215. In addition, the wireless communication unit 214 encodes the voice input from the call unit 215 and transmits it to the mobile phone base station. The call unit 215 includes a microphone and a speaker, outputs the voice input from the wireless communication unit 214 from the speaker, and outputs the voice input from the microphone to the wireless communication unit 214. Further, the wireless communication unit 214 is controlled by the CPU 211, transmits and receives data via the mobile phone base station, and connects the mobile information device 200 to the Internet, for example.

  The camera 212 includes a lens and a photoelectric conversion element such as a CMOS (Complementary Metal Oxide Semiconductor) sensor, and focuses light collected by the lens on a CMOS sensor. The CMOS sensor photoelectrically converts the received light to convert image data. It outputs to CPU201.

  The display unit 216 is a display device such as a liquid crystal display (LCD) or an organic ELD, and displays an instruction menu for a user, data received from the outside, and the like. The operation unit 217 includes a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys.

  The operation unit 217 includes a touch panel 217A. Touch panel 217A detects a position designated by the user on the display surface of display unit 216. The touch panel 217A is provided on the upper surface or the lower surface of the display unit 216, and outputs the coordinates of the position instructed by the user to the CPU 211. The touch panel 217A is a multi-touch screen panel, and outputs a plurality of coordinates respectively corresponding to a plurality of positions designated by the user to the CPU 211 when a plurality of positions are designated by the user at the same time. The touch panel 217A is preferably the same size or larger than the display surface of the display unit 216. Since the touch panel 217A is provided so as to be superimposed on the display unit 216, the touch panel 217A is provided at one or more positions designated by the user on the display surface of the display unit 216 when the user indicates the display surface of the display unit 216. One or more corresponding coordinates are output to the CPU 211. For the touch panel 217A, for example, a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, or a capacitance method can be used, and the method is not limited.

  The wireless LAN I / F 218 is an interface for communicating with the wireless station 5 and connecting the portable information device 200 to the network 3. Portable information device 200 can communicate with MFPs 100, 100 </ b> A, and 100 </ b> B via wireless LAN I / F 218, and can transmit and receive data.

  Short-range wireless communication unit 220 performs wireless communication with short-range wireless communication unit 170 included in MFP 100. Therefore, only when mobile information device 200 is located within the communicable distance range of short-range wireless communication unit 170 included in MFP 100, short-range wireless communication unit 220 includes short-range wireless communication unit 170 included in MFP 100. Wirelessly communicate with.

  FIG. 5 is a diagram illustrating an example of functions of a CPU included in the MFP. The functions shown in FIG. 5 are functions formed in CPU 111 when CPU 111 provided in MFP 100 executes an image processing apparatus cooperation program stored in ROM 113, EEPROM 115, HDD 116, or CD-ROM 119A. Referring to FIG. 5, the CPU 111 includes a first operation receiving unit 51 that receives an operation, a first operation screen determining unit 53 that determines an operation screen, a first display control unit 55 that controls the display unit 161, and a process. The first processing execution unit 57 that executes the operation, the first server unit 59 that functions as a server, the first client unit 61 that functions as a client, the first selection unit 63, and the first switching unit that switches the operation mode of the MFP 100. 65, a position detecting unit 67, a user authenticating unit 69 for authenticating an operating user, and a first operating device determining unit 71.

  The position detection unit 67 detects that the user operating the portable information device 200 exists within a predetermined range determined by the distance from the own device. Specifically, the position detection unit 67 determines whether communication with the portable information device 200 is possible via the short-range wireless communication unit 220. The range in which the short-range wireless communication unit 170 can communicate is determined in advance.

  If the position detection unit 67 can communicate with the portable information device 200 via the short-range wireless communication unit 220, the position detection unit 67 detects that the user of the portable information device 200 exists within a predetermined range determined by the distance from the own device. . The position detection unit 67 indicates that the user operating the portable information device 200 is within a predetermined range determined by the distance from the own device while the portable information device 200 can communicate with the portable information device 200 via the short-range wireless communication unit 220. The detection signal is output to the first selection unit 63.

  Further, when MFP 100 includes a connector that is electrically connected to portable information device 200 in order to charge portable information device 200 separately from or in place of short-range wireless communication unit 170, for example. The position detection unit 67 may determine that the portable information device 200 is within an operable range by detecting that the portable information device 200 is electrically connected to the connector. Good.

  User authentication unit 69 authenticates a user who operates MFP 100 using operation panel 160. Specifically, the user authentication unit 69 displays a login screen on the display unit 161 and accepts authentication information that the operation user inputs to the operation unit 163 according to the login screen. For example, the authentication information is a set of a user ID and a password. If the received authentication information is stored in advance, the user authentication unit 69 authenticates the operating user and permits login. Although the authentication information is a set of a user ID and a password, for example, an IC card or biometric information can be used as long as it is information that can specify the operating user. In this case, MFP 100 needs to include an IC card reader when using an IC card as authentication information, and a detection device that detects the biological information of the operating user when biometric information is used.

  In addition, after authenticating the operation user and permitting login, the user authentication unit 69 receives an operation for instructing logout by the authenticated operation user, or the operation is finally input to the operation unit 165. The login is canceled when a predetermined time elapses.

  When the first selection unit 63 can communicate with the portable information device 200 via either the communication I / F 112 or the short-range wireless communication unit 170, the first selection unit 63 is either the own device or the portable information device 200. One is determined as the operating device. The first selection unit 63 determines that the own device is the operating device on condition that the presence detection signal is input from the position detection unit 67. In addition, the first selection unit 63 determines the own device as the operating device on the condition that the operation mode is not switched to the power saving mode in which the power consumption is smaller than that in the normal mode by the first switching unit 65 described later. Further, the first selection unit 63 determines the own device as the operation device on the condition that the user authentication unit 69 does not authenticate a user different from the user who operates the portable information device 200. In addition, when the user authentication unit 69 authenticates the user who operates the portable information device 200 in a state where the portable information device 200 is determined as the operating device, the first selecting unit 63 sets the own device as the operating device. decide. Further, when the portable information device 200 determines that the portable information device is the operating device, the first selection unit 63 determines the portable information device 200 as the operating device.

  More specifically, the first selection unit 63 receives a cooperation request signal from the portable information device 200 when the communication I / F 112 or the short-range wireless communication unit 170 can communicate with the portable information device 200. . The cooperation request signal includes a first cooperation request signal that requests that portable information device 200 be an operating device, and a second cooperation request signal that requests that MFP 100 be an operating device. When the first selection unit 63 receives the first cooperation request signal, the first selection unit 63 determines the portable information device 200 as an operating device, and returns a permission signal to the portable information device 200 that has transmitted the first cooperation request signal.

  Further, when receiving the second cooperation request signal, the first selection unit 63 determines that the portable information device 200 is the operating device if the presence detection signal is not input from the position detection unit 67, and the second cooperation request signal An operating device change signal is returned to portable information device 200 that has transmitted the signal.

  Further, when receiving the second cooperation request signal, the first selection unit 63 is switched to the power saving mode by the first switching unit even when the presence detection signal is input from the position detection unit 67. If so, the mobile information device 200 is determined as the operating device, and the operating device change signal is returned to the mobile information device 200 that has transmitted the second cooperation request signal.

  Furthermore, when the first selection unit 63 receives the second cooperation request signal, the first detection unit 63 receives the presence detection signal from the position detection unit 67 and is switched to the power saving mode by the first switching unit. If a user different from the user who operates the portable information device 200 is authenticated by the user authentication unit 69, the portable information device 200 determines the portable information device 200 as the operating device and transmits the second cooperation request signal. An operating device change signal is returned to 200.

  When receiving the second cooperation request signal, the first selection unit 63 receives the presence detection signal from the position detection unit 67 and is switched to the power saving mode by the first switching unit. If the user who is different from the user who operates the portable information device 200 is not authenticated by 69, the own device is determined as the operation device, and the permission signal is returned to the portable information device 200 that has transmitted the second cooperation request signal. .

  In addition, when the user authentication unit 69 authenticates the user who operates the portable information device 200 in a state where the portable information device 200 is determined as the operating device, the first selecting unit 63 sets the own device as the operating device. The controller device change signal is transmitted to the portable information device 200 that has determined and transmitted the second cooperation request signal.

  The first selection unit 63 includes a first state in which the first server unit 59 communicates with the portable information device 200 that functions as a client, and a second state in which the first client unit 61 communicates with the portable information device that functions as a server. One of the states and the state is selected. Specifically, the first selection unit 63 selects the first state while the portable information device 200 is determined as the operating device, and the second state while the mobile information device 200 is determined as the operating device. Select.

  The first selection unit 63 outputs the first state signal to the first server unit 59 while selecting the first state, and outputs the device identification information of the portable information device 200 functioning as a client to the first server unit 59. To do. The first server unit 59 is activated in response to the input of the first status signal, and communicates with the portable information device 200 via either the communication I / F unit 112 or the short-range wireless communication unit 170. Note that the first server unit 59 may reside in the CPU 111. In this case, the first server unit 59 communicates with the portable information device 200 via either the communication I / F unit 112 or the short-range wireless communication unit 170 in response to the input of the first state signal.

  Further, the first selection unit 63 outputs a second state signal to the first client unit 61 while selecting the second state, and the device identification information of the portable information device 200 functioning as a server is output to the first client unit 61. Output to. The first client unit 61 is activated in response to the input of the second state signal, and communicates with the portable information device 200 via either the communication I / F unit 112 or the short-range wireless communication unit 170.

  First operation screen determination unit 53 is an operation screen for operating MFP 100, and determines a first own device operation screen to be displayed on display unit 161. The first operation screen determination unit 53 determines the first own device operation screen according to an operation by a user received by a first operation reception unit 51 described later or according to an operation received by a first server unit 59 described later from a client. To do. When the second state signal is input from the first selection unit 63, the first operation screen determination unit 53 outputs the first own device operation screen to the first display control unit 55, and the first selection unit 63 outputs the first operation screen. When the 1 state signal is input, the first device operation screen is output to the first server unit 59.

  The first server unit 59 communicates with the portable information device 200 functioning as a client via either the communication I / F unit 112 or the short-range wireless communication unit 170, and is operated as a server remotely operated by the portable information device 200. Function. Specifically, the first server unit 59 transmits the first device operation screen input from the first operation screen determination unit 53 to the portable information device 200 as a first remote operation screen. For this reason, the first device operation screen is displayed on the portable information device 200. In addition, when the first server unit 59 receives position information indicating a position in the first device operation screen (first remote operation screen) from the portable information device 200, the first server unit 59 is based on the received position information. An instruction from a user who operates 200 is received.

  The operation accepted by first server unit 59 is the same as the operation accepted by operation unit 163 when the user operates MFP 100 using operation unit 163. More specifically, the operation accepted by the first server unit 59 is determined by the first device operation screen. When the first device operation screen is a screen for setting a setting value, an operation for setting the setting value is accepted, and the first device operation screen has a button to which an instruction to execute processing is assigned When the position of the button is received, an operation for instructing execution of the process is accepted. The first server unit 59 outputs a command for executing the process to the first process executing unit 57 when the received operation is an operation instructing execution of the process.

  The first client unit 61 communicates with the portable information device 200 functioning as a server via either the communication I / F unit 112 or the short-range wireless communication unit 170, and functions as a client for remotely operating the portable information device 200 To do. Specifically, the first client unit 61 receives a second remote operation screen for allowing the user to remotely operate the portable information device 200 from the portable information device 200, and displays the received second remote operation screen as the first remote operation screen. The data is output to the display control unit 55. The first display control unit 55 controls the display unit 161 to display an image on the display unit 161. The first display control unit 55 causes the display unit 161 to display the second remote operation screen input from the first client unit 61. Therefore, a user who operates MFP 100 can remotely operate portable information device 200 by looking at the second remote operation screen displayed on display unit 161.

  The first client unit 61 receives position information indicating a position in the second remote operation screen from a first remote operation receiving unit 87 described later. Although details of the first remote operation reception unit 87 will be described later, if the user touches the second remote operation screen with a finger, the first remote operation reception unit 87 is based on the position information input from the touch panel 165. The position information indicating the position in the second remote operation screen is output to the first client unit 61. The first client unit 61 transmits the position information input from the first remote operation accepting unit 87 to the portable information device 200 via the communication I / F unit 112.

  The first display control unit 55 causes the display unit 161 to display the first device operation screen input from the first operation screen determination unit 53. In addition, when the second state signal is input from the first selection unit 63, the first display control unit 55 receives the second remote operation screen from the first client unit 61, the first device operation screen, and the second A screen arranged side by side with the remote operation screen is displayed on the display unit 161. Therefore, when the second status signal is input from the first selection unit 63, in other words, when the MFP 100 functions as a client of the portable information device 200, the first device operation screen and the second remote control are displayed on the display unit 161. Since the operation screen is displayed at the same time, the user of the MFP 100 can operate the MFP 100 while looking at the display unit 161 and can remotely operate the portable information device 200.

  The first display control unit 55 outputs display information to the first operation receiving unit 51. When the display unit 161 displays only the first device operation screen, the display information includes operation screen identification information for identifying the first device operation screen and a display unit for the first device operation screen. 161 position information indicating the position on the display surface 161. The display information includes operation screen identification information for identifying the first device operation screen and the first information when the first device operation screen and the second remote operation screen are displayed on the display unit 161. In addition to the position information indicating the position on the display surface of the display unit 161 of the own device operation screen, the position information indicating the position on the display surface of the display unit 161 of the second remote operation screen is included.

  First switching unit 65 switches the operation mode of MFP 100. The operation mode includes a normal mode and a power saving mode that consumes less power than the normal mode. The power saving mode includes a state where the display unit 161 does not display an image, and includes a case where power is not supplied to the display unit 161. The first switching unit 65 switches to the power saving mode when no operation is input to the operation unit 163 for a predetermined time. Further, in response to an operation input to the operation unit 163, the mode is switched to the normal mode.

  The first operation receiving unit 51 receives display information from the first display control unit 55 and receives an operation input by the user. The operation input by the user includes an own device operation that is an operation on the own device, and a remote operation that is an operation on the portable information device 200. The first operation accepting unit 51 is either a first detection unit 81 that detects a position designated by the user on the display surface of the display unit 161, or an operation of the device itself or a remote operation based on the detected position. A first determination unit 83 that determines whether or not, a first own-device operation reception unit 85 that receives an own-device operation based on the determination result, a first remote-operation reception unit 87 that receives a remote operation based on the determination result, 1 temporary storage unit 89.

  The first detection unit 81 is connected to the touch panel 165, and the coordinate value of the position designated by the user on the display surface of the display unit 161 is input from the touch panel 165. The first detection unit 81 outputs the coordinate value input from the touch panel 165 to the first determination unit 83.

  Based on the display information input from the first display control unit 55, the first determination unit 83 determines that the position indicated by the coordinate value input from the first detection unit 81 is the first device operation screen and the second remote operation. Determine which screen belongs. When determining that the position indicated by the coordinate value input from the first detection unit 81 belongs to the first device operation screen, the first determination unit 83 determines that the device is operated. The first determination unit 83 determines that the remote operation is performed when it is determined that the position indicated by the coordinate value input from the first detection unit 81 belongs to the second remote operation screen.

  When determining that the own device is operated, the first determining unit 83 converts the coordinate value input from the first detecting unit 81 into a coordinate value indicating a position in the first own device operation screen, and converts the converted coordinate value. The included position information is output to the first device operation accepting unit 85. When determining that the remote operation is performed, the first determination unit 83 converts the coordinate value input from the first detection unit 81 into a coordinate value indicating a position in the second remote operation screen, and includes the converted coordinate value The positional information including the information is output to the first remote operation receiving unit 87.

  First device operation accepting unit 85 includes a first setting accepting unit 91 and a first copy instruction accepting unit 95. The first setting reception unit 91 is set by the user based on the first device operation screen specified by the display information input from the first display control unit 55 and the position information input from the first determination unit 83. Accept the operation. The operation by the user is determined by the first device operation screen specified by the display information input from the first display control unit 55. When the first device operation screen is a screen for setting a setting value, an operation for setting the setting value is accepted, and the first device operation screen has a button to which an instruction to execute processing is assigned When position information indicating the position of the button is input, an operation for instructing execution of the process is accepted. When the received operation is an operation for instructing execution of a process, the first setting reception unit 91 outputs a process execution instruction to the first process execution unit 57.

  The first copy instruction accepting unit 95 accepts an operation for designating a character string included in the first device operation screen, and outputs the designated character string to the first temporary storage unit 89. The first temporary storage unit 89 temporarily stores the character string input from the first copy instruction receiving unit 95 in the buffer. The first copy instruction accepting unit 95 accepts a copy instruction when the user inputs a copy instruction for copying a character string, and is included in the first device operation screen based on the position information input from the first determination unit 83. Specify the character string to be read. The first copy instruction accepting unit 95 accepts a copy instruction when the same position information is input from the first determining unit 83 for a predetermined time T1 or more. Further, when the same position information is input from the first determination unit 83 for a predetermined time or less, a copy instruction may be received. Further, a copy instruction may be received when a predetermined key provided in the operation unit 163 is instructed.

  The first remote operation reception unit 87 outputs the position information input from the first determination unit 83 to the first client unit 61. The first remote operation receiving unit 87 includes a first output unit 97 and a first pasting position receiving unit 99.

  When the first temporary storage unit 89 stores a character string in the buffer, the first pasting position accepting unit 99 accepts the position specified by the position information input from the first determining unit 83 as the pasting position. The first pasting position receiving unit 99 outputs position information including the coordinate value of the pasting position to the first output unit 97.

  The first output unit 97 reads out the character string stored in the first temporary storage unit 89 from the buffer in response to the input of the position information including the coordinate value of the pasting position from the first pasting position receiving unit 99. A set of position information and a character string including the coordinate value of the pasting position is output to the first client unit 61. When a set of position information and a character string is input, the first client unit 61 treats the character string as input at the pasting position specified by the position information on the second remote operation screen. Specifically, the character string and the position information are transmitted to portable information device 200 that functions as a server. Thereby, the character string included in the first device operation screen displayed on the display unit 161 can be input to the pasting position on the second remote operation screen displayed on the display unit 161.

  FIG. 6 is a diagram illustrating an example of functions of a CPU included in the portable information device. The functions shown in FIG. 6 are functions formed in the CPU 211 when the CPU 211 included in the portable information device 200 executes the portable information device cooperation program stored in the flash memory 213. Referring to FIG. 6, the CPU 211 has a second operation reception unit 251 that receives an operation, a second operation screen determination unit 253 that determines an operation screen, a second display control unit 255 that controls the display unit 216, and processing. The second processing execution unit 257 for executing the operation, the second server unit 259 functioning as a server, the second client unit 261 functioning as a client, the second selection unit 263, and the second switching the operation mode of the display unit 216. Switching unit 265.

  When the second selection unit 263 can communicate with the MFP 100 via either the wireless LAN I / F 218 or the short-range wireless communication unit 220, the second selection unit 263 uses either the MFP 100 or the MFP 100 as an operation device. decide. When the data to be processed is selectable by the user, the second selection unit 263 determines the own device as the operation device. The data to be processed includes data stored in the flash memory 213 or data stored in a computer connected via the Internet. The state in which the data stored in the flash memory 213 can be selected includes a state in which a list of file names of data stored in the flash memory 213 is displayed. The state in which data stored in a computer connected via the Internet can be selected includes a state in which a screen on which data stored in a computer connected via the Internet can be downloaded is displayed.

  In addition, second MFP 263 determines MFP 100 as the operating device when MFP 100 is determined as the operating device by MFP 100, and selects itself as the operating device when portable information device 200 is determined as the operating device by MFP 100. decide.

  More specifically, the second selection unit 263 is an operation that is input by the user of the portable information device 200 in a state in which communication with the MFP 100 can be performed by either the wireless LAN I / F 218 or the short-range wireless communication unit 220. When an operation for instructing cooperation with the MFP 100 is accepted, if the data to be processed is selectable by the user at that time, a first cooperation request signal is transmitted to the MFP 100. The MFP 100 that receives the first cooperation request signal returns a permission signal. When receiving the permission signal, the MFP 100 determines its own device as the operation device.

  Further, the second selection unit 263 transmits a second cooperation request signal to the MFP 100 if the data to be processed is not in a state that can be selected by the user at the time when an operation instructing the cooperation with the MFP 100 is received. As described above, MFP 100 that receives the second cooperation request signal returns either the permission signal or the operation device change signal, and therefore, when receiving the permission signal, MFP 100 is determined as the operation device, and the operation device. When the change signal is received, the own device is determined as the operation device.

  Second selection unit 263 has either a first state in which second server unit 259 communicates with MFP 100 that functions as a client or a second state in which second client unit 261 communicates with MFP 100 that functions as a server. Select one of these states. Specifically, second selection unit 263 selects the first state while MFP 100 is determined as the operation device, and selects the second state while the own device is determined as the operation device. .

  While selecting the first state, second selection unit 263 outputs a first state signal to second switching unit 265 and second server unit 259, and device identification information of MFP 100 functioning as a client is stored in second server. Output to the unit 259. Second server unit 259 is activated in response to the input of the first status signal, and communicates with MFP 100 via either wireless LAN I / F 218 or short-range wireless communication unit 220. Note that the second server unit 259 may reside in the CPU 211. In this case, second server unit 259 communicates with MFP 100 via either wireless LAN I / F 218 or short-range wireless communication unit 220 in response to the input of the first status signal.

  While selecting the second state, second selection unit 263 outputs a second state signal to second switching unit 265, second client unit 261, and second display control unit 255, and apparatus of MFP 100 functioning as a server. The identification information is output to the second client unit 261. The second client unit 261 is activated in response to the input of the second state signal, and communicates with the MFP 100 via either the wireless LAN I / F 218 or the short-range wireless communication unit 220.

  The second operation screen determination unit 253 is an operation screen for operating the portable information device 200 and determines a second own device operation screen to be displayed on the display unit 216. The second operation screen determination unit 253 determines the second own device operation screen according to an operation by a user received by a second operation reception unit 251 described later or according to an operation received by a second server unit 259 described later from a client. To do. When the second state signal is input from the second selection unit 263, the second operation screen determination unit 253 outputs the second device operation screen to the second display control unit 255, and the second selection unit 263 outputs the second operation screen. When the 1 state signal is input, the second device operation screen is output to the second server unit 259.

  Second server unit 259 communicates with MFP 100 functioning as a client via either wireless LAN I / F 218 or short-range wireless communication unit 220, and functions as a server remotely operated by MFP 100. Specifically, second server unit 259 transmits to MFP 100 the second device operation screen input from second substitute screen transmission unit 267 as the second remote operation screen. In addition, when the second server unit 259 receives position information indicating the position on the second device operation screen (second remote operation screen) from the MFP 100, the second server unit 259 is operated by the user operating the MFP 100 based on the received position information. Accept instructions. The operation accepted by the second server unit 259 is the same as the operation accepted by the operation unit 217 when the user operates the portable information device 200 using the operation unit 217.

  Second client unit 261 communicates with MFP 100 functioning as a server via either wireless LAN I / F 218 or short-range wireless communication unit 220 and functions as a client for remotely operating MFP 100. Specifically, second client unit 261 receives a first remote operation screen for allowing user to remotely operate MFP 100 from MFP 100, and outputs the received first remote operation screen to second display control unit 255. To do. The second display control unit 255 controls the display unit 216 to display an image on the display unit 216. The second display control unit 255 causes the display unit 216 to display the first remote operation screen input from the second client unit 261. Therefore, a user who operates portable information device 200 can remotely operate MFP 100 by looking at the first remote operation screen displayed on display unit 216.

  The second client unit 261 receives position information indicating a position in the first remote operation screen from a second remote operation reception unit 287 described later. The details of the second remote operation accepting unit 287 will be described later. If the user touches the second remote operation screen with a finger, the second remote operation accepting unit 287 is based on the position information input from the touch panel 217A. The position information indicating the position in the first remote operation screen is output to the second client unit 261. Second client unit 261 transmits the position information input from second remote operation accepting unit 287 to MFP 100 via wireless LAN I / F 218.

  The second display control unit 255 causes the display unit 216 to display the second device operation screen input from the second operation screen determination unit 253. In addition, when the second state signal is input from the second selection unit 263, the second display control unit 255 receives the first remote operation screen from the second client unit 261, the second device operation screen, and the first display unit 255. A screen arranged side by side with the remote operation screen is displayed on the display unit 216. For this reason, when the second state signal is input from the second selection unit 263, in other words, when the portable information device 200 functions as a client, the second self-device operation screen and the first remote operation screen are displayed on the display unit 216. Are displayed at the same time, the user of the portable information device 200 can operate the portable information device 200 while looking at the display unit 216 and can also remotely operate the MFP 100.

  The second display control unit 255 outputs the display information to the second operation receiving unit 251. When only the second device operation screen is displayed on the display unit 216, the display information includes operation screen identification information for identifying the second device operation screen and a display unit for the second device operation screen. And position information indicating the position on the display surface 216. The display information includes, when the second device operation screen and the first remote operation screen are displayed on the display unit 216, operation screen identification information for identifying the second device operation screen, In addition to the position information indicating the position on the display surface of the display unit 161 of the own device operation screen, the position information indicating the position on the display surface of the display unit 216 of the first remote operation screen is included.

  The second switching unit 265 switches the display mode of the display unit 216 based on the first state signal input from the second selection unit 263. The display modes of the display unit 216 include a normal display mode and a power saving display mode that consumes less power than the normal display mode. The power saving display mode includes a state where the display unit 216 does not display an image, and includes a case where power is not supplied to the display unit 216. The second switching unit 265 switches the display mode of the display unit 216 from the normal display mode to the power saving display mode in response to the input of the first state signal from the second selection unit 263. For this reason, when the portable information device 200 functions as a server, the display mode of the display unit 216 is switched to the power saving display mode, so that power consumed while the portable information device 200 functions as a server is reduced. Can do.

  The second operation receiving unit 251 receives display information from the second display control unit 255 and receives an operation input by the user. The second operation reception unit 251 is either a second detection unit 281 that detects a position instructed by the user on the display surface of the display unit 216, or an operation of the device itself or a remote operation based on the detected position. A second determination unit 283 that determines whether or not, a second remote operation reception unit 287 that receives a remote operation based on the determination result, a second own device operation reception unit 285 that receives an own device operation based on the determination result, and a second 2 temporary storage unit 289.

  The second detection unit 281 is connected to the touch panel 217A and receives coordinate values of one or more positions designated by the user on the display surface of the display unit 216 from the touch panel 217A. The second detection unit 281 outputs one or more coordinate values input from the touch panel 217A to the second determination unit 283.

  Based on the display information input from the second display control unit 255, the second determination unit 283 determines that the position indicated by the coordinate value input from the second detection unit 281 is the second device operation screen and the first remote operation. Determine which screen belongs. When two or more coordinate values are input from the second detection unit 281, the second determination unit 283 displays the position indicated by the two or more coordinate values on either the second device operation screen or the first remote operation screen. Decide if it belongs. The second determination unit 283 determines that the own device is operated when it is determined that the position indicated by each of the one or more coordinate values input from the second detection unit 281 belongs to the second device operation screen. The second determination unit 283 determines that the remote operation is performed when it is determined that the position indicated by each of the one or more coordinate values input from the second detection unit 281 belongs to the first remote operation screen.

  When determining that the own device is operated, the second determination unit 283 converts one or more coordinate values input from the second detection unit 281 into one or more coordinate values indicating positions on the second own device operation screen. The position information including one or more coordinate values after conversion is output to the second device operation accepting unit 285. When determining that the remote operation is performed, the second determination unit 283 converts one or more coordinate values input from the second detection unit 281 into one or more coordinate values indicating a position in the first remote operation screen, respectively, The positional information including the later one or more coordinate values is output to the second remote operation receiving unit 287.

  Second device operation accepting unit 285 includes a second setting accepting unit 291 and a second copy instruction accepting unit 295. Based on the second device operation screen specified by the display information input from the second display control unit 255 and the position information input from the second determination unit 283, the second setting reception unit 291 is performed by the user. Accept the operation. The operation by the user is determined by the second device operation screen specified by the display information input from the second display control unit 255.

  The second copy instruction accepting unit 295 accepts an operation for designating a character string included in the second device operation screen, and outputs the designated character string to the second temporary storage unit 289. Second temporary storage unit 289 temporarily stores the character string input from second copy instruction receiving unit 295 in a buffer. The second copy instruction reception unit 295 receives a copy instruction when the same position information is input from the second determination unit 283 for a predetermined time T2 or more. In addition, a copy instruction may be received when the time during which the same position information is input from the second determination unit 283 is a predetermined time or less. Further, a copy instruction may be received when a predetermined key provided in the operation unit 217 is instructed.

  The second remote operation reception unit 287 outputs the position information input from the second determination unit 283 to the second client unit 261. Second remote operation receiving unit 287 includes a second output unit 297 and a second pasting position receiving unit 299.

  When the character string is stored in the buffer by the second temporary storage unit 289, the second pasting position receiving unit 299 receives the position specified by the position information input from the second determination unit 283 as the pasting position. The second pasting position receiving unit 299 outputs position information including the coordinate value of the pasting position to the second output unit 297.

  The second output unit 297 reads the character string stored in the second temporary storage unit 289 from the buffer in response to the input of the position information including the coordinate value of the pasting position from the second pasting position receiving unit 299, A set of position information including a coordinate value of the pasting position and a character string is output to the second client unit 261. When a set of position information and a character string is input, the second client unit 261 treats the character string as input at the pasting position specified by the position information on the first remote operation screen. Specifically, the character string and the position information are transmitted to MFP 100 functioning as a server. Thereby, the character string included in the second device operation screen displayed on the display unit 216 can be input to the pasting position on the first remote operation screen displayed on the display unit 216.

  FIG. 7 is a diagram illustrating an example of a screen displayed on the MFP functioning as a client. Referring to FIG. 7, first display device operation screen 305 for operating MFP 100 is arranged in the left region on display surface 301 of display unit 161 provided in MFP 100, and portable information device 200 is remotely connected to the right region. A second remote operation screen 303 for operation is arranged, and the first device operation screen 305 and the second remote operation screen 303 are displayed side by side.

  FIG. 8 is a diagram illustrating an example of a screen displayed on the portable information device functioning as a client. Referring to FIG. 8, on display surface 311 of display unit 216 included in portable information device 200, second device operation screen 313 is arranged in the upper region, and first remote operation screen 315 is arranged in the lower region. Then, the second device operation screen 313 and the first remote operation screen 315 are displayed side by side.

  FIG. 9 is a diagram illustrating an example of a copy and paste operation. FIG. 9 shows a copy and paste operation when the portable information device 200 is a client. Referring to FIG. 9, on display surface 321 of display unit 216 included in portable information device 200, second device operation screen 323 is arranged in the upper region, and first remote operation screen 325 is arranged in the lower region. Is done.

  The second device operation screen 323 is a screen that displays the address data of the user with the name “Ishikawa XXX” registered in the address book. Here, the name, company name, address, e-mail address, telephone number, and facsimile number of the user with the name “Ishikawa XXX” are displayed.

  The first remote operation screen 325 is a registration screen for registering in the address book. First remote operation screen 325 includes an area for inputting a name, company name, e-mail address, and facsimile number as address data.

  If the character string of the name displayed on the second own device operation screen 323 is copied and the area for inputting the name included in the first remote operation screen 325 is indicated, the copied character string of the name is the first remote operation. This is entered in the area for entering the name included in the screen 325. Similarly, for the company name, e-mail address, and facsimile number, if the character string displayed on the second device operation screen 323 is copied and the corresponding area included in the first remote operation screen 325 is indicated, The copied character string is input to the input area included in the first remote operation screen 325.

  FIG. 10 is a flowchart illustrating an example of the flow of image processing apparatus cooperation processing. The image processing apparatus cooperation process is a process executed by the CPU 111 when the CPU 111 included in the MFP 100 executes an image processing apparatus cooperation program stored in the ROM 113, the EEPROM 115, the HDD 166, or the CD-ROM 119A. Referring to FIG. 10, CPU 111 determines whether communication has been established with portable information device 200 (step S01). Communication is established with portable information device 200 via communication I / F 112 or short-range wireless communication unit 170.

  For example, when a search signal is periodically transmitted by broadcast via the communication I / F 112 or the short-range wireless communication unit 170, and the portable information device 200 responds to the search signal, the portable information device 200 is in communication with the portable information device 200. Establish communication. Note that network addresses of a plurality of portable information devices that can be linked may be stored in advance, and a search signal may be transmitted to each of the plurality of portable information devices. The process waits until communication is established with portable information device 200 (NO in step S01). If communication is established (YES in step S01), the process proceeds to step S02. In other words, the image device cooperation processing is processing executed on the condition that communication is established with the portable information device 200.

  In step S02, a first controller determination process is executed. Although details of the first controller determination process will be described later, this is a process of determining one of the portable information device 200 and its own apparatus with which communication has been established in step S01 as the controller operated by the operating user.

  In step S03, it is determined whether the own device is an operating device. The determination is made based on the operating device determined by the first operating device determination process executed in step S02. If the own device is determined to be the operating device, the process proceeds to step S04. If portable information device 200 is determined to be the operating device, the process proceeds to step S11. In step S04, the client task is activated. Specifically, the client program stored in ROM 113, EEPROM 115, HDD 166, or CD-ROM 119A is executed. At this time, the network address of the portable information device 200 serving as a server, for example, an IP (Internet Protocol) address is passed to the client task as an argument. At this stage, the client task receives the second remote operation screen from the portable information device 200.

  In the next step S05, the display areas of the first device operation screen and the second remote operation screen are determined. A display area on the display surface of the display unit 161 is determined. The first device operation screen is an operation screen for operating MFP 100. The second remote operation screen is an operation screen that the client task receives from the portable information device 200 and is an operation screen for remotely operating the portable information device 200. In step S06, the display area determined for the first own apparatus operation screen in step S05 is set as an area for displaying the first own apparatus operation screen. In step S07, the display area determined for the second remote operation screen in step S05 is set as an area for displaying the second remote operation screen output by the client task activated in step S04.

  In the next step S08, the first operation reception process is executed, and the process proceeds to step S09. Details of the first operation reception process will be described later. In step S09, it is determined whether a cooperation end instruction has been accepted. If the user points to a key provided in the operation unit 163 and to which a cooperation end instruction is assigned, the cooperation end instruction is accepted. When communication I / F unit 112 or short-range wireless communication unit 170 receives a cooperation end signal from portable information device 200, it receives a cooperation end instruction. If a cooperation end instruction is accepted, the process proceeds to step S10; otherwise, the process returns to step S08. In step S10, the display area of the first device operation screen is set to the entire area of the display surface of display unit 161, and the process ends.

  On the other hand, in step S11, a server task is activated. Specifically, a server program stored in the ROM 113, the EEPROM 115, the HDD 166, or the CD-ROM 119A is executed. At this stage, the server task communicates with the portable information device 200 as a client, transmits the first own device operation screen as the first remote operation screen to the portable information device 200, and follows the operation received from the portable information device 200. Execute the process.

  In the next step S12, it is determined whether or not there is an operating user. It is determined whether there is a user who operates the operation unit 163. If there is a user who logs in to MFP 100 by operating operation unit 163, it is determined that there is an operating user. If there is no operating user, the process proceeds to step S13. If there is an operating user, step S13 is skipped and the process proceeds to step S14. In step S13, the operation mode is switched from the normal mode to the power saving mode. When the operation mode has already been switched to the power saving mode, the power saving mode is maintained. When the MFP 100 is in the power saving mode, the driving of the display unit 161 may be stopped. Further, the power supplied to the display unit 161 may be cut off. Thereby, the power consumed by MFP 100 can be reduced, and the power consumption can be reduced. When there is an operating user, step S13 is not executed, so the first device operation screen is displayed on the entire screen of the display unit 161 on the display unit 161, and the operation user operates according to the first device operation screen. Is possible.

  In step S14, it is determined whether an operation has been accepted. It is determined whether or not the operation unit 163 of the operation panel 160 has been operated. If an operation is accepted by operation unit 163, the process proceeds to step S15. If not, the process proceeds to step S19.

  In step S15, the display unit 161 is driven. If the display unit 161 is already driven, the state is maintained. In the next step S16, it is determined whether or not the remote operation user has logged in. The remote operation user is an operation user who operates portable information device 200 that has established communication in step S01. User identification information for identifying the operating user is acquired from the portable information device 200, and user identification information of the user who is authenticated based on the authentication information input to the operation unit 163 is acquired from the portable information device 200. If it is the same as the user identification information, it is determined that the remote operation user has logged in. If the remote operation user has logged in, the process proceeds to step S17; otherwise, the process proceeds to step S19.

  In step S17, the controller device is changed to its own device. Before the step S17 is executed, the operating device is determined to be the portable information device 200, and the remote operation user who operates the portable information device 200 remotely operates the MFP 100 using the portable information device 200. . When the remote operation user logs in from the operation panel 160 of the MFP 100, the subsequent operation can be input to the operation panel 160 of the MFP 100 by changing the operation device to the own device. In the next step S18, an operating device change signal is transmitted to portable information device 200, and the process proceeds to step S04.

  In step S19, it is determined whether a cooperation end instruction has been received. When communication I / F unit 112 receives a cooperation end signal from portable information device 200, it receives a cooperation end instruction. If the cooperation end instruction is accepted, the process ends. If not, the process returns to step S14.

  FIG. 11 is a flowchart illustrating an example of the flow of the first controller determination process. The first controller determination process is a process executed in step S02 of the image forming apparatus cooperation process shown in FIG. Referring to FIG. 11, CPU 111 determines whether a first cooperation request signal has been received from portable information device 200 (step S <b> 21). The first cooperation request signal is a signal transmitted by the portable information device 200 and a signal for requesting that the portable information device 200 be an operating device. If the first cooperation request signal is received, the process proceeds to step S22; otherwise, the process proceeds to step S24. In step S24, it is determined whether a second cooperation request signal has been received from portable information device 200. The second cooperation request signal is a signal transmitted from portable information device 200 and a signal for requesting that MFP 100 be an operation device. If the second cooperation request signal is received, the process proceeds to step S25. If not, the process returns to step S21. In other words, when the first cooperation request signal is received from the portable information device 200, the process after step S22 is executed, and when the second cooperation request signal is received, the process after step S25 is executed.

  In step S22, portable information device 200 is determined as the operating device, and the process proceeds to step S23. In step S23, a permission signal is returned to portable information device 200 that has transmitted the first cooperation request signal, and the process returns to the image forming apparatus cooperation process.

  On the other hand, in step S25, the position of the portable information device 200 is detected. Specifically, it is determined whether or not communication with portable information device 200 is possible via short-range wireless communication unit 220. If communication with the portable information device 200 is possible via the short-range wireless communication unit 220, it is detected that the portable information device 200 is within a predetermined range determined by the distance from the own device.

  In the next step S26, it is determined whether or not the user operating the portable information device 200 exists within a range that can be operated (step S26). If the user of the portable information device 200 is within the operable range, the process proceeds to step S27. If not, the process proceeds to step S29. If it is detected that portable information device 200 is within a predetermined range, it is determined that portable information device 200 is within an operable range, but communication can be performed via short-range wireless communication unit 170. If it is not detected that the portable information device 200 is within the predetermined range, it is determined that the portable information device 200 is not within the operable range. The range in which the short-range wireless communication unit 170 can communicate is determined in advance. Here, the range is preferably within 2 m, more preferably within 1 m, and even more preferably within 0.5 m. . Further, when MFP 100 includes a connector that is electrically connected to portable information device 200 in order to charge portable information device 200 separately from or in place of short-range wireless communication unit 170, connector It may be determined that the user of the portable information device 200 can be operated by detecting that the portable information device 200 is electrically connected.

  In step S27, it is determined whether or not the operation mode is switched to the power saving mode. If the operation mode is switched to the power saving mode, the process proceeds to step S29; otherwise, the process proceeds to step S28. In step S28, it is determined whether another user is operating the operation panel 160 or not. If another user is operating operation panel 160, the process proceeds to step S29. If not, the process proceeds to step S31. The other user is a user different from the remote operation user, in other words, a user different from the operation user who operates the portable information device 200. While another user is logged in and the operation is being accepted by the operation unit 165, it is determined that the other user is operating. After another user logs out, it is determined that the other user is not operating. Even when another user does not input an operation to log out, it is determined that another user has logged out when a predetermined time has elapsed since the last operation was input to the operation unit 165 during login.

  In step S29, portable information device 200 is determined as the operating device, and the process proceeds to step S30. In step S30, an operation device change signal is transmitted to portable information device 200 that has transmitted the second cooperation request signal, and the process returns to the image forming apparatus cooperation process.

  On the other hand, in step S31, MFP 100 is determined as the operating device, and the process proceeds to step S32. In step S32, a permission signal is transmitted to portable information device 200 that has transmitted the second cooperation request signal, and the process returns to the image forming apparatus cooperation process.

  FIG. 12 is a flowchart illustrating an example of the flow of the first operation reception process. The first operation reception process is a process executed in step S08 of the image processing apparatus cooperation process shown in FIG. Referring to FIG. 12, CPU 111 determines whether an instruction position has been detected (step S41). When position information is input from the touch panel 165, a position specified by a coordinate value included in the position information is detected as an indicated position. If the designated position is detected, the process proceeds to step S42; otherwise, the process returns to the image processing apparatus cooperation process.

  In step S42, it is determined whether or not the designated position is the display area of the first device operation screen. The display area of the first device operation screen is set in step S11 in FIG. If the designated position is within the display area of the first device operation screen, the process proceeds to step S43; otherwise, the process proceeds to step S46.

  In step S43, it is determined whether or not the instruction time for detecting the instruction position is equal to or greater than a threshold value T1. If the instruction time is equal to or greater than the threshold value T1, it is determined that the operation is to instruct copying, and the process proceeds to step S44. Otherwise, the process proceeds to step S45. In step S44, the character string arranged around the designated position in the first device operation screen is temporarily stored in the buffer, and the process returns to the image processing apparatus cooperation process. In addition, a temporal change in the designated position may be detected, and a character string included in an area specified by the designated position that changes may be specified as a character string that is temporarily stored. In step S45, an operation corresponding to the designated position is accepted, and the process returns to the image processing apparatus cooperation process.

  On the other hand, in step S46, it is determined whether or not the designated position is the display area of the second remote operation screen. The display area of the second remote operation screen is an area in the display surface of the display unit 161 set in step S12 of FIG. If the designated position is within the display area of the second remote operation screen, the process proceeds to step S47; otherwise, the process proceeds to step S51.

  In step S47, step S44 is executed to determine whether a character string is stored in the buffer. If the character string is stored, it is determined that the operation is an instruction for pasting, and the process proceeds to step S48; otherwise, the process proceeds to step S50. In step S48, the character string is read from the buffer, and the designated position and the character string are output to the client task. In the client task, it is determined that a character string is input at the indicated position, and an operation in which the character string is input at the indicated position is transmitted to the portable information device 200 that is a server. For this reason, it is possible to input a character string to the second remote operation screen by a simple operation of copying the character string included in the first device operation screen and pasting it to the process input area on the second remote operation screen. it can. In the next step S49, the buffer is cleared, and the process returns to the image processing apparatus cooperation process.

  In step S50, the designated position is output to the client task, and the process returns to the image processing apparatus cooperation process. In the client task, an operation for designating the designated position is transmitted to the portable information device 200 which is a server. For this reason, portable information device 200 detects that the designated position on the second device operation screen, which is the second remote operation screen, has been designated, and accepts the remote operation.

  In step S51, it is determined whether a cooperation end instruction has been accepted. When the designated position is an area of a key to which an instruction to end the cooperation process is assigned, the cooperation end instruction is accepted. If a cooperation end instruction is accepted, the process proceeds to step S52. If not, the process returns to the image processing apparatus cooperation process. In step S52, the mobile information device 200 that is the client is notified of the end of cooperation, and the processing returns to the image processing device cooperation processing. Specifically, a cooperation end signal is transmitted to portable information device 200 via communication I / F unit 112.

  FIG. 13 is a flowchart illustrating an example of the flow of portable information device cooperation processing. The portable information device cooperation process is a process executed by the CPU 211 when the CPU 211 included in the portable information device 200 executes the portable information device cooperation program stored in the flash memory 213. Referring to FIG. 13, CPU 211 determines whether or not a cooperation instruction has been received (step S101). If the cooperation instruction is accepted, the process proceeds to step S102; otherwise, the process proceeds to step S105. In other words, the portable information device cooperation process is a process executed on condition that a cooperation instruction is received from an operating user of the portable information device 200.

  Here, a case will be described as an example where device identification information of MFP 100 is registered in advance as a device that can be linked among MFPs 100, 100A, and 100B. However, the operating user is linked from among MFPs 100, 100A, and 100B. You may make it select an apparatus. For example, the network addresses of the MFPs 100, 100A, and 100B are stored in advance, the device identification information of each of the MFPs 100, 100A, and 100B is displayed in a list, and whether or not communication with the device identification information selected by the user is possible is performed. Judging. Further, the MFPs 100, 100A, and 100B that can communicate with each other by searching for an inquiry signal by broadcasting are searched, and device identification information of one or more communicable devices detected by the search is displayed in a list and selected by the user. You may make it identify the apparatus of apparatus identification information as a cooperation other party's apparatus.

  In step S102, it is determined whether or not communication is established with MFP 100, which is a partner apparatus to cooperate with. Communication is established with MFP 100 via wireless LAN I / F 218 or short-range wireless communication unit 220. If communication with MFP 100 has been established, the process proceeds to step S103; otherwise, the process proceeds to step S118. In step S118, an error process is executed, and the process ends. The error process is a process of notifying the operating user that there is no communicable MFP 100, and displays a message on the display unit 216, for example.

  In step S103, a second controller determination process is executed. Although details of the second controller determination process will be described later, this is a process of determining one of the MFP 100 and the own apparatus with which communication has been established in step S102 as the controller operated by the operation user.

  In step S104, it is determined whether the own device is an operating device. The determination is based on the operating device determined by the second operating device determination process executed in step S103. If the own device is determined to be the operating device, the process proceeds to step S105. If MFP 100 is determined to be the operating device, the process proceeds to step S114.

  In step S105, the client task is activated. At this stage, the client task receives the first remote operation screen from MFP 100. Specifically, the client program stored in the flash memory 213 is executed. At this time, a network address of MFP 100 serving as a server, for example, an IP address is passed as an argument to the client task. At this stage, the client task receives the first remote operation screen from MFP 100.

  In the next step S106, the display areas of the second device operation screen and the first remote operation screen are determined. The display area on the display surface of the display unit 216 is determined. The second device operation screen is an operation screen for operating portable information device 200. The first remote operation screen is an operation screen that the client task receives from MFP 100 and is an operation screen for remotely operating MFP 100. In step S107, the display area determined for the second own apparatus operation screen in step S106 is set as an area for displaying the second own apparatus operation screen. In step S108, the display area determined for the first remote operation screen in step S106 is set as an area for displaying the first remote operation screen output by the client task activated in step S105.

  In the next step S109, a second operation acceptance process is executed, and the process proceeds to step S110. Details of the second operation reception process will be described later. In step S110, it is determined whether an operation device change signal is received from MFP 100 for which communication has been established in step S102. As described above, MFP 100 transmits an operation device change signal to portable information device 200 when the user of portable information device 200 logs in while portable information device 200 is in the state of the operation device. In step S110, it is determined whether or not the wireless LAN I / F 218 or the short-range wireless communication unit 170 has received a brain signal to the controller device. If an operation device change signal is received from MFP 100, the process proceeds to step S113. If not, the process proceeds to step S111.

  In step S111, it is determined whether a cooperation end instruction has been accepted in the second operation acceptance process executed in step S109. If the user points to a key provided in the operation unit 217 and to which a cooperation end instruction is assigned, the cooperation end instruction is accepted. When wireless LAN I / F 218 or short-range wireless communication unit 170 receives a cooperation end signal from MFP 100, it accepts a cooperation end instruction. If a cooperation end instruction is accepted, the process proceeds to step S112; otherwise, the process returns to step S109. In step S112, the display area of the second device operation screen is set to the entire area of the display surface of display unit 216, and the process ends.

  The process proceeds to step S113 when an operation device change signal is received from MFP 100 in step S110. Before step S113 is executed, the operating device is determined to be portable information device 200 in step S103, and a remote operation user who operates portable information device 200 remotely operates MFP 100 using portable information device 200. doing. When the remote operation user logs in from the operation panel 160 of the MFP 100, the operation device is changed to the MFP 100 so that the subsequent operation can be input to the operation panel 160 of the MFP 100. Therefore, in step S113, the operating device is changed to MFP 100, and the process proceeds to step S114.

  In step S114, a server task is activated. Specifically, the server program stored in the flash memory 213 is executed. At this stage, the server task communicates with MFP 100 serving as the client, transmits the second device operation screen as a second remote operation screen to MFP 100, and executes processing according to the operation received from MFP 100.

  In the next step S115, the driving of the display unit 216 is stopped. Here, the power supplied to the display unit 216 is cut off. This is to reduce power consumption by preventing the display unit 216 from consuming power. Further, instead of cutting off the power, the power consumed by the display unit 216 may be reduced. In the next step S116, it is determined whether a cooperation end instruction has been received. The wireless LAN I / F 218 or the short-range wireless communication unit 170 is in a standby state until it receives a cooperation end signal from the MFP 100 (NO in step S116). If the cooperation end signal is received (YES in step S116), the process proceeds to step S117. Proceed to In step S117, the display unit 216 that was stopped in step S115 is driven, and the process ends.

  FIG. 14 is a flowchart illustrating an example of the flow of the second controller determination process. The first controller device determination process is a process executed in step S103 of the portable information device cooperation process shown in FIG. Referring to FIG. 14, CPU 211 determines whether or not data to be processed is selectable (step S121). If the data to be processed can be selected by the user, the process proceeds to step S122. If not, the process proceeds to step S125. The data to be processed includes data stored in the flash memory 213 or data stored in a computer connected via the Internet. The state in which the data stored in the flash memory 213 can be selected includes a state in which a list of file names of data stored in the flash memory 213 is displayed. The state in which data stored in a computer connected via the Internet can be selected includes a state in which a screen on which data stored in a computer connected via the Internet can be downloaded is displayed.

  In step S122, the own device is determined as the controller device, and the process proceeds to step S123. In step S123, the first cooperation request signal is transmitted to MFP 100 via wireless LAN I / F 218 or short-range wireless communication unit 170. In the next step S124, it is determined whether or not a permission signal is received from MFP 100. The wireless LAN I / F 218 or the short-range wireless communication unit 170 is in a standby state until it receives a permission signal from the MFP 100 (NO in step S124). If the permission signal is received (YES in step S124), the process is linked to the portable information device. Return to processing.

  On the other hand, in step S125, MFP 100 is determined as the operating device, and the process proceeds to step S126. In step S126, the second cooperation request signal is transmitted to MFP 100 via wireless LAN I / F 218 or short-range wireless communication unit 170. In the next step S127, it is determined whether a permission signal is received from MFP 100 or not. If the wireless LAN I / F 218 or the short-range wireless communication unit 170 receives the permission signal from the MFP 100, the process returns to the portable information device cooperation process. In step S128, it is determined whether an operation device change signal is received from MFP 100 or not. If wireless LAN I / F 218 or short-range wireless communication unit 170 receives an operation device change signal from MFP 100, the process proceeds to step S129. If not, the process returns to step S127. In step S129, the controller device is changed to its own device, and the process returns to the portable information device cooperation process.

  FIG. 15 is a flowchart illustrating an example of the flow of the second operation reception process. The second operation acceptance process is a process executed in step S109 of the portable information device cooperation process shown in FIG. Referring to FIG. 15, CPU 211 determines whether or not the designated position has been detected (step S131). When position information is input from the touch panel 217A, a coordinate value included in the position information is detected as an indicated position. If the designated position is detected, the process proceeds to step S132; otherwise, the process returns to the portable information device cooperation process.

  In step S132, it is determined whether or not the designated position is the display area of the second device operation screen. The display area of the second device operation screen is set in step S111 in FIG. 13 and is an area in the display surface of the display unit 216. If the designated position is within the display area of the second device operation screen, the process proceeds to step S133; otherwise, the process proceeds to step S136.

  In step S133, it is determined whether or not the instruction time for detecting the instruction position is greater than or equal to threshold value T2. If the instruction time is equal to or greater than the threshold value T2, it is determined that the operation is to instruct copying, and the process proceeds to step S134. If not, the process proceeds to step S135. In step S134, the character string arranged around the designated position in the second device operation screen is temporarily stored in the buffer, and the process returns to the portable information device cooperation process. In addition, a temporal change in the designated position may be detected, and a character string included in an area specified by the designated position that changes may be specified as a character string that is temporarily stored. In step S135, an operation corresponding to the designated position is accepted, and the process returns to the portable information device cooperation process.

  On the other hand, in step S136, it is determined whether or not the designated position is the display area of the first remote operation screen. The display area of the first remote operation screen is an area in the display surface of the display unit 216, which is set in step S112 in FIG. If the designated position is within the display area of the first remote operation screen, the process proceeds to step S137; otherwise, the process proceeds to step S144.

  In step S137, it is determined whether a specific operation has been detected. When a plurality of designated positions are detected in step S131, a specific operation is detected. If a specific operation is detected, the process proceeds to step S138; otherwise, the process proceeds to step S140. In step S138, the amount of change is detected based on the temporal change of the plurality of detected indication positions. The specific operation includes an enlargement operation and a reduction operation. The change amount D is obtained from the interval L1 between the two indicated positions at the first time and the interval L2 between the two indicated positions at the second time after the first time, and the change amount D is calculated from the interval L2 Is a value obtained by subtracting the interval L1 from. If the amount of change D is positive, it is an enlargement operation, and if it is negative, it is a reduction operation. The first time is when the designated position is first detected, and the second time is when the designated position is no longer detected or when the distance between the two designated positions no longer changes.

  In step S139, the specific operation information is transmitted to MFP 100 via wireless LAN I / F 218, and the process returns to the portable information device cooperation process. The specific operation information includes a set of any one of the coordinate values detected in step S131 and the change amount detected in step S138.

  In step S140, step S134 is executed to determine whether a character string is stored in the buffer. If the character string is stored, it is determined that the operation is an instruction for pasting, and the process proceeds to step S141. If not, the process proceeds to step S143. In step S141, the character string is read from the buffer, and the designated position and the character string are output to the client task. In the client task, it is determined that a character string has been input at the indicated position, and an operation in which the character string has been input at the indicated position is transmitted to MFP 100 as the server. For this reason, it is possible to input a character string to the first remote operation screen by a simple operation of copying the character string included in the second device operation screen and pasting it to the process input area on the first remote operation screen. it can. In the next step S142, the buffer is cleared, and the process returns to the portable information device cooperation process.

  In step S143, the designated position is output to the client task, and the process returns to the portable information device cooperation process. In the client task, an operation for designating the designated position is transmitted to MFP 100 as a server. Therefore, MFP 100 detects that the designated position on the first device operation screen, which is the first remote operation screen, is designated, and accepts the remote operation.

  In step S144, it is determined whether a cooperation end instruction has been accepted. When the designated position is an area of a key to which an instruction to end the cooperation process is assigned, the cooperation end instruction is accepted. If a cooperation end instruction is accepted, the process proceeds to step S145; otherwise, the process returns to the portable information device cooperation process. In step S145, the MFP 100 that is the client is notified of the end of cooperation, and the process returns to the portable information device cooperation process. Specifically, a cooperation end signal is transmitted to MFP 100 via wireless LAN I / F 218.

  As described above, MFP 100 functions as an image processing apparatus, can function as a server, and can function as a client. In addition, when MFP 100 functions as a client, the first device operation screen and the second remote operation screen are simultaneously displayed on display unit 161. For this reason, when functioning as a client, the self-device and the portable information device 200 can be operated.

  Further, in MFP 100, a first state in which first server unit 59, which is a task for executing a server program, can communicate with portable information device 200, and a first client unit 61, which is a task for executing a client program, are included in portable information device. One state of the second state capable of communicating with 200 is selected. Therefore, one of MFP 100 and portable information device 200 can function as a server, and the other can function as a client.

  In particular, the second state is selected on the condition that the portable information device 200 is detected to exist within a predetermined range that is determined in advance as a range in which the user of the portable information device 200 can operate the MFP 100. To do. Therefore, only when a user is present at a position where MFP 100 can be operated, the operating user can remotely operate portable information device 200 by operating MFP 100. Therefore, the operating user can operate MFP 100 and portable information device 200 by operating MFP 100.

  Further, MFP 100 selects the second state on condition that the operation mode is not switched to the power saving mode. Therefore, when MFP 100 is in the power saving mode, the second state is not selected, and MFP 100 cannot be switched to the normal mode. Therefore, the power consumption of MFP 100 can be reduced.

  Further, MFP 100 selects the second state on condition that a user different from the operating user of portable information device 200 is not logged in. Therefore, when a user who is different from the operating user of portable information device 200 is logged in to MFP 100, the operating user can remotely operate MFP 100 by operating portable information device 200.

  Further, MFP 100 selects the second state when the operating user of portable information device 200 logs in while the first state is selected. Therefore, the state in which MFP 100 and portable information device 200 can be operated using portable information device 200 is switched to the state in which MFP 100 and portable information device 200 can be operated using MFP 100. As a result, the operating user can easily switch the operating device by performing an operation to log in to MFP 100. For this reason, it is not necessary to input an operation for switching the operation device.

  Further, when the user can select data to be processed by portable information device 200, portable information device 200 is determined as the operation device, and the user uses MFP 100, portable information device 200, and portable information device 200. Can be operated. For this reason, it is not necessary to input an operation for determining the operating device.

  When MFP 100 functions as a client, the character string included in the first device operation screen is temporarily stored, and the temporarily stored character string and the position designated by the user in the second remote operation screen are indicated. The position information is output to the first client unit 61. Therefore, when MFP 100 functions as a client, a character string included in the first device operation screen can be a character string input at a position designated by the user on the second remote operation screen.

  When MFP 100 functions as a server, MFP 100 receives position information indicating the position in the remote operation screen transmitted to portable information device 200 functioning as a client and specific operation information including the amount of change from portable information device 200. Accordingly, the process for the specific operation is determined based on the specific operation information and the second remote operation screen, and the determined process is executed. Therefore, even when a specific operation different from the operation that can be input to MFP 100 is input to portable information device 200, the operation can be converted to an operation that can be input to MFP 100. As a result, the function of the portable information device 200 can be used effectively.

  On the other hand, the portable information device 200 can function as a server and can function as a client. In addition, since the display unit 216 is switched to the power saving mode when the portable information device 200 functions as a server, power consumption when functioning as a server can be reduced. When functioning as a client, the second device operation screen and the first remote operation screen are simultaneously displayed on the display unit 216. Therefore, when functioning as a client, the apparatus and MFP 100 can be operated.

  Further, either the first state in which the second server unit 259 that executes the server program can communicate with the MFP 100 or the second state in which the second client unit 261 that executes the client program can communicate with the MFP 100 is selected. Select one state. Therefore, one of MFP 100 and portable information device 200 can function as a server, and the other can function as a client.

  Further, when functioning as a client, portable information device 200 temporarily stores the character string included in the second device operation screen, and is specified by the user in the temporarily stored character string and the first remote operation screen. The position information indicating the position is output to the second client unit 261. Therefore, when the portable information device 200 functions as a client, the character string included in the second device operation screen can be a character string input at a position designated by the user in the first remote operation screen. .

  In the above-described embodiment, the image processing system 1 has been described. However, the image processing apparatus cooperation method for causing the MFPs 100, 100A, and 100B to execute the image processing apparatus cooperation processing illustrated in FIGS. A portable information device that causes the portable information device 200 to execute the portable information device cooperation processing shown in FIGS. 13 to 15 as an image processing device cooperation program that causes the CPU 111 included in each of the MFPs 100, 100A, and 100B to execute the processing device cooperation method. Needless to say, the present invention can be understood as a portable information device cooperation program that causes the CPU 211 of the portable information device 200 to execute the cooperation method and the portable information device cooperation method.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
(1) causing the image processing apparatus to further execute a mode switching step of switching an operation mode between a normal mode and a power saving mode in which the power consumption is smaller than the normal mode;
The image processing apparatus cooperation method according to claim 13, wherein the selecting step includes a step of selecting the second state on the condition that the operation mode is not switched to the power saving mode in the mode switching step. .
(2) The image processing apparatus further includes:
It further comprises an operation receiving means for receiving an operation by the user,
Causing the image processing apparatus to further execute an authentication step of authenticating a user who operates the operation accepting unit;
The selection step includes a step of selecting the second state on the condition that a user different from the user associated with the portable information device in the authentication step is not authenticated. The image processing apparatus cooperation method as described in 1).
(3) The selection step selects the second state when the user associated with the portable information device is authenticated in the authentication step while the first state is selected. The image processing apparatus cooperation method according to (2), including steps.
(4) The portable information device includes storage means for storing data,
The selection step includes a step of selecting the first state when the data to be processed by the portable information device is in a state that can be selected by a user, or any one of (1) to (3). The image processing apparatus cooperation method described in 1.

DESCRIPTION OF SYMBOLS 1 Image processing system, 100, 100A, 100B MFP, 200 Portable information apparatus, 3 network, 5 wireless station, 51 1st operation reception part, 53 1st operation screen determination part, 55 1st display control part, 57 1st process Execution unit, 59 first server unit, 61 first client unit, 63 first selection unit, 65 first switching unit, 67 position detection unit, 69 user authentication unit, 71 first operating device determination unit, 81 first detection unit 83 First determination unit 85 First device operation accepting unit 87 First remote operation accepting unit 89 First temporary storage unit 91 First setting accepting unit 93 First cooperation instruction accepting unit 95 First copy Instruction receiving unit, 97 first output unit, 99 first pasting position receiving unit, 110 main circuit, 111 CPU, 112 communication I / F unit, 113 ROM, 114 RAM, 115 EEPROM, 116 HDD 117 facsimile unit, 119 external storage device, 119A CD-ROM, 120 automatic document feeder, 130 document reading unit, 140 image forming unit, 150 sheet feeding unit, 160 operation panel, 161 display unit, 163 operation unit, 165 touch panel, 170 Short-range wireless communication unit, 200 Portable information device, 211 CPU, 212 Camera, 213 Flash memory, 214 Wireless communication unit, 215 Calling unit, 216 Display unit, 217 Operation unit, 217A Touch panel, 220 Short-range wireless communication unit, 251 2nd operation reception part, 253 2nd operation screen determination part, 255 2nd display control part, 257 2nd process execution part, 259 2nd server part, 261 2nd client part, 263 2nd selection part, 265 2nd switching Unit, 281 second detection unit, 283 second determination unit, 285 second self apparatus operation acceptance , 287 second remote control receiving unit, 289 second temporary storage unit, 291 setting receiving unit 295 copies the instruction receiving unit, 297 output unit, 299 pasting position receiving unit.

Claims (13)

An image processing system in which either one of an image processing device and a portable information device is remotely operated as a client and the other is remotely operated as a server,
Each of the image processing device and the portable information device is
Display means for displaying an image;
Server means for communicating with the device functioning as the client and functioning as a server remotely operated by the device functioning as the client;
Client means for communicating with the device functioning as the server and functioning as a client for remotely operating the server;
Selection means for selecting one of a first state in which the server means communicates with the device functioning as the client and a second state in which the client means communicates with the device functioning as the server When,
When the second state is selected by the selection means, a display for simultaneously displaying on the display means a self-device operation screen for operating the self-device and a remote operation screen for remotely operating the server Control means,
The image processing apparatus further includes:
Position detecting means for detecting that the portable information device exists within a predetermined range determined by a distance from the device,
The selection means included in the image processing apparatus selects the second state on the condition that the position detection means detects that the portable information device is within the predetermined range. system. The image processing apparatus further includes:
A mode switching means for switching the operation mode between a normal mode and a power saving mode with lower power consumption than the normal mode,
The image processing according to claim 1, wherein the selection unit included in the image processing apparatus selects the second state on the condition that an operation mode is not switched to the power saving mode by the mode switching unit. system. The image processing apparatus further includes:
An operation accepting means for accepting an operation by a user;
Authenticating means for authenticating a user who operates the operation accepting means,
The selection unit included in the image processing device selects the second state on the condition that a user different from a user associated with the portable information device is not authenticated by the authentication unit. The image processing system according to 1 or 2.   When the user associated with the portable information device is authenticated by the authentication unit while the selection unit included in the image processing apparatus selects the first state, the second state The image processing system according to claim 3, wherein   5. The device according to claim 1, wherein the selection unit included in the portable information device selects the first state when the user can select data to be processed by the portable information device. Image processing system.   The selection unit included in the portable information device selects the second state when the first state is selected by the selection unit included in the image processing device, and the selection included in the image processing device. The image processing system according to claim 1, wherein when the second state is selected by means, the first state is selected. Display means for displaying an image;
A communication means for communicating with the portable information device;
Server means for communicating with the portable information device and functioning as a server remotely operated by the portable information device;
Client means for communicating with the portable information device and functioning as a client for remotely operating the portable information device;
Selection means for selecting one of a first state in which the server means communicates with the device functioning as the client and a second state in which the client means communicates with the device functioning as the server When,
Position detecting means for detecting that the portable information device exists within a predetermined range determined by a distance from the device;
When the second state is selected by the selection means, a display for simultaneously displaying on the display means a self-device operation screen for operating the self-device and a remote operation screen for remotely operating the server Control means,
The image processing apparatus, wherein the selection unit selects the second state on the condition that the position detection unit detects that the portable information device is within the predetermined range. A mode switching means for switching the operation mode between a normal mode and a power saving mode with lower power consumption than the normal mode;
The image processing according to claim 7, wherein the selection unit included in the image processing device selects the second state on the condition that an operation mode is not switched to the power saving mode by the mode switching unit. apparatus. The image processing apparatus further includes:
An operation accepting means for accepting an operation by a user;
Authenticating means for authenticating a user who operates the operation accepting means,
The said selection means selects the said 2nd state on condition that the user different from the user linked | related with respect to the said portable information device by the said authentication means is not authenticated, The Claim 7 or 8 Image processing system.   The selection unit selects the second state when a user associated with the portable information device is authenticated by the authentication unit while the first state is selected. 10. The image processing system according to 9.   The image processing device according to claim 7, wherein the selection unit selects the first state when the user can select data to be processed by the portable information device. An image processing apparatus cooperation method executed by an image processing apparatus that accepts an operation in cooperation with a portable information device,
The image processing apparatus includes:
Display means for displaying an image;
A communication means for communicating with the portable information device;
Server means for communicating with the portable information device and functioning as a server remotely operated by the portable information device;
Client means for communicating with the portable information device and functioning as a client for remotely operating the portable information device;
A selection step of selecting one of a first state in which the server means communicates with the device functioning as the client and a second state in which the client means communicates with the device functioning as the server. When,
A detection step of detecting that the portable information device exists within a predetermined range determined by a distance from the device;
When the second state is selected in the selection step, a display for simultaneously displaying the own device operation screen for operating the own device and the remote operation screen for remotely operating the server on the display means And causing the image processing apparatus to execute a control step,
The image processing apparatus cooperation method, wherein the selection step includes a step of selecting the second state on condition that the detection step detects that the portable information device is within the predetermined range. An image processing apparatus cooperation program executed by a computer that controls an image processing apparatus that receives an operation in cooperation with a portable information device,
The image processing apparatus includes:
Display means for displaying an image;
A communication means for communicating with the portable information device;
Server means for communicating with the portable information device and functioning as a server remotely operated by the portable information device;
Client means for communicating with the portable information device and functioning as a client for remotely operating the portable information device;
A selection step of selecting one of a first state in which the server means communicates with the device functioning as the client and a second state in which the client means communicates with the device functioning as the server. When,
A detection step of detecting that the portable information device exists within a predetermined range determined by a distance from the device;
When the second state is selected in the selection step, a display for simultaneously displaying the own device operation screen for operating the own device and the remote operation screen for remotely operating the server on the display means And causing the computer to execute a control step,
The image processing apparatus cooperation program, wherein the selection step includes a step of selecting the second state on condition that the detection step detects that the portable information device exists within the predetermined range.

Images