JP2018107510A - Information processing device, coordination method, and coordination program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate an operation for coordination with a portable device.SOLUTION: An information processing device communicable with a portable device carried by a user includes: a path establishing unit 43 that establishes a communication path with the portable device; a continuation state detection unit 51 that detects a continuation state on the basis of the state of the portable device or the state of its own device; and a mode switching unit 35 that switches from a single mode for not coordinating with the portable device to a coordination mode for coordinating with the portable device in response to the establishment of a coordination start condition, and switches to the single mode in response to the establishment of a coordination end condition in the coordination mode. The mode switching unit includes a resumption unit 56 that, when a coordination resumption condition different from the coordination start condition is established after switching from the coordination mode to the single mode in a state where the continuation state is detected, switches from the single mode to the coordination mode.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an information processing device, a cooperation method, and a cooperation program, and more particularly to an information processing device that executes processing in cooperation with a portable device carried by a user, a cooperation method and a cooperation program executed by the information processing device. .

  2. Description of the Related Art In recent years, a technique for remotely operating an image processing apparatus such as an MFP (Multi Function Peripheral) with a portable apparatus such as a smartphone or PDA (Personal Digital Assistant) carried by a user is known.

  For example, in Japanese Patent Application Laid-Open No. 2008-123476, whether the operation of pressing the display surface of the liquid crystal panel is due to the portable information terminal being placed on the display surface or by the user pointing with a finger. If the mobile information terminal is determined to be a portable information terminal, the communication path is established with the portable information terminal only while the portable information terminal is placed on the display surface, and the processing menu screen for the portable information terminal is displayed. It is described to do.

However, while the portable information device terminal is placed on the liquid crystal panel, another process may be executed in the portable information terminal, for example, by receiving an incoming call from the outside. When the user gives priority to another process in the portable information terminal, the portable information terminal may be operated away from the liquid crystal panel. When another portable information terminal is placed on the liquid crystal panel after completing another process in the portable information terminal, the setting must be performed again from the beginning in the image forming apparatus. There is a problem that an operation input to the image processing apparatus before being released is wasted.
JP 2008-123476 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to provide an information processing apparatus that facilitates an operation for linking with a portable device.

  Another object of the present invention is to provide a cooperation method that facilitates an operation for cooperation with a portable device.

  Still another object of the present invention is to provide a linkage program that facilitates an operation for linking with a portable device.

  In order to achieve the above-described object, according to an aspect of the present invention, there is provided an information processing apparatus capable of communicating with a portable device carried by a user, and a route establishing means for establishing a communication route with the portable device; Based on the state of the portable device or the state of the own device, the continuation state detecting means for detecting the continuation state and the cooperation that cooperates with the portable device from the single mode that does not cooperate with the portable device when the cooperation start condition is established Mode switching means for switching to the mode and switching to the single mode in response to establishment of the link termination condition in the link mode, and the mode switching means switches from the link mode to the single mode in a state in which the continuation state is detected. Later, when a cooperation resumption condition different from the cooperation start condition is satisfied, a restarting means for switching from the single mode to the cooperation mode is included.

  According to this aspect, when the cooperation start condition is satisfied, the single mode is switched to the cooperation mode, when the cooperation end condition is satisfied, the single mode is switched, and the continuation state is detected and the single mode is set. After the switching, when the cooperation restart condition is satisfied, the mode is switched to the cooperation mode. Since the cooperation restart condition is different from the cooperation start condition, it is possible to facilitate the user's operation for switching to the cooperation mode after switching to the single mode in a state where the continuation state is detected. As a result, it is possible to provide an information processing apparatus that facilitates an operation for linking with a portable device.

  Preferably, the display unit that displays the image, the position detection unit that detects the position where the object is in contact with the display surface of the display unit, and the position detection unit detects the position where the object is in contact Device detection means for detecting a device, and the cooperation start condition includes a condition for establishing a communication path with the portable device in a state where the portable device is detected by the device detection means.

  According to this aspect, since the information processing apparatus switches to the cooperation mode by simply placing the portable device on the display surface, the operation for linking with the portable device is easy.

  Preferably, the cooperation end condition includes a first condition in which the portable device is not detected by the device detection unit.

  According to this aspect, since the information processing apparatus is switched to the single mode only by moving the portable device placed on the display surface away from the display surface, the operation for ending the cooperation with the portable device is easy.

  Preferably, the mode switching means includes a maintaining means for continuing the cooperation mode when the portable device is not detected by the device detection means in a state where the continuation state is detected in the cooperation mode, and the cooperation end condition is the continuation state Communication established between the first condition in which the portable device is not detected by the device detection means in a state where no portable device is detected and the portable device after the portable device is no longer detected in the state in which the continuation state is detected And a second condition for disconnecting the path.

  Preferably, the information processing apparatus further includes a restart notification unit configured to display correspondence information corresponding to the portable device on the display unit and display identification information that can identify the correspondence information on the portable device in response to establishment of the cooperation restart condition. .

  According to this aspect, since the correspondence information corresponding to the portable device is displayed and the identification information that can identify the correspondence information is displayed on the portable device, it is possible to notify the user that the mode has been switched to the cooperation mode.

  Preferably, the restart notification means terminates the display of the correspondence information and terminates the display of the identification information on the portable device in response to an operation for terminating the display of the correspondence information being accepted.

  According to this aspect, when the operation for terminating the display of the correspondence information is accepted, the display of the correspondence information and the identification information is terminated, so that the operation by the user can be accepted.

  Preferably, the mobile device further includes mobile-side notification means for ending the display of the correspondence information in response to receiving an end instruction transmitted by the mobile device that receives an operation for ending the display of the identification information.

  According to this aspect, an operation for terminating the display of the correspondence information can be received by the portable device.

  Preferably, an operation area determining means for allocating one operation area corresponding to the mobile device from among a plurality of operation areas of the display surface of the display means in response to switching to the cooperation mode by the mode switching means, and mode switching An operation region storage means for storing the portable device and the operation region assigned to the portable device in association with each other in response to switching from the cooperation mode to the single mode in a state in which the continuation state is detected by the means; The correspondence information display means displays the correspondence information in the operation area assigned to the portable device by the operation area determination means.

  According to this aspect, the correspondence information is displayed in the operation region assigned to the portable device among the plurality of operation regions, and the identification information for identifying the correspondence information is displayed on the portable device. The operation area assigned to the portable device can be notified.

  Preferably, when the operation region determining unit is switched to the cooperation mode by the mode switching unit, and the operation region is associated with the portable device by the operation region storage unit, the operation region associated with the portable device is not yet stored. If used, the operation area associated with the portable device is assigned to the portable device, and if the operation area associated with the portable device is in use, one of the plurality of operation areas unused is carried When the operation area storage means associates the operation area with the portable device, or when the operation area different from the operation area associated with the portable device is assigned, the restart notification means assigns the correspondence information. indicate.

  According to this aspect, when the operation area different from the operation area assigned in the cooperation mode before switching to the single mode is assigned, the correspondence information is displayed, so that the operation area is changed to the user. The operation area after the change can be notified.

  Preferably, the restart notification unit displays the correspondence information when any one or more operation areas other than the operation area assigned to the portable device by the operation area determination unit is in use.

  According to this aspect, since correspondence information is displayed when one of one or more operation areas other than the operation area assigned to the mobile device is in use, the correspondence information is displayed. The user can be notified of the operation area.

  Preferably, a rotation mechanism that rotates the direction of the display surface of the display unit, and the direction of the portable device and the display surface in response to switching from the cooperation mode to the single mode in a state where the continuation state is detected by the mode switching unit. Direction resumption means, and the resumption notification means displays correspondence information when the direction of the display surface is different from the direction of the display surface stored in association with the portable device.

  According to this aspect, since the correspondence information is displayed when the direction of the display surface is changed, the user can be notified of the operation area assigned to the portable device.

  Preferably, the correspondence information is an image in which a predetermined color is determined in a first shape, and the identification information is an image in which a predetermined color is determined in a second shape.

  Preferably, the correspondence information is an image of a predetermined character string, and the identification information is an image of a predetermined character string.

  Preferably, the apparatus further includes a relative position detection unit configured to detect a portable device that exists at a predetermined relative position, and the cooperation start condition is determined between the portable device and the portable device after it is detected that the portable device exists at the predetermined relative position. The communication termination condition includes the condition that the communication path established with the portable device is disconnected, and the cooperation restart condition establishes the communication path with the portable device. Including at least a condition to be performed.

  According to this aspect, since the information processing apparatus is switched to the cooperation mode only by placing the portable apparatus at a predetermined relative position with the information processing apparatus, an operation for starting cooperation with the portable apparatus is easy.

  Preferably, the information processing apparatus further includes a measurement unit that measures the distance to the portable device, and the cooperation restart condition is a condition in which the distance from the portable device changes from a state larger than the predetermined distance to a state equal to or smaller than the predetermined distance. including.

  According to this aspect, when the distance to the portable device changes from a state larger than the predetermined distance to a state equal to or smaller than the predetermined distance, the mode is switched to the cooperation mode. be able to.

  Preferably, the cooperation resumption condition includes a condition for accepting a resumption instruction operation instructing resumption of the cooperation mode input by the user.

  Preferably, the restart instruction operation is accepted in the portable device.

  Preferably, a device-side receiving unit that receives an operation by a user, a device-side setting unit that sets a setting value according to an operation received by the device-side receiving unit in the cooperation mode, and a process according to the setting value in the cooperation mode with the portable device A device-side execution unit that executes in cooperation and executes processing according to a set value in the single mode, and a setting value that is set by the device-side setting unit when switching from the cooperative mode to the single mode in a state in which the continuation state is detected Maintaining means for storing the information in association with the portable device, and when the device-side setting means is switched from the single mode to the cooperation mode, if the setting value associated with the portable device is stored, the stored setting is stored. The value setting is restarted, and if the setting value associated with the portable device is not stored, the device-side setting value is set from the beginning.

  According to this aspect, the user can continue the setting in the previous cooperation mode.

  According to another aspect of the present invention, the cooperation method is a cooperation method executed by an information processing device capable of communicating with a portable device carried by a user, and a route for establishing a communication route with the portable device The establishment step, the continuation state detection step for detecting the continuation state based on the state of the portable device or the state of the own device, and the portable device from the single mode that does not cooperate with the portable device when the cooperation start condition is established A mode switching step for switching to a cooperative mode and switching to a single mode in response to the establishment of a cooperative termination condition in the cooperative mode, wherein the mode switching step is a single mode from the cooperative mode in a state in which a continuation state is detected. If the cooperation restart condition different from the cooperation start condition is satisfied after switching to Including.

  If this aspect is followed, the cooperation method which made easy operation for making it cooperate with a portable apparatus can be provided.

  According to another aspect of the present invention, the cooperation program is a cooperation program executed by a computer that controls an information processing apparatus that can communicate with a portable device carried by a user, and a communication path between the portable device and the portable device. A path establishment step that establishes a state, a continuation state detection step that detects a continuation state based on the state of the portable device or the state of the device itself, and a single mode that does not cooperate with the portable device when the cooperation start condition is satisfied The computer is switched to the cooperation mode that cooperates with the mobile device, and the computer executes a mode switching step that switches to the single mode in response to establishment of the cooperation end condition in the cooperation mode, and the continuation state is detected in the mode switching step. After switching from cooperation mode to single mode in the state, the cooperation restart condition different from the cooperation start condition is satisfied And, the resumption step of switching from a single mode in cooperation mode, including.

  If this aspect is followed, the cooperation program which made easy operation for making it cooperate with a portable apparatus can be provided.

It is a figure which shows an example of the whole outline | summary of the cooperation system in embodiment of this invention. 2 is a block diagram illustrating an example of a hardware configuration of an MFP according to the first embodiment. FIG. It is a block diagram which shows the outline | summary of the hardware constitutions of the smart phone in 1st Embodiment. 3 is a block diagram illustrating an example of functions of a CPU provided in the MFP according to the first embodiment. FIG. It is a figure which shows an example of an operation screen. It is a figure which shows an example of a continuation condition setting screen. It is a figure which shows an example of the function which CPU with which the smart phone in 1st Embodiment has is provided. It is a figure which shows an example of the flow of the data in the cooperation system in 1st Embodiment. It is a flowchart which shows an example of the flow of the cooperation process in 1st Embodiment. It is a flowchart which shows an example of the flow of a cooperation start condition detection process. It is a flowchart which shows an example of the flow of a cooperation resumption condition detection process. It is a flowchart which shows an example of the flow of a return process. It is a flowchart which shows an example of the flow of an acceptance control process. It is a flowchart which shows an example of the flow of a continuation state detection process. It is a flowchart which shows an example of the flow of the portable side cooperation process in 1st Embodiment. It is a figure which shows an example of the whole outline | summary of the cooperation system in 2nd Embodiment. FIG. 10 is a block diagram illustrating an example of a hardware configuration of an MFP according to a second embodiment. FIG. 10 is a block diagram illustrating an example of functions of a CPU provided in an MFP according to a second embodiment. It is a figure which shows an example of the function which CPU with which the smart phone in 2nd Embodiment has is provided. It is a flowchart which shows an example of the flow of the cooperation process in 2nd Embodiment. It is a flowchart which shows an example of the flow of the cooperation start condition detection process in 2nd Embodiment. It is a figure which shows an example of the flow of the continuation state detection process in 2nd Embodiment. It is a flowchart which shows an example of the flow of the portable side cooperation process in 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment>
FIG. 1 is a diagram illustrating an example of an overall outline of a cooperation system according to an embodiment of the present invention. Referring to FIG. 1, cooperation system 1 includes an MFP (Multi Function Peripheral) 100 and smartphones 200A, 200B, and 200C. In this example, three users A, B, and C carry smartphones 200A, 200B, and 200C, respectively, and operate MFP 100 at the same time.

  Here, a case where three users A, B, and C operate MFP 100 at the same time will be described as an example. However, the number of users is not limited, and one or more users may operate MFP 100. Good.

  MFP 100 is an example of an information processing apparatus. Display unit 161, touch panel 165, document reading unit 130 that reads a document, image forming unit 140 that forms an image on a sheet or the like based on data, and image forming unit 140. And a paper feeding unit 150 for feeding paper to the printer. The display unit 161 is a display device such as a liquid crystal display device (LCD) or an organic ELD (Electro-Luminescence Display). Display unit 161 is provided on the upper surface of MFP 100 main body. The touch panel 165 is provided on the display unit 161 so as to overlap the upper surface or the lower surface, and detects a position where an object is in contact with the display surface of the display unit 161. The touch panel 165 is a multi-touch compatible touch panel. For this reason, when an object contacts at once at a plurality of locations on the display surface of the display unit 161, the touch panel 165 can detect a plurality of positions where the object contacts. The objects here include smartphones 200A, 200B, and 200C in addition to the user's finger.

  One touch panel 165 may be used, or a plurality of touch panels 165 may be combined. When the touch panel 165 is a combination of a plurality of touch panels, for example, the display surface of the display unit 161 may be divided into a plurality of areas, and the plurality of touch panels may be associated with each of the plurality of areas. For the touch panel 165, for example, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, or a capacitance method can be used, and the method is not limited.

  Three users A, user B, and user C are located around MFP 100. MFP 100 can be used for a conference in which user A, user B, and user C participate. Since each of user A, user B, and user C is located around MFP 100, the entire display surface of display unit 161 is visible. For this reason, if the data prepared for the conference is stored in the MFP 100 in advance, the same data is displayed to the user A, the user B, and the user C by causing the display unit 161 to display the data. You can show it at the same time. In addition, touch panel 165 of MFP 100 is used as an input device for user A, user B, and user C to operate MFP 100. For example, when an application program for editing a document is installed in MFP 100, MFP 100 may be made to create a document using touch panel 165 as a keyboard.

  Smartphones 200 </ b> A, 200 </ b> B, and 200 </ b> C are examples of portable devices, and are carried and used by users A, B, and C, respectively. User A, user B, and user C place smartphones 200 </ b> A, 200 </ b> B, 200 </ b> C on the display surface of display unit 161. For this reason, the smartphones 200A, 200B, and 200C are arranged on the display surface of the display unit 161 in the vicinity of the sides in the direction in which the users A, B, and C are located. In this case, since touch panel 165 detects smartphones 200A, 200B, and 200C, MFP 100 can detect the positions of smartphones 200A, 200B, and 200C.

  Each of MFP 100 and smartphones 200A, 200B, and 200C has a short-range wireless communication function, and can communicate with each other on a one-to-one basis when the counterpart device is within a predetermined range. Each of MFP 100 and smartphones 200A, 200B, and 200C has a wireless LAN function and can communicate with a wireless base station connected to a network. The wireless base station is a network relay device, and communicates with MFP 100 and smartphones 200A, 200B, and 200C, and connects MFP 100 and smartphones 200A, 200B, and 200C to the network. Therefore, MFP 100 and smartphones 200A, 200B, and 200C can communicate with each other via a network by communicating with a wireless base station. The network may further be connected to the Internet. In this case, each of MFP 100 and smartphones 200A, 200B, and 200C can communicate with a computer connected to the Internet. The network is, for example, a local area network (LAN), and the connection form may be wired or wireless. The network is not limited to a LAN, and may be a network using a public switched telephone network. Further, the network may be a wide area network (WAN) such as the Internet.

  In cooperation system 1 in the present embodiment, any of smartphones 200A, 200B, and 200C and MFP 100 can execute cooperation processing in cooperation with each other. For example, the smartphone 200 </ b> A and the MFP 100 communicate using a near field communication function or a wireless LAN function, and execute cooperation processing in cooperation with each other. The linkage process defines a series of processes. A series of a plurality of processes determined by the cooperation process includes an apparatus-side process executed by MFP 100 and a mobile-side process executed by smartphone 200A. For example, when a cooperative process in which the mobile-side process is a process for selecting data and the apparatus-side process is a process for forming an image is executed by the MFP 100 and the smartphone 200A, the selection is performed by the user A who operates the smartphone 200A. In this process, the MFP 100 forms an image of the data stored in the smartphone 200A on the paper according to the image forming conditions set by the user A who operates the MFP 100. When the apparatus-side process is a process for selecting data and the portable-side process is a process for transmitting data, the cooperation process executed between MFP 100 and smartphone 200A is selected by user A who operates MFP 100. In this process, the smartphone 200A transmits the data stored in the MFP 100 in accordance with the transmission conditions set by the user A who operates the smartphone 200A. The transmission condition is determined, for example, by the user selecting a destination and a transmission method from an address book stored in the smartphone 200A.

  Note that smartphones 200A, 200B, and 200C will be described as an example of portable devices carried by the user. However, a PDA (Personal Digital Assistant) or the like may be used as long as the device is portable by the user.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the MFP according to the first embodiment. Referring to FIG. 2, MFP 100 includes a main circuit 110, a document reading unit 130, an image forming unit 140, a paper feeding unit 150, a display unit 161, and a touch panel 165.

  The main circuit 110 includes a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a mass storage device, a facsimile unit 116, and a CD-ROM 118. An external storage device 117 and a short-range communication unit 119. CPU 111 is connected to document reading unit 130, image forming unit 140, paper feeding unit 150, display unit 161 and touch panel 165, and controls the entire MFP 100.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. The RAM 114 temporarily stores read data (image data) continuously sent from the document reading unit 130.

  Communication I / F unit 112 is an interface for connecting MFP 100 to a network. The CPU 111 communicates with each of the smartphones 200A, 200B, and 200C via the communication I / F unit 112, and transmits and receives data. The communication I / F unit 112 can communicate with a computer connected to the Internet via a wireless base station and a network.

  The short-range communication unit 119 communicates wirelessly with the smartphones 200A, 200B, and 200C based on the Bluetooth (registered trademark) standard GAP (Generic Access Profile) and the like. For example, the short-range communication unit 119 communicates with the smartphone 200A when the distance to the smartphone 200A is equal to or less than a communicable distance. The distance that the short-range communication unit 119 can communicate is several meters.

  The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to the PSTN or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or outputs it to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 116 on a sheet. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN.

  The external storage device 117 is loaded with a CD-ROM 118. The CPU 111 can access the CD-ROM 118 via the external storage device 117. The CPU 111 loads the program recorded on the CD-ROM 118 attached to the external storage device 117 to the RAM 114 and executes it. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, but an optical disc (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, It may be a semiconductor memory such as a mask ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM).

  Further, the program executed by the CPU 111 is not limited to the program recorded on the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network may rewrite the program stored in HDD 115 of MFP 100 or may add a new program and write it. Further, MFP 100 may download a program from another computer connected to the network and store the program in HDD 115. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  Since the basic hardware configurations and functions of the smartphones 200A, 200B, and 200C are the same, the smartphone 200A will be described as an example here.

  FIG. 3 is a block diagram illustrating an outline of the hardware configuration of the smartphone according to the first embodiment. Referring to FIG. 3, smartphone 200A in the present embodiment is connected to CPU 201 for controlling overall smartphone 200A, camera 202, flash memory 203 for storing data in a nonvolatile manner, and call unit 205. Wireless communication unit 204, display unit 206 for displaying information, operation unit 207 for accepting user operations, wireless LAN I / F 208, short-range communication unit 209, GPS reception unit 210, external storage device 211, ,including.

  The display unit 206 is a display device such as a liquid crystal display (LCD) or an organic ELD, and displays an instruction menu for a user, information about acquired image data, and the like. The operation unit 207 includes a main key 207A and a touch panel 207B. When the user instructs the display surface of the display unit 206, the operation unit 207 outputs the position of the display surface detected by the touch panel 207B to the CPU 201. Based on the position detected by the touch panel 207B, the CPU 201 detects a position designated by the user in the screen displayed on the display unit 206. Based on the screen displayed on the display unit 206 and the position detected by the touch panel 207 </ b> B, the CPU 201 accepts input of various instructions, data such as characters and numbers by user operations. For example, when a screen including a numeric keypad image is displayed on the display unit 206, a number corresponding to the key displayed at the position detected by the touch panel 207B is received.

  The camera 202 includes a lens and a photoelectric conversion element. The light focused by the lens is imaged on the photoelectric conversion element. The photoelectric conversion element photoelectrically converts the received light and outputs image data to the CPU 201. A photoelectric conversion element is a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge Coupled Device) sensor, or the like.

  The wireless communication unit 204 performs wireless communication with a mobile phone base station connected to a telephone communication network. The wireless communication unit 204 connects the smartphone 200 </ b> A to the telephone communication network and enables a call using the call unit 205. The radio communication unit 204 decodes a voice signal obtained by demodulating the radio signal received from the mobile phone base station and outputs the decoded signal to the call unit 205. Further, the wireless communication unit 204 encodes the voice input from the call unit 205 and transmits it to the mobile phone base station. The call unit 205 includes a microphone and a speaker, and outputs the sound input from the wireless communication unit 204 from the speaker, and outputs the sound input from the microphone to the wireless communication unit 204. Further, the wireless communication unit 204 is controlled by the CPU 201, connects the smartphone 200A to an email server, and transmits and receives emails.

  The wireless LAN I / F 208 is an interface for communicating with a wireless station connected to the network and connecting the smartphone 200A to the network. By registering the IP (Internet Protocol) address of MFP 100 in smartphone 200A, smartphone 200A can communicate with MFP 100 and can transmit and receive data.

  The short-range communication unit 209 communicates with other devices, for example, the MFP 100 wirelessly based on Bluetooth (registered trademark) standard GAP or the like. For example, the short-range communication unit 209 communicates with the MFP 100 when the distance to the MFP 100 is equal to or less than a communicable distance. The distance that the short-range communication unit 209 can communicate is several meters.

  The GPS receiving unit 210 receives a signal transmitted from a GPS (Global Positioning System) satellite and detects a current position based on the received signal. The current position is, for example, latitude and longitude. The GPS receiving unit 210 outputs the detected current position to the CPU 201.

  The flash memory 203 stores a program executed by the CPU 201 or data necessary for executing the program. The CPU 201 loads the program recorded in the flash memory 203 to the RAM included in the CPU 201 and executes it.

  The external storage device 211 is detachably attached to the smartphone 200A, and a CD-ROM 211A storing a remote operation program can be attached thereto. The CPU 201 can access the CD-ROM 211A via the external storage device 211. The CPU 201 can load a remote operation program recorded on the CD-ROM 211A attached to the external storage device 211 into a RAM included in the CPU 201 and execute it.

  Note that the program recorded in the flash memory 203 or the CD-ROM 210A has been described as a program executed by the CPU 201. However, another program connected to the network rewrites the program stored in the flash memory 203, or A new program written additionally may be used. Furthermore, the program which the smart phone 200A downloaded from the other computer connected to the network may be sufficient. The program here includes not only a program directly executable by the CPU 201 but also a source program, a compressed program, an encrypted program, and the like.

  The medium for storing the program executed by the CPU 201 is not limited to the CD-ROM 211A, and may be a semiconductor memory such as an optical disk (MO / MD / DVD), IC card, optical card, mask ROM, EPROM, or EEPROM. Good.

  FIG. 4 is a block diagram illustrating an example of the functions of the CPU provided in the MFP according to the first embodiment. The functions illustrated in FIG. 4 are functions formed in the CPU 111 when the CPU 111 provided in the MFP 100 executes the cooperation program stored in the ROM 113, the HDD 115, and the CD-ROM 118.

  Referring to FIG. 4, CPU 111 provided in MFP 100 includes device-side setting unit 31, device-side execution unit 33, linkage mode switching unit 35, operation area determination unit 37, user management unit 39, and device detection unit. 41, a path establishment unit 43, a release notification unit 45, a maintenance notification unit 46, a maintenance unit 47, a return unit 49, and a continuation state detection unit 51.

  The cooperation mode switching unit 35 switches the operation mode between the single mode and the cooperation mode. In the first embodiment, since a plurality of users operate MFP 100 at the same time, cooperation mode switching unit 35 switches the operation mode for each of smartphones 200A, 200B, and 200C. For example, for the smartphone 200A carried by the user A, the cooperation mode switching unit 35 changes the operation mode to a cooperation mode that operates in cooperation with the smartphone 200A, and a single mode that operates independently without cooperation with the smartphone 200A. Switch to one of the following. Hereinafter, an apparatus that is a target for the cooperation mode switching unit 35 to switch to the cooperation mode is referred to as a cooperation apparatus.

  The cooperation mode switching unit 35 includes a cooperation setting unit 53 that registers a cooperation device when a cooperation start condition is satisfied, a release unit 54 that cancels registration of the cooperation device when a cooperation end condition is satisfied, a relative position detection unit 55, and a resumption of cooperation. And a resuming unit 56 that re-registers the cooperation device when the condition is satisfied. When the cooperation device is registered by the cooperation setting unit 53, the cooperation mode switching unit 35 switches the operation mode of the cooperation device to the cooperation mode, and changes the cooperation device information of the cooperation device and the operation mode information indicating the cooperation mode to the device side. The data is output to the execution unit 33, the operation area determination unit 37, and the continuation state detection unit 51. When the registration of the cooperation device is canceled by the release unit 54, the cooperation mode switching unit 35 switches the operation mode of the cooperation device to the single mode, and the cooperation device information of the cooperation device and the operation mode information indicating the single mode are displayed on the device side. The data is output to the execution unit 33 and the operation area determination unit 37. When the cooperation device is re-registered by the resuming unit 56, the cooperation mode switching unit 35 switches the operation mode of the cooperation device to the cooperation mode, and changes the cooperation device information of the cooperation device and the operation mode information indicating the cooperation mode to the device side. The data is output to the execution unit 33, the operation area determination unit 37, and the continuation state detection unit 51.

  The cooperation setting unit 71 registers the cooperation device when the cooperation start condition is satisfied. The cooperation start condition is satisfied when any of the smartphones 200A, 200B, and 200C is placed on the display surface of the display unit 161 and a communication path is established with the placed device. Hereinafter, a case where the user A places the smartphone 200 </ b> A on the display surface of the display unit 161 will be described as an example.

  The device detection unit 41 controls the touch panel 165 to detect that any one of the smartphones 200A, 200B, and 200C is placed on the display surface of the display unit 161. When any one of the smartphones 200A, 200B, and 200C, for example, the smartphone 200A is placed on the display surface of the display unit 161, the touch panel 165 detects the position where the smartphone 200A is placed on the display surface of the display unit 161. To do. Since the area where the smartphone 200A contacts the display surface of the display unit 161 is larger than the area of the user's finger, the upper limit of the area of the user's finger is set in advance as a threshold value, and the touch panel 165 detects the contact of the object. If the area of the region is equal to or greater than the threshold value, it is determined that smartphone 200A is placed. The device detection unit 41 outputs a device detection signal to the cooperation mode switching unit 35 when the area where the touch panel 165 detects an object contact is equal to or greater than a threshold value. The device detection signal includes position information indicating a position where the object detected by the touch panel 165 is in contact.

  If the touch panel 165 does not detect contact with an object after outputting the device detection signal, the device detection unit 41 outputs a separation signal to the cooperation mode switching unit 35. The separation signal includes position information indicating a position where the object detected by the touch panel 165 is in contact.

  In response to the input of the device detection signal from the device detection unit 41, the cooperation setting unit 53 controls the short-range communication unit 119 to transmit a search command for searching for devices existing in the vicinity. When each of the smartphones 200A, 200B, and 200C receives a search command, the smartphone 200A, 200B, and 200C returns a response command that includes device identification information for identifying the device itself. As the device identification information, a network address assigned in the network can be used. The network address is, for example, an IP address (Internet Protocol) address or a MAC (Media Access Control) address. When the smartphone 200 </ b> A is placed on the display surface of the display unit 161, it receives a search command and returns a response command. Here, since the smartphone 200A is placed on the display surface of the display unit 161, the smartphone 200A returns a response command. The device detection unit 41 receives the response command returned from the smartphone 200A, and thereby detects that the device placed at the position previously detected by the touch panel 165 is the smartphone 200A. When detecting the smartphone 200A, the cooperation setting unit 53 registers the smartphone 200A as a contact device. Specifically, the cooperation setting unit 53 stores, in the RAM 114, contact device information including a set of device identification information of the smartphone 200A and position information indicating a position where the smartphone 200A is placed, and a route establishment unit. A route establishment instruction is output to 43. The route establishment instruction includes device identification information of a device placed on the display surface of the display unit 161, here, the smartphone 200A.

  Here, in the case where the cooperation setting unit 53 controls the short-range communication unit 119 to transmit a search command in response to the input of the device detection signal from the device detection unit 41, a response command received from the smartphone 200A Separately, a response command may be received from the smartphones 200B and 200C. In this case, the cooperation setting unit 53 excludes a response command received from a device specified by device identification information included in excluded device information described later from a plurality of response commands. Further, among the response commands to be processed, the cooperation setting unit 53 determines a response command whose device identification information of the device that has transmitted the command is not included in any of the contact device information stored in the RAM 114 as a processing target. To do. When there is one response command determined to be processed, the cooperation setting unit 53 determines that the device that has transmitted the response command is placed at a position where it is detected by the touch panel 165.

  There may be a plurality of response commands that the cooperation setting unit 53 determines to be processed. For example, another user B is in the vicinity of the MFP 100 while carrying the smartphone 200B without placing it on the display surface of the display unit 161. In this case, the cooperation setting unit 53 can control the display unit 161 to select the device identification information of each of the plurality of devices that respectively transmitted the plurality of response commands in the vicinity of the position detected by the touch panel 165. Display the inquiry screen. If the user carrying the smartphone 200A selects the device identification information of the smartphone 200A according to the inquiry screen, the cooperation setting unit 53 indicates that the device previously placed at the position detected by the touch panel 165 is the smartphone 200A. The contact device information consisting of a set of device identification information of the smartphone 200A and position information indicating the position where the smartphone 200A is placed is stored in the RAM 114, and the device identification information that has not been selected is excluded from the exclusion device. The information is stored in the RAM 114 as information.

  The cooperation setting unit 53 may authenticate the user before storing the contact device information in the RAM 114. For example, the authentication information that associates the user identification information of the user who is permitted to use the MFP 100 and the device identification information of the device assigned to the user is stored in the HDD 115 in advance, and the response determined as the processing target When the authentication information including the device identification information of the device that has transmitted the command is stored in the HDD 115, the contact device information corresponding to the device that has transmitted the response command determined to be processed is stored in the RAM 114. In addition, when the authentication information including the device identification information of the device that has transmitted the response command determined as the processing target is not stored in the HDD 115, the device detection unit 41 stores the contact device information in the RAM 114 without storing the contact device information. The device identification information of the device that has transmitted the response command determined in (1) is stored in the RAM 114 as excluded device information. As a result, only the user registered in advance in MFP 100 can use MFP 100.

  The route establishment unit 43 controls the communication I / F unit 112 in response to the input of the route establishment instruction from the cooperation setting unit 53, and negotiates with the device specified by the device identification information included in the route establishment instruction. And establish a communication path. For example, when the smartphone 200A is placed on the display surface of the display unit 161 by the user A, the route establishment instruction input from the cooperation setting unit 53 includes the device identification information of the smartphone 200A. Establish a communication path between the two. When establishing a communication route with the smartphone 200A, the route establishing unit 43 stores route information including device identification information of the smartphone 200A and route identification information for identifying the communication route in the RAM 114, and also includes route information. Is output to the cooperation mode switching unit 35 and the cancellation notification unit 45. When the established communication route is disconnected, the route establishing unit 43 deletes the route information including the disconnected route identification information from the RAM 114 and outputs a disconnection signal including the route identification information to the cooperation mode switching unit 35. . The case where the communication path is disconnected includes, for example, the case where the smartphone 200A disconnects the communication path.

  When the link setting unit 53 outputs the route establishment instruction to the route establishment unit 43 and then receives the same device identification information and route identification information as the device identification information included in the route establishment instruction from the route establishment unit 43, The device specified by the device identification information included in the establishment instruction is registered in the cooperation device. When the cooperation setting unit 53 registers the cooperation device, the device identification information of the cooperation device, the position information indicating the position on the display surface of the display unit 161 of the cooperation device, and the communication path established between the cooperation device. The cooperative device information including the route identification information is stored in the RAM 114. Here, after the cooperation setting unit 53 outputs a route establishment instruction including the device identification information of the smartphone 200A, when the communication route is established in the route establishment unit 43, the cooperation setting unit 53 determines the cooperation start condition for the smartphone 200A. Is established, and the smartphone 200A is registered in the cooperation device.

  When the short-range communication unit 119 performs communication using the NFC communication method, the user A may place the smartphone 200 </ b> A on the display surface of the display unit 161 after bringing the smartphone 200 </ b> A close to the antenna of the short-range communication unit 119. . In this case, the cooperation setting unit 53 controls the communication I / F unit 112, the short-range communication unit 119, and the touch panel 165, the short-range communication unit 119 detects the smartphone 200A, and the communication I / F unit 112 communicates with the communication path. , The position where the smartphone 200A is placed is detected by the touch panel 165 within a predetermined time.

  The canceling unit 54 deletes the registration of the cooperation device when the cooperation end condition is satisfied. The cooperation end condition includes a condition that is satisfied when the cooperation device leaves the display surface of the display unit 161. When the disconnection signal is input from the device detection unit 41, the canceling unit 54 determines that the cooperation end condition is satisfied, and cancels the registration of the device specified by the device identification information included in the disconnection signal. The canceling unit 54 erases the cooperation device information including the device identification information included in the separation signal from the cooperation device information stored in the RAM 114 in response to the separation signal input from the device detection unit 41.

  The cooperation termination condition includes a condition that is satisfied when a predetermined operation input by the user is received. The cancellation unit 54 may receive a cooperation end instruction from the device-side setting unit 31 described later. Details of the cooperation end instruction will be described later. For example, when the user A instructs the end of the cooperation process, the cooperation end instruction is output from the apparatus-side setting unit 31 and includes the apparatus identification information of the smartphone 200A carried by the user A. When the cooperation end instruction is input from the apparatus side setting unit 31, the canceling unit 54 deletes the cooperation apparatus information including the device identification information included in the cooperation end instruction from the cooperation apparatus information stored in the RAM 114.

  When the release signal is input from the device detection unit 41 and the continuation signal indicating the continuation state is not input from the continuation state detection unit 51, the release unit 54 instructs the release notification unit 45 to cancel the cooperation. Output. The cooperation cancellation instruction includes device identification information included in the withdrawal signal. If the release signal is input from the device detection unit 41 and the continuation signal indicating the continuation state is input from the continuation state detection unit 51, the release unit 54 issues a maintenance instruction to the maintenance unit 47 and the restart unit. To 56. The continuation instruction includes device identification information of any one of the smartphones 200A, 200B, and 200C. Specifically, the release unit 54 receives a continuation signal including the same device identification information as the device identification information included in the detachment signal from the continuation state detection unit 51 when the detachment signal is input from the device detection unit 41. If so, the maintenance instruction is output to maintenance unit 47, resumption unit 56 and maintenance notification unit 46.

  The cancellation notification unit 45 refers to a set of device identification information and path identification information input from the path establishment unit 43 in response to the input of the collaboration cancellation instruction, and includes device identification information included in the cooperation cancellation instruction. And identifying the end of the cooperation process to the smartphone 200A via the identified route identification information. Thereby, the user A can end the cooperation between the MFP 100 and the smartphone 200A, and can confirm that the cooperation is ended on the smartphone 200A.

  The maintenance notifying unit 46 refers to a set of device identification information and route identification information input from the route establishing unit 43 in response to the maintenance instruction being input, and sets the device identification information and the set included in the maintenance instruction. The route identification information to be identified is identified, and the smartphone 200A is notified that the cooperation processing has been maintained via the identified route identification information. Thereby, the user A can confirm on the smartphone 200A that the cooperation between the MFP 100 and the smartphone 200A is completed but the cooperation is maintained.

  After the maintenance instruction is input from the cancellation unit 54, the resuming unit 56 outputs a restoration instruction to the restoration unit 49 when the cooperation resumption condition is established for the device identification information included in the maintenance instruction. The return instruction includes device identification information included in the maintenance instruction. The resume unit 56 outputs the return instruction to the return unit 49, and then registers the device specified by the device identification information included in the return instruction in the cooperation device in response to the return completion signal input from the return unit 49. To do. Specifically, the resuming unit 56 stores, in the RAM 114, cooperation device information including device identification information of the cooperation device and route identification information of a communication path established with the cooperation device. Note that the cooperation device information does not include position information when the cooperation device is not placed on the display surface of the display unit 161.

  The cooperation restart condition is different from the cooperation start condition. The cooperation restart condition includes a condition in which the device specified by the device identification information included in the maintenance instruction and the MFP 100 that is the self device change from the first relative position to the second relative position. The resume unit 56 outputs the device identification information included in the maintenance instruction to the relative position detection unit 55 in response to the maintenance instruction input from the release unit 54. The relative position detection unit 55 detects the relative position between the device specified by the device identification information input from the resumption unit 56 and the own device, and outputs the detected relative position to the resumption unit 56. The resuming unit 56 determines that the cooperation resuming condition is satisfied when the relative position detecting unit 55 detects the second relative position after the relative position detecting unit 55 detects the first relative position. Here, a case where the device identification information included in the maintenance instruction input from the release unit 54 to the resuming unit 56 is the device identification information of the smartphone 200A will be described as an example.

<First Specific Example of Relative Position Detection Unit>
Smartphone 200 </ b> A detects the current position based on radio waves received by GPS receiver 210 from GPS satellites. The relative position detection unit 68 acquires the current position of the smartphone 200 </ b> A from the smartphone 200 </ b> A and outputs it to the resuming unit 56. The relative position detection unit 55 determines the distance between the smartphone 200A and the MFP 100A as a relative position from the current position of the smartphone 200A and the position where the MFP 100A is disposed, and outputs the determined relative position to the resumption unit 56 To do.

  The resuming unit 56 determines that the cooperative resumption condition is satisfied when the distance from the smartphone 200A changes from the first relative position larger than the predetermined threshold T to the second relative position smaller than the threshold T. . When the resuming unit 56 detects the first relative position with the smartphone 200A and then receives the disconnection signal from the route establishing unit 43 and then detects the second relative position with the smartphone 200A, the cooperation resumption condition is Judge that it was established.

  The resuming unit 56 may determine that the cooperation resumption condition is satisfied when the second relative position is shorter than the distance from the first relative position to the smartphone 200A at the first relative position. Good.

<Second Specific Example of Relative Position Detection Unit>
When the MFP 100 includes a human body communication unit that communicates using a human body as a medium separately from the communication I / F unit 112, the path establishing unit 43 may control the human body communication unit to communicate with the smartphone 200A. The human body communication unit can communicate with the smartphone 200A when the user contacts the antenna of the human body communication unit. When the user A does not contact the antenna of the human body communication unit, the human body communication unit cannot communicate with the smartphone 200A. When the human body communication unit cannot communicate with the smartphone 200A specified by the device identification information included in the maintenance instruction input from the release unit 54, the relative position detection unit 55 is configured so that the smartphone 200A has the antenna of the human body communication unit. When the human body communication unit can communicate with the smartphone 200A without being in the laid range, the smartphone 200A exists in the range where the antenna of the human body communication unit is laid. The relative position detection unit 55 detects the first relative position with the smartphone 200A when the human body communication unit cannot communicate with the smartphone 200A, and the relative position detection unit 55 with the smartphone 200A when the human body communication unit can communicate with the smartphone 200A. The relative position of 2 is detected.

<Third Specific Example of Relative Position Detection Unit>
You may make it detect the smart phone 200A using the position of the user A managed in the entrance / exit management system which manages a user's entrance / exit. In this case, MFP 100A is installed in a work room managed by an entry / exit management system, and each of a plurality of users carries a unique IC tag.

  The entrance / exit management system includes a memory storing user identification information for identifying the owner of the IC tag and a tag reading unit for reading the IC tag. When entering the work room, the user brings his / her IC tag close to or in contact with the tag reading unit of the entrance / exit management system. The tag reading unit detects the user entering the room by reading the proximity or contacted IC tag, and specifies user identification information for identifying the owner of the IC tag. Further, when the user leaves the work room, the user brings his / her IC tag close to or in contact with the tag reading unit of the entrance / exit management system. The tag reading unit detects the user leaving the room by reading the proximity or contacted IC tag.

  The relative position detection unit 55 acquires the position of the work room and the user identification information of the user who has entered the work room from the entrance / exit management system. The relative position detection unit 55 acquires the position of the work room and the user identification information of the user who has left the work room from the entrance / exit management system. Relative position detection unit 55 identifies a user existing in the work room in which MFP 100 is arranged based on the combination of the work room position and user identification information acquired from the entrance / exit management system. Detect the smartphone you carry.

  For example, when the MFP 100A is arranged in the work room A, the relative position detection unit 55 acquires the position of the work room A and the user identification information of the user A as the user who has entered the work room from the entrance / exit management system. Accordingly, the second relative position between MFP 100 and smartphone 200A carried by user A is detected. The relative position detection unit 55 is a smartphone carried by the MFP 100 and the user A in response to the acquisition of the position of the work room A and the user identification information of the user A as the user who has left the work room from the entrance / exit management system. A first relative position with respect to 200A is detected. In other words, the relative position detection unit 68 detects a first relative position where the smartphone 200A does not exist in the work room A in which the MFP 100 is installed and a second relative position where the smartphone 200A exists in the work room A. .

<Fourth Specific Example of Relative Position Detection Unit>
The MFP 100 may be provided with a function for image authentication of the user A existing around the MFP 100, and the smartphone 200A may be detected using the authentication result. The MFP 100 includes a camera that includes the periphery of the MFP 100 at an angle of view, and when the user A enters the angle of view of the camera, the camera authenticates the user A based on an image that the user A captures and outputs as a subject.

  When the relative position detection unit 55 does not authenticate the user A who carries the smartphone 200A, the relative position detection unit 55 detects the first relative position where the smartphone 200A does not exist in the imaging range of the camera included in the MFP 100, and successfully authenticates the user A. The second relative position where the smartphone 200 </ b> A exists in the imaging range of the camera included in the MFP 100 is detected.

<Fifth Specific Example of Relative Position Detection Unit>
The short-range communication unit 119 has a predetermined communicable distance. When the short-range communication unit 119 cannot communicate with the smartphone 200A, the relative position detection unit 55 detects the first relative position where the smartphone 200A exists outside the range where the short-range communication unit 119 can communicate with the MFP 100. . When the near field communication unit 119 can communicate with the smartphone 200A, the relative position detection unit 55 detects a second relative position where the smartphone 200A exists within a range in which the near field communication unit 119 can communicate from the MFP 100.

  The cooperation resumption condition includes a condition that is satisfied when a predetermined operation input by the user is received. After the maintenance instruction is input from the release unit 54, the resuming unit 56 receives device identification information included in the maintenance instruction, for example, when the smartphone 200A receives an operation instructing resumption by the user A who operates the smartphone 200A. You may make it judge that cooperation resumption conditions are satisfied. When a button to which an operation for instructing resumption is assigned is displayed on the display unit 206 included in the smartphone 200A and the operation unit 207 accepts an operation for instructing the button, it is determined that the cooperation resumption condition is satisfied. In this case, MFP 100 is notified that an operation for instructing resumption has been received from smartphone 200A, and resuming unit 56 determines that the cooperation resumption condition has been established by the notification from smartphone 200A. Note that the operation that the user A inputs to the smartphone 200A is not limited to pressing the button to which the operation for instructing resumption is assigned, and if the operation can be detected by the smartphone 200A, for example, the smartphone 200A is held in the hand. And may be an operation of tapping the display surface of the display unit 206.

  The operation region determination unit 37 determines the operation region on the display surface of the display unit 161 in response to input of the cooperation device information of the cooperation device and the operation mode information indicating the cooperation mode from the cooperation mode switching unit 35. Specifically, the operation area determination unit 37 determines an area within a predetermined range from the position specified by the position information included in the cooperation apparatus information as an operation area corresponding to the apparatus identification information included in the cooperation apparatus information. To do. Here, since the display surface of the display unit 161 is rectangular, among the four regions obtained by dividing the display surface into four equal parts by diagonal lines, the region including the position specified by the position information included in the cooperation device information is determined as the operation region. To do. When determining the operation region, the operation region determination unit 37 stores operation region information including device identification information of the cooperation device and region identification information for identifying the operation region in the RAM 114. Further, when the operation area information is stored in the RAM 114, the operation area determination unit 37 outputs the operation area information to the maintenance unit 47 and outputs a registration instruction including the operation area information to the user management unit 39.

  When the cooperation device information of the cooperation device and the operation mode information indicating the single mode are input from the cooperation mode switching unit 35, the operation area determination unit 37 sets the cooperation device specified by the device identification information included in the cooperation device information. Free the associated operation area. Specifically, the operation region determination unit 37 receives the cooperation device information and the operation mode information of the single mode from the cooperation mode switching unit 35, and among the operation region information stored in the RAM 114, the cooperation device. The operation area information including the device identification information included in the information is deleted, and a deletion instruction including the operation area information is output to the user management unit 39.

  User management unit 39 manages users who use MFP 100. In response to the registration instruction input from the operation area determination unit 37, the user management unit 39 identifies a user who uses the cooperation device specified by the device identification information based on the device identification information included in the registration instruction. To do. A table in which a user and a device assigned to the user are associated in advance may be prepared. The user management unit 39 associates the identified user with the operation area. Specifically, user information including the user identification information of the identified user and the area identification information input from the operation area determination unit 37 is stored in the RAM 114 and output to the apparatus side setting unit 31.

  In response to the deletion instruction input from the operation area determination unit 37, the user management unit 39 identifies the user based on the device identification information included in the deletion instruction, and selects the operation area associated with the identified user. Open. Specifically, the user management unit 39 erases user information including user identification information of the identified user from the RAM 114.

  Of the four areas on the display surface of the display unit 161, there may be an unused area that is not assigned to any user by the user management unit 39. When the touch panel 165 detects an operation instructing an unused area, the user management section 39 displays the login screen only in the display section 161 in the setting area, and the authentication information input by the user to the touch panel 165 is authentic. Identify and authenticate users. When authenticating the user, the user management unit 39 associates the authenticated user with the operation area. Specifically, user information including user identification information of the identified user and area identification information for identifying an unused area designated by the user is stored in the RAM 114 and output to the apparatus setting unit 31. To do.

  Further, when detecting a logout operation input by the authenticated user, the user management unit 39 releases an operation area associated with the authenticated user. Specifically, the user management unit 39 erases user information and operation area information including user identification information of the authenticated user from the RAM 114.

  The device-side execution unit 33 can execute a plurality of types of processing. The plurality of types of processing that can be executed by the apparatus-side execution unit 33 includes document reading processing, image formation processing, data transmission / reception processing, facsimile transmission / reception processing, and data management processing. Processing that can be executed by the apparatus-side execution unit 33 includes processing that combines at least two of document reading processing, image formation processing, data transmission / reception processing, facsimile transmission / reception processing, and data management processing. Note that the processing that can be executed by the apparatus-side execution unit 33 is not limited to these, and may be smaller or may include more types of processing.

  The document reading process is a process of storing image data obtained by reading a document with the document reading unit 130 in the RAM 114. The setting values used to execute the document reading process include the document reading surface, whether the document is color or monochrome, reading resolution, image quality, density, presence or absence of stamp or page printing, and a frame for deleting the periphery of the scanned image. This includes the presence / absence of image processing such as erasing and sharpening, the file format and name of image data stored in the RAM 114, the size of the document, the number of documents, and the type of document. The types of originals include book originals indicating the presence or absence of different-size originals and the formation of a plurality of pages.

  The image forming process is a process for causing the image forming unit 140 to form an image on a sheet supplied from the sheet feeding unit 150. The setting values used to execute the image forming process include, for example, color and monochrome, paper size, paper type, number of copies, paper feed tray designation, presence / absence of post-processing, image forming surface (single side Or both sides) and the orientation of the document. The presence / absence of post-processing includes the presence / absence of sorting, stapling, punching, and the like.

  The data transmission / reception process is a process of receiving data from a computer connected to a network via the communication I / F unit 112, or data stored in the HDD 115 or the external storage device 117 via the communication I / F unit 112. This is a process to send to a computer connected to the network. The setting values used for executing the data transmission / reception processing include, for example, data resolution, color and monochrome, and file format.

  The facsimile transmission / reception process is a process for transmitting an image of facsimile data to the facsimile unit 116 or a process for receiving an image of facsimile data from the outside. The setting values used for executing the facsimile transmission / reception process include, for example, a setting of a facsimile line, a setting value for designating a transmission time, a password, and an F code.

  Data management processing includes processing for storing data in the HDD 115 or the external storage device 117, processing for changing or deleting data stored in the HDD 115 or the external storage device 117, and data stored in the HDD 115 or the external storage device 117. Is a process of selecting one or more as processing targets. The process of changing data includes a process of editing data and a process of changing the format. The setting values used to execute the data management process are, for example, a folder name when creating a folder in the HDD 115, a password set for the folder, a search character string for searching for data, a folder type, a document Deletion time, etc.

  The device-side setting unit 31 uses one or more of a plurality of types of processing that can be executed by the device-side execution unit 33 based on an operation input by the user on the touch panel 165, and a setting value used to execute one or more processing. And set. The device-side setting unit 31 receives user information from the user management unit 39. The user information is information associating the user with the operation area, and includes user identification information and area identification information.

  When the touch panel 165 receives an instruction from the user, the device-side setting unit 31 refers to the user information and determines the subject of the received operation. Specifically, the device-side setting unit 31 specifies an operation area that includes a position detected by the touch panel 165, refers to user information, and specifies a user associated with the specified operation area. The device-side setting unit 31 accepts an operation accepted by the touch panel 165 as a device by a specified user. In addition, when displaying the operation screen based on the operation by the user, the device-side setting unit 31 refers to the user information and displays the operation screen in the operation area assigned to the user. The operation screen includes a screen for selecting one of a plurality of types of processing that can be executed by the apparatus-side execution unit 33, and a screen for setting a setting value used for executing the selected processing. Including. Here, a case where user A inputs an operation to touch panel 165 will be described as an example.

  The device-side setting unit 31 sets a process to be executed by the device-side execution unit 33 and a setting value for the device-side execution unit 33 to execute the process according to an operation input by the user on the touch panel 165. Are output to the apparatus side execution unit 33, the maintenance unit 47, and the continuation state detection unit 51.

  The device-side execution unit 33 receives device identification information and an operation mode signal from the cooperation mode switching unit 35. The operation mode signal indicates either the interlock mode or the single mode. The device-side execution unit 33 includes a device-only execution unit 65 that executes processing in the single mode and a device-side cooperation processing execution unit 67 that executes processing in the cooperation mode. The device single execution unit 65 and the device side cooperation processing execution unit 67 can execute a plurality of types of processing that can be executed by the device side execution unit 33. Hereinafter, the processing executed by the device single execution unit 65 is referred to as device single processing, and the processing executed by the device side cooperation processing execution unit 67 is referred to as device side processing.

  The apparatus-side execution unit 33 receives process identification information, a set value, and region identification information from the apparatus-side setting unit 31, and receives cooperation apparatus information and an operation mode signal from the cooperation mode switching unit 35. The device-side execution unit 33 determines the operation mode from the area identification information input from the device-side setting unit 31 and the cooperation device information input from the cooperation mode switching unit 35. Among the cooperation device information input from the cooperation mode switching unit 35, the cooperation device information including the area identification information input from the device side setting unit 31 is determined, and input from the cooperation mode switching unit 35 together with the determined cooperation device information. The operation mode signal to be determined is determined. When the determined operation mode signal indicates the cooperation mode, the device-side execution unit 33 sets the device-side cooperation processing execution unit 67 to be valid and sets the device-only execution unit 65 to be invalid. The device-side execution unit 33 includes region identification information input from the device-side setting unit 31 in the cooperation device information input from the cooperation mode switching unit 35 when the determined operation mode signal indicates the single mode. When the cooperation device information does not exist, the device single execution unit 65 is set to be valid, and the device side cooperation processing execution unit 67 is set to be invalid.

  The device-side cooperation processing execution unit 67 specifies the cooperation device specified by the device identification information included in the determined cooperation device information when being effectively set by the device-side execution unit 33, and from the device-side setting unit 31. Based on the input process identification information and the set value, the apparatus side process specified by the process identification information is executed according to the set value in cooperation with the specified cooperative apparatus. For example, when the smartphone 200A is specified as the cooperation device, the device-side processing set by the device-side setting unit 31 is executed according to the device-side setting value in cooperation with the smartphone 200A. Specifically, the device side cooperation processing execution unit 67 executes the device side processing in synchronization with the mobile side processing executed on the smartphone 200A. For example, the apparatus side cooperation process execution part 67 acquires the execution state of the portable side process performed with the smart phone 200A from the smart phone 200A, and performs an apparatus side process. When the device-side processing is executed before the mobile-side processing, the device-side processing is executed after confirming that the mobile-side processing can be executed by the smartphone 200A. When the device-side processing is executed after the mobile-side processing, the device-side processing is executed after confirming that the mobile-side processing has ended on the smartphone 200A.

  When the device-side processing is executed by the device-side cooperation processing execution unit 67, the device-side setting unit 31 deletes the device-side setting value and outputs a cooperation end instruction to the cancellation unit 54. Further, for example, when the device-side setting unit 31 detects an operation instructing the user A to end the setting of the cooperation process, the device-side setting unit 31 outputs a cooperation end instruction to the release unit 54. The cooperation end instruction includes device identification information of the smartphone 200A carried by the user A.

  The device single execution unit 65 executes device single processing specified by the process identification information based on the process identification information and the set value input from the device side setting unit 31 according to the set value.

  FIG. 5 is a diagram illustrating an example of the operation screen. Referring to FIG. 5, operation screen 300 is displayed in a partial area including the position where smartphone 200 </ b> A is placed on the display surface of display unit 161. The operation screen 300 includes a single area 301 effective in the single mode, a setting value area 303 in which a setting screen for setting a setting value is displayed, and a cooperation area 305 effective in the cooperation mode. In addition, the dotted line in the figure is attached to distinguish the single area 301, the set value area 303, and the cooperation area 305, and does not actually exist. In order to distinguish the single area 301, the setting value area 303, and the cooperation area 305, a boundary line may be attached to the operation screen 300, and the background colors of the single area 301, the setting value area 303, and the cooperation area 305 are changed. It may be different.

  The single area 301 can accept an operation by the user when the operation mode is the single mode. The single area 301 includes a plurality of buttons for selecting device single processing. Here, a plurality of buttons are a button for selecting a document reading process and an image forming process in which the characters “copy” are displayed, and a button for selecting a document reading process in which the characters “scan” are displayed. A button for selecting a data management process and an image forming process in which “print” characters are represented, a button for selecting a data transmission / reception process in which “send” characters are represented, and a “box” A button for selecting a data management process in which characters are represented.

  The cooperation area 305 can accept an operation by the user when the operation mode is the cooperation mode. The cooperation area 305 includes a position where the smartphone 200A is placed, and includes a plurality of buttons for selecting a mobile-side process around the area where the smartphone 200A is placed. Here, a plurality of buttons are a button for selecting a data transmission / reception process in which “Send” characters are represented, a button for selecting an image forming process in which “Print” characters are represented, and a “Box ”,“ Preview ”,“ OCR ”, and“ Edit ”, and four buttons for selecting a data management process represented respectively.

  In the setting value area 303, in the case of the single mode, a setting screen for setting the apparatus single setting value used for executing the single apparatus processing selected in the single area 301 is displayed. A setting screen for setting a device-side setting value used for executing the device-side process selected in the cooperation area 305 is displayed.

  In the single mode, the user can select an apparatus single process and set an apparatus single set value by inputting an operation to the single area 301 and the set value area 303. In the cooperation mode, the user can select an apparatus-side process and set an apparatus-side setting value by inputting an operation to the cooperation area 305 and the setting value area 303. The mobile side processing can be selected and the mobile side set value can be set by operating.

  Returning to FIG. 4, the maintenance unit 47 receives a set of process identification information, a set value, and region identification information from the apparatus side setting unit 31, and receives operation region information from the operation region determination unit 37. The maintenance unit 47 maintains the process identification information and the set value input to the operation area corresponding to the device identification information included in the maintenance instruction in response to the maintenance instruction input from the release unit 54. Specifically, the maintenance unit 47 includes device identification information included in the maintenance instruction among the operation region information input from the operation region determination unit 37 in response to the maintenance instruction input from the release unit 54. The operation area information is determined, and the operation area specified by the area identification information included in the determined operation area information is determined. The maintenance unit 47 determines a set including the region identification information of the operation region determined from the set of the processing identification information, the setting value, and the region identification information input from the apparatus side setting unit 31. The RAM 114 stores the area identification information of the selected operation area, the process identification information included in the determined set, and the maintenance information in which the side set value is associated with the apparatus identification information included in the maintenance instruction.

  The return unit 49 secures an operation area corresponding to the device identification information included in the return instruction in response to the return instruction input from the resume unit 56 and is set before the cooperation mode is canceled. Restore settings. When the return unit 49 returns to the setting that was set before the cooperation mode was canceled, the return unit 49 outputs a return completion signal to the restart unit 56. The return unit 49 includes a restart time area determination unit 59 and a restart notification unit 61. The resuming area determination unit 59 determines an operation area corresponding to the device identification information included in the return instruction in response to the return instruction input from the restart unit 56. Specifically, the resuming area determination unit 59 specifies maintenance information including the device identification information included in the return instruction from the maintenance information stored in the RAM 114. The resuming area determination unit 59 refers to the operation area information stored in the RAM 114 and is specified by the area identification information included in the specified maintenance information among the four areas on the display surface of the display unit 161. If the area is unused, that area is determined as the operation area. When the area specified by the area identification information included in the specified maintenance information is in use, the resuming area determination unit 59 selects an unused area that has not been assigned to any user by the user management unit 39. Arbitrary one is determined as an operation area. The resuming area determination unit 59 stores operation area information including the device identification information included in the return instruction and area identification information for identifying the operation area in the RAM 114 and outputs the operation area information to the resumption notification unit 61. To do. In addition, when the operation area information is stored in the RAM 114, the resuming area determination unit 59 outputs a registration instruction including the operation area information to the user management unit 39.

  In response to the input of the registration instruction from the resuming area determination unit 59, the user management unit 39 selects a user who uses the cooperation device specified by the device identification information based on the device identification information included in the registration instruction. Identifies and associates the identified user with the operation area. As a result, user information including the user identification information of the identified user and the area identification information input from the resuming area determination unit 59 is stored in the RAM 114 and output to the apparatus side setting unit 31.

  The return unit 49 further reads a set of process identification information and setting values associated with the same device identification information as the device identification information included in the return instruction from the RAM 114, and stores the operation region determined by the restart region determination unit 59. A set of region identification information, process identification information, and a set value is output to the apparatus side setting unit 31, and the apparatus side setting unit 31 is set with the process identification information and the set value. When the combination of the area identification information, the process identification information, and the set value is input from the return unit 49, the apparatus-side setting unit 31 sets the process identification information and the set value as the area identification information in order to continue the setting of the cooperation process And set as the process identification information and set value input to the operation area specified by. In addition, the apparatus-side setting unit 31 receives an operation screen for accepting a change in the process identification information and the apparatus-side setting value in response to the combination of the area identification information, the process identification information, and the setting value input from the return unit 49 Is displayed. Then, after the region information is input from the return unit 49, the apparatus-side setting unit 31 performs an operation input to the operation region specified by the region identification information included in the region information, as a user identification included in the region identification information. Accepted as an operation by the user specified by the information. Accordingly, the user can continuously set the setting value from the state set before the cooperation apparatus leaves MFP 100.

  In response to the input of the region information from the resuming region determination unit 59, the restart notification unit 61 applies a return instruction input from the restart unit 56 to the operation region specified by the region identification information included in the region information. Corresponding information corresponding to the cooperation device specified by the included device identification information is displayed, and the identification information is displayed on the cooperation device. Specifically, the communication I / F unit 112 is controlled to transmit a command for displaying the identification information on the cooperation device specified by the device identification information included in the return instruction, and the identification information is displayed on the cooperation device. The identification information is information that can identify the correspondence information. Specifically, when the correspondence information corresponding to the cooperation device is an image in which a predetermined color is determined in the first shape, the identification information is determined in the same color as the color of the correspondence information in the second shape. It is an image. The first shape and the second shape may be the same or different. When the correspondence information is an image of a predetermined character string, the identification information is an image of the same character string as the correspondence information. When the cooperation device is the smartphone 200A, the correspondence information is displayed in the operation area of the display unit 161, and the identification information is displayed on the smartphone 200A. The user A visually recognizes the correspondence information identified by the identification information displayed on the smartphone 200 </ b> A in the display surface of the display unit 161, so that the correspondence information is arranged on the display surface of the display unit 161. The operation area can be recognized.

  The restart notification unit 61 displays the correspondence information corresponding to the cooperation device when the touch panel 165 detects an operation indicating an arbitrary position in the operation area after the correspondence information corresponding to the cooperation device is displayed on the display unit 161. And the display of the identification information on the cooperation device is terminated. Specifically, an end command is transmitted to the cooperation apparatus. In addition, when the user inputs an operation to end the display of the information corresponding to the cooperation device after the cooperation device displays the information corresponding to the cooperation device on the cooperation device, the restart notification unit 61 responds to the correspondence corresponding to the cooperation device. End the information display. For example, the display of the correspondence information is ended in response to receiving an end command from the cooperation apparatus.

  The restart notification unit 61 is in other words, when the operation region determined by the restart region determination unit 59 is different from the region identification information stored in the RAM 114 in association with the device identification information included in the return instruction by the maintenance unit 47. For example, when the operation area in the current cooperation mode is different from the operation area in the previous cooperation mode, the correspondence information corresponding to the cooperation apparatus may be displayed and the identification information may be displayed on the cooperation apparatus. This is because when the operation area in the current cooperation mode is the same as the operation area in the previous cooperation mode, the user recognizes the previous operation area.

  In addition, when one or more areas other than the operation area determined by the resuming area determining unit 59 are in use, the resuming notifying unit 61 specifically, the user managing unit 39 uses the resuming area determining unit 59. When an area other than the operation area determined by the above is assigned to another user, correspondence information corresponding to the cooperation apparatus may be displayed and identification information may be displayed on the cooperation apparatus. This is because if the user is alone, the user can visually recognize the area where the operation screen is displayed.

  When the display unit 161 has a mechanism for rotating the display surface about the normal of the display surface, the maintenance unit 47 stores the direction of the display surface of the display unit 161 in association with the device identification information in the RAM 114. Thus, the restart notification unit 61 cooperates when the direction of the display surface of the display unit 161 when the region information is input from the resuming region determination unit 59 is different from the direction stored in the RAM 114 by the maintenance unit 47. The correspondence information corresponding to the device may be displayed, and the identification information may be displayed on the cooperation device. This is because the relative position of the operation area with respect to MFP 100 does not change when the display surface of display unit 161 is not rotated.

  The continuation state detection unit 51 receives device identification information and an operation mode signal from the cooperation mode switching unit 35. The operation mode signal indicates either the interlock mode or the single mode. The continuous state detection unit 51 includes a device state detection unit 73, a portable state detection unit 77, and a user setting unit 75. Device state detection unit 73 detects a continuation state based on the state of MFP 100 if an operation mode signal indicating the cooperation mode is included in the operation mode signal input from cooperation mode switching unit 35. Device state detection unit 73 outputs a continuation signal including device identification information of MFP 100 to cooperative mode switching unit 35 when MFP 100 is in the continuous state.

  Device state detection unit 73 includes a device operation detection unit 81 and an error detection unit 83. The device operation detection unit 81 sets the device identification information, the process identification information, and the device side of the smartphone 200A, 200B, or 200C from the device side setting unit 31 every time the device setting value is set by the device side setting unit 31. A set and a set value are input. The device operation detection unit 81 specifies device identification information that is paired with the operation mode signal indicating the cooperation mode based on the combination of the device identification information and the operation mode signal input from the cooperation mode switching unit 35. The device operation detection unit 81 includes the specified device identification information while the elapsed time from the last input of the processing identification information and the device setting value paired with the specified device identification information is within a predetermined time. The signal is output to the cooperation mode switching unit 35. In other words, for example, the device operation detection unit 81 performs an operation of setting a device-side setting value in the MFP 100 while the user A who operates the smartphone 200A and the MFP 100 is setting the cooperation processing. During this time, a continuation signal is output.

  Error detection unit 83 outputs a continuation signal including device identification information of MFP 100 to cooperation mode switching unit 35 while an error has occurred in the hardware resources of MFP 100. The hardware resource includes an image forming unit 140 and a paper feeding unit 150. For example, while the user A who operates the smartphone 200 </ b> A and the MFP 100 is setting the cooperation processing, an error occurs in the image forming unit 140 and the paper feeding unit 150, and the user A performs error recovery work. During this time, the error detection unit 83 outputs a continuation signal including the device identification information of the smartphone 200 </ b> A to the cooperation mode switching unit 35. The image forming unit 140 and the paper feeding unit 150 have consumables, and recover from errors if the consumables are replaced or replenished. The consumables include toner, a photosensitive drum, a developing roller, and a fixing roller in the image forming unit 140. The consumable item in the paper supply unit 150 includes paper. Further, when an error occurs in which the paper is jammed in the paper conveyance path, the error detection unit 83 can output a continuation signal including the device identification information of the MFP 100 to the cooperation mode switching unit 35 until the jammed paper is removed. . When user A, user B, and user B are operating MFP 100, a continuation signal including device identification information of each of smartphones 200A, 200B, and 200C is output.

  User setting unit 75 outputs a continuation signal including device identification information of MFP 100 to cooperation mode switching unit 35 when it is set to always be in a continuation state. Accordingly, for example, while the smartphone 200A and the MFP 100 are linked, the linkage mode can be continued even when the smartphone 200A is separated from the display surface of the display unit 161 of the MFP 100. When user A, user B, and user B are operating MFP 100, a continuation signal including device identification information of each of smartphones 200A, 200B, and 200C is output.

  The portable state detection unit 77 specifies device identification information whose operation mode signal indicates the cooperation mode. Here, a case where device identification information of smartphone 200A is specified will be described as an example. The portable state detection unit 77 detects the continuation state based on the state of the smartphone 200A specified by the specified device identification information. When the state of the smartphone 200A is the continuous state, the portable state detection unit 77 outputs a continuation signal including the device identification information of the smartphone 200A to the cooperation mode switching unit 35.

  The portable state detection unit 77 includes an application detection unit 85 and a portable operation detection unit 87. The application detection unit 85 inquires of the smartphone 200A about the application program being executed in the current state via the communication path specified by the path identification information paired with the device identification information of the smartphone 200A. The current state is a state where data can be output to the user or a state where input by the user can be accepted. For example, while the user A who operates the smartphone 200 </ b> A and the MFP 100 is setting the cooperation process, the smartphone 200 </ b> A cant execute a predetermined application program different from the application program for cooperation with the MFP 100. May be executed in The predetermined application program includes, but is not limited to, for example, an application program for calling and an application program for receiving an e-mail. This is because when the smartphone 200A receives a call, the user A may give priority to the call, and when the smartphone 200A receives an e-mail, the user A may give priority to viewing the e-mail. The portable state detection unit 77 outputs a continuation signal including the device identification information of the smartphone 200 </ b> A to the cooperation mode switching unit 35 while the smartphone 200 </ b> A is executing a predetermined application program in the current state. Thereby, when user A picks up smartphone 200A and separates it from the display surface of display unit 161 of MFP 100, the cooperation mode can be continued.

  The portable operation detection unit 87 inquires of the smartphone 200A about the operation state via the communication path specified by the path identification information paired with the device identification information of the smartphone 200A. In smart phone 200A, an application program for cooperating with MFP 100 is executed, and a continuation signal including device identification information of smart phone 200A is displayed in cooperation mode until a predetermined time elapses after user A inputs a mobile-side setting value. Output to the switching unit 35. For example, in order for the user A to determine the mobile-side setting value, the smartphone 200A may be picked up and separated from the display surface of the display unit 161 of the MFP 100 in order to examine data. Even in such a case, the cooperation mode can be continued.

  The continuation condition may be set by the user. A continuation condition setting screen for setting the continuation condition is displayed on the display unit 161, and the continuation condition is set according to an operation that the user inputs according to the continuation condition setting screen. The continuation condition is a condition for enabling at least one of the device operation detection unit 81, the error detection unit 83, the application detection unit 85, the portable operation detection unit 87, and the user setting unit 75.

  FIG. 6 is a diagram illustrating an example of the continuation condition setting screen. Referring to FIG. 6, continuation condition setting screen 310 includes an area 311 for setting whether or not to set a continuation condition, and areas 312 to 315 for setting a continuation condition. In the area 311, an item including the characters “automatic continuation of cooperation mode” is arranged on the left side, and “continue” or “do not continue” is set in the area 311. When “Continue” is set in the area 311, it is set to set the continuation condition, and the areas 312 to 315 can be set.

  The area 312 is an area for setting that a predetermined application program is being executed on the cooperation apparatus, here, the smartphone 200 </ b> A as a continuation condition. When the area 312 is instructed and marked by the user, an application program can be specified in the area 312A. In the area 312A, one or more application programs can be specified. In the smartphone 200A, the continuation condition is satisfied while the application program specified in the area 312A is being executed in the current state.

  An area 313 is an area for setting that a device-side setting value or a mobile-side setting value is being set as a continuation condition. When area 313 is instructed and marked by the user, the continuation condition is satisfied within a predetermined time after setting the apparatus-side setting value in MFP 100, and the mobile-side setting value is set in smartphone 200A. The continuation condition is satisfied within a predetermined time.

  An area 314 is an area for setting that the remaining battery level of the cooperation apparatus is equal to or less than the threshold value T as a continuation condition. When the region 314 is instructed and marked by the user, the remaining battery level of the smartphone 200A is equal to or less than the threshold value T, and the continuation condition is satisfied.

  The area 314 is set to follow a user instruction as a continuation condition. When the area 314 is instructed and marked by the user, the MFP 100 displays an inquiry screen asking whether or not to continue on the display unit 161, and the continuation condition is satisfied when the user instructs to continue. To do.

  The user can indicate and mark one or more of the areas 312-314. In other words, when one or more continuation conditions are set, the continuation condition is met if at least one of the one or more continuation conditions is met.

<First Modification of Resume Notification Unit>
The restart notification unit 61 displays the correspondence information corresponding to the cooperation device in the operation area of the display unit 161, and transmits identification information for identifying the correspondence information to the cooperation device to be displayed on the cooperation device. In this case, the user of the cooperation device can recognize the operation area on the display surface of the display unit 161 where the corresponding information displayed by the identification information displayed on the cooperation device is displayed.

  The correspondence information corresponding to the cooperation device may be information that cannot identify the cooperation device. For example, the correspondence information corresponding to the cooperation device can be only the color. In this case, if the entire operation area is displayed in the color determined by the correspondence information and the same color is displayed on the cooperation apparatus, the user of the cooperation apparatus recognizes the operation area having the same color as the color displayed on the cooperation apparatus. be able to.

<Second Modification of Resume Notification Unit>
The identification information may be an image of the entire display surface of the display unit 161 on which the correspondence information is displayed. The restart notification unit 61 displays the correspondence information corresponding to the cooperation device in the operation area of the display unit 161, and transmits the image displayed on the entire display surface of the display unit 161 to the cooperation device and displays it on the cooperation device. Let In this case, the user of the cooperation device can recognize the operation area in which the correspondence information corresponding to the cooperation device is displayed in the image displayed on the display unit 206. The correspondence information corresponding to the cooperation device may be information that can identify the cooperation device, or may be information that cannot identify the cooperation device as in the first modification.

  FIG. 7 is a diagram illustrating an example of functions of the CPU included in the smartphone according to the first embodiment. The functions illustrated in FIG. 7 are functions formed in the CPU 201 when the CPU 201 included in the smartphone 200A executes the mobile-side cooperation program stored in the flash memory 203 and the CD-ROM 211A. The mobile side cooperation program is a part of the cooperation program. Hereinafter, a task in which the CPU 201 executes the mobile-side cooperation program is referred to as a cooperation task.

  Referring to FIG. 7, CPU 201 includes communication control unit 250, portable side setting unit 251, portable side execution unit 253, continuation determination unit 255, setting value transmission unit 257, and portable side resumption notification unit 259. ,including.

  The CPU 201 executes a plurality of types of application programs. Here, at least a mobile side cooperation program, an application program that enables a telephone call, an application program that transmits and receives an e-mail, and a browsing program for browsing a web page arranged on the Internet are installed in the smartphone 200A. An example will be described. In addition, the application program installed in the smart phone 200A is not limited to these. Hereinafter, a task in which the CPU 201 executes the mobile-side cooperation program is referred to as a cooperation task, and a task in which the CPU 201 executes an application program other than the mobile-side cooperation program is referred to as an application task. Here, application programs other than the mobile-side cooperation program are an application program that enables a telephone call, an application program that transmits and receives an e-mail, and a browsing program.

  The portable side execution unit 253 can execute a plurality of types of processing. A plurality of types of processing that can be executed by the mobile-side execution unit 253 is determined by an application program installed in the smartphone 200A. The portable side execution unit 253 includes a portable single execution unit 265 and a portable side cooperation processing execution unit 267.

  The mobile-side setting unit 251 is a setting used to execute one or more of a plurality of types of processes that can be executed by the mobile-side execution unit 253 and one or more processes based on an operation input by the user to the operation unit 207. Set the value. The portable side setting unit 251 includes a portable single set value setting unit 261 and a portable side set value setting unit 263. The portable individual set value setting unit 261 and the portable individual execution unit 265 are application tasks. The portable side setting value setting unit 263, the portable side cooperation processing execution unit 267, the continuation determination unit 255, the setting value transmission unit 257, the portable side resumption notification unit 259, and the communication control unit 250 are cooperation tasks.

  Communication control unit 250 controls short-range communication unit 209 and returns a response command including device identification information of the device itself in response to receiving a search command from MFP 100. Further, communication control unit 250 controls wireless LAN I / F 208 to negotiate with MFP 100 in response to receiving a connection request from MFP 100 to establish a communication path. In the present embodiment, when user A places smartphone 200A on display surface of display unit 161 of MFP 100, MFP 100 transmits a connection request to establish a communication path. When A places the smartphone 200 </ b> A on the display surface of the display unit 161 of the MFP 100, a communication path is established.

  The portable individual set value setting unit 261 sets a portable single process executed by the portable single execution unit 265 and a portable single set value for the portable single execution unit 265 to execute the portable single process while the application task is in the current state. . The current state is a state in which an operation by a user input to the operation unit 207 can be accepted, and the non-current state is a state in which an operation by a user input to the operation unit 207 cannot be accepted. The portable individual set value setting unit 261 outputs the process identification information for identifying the set portable individual process and the portable individual set value to the portable individual execution unit 265. When the application task is in the current state and the operation unit 207 detects an operation instructing execution of the mobile single processing, the mobile single execution unit 265 sets the mobile single processing set by the mobile single setting value setting unit 261 to the mobile single setting. Execute according to the value.

  The mobile-side setting value setting unit 263 includes a mobile-side process executed by the mobile-side cooperation processing execution unit 267 and a mobile-side setting for the mobile-side cooperation processing execution unit 267 to execute the mobile-side processing when the cooperation task is in the current state. Set the value. The mobile-side set value setting unit 263 outputs a set of the process identification information for identifying the set mobile-side process and the mobile-side set value to the mobile-side cooperation process execution unit 267. When the execution of the cooperation process is instructed from the MFP 100, the portable side cooperation process execution unit 267 executes the portable side process set by the portable side setting value setting unit 263 according to the portable side setting value in cooperation with the MFP 100. . Specifically, portable side cooperation processing execution unit 267 executes portable side processing in synchronization with MFP 100. For example, the portable side cooperation process execution unit 267 acquires the execution state of the apparatus side process executed by the MFP 100 from the MFP 100 and executes the portable side process. When the mobile side process is executed before the device side process, the mobile side process is executed after confirming that the MFP 100 is ready to execute the device side process. When the mobile-side process is executed after the device-side process, the mobile-side process is executed after confirming the completion of the device-side process in the MFP 100.

  The mobile-side setting value setting unit 263 performs the mobile-side setting value when the mobile-side cooperation processing execution unit 267 executes the mobile-side processing or detects an operation instructing the user A to end the setting of the cooperation processing. Erase.

  The portable-side resume notification unit 259 displays the identification information on the display unit 206 in response to the wireless LAN I / F 208 receiving a command for displaying the identification information from the MFP 100. Further, when detecting the operation for terminating the display of the identification information after displaying the identification information, the portable-side resume notifying unit 259 terminates the display of the identification information and causes the MFP 100 to terminate the display of the correspondence information. The operation for terminating the display of the identification information is an operation for instructing an arbitrary position on the touch panel 207B, although not limited thereto. Specifically, the wireless LAN I / F 208 is controlled to transmit a command for causing the MFP 100 to end the display of the correspondence information. In addition, after displaying the identification information, the mobile-side resumption notification unit 259 terminates the display of the identification information in response to the wireless LAN I / F 208 receiving a command for terminating the display of the identification information from the MFP 100.

  FIG. 8 is a diagram illustrating an example of a data flow in the linkage system according to the first embodiment. In FIG. 8, the flow of time is shown from the top to the bottom, and the case where the MFP 100 and the smartphone 200A cooperate is shown as an example. Referring to FIG. 8, in MFP 100, when touch panel 165 and short-range communication unit 119 detect smartphone 200A, it is detected that the cooperation start condition is satisfied. At this time, the MFP 100 transmits a cooperation operation start request to the smartphone 200A. Thereby, in the smartphone 200A, a cooperation task for cooperation with the MFP 100 is started by executing the portable side cooperation program. In this case, the cooperation task returns a cooperation operation start response to MFP 100 and displays an operation screen for accepting the mobile-side setting value. At this stage, the smartphone 200A can accept and set the mobile-side setting value input by the user A.

  In MFP 100, when the cooperation operation start response is received from smartphone 200A, the operation screen shown in FIG. 5 is displayed. At this stage, the MFP 100 can accept and set a setting value for executing apparatus-side processing.

  Next, when the MFP 100 detects the end of cooperation, if the maintenance state is detected, the MFP 100 notifies the smartphone 200A of cooperation maintenance. And the operation side information including the set value set so far. The area identification division of the operation area assigned to the smartphone 200A and the device identification information of the smartphone 200A are stored, and the display of the operation screen is ended. When the smartphone 200A is notified of the maintenance of cooperation, the device identification information of the MFP 100 is stored in association with each other.

  Further, when the MFP 100 detects the cooperation restart condition, the MFP 100 transmits a restart notification to the smartphone 200A. In response to receiving the restart notification, the smartphone 200A switches the cooperation task to the current state and returns a restart response. When MFP 100 receives a restart response from smartphone 200A, MFP 100 displays an operation screen. In this case, when the area specified by the area identification information stored in association with the device identification information of the smartphone 200A is in use, the operation screen is displayed in another area and the correspondence information is displayed. Then, identification information for identifying the correspondence information is transmitted to the smartphone 200.

  When the smartphone 200A receives the identification information from the MFP 100, the smartphone 200A displays the identification information.

  Next, when the MFP 100 accepts an end operation, for example, an operation for designating an arbitrary position on the touch panel 165 as the first display end pattern, the display of the correspondence information is ended and an end command is transmitted to the smartphone 200A. When the smartphone 200A receives an end command from the MFP 100, the smartphone 200A ends the display of the identification information. Accordingly, the correspondence information is not displayed on MFP 100, and the identification information is not displayed on smartphone 200A.

  Next, when the smartphone 200A accepts an end operation, for example, an operation for designating an arbitrary position on the touch panel 207B, as the second display end pattern, the display of the identification information is ended and an end command is transmitted to the MFP 100. When MFP 100 receives the end command from smartphone 200A, MFP 100 ends the display of the correspondence information. Accordingly, the correspondence information is not displayed on MFP 100, and the identification information is not displayed on smartphone 200A.

  FIG. 9 is a flowchart illustrating an example of the flow of cooperation processing in the first embodiment. The cooperation process is a process executed by the CPU 111 when the CPU 111 included in the MFP 100 executes the cooperation program stored in the ROM 113, the HDD 115, and the CD-ROM 118. Referring to FIG. 9, CPU 111 executes a cooperation start condition detection process (step S01).

  FIG. 10 is a flowchart illustrating an example of the flow of the cooperation start condition detection process. Referring to FIG. 10, CPU 111 determines whether or not the display surface of display unit 161 is instructed (step S31). Specifically, when the touch panel 165 is controlled to detect a position where the object touches the touch panel 165, it is detected that the display surface of the display unit 161 is instructed. If the display surface of display unit 161 is instructed, the process proceeds to step S32. If not, the process returns to the cooperation process.

  In step S32, it is determined whether or not the area of the area where the display surface of display unit 161 is designated is equal to or larger than a predetermined size. The predetermined size is preferably the upper limit of the area of the user's finger. This is for distinguishing between an instruction by a human finger and an instruction by placing the smartphone 200A. If the area of the area where the display surface of display unit 161 is designated is equal to or larger than the predetermined size, the process proceeds to step S33; otherwise, the process proceeds to step S45. In step S45, the operation area is specified, and the process proceeds to step S46. Of the four areas of the display surface of the display unit 161, an area including the position detected by the touch panel 165 is specified as the operation area. In step S46, it is determined whether or not a user is assigned to the specified operation area. If the user is assigned and enters, the process proceeds to step S47; otherwise, the process proceeds to step S48. In step S47, an operation is detected based on the position detected by touch panel 165, and the process returns to the return process. In step S48, it is determined whether the user has been successfully authenticated. If a login screen is displayed in the operation area and authentic authentication information is input in the operation area, it is determined that the authentication is successful. If the authentication is successful, the process proceeds to step S49; otherwise, the process proceeds to step S50. In step S49, an authenticated user is assigned to the operation area, and the process returns to the cooperation process. In step S50, an error is set, and the process returns to the cooperation process.

  In step S33, the short-range communication unit 119 is controlled to transmit a search command. One or more of the smartphones 200A, 200B, and 200C that exist in a range that can communicate with the short-range communication unit 119 each returns a response command including the device identification information of the device itself in response to receiving the search command. Smartphones 200A, 200B, and 200C, which are devices that are placed on the display surface of the display unit 161 and that are not registered as cooperation devices, devices that are not placed on the display surface of the display unit 161, and display units A device that is placed on the display surface 161 but is already registered in the cooperation device may return a response command. Hereinafter, a device that returns a response command is referred to as a candidate device. For this reason, in the next step S34, the cooperation device and the exclusion device are excluded from the candidate devices. The exclusion device is a device registered as an exclusion device in step S39 described later. A cooperation apparatus is an apparatus registered as a cooperation apparatus in step S43 mentioned later. In the next step S35, it is determined whether there is a candidate device. If a candidate device exists, the process proceeds to step S36; otherwise, the process proceeds to step S44. In step S44, an error is set, and the process returns to the cooperation process.

  In the next step S36, it is determined whether or not there are a plurality of candidate devices. If there are a plurality of candidate devices, the process proceeds to step S37; otherwise, the process proceeds to step S40. In step S40, when the process proceeds from step S36, one candidate device is specified, and the process proceeds to step S41.

  The process proceeds to step S37 when there are a plurality of candidate devices. In step S37, a candidate selection screen for selecting one of the plurality of candidate devices is displayed on display unit 161, and the process proceeds to step S38. The position for displaying the candidate selection screen is in the vicinity of the position detected by the touch panel 165 in step S31. In step S38, the process waits until one of the plurality of candidate devices is selected (NO in step S38). If one is selected (YES in step S38), the process proceeds to step S39. In step S39, all of one or more candidate devices not selected from among the plurality of candidate devices are registered in the exclusion device, and the process proceeds to step S40.

  In step S40, when the process proceeds from step S39, the candidate device selected in step S38 is specified, and the process proceeds to step S41. In step S41, the communication I / F unit 112 is controlled to establish a communication path with the candidate device specified in step S40, and the process proceeds to step S42.

  In step S42, an area including the position detected by touch panel 165 in step S31 is determined as the operation area among the four areas included in the display surface of display unit 161 as the candidate area specified in step S40, and the process is performed. Advances to step S43. In step S43, the candidate device is determined as the cooperation device, and the process returns to the cooperation processing. Specifically, the operation area information including the apparatus identification information of the candidate apparatus and the area identification information for identifying the operation area determined in step S42 is stored in the RAM 114.

  Returning to FIG. 9, in step S <b> 02, it is determined whether or not the cooperation start condition is satisfied as a result of executing the cooperation start condition detection process in step S <b> 01. If the cooperation start condition is satisfied, the process proceeds to step S03; otherwise, the process proceeds to step S05. When the cooperation start condition is satisfied by executing the cooperation start condition detection process, a cooperation device is determined. Therefore, if a new cooperative device has been determined, the process proceeds to step S03. If not, the process proceeds to step S05. Here, a case where the user A places the smartphone 200 </ b> A on the display surface of the display unit 161 will be described as an example. In this case, the smartphone 200A is registered in the cooperation device, and the device identification information of the smartphone 200A and the position identification information indicating the position where the smartphone 200A is placed on the display surface of the display unit 161 are temporarily stored in the RAM 114.

  In step S03, the cooperation device is registered, and the process proceeds to step S04. Specifically, among the four areas of the display surface of the display unit 161, an operation area including a position where the cooperation apparatus is placed is assigned to a user who operates the cooperation apparatus. Specifically, it is specified by the user identification information of the user registered as a user who operates the cooperation device and the position information associated with the device identification information of the cooperation device among the four areas of the display surface of the display unit 161. A set of the region identification information of the operation region including the position to be stored is stored in the RAM 114. In step S04, the operation mode is switched to the cooperation mode, and the process proceeds to step S09.

  In step S05, it is determined whether or not an operation is specified as a result of executing the cooperation start condition detection process in step S01. When the position detected by the touch panel 165 is detected, it is determined that the operation input by the user has been specified. If an operation is specified, the process proceeds to step S06; otherwise, the process proceeds to step S08.

  In step S06, an acceptance control process is executed, and the process proceeds to step S08. Although details of the reception control process will be described later, this is a process of determining an operation by the user A based on the position detected in step S01 and executing a process determined by the determined operation.

  In step S07, it is determined whether or not an error is determined as a result of executing the cooperation start condition detection process in step S01. If an error is determined, the process returns to step S01; otherwise, the process proceeds to step S08.

  In step S08, a cooperation end condition detection process is executed, and the process proceeds to step S09. The cooperation end condition detection process is a process for determining whether or not a cooperation end condition is satisfied. Here, the cooperation end condition is a case where the cooperation device, for example, the smartphone 200 </ b> A leaves the display surface of the display unit 161. For this reason, when a cooperation apparatus leaves | separates from the display surface of the display part 161, it determines that the cooperation completion conditions with respect to 200 A of smartphones were satisfied. When the smartphone 200 </ b> A is registered in the cooperation device, the device identification information of the smartphone 200 </ b> A is associated with position information indicating a position on the display surface of the display unit 161. When the touch panel 165 does not detect an instruction at the position specified by the position information associated with the smartphone 200 </ b> A, it is determined that the smartphone 200 </ b> A has left the display surface of the display unit 161. In the next step S09, it is determined whether or not the cooperation end condition is satisfied as a result of the cooperation end condition detection process. If the cooperation termination condition is terminated, the process proceeds to step S10. If not, the process proceeds to step S11.

  In step S10, the operation mode corresponding to the cooperation device in which the cooperation end condition is detected, here, the smartphone 200A is switched to the single mode, and the process proceeds to step S11. In step S11, a continuation state detection process is executed, and the process proceeds to step S12. Although details of the continuation state detection process will be described later, this is a process for detecting the continuation state. In step S12, it is determined whether a continuation state is detected. If a continuation state is detected, the process proceeds to step S13. If not, the process proceeds to step S15. In step S13, the device side information corresponding to the cooperation device is stored in the RAM 114 in association with the device identification information of the cooperation device, and the process proceeds to step S14.

  In step S14, the cooperation device in which the cooperation end condition is detected is deleted from the cooperation device, and the process proceeds to step S15. In step S15, a cooperation restart condition detection process is executed, and the process proceeds to step S16. Although details of the cooperation resumption condition detection process will be described later, it is determined whether or not the cooperation resumption condition is established for the device in which the device identification information is stored in the RAM 114 in association with the device side information and the mobile side information. It is processing. In step S16, it is determined whether or not the cooperation resumption condition is satisfied as a result of executing the cooperation resumption condition detection process. If the cooperation restart condition is satisfied, the process proceeds to step S17. If not, the process returns to step S01.

  In step S17, the operation mode corresponding to the device for which the cooperation restart condition is satisfied is switched to the cooperation mode, and the process proceeds to step S18. In step S18, the device for which the cooperation restart condition is satisfied is registered in the cooperation device, and the process proceeds to step S19. In step S19, the cooperation apparatus is notified of resumption, and the process proceeds to step S20. In step S20, a return process is executed, and the process returns to step S01. Details of the return processing will be described later.

  FIG. 11 is a flowchart illustrating an example of the flow of cooperative resumption condition detection processing. The cooperation restart condition detection process is a process executed in step S16 of FIG. Referring to FIG. 11, CPU 111 identifies a target device to be processed (step S71). A device whose device identification information is stored in the RAM 114 in association with the device-side information is specified as a target device. In step S <b> 15 of FIG. 9, the RAM 114 stores a set of device identification information and device side information of the cooperation device in the RAM 114. One of the one or more sets stored in the RAM 114 is selected, and the device specified by the device identification information included in the selected set is specified as the target device. Here, a case where the smartphone 200A is specified as a target device will be described as an example.

  In step S72, the flag is set to “0”, and the process proceeds to step S73. The flag indicates whether or not the first relative position is detected. When the flag is set to “1”, the flag indicates that the first relative position is detected. When the flag is set to “0”, the flag indicates the first relative position. The relative position of is not detected. The first relative position and the second relative position differ depending on the first to fifth specific examples of the relative position detection unit described above. Here, the case of the first specific example will be described as an example. In the case of the first specific example, the first relative position is a case where the distance between the MFP 100 and the smartphone 200 </ b> A that is the target device is equal to or greater than the threshold T, and the second relative position is the MFP 100 and the target device. This is a case where the distance to the smartphone 200A is shorter than the threshold value T.

  In step S73, a relative position with respect to the target device is detected. Then, it is determined whether or not the relative position detected in step S73 is the first relative position (step S74). If it is the first relative position, the process proceeds to step S75; otherwise, the process proceeds to step S76. Here, if the distance to smartphone 200A is equal to or greater than threshold value T, the process proceeds to step S74. In step S75, the flag is set to “1” and the process returns to the cooperation process.

  In step S76, it is determined whether or not the relative position detected in step S73 is the second relative position. If it is the second relative position, the process proceeds to step S77; otherwise, the process proceeds to step S78. Here, if the distance to smartphone 200A is shorter than the threshold value, the process proceeds to step S78. In step S77, it is determined whether or not “1” is set in the flag. If “1” is set in the flag, the process proceeds to step S79; otherwise, the process returns to the cooperation process. When the flag is set to “1”, since the first relative position is detected, it indicates that the relative position between the MFP 100 and the smartphone 200A has changed from the first relative position to the second relative position. If so, the process proceeds to step S80.

  In step S79, when the process proceeds from step S77, a cooperation resumption condition for the smartphone 200 that is the target device is detected, and the process returns to the cooperation process.

  In step S78, it is determined whether a restart operation has been received from smartphone 200A that is the target device. When the smartphone 200A displays a button to which a resume operation is assigned, and the smartphone 200A detects an operation instructing the button, the smartphone 200A transmits the resume instruction operation to the MFP 100. If communication I / F unit 112 receives a restart instruction operation from smartphone 200A as the target device, the process proceeds to step S79. If not, the process returns to the cooperation process.

  In step S79, when the process proceeds from step S77 or step S78, the cooperation restart condition for the smartphone 200 that is the target device is detected, and the process returns to the cooperation process.

  FIG. 12 is a flowchart illustrating an example of the flow of return processing. The return process is a process executed in step S20 of FIG. In step S18 before the return process is executed, the device registered in the cooperation device is specified. Here, a case where the smartphone 200A is registered in the cooperation device will be described as an example. Referring to FIG. 12, CPU 111 reads device side information associated with device identification information of smartphone 200 </ b> A from RAM 114 into RAM 114 (step S <b> 51). When step S13 of FIG. 9 is executed, device-side information is stored in the RAM 114 in association with the device identification information of the smartphone 200A that is the cooperation device. In step S52, a device-side setting value included in the device-side information associated with the device identification information of smartphone 200A that is the cooperation device is set, and the process proceeds to step S53.

  In step S53, an operation area corresponding to the device identification information of the smartphone 200A that is the cooperation device is determined. Specifically, referring to the maintenance information stored in the RAM 114, the maintenance information including the device identification information of the smartphone 200A that is the cooperation device is determined from the four areas on the display surface of the display unit 161. Next, referring to the user information stored in the RAM 114, it is determined whether or not the area specified by the area identification information included in the determined maintenance information is unused. If it is unused, the area specified by the area identification information included in the maintenance information is determined as the operation area. When the area specified by the area identification information included in the determined maintenance information is not used and is being used, the resuming area determination unit 59 has not been assigned to any user by the user management unit 39. Any one of the used areas is determined as the operation area. Specifically, an unused area is specified with reference to the user information.

  In the next step S54, it is determined whether or not the determined operation area is the same as the previous operation area. If the region identification information included in the maintenance information is the same as the region identification information of the operation region determined in step S53, it is determined that the same operation region as the previous operation region has been determined. If the operation area is the same as the operation area, the process proceeds to step S55; otherwise, the process proceeds to step S56. In step S55, an operation screen is displayed in the operation area determined in step S53, and the process returns to the cooperation process.

  In step S56, correspondence information is displayed in the operation area determined in step S53. Then, identification information for identifying the correspondence information is transmitted to the smartphone 200 </ b> A that is the cooperation device (step S <b> 57). In the next step S58, it is determined whether an end operation has been accepted. When touch panel 165 detects that an arbitrary position in the operation area is designated, an end operation is accepted. If an end operation has been accepted, the process proceeds to step S60; otherwise, the process proceeds to step S59.

  In step S59, an end command is transmitted to the cooperation apparatus, and the process proceeds to step S60A. In step S60, it is determined whether an end command has been received from smartphone 200A that is the cooperation device. If an end command is received, the process proceeds to step S60A. If not, the process returns to step S58. In step S60A, the display of the correspondence information displayed in step S56 is terminated, the operation screen is displayed in the operation area determined in step S53, and the process returns to the cooperation process.

  FIG. 13 is a flowchart illustrating an example of the flow of reception control processing. The acceptance control process is a process executed in step S06 in FIG. The position designated by the user A is detected by the touch panel 165 before the reception control process is executed. Referring to FIG. 13, CPU 111 determines an operation based on the position detected by touch panel 165 (step S61). Based on the position detected by the touch panel 165 in a state where the operation screen is displayed on the display unit 161, the position in the operation screen is specified and the operation is determined. When the operation screen includes a button to which an operation is assigned and the position in the button is specified, the operation assigned to the button is determined. For example, when the operation screen is a keyboard and the position in the key is specified, an operation for inputting an alphanumeric character assigned to the key is determined. Further, when the operation screen includes an execution key to which an execution instruction operation for instructing execution of the process is assigned, and the position in the execution key is specified, the execution instruction operation is determined.

  In the next step S62, the process branches depending on the operation mode. If the operation mode is the cooperation mode, the process proceeds to step S63. If the operation mode is the single mode, the process proceeds to step S68.

  In step S63, it is determined whether or not the operation determined in step S61 is an execution instruction operation. If it is an execution instruction operation, the process proceeds to step S64; otherwise, the process proceeds to step S67. In step S67, a setting value is set according to the determined operation, and the process returns to the cooperation process. In step S64, the apparatus-side process is executed in accordance with the setting value in cooperation with the smartphone 200A that is the cooperation apparatus, and the process proceeds to step S65. In step S65, the set value is deleted, and the process returns to the cooperation process.

  In step S68, it is determined whether or not the operation determined in step S61 is an execution instruction operation. If so, the process proceeds to step S69; otherwise, the process proceeds to step S70. In step S70, a setting value is set according to the determined operation, and the process returns to the cooperation process. In step S69, the device single process is executed according to the set value, and the process returns to the cooperation process.

  FIG. 14 is a flowchart illustrating an example of the flow of the continuation state detection process. The continuation state detection process is a process executed in step S12 of FIG. Referring to FIG. 14, CPU 111 determines whether or not the user has set the continuation state (step S81). If the continuation state is set by the user, the process proceeds to step S84; otherwise, the process proceeds to step S82. In step S82, it is determined whether it is within a predetermined time after the setting value on the apparatus side is set. If it is within a predetermined time after the setting value on the apparatus side is set, the process proceeds to step S84; otherwise, the process proceeds to step S83. Note that it may be determined whether or not it is within a predetermined time after an operation for a task that executes the cooperation program is input. The operation for the task that executes the cooperation program includes, for example, an operation for scrolling the screen and an operation for changing the screen, in addition to the operation for setting the apparatus-side setting value.

  In step S83, it is determined whether an error has occurred in the hardware resource. If an error has occurred in the hardware resource, the process proceeds to step S84; otherwise, the process proceeds to step S85. In step S84, the continuation state on the MFP 100 side is detected, and the process proceeds to step S85.

  In step S85, the portable state indicating the state of the smartphone 200A is acquired from the smartphone 200A that is the cooperation apparatus. Then, based on the portable state, it is determined whether or not the smartphone 200A that is the cooperation device is executing a predetermined application program (step S86). If the predetermined application program is being executed, the process proceeds to step S88; otherwise, the process proceeds to step S87. The predetermined application program is a predetermined application program that is different from the mobile-side cooperation program for the smartphone 200A to cooperate with the MFP 100. For example, the application program for calling and the application program for receiving e-mail Including. While the smartphone 200A receives a call while the setting of the cooperation process with the MFP 100A is performed, the user A may give priority to the call, and when the smartphone 200A receives an e-mail, the user A This is because priority may be given to browsing electronic mail.

  In step S87, it is determined whether or not it is within a predetermined time after the mobile-side set value is set. If it is within a predetermined time after setting the mobile-side setting value, the process proceeds to step S88. If not, the process returns to the cooperation process. Note that it may be determined whether or not it is within a predetermined time after an operation for a task that executes the mobile-side cooperation program is input. The operation for the task that executes the mobile side cooperation program includes, for example, an operation for scrolling the screen and an operation for changing the screen, in addition to the operation for setting the mobile side setting value. In step S88, the continuation state on the cooperation device side is detected, and the process returns to the cooperation process.

  FIG. 15 is a flowchart illustrating an example of the flow of portable side cooperation processing in the first embodiment. The portable side cooperation process is a process executed by the CPU 201 when the CPU 201 included in the smartphone 200A executes the portable side cooperation program stored in the flash memory 203 and the CD-ROM 211A. Referring to FIG. 15, it is determined whether short-range communication unit 209 has received a search command. If a search command is received, the process proceeds to step S202; otherwise, the process proceeds to step S205. Here, a case where a search command transmitted by MFP 100 is received will be described as an example.

  In step S202, the near field communication unit 209 is controlled and a response command is returned. Then, the short-range communication unit 119 determines whether or not a connection request has been received from the MFP 100 that has transmitted the search command received in step S201 (step S203). If a connection request is received, the process proceeds to step S204; otherwise, the process proceeds to step S205. In step S204, a communication path is established with MFP 100 that has transmitted the connection request, and the process proceeds to step S205.

  In step S205, it is determined whether an operation has been accepted. Based on the position detected by the touch panel 207B while the operation screen is displayed on the display unit 206, the position in the operation screen is specified and the operation is determined. When the operation is determined, it is determined that the operation has been accepted. If an operation is accepted, the process proceeds to step S206; otherwise, the process proceeds to step S215. When the operation screen includes a button to which an operation is assigned and the position in the button is specified, the operation assigned to the button is determined. For example, when the operation screen is a keyboard and the position in the key is specified, an operation for inputting an alphanumeric character assigned to the key is determined. Further, when the operation screen includes an execution key to which an execution instruction operation for instructing execution of the process is assigned, and the position in the execution key is specified, the execution instruction operation is determined. Further, when the operation screen includes a switching key for switching tasks and the position in the switching key is specified, the task switching operation is determined.

  In step S206, if the operation accepted in step S205 is a task switching operation, the process proceeds to step S207. If not, the process proceeds to step S208. In step S207, the task is switched and the process returns to step S201.

  In step S208, it is determined whether or not the cooperative task is in a current state. If the cooperation task is in the current state, the process proceeds to step S209; otherwise, the process proceeds to step S212. In step S209, it is determined whether a restart operation has been accepted. The resume operation is an operation for instructing a resume button. If a restart operation is accepted, the process proceeds to step S210; otherwise, the process proceeds to step S211. In step S210, a restart notification is transmitted to MFP 100, and the process returns to step S201. In step S211, the mobile-side set value is set according to the operation accepted in step S207, and the process returns to step S201.

  In step S212, it is determined whether the operation accepted in step S205 is an execution instruction operation. If so, the process proceeds to step S213; otherwise, the process proceeds to step S214. In step S213, the mobile single process specified by the execution instruction operation is executed according to the mobile single set value, and the process returns to step S201. In step S214, according to the operation accepted in step S205, the mobile phone single set value is set, and the process returns to step S201.

  In step S215, it is determined whether an execution instruction is received from MFP 100 or not. If an execution instruction has been received, the process proceeds to step S216; otherwise, the process proceeds to step S217. In step S216, the mobile-side process specified by the execution instruction is executed according to the mobile-side setting value, and the process returns to step S201.

  In step S217, it is determined whether a restart notification has been received. If a restart notification is received from MFP 100, the process proceeds to step S218. If not, the process returns to step S201. For example, if wireless LAN I / F 208 receives a signal indicating resumption notification from MFP 100, it is determined that resumption notification has been received. In step S218, the cooperative task is switched to the current state, and the process proceeds to step S219.

  In step S219, the identification information received from MFP 100 is displayed on display unit 206, and the process proceeds to step S220. In step S220, it is determined whether an end operation has been accepted. When touch panel 207B detects that an arbitrary position on the display surface of display unit 206 has been designated, an end operation is accepted. If an end operation has been accepted, the process proceeds to step S221; otherwise, the process proceeds to step S222. In step S222, it is determined whether an end command is received from MFP 100 or not. If an end command is received, the process proceeds to step S223; otherwise, the process returns to step S220. In step S223, the display of the identification information displayed in step S219 is terminated, and the process returns to step S201.

<First Modification>
In the first embodiment, the device detection unit 41 controls the short-range communication unit 119 in response to the touch panel 165 detecting the position where the smartphone 200A is placed, and searches for devices existing in the vicinity. The device placed at the position previously detected by the touch panel 165 is received by, for example, receiving a response command returned from the smartphone 200A among the smartphones 200A, 200B, and 200C. 200A is detected. Then, the route establishing unit 43 controls the communication I / F unit 112 to establish a communication route with the smartphone 200 </ b> A detected by the device detection unit 41.

  In the first modification, the route establishing unit 43 controls the short-range communication unit 119 to establish a communication route with the smartphone 200 </ b> A detected by the device detection unit 41. The short-range communication unit 119 has a limited communication range. For this reason, the cooperation end condition in the first modification is different from the cooperation end condition in the first embodiment. The cooperation end condition in the first modified example is the first condition in which the device detection unit 41 does not detect the smartphone 200A when the continuation state is not detected by the continuation state detection unit 51, and the continuation state detection And a second condition in which the communication path established with the smartphone 200A by the path establishing unit 43 in a state where the continuation state is detected by the unit 51 is disconnected.

  In the first modification, when a disconnection signal is input from the device detection unit 41, the release unit 54 receives a continuation signal including the same device identification information as the device identification information included in the disconnection signal from the continuation state detection unit 51. If not, the operation mode corresponding to the device identification information included in the separation signal is switched from the cooperation mode to the single mode, and a maintenance instruction is output to the maintenance unit 47 and the resumption unit 56. In the first modification, when a disconnection signal is input from the device detection unit 41, the release unit 54 receives a continuation signal including the same device identification information as the device identification information included in the disconnection signal from the continuation state detection unit 51. If so, the cooperation mode is maintained without switching the operation mode corresponding to the device identification information included in the separation signal from the cooperation mode to the single mode.

  When the release unit 54 in the first modified example maintains the cooperation mode at the stage where the separation signal is input from the device detection unit 41, the operation mode is changed to the cooperation mode when the short-range communication unit 119 cannot communicate with the smartphone 200A. Is switched to the single mode, and a maintenance instruction is output to the maintenance unit 47 and the resumption unit 56. Specifically, the release unit 54 in the first modification example includes a disconnection signal including the same device identification information as the device identification information included in the separation signal after the separation signal is input from the device detection unit 41 and the interlock mode is maintained. Is input from the path establishment unit 43, the operation mode corresponding to the device identification information included in the disconnection signal is switched from the cooperation mode to the single mode, and a maintenance instruction is output to the maintenance unit 47 and the restart unit 56. The maintenance instruction includes device identification information included in the disconnection signal.

  After the maintenance instruction is input from the release unit 54, the resuming unit 56 sets the operation mode corresponding to the device identification information included in the maintenance instruction when the cooperation resumption condition is satisfied for the device identification information included in the maintenance instruction. While switching from the single mode to the cooperation mode, a return instruction is output to the return unit 49.

  In the first modified example, for example, the cooperation mode may be maintained in a state where the user A separates the smartphone 200A from the display surface of the display unit 161. The setting for the cooperation processing can be continued in a state where is separated from the display surface of the display unit 161.

  In the first modification, the cooperation resumption condition further includes a condition that allows the short-range communication unit 119 to communicate with the device specified by the device identification information included in the maintenance instruction.

<Second Embodiment>
About the cooperation system 1 in 2nd Embodiment, a different point from the cooperation system 1 in 1st Embodiment is mainly demonstrated.

  FIG. 16 is a diagram illustrating an example of the overall outline of the cooperation system according to the second embodiment. Referring to FIG. 16, cooperation system 1A in the second embodiment includes MFP 100A and smartphone 200A. In MFP 100 according to the first embodiment, a plurality of people can use MFP 100 at the same time. However, in MFP 100A according to the second embodiment, a plurality of people cannot use at the same time, and one person can use MFP 100. It is said. Here, a case where user A carrying smartphone 200A operates MFP 100A will be described as an example. In the cooperation system 1A according to the second embodiment, the smartphone 200A and the MFP 100A can execute cooperation processing in cooperation with each other. Smartphone 200 </ b> A and MFP 100 </ b> A communicate using a short-range communication function or a wireless LAN function, and execute cooperation processing in cooperation with each other. MFP 100A according to the second embodiment switches the operation mode to a cooperation mode that operates in cooperation with smartphone 200A carried by user A, triggered by the establishment of a predetermined cooperation start condition.

  FIG. 17 is a block diagram illustrating an example of a hardware configuration of the MFP according to the second embodiment. Referring to FIG. 16 and FIG. 17, MFP 100A in the second embodiment is different from MFP 100 in the first embodiment in that automatic document feeder 120 and NFC communication unit 119A are added, and the operation. The panel 160 is added. Since other configuration of MFP 100A is the same as that of MFP 100 in the first embodiment, description thereof will not be repeated here.

  The automatic document feeder 120 handles one or more documents placed on the document tray by the user and conveys them one by one to the document reading unit 130. In addition, when images are formed on both sides of a document, it has a function of reversing the front and back of the document, transports the document in a direction that can be read by the document reading unit 130, and then reverses the document. Then, the document is conveyed in a direction in which the document reading unit 130 can read the back side of the document.

  The operation panel 160 includes a display unit 161A and an operation unit 163. The display unit 161A is a display device such as an LCD or an organic ELD, and is smaller in size than the display unit 161 in the first embodiment. The operation unit 163 includes a hard key unit 167 including a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys. The touch panel 165 is provided so as to overlap with the upper surface or the lower surface of the display unit 161A, and detects a position designated by the user on the display surface of the display unit 161A.

  The NFC communication unit 119A performs communication using a near field communication (NFC) near field communication system. The distance that the NFC communication unit 119A can communicate is several centimeters. In the second embodiment, the smartphone 200A is equipped with an NFC tag, and the NFC communication unit 119A detects the smartphone 200A by communicating with the NFC tag when the distance from the smartphone 200A is several cm or less. To do.

  The short-range communication unit 119 communicates wirelessly with the smartphones 200A, 200B, and 200C based on the Bluetooth (registered trademark) standard GAP (Generic Access Profile) and the like. For example, the short-range communication unit 119 communicates with the smartphone 200A when the distance to the smartphone 200A is equal to or less than a communicable distance. The distance that the short-range communication unit 119 can communicate is several meters.

  FIG. 18 is a block diagram illustrating an example of the functions of the CPU provided in the MFP according to the second embodiment. The functions illustrated in FIG. 18 are functions formed in the CPU 111 when the CPU 111 provided in the MFP 100 executes the cooperation program stored in the ROM 113, the HDD 115, and the CD-ROM 118.

  18, the difference from the function shown in FIG. 4 is that operation region determination unit 37, user management unit 39, release notification unit 45 and maintenance notification unit 46 are deleted, linkage mode switching unit 35, Device detection unit 41, path establishment unit 43, maintenance unit 47, return unit 49, continuation state detection unit 51 are linked mode switching unit 35A, device detection unit 41A, route establishment unit 43A, maintenance unit 47A, return unit 49A, continuation. This is a point changed to the state detection unit 51A. The continuation state detection unit 51 </ b> A is different from the continuation state detection unit 51 shown in FIG. 4 in that the portable state detection unit 77 includes a battery remaining amount detection unit 89. The other functions are the same as the functions shown in FIG. 4, and thus description thereof will not be repeated here.

  The device detection unit 41A controls the NFC communication unit 119A to detect the smartphone 200A. When the user A brings the smartphone 200A close to the antenna of the NFC communication unit 119A, the device detection unit 41A communicates with the NFC tag attached to the smartphone 200A to detect the smartphone 200A. When detecting the smartphone 200A, the device detection unit 41A outputs an establishment instruction including the device identification information of the smartphone 200A to the route establishment unit 43A.

  In response to the establishment instruction input from the device detection unit 41A, the route establishment unit 43A specifies the connection target device based on the device identification information included in the establishment instruction, and controls the short-range communication unit 119. Then, a communication path is established with the identified device, and a cooperation instruction is output to the cooperation mode switching unit 35A. Here, since the device identification information of the smartphone 200 </ b> A is included in the establishment instruction, the route establishment unit 43 </ b> A establishes a communication route with the smartphone 200 </ b> A and outputs a cooperation instruction to the cooperation mode switching unit 35. The cooperation instruction includes device identification information of a device that has established a communication route, here, the smartphone 200A, and route identification information for identifying the communication route.

  When the established communication path is disconnected, the path establishment unit 43A outputs a disconnection signal including the path identification information of the disconnected communication path to the cooperation mode switching unit 35A. The case where the communication path is disconnected includes, for example, the case where the smartphone 200A disconnects the communication path when the smartphone 200A goes out of the communicable range of the communication I / F unit 112.

  Note that the device detection unit 41A controls the short-range communication unit 119 to transmit a search command at a predetermined time interval so that the short-range communication unit 119 detects a device that can communicate. Good. In this case, the route establishing unit 43A is not necessary.

  The device detection unit 41A may perform user authentication before outputting the establishment instruction to the route establishment unit 43A. For example, authentication information associating user identification information of a user authorized to use MFP 100A with device identification information of a device assigned to the user is stored in HDD 115 in advance, and the device of the detected device is stored. When authentication information including identification information is stored in the HDD 115, an establishment instruction is output to the path establishment unit 43A. When such authentication information is not stored in the HDD 115, an establishment instruction is issued to the path establishment unit 43A. Do not output. Only a user registered in advance in MFP 100 can use MFP 100.

  The cooperation mode switching unit 35A switches the operation mode between the single mode and the cooperation mode. The cooperation mode switching unit 35A outputs an operation mode signal indicating one of the operation modes of the single mode and the cooperation mode to the apparatus-side execution unit 33, the operation area determination unit, and the continuation state detection unit 51A.

  Cooperation mode switching unit 35A includes a cooperation setting unit 53A, a releasing unit 54A, a relative position detecting unit 55, and a resuming unit 56A. The cooperation setting unit 53A switches the operation mode from the single mode to the cooperation mode in response to establishment of the cooperation start condition. Here, the cooperation start condition is that the communication I / F unit 112 establishes a communication path after the short-range communication unit 119 becomes communicable with the smartphone 200A. The cooperation setting unit 53A switches the operation mode corresponding to the device identification information included in the cooperation instruction from the single mode to the cooperation mode in response to the input of the cooperation instruction from the route establishing unit 43A.

  When the cooperation end condition is satisfied, the canceling unit 54A switches the operation mode from the cooperation mode to the single mode. The cooperation termination condition is that an operation for terminating the cooperation is input by the user or the communication path is disconnected. Moreover, the cancellation | release part 54A will output a maintenance signal to the maintenance part 47A, if the continuation signal which shows that it is a continuation state is input from the continuation state detection part 51A in the step in which cooperation completion | finish conditions are satisfied. The continuation signal includes device identification information of the cooperation device, here, the smartphone 200A. When the disconnection signal is input from the route establishment unit 43A, the canceling unit 54A receives the device identification information included in the disconnection signal when the continuation signal including the same device identification information as the device identification information included in the disconnection signal is input. The operation mode corresponding to the information is switched from the cooperation mode to the single mode, and a maintenance instruction is output to the maintenance unit 47A and the resumption unit 56A. The maintenance instruction includes device identification information included in the disconnection signal.

  The cancellation unit 54A may receive a cooperation end instruction from the device-side setting unit 31. Although details of the cooperation end instruction will be described later, when the user A instructs the end of the cooperation process, the apparatus end setting unit 31 outputs the apparatus identification information of the smartphone 200A carried by the user A. 54 A of cancellation | release parts judge that cooperation end conditions are satisfied when the cooperation end instruction | indication is input from the apparatus side setting part 31, and the operation mode corresponding to the apparatus identification information contained in a cooperation end instruction | indication is changed from cooperation mode to single mode. And an end notification instruction is output to the release notification unit 45. The end notification instruction includes device identification information included in the cooperation end instruction.

  After the maintenance instruction is input from the canceling unit 54, the resuming unit 56A outputs a restoration instruction to the restoration unit 49A when the cooperative resumption condition is established for the device identification information included in the maintenance instruction. The return instruction includes device identification information included in the maintenance instruction. The restart unit 56A outputs the return instruction to the return unit 49A, and then links the operation mode corresponding to the device identification information included in the return instruction from the single mode in response to the input of the return completion signal from the return unit 49A. Switch to mode.

  The cooperation restart condition is different from the cooperation start condition. The cooperation restart condition includes at least a condition that enables the short-range communication unit 119 to communicate with the device specified by the device identification information included in the maintenance instruction, and the device specified by the device identification information included in the maintenance instruction and the own device Includes a condition for changing from the first relative position to the second relative position. After the maintenance instruction is input from the release unit 54A, the resuming unit 56A outputs a connection instruction including device identification information included in the maintenance instruction to the route establishing unit 43A. When the connection instruction is input from the resuming unit 56A, the path establishing unit 43A controls the short-range communication unit 119 to transmit a connection request for the device identification information included in the connection instruction at predetermined time intervals. Here, the short-range communication unit 119 transmits a connection request to the smartphone 200A at predetermined time intervals. Since the smartphone 200A returns a response when receiving the connection request, the short-range communication unit 119 establishes a communication path with the smartphone 200A. When the short-range communication unit 119 establishes a communication route with the smartphone 200A, the route establishment unit 43A outputs a cooperation instruction to the resumption unit 56A.

  In the case where the resumption unit 56A detects the second relative position by the relative position detection unit 55 after the relative position detection unit 55 detects the first relative position after the cooperation instruction is input from the route establishment unit 43A. It is determined that the cooperation restart condition is satisfied.

  The cooperation resumption condition is satisfied when a predetermined operation input by the user is accepted, including at least a condition that enables the short distance communication unit 119 to communicate with the device specified by the device identification information included in the maintenance instruction. You may make it include conditions. After the maintenance instruction is input from the canceling unit 54, the resuming unit 56A can communicate with the device identification information included in the maintenance instruction, for example, the smartphone 200A and the short-range communication unit 119, and the smartphone 200A can communicate with the smartphone 200A. When accepting an operation for instructing resumption by the user A who operates A, it may be determined that the cooperation resumption condition is satisfied. In this case, MFP 100 is notified that an operation for instructing resumption has been received from smartphone 200A, and resuming unit 56A determines that the cooperation resumption condition has been established by the notification from smartphone 200A.

  The maintenance unit 47A maintains the processing identification information and the setting value in response to the combination of the processing identification information and the setting value input from the apparatus side setting unit 31 and the maintenance instruction input from the release unit 54A. . Specifically, the maintenance unit 47A includes the device identification information included in the maintenance instruction with the processing identification information and the side set value input from the device side setting unit 31 in response to the maintenance instruction input from the release unit 54A. And stored in the RAM 114.

  In response to the input of the return instruction from the resuming unit 56A, the return unit 49A returns the setting that was set before the cooperation mode was canceled. When the return unit 49A returns to the setting set before the cooperation mode is canceled, the return unit 49A outputs a return completion signal to the restart unit 56A. The return unit 49A reads from the RAM 114 a set of process identification information and setting values associated with the same device identification information as the device identification information included in the return instruction, outputs them to the device side setting unit 31, and outputs the device side setting unit. 31 sets processing identification information and a set value. When the combination of the process identification information and the set value is input from the return unit 49A, the apparatus-side setting unit 31 sets the process identification information and the set value in order to continue the setting of the cooperation process. The apparatus-side setting unit 31 displays an operation screen for accepting changes in the process identification information and the apparatus-side setting value. Accordingly, the user can continuously set the setting value from the state set before the cooperation apparatus leaves MFP 100.

  The remaining battery level detection unit 89 inquires of the smartphone 200A about the remaining battery level via the communication path specified by the path identification information paired with the device identification information of the smartphone 200A. The remaining battery level detection unit 89 outputs a continuation signal including device identification information of the smartphone 200A to the cooperation mode switching unit 35 when the remaining battery level of the smartphone 200A is equal to or less than a predetermined threshold T. When the battery remaining amount of the smartphone 200A is equal to or less than the threshold value T, the time during which the smartphone 200A can be driven is limited thereafter. For this reason, when the smartphone 200A has a low battery level and the smartphone 200A cannot communicate with the MFP 100A, the communication path is disconnected. In the MFP 100A, the smartphone 200A battery level is less than or equal to the threshold T. In this case, since the continuation state is detected, the device-side setting value set by the device-side setting unit 31 and the mobile-side setting value set in the smartphone 200A are stored. After that, when the smartphone 200A battery is charged and the smartphone 200A and the MFP 100A are linked again, the setting for reproducing the device-side setting value and the mobile-side setting value set earlier and executing the linkage process Can continue.

  FIG. 19 is a diagram illustrating an example of functions of a CPU included in the smartphone according to the second embodiment. Referring to FIG. 19, the difference from the function shown in FIG. 7 is that mobile-side resumption notification unit 259 is deleted and communication control unit 250 is changed to communication control unit 250A. The other functions are the same as those shown in FIG. 7, and thus description thereof will not be repeated here.

  Communication control unit 250A controls short-range communication unit 209 to establish a communication path with MFP 100A. When the user A brings the smartphone 200A close to the antenna of the NFC communication unit 119A provided in the MFP 100A, the short-range communication unit 209 receives a connection request from the MFP 100A. Therefore, the user A controls the short-range communication unit 209 to communicate with the MFP 100A. Establish a communication path.

  FIG. 20 is a flowchart illustrating an example of the flow of cooperation processing in the second embodiment. Referring to FIG. 20, the difference from the linkage processing in the first embodiment shown in FIG. 9 is that step S01, step S05, step S08, step S11, step S15 and step S20 are replaced by step S01A and step S05A. , Step S08A, Step S11A, Step S15A and Step S20A. Other processing is the same as the processing shown in FIG. 9, and therefore description thereof will not be repeated here.

  FIG. 21 is a flowchart illustrating an example of the flow of a cooperation start condition detection process according to the second embodiment. The cooperation start condition detection process is a process executed in step S01A in FIG. Referring to FIG. 21, CPU 111 determines whether short-range communication unit 119 that communicates with the NFC standard has detected a device (step S31A). If an apparatus is detected, the process proceeds to step S32A. If not, the process returns to the cooperation process. In the next step S32A, the device detected by the short-range communication unit 119 is specified, and the process proceeds to step S33A. It is specified by receiving device identification information from the device. Here, a case where the smartphone 200A is detected will be described as an example.

  In step S33A, the short-range communication unit 119 is controlled to establish a communication path with the device specified in step S32A, here, the smartphone 200A, and the process returns to the cooperation process.

  Returning to FIG. 20, in step S02, it is determined whether or not the cooperation start condition is satisfied as a result of the cooperation start condition detection process executed in step S01A. In the cooperation start condition detection process, if there is a device for which a new communication path has been established, it is determined that the cooperation start condition has been established. If the cooperation start condition is satisfied, the process proceeds to step S03; otherwise, the process proceeds to step S05A.

  In step S05A, it is determined whether an operation has been accepted. When the touch panel 165 detects a position designated by the user, an operation is detected. If an operation is detected, the process proceeds to step S06; otherwise, the process proceeds to step S07. In step S06, the admission control process shown in FIG. 13 is executed, and the process proceeds to step S08.

  In step S08A, the cooperation end condition detection process in the second embodiment is executed, and the process proceeds to step S09. The cooperation end condition is that an operation for ending the cooperation is input by the user, or a communication path established with the cooperation apparatus is disconnected. In step S09, it is determined whether or not a cooperation end condition is satisfied as a result of the cooperation end condition detection process. If the cooperation termination condition is terminated, the process proceeds to step S10. If not, the process proceeds to step S12. Here, a case where the smartphone 200A is registered in the cooperation device and the communication path with the smartphone 200A is disconnected will be described as an example.

  In step S10, the operation mode corresponding to the cooperation device in which the cooperation end condition is detected, here, the smartphone 200A is switched to the single mode, and the process proceeds to step S11A. In step S11A, the continuation state detection process in the second embodiment is executed, and the process proceeds to step S16.

  In step S15A, the cooperative resumption condition detection process in the second embodiment is executed, and the process proceeds to step S16. When the short-range communication unit 119 becomes able to communicate with the smartphone 200 </ b> A that was the cooperation device, it detects that the cooperation resumption condition is established. In step S16, it is determined whether or not the cooperation resumption condition is satisfied as a result of executing the cooperation resumption condition detection process. If the cooperation restart condition is satisfied, the process proceeds to step S17. If not, the process returns to step S01.

  In step S20A, the return process in the second embodiment is executed, and the process returns to step S01. Specifically, in step S13, the apparatus-side information stored in association with the apparatus identification information of the cooperation apparatus is read, the process identification information and the setting value are set, and the change of the process identification information and the apparatus side setting value is accepted. Display the operation screen. Accordingly, the user can continuously set the setting value from the state set before the cooperation apparatus leaves MFP 100.

  FIG. 22 is a diagram illustrating an example of the flow of a continuation state detection process in the second embodiment. Referring to FIG. 22, the difference from the continuation state detection process in the first embodiment shown in FIG. 14 is that step S87A is added. Other processing is the same as the processing shown in FIG. 14, and therefore description thereof will not be repeated here.

  In step S87, when it is determined that it is not within the predetermined time since the portable side set value is set, the process proceeds to step S87A. In step S87A, it is determined whether or not the remaining amount of the battery built in smartphone 200A that is the cooperation apparatus is equal to or less than threshold value T. If the remaining battery level of smartphone 200A that is the cooperation device is equal to or less than threshold value T, the process proceeds to step S88. If not, the process returns to the cooperation process.

  FIG. 23 is a flowchart illustrating an example of the flow of mobile side cooperation processing in the second embodiment. The difference from the mobile-side cooperation process in the first embodiment shown in FIG. 15 is that step S201 to step S204 are changed to step S201A to step S204A, and step S219 to step S222 are deleted. is there. The other processing is the same as the processing shown in FIG. 15, and therefore description thereof will not be repeated here.

  Referring to FIG. 23, CPU 201 determines in step S201A whether the NFC tag has detected a device. If a device is detected, the process proceeds to step S202A; otherwise, the process proceeds to step S209. Here, a case where MFP 100A is detected will be described as an example.

  In step S202A, the short-range communication unit 209 is controlled to transmit a response command to the MFP 100A. In the next step S203B, the short-range communication unit 209 is controlled to determine whether a connection request is received from the MFP 100A. If a connection request is received, the process proceeds to step S204A; otherwise, the process proceeds to step S205. In step S204A, short-range communication unit 209 is controlled to establish a communication path with MFP 100A, and the process proceeds to step S205.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
(1) The information processing apparatus according to any one of claims 1 to 18, wherein the continuation state detection unit detects the continuation state when the portable device is executing a predetermined application program.
(2) The information processing apparatus according to (1), wherein the predetermined application program is an application program different from an application program for executing processing in cooperation with the information processing apparatus.
(3) The information processing according to any one of claims 1 to 18, wherein the continuation state detection unit detects the continuation state when a predetermined time has not elapsed since an operation was received in the portable device. apparatus.
(4) The information according to any one of claims 1 to 18, wherein the continuation state detection unit detects the continuation state when a predetermined time has not elapsed since an operation was received in the information processing apparatus. Processing equipment.
(5) The information processing apparatus according to any one of claims 1 to 18, wherein the continuation state detection unit detects the continuation state when a hardware resource malfunction occurs.
(6) The continuation state detection unit detects the continuation state when a remaining amount of a battery that stores electric power for driving the portable device is equal to or less than a predetermined value. Information processing device.

  DESCRIPTION OF SYMBOLS 1 Cooperation system, 100 MFP, 200A, 200B, 200C Smart phone, 110 main circuit, 111 CPU, 112 Communication I / F part, 113 ROM, 114 RAM, 115 HDD, 116 Facsimile part, 117 External storage device, 119 Short distance communication Section, 119A NFC communication section, 120 automatic document feeder, 130 document reading section, 140 image forming section, 150 sheet feeding section, 160 operation panel, 161 display section, 161A display section, 163 operation section, 165 touch panel, 167 hard key Unit, 201 CPU, 202 camera, 203 flash memory, 204 wireless communication unit, 205 call unit, 206 display unit, 207 operation unit, 207A main key, 207B touch panel, 208 LAN wireless LAN I / F, 209 Distance communication unit, 210 reception unit, 211 external storage device, 31 device side setting unit, 33 device side execution unit, 35, 35A cooperation mode switching unit, 37 operation area determination unit, 39 user management unit, 41, 41A device detection unit 43, 43A Route establishment unit, 45 Release notification unit, 46 Maintenance notification unit, 47, 47A Maintenance unit, 49 Recovery unit, 49, 49A Recovery unit, 51, 51A Continuous state detection unit, 53, 53A Coordination setting unit, 54 , 54A release unit, 55 relative position detection unit, 56, 56A resumption unit, 59 resuming area determination unit, 61 resumption notification unit, 63 device side set value setting unit, 65 device single execution unit, 67 device side cooperation processing execution unit , 68 Relative position detection unit, 71 Cooperation setting unit, 73 Device state detection unit, 75 User setting unit, 77 Portable state detection unit, 81 Device operation detection unit, 83 Error detection unit, 85 application detection unit, 87 portable operation detection unit, 89 battery remaining amount detection unit, 250, 250A communication control unit, 251 portable side setting unit, 253 portable side execution unit, 255 continuation determination unit, 257 set value transmission Part, 259 portable side resumption notification part, 261 portable single set value setting part, 263 portable side set value setting part, 265 portable single execution part, 267 portable side cooperation process execution part.

Claims (20)

An information processing device capable of communicating with a portable device carried by a user,
Route establishment means for establishing a communication route with the portable device;
Continuation state detecting means for detecting a continuation state based on the state of the portable device or the state of the own device;
When the cooperation start condition is satisfied, the single mode that does not cooperate with the portable device is switched to the cooperation mode that cooperates with the portable device, and when the cooperation end condition is established in the cooperation mode, the single mode is switched. Mode switching means,
The mode switching means switches from the single mode to the cooperative mode when a cooperative restart condition different from the cooperative start condition is satisfied after switching from the cooperative mode to the single mode with the continuation state detected. An information processing apparatus including means. Display means for displaying an image;
Position detecting means for detecting a position where an object contacts in the display surface of the display means;
Device detecting means for detecting the portable device in response to detection of a position where the object is touched by the position detecting means,
The information processing apparatus according to claim 1, wherein the cooperation start condition includes a condition for establishing a communication path with the portable device in a state where the portable device is detected by the device detection unit.   The information processing apparatus according to claim 2, wherein the cooperation termination condition includes a first condition in which the portable device is not detected by the device detection unit. The mode switching means includes a maintaining means for continuing the cooperation mode when the portable device is not detected by the apparatus detection means in a state where the continuation state is detected in the cooperation mode,
The cooperation termination condition includes a first condition in which the portable device is not detected by the device detection unit when the continuation state is not detected, and the portable device is detected when the continuation state is detected. The information processing apparatus according to claim 2, further comprising: a second condition in which a communication path established with the portable device after being lost is disconnected.   Responsive notification means for displaying correspondence information corresponding to the portable device on the display means and displaying identification information for identifying the correspondence information on the portable device in response to the establishment of the cooperation resumption condition, The information processing apparatus according to claim 2, further comprising:   The restart notification means terminates the display of the correspondence information and terminates the display of the identification information on the portable device in response to receiving an operation for terminating the display of the correspondence information. The information processing apparatus described.   The mobile-side notification means for ending the display of the correspondence information in response to receiving an end instruction transmitted by the mobile device that accepts an operation to end the display of the identification information. The information processing apparatus described. An operation area determining means for allocating one operation area corresponding to the portable device from among a plurality of operation areas on the display surface of the display means in response to being switched to the cooperation mode by the mode switching means;
An operation for storing the portable device and the operation area assigned to the portable device in association with each other when the mode is switched from the cooperation mode to the single mode with the continuation state detected by the mode switching unit. An area storage means,
The information processing apparatus according to claim 5, wherein the correspondence information display unit displays the correspondence information in the operation area assigned to the portable device by the operation area determination unit. The operation area determination means is associated with the portable device when the operation area is associated with the portable device by the operation area storage means when the mode switching means is switched to the cooperation mode. If the operation area is unused, the operation area associated with the portable device is assigned to the portable apparatus, and if the operation area associated with the portable device is in use, the plurality of operation areas are unused. Assign one of the operation areas to the portable device,
The restart notification means is configured such that when the operation area is associated with the portable device by the operation area storage means, an operation area different from the operation area associated with the portable apparatus is assigned. The information processing apparatus according to claim 8, wherein the correspondence information is displayed.   The resumption notification means displays the correspondence information when any one or more operation areas other than the operation area assigned to the portable device by the operation area determination means is in use. The information processing apparatus described in 1. A rotation mechanism for rotating the direction of the display surface of the display means;
Direction storage means for storing the portable device and the direction of the display surface in association with each other in response to switching from the cooperation mode to the single mode in a state where the continuation state is detected by the mode switching means; Further comprising
The said restart notification means displays the said correspondence information, when the direction of the said display surface differs from the direction of the said display surface memorize | stored matched with the said portable apparatus. The information processing apparatus described. The correspondence information is an image in which a predetermined color is determined in the first shape,
The information processing apparatus according to claim 5, wherein the identification information is an image in which the predetermined color is determined in a second shape. The correspondence information is an image of a predetermined character string,
The information processing apparatus according to claim 5, wherein the identification information is an image of the predetermined character string. A relative position detecting means for detecting the portable device existing at a predetermined relative position;
The cooperation start condition includes a condition that a communication path is established with the portable device after it is detected that the portable device exists at the predetermined relative position,
The cooperation termination condition includes a condition that a communication path established with the portable device is disconnected,
The information processing apparatus according to claim 1, wherein the cooperation restart condition includes at least a condition for establishing a communication path with the portable device. A measuring means for measuring a distance between the portable device, and
The information processing apparatus according to claim 1, wherein the cooperation resumption condition includes a condition in which a distance from the portable device changes from a state larger than a predetermined distance to a state equal to or smaller than the predetermined distance. .   The information processing apparatus according to claim 1, wherein the cooperation resumption condition includes a condition for accepting a resumption instruction operation instructing resumption of the cooperation mode input by a user.   The information processing apparatus according to claim 16, wherein the restart instruction operation is received by the portable device. A device-side receiving means for receiving a user operation;
In the cooperation mode, a device-side setting unit that sets a setting value according to an operation received by the device-side receiving unit;
Device-side execution means for executing processing according to the setting value in the cooperation mode in cooperation with the portable device, and executing processing according to the setting value in the single mode;
A maintenance unit that stores the setting value set by the device-side setting unit in association with the portable device when the cooperative mode is switched to the single mode in a state in which the continuation state is detected;
If the setting value associated with the portable device is stored when the device-side setting unit is switched from the single mode to the cooperation mode, the setting of the stored setting value is resumed, and the portable device The information processing apparatus according to claim 1, wherein if the setting value associated with the apparatus is not stored, the apparatus-side setting value is set from the beginning. A cooperation method executed by an information processing device capable of communicating with a portable device carried by a user,
A path establishing step for establishing a communication path with the portable device;
A continuation state detecting step for detecting a continuation state based on the state of the portable device or the state of the device itself;
When the cooperation start condition is satisfied, the single mode that does not cooperate with the portable device is switched to the cooperation mode that cooperates with the portable device, and when the cooperation end condition is established in the cooperation mode, the single mode is switched. A mode switching step,
The mode switching step restarts switching from the single mode to the cooperative mode when a cooperative restart condition different from the cooperative start condition is satisfied after switching from the cooperative mode to the single mode with the continuation state detected. A cooperation method including steps. A cooperation program that is executed by a computer that controls an information processing device that can communicate with a portable device carried by a user,
A path establishing step for establishing a communication path with the portable device;
A continuation state detecting step for detecting a continuation state based on the state of the portable device or the state of the device itself;
When the cooperation start condition is satisfied, the single mode that does not cooperate with the portable device is switched to the cooperation mode that cooperates with the portable device, and when the cooperation end condition is established in the cooperation mode, the single mode is switched. Causing the computer to execute a mode switching step;
The mode switching step restarts switching from the single mode to the cooperative mode when a cooperative restart condition different from the cooperative start condition is satisfied after switching from the cooperative mode to the single mode with the continuation state detected. A cooperation program including steps.

Images