JP2016122972A - Image processing system, image processing apparatus, remote control method and remote control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate remote operation by a plurality of remote operation devices.SOLUTION: An MFP includes a first communication path establishment unit 71 for establishing a communication path with an initial device in response to a request therefrom, a remote control unit 59 executing the processing according to remote operation received from the initial device, and a second communication path establishment unit 73 for establishing a communication path with a switching device, in response to reception of a switching instruction for instructing the switching from the initial device to the switching device. The remote control unit 59 continuously executes the processing, executed according to the remote operation received from the initial device before a communication path is established between the switching device and the remote control unit, according to the remote operation received from the switching device.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an image processing system, an image processing device, a remote control method, and a remote control program, and in particular, an image processing device remotely operated by a remote operation device, a remote operation device, and an image processing remotely operated by the remote operation device. The present invention relates to an image processing system including an apparatus, a remote control method and a remote control program executed by the image processing apparatus.

  2. Description of the Related Art In recent years, a technology for remotely operating a multifunction peripheral (hereinafter referred to as “MFP”) using a portable information device such as a smartphone or a tablet terminal is known. The portable information device can be connected to the MFP, and the MFP can be remotely operated by the portable information device.

  For example, in JP 2012-93940 A, the operated terminal receives from the mobile terminal a display screen control unit that creates a mobile terminal screen in which the operated terminal screen is modified based on the display attribute information of the mobile terminal. The mobile terminal includes an encoding unit that encodes the mobile terminal screen using the encoding method and an operation processing unit that executes an operation specified by position information received from the mobile terminal. When a decoding unit that decodes the terminal screen and outputs it to the touch screen and a touch operation on the touch screen displaying the mobile terminal screen is detected, position information indicating the touch position on the mobile terminal screen is displayed as its own display attribute information. And a position information correction unit for correcting the position information on the operated terminal screen based on the display attribute information of the operated terminal received from the operated terminal. There has been described.

On the other hand, when the MFP is remotely operated by a portable information device, the user who remotely operates the MFP is restricted by authenticating the user of the portable information device. In other words, the MFP gives the use authority to the pair of the portable information device and the user. Therefore, the remote operation of the MFP using the first portable information device and the remote operation of the MFP using the second portable information device by the same user are recognized as different operations in the MFP. For example, when the MFP is remotely operated by the second portable information device while the MFP is remotely operated by the first portable information device, the MFP needs to authenticate the second portable information device. It becomes. Further, when the second portable information device is authenticated by the MFP, the setting value is reset in the MFP by the remote operation by the first portable information device, so that the first portable information device and the second portable information device are reset. There is a problem that the MFP cannot be remotely operated using the two information devices.
JP 2012-93940 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to provide an image processing apparatus that facilitates remote control by a plurality of remote control devices.

  Another object of the present invention is to provide an image processing system that facilitates remote control by a plurality of remote control devices.

  Still another object of the present invention is to provide a remote control method that facilitates remote control by a plurality of remote control devices.

  Still another object of the present invention is to provide a remote control program that facilitates remote control by a plurality of remote control devices.

  In order to achieve the above object, according to one aspect of the present invention, the image processing device establishes a communication path with the first remote control device in response to a request from the first remote control device. A first communication path establishing means; a remote control means for executing processing in accordance with a remote operation received from the first remote control device; and a second remote controller different from the first remote control device to the first remote control device. A second communication path establishing means for establishing a communication path with the second remote control device in response to receiving a switching instruction for switching to the remote control device. In accordance with the remote operation received from the second remote control device, the process executed according to the remote operation received from the first remote control device before the communication path with the second remote control device is established. Continue to run.

  According to this aspect, a communication path is established between the first remote control device and the second remote control device in response to receiving a switching instruction instructing switching from the first remote control device to the second remote control device. In accordance with the remote operation received from the second remote control device, the processing executed according to the remote operation received from the first remote control device before the communication path with the second remote control device is established Continue to execute. Therefore, the device for remotely operating the image processing apparatus can be switched from the first remote operation apparatus to the second remote operation apparatus, and the remote operation of the image processing apparatus can be continued before and after the switching. As a result, it is possible to provide an image processing device that facilitates remote operation by a plurality of remote control devices.

  Preferably, the information processing apparatus further comprises authentication means for receiving authentication information of a user who operates the first remote control device, and authenticating the user based on the received authentication information, wherein the first remote operation reception means includes: On the condition that the user who operates the remote operation device is authenticated, the remote operation is received from the first remote operation device, and the second remote operation receiving means determines the user who operates the second remote operation device. A remote operation is received from the second remote control device without authentication.

  According to this aspect, on the condition that the user who operates the first remote control device is authenticated, the user who receives the remote operation from the first remote control device and operates the second remote control device Since the remote operation is received from the second remote operation device without authentication, it is possible to simplify the operation when switching the device to be remotely operated from the first remote operation device to the second remote operation device.

  Preferably, remote control screen transmission means for transmitting a remote control screen to the first remote control device or the second remote control device is further provided, and the remote control screen transmission means is connected to the second remote control device. In response to the establishment of the communication path, the same remote operation screen as the last remote operation screen transmitted to the first remote operation device is transmitted to the second remote operation device.

  According to this aspect, when a communication path is established with the second remote control device, the same remote control screen as the last remote control screen transmitted to the first remote control device is displayed. Since it is transmitted to the apparatus, the user can be notified by the second remote control device that the first remote control device has been switched.

  Preferably, when the remote operation received from the first remote control device or the remote operation received from the first remote control device is a setting operation, the remote control means sets the setting value according to the setting operation. And a setting value setting means, when a communication path is established with the second remote control device, the first remote control device before the communication path is established with the second remote control device. The setting value set according to the setting operation received from the controller device is not reset to the initial value.

  According to this aspect, when a communication path is established with the second remote control device, the setting value set according to the setting operation received from the first remote control device is not reset to the initial value. The setting value set by the user using the first remote control device can be taken over by the remote control by the second remote control device.

  Preferably, when the remote operation received from the first remote operation device or the remote operation received from the first remote operation device is an execution instruction operation instructing execution of processing, the remote control means performs the execution instruction operation. It further includes processing execution means for executing processing determined by the operation execution instruction operation using the set value set before the reception.

  According to this aspect, when the execution instruction operation is received from the first remote operation device or the second remote operation device, the process is executed using the set value set before the execution instruction operation is received. Therefore, the user can execute processing from either the first remote control device or the second remote control device.

  Preferably, when the switching instruction is received from the first remote control device, if the first remote control device and the second remote control device are not associated with each other, the second remote control device is set to the second remote control device. Confirmation means for confirming the switching to the remote operation device is further provided, and the second communication path establishment means is configured such that when the first remote operation device and the second remote operation device are not associated in advance, A communication path is established with the second remote control device on the condition that switching to the second remote control device is confirmed by the remote control device.

  According to this aspect, when a switching instruction is received from the first remote control device, the first remote control device is confirmed to switch to the second remote control device and confirmed by the first remote control device. On the condition that the communication path is established with the second remote control device, it is possible to cope with an erroneous operation by the user who operates the first remote control device.

  Preferably, when a communication path is established with the second remote operation device, association information generation means for generating association information associating the first remote operation device with the second remote operation device is provided. And further.

  According to this aspect, when a communication path is established with the second remote control device, the association information that associates the first remote control device with the second remote control device is generated. One remote control device and the second remote control device can be easily associated with each other.

  Preferably, the first communication path establishing means disconnects the communication path with the first remote control device in response to the establishment of the communication path with the second remote control device.

  According to this aspect, the communication path with the first remote control device is disconnected in response to the establishment of the communication path with the second remote control device. And a second remote control device can receive a remote control.

  Preferably, when receiving a reconnection instruction from the second remote control device, the first communication route establishment unit establishes a communication route with the first remote control device, and the second communication route establishment unit includes: In response to the establishment of the communication path with the first remote control device, the communication path with the second remote control device is disconnected, and the remote control means receives from the first remote control device. In accordance with the remote operation, the process executed according to the remote operation received from the second remote control device before the communication path is established with the first remote control device is continuously executed.

  According to this aspect, when a reconnection instruction is received from the second remote control device, a communication path is established with the first remote control device, and a communication path with the second remote control device is established. Disconnect and continue to execute the process performed according to the remote operation received from the second remote control device in accordance with the remote operation received from the first remote control device. Therefore, the device for remotely operating the image processing apparatus can be switched from the second remote operation apparatus to the first remote operation apparatus, and the remote operation of the image processing apparatus can be continued before and after the switching.

  Preferably, when receiving a reconnection instruction from the first remote control device, the second communication route establishment unit establishes a communication route with the second remote control device, and the first communication route establishment unit includes: In response to the establishment of a communication path with the second remote control device, the communication path with the first remote control device is disconnected, and the remote control means receives from the second remote control device. In accordance with the remote operation, the process executed according to the remote operation received from the first remote control device before the communication path is established with the second remote control device is continuously executed.

  According to this aspect, when a reconnection instruction is received from the first remote control device, a communication path is established with the second remote control device, and a communication path with the first remote control device is established. Disconnect and continue to execute the process performed according to the remote operation received from the first remote control device in accordance with the remote operation received from the second remote control device. Therefore, the device for remotely operating the image processing apparatus can be switched from the first remote operation apparatus to the second remote operation apparatus, and the remote operation of the image processing apparatus can be continued before and after the switching.

  According to another aspect of the present invention, an image processing system is an image processing system including the image processing device, the first remote control device, and the second remote control device, wherein the first remote control device and Each of the second remote operation devices includes communication control means for establishing a communication path with the image processing apparatus, and remote operation means for remotely operating the image processing apparatus via the established communication path. The first remote control device, after the communication control means establishes a communication path with the image processing device, sends a switching instruction including device identification information of the second remote control device via the communication route. A switching instruction means for transmitting to the apparatus is further provided.

  According to this aspect, the first remote control device establishes a communication path with the image processing device, and then issues a switching instruction including device identification information of the second remote control device via the communication route. Send to device. Therefore, it is possible to switch the device that remotely operates the image processing apparatus to the second remote operation device by operating the first remote operation device. As a result, it is possible to provide an image processing system that facilitates remote operation by a plurality of remote operation devices.

  Preferably, the second remote control device further includes identification image display means for displaying an identification image including device identification information for identifying the second remote control device, and the first remote control device further includes An image capturing unit that captures an image of an object, and an identification image obtained by the image capturing unit capturing an identification image displayed on the second remote control device are analyzed to obtain device identification information of the second remote control device. Switching device information acquisition means, and the switching instruction means of the first remote control device is configured such that after the communication control means forms a communication path with the image processing device, the second remote control device is used by the imaging means. A switching instruction including the device identification information of the second remote control device acquired by the switching device information acquisition means is transmitted to the image processing device via the communication path in response to the identification image displayed on the screen being captured. To do.

  According to this aspect, the first remote control device analyzes the identification image obtained by capturing the identification image displayed on the second remote control device, and obtains the device identification information of the second remote control device. After the communication path is acquired and formed with the image processing apparatus, a switching instruction including apparatus identification information of the second remote control apparatus is transmitted to the image processing apparatus. If the identification image displayed on the remote control device is taken, the first remote control device can be switched to the second remote control device.

  Preferably, each of the first remote control device and the second remote control device further includes short-range wireless communication means, and the first remote control device further includes the short-range wireless communication means configured by the second remote control device. And a switching device information acquisition means for acquiring device identification information of the second remote control device when communication with the device is possible. The switching control means of the first remote control device has the communication control means as the image processing device. After the communication path is established, the switching device information acquisition means acquires the device identification information of the second remote control device in response to the device identification information of the second remote control device being acquired. The switching instruction including is transmitted to the image processing apparatus via the communication path.

  According to this aspect, when the first remote control device is able to communicate with the second remote control device after establishing a communication path with the image processing device, device identification information of the second remote control device. And a switching instruction including the device identification information of the second remote control device is transmitted to the image processing device via the communication path. For this reason, if the first remote control device is brought close to the second remote device, the first remote control device can be switched to the second remote control device.

  According to still another aspect of the present invention, the remote control method establishes a communication path with the first remote control device in response to a request from the first remote control device. A remote control step for executing processing in accordance with a remote operation received from the first remote control device; and switching from the first remote control device to a second remote control device different from the first remote control device In response to receiving the switching instruction for instructing the image processing apparatus, the image processing apparatus executes a second communication path establishing step for establishing a communication path with the second remote control device. In accordance with the remote operation received from the second remote control device, the processing executed according to the remote operation received from the first remote control device is continued before the communication path with the second remote control device is established. Step to perform No.

  According to this aspect, it is possible to provide a remote control method that facilitates remote operation by a plurality of remote operation devices.

  According to still another aspect of the present invention, the remote control program establishes a communication path with the first remote control device in response to a request from the first remote control device. A remote control step for executing processing in accordance with a remote operation received from the first remote control device; and switching from the first remote control device to a second remote control device different from the first remote control device And a second communication path establishment step for establishing a communication path with the second remote control device in response to receiving the switching instruction for instructing the image processing apparatus to perform remote control. The step is performed according to the remote operation received from the second remote control device and according to the remote operation received from the first remote control device before the communication path with the second remote control device is established. Where The continued including the step of performing.

  According to this aspect, a remote control program that facilitates remote operation by a plurality of remote operation devices can be provided.

1 is a diagram showing an overall outline of an image processing system in one embodiment of the present invention. 2 is a block diagram illustrating an example of an outline of a hardware configuration of an MFP. FIG. It is a block diagram which shows the outline | summary of a structure of a portable information device. 3 is a block diagram showing an example of functions of a CPU provided in the MFP according to the present embodiment. FIG. It is a block diagram which shows an example of the outline | summary of the function of CPU with which a portable information device is provided. It is a flowchart which shows an example of the flow of a remote control process. It is a flowchart which shows an example of the flow of a remote operation reception process. It is a 1st flowchart which shows an example of the flow of a remote operation process. It is a 2nd flowchart which shows an example of the flow of a remote operation process. It is a flowchart which shows an example of the flow of a switching side remote operation process. It is a figure for demonstrating the state between an initial stage apparatus, a switching apparatus, and a remote control apparatus in a time series.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an overall outline of an image processing system according to one embodiment of the present invention. Referring to FIG. 1, an image processing system 1 includes a multifunction peripheral (hereinafter referred to as “MFP”) 100 that functions as a remote control device, a personal computer (hereinafter referred to as “PC”) 300, a wireless station 5, Mobile information devices 200 and 200A. An MFP (Multi Function Peripheral) 100, the PC 300, and the wireless station 5 are connected to the network 3. The portable information devices 200 and 200 </ b> A are connected to the network 3 through the wireless station 5.

  The network 3 is a local area network (LAN), and the connection form may be wired or wireless. The network 3 is not limited to a LAN, and may be a wide area network (WAN), a public switched telephone network (PSTN), the Internet, or the like.

  The PC 300 is a general computer. The PC 300 is installed with a printer driver program corresponding to the MFP 100, and by executing the printer driver program, the MFP 100 can be controlled to cause the MFP 100 to execute image forming processing, document reading processing, and the like. .

  The portable information devices 200 and 200A are computers that are carried and used by users, such as PDAs (Personal Digital Assistants) such as smartphones and tablet terminals. The size of the display surface of portable information device 200 is smaller than the size of the display surface of portable information device 200A. The portable information device 200 is, for example, a smartphone, and the portable information device 200A is, for example, a tablet terminal. The hardware configurations and functions of the portable information device 200 and the portable information device 200A are different in the size of the display surface, but the basic configuration and functions are the same. Here, the portable information device 200 will be described as an example unless otherwise specified.

  In image processing system 1 according to the present embodiment, portable information devices 200 and 200A can remotely operate MFP 100. In this case, portable information devices 200 and 200A each function as a remote control device that remotely controls MFP 100, and MFP 100 functions as a remote control device that is remotely controlled by one of portable information devices 200 and 200A. In portable information devices 200 and 200A, a remote operation program for remotely controlling MFP 100 is installed. On the other hand, the MFP 100 is installed with a remote control program that is remotely controlled by the portable information device 200 or the portable information device 200A and executes processing.

  Here, an apparatus for remotely operating MFP 100 while user A is remotely operating MFP 100 using portable information device 200 while portable information device 200 and portable information device 200A can be operated simultaneously. A case where the portable information device 200 is switched to the portable information device 200A will be described as an example.

  In the present embodiment, a case where a remote operation program for remotely controlling MFP 100 is installed in portable information device 200 and portable information device 200A will be described as an example, but a remote operation program for remotely controlling MFP 100 is described. May be installed in the PC 300. In this case, the user can remotely control MFP 100 using PC 300 as in the case of remotely controlling MFP 100 using portable information devices 200 and 200A.

  FIG. 2 is a block diagram illustrating an example of an outline of the hardware configuration of the MFP. Referring to FIG. 2, MFP 100 includes a main circuit 110, a document reading unit 130 for reading a document, an automatic document feeder 120 for transporting a document to document reading unit 130, and a document reading unit 130. An image forming unit 140 for forming an image on a sheet or the like based on image data output by reading the image, a sheet feeding unit 150 for supplying the image to the image forming unit 140, and processing the sheet on which the image is formed A post-processing unit 155 and an operation panel 160 as a user interface.

  The post-processing unit 155 executes a sorting process for sorting and discharging one or more sheets on which images are formed by the image forming unit 140, a punching process for punch hole processing, and a staple process for driving staple needles.

  The main circuit 110 includes a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a mass storage device, a facsimile unit 116, and a CD-ROM (Compact Disk). ROM) 118 is mounted on the external storage device 117. CPU 111 is connected to automatic document feeder 120, document reading unit 130, image forming unit 140, paper feeding unit 150, post-processing unit 155, and operation panel 160, and controls the entire MFP 100.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 includes a set value storage area and a screen storage area. The set value storage area is an area for storing a set value for executing processing. The screen storage area is an area for storing an operation screen and a remote operation screen displayed on the display unit 161. The RAM 114 temporarily stores read data (image data) continuously sent from the document reading unit 130.

  Communication I / F unit 112 is an interface for connecting MFP 100 to network 3. The CPU 111 communicates with the PC 300 or the portable information devices 200 and 200A via the communication I / F unit 112 to transmit and receive data. The communication I / F unit 112 can communicate with a computer connected to the Internet via the network 3.

  The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to the PSTN or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or outputs it to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 116 on a sheet. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN.

  The external storage device 117 is loaded with a CD-ROM 118. The CPU 111 can access the CD-ROM 118 via the external storage device 117. The CPU 111 loads the program recorded on the CD-ROM 118 attached to the external storage device 117 to the RAM 114 and executes it. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, but an optical disc (MO (Magnetic Optical disc) / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, It may be a semiconductor memory such as a mask ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM).

  Further, the program executed by the CPU 111 is not limited to the program recorded on the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network 3 may rewrite the program stored in the HDD 115 of the MFP 100 or may add a new program and write it. Further, MFP 100 may download a program from another computer connected to network 3 and store the program in HDD 115. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  Operation panel 160 is provided on the upper surface of MFP 100. Operation panel 160 includes a display unit 161 and an operation unit 163. The display unit 161 is, for example, a liquid crystal display device (LCD), and displays an instruction menu for a user, information about acquired image data, and the like.

  The operation unit 163 includes a touch panel 165 and a hard key unit 167. The touch panel 165 is provided to overlap the display unit 161 on the upper surface or the lower surface of the display unit 161. Hard key portion 167 includes a plurality of hard keys. The hard key is, for example, a contact switch. The touch panel 165 detects a position designated by the user on the display surface of the display unit 161. When the user operates the MFP 100, the user often takes an upright posture, and thus the display surface of the display unit 161, the operation surface of the touch panel 165, and the hard key unit 167 are arranged facing upward. This is because the user can easily visually recognize the display surface of the display unit 161 and the user can easily instruct the operation unit 163 with a finger.

  FIG. 3 is a block diagram showing an outline of the configuration of the portable information device. Referring to FIG. 3, portable information device 200 in the present embodiment includes a CPU 201 for controlling the entire portable information device 200, a camera 202, a flash memory 203 for storing data in a nonvolatile manner, and a calling unit. 205, a wireless communication unit 204 connected to 205, a display unit 206 that displays information, an operation unit 207 that accepts user operations, a wireless LAN I / F 208, a short-range communication unit 209, an acceleration sensor 210, and an external storage Device 211.

  The flash memory 203 stores a program executed by the CPU 201 or data necessary for executing the program. The CPU 201 loads the program recorded in the flash memory 203 to the RAM included in the CPU 201 and executes it. The flash memory 203 stores device identification information for identifying the portable information device 200 and user identification information for identifying a user assigned as a user who uses the portable information device 200.

  The display unit 206 is a display device such as a liquid crystal display (LCD) or an organic ELD, and displays an instruction menu for a user, information about acquired image data, and the like. The operation unit 207 includes a main key 207A and a touch panel 207B. When the user instructs the display surface of the display unit 206, the operation unit 207 outputs the position of the display surface detected by the touch panel 207B to the CPU 201. Based on the position detected by the touch panel 207B, the CPU 201 detects a position designated by the user in the screen displayed on the display unit 206. Based on the screen displayed on the display unit 206 and the position detected by the touch panel 207 </ b> B, the CPU 201 accepts input of various instructions, data such as characters and numbers by user operations. For example, when a screen including a numeric keypad image is displayed on the display unit 206, a number corresponding to the key displayed at the position detected by the touch panel 207B is received.

  The camera 202 includes a lens and a photoelectric conversion element. The light focused by the lens is imaged on the photoelectric conversion element. The photoelectric conversion element photoelectrically converts the received light and outputs image data to the CPU 201. The photoelectric conversion element is a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge Coupled Device) sensor, or the like.

  The wireless communication unit 204 performs wireless communication with a mobile phone base station connected to a telephone communication network. The wireless communication unit 204 connects the portable information device 200 to a telephone communication network and enables a call using the call unit 205. The radio communication unit 204 decodes a voice signal obtained by demodulating the radio signal received from the mobile phone base station and outputs the decoded signal to the call unit 205. Further, the wireless communication unit 204 encodes the voice input from the call unit 205 and transmits it to the mobile phone base station. The call unit 205 includes a microphone and a speaker, and outputs the sound input from the wireless communication unit 204 from the speaker, and outputs the sound input from the microphone to the wireless communication unit 204. Further, the wireless communication unit 204 is controlled by the CPU 201, connects the portable information device 200 to an electronic mail server, and transmits and receives electronic mail.

  The wireless LAN I / F 208 is an interface for communicating with the wireless station 5 and connecting the portable information device 200 to the network 3. For example, the wireless LAN I / F 208 is an interface that performs wireless communication based on the Wi-Fi standard. By registering the IP (Internet Protocol) addresses of PC 300 and MFP 100 in portable information device 200, portable information device 200 can communicate with PC 300 and MFP 100, and data can be transmitted and received.

  The short-range communication unit 209 performs wireless communication with the portable information device 200A based on the Bluetooth (registered trademark) standard GAP (Generic Access Profile) or the like. Further, the short-range communication unit 209 may perform communication using a NFC (Near Field Communication) short-range wireless communication method. The short-range communication unit 209 communicates with the portable information device 200A when the distance to the portable information device 200A is equal to or less than a communicable distance. The distance that the short-range communication unit 209 can communicate is several centimeters.

  When PC 300 and MFP 100 are equipped with a short-range wireless device capable of communicating with short-range communication unit 209, portable information device 200 communicates with one of PC 300, MFP 100, 100A, and 100B on a one-to-one basis. You may do it.

  The acceleration sensor 210 is a triaxial acceleration sensor that measures accelerations in three directions of the X axis, the Y axis, and the Z axis. The acceleration sensor 210 outputs the detected acceleration to the CPU 201.

  The external storage device 211 is detachable from the portable information device 200, and a CD-ROM 211A storing a remote operation program can be attached thereto. The CPU 201 can access the CD-ROM 211A via the external storage device 211. The CPU 201 can load a remote operation program recorded on the CD-ROM 211A attached to the external storage device 211 into a RAM included in the CPU 201 and execute it.

  Although the program recorded in the flash memory 203 or the CD-ROM 211A has been described as a program executed by the CPU 201, a program in which another computer connected to the network 3 rewrites the program stored in the flash memory 203, Alternatively, it may be a new program written additionally. Further, the portable information device 200 may be a program downloaded from another computer connected to the network 3. The program here includes not only a program directly executable by the CPU 201 but also a source program, a compressed program, an encrypted program, and the like.

  The medium for storing the program executed by the CPU 201 is not limited to the CD-ROM 211A, and may be a semiconductor memory such as an optical disk (MO / MD / DVD), IC card, optical card, mask ROM, EPROM, or EEPROM. Good.

  FIG. 4 is a block diagram illustrating an example of functions of the CPU provided in the MFP according to the present embodiment. The functions shown in FIG. 4 are functions formed in CPU 111 when CPU 111 provided in MFP 100 executes a remote control program stored in ROM 113, HDD 115, and CD-ROM 118. Referring to FIG. 4, CPU 111 includes connection control unit 51, authentication unit 53, operation reception unit 55, remote operation screen transmission unit 57, remote control unit 59, switching instruction reception unit 61, and reconnection. An instruction receiving unit 63, an association unit 65, and a confirmation unit 67 are included.

  The connection control unit 51 controls the communication I / F unit 112, and when the communication I / F unit 112 receives a connection request from one of the portable information devices 200 and 200A, the connection control unit 51 issues a connection request from the portable information devices 200 and 200A. A communication path is established with the transmitting apparatus. A device whose communication path is established by the connection control unit 51 is referred to as a connected device. The connection control unit 51 sets a set of path identification information for identifying a communication path established with the currently connected apparatus and apparatus identification information for identifying the currently connected apparatus as an operation receiving unit 55 and a remote operation. The data is output to the screen transmission unit 57.

  When the combination of the path identification information and the device identification information is input from the connection control unit 51, the operation receiving unit 55 controls the communication control unit 112 and identifies the device via the communication path specified by the path identification information. A remote operation transmitted from the connected device specified by the information is received. In response to receiving a remote operation from the connected device, the operation receiving unit 55 outputs a set of operation identification information and device identification information for identifying the remote operation to the remote control unit 59.

  The remote operation screen transmission unit 57 receives a set of route identification information and device identification information from the connection control unit 51, controls the communication I / F unit 112, and passes the communication path specified by the route identification information. The remote operation screen is transmitted to the connected apparatus specified by the apparatus identification information.

  Remote control unit 59 receives a set of operation identification information and device identification information for identifying a remote operation from operation reception unit 55, and executes processing according to the remote operation. Remote control unit 59 includes a setting unit 81, a process execution unit 83, and a remote operation screen generation unit 85.

  The remote operation that the connected apparatus transmits to the MFP 100 includes a setting operation for setting a setting value, a screen transition operation for instructing switching of the remote operation screen to another remote operation screen, and an execution instruction operation for instructing execution of processing. ,including. When the remote operation received after the remote operation screen is transmitted includes the position information, the operation reception unit 55 is based on the position information and the remote operation screen transmitted to the remote operation device by the remote operation screen transmission unit 57. To detect remote operation. Specifically, if the position specified in the remote operation screen is within the transition button included in the remote operation screen based on the position information, the screen transition operation is specified. If the position specified on the remote operation screen by the position information is within an area to which a command for setting a setting value is assigned, the setting operation is specified. If the position specified on the remote operation screen by the position information is within the area of the button to which the execution command is assigned, the execution instruction operation is specified. Here, the remote operation is specified from the position on the remote operation screen, but the connected device may transmit the remote operation in a form that can distinguish the screen transition operation, the setting operation, and the function execution operation. For example, the remote operation device may transmit a remote operation command corresponding to each of the screen transition operation, the setting operation, and the function execution operation.

  The setting unit 81 sets a setting value according to the setting operation when a set of operation identification information and device identification information of the setting operation is input from the operation receiving unit 55. The setting operation includes a setting item and a setting value. The setting unit 81 sets a setting value included in the setting operation to a setting item included in the setting operation. When setting the setting value, setting unit 81 outputs a generation instruction including device identification information to remote operation screen generation unit 85.

  The remote operation screen generation unit 85 generates the same remote operation screen as the previously generated remote operation screen in response to the generation instruction input from the setting unit 81, and includes the generated remote operation screen and the generation instruction. The device identification information set is output to the remote operation screen transmission unit 57. The remote operation screen generated based on the generation instruction input from the setting unit 81 by the remote operation screen generating unit 57 includes a value after the set value is updated. For this reason, a remote operation screen including the value after the set value is updated is transmitted to the connected device and displayed on the remote operation device.

  The remote operation screen generation unit 85 generates and generates a remote operation screen determined by the screen transition operation in response to the input of the operation identification information and device identification information of the screen transition operation from the operation reception unit 55. The remote operation screen and the device identification information input from the operation receiving unit 55 are output to the remote operation screen transmitting unit 57. For this reason, the remote operation screen determined by the screen transition operation is transmitted to the connected apparatus, and the remote operation screen is displayed on the connected apparatus.

  Process execution unit 83 executes a process corresponding to the mounting function of MFP 100. The process execution unit 83 uses the set value set in the setting unit 81 in response to the input of the operation identification information of the execution instruction operation and the device identification information from the operation reception unit 55, and executes the execution instruction operation. The process determined by is executed. The mounting functions are, for example, an image processing function for processing an image, an image forming function for forming an image, a post-processing function for processing a sheet on which an image is formed, and an output function for outputting data. The image processing function includes, for example, an OCR function for recognizing characters in an image and an aggregation function for converting a plurality of images into one image. The image forming function includes, for example, a monochrome printing function for forming an image in monochrome, a color printing function for forming an image in color, and a double-sided printing function for forming an image on both sides of a sheet. The post-processing function includes, for example, a punching function for punching holes in a sheet, a stapling function for driving staples into a plurality of sheets, and a folding function for folding sheets. The output function includes, for example, a FAX function for transmitting data by facsimile, a storage function for storing data in a recording medium such as the HDD 115, and a transmission function for controlling the communication I / F unit 112 to transmit data to the outside.

  The connection control unit 51 includes a first communication path establishment unit 71 and a second communication path establishment unit 73. The first communication path establishment unit 71 controls the communication I / F unit 112, and when the communication I / F unit 112 receives a connection request from the remote operation device, the first communication path establishment unit 71 is connected on the condition that the authentication by the authentication unit 53 is successful. A communication path is established with the remote control device that has transmitted the request. Specifically, the first communication path establishing unit 71 controls the communication I / F unit 112, and when the communication I / F unit 112 receives a connection request from the remote operation device, the first communication route establishment unit 71 communicates with the remote operation device. And the path identification information of the communication path is output to the authentication unit 53.

  The authentication unit 53 controls the communication I / F unit 112 in response to the input of the route identification information from the first communication route establishment unit 71, and performs remote operation via the communication route specified by the route identification information. An authentication screen for inputting authentication information is transmitted to the apparatus, and authentication information returned from the remote control apparatus is received. Here, the authentication information is a set of a user ID and a password for identifying the user. The authentication information is not limited to this, and biometric information such as fingerprints and irises may be used. The authentication unit 53 authenticates the remote operation device if the same authentication information as the authentication information received from the remote operation device is registered, but the same authentication information as the authentication information received from the remote operation device is registered. Otherwise, the remote control device is not authenticated. The authentication unit 53 outputs the authentication result to the first communication path establishment unit 71.

  When the authentication result input from the authentication unit 53 indicates that the authentication is successful, the first communication path establishment unit 71 sets the remote operation device that has transmitted the connection request as the initial device, and The route identification information for identifying the established communication route and the device identification information of the initial device are output to the operation reception unit 55, the switching instruction reception unit 61, the reconnection instruction reception unit 63, and the remote operation screen transmission unit 57. The device identification information of the initial device is output to the associating unit 65. Here, a case where the initial device is the portable information device 200 will be described as an example. While the first communication path establishment unit 71 establishes a communication path with the initial device, the initial device is a connected device. Therefore, while the first communication path establishing unit 71 establishes a communication path with the initial device, the operation receiving unit 55 receives a remote operation from the initial device, and the remote operation screen transmitting unit 57 is the initial device. Send remote control screen to.

  When the first set of route identification information and device identification information is first input from the first communication path establishing unit 71, in other words, the remote operation screen transmission unit 57 is connected to the initial device by the first communication path establishing unit 71. When a communication path is established between the two, a remote operation screen defined as a default as an initial screen is read from the HDD 116, and the read remote operation screen is specified by path identification information by controlling the communication I / F unit 112. Is transmitted to the initial device specified by the device identification information via the communication path.

  The switching instruction receiving unit 61 receives a set of route identification information and device identification information from the first communication route establishing unit 71, and then controls the communication I / F unit 112 to identify the communication specified by the route identification information. A switching instruction is received from the initial device specified by the device identification information via the path. The switching instruction is a signal instructing switching to a switching device (second remote control device) different from the initial device, and includes device identification information for identifying the switching device. Here, a case where the switching device is the portable information device 200A will be described as an example. In this case, portable information device 200 as the initial device transmits a switching instruction including device identification information of portable information device 200 </ b> A as the switching device to MFP 100. In response to receiving the switching instruction, the switching instruction receiving unit 61 outputs the path identification information input from the first communication path establishing unit 71 and the confirmation instruction to the confirmation unit 67. The confirmation instruction includes device identification information of the initial device that has transmitted the switching instruction, and device identification information of the switching device included in the switching instruction.

  The confirmation unit 67 associates the initial device and the switching device specified by the two device identification information included in the confirmation instruction in response to the input of the route identification information and the confirmation instruction from the switching instruction reception unit 61. It is judged by the part 65 whether it is linked | related. As will be described later, when the association unit 65 associates two devices, the association unit 65 generates association information including device identification information of each of the two devices and stores the association information in the HDD 116. If association information including identification information and device identification information of the switching device is stored in HDD 116, it is determined that the initial device and the switching device are associated with each other, and such association information is stored in HDD 116. If not, it is determined that the initial device and the switching device are not associated with each other. When the confirmation unit 67 determines that the initial device and the switching device are associated with each other, the confirmation unit 67 outputs an establishment instruction to the second communication path establishment unit 73. The establishment instruction includes device identification information of the switching device.

  Further, when the confirmation unit 67 determines that the initial device and the switching device are not associated with each other, the confirmation unit 67 controls the communication I / F unit 112 and is specified by the route identification information input from the switching instruction receiving unit 61. A confirmation screen is transmitted to the initial device via the communication path. The confirmation screen is a screen for requesting confirmation of switching to the switching device, a “Yes” button to which a command indicating confirmation is assigned, and a “No” button to which a command indicating denial is assigned, including. The initial device returns a confirmation signal when the user designates the “Yes” button, and returns a denial signal when the user designates the “No” button. The confirmation unit 67 controls the communication I / F unit 112 to receive a confirmation signal from the initial device via the communication path specified by the path identification information input from the switching instruction reception unit 61. When the establishment instruction including the device identification information of the switching device is output to the communication path establishment unit 73 and a denial signal is received from the initial device, the establishment instruction is not output to the second communication path establishment unit 73.

  When the establishment instruction is input from the confirmation unit 67, the second communication path establishment unit 73 controls the communication I / F unit 112 to transmit a connection request to the switching device, and to establish a communication path with the switching device. Establish. When the second communication path establishing unit 73 establishes the communication path with the switching device, the second communication path establishing unit 73 outputs a disconnection instruction to the first communication path establishing unit 71 and the path identification information of the communication path established with the switching device. And the device identification information of the switching device are output to the operation receiving unit 55, the switching instruction receiving unit 61, the reconnection instruction receiving unit 63, and the remote operation screen transmitting unit 57, and the device identification information of the switching device is output to the association unit 65. Is output. When a disconnection instruction is input from the second communication path establishment unit 73, the first communication path establishment unit 71 disconnects the communication path established with the initial device. While the communication path is established with the switching device by the second communication path establishing unit 73, the switching device is a connected device. Therefore, while the second communication path establishing unit 73 establishes a communication path with the switching device, the operation receiving unit 55 receives a remote operation from the switching device, and the remote operation screen transmitting unit 57 is the switching device. Send remote control screen to.

  The remote operation screen transmission unit 57 receives a set of route identification information and device identification information from the first communication route establishment unit 71 and then sets a combination of route identification information and device identification information from the second communication route establishment unit 73. Is input to the initial device, the remote operation screen is added to the same remote operation screen as the last remote operation screen transmitted to the initial device, and the communication I / F unit 112 is controlled. Then, the data is transmitted to the switching device via the communication path specified by the path identification information input from the second communication path establishing unit 73.

  The association unit 65 switches to the initial device when the device identification information of the switching device is input from the second communication path establishment unit 73 after the device identification information of the initial device is input from the first communication path establishment unit 71. Associate the device. Specifically, the associating unit 65 generates association information including the device identification information of the initial device and the device identification information of the switching device, and stores the generated association information in the HDD 116.

  The reconnection instruction receiving unit 63 receives a pair of the path identification information of the communication path established between the second communication path establishment unit 73 and the switching device and the device identification information of the switching device, and then receives the communication I / F. The control unit 112 is controlled to receive a reconnection instruction from the switching device specified by the device identification information via the communication path specified by the route identification information. The reconnection instruction receiving unit 63 outputs a reconnection instruction to the first communication path establishing unit 71 in response to receiving the reconnection instruction from the switching device.

  The first communication path establishing unit 71 controls the communication I / F unit 112 in response to the input of the reconnection instruction from the reconnection instruction receiving unit 63, and transmits a connection request to the initial device. Establish a communication path with When the first communication path establishing unit 71 establishes a communication path with the initial device, the first communication path establishing unit 71 outputs a disconnection instruction to the second communication path establishing unit 73 and the path identification information of the communication path established with the initial device. And the device identification information of the switching device are output to the operation receiving unit 55, the switching instruction receiving unit 61, the reconnection instruction receiving unit 63, and the remote operation screen transmitting unit 57.

  The remote operation screen transmission unit 57 receives the combination of the route identification information and the device identification information from the second communication route establishment unit 73 and then sets the combination of the route identification information and the device identification information from the first communication route establishment unit 71. In response to the input, the communication I / F unit 112 is controlled with a remote operation screen in which a button for accepting a reconnection instruction is added to the same remote operation screen as the last remote control screen transmitted to the switching device. And transmitted to the initial device via the communication path specified by the path identification information input from the first communication path establishing unit 71.

  When a disconnection instruction is input from the first communication path establishment unit 71, the second communication path establishment unit 73 disconnects the communication path established with the switching device. Therefore, while the first communication path establishing unit 71 establishes a communication line with the initial device, the operation receiving unit 55 receives a remote operation from the initial device, and the remote operation screen transmitting unit 57 is the initial device. Send remote control screen to.

  The reconnection instruction receiving unit 63 outputs the reconnection instruction to the first communication path establishing unit 71, and then the path identification information of the communication path established between the first communication path establishing unit 71 and the initial apparatus and the initial apparatus A set with device identification information is input. After the reconnection instruction receiving unit 63 outputs the reconnection instruction to the first communication path establishing unit 71, the communication I / F unit 112 receives the reconnection instruction via the communication path established with the initial device. There is a case. The reconnection instruction receiving unit 63 outputs a reconnection instruction to the second communication path establishing unit 73 in response to receiving the reconnection instruction.

  The second communication path establishing unit 73 controls the communication I / F unit 112 in response to the input of the reconnection instruction from the reconnection instruction receiving unit 63, and transmits a connection request to the switching device. Establish a communication path with When the second communication path establishing unit 73 establishes the communication path with the switching device, the second communication path establishing unit 73 outputs a disconnection instruction to the first communication path establishing unit 71 and the path identification information of the communication path established with the switching device. And the device identification information of the switching device are output to the operation receiving unit 55, the switching instruction receiving unit 61, the reconnection instruction receiving unit 63, and the remote operation screen transmitting unit 57.

  The remote operation screen transmission unit 57 receives a set of route identification information and device identification information from the first communication route establishment unit 71 and then sets a combination of route identification information and device identification information from the second communication route establishment unit 73. Is input to the initial device, the remote operation screen is added to the same remote operation screen as the last remote operation screen transmitted to the initial device, and the communication I / F unit 112 is controlled. Then, the data is transmitted to the switching device via the communication path specified by the path identification information input from the second communication path establishing unit 73.

  FIG. 5 is a block diagram illustrating an example of an outline of functions of a CPU provided in the portable information device. The functions shown in FIG. 5 are functions formed in the CPU 201 when the CPU 201 included in the portable information device 200 executes a remote operation program stored in the flash memory 203 or the CD-ROM 211A. Referring to FIG. 5, CPU 201 includes communication control unit 251, remote operation screen reception unit 253, image display control unit 255, operation reception unit 257, remote operation transmission unit 259, and identification image display control unit 261. And an identification information transmission unit 263, a switching device information acquisition unit 265, and a switching instruction unit 267.

  The communication control unit 251 establishes a communication path with a remote control device that is a target of remote operation. Specifically, communication control unit 251 controls wireless LAN I / F 208 to perform remote control when the user operates operation unit 207 and inputs an instruction as a remote control device to be remotely operated by MFP 100. A connection request is transmitted to the device, and a communication path with the remote control device is established. When the communication control unit 251 establishes a communication route with the remote control device, the communication control unit 251 outputs route identification information of the communication route to the remote operation screen reception unit 253, the remote operation transmission unit 259, and the switching instruction unit 267.

  When the route identification information is input from the communication control unit 251, the remote operation screen receiving unit 253 controls the wireless LAN I / F 208, and the wireless LAN I / F 208 is a communication route specified by the route identification information from the remote control device. Receive remote operation screen. The remote operation screen receiving unit 253 outputs the received remote operation screen to the image display control unit 255. The image display control unit 255 controls the display unit 206 and displays an image of the remote operation screen on the display unit 206 in response to the input of the remote operation screen.

  The operation reception unit 257 controls the operation unit 207 and receives an operation input by the user to the operation unit 207. The operation accepting unit 257 accepts a remote operation when the user instructs the touch panel 207B included in the operation unit 207 in a state where the remote operation screen is displayed on the display unit 206 by the image display control unit 255. Specifically, the operation reception unit 257 determines position information indicating a position in the remote operation screen displayed on the display unit 206 based on the position detected by the touch panel 207B, and performs a remote operation including the position information. Is output to the remote control transmission unit 259.

  When a remote operation is input from the operation receiving unit 257, the remote operation transmission unit 259 controls the wireless LAN I / F 208 and transmits the remote operation to the MFP 100, which is a remote control device, via a communication path specified by the path identification information. Send.

  The switching device information acquisition unit 265 acquires device identification information of the switching device. The switching device information acquisition unit 265 outputs a transmission instruction to the switching instruction unit 267 when acquiring the device identification information of the switching device. The transmission instruction includes device identification information of the switching device.

  The switching device information acquisition unit 265 includes a short distance control unit 269 and an imaging control unit 271. The short-range control unit 269 controls the short-range communication unit 209, and when the short-range communication unit 209 can communicate with another device, here, the portable information device 200A, the device identification information of the portable information device 200A is stored as the portable information. Obtained from device 200A. The short-range control unit 269 acquires device identification information of the portable information device 200A as device identification information of the switching device.

  The imaging control unit 271 controls the camera 202, analyzes an image output by the camera 202 imaging a subject, and acquires device identification information of the switching device. For example, the portable information device 200A, which is a switching device, displays the two-dimensional barcode including the device identification information of the portable information device 200A on the display unit 206 of the own device, and is carried by the portable information device 200 with the camera 202. The two-dimensional barcode displayed on the information device 200A is imaged. Since the camera 202 outputs the image of the two-dimensional barcode, the device identification information of the portable information device 200A is acquired by analyzing the image.

  The switching instruction unit 267 receives the route identification information from the communication control unit 251. The switching instruction unit 267 controls the wireless LAN I / F 208 in response to the transmission instruction input from the switching device information acquisition unit 265, and transmits the switching instruction including the device identification information of the switching device included in the transmission instruction. The data is transmitted to MFP 100 that is a remote control device through a communication path specified by the identification information.

  The identification image display control unit 261 and the identification information transmission unit 263 are functions formed in the CPU 201 when the remote operation device functions as a switching device. Here, when the portable information device 200A functions as a switching device, the identification image display control unit 261 and the identification information transmission unit 263 included in the CPU 201 included in the portable information device 200A will be described. The operation receiving unit 257 outputs a display instruction to the identification image display control unit 261 when receiving an operation for instructing display of the identification image. The identification image display control unit 261 controls the display unit 206 in response to a display instruction input from the operation reception unit 257 and displays an image including the device identification information of the own device on the display unit 206. The image including the device identification information of the own device is, for example, a two-dimensional barcode such as a QR code (registered trademark). When the identification image display control unit 261 displays an image including the device identification information of the portable information device 200 </ b> A on the display unit 206, the identification image display control unit 261 outputs a connection instruction to the communication control unit 251.

  The identification information transmission unit 263 controls the short-range communication unit 209, and when the short-range communication unit 209 can communicate with another device, here, the portable information device 200 which is an initial device, the device identification of the portable information device 200A. Information is transmitted to portable information device 200. When the identification information transmission unit 263 transmits the device identification information of the portable information device 200 </ b> A to the portable information device 200, the identification information transmission unit 263 outputs a connection instruction to the communication control unit 251.

  When a connection instruction is input from the identification image display control unit 261 or the identification information transmission unit 263, the communication control unit 251 controls the wireless LAN I / F 208 to establish a communication path with the remote control device. Specifically, when wireless LAN I / F 208 receives a connection request from MFP 100 that is a remote control device, it establishes a communication path with the remote control device. When the communication control unit 251 establishes a communication route with the remote control device, the communication control unit 251 outputs route identification information of the communication route to the remote operation screen reception unit 253, the remote operation transmission unit 259, and the switching instruction unit 267.

  FIG. 6 is a flowchart illustrating an example of the flow of remote control processing. The remote control process is a process executed by CPU 111 when CPU 111 provided in MFP 100 executes a remote control program stored in ROM 113, HDD 115, and CD-ROM 118. Referring to FIG. 6, CPU 111 determines whether a connection request has been received (step S01). It is determined whether communication I / F unit 112 has received a connection request from either portable information device 200 or 200A. The process waits until a connection request is received (NO in step S01). If a connection request is received (YES in step S01), the process proceeds to step S02. Here, a case where a connection request is received from portable information device 200 will be described as an example.

  In step S02, the device that has transmitted the connection request, here, portable information device 200 is set as the initial device. In the next step S03, a communication path is established with the initial device, and the process proceeds to step S04. In step S04, an authentication screen is transmitted to the initial device. Then, authentication information is received from the initial device (step S05). In step S06, authentication is performed based on the received authentication information, and it is determined whether authentication is successful. If the authentication information is registered in advance, the authentication is successful. If the authentication is successful, the process proceeds to step S08; otherwise, the process proceeds to step S07. In step S07, the communication path established in step S03 is disconnected, and the process returns to step S01.

  In step S08, an initial screen is determined as a remote operation screen to be transmitted to the initial device, and the process proceeds to step S09. In step S09, a remote operation reception process is executed, and the process proceeds to step S10. Although details of the remote operation reception process will be described later, this is a process of transmitting a remote operation screen to the connected apparatus and receiving the remote operation. The connected device is a device that has established a communication path. When the process proceeds from step S08, the connected apparatus is the initial apparatus specified in step S02. When the process proceeds from step S11, step S13, or step S16, the connected apparatus determines that the connected apparatus is an initial apparatus and a switching apparatus. Either.

  In step S10, as a result of executing the remote operation reception process, the process is branched by the remote operation received from the connected apparatus. If the remote operation is a screen transition operation, the process proceeds to step S11. If the remote operation is a setting operation, the process proceeds to step S12. If the remote operation is an execution instruction operation, the process proceeds to step S14. If so, the process proceeds to step S17.

  In step S11, a remote operation screen specified by the screen transition operation is generated, and the process returns to step S09. In step S09, when the process proceeds from step S09, the remote operation reception process is executed with the remote operation screen generated in step S09 as a processing target.

  In step S12, a set value is set according to the setting operation. Specifically, the setting value included in the setting operation is set in the setting item included in the setting operation. In the next step S13, the same remote operation screen as previously transmitted is generated, and the process returns to step S09. Since the remote operation screen after the setting value is set is generated, when the setting value is included in the remote operation screen, the remote operation screen including the changed setting value is generated. In step S09, when the process proceeds from step S13, the remote operation reception process is executed with the remote operation screen generated in step S13 as a processing target.

  In step S14, the process is executed according to the execution instruction operation, and the process proceeds to step S15. In step S15, a remote operation screen to be displayed on the connected device after executing the process is determined, and the process proceeds to step S16. For example, the remote operation screen for notifying the result of executing the function is determined. In step S16, the determined remote operation screen is generated, and the process returns to step S09. In step S09, when the process proceeds from step S16, the remote operation reception process is executed using the remote operation screen generated in step S16 as a processing target.

  In step S17, the communication path established with the connected device is disconnected, and the process returns to step S01.

  FIG. 7 is a flowchart illustrating an example of the flow of remote operation reception processing. The remote operation reception process is a process executed in step S09 in FIG. Referring to FIG. 7, CPU 111 transmits a remote operation screen set as a processing target to the connected apparatus. Specifically, the communication I / F unit 112 is controlled to transmit a remote operation screen via a communication path established with the currently connected device. When the remote operation reception process is executed first, the connected device is the initial device. In this case, a remote operation screen is transmitted to the initial device via the communication path established with the initial device in step S03 of FIG. When the remote operation reception process is executed after the second time, the connected device is either the initial device or the switching device. In this case, the remote operation screen is transmitted to the initial device via the communication path established with the initial device in step S03 in FIG. 6 or the communication route established with the initial device in step S35. Alternatively, a remote operation screen is transmitted to the switching device via the communication path established with the switching device in step S28 or step S39 described later.

  In the next step S22, it is determined whether or not a remote operation has been received from the connected device. If a remote operation is received from the connected device, the process returns to the remote control process. If not, the process proceeds to step S23.

  In step S23, it is determined whether a switching instruction is received from the initial device. If a switching instruction is received, the process proceeds to step S24; otherwise, the process proceeds to step S33. In step S24, a switching device is determined. The device specified by the device identification information included in the switching instruction is determined as the switching device.

  In the next step S25, it is determined whether or not the switching device is associated with the initial device. In step S31 to be described later, if the association information stored in the HDD 116 includes association information including device identification information of the initial device and the switching device, it is determined that the switching device is associated with the initial device. If the switching device is associated with the initial device, the process proceeds to step S28; otherwise, the process proceeds to step S26.

  In step S26, a confirmation screen is transmitted to the initial device. And it is judged whether the confirmation signal was received from the initial stage apparatus. If a confirmation signal is received, the process proceeds to step S28; otherwise, the process returns to step S22.

  In step S28, a communication path is established with the switching device. Specifically, the communication I / F unit 112 is controlled, a connection request is transmitted to the switching device, and a communication path is established with the connection device. Note that a connection request may be transmitted from the switching device, and a communication path may be established with the connection device when the communication I / F unit 112 receives the connection request. In the next step S29, the communication path established with the initial device in step S03 of FIG. 6 is disconnected, and the process proceeds to step S30.

  In step S30, association information for associating the initial device with the switching device is generated. Association information including device identification information of the initial device and the switching device is generated. Then, the association information generated in the HDD 116 is stored (step S31), and the process proceeds to step S32. In step S32, a remote operation screen in which a button for accepting a reconnection instruction is added to the same remote operation screen as the last remote operation screen transmitted to the initial device in step S21 is transmitted to the switching device, and the process is performed in step S22. Return to.

  In step S33, it is determined whether a reconnection instruction has been received. The reconnection instruction is received after switching from the initial device to the switching device, and may be received from the switching device or received from the initial device. If a reconnection instruction is received, the process proceeds to step S34; otherwise, the process returns to step S22. In step S34, it is determined whether or not the device that has transmitted the reconnection instruction is a switching device. If so, the process proceeds to step S35; otherwise, the process proceeds to step S38. In step S35, a communication path is established with the initial device, and the process proceeds to step S36. In step S36, the communication path established with the switching device is disconnected, and the process proceeds to step S37. In step S37, a remote operation screen in which a button for accepting a reconnection instruction is added to the same remote operation screen as the last remote operation screen transmitted to the switching device is transmitted to the initial device, and the process returns to step S22.

  When the process proceeds to step S38, a reconnection instruction is received from the initial device. In this case, before switching to the switching device, in order to eliminate the case where a reconnection instruction is received from the initial device, in step S38, it is determined whether or not the switching device has already been switched. If there is a record of switching to the switching device, the process proceeds to step S39; otherwise, the process returns to step S22. In step S39, a communication path is established with the switching device, and the process proceeds to step S36. In step S40, the communication path established with the initial device is disconnected, and the process proceeds to step S41. In step S41, a remote operation screen in which a button for accepting a reconnection instruction is added to the same remote operation screen as the last remote operation screen transmitted to the initial device is transmitted to the switching device, and the process returns to step S22.

  8 and 9 are flowcharts showing an example of the flow of remote operation processing. The remote operation process is a process executed by the CPU 201 when the CPU 201 provided in each of the portable information devices 200 and 200A executes a remote operation program stored in the flash memory 203 or the CD-ROM 211A. Here, a case where the portable information device 200 executes remote operation processing will be described as an example.

  Referring to FIGS. 8 and 9, CPU 201 determines whether or not a remote operation instruction has been accepted (step S51). If the operation unit 207 receives a remote operation instruction input by the user, the remote operation instruction is received. The process waits until a remote operation instruction is accepted (NO in step S51). If a remote operation instruction is accepted (YES in step S51), the process proceeds to step S52. The remote operation instruction includes an instruction for specifying a remote control device to be remotely operated. Here, a case where MFP 100 is specified as a remote control device will be described as an example.

  In step S52, a connection request is transmitted to MFP 100, which is a remote control device. The wireless LAN I / F 208 is controlled to transmit a connection request in order to establish a communication path with the MFP 100. Then, it is determined whether or not a communication path has been established (step S53). A communication path is established by negotiating with the MFP 100. Step S52 is repeated until the communication path is established (NO in step S53). If the communication path is established (YES in step S53), the process proceeds to step S54.

  In step S54, it is determined whether a remote operation screen has been received. It is determined whether or not wireless LAN I / F 208 has received a remote operation screen from MFP 100 via the communication path established in step S53. If a remote operation screen is received (YES in step S54), the process proceeds to step S55. If not, the process proceeds to step S54A.

  In step S55, the received remote operation screen is displayed on display unit 206, and the process proceeds to step S56. In step S56, it is determined whether a remote operation by the user has been accepted. If a remote operation has been accepted, the process proceeds to step S57; otherwise, the process proceeds to step S58. When touch panel 207B detects the position designated by the user, remote operation is accepted.

  In step S57, the remote operation is transmitted to MFP 100 as the remote control device, and the process returns to step S54. Specifically, based on the position indicated by the user detected in step S56, the position in the image on the operation screen is specified, the wireless LAN I / F 208 is controlled, and the position information indicating the specified position is included. The remote operation is transmitted to MFP 100 via the communication path established in step S53.

  If the remote operation screen received in step S55 is an authentication screen, a remote operation including authentication information is transmitted in step S57. In this case, if the authentication is successful by the MFP 00, which is the remote control device, a remote operation screen is transmitted, but if the authentication fails, the communication path is disconnected. Therefore, in step S54A, it is determined whether or not the communication path established in step S53 has been disconnected. If the communication path is disconnected, the process ends. If not, the process returns to step S54.

  On the other hand, in step S58, it is determined whether an imaging instruction has been accepted. When a button for instructing imaging provided in the operation unit 207 is instructed, an imaging instruction is accepted. If an imaging instruction has been accepted, the process proceeds to step S59; otherwise, the process proceeds to step S62. In step S59, the camera 202 is controlled to image the subject. Then, the camera 202 images the subject and analyzes the output image to obtain device identification information of the switching device (step S60), and the process proceeds to step S61. For example, in a state where the portable information device 200A executes a switching-side remote operation process shown in FIG. 10 to be described later and displays a two-dimensional barcode including device identification information of the portable information device 200A on the display unit 202, When a two-dimensional barcode is imaged as a subject, the image output by the camera 202 includes a two-dimensional barcode image.

  On the other hand, in step S62, the short-range communication unit 209 is controlled to determine whether there is a communicable device. For example, when the portable information device 200 is brought close to the portable information device 200A, the short-range communication unit 209 can communicate with the portable information device 200A. If there is a device with which short-range communication unit 209 can communicate, the process proceeds to step S63; otherwise, the process proceeds to step S79. Here, a case where the short-range communication unit 209 can communicate with the portable information device 200A will be described as an example. In step S63, the short-range communication unit 209 is controlled to transmit a device identification information transmission request to the portable information device 200A. And it will be in a standby state until it receives apparatus identification information from 200 A of portable information devices (it is NO at step S64), and if apparatus identification information is received from 200 A of portable information devices (it is YES at step S64), a process will be advanced to step S61.

  In step S61, a switching instruction is transmitted to MFP 100, which is a remote control device, and the process proceeds to step S65. The switching instruction includes the device identification information acquired in step S60 or step S64. Here, the device identification information of portable information device 200A is included. Specifically, wireless LAN I / F 208 is controlled, and a switching instruction is transmitted to MFP 100 via the communication path established in step S53.

  In step S65, it is determined whether a confirmation screen is received from MFP 100 that is the remote control device. If a confirmation signal is received, the process proceeds to step S66; otherwise, the process proceeds to step S69. In step S66, a confirmation screen is displayed on display unit 206. Then, it is determined whether or not an operation to be confirmed has been accepted (step S67). When a “Yes” button included in the confirmation screen is instructed, an operation to confirm is accepted, but when a “No” button is instructed, an operation to confirm is not accepted. If an operation to confirm is accepted, the process proceeds to step S68; otherwise, the process proceeds to step S79. In step S68, a confirmation signal is transmitted to MFP 100, which is a remote control device, and the process proceeds to step S69.

  In step S79, it is determined whether an end operation has been accepted. If an end operation has been accepted, the process proceeds to step S80; otherwise, the process returns to step S56. In step S80, the communication path established with MFP 100 in step S53 is disconnected, and the process ends.

  When the process proceeds to step S69, the switching signal is transmitted in the previous step S61. Upon receiving the switching signal, MFP 100 as the remote control device disconnects the communication path established with MFP 100 in step S53. Therefore, when the process proceeds to step S69, the communication path established with MFP 100 in step S53 is disconnected.

  In step S69, wireless LAN I / F 208 is controlled to determine whether or not a connection request has been received from MFP 100, which is a remote control device. If a connection request is received, the process proceeds to step S70; otherwise, the process ends. In step S70, a communication path is established. A communication path is established by negotiating with the MFP 100.

  In step S71, it is determined whether a remote operation screen has been received. It is determined whether or not wireless LAN I / F 208 has received a remote operation screen from MFP 100 via the communication path established in step S70. The process waits until the remote operation screen is received (NO in step S71). If the remote operation screen is received (YES in step S71), the process proceeds to step S72.

  In step S72, the received remote operation screen is displayed on display unit 206, and the process proceeds to step S73. In step S73, it is determined whether a remote operation by the user has been accepted. If a remote operation has been accepted, the process proceeds to step S74. If not, the process proceeds to step S75. When touch panel 207B detects the position designated by the user, remote operation is accepted.

  In step S74, the remote operation is transmitted to MFP 100 as the remote control device, and the process returns to step S71. The remote operation is transmitted to MFP 100 via the communication path established in step S70.

  In step S75, it is determined whether a reconnection operation has been accepted. Since the remote operation screen received in step S71 includes a button for accepting a reconnection instruction, the reconnection operation is accepted when the button is designated. If a reconnection operation is accepted, the process proceeds to step S76; otherwise, the process proceeds to step S77. In step S76, a reconnection request is transmitted to MFP 100 via the communication path established in step S70, and the process returns to step S69. Upon receiving the reconnection request, MFP 100 serving as the remote control device disconnects the communication path established with MFP 100 in step S70. Therefore, when the process proceeds from step S76 to step S69, the communication path established with MFP 100 in step S70 is disconnected.

  In step S77, it is determined whether an end operation has been accepted. If an end operation has been accepted, the process proceeds to step S78; otherwise, the process returns to step S73. In step S78, the communication path established with MFP 100 in step S70 is disconnected, and the process ends.

  FIG. 10 is a flowchart illustrating an example of the flow of the switching-side remote operation process. The switching-side remote operation process is a process executed by the CPU 201 when the CPU 201 included in each of the portable information devices 200 and 200A executes a remote operation program stored in the flash memory 203 or the CD-ROM 211A. Here, a case where portable information device 200A executes remote operation processing will be described as an example.

  Referring to FIG. 10, CPU 201 determines whether or not an identification image display instruction has been received. If an identification image display instruction is accepted, the process proceeds to step S82; otherwise, the process proceeds to step S83. In step S82, the display unit 206 is controlled to display an image including the device identification information of the own device on the display unit 206. The image including the device identification information of the own device is, for example, a two-dimensional barcode such as a QR code (registered trademark).

  On the other hand, in step S83, the short-range communication unit 209 is controlled to determine whether there is a communicable device. For example, when the portable information device 200 </ b> A is brought close to the portable information device 200, the short-range communication unit 209 can communicate with the portable information device 200. If there is a device with which short-range communication unit 209 can communicate, the process proceeds to step S84; otherwise, the process returns to step S81. Here, a case where the short-range communication unit 209 can communicate with the portable information device 200 will be described as an example. In step S <b> 84, the short-range communication unit 209 is controlled to determine whether or not a device identification information transmission request has been received from the portable information device 200. If a transmission request is received, the process proceeds to step S85; otherwise, the process returns to step S81. In step S85, the short-range communication unit 209 is controlled to transmit device identification information of the device itself to the portable information device 200, and the process proceeds to step S86.

  In step S86, wireless LAN I / F 208 is controlled to determine whether or not a connection request has been received from MFP 100, which is a remote control device. If a connection request is received, the process proceeds to step S87; otherwise, the process ends. In step S87, a communication path is established. A communication path is established by negotiating with the MFP 100.

  In step S88, it is determined whether a remote operation screen has been received. It is determined whether or not wireless LAN I / F 208 has received a remote operation screen from MFP 100 via the communication path established in step S87. The process waits until the remote operation screen is received (NO in step S88). If the remote operation screen is received (YES in step S88), the process proceeds to step S89.

  In step S89, the received remote operation screen is displayed on display unit 206, and the process proceeds to step S90. In step S90, it is determined whether a remote operation by the user has been accepted. If a remote operation is accepted, the process proceeds to step S91. If not, the process proceeds to step S92. When touch panel 207B detects the position designated by the user, remote operation is accepted.

  In step S91, the remote operation is transmitted to MFP 100 as the remote control device, and the process returns to step S88. The remote operation is transmitted to MFP 100 via the communication path established in step S87.

  In step S92, it is determined whether a reconnection operation has been accepted. Since the remote operation screen received in step S88 includes a button for accepting a reconnection instruction, the reconnection operation is accepted when the button is designated. If a reconnection operation is accepted, the process proceeds to step S93; otherwise, the process proceeds to step S94. In step S93, a reconnection request is transmitted to MFP 100 via the communication path established in step S87, and the process returns to step S86. Upon receiving the reconnection request, MFP 100 serving as the remote control device disconnects the communication path established with MFP 100 in step S87. Therefore, when the process proceeds from step S93 to step S86, the communication path established with MFP 100 in step S87 is disconnected.

  In step S94, it is determined whether an end operation has been accepted. If an end operation has been accepted, the process proceeds to step S95; otherwise, the process returns to step S90. In step S95, the communication path established with MFP 100 in step S87 is disconnected, and the process ends.

  FIG. 11 is a diagram for explaining the state among the initial device, the switching device, and the remote control device in time series. Here, each state is shown with portable information device 200 as the initial device, portable information device 200A as the switching device, and MFP 100 as the remote control device. Referring to FIG. 11, when portable information device 200 as an initial device transmits a connection request to MFP 100 as a remote control device, a communication path is established between portable information device 200 and MFP 100.

  Then, MFP 100 transmits a remote operation screen to portable information device 200 and receives a remote operation from portable information device 200. The remote operation screen includes an authentication screen, and the remote operation received by transmitting the authentication screen includes authentication information. Therefore, MFP 100 authenticates the user who operates portable information device 200, and disconnects the communication path with portable information device 200 if the authentication fails.

  When MFP 100 succeeds in authenticating a user who operates portable information device 200, MFP 100 transmits a remote operation screen and receives a remote operation from portable information device 200. The remote operation includes a setting operation, a screen transition operation, and an execution instruction operation. When MFP 100 receives a setting operation, MFP 100 sets a setting value.

  When portable information device 200 transmits to MFP 100 a switching instruction including device identification information of portable information device 200 that is a switching device, MFP 100 displays a confirmation screen if portable information device 200 and portable information device 200A are not associated with each other. Send back. When the portable information device 200 receives the confirmation screen, it returns a confirmation signal or a denial signal.

  After receiving the switching signal, MFP 100 is associated with portable information device 200 and portable information device 200A, or when portable information device 200 and portable information device 200A are not associated with each other. If a confirmation signal is received from 200, a connection request is transmitted to portable information device 200A, and a communication path is established between portable information device 200A and MFP 100. At this stage, MFP 100 disconnects the communication path established with portable information device 200.

  Then, MFP 100 transmits a remote operation screen to portable information device 200A and receives the remote operation from portable information device 200A. MFP 100 transmits a remote operation screen to portable information device 200A and receives a remote operation from portable information device 200A. The remote operation includes a setting operation, a screen transition operation, and an execution instruction operation. When MFP 100 receives a setting operation, MFP 100 sets a setting value.

  When portable information device 200A transmits a reconnection instruction to MFP 100, MFP 100 transmits a connection request to portable information device 200, and establishes a communication path between portable information device 200 and MFP 100. At this stage, MFP 100 disconnects the communication path established with portable information device 200A.

  In addition, MFP 100 transmits a remote operation screen to portable information device 200 and receives a remote operation from portable information device 200. The remote operation includes a setting operation, a screen transition operation, and an execution instruction operation. When MFP 100 receives an execution instruction operation, MFP 100 executes a process specified by the execution instruction operation.

  As described above, MFP 100 in the present embodiment functions as a remote control device that is remotely operated by one of portable information devices 200 and 200A that function as a remote operation device. MFP 100 establishes a communication path between the initial devices in response to a request from portable information device 200 that is the initial device (first remote operation device), and switches from the initial device to the switching device (second remote operation device). In response to receiving a switching instruction for instructing switching to portable information device 200A, a communication path is established with the switching device, and according to a remote operation received from the switching device, The processing executed according to the remote operation received from the initial device before the communication path is established is continuously executed. Therefore, the device for remotely operating MFP 100 can be switched from the initial device to the switching device, and the remote operation of MFP 100 can be continued before and after switching.

  Further, MFP 100 receives a remote operation from the initial device on condition that the user who operates the initial device is authenticated, and after switching to the switching device, does not authenticate the user who operates the switching device. Since the remote operation is received from the switching device, the operation for switching the device to be remotely operated from the initial device to the switching device can be simplified.

  Further, when a communication path is established with the switching device, MFP 100 transmits the same remote operation screen as the last remote operation screen transmitted to the initial device to the switching device, so that the switching device switches from the initial device. The user can be notified of the change.

  In addition, when a communication path is established with the switching device, MFP 100 does not reset the setting value set according to the setting operation received from the initial device to the initial value, so that the user sets using the initial device. The set value can be succeeded to the remote operation by the switching device.

  Further, when the MFP 100 receives an execution instruction operation from the initial device or the switching device, the MFP 100 executes processing using the set value set before the execution instruction operation is received. Processing can be executed from any of the apparatuses.

  Further, when a switching instruction is received from the initial device and MFP 100 is not associated with the switching device, MFP 100 transmits a confirmation screen for confirming switching to the switching device to initial device. Since the communication path is established with the switching device on the condition that it is confirmed, it is possible to prevent erroneous operation of designation of the switching device by the user operating the first remote control device.

  Further, when a communication path is established between the MFP 100 and the switching device, the association information that associates the initial device with the switching device is generated and stored in the HDD 116, so that the initial device and the switching device can be easily configured. Can be associated.

  In addition, since MFP 100 disconnects the communication path with the initial device in response to the establishment of the communication path with the switching device, remote control is received from either the initial device or the switching device. can do.

  Further, when receiving a reconnection instruction from the switching device, the MFP 100 establishes a communication path with the initial device, disconnects the communication path with the switching device, and according to a remote operation received from the initial device, The process executed according to the remote operation received from the switching device is continuously executed. Therefore, the device for remotely operating MFP 100 can be switched from the switching device to the initial device, and remote operation of MFP 100 can be continued before and after switching.

  The switching device displays an identification image including device identification information for identifying the switching device, for example, a two-dimensional barcode, and the initial device is obtained by further imaging the two-dimensional barcode with the camera 202. The identification image is analyzed to obtain device identification information of the switching device, and after a communication path is formed with the MFP 100, the two-dimensional barcode displayed on the switching device is captured by the camera 202. The switching instruction is transmitted to MFP 100 via the communication path. Therefore, by operating the initial device and capturing an image of the two-dimensional barcode displayed on the switching device with camera 202, the device for remotely operating MFP 100 can be switched from the initial device to the switching device.

  In addition, when the short-range communication unit 209 can communicate with the switching device after establishing a communication path with the MFP 100, the initial device acquires device identification information of the switching device and includes the device identification information of the switching device. A switching instruction is transmitted to MFP 100 via the communication path. Therefore, if the initial device is brought closer to the switching device, the device for remotely operating MFP 100 can be switched from the initial device to the switching device.

  In the above-described embodiment, the screen processing system 1 has been described. However, the remote control method for causing the MFP 100 to execute the remote control processing illustrated in FIGS. 6 and 7 is performed by the CPU 111 that controls the MFP 100. A remote control program to be executed, a remote operation method for causing the portable information device 200 to execute the remote operation processing shown in FIGS. 8 and 9 and the switching-side remote operation processing shown in FIG. 10, and the remote operation method for the portable information device 200 Needless to say, the invention can be understood as a remote operation program to be executed by the CPU 201 to be controlled.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 Image processing system, 3 networks, 5 wireless stations, 100 MFP, 110 main circuit, 111 CPU, 112 communication I / F unit, 113 ROM, 114 RAM, 115 HDD, 116 facsimile unit, 117 external storage device, 118 CD- ROM, 120 automatic document feeder, 130 document reading unit, 140 image forming unit, 150 paper feeding unit, 155 post-processing unit, 160 operation panel, 161 display unit, 163 operation unit, 165 touch panel, 165 hard key unit, 167 hardware Key unit, 200, 200A portable information device, 201 CPU, 202 camera, 203 flash memory, 204 wireless communication unit, 205 call unit, 206 display unit, 207 operation unit, 207A main key, 207B touch panel, 208 wireless LAN I / F, 209 Short-range communication unit, 2 0 acceleration sensor, 211 external storage device, 51 connection control unit, 53 authentication unit, 55 operation reception unit, 57 remote operation screen transmission unit, 59 remote control unit, 61 switching instruction reception unit, 63 reconnection instruction reception unit, 65 Appendices, 67 confirmation unit, 71 first communication path establishment unit, 73 second communication path establishment unit, 81 setting unit, 83 processing execution unit, 85 remote operation screen generation unit, 251 communication control unit, 253 remote operation screen reception unit 255 Image display control unit 257 Operation reception unit 259 Remote operation transmission unit 261 Identification image display control unit 263 Identification information transmission unit 265 Switching device information acquisition unit 267 Switching instruction unit 269 Short distance control unit 271 Imaging control unit.

Claims (15)

First communication path establishing means for establishing a communication path with the first remote control device in response to a request from the first remote control device;
Remote control means for executing processing in accordance with a remote operation received from the first remote control device;
In response to receiving a switching instruction instructing switching from the first remote control device to a second remote control device different from the first remote control device, the second remote control device A second communication path establishing means for establishing a communication path between them,
The remote control means is received from the first remote control device in accordance with the remote control received from the second remote control device before a communication path with the second remote control device is established. An image processing apparatus that continuously executes processing executed according to remote operation. Authentication means for receiving authentication information of a user who operates the first remote control device and authenticating the user based on the received authentication information;
The first remote operation receiving means receives a remote operation from the first remote operation device on the condition that a user operating the first remote operation device is authenticated,
The image processing apparatus according to claim 1, wherein the second remote operation reception unit receives a remote operation from the second remote operation apparatus without authenticating a user who operates the second remote operation apparatus. A remote operation screen transmission means for transmitting a remote operation screen to the first remote operation device or the second remote operation device;
The remote operation screen transmission means is configured to perform the same remote operation as the remote operation screen last transmitted to the first remote operation device in response to establishment of a communication path with the second remote operation device. The image processing device according to claim 1, wherein a screen is transmitted to the second remote control device. When the remote operation received from the first remote control device or the remote operation received from the first remote control device is a setting operation, the remote control means sets a setting value according to the setting operation Comprising setting means,
When a communication path is established with the second remote control device, the set value setting means is configured to set the first remote control device before the communication path is established with the second remote control device. The image processing apparatus according to claim 1, wherein a setting value set in accordance with a setting operation received from the operation apparatus is not reset to an initial value.   When the remote operation received from the first remote operation device or the remote operation received from the second remote operation device is an execution instruction operation instructing execution of processing, the remote control means is configured to execute the execution instruction operation. 5. The image processing apparatus according to claim 1, further comprising: a process execution unit that executes a process determined by the operation execution instruction operation using a setting value set before the image is received. When the switching instruction is received from the first remote control device, if the first remote control device and the second remote control device are not associated with each other, the first remote control device Confirming means for confirming switching to the second remote control device,
When the first remote control device and the second remote control device are not associated with each other in advance, the second communication path establishment means sends the second remote control device to the second remote control device by the first remote control device. The image processing device according to claim 1, wherein a communication path is established with the second remote control device on condition that switching of the second remote control device is confirmed.   Association information generating means for generating association information associating the first remote operation device with the second remote operation device when a communication path is established with the second remote operation device; The image processing apparatus according to claim 6, further provided.   The first communication path establishment means disconnects a communication path with the first remote control device in response to establishment of a communication path with the second remote control device. The image processing apparatus according to any one of 1 to 7. The first communication path establishing means establishes a communication path with the first remote control device when receiving a reconnection instruction from the second remote control device;
The second communication path establishment means disconnects the communication path with the second remote control device in response to the establishment of the communication path with the first remote control device,
The remote control means is received from the second remote control device according to the remote control received from the first remote control device before a communication path is established with the first remote control device. The image processing apparatus according to claim 8, wherein the processing executed according to the remote operation is continuously executed. The second communication path establishment means establishes a communication path with the second remote control device when receiving a reconnection instruction from the first remote control device;
The first communication path establishing means disconnects the communication path with the first remote control device in response to the establishment of the communication path with the second remote control device,
The remote control means is received from the first remote control device according to the remote control received from the second remote control device before a communication path is established with the second remote control device. The image processing apparatus according to claim 9, wherein the processing executed according to the remote operation is continuously executed. An image processing system including the image processing device according to claim 1, the first remote operation device, and the second remote operation device,
Each of the first remote control device and the second remote control device is:
Communication control means for establishing a communication path with the image processing apparatus;
Remote operation means for remotely operating the image processing apparatus via the established communication path,
After the communication control unit establishes a communication path with the image processing apparatus, the first remote control device sends a switching instruction including device identification information of the second remote control device via the communication path. An image processing system further comprising switching instruction means for transmitting to the image processing apparatus. The second remote control device further includes identification image display means for displaying an identification image including device identification information for identifying the second remote control device,
The first remote control device further includes imaging means for imaging a subject;
Switching device information acquisition means for analyzing the identification image obtained by the imaging means imaging the identification image displayed on the second remote control device and acquiring device identification information of the second remote control device; Further comprising
The switching instruction means of the first remote control device is the identification displayed on the second remote control device by the imaging means after the communication control means forms a communication path with the image processing device. In response to an image being captured, a switching instruction including device identification information of the second remote control device acquired by the switching device information acquisition means is transmitted to the image processing device via the communication path. The image processing system according to claim 11. Each of the first remote control device and the second remote control device further includes short-range wireless communication means,
The first remote control device further includes a switching device information acquisition unit that acquires device identification information of the second remote control device when the short-range wireless communication unit can communicate with the second remote control device. And further comprising
The switching instruction unit of the first remote operation device is configured to be configured such that after the communication control unit establishes a communication path with the image processing device, the switching device information acquisition unit causes the device of the second remote operation device. The switching instruction including the acquired device identification information of the second remote control device is transmitted to the image processing device via the communication path in response to the acquisition of the identification information. The image processing system described. A first communication path establishing step for establishing a communication path with the first remote control device in response to a request from the first remote control device;
A remote control step of executing processing in accordance with a remote operation received from the first remote control device;
In response to receiving a switching instruction instructing switching from the first remote control device to a second remote control device different from the first remote control device, the second remote control device A second communication path establishment step for establishing a communication path between the image processing apparatus,
The remote control step is received from the first remote control device according to a remote operation received from the second remote control device before a communication path with the second remote control device is established. A remote control method including a step of continuously executing a process executed according to a remote operation. A first communication path establishing step for establishing a communication path with the first remote control device in response to a request from the first remote control device;
A remote control step of executing processing in accordance with a remote operation received from the first remote control device;
In response to receiving a switching instruction instructing switching from the first remote control device to a second remote control device different from the first remote control device, the second remote control device A second communication path establishment step for establishing a communication path between the image processing apparatus and a computer that controls the image processing apparatus,
The remote control step is received from the first remote control device according to a remote operation received from the second remote control device before a communication path with the second remote control device is established. A remote control program comprising a step of continuously executing a process executed in accordance with a remote operation.

Images