JP5994615B2 - Remote control system, portable information device, remote control method, and remote control program - Google Patents

Description

  The present invention relates to a remote control system, a portable information device, a remote control method, and a remote control program, and in particular, a remote control system including an information processing device and a portable information device that remotely operates the information processing device, the portable information device, The present invention also relates to a remote control method and a remote control program executed in a portable information device.

  In recent years, a plurality of multifunction peripherals (hereinafter referred to as “MFP”) may be used in a personal computer (hereinafter referred to as “PC”) connected to a network. In this environment, when a user prints using a PC, one of the plurality of MFPs to be printed must be specified. As a technique for facilitating this operation, for example, Japanese Patent Application Laid-Open No. 2009-278387 discloses a cooperative system in which a plurality of image forming apparatuses and a server apparatus are connected via a network so that data communication is possible. The image forming apparatus includes remote operation means configured to be able to use an application of the server apparatus by remote operation, and the server apparatus includes a plurality of image forming apparatuses connected via a network. Among them, the remote operation source device identifying means for identifying the remote operation source device which is an image forming apparatus remotely operated by the remote operation means, and the application is printed based on the identification result identified by the remote operation source device identification means. Automatic setting means for automatically setting the image forming apparatus used for the remote operation source apparatus, and the automatic setting means automatically sets the image forming apparatus. When the remote operation source device is not ready for immediate printing, the similarity with the printing capability of the remote operation source device is calculated by a method set in advance using print parameter setting values that the image forming apparatus individually has. An alternative image forming apparatus searching unit that searches for an image forming apparatus whose similarity value is within a predetermined range and identifies the alternative image forming apparatus that performs immediate printing processing instead of the remote operation source apparatus; Is described.

However, in the conventional linkage system, one of the plurality of image forming apparatuses for printing is determined in the server, and therefore, the user can print on the image forming apparatus desired by the user among the plurality of image forming apparatuses. There is a problem that it may not be possible.
JP 2009-278387 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to provide a remote control system that facilitates an operation for specifying a device to be remotely operated. .

  Another object of the present invention is to provide a portable information device that facilitates an operation for specifying a device to be remotely operated.

  Still another object of the present invention is to provide a remote control method that facilitates an operation for specifying a device to be remotely operated.

  Still another object of the present invention is to provide a remote control program that facilitates an operation for specifying a device to be remotely operated.

In order to achieve the above object, according to one aspect of the present invention, a remote control system is a remote control system including a server, a plurality of information processing devices, and a portable information device, and a plurality of information Each of the processing devices includes a processing execution unit that executes processing, a device-side position detection unit that detects the position of the own device, device identification information for identifying the own device, detected position information, and a processing execution unit. And air tag transmission means for transmitting to the server air tag information including processing information relating to processing that can be executed by the plurality of information processing devices, a first information processing device that executes processing for displaying data, and data anda second information processing apparatus capable of executing a process of outputting, portable information device includes an imaging means for imaging an object, detecting the azimuth indicating the direction in which the imaging means for imaging a subject Direction detecting means, display means for displaying the image of the subject imaged by the imaging means, portable side position detecting means for detecting the position of the own apparatus, and air tag information transmitted from the information processing apparatus to the server. An information processing apparatus as a subject to be imaged by the imaging means based on the air tag information acquisition means, the acquired air tag information, the position detected by the portable side position detection means, and the orientation detected by the orientation detection means. and the object specifying means for specifying, and a remote operation unit for remotely operating the information processing apparatus based on the processing information included in Eatagu information corresponding to the identified information processing apparatus, the remote operating means, subject specifying means When the first and second information processing devices are specified by the data, the data displayed on the first information processing device is changed to the second information. Ru is output to the management apparatus.

  According to this aspect, when the subject is imaged by the portable information device, an image of the subject is displayed, the orientation indicating the direction in which the subject is imaged is detected, the position of the own device is detected, and the information processing device The air tag information sent to the server is acquired from the server. Then, based on the acquired air tag information, the detected position of the own device, and the detected orientation, the information processing device as a subject is specified and included in the air tag information corresponding to the specified information processing device. The information processing apparatus is remotely operated based on the processed information. For this reason, since the target of remote operation is specified by imaging the information processing device, it is possible to provide a remote control system that facilitates the operation of specifying the device that is the target of remote operation.

In addition , when the first and second information processing devices are specified, data displayed on the first information processing device is output to the second information processing device. For this reason, the two devices can be remotely operated simultaneously.

  Preferably, the remote control means includes data specifying means for specifying data displayed on the first information processing apparatus based on processing information included in the first air tag information corresponding to the first information processing apparatus, Processing specifying means for specifying a process executable by the second information processing apparatus based on processing information included in the second air tag information corresponding to the second information processing apparatus, and data specified by the data specifying means An operation for associating the first identification image and the second identification image with the identification image display means for displaying the corresponding first identification image and the second identification image corresponding to the process specified by the process specifying means is input. In the case where the second information processing apparatus executes a command for causing the second information processing apparatus to execute processing specified by the second identification image with respect to data corresponding to the first identification image. Including a command transmission means for transmitting either one of the information processing apparatus.

  According to this aspect, data displayed on the first information processing apparatus is specified, a first identification image corresponding to the specified data is displayed, and processing that can be executed on the second information processing apparatus is performed. When the second identification image corresponding to the specified process is displayed and an operation for associating the first identification image with the second identification image is input, the data corresponding to the first identification image is displayed. On the other hand, a command for causing the second information processing apparatus to execute the process specified by the second identification image is transmitted. For this reason, an operation for specifying data to be processed is easy. Furthermore, an operation for specifying a device for executing a process and a process to be executed is easy. As a result, the two devices can be remotely operated by a simple operation that associates the first identification image and the second identification image displayed on one screen.

  Preferably, the remote operation means includes a processing information display means for displaying an identification image corresponding to the processing information, and, when the displayed identification image is instructed by the user, information based on the processing information corresponding to the identification image. Command transmitting means for transmitting a command for causing the processing device to execute processing.

  According to this aspect, when the identification image corresponding to the processing information is displayed and the identification image is instructed by the user, a command for causing the information processing apparatus to execute processing based on the processing information corresponding to the identification image is provided. Sent. For this reason, it is easy to specify an apparatus for executing the process and an operation to be executed. As a result, the information processing apparatus can be remotely operated by a simple operation that designates an identification image displayed on one screen.

According to another aspect of the present invention, the portable information device is a portable information device capable of communicating with a server, and the server is device identification information for identifying an object, an absolute position of the object, and processing related to the object. Air tag information including information, there are a plurality of objects, and the plurality of objects includes a first information processing apparatus that executes a process of displaying data and a second information that can execute a process of outputting data An image processing unit that images a subject, an orientation detection unit that detects a direction in which the imaging unit captures the subject, and a display unit that displays an image of the subject captured by the imaging unit. A portable side position detecting means for detecting the position of the own device, an air tag information acquiring means for acquiring air tag information from the server, and the acquired air Based on the tag information, the position detected by the portable side position detecting means, and the orientation detected by the orientation detecting means, subject specifying means for specifying an object as a subject to be imaged by the imaging means, and the specified object Remote operation means for remotely operating the object based on processing information included in the corresponding air tag information, and when the first and second information processing devices are specified by the subject specifying means, the data displayed in the first information processing apparatus Ru is output to the second information processing apparatus.

  According to this aspect, since the target of remote operation is specified by imaging the information processing apparatus, it is possible to provide a portable information device that facilitates the operation of specifying the device that is the target of remote operation.

  Preferably, the remote control means includes data specifying means for specifying data displayed on the first information processing apparatus based on processing information included in the first air tag information corresponding to the first information processing apparatus, Processing specifying means for specifying a process executable by the second information processing apparatus based on processing information included in the second air tag information corresponding to the second information processing apparatus, and data specified by the data specifying means An operation for associating the first identification image and the second identification image with the identification image display means for displaying the corresponding first identification image and the second identification image corresponding to the process specified by the process specifying means is input. In the case where the second information processing apparatus executes a command for causing the second information processing apparatus to execute processing specified by the second identification image with respect to data corresponding to the first identification image. Including a command transmission means for transmitting either one of the information processing apparatus.

  Preferably, the remote operation means includes an identification image display means for displaying an identification image corresponding to the processing information, and, when the displayed identification image is instructed by the user, based on the processing information corresponding to the identification image, Command transmitting means for transmitting a command for causing the processing to be executed.

According to still another aspect of the present invention, a remote control method is a remote control method executed by a portable information device that can communicate with a server, the server including device identification information for identifying an object, and an object The air tag information including the absolute position and the processing information related to the object is stored, and there are a plurality of objects, and the plurality of objects outputs a first information processing device that executes a process of displaying data, and outputs the data A second information processing device capable of executing processing, an imaging step for imaging a subject, an orientation detection step for detecting an orientation indicating a direction in which the subject is imaged in the imaging step, and a subject imaged in the imaging step A display step for displaying the image of the device, a portable side position detection step for detecting the position of the own device, and an error from the server. -The subject imaged in the imaging step based on the air tag information acquisition step for acquiring tag information, the acquired air tag information, the position detected in the portable side position detection step, and the direction detected in the direction detection step and the subject specifying step of specifying an object as, seen including and a remote control step of remotely controlling the object based on the processing information included in Eatagu information corresponding to the specific object, the remote control step is subject specifying step When the first and second information processing apparatuses are specified in step S1, the data displayed on the first information processing apparatus is output to the second information processing apparatus .

  According to this aspect, since the target of remote operation is specified by imaging the information processing device, it is possible to provide a remote control method that facilitates the operation of specifying the device that is the target of remote operation.

According to still another aspect of the present invention, the remote control program is a remote control program executed by a computer that controls a portable information device that can communicate with the server, wherein the server identifies a device for identifying an object. Storing air tag information including information, an absolute position of the object, and processing information related to the object, wherein there are a plurality of objects, and the plurality of objects includes a first information processing apparatus that executes a process of displaying data; A second information processing apparatus capable of executing a process of outputting data, an imaging step of imaging a subject, an orientation detection step of detecting a direction indicating the direction of imaging of the subject in the imaging step, and an imaging step A display step for displaying the image of the imaged subject and a portable device for detecting the position of the own device Based on the position detection step, the air tag information acquisition step for acquiring the air tag information from the server, the acquired air tag information, the position detected in the mobile side position detection step, and the direction detected in the direction detection step, Causing a computer to execute a subject specifying step of specifying an object as a subject imaged in the imaging step, and a remote control step of remotely operating the object based on processing information included in air tag information corresponding to the specified object , remote control step, when the first and second information processing apparatus is specified in the object specifying step, Ru to output the data displayed in the first information processing apparatus to the second information processing apparatus.

  According to this aspect, since the target of remote operation is specified by imaging the information processing apparatus, it is possible to provide a remote control program that facilitates the operation of specifying the device that is the target of remote operation.

It is a figure which shows an example of the whole outline | summary of the remote control system in embodiment of this invention. 1 is a perspective view showing an appearance of an MFP. 2 is a block diagram illustrating an outline of a hardware configuration of an MFP. FIG. It is a block diagram which shows an example of the outline | summary of the hardware constitutions of the portable information device in this Embodiment. It is a block diagram which shows an example of the outline | summary of the hardware constitutions of the electronic paper apparatus in this Embodiment. It is a block diagram which shows an example of the outline | summary of the hardware constitutions of the server in this Embodiment. 3 is a block diagram illustrating an example of an overview of functions of a CPU provided in the MFP according to the present embodiment. FIG. It is a figure which shows an example of the format of air tag information. It is a figure which shows an example of the format of a command. It is a figure which shows an example of the detailed format of the item of the command condition in which process identification information shows a remote operation process. It is a block diagram which shows an example of the outline | summary of the function of CPU with which the electronic paper apparatus in this Embodiment is provided. It is a block diagram which shows an example of the outline | summary of the function of CPU with which the server in this Embodiment is provided. It is a block diagram which shows an example of the outline | summary of the function of CPU with which the portable information device in this Embodiment is provided. 6 is a flowchart illustrating an example of a flow of MFP control processing. It is a flowchart which shows an example of the flow of an electronic paper control process. It is a flowchart which shows an example of the flow of an air tag information management process. It is a flowchart which shows an example of the flow of a remote control process. It is a figure which shows an example of the remote operation screen displayed on a portable information device.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an example of an overall outline of a remote control system according to an embodiment of the present invention. Referring to FIG. 1, a remote control system 1 includes MFPs (Multi Function Peripherals) 100, 101, 102, a portable information device 200, and a personal computer (hereinafter referred to as “PC”) 300 each connected to a network 2. And an electronic paper device 400 and a wireless station 500.

  MFPs 100, 101, and 102 are image forming apparatuses and are examples of information processing apparatuses. Each of MFPs 100, 101, and 102 functions as an image forming apparatus, and transmits and receives a document reading function for reading a document, an image forming function for forming an image on a recording medium such as paper based on the image data, and facsimile data. A facsimile transmission / reception function is provided. In the first embodiment, the MFPs 100, 101, and 102 will be described as an example. However, instead of the MFPs 100, 101, and 102, any apparatus having a function of forming an image may be used, for example, a printer or a facsimile machine. Etc. Since MFPs 100, 101, and 102 have the same hardware and functions, MFP 100 will be described as an example in the following description unless otherwise specified.

  The PC 300 is a general computer and is an example of an information processing apparatus. The PC 300 is installed with a printer driver program for controlling the MFPs 100, 101, and 102. When the types of MFPs 100, 101, and 102 are different, three types of printer driver programs for controlling MFPs 100, 101, and 102 are installed in PC 300, respectively.

  The electronic paper device 400 is an example of an information processing device. The electronic paper device 400 is used by being carried by a user and has a function of storing data and a wireless LAN function. Similarly to the PC 300, the electronic paper device 400 is installed with a printer driver program for controlling the MFPs 100, 101, 102, and the image of the data stored in the electronic paper device 400 is transferred to the MFPs 100, 101, 102. Can be printed.

  The portable information device 200 is a computer used by a user such as a PDA (Personal Digital Assistant). Here, the portable information device 200 is a smartphone, and has a wireless LAN function and a call function. For this reason, the portable information device 200 is connected to the cellular phone network by wirelessly communicating with the cellular phone base station, and can make a call.

  The network 2 is a local area network (LAN), and the connection form may be wired or wireless. Further, the network 2 is not limited to a LAN, and may be a network using a public switched telephone network (Public Switched Telephone Networks). Furthermore, the network 2 is connected to a wide area network (WAN) such as the Internet. Each of MFPs 100, 101, and 102 can transmit and receive data with PC 300 via network 2.

  The wireless station 500 is a relay device of the network 2 and communicates with the portable information device 200 and the electronic paper device 400 having a wireless LAN communication function to connect the portable information device 200 and the electronic paper device 400 to the network 2. Therefore, each of MFPs 100, 101, 102 and PC 300 can send and receive data to / from portable information device 200 and electronic paper device 400 via network 2 and wireless station 500.

  FIG. 2 is a perspective view showing the appearance of the MFP. FIG. 3 is a block diagram showing an outline of the hardware configuration of the MFP. 2 and 3, MFP 100 includes a main circuit 110, a document reading unit 130 for reading a document, an automatic document transport device 120 for transporting a document to document reading unit 130, and a document reading unit. An image is formed by an image forming unit 140 for forming an image on a sheet or the like based on image data output by the manuscript 130 reading and outputting a document, a paper feeding unit 150 for supplying the image to the image forming unit 140, and an image. A post-processing unit 155 that processes paper and an operation panel 160 as a user interface are included.

  The post-processing unit 155 executes a sorting process for sorting and discharging one or more sheets on which images are formed by the image forming unit 140, a punching process for punch hole processing, and a staple process for driving staple needles.

  The main circuit 110 includes a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a mass storage device, a facsimile unit 116, and a CD-ROM 118. External storage device 117. CPU 111 is connected to automatic document feeder 120, document reading unit 130, image forming unit 140, sheet feeding unit 150, and operation panel 160, and controls the entire MFP 100.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. The RAM 114 temporarily stores read data (image data) continuously sent from the document reading unit 130.

  Operation panel 160 is provided on the upper surface of MFP 100 and includes a display unit 161 and an operation unit 163. The display unit 161 is a display device such as a liquid crystal display (LCD) or an organic ELD (Electro-Luminescence Display), and displays an instruction menu for the user, information about acquired image data, and the like. The operation unit 163 includes a hard key unit 167 including a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys. The operation unit 163 further includes a touch panel 165 provided on the display unit 161.

  Communication I / F unit 112 is an interface for connecting MFP 100 to network 2. The CPU 111 communicates with the MFPs 101 and 102, the PC 300, or the portable information device 200 via the communication I / F unit 112, and transmits and receives data. The communication I / F unit 112 can communicate with a computer connected to the Internet via the network 2.

  The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to the PSTN or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or outputs it to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 116 on a sheet. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN.

  The external storage device 117 is loaded with a CD-ROM (Compact Disk ROM) 118. The CPU 111 can access the CD-ROM 118 via the external storage device 117. The CPU 111 loads the program recorded on the CD-ROM 118 attached to the external storage device 117 to the RAM 114 and executes it. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, but an optical disc (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, It may be a semiconductor memory such as a mask ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM).

  Further, the program executed by the CPU 111 is not limited to the program recorded on the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network 2 may rewrite the program stored in the HDD 115 of the MFP 100, or may write a new program. Further, MFP 100 may download a program from another computer connected to network 2 and store the program in HDD 115. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  In the remote control system 1, data is transmitted and received between the MFPs 100, 101, 102, the portable information device 200, the electronic paper device 400 that is an information processing device, and the MFPs 100, 101, 102. As a protocol for transmitting and receiving data, any protocol can be used as long as the transmission source can be specified in the receiving apparatus. As a protocol for transmitting and receiving data, for example, HTTP (Hyper Text Transfer Protocol), FTP (File Transfer Protocol), SMPT (Simple Mail Transfer Protocol), POP (Post Office Protocol), and the like are used.

  FIG. 4 is a block diagram illustrating an example of an outline of a hardware configuration of the portable information device according to the present embodiment. Referring to FIG. 4, portable information device 200 in the present embodiment includes a CPU 201 for controlling the entire portable information device 200, a camera 202, a flash memory 203 for storing data in a nonvolatile manner, and a calling unit. 205, a wireless communication unit 204 connected to 205, a display unit 206 that displays information, an operation unit 207 that accepts user operations, a wireless LAN I / F 208, a position detection unit 209, an orientation detection unit 210, and an external storage Device 211.

  The wireless communication unit 204 performs wireless communication with a mobile phone base station connected to a telephone communication network. The wireless communication unit 204 connects the portable information device 200 to a telephone communication network and enables a call using the call unit 205. The radio communication unit 204 decodes a voice signal obtained by demodulating the radio signal received from the mobile phone base station and outputs the decoded signal to the call unit 205. Further, the wireless communication unit 204 encodes the voice input from the call unit 205 and transmits it to the mobile phone base station. The call unit 205 includes a microphone and a speaker, outputs the voice input from the wireless communication unit 204 from the speaker, and outputs the voice input from the microphone to the wireless communication unit 204. Further, the wireless communication unit 204 is controlled by the CPU 201, connects the portable information device 200 to an electronic mail server, and transmits and receives electronic mail.

  The camera 202 includes a lens and a photoelectric conversion element. The light focused by the lens is imaged on the photoelectric conversion element. The photoelectric conversion element photoelectrically converts the received light and outputs image data to the CPU 201. The photoelectric conversion element is a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge Coupled Device) sensor, or the like.

  The display unit 206 is a display device such as a liquid crystal display (LCD) or an organic ELD, and displays an instruction menu for a user, information about acquired image data, and the like. The operation unit 207 includes a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys.

  The wireless LAN I / F 208 is an interface for communicating with the wireless station 500 and connecting the portable information device 200 to the network 2. By registering the IP (Internet Protocol) address of each of the server 300, MFPs 100, 101, and 102 and the electronic paper device 400 in the portable information device 200, the portable information device 200 is connected to the server 300, MFPs 100, 101, 102, Communication with the electronic paper device 400 is possible, and data can be transmitted and received. In the present embodiment, a case where portable information device 200 communicates with server 300, MFPs 100, 101, and 102 and electronic paper device 400 using wireless LAN I / F 208 will be described as an example. You may make it communicate using. Specifically, when the portable information device 200, the server 300, the MFPs 100, 101, 102, and the electronic paper device 400 are mounted with a short-range wireless device such as Bluetooth (registered trademark), the portable information device 200 One-to-one communication may be performed with any of the server 300, the MFPs 100, 101, 102, and the electronic paper device 400. Further, the portable information device 200 is connected to any one of the server 300, the MFPs 100, 101, 102, and the electronic paper device 400 with a wire such as a USB (Universal Serial Bus) cable, and the portable information device 200 is connected to the server 300. Alternatively, the MFP 100, 101, 102, or the electronic paper device 400 may communicate one-on-one.

  The flash memory 203 stores a program executed by the CPU 201 or data necessary for executing the program. The CPU 201 loads the program recorded in the flash memory 203 to the RAM included in the CPU 201 and executes it.

  The position detection unit 209 detects the current position of the portable information device 200. Specifically, the position detection unit 209 is a global positioning system receiver, and measures the current position by receiving radio waves from a plurality of GPS satellites. The position detection unit 209 outputs a value indicating the measured current position, for example, latitude and longitude to the CPU 201.

  The direction detection unit 210 detects the direction in which the camera 202 of the portable information device 200 faces. Specifically, the orientation detection unit 210 is a geomagnetic sensor that measures geomagnetism. The direction detection unit 210 outputs the detected direction to the CPU 201. The direction detection unit 210 is installed in the portable information device 200 so as to be able to detect the imaging direction of the camera 202, in other words, the direction in which the optical axis of the lens of the camera 202 faces. The direction detection unit 210 is not limited to a geomagnetic sensor, and a gyro sensor or the like may be used.

  The external storage device 211 is detachable from the portable information device 200, and a CD-ROM 210A storing a remote operation program can be attached thereto. The CPU 201 can access the CD-ROM 210 </ b> A via the external storage device 211. The CPU 201 can load a remote operation program recorded on the CD-ROM 210A attached to the external storage device 211 into a RAM included in the CPU 201 and execute it.

  The program recorded in the flash memory 203 or the CD-EOM 210A has been described as a program executed by the CPU 201. However, a program in which another computer connected to the network 2 rewrites the program stored in the flash memory 203, Alternatively, it may be a new program written additionally. Further, the portable information device 200 may be a program downloaded from another computer connected to the network 2. The program here includes not only a program directly executable by the CPU 201 but also a source program, a compressed program, an encrypted program, and the like.

  The medium for storing the program executed by the CPU 201 is not limited to the CD-ROM 211A, and may be a semiconductor memory such as an optical disk (MO / MD / DVD), IC card, optical card, mask ROM, EPROM, or EEPROM. Good.

  FIG. 5 is a block diagram illustrating an example of an outline of a hardware configuration of the electronic paper device according to the present embodiment. Referring to FIG. 4, an electronic paper device 400 includes a CPU 401 for controlling the entire electronic paper device 400, a flash memory 403 that stores data in a nonvolatile manner, a display unit 405 that displays an image of the data, An operation unit 407 that receives an input of a user operation, a wireless LAN I / F 409, a position detection unit 411, and an external storage device 413 are included.

  A display unit 405 is electronic paper, and displays an image of data stored in the flash memory 403. The operation unit 407 is a touch panel provided so as to overlap the display unit 405.

  The wireless LAN I / F 409 is an interface for communicating with the wireless station 500 and connecting the electronic paper device 400 to the network 2. By registering the IP addresses of the server 300, MFPs 100, 101, 102, and the portable information device 200 in the electronic paper device 400, the electronic paper device 400 can be used by the server 300, MFPs 100, 101, 102, and the portable information device 200. Can be transmitted and received. In the present embodiment, the case where electronic paper apparatus 400 communicates with server 300, MFPs 100, 101, and 102 and portable information apparatus 200 using wireless LAN I / F 409 will be described as an example. You may make it communicate using. Specifically, when each of the server 300, the MFPs 100, 101, 102, the portable information device 200, and the electronic paper device 400 is equipped with a short-range wireless device such as Bluetooth (registered trademark), the electronic paper device 400 is used. However, one-to-one communication may be performed with any of server 300, MFPs 100, 101, and 102 and portable information device 200. Further, the electronic paper device 400 is connected to any one of the server 300, the MFPs 100, 101, and 102 and the portable information device 200 by a wired connection such as a USB cable. One-to-one communication may be performed with either the mobile phone 102 or the portable information device 200.

  The flash memory 403 stores a program executed by the CPU 401 or data necessary for executing the program. The CPU 401 loads the program recorded in the flash memory 403 into the RAM included in the CPU 401 and executes it.

  The position detection unit 411 detects the current position of the electronic paper device 400. Specifically, the position detection unit 411 is a GPS receiver, and measures the current position by receiving radio waves from a plurality of GPS satellites. The position detection unit 411 outputs a value indicating the measured current position, for example, latitude and longitude to the CPU 401.

  The external storage device 413 is detachable from the electronic paper device 400, and a CD-ROM 413A storing a program can be attached thereto. The CPU 401 can access the CD-ROM 413A via the external storage device 413. The CPU 401 can load a program recorded on the CD-ROM 413A attached to the external storage device 413 into a RAM included in the CPU 401 and execute the program.

  FIG. 6 is a block diagram showing an example of an outline of the hardware configuration of the server in the present embodiment. Referring to FIG. 6, the server 300 includes a CPU 301 for controlling the entire server 300, a ROM 302 for storing a program to be executed by the CPU 301, a RAM 303 used as a work area for the CPU 301, and nonvolatile data. HDD 304 which memorize | stores automatically, the communication part 305 which connects CPU301 to the network 2, the display part 306 which displays information, and the operation part 307 which receives the input of a user's operation.

  FIG. 7 is a block diagram illustrating an example of an overview of the functions of the CPU provided in the MFP according to the present embodiment. The functions shown in FIG. 7 are functions formed in CPU 111 when CPU 111 provided in each of MFPs 100, 101, and 102 in the present embodiment executes programs stored in ROM 113, HDD 115, and CD-ROM 118. Referring to FIG. 7, CPU 111 includes a first command reception unit 51, a first process execution unit 53, a first air tag transmission unit 55, and a position setting unit 57.

  Position setting unit 57 sets position information indicating the position where MFP 100 is installed. Specifically, the position setting unit 57 is input when a user who operates the MFP 100, for example, a user who manages the MFP 100 inputs position information indicating the current position where the MFP 100 is disposed to the operation unit 163. The current position is stored in the HDD 115. The current position input by the user is latitude and longitude indicating the current position where MFP 100 is arranged. If MFP 100 includes a GPS receiving device, position information indicating the position measured by the GPS receiving device may be set. Position setting unit 57 sets position information when the location where MFP 100 is arranged is changed. The position setting unit 57 outputs the set position information to the first air tag transmission unit 55.

  The first air tag transmission unit 55 receives position information set from the position setting unit 57 and processing information from the first process execution unit 53. Hereinafter, the process information output by the first process execution unit 53 is also referred to as first process information. The first process information includes the type of process that can be executed by the first process execution unit 53 and the set value for each condition for executing the type of process. Instead of the set value, an attribute of the set value may be used. Further, when the first process execution unit 53 is executing a process, the first process information further includes data identification information for identifying data to be processed by the first process execution unit 53. First air tag transmission unit 55 generates air tag information including device identification information for identifying MFP 100, position information, and first process information input from first process execution unit 53, and uses the air tag information as a server. It transmits to 300 via the communication I / F part 112.

  FIG. 8 is a diagram illustrating an example of a format of air tag information. Referring to FIG. 8, the air tag information includes an apparatus identification information item, a position information item, and a processing information item. Further, the air tag information includes an item to be processed as an option. In the item of device identification information, device identification information of a device that transmits air tag information is set. In the position information item, position information indicating the current position of the device that transmits the air tag information is set. The item of processing information includes a type item and a condition item. For the type item, process identification information is set, and in the condition item, a set value attribute is set for each item that defines a condition for executing the process identified by the process identification information. In the item to be processed, data identification information for identifying data to be processed is set. The items to be processed may or may not be included in the air tag information.

  Returning to FIG. 7, the first command receiving unit 51 receives a command that the communication I / F unit 112 receives from the outside. The first command receiving unit 51 outputs a command received from the outside to the first process execution unit 53. The first command receiving unit 51 receives a command transmitted from the electronic paper device 400 or the portable information device 200 described later to the MFP 100. The command includes process identification information for identifying the process and a setting value for each condition for executing the process. Further, the command may include data identification information for identifying data to be processed. The first command receiving unit 51 may receive data together with a command. When receiving a command and data, the first command receiving unit 51 outputs a set of the command and data to the first process execution unit 53.

  FIG. 9 is a diagram illustrating an example of a command format. Referring to FIG. 9, the command includes a process identification information item, a condition item, and a data specifying item. In the process identification information item, process identification information for identifying a process is set. In the condition item, a set value for each condition for executing the process specified by the process identification information set in the process identification information item is set. In the data specifying item, data identification information for identifying data to be processed is set. Data specific items may or may not be included in the command.

  Returning to FIG. 7, the first processing execution unit 53 includes a first display control unit 61, a first image formation control unit 63, a first transmission / reception control unit 65, a first data storage unit 67, and a first command. A transmission unit 69. The first display control unit 61 controls the display unit 161 to display an image of data on the display unit 161. The image displayed by the first display control unit 61 on the display unit 161 includes an image of data received from the outside and an image of data stored in the HDD 115. For example, when a user operating MFP 100 operates operation unit 163 to input an operation for displaying a preview of an image of data stored in HDD 116, first display control unit 61 causes display 116 to display on HDD 116. An image of stored data is displayed. In this case, the first process execution unit 53 sets the image data displayed by the first display control unit 61 as a processing target. In addition, when the process identification information included in the command input from the first command receiving unit 51 indicates display processing, the first display control unit 61 displays an image of data input together with the command according to the condition included in the command. It is displayed on the display unit 161 according to the set value set in the item.

  When the process identification information included in the command input from the first command receiving unit 51 indicates the image forming process, the first image formation control unit 63 displays the image of the data input together with the command as a condition included in the command. An image is formed on a sheet according to the setting value set in the item. In addition, the first image formation control unit 63 is a case where the process identification information included in the command input from the first command receiving unit 51 indicates an image formation process, and the command includes a data specifying item. Data specified by the data identification information set in the data specifying item is acquired, and an image of the acquired data is formed on a sheet according to the setting value set in the condition item included in the command.

  When the process identification information included in the command input from the first command receiving unit 51 indicates the data transmission process, the first transmission / reception control unit 65 sets the data input together with the command as the condition item included in the command. Transmit according to the set value. For example, if the condition that determines the transmission method is email transmission, and the condition that determines the transmission destination is an email address, the email address is the destination, an email with data attached is created, and the created email is communicated. The I / F unit 112 is controlled and transmitted to the e-mail server. The e-mail server address may be registered in advance. If the condition for determining the transmission method indicates facsimile transmission and the condition for determining the transmission destination indicates a facsimile number, the facsimile unit 116 is controlled to transmit the data to the facsimile number. In addition, when the condition for determining the transmission method indicates file transfer and the condition for determining the destination indicates an IP (Internet Protocol) address, the communication I / F unit 112 is controlled to transfer the data to the IP using the FTP (File Transfer Protocol) protocol. Send to address.

  In addition, when the process identification information included in the command input from the first command receiving unit 51 indicates a data reception process, the first transmission / reception control unit 65 receives data according to the set value set in the condition included in the command. To do. For example, data specified by the data identification information set in the data specifying item included in the command is downloaded by controlling the communication I / F unit 112. The data identification information set in the data specific item is, for example, a URL (Uniform Resource Locator).

  When the process identification information included in the command input from the first command receiving unit 51 indicates the data storage process, the first data storage unit 67 sets the data input together with the command as the condition item included in the command. According to the set value. For example, when the condition for determining the storage destination indicates the HDD 116, data input together with the command is stored in the HDD 116.

  When the process identification information included in the command input from the first command receiver 51 indicates a remote operation process, the first command transmission unit 69 is included in the command according to the set value set in the condition included in the command. The remote operation command included in the command is transmitted to the device specified by the condition.

  FIG. 10 is a diagram illustrating an example of a detailed format of a command condition item whose process identification information indicates a remote operation process. Referring to FIG. 10, the command condition items whose process identification information indicates remote operation processing include a remote operation device item, a remote operation command item, and a remote operation data item. In the item of the remote operation device, device identification information of the device to be remotely operated is set. In the item of the remote operation command, a command to be transmitted to a device to be remotely operated is set. In the item of remote operation data, data identification information for identifying data to be processed is set. The remote operation command item further includes a process identification information item and a condition item. In the process identification information item, process identification information for identifying a process is set. In the condition item, a set value for each condition for executing the process specified by the process identification information set in the process identification information item is set.

  Returning to FIG. 7, the case where the command input from the first command receiving unit 51 is set to the remote operation process in the item of the process identification information will be specifically described. The apparatus identification information of the electronic paper apparatus 400 is set in the item of the remote operation apparatus, the process identification information of the data storage process is set in the process identification information item of the remote operation command item, and the file format is set in the condition item. An example in which the data identification information of the image data displayed by the first display control unit 61 is set in the remote operation data item will be described. The first command transmission unit 69 generates a new command based on the command input from the first command reception unit 51. Specifically, the process identification information and file format of the data storage process set in the item of the remote operation command of the command input from the first command receiving unit 51, the item of the process identification information of the new command, and A new command is generated by setting each of the condition items. Then, the generated new command and the image data displayed by the first display control unit 61 set in the item of the remote operation data of the command input from the first command receiving unit 51 are remotely operated. The data is transmitted via the communication I / F unit 112 to the electronic paper device 400 specified by the device identification information set in the device item.

  As described above, the processes that can be executed by the first process execution unit 53 are an image display process, an image formation process, a data transmission process, a data reception process, a data storage process, and a remote operation process. For this reason, the first process execution unit 53 sends the first air tag transmission unit 55 to the image display process, the image formation process, the data transmission process, the data reception process, the data storage process, and the remote operation as information indicating the type of process. Process identification information for identifying each process is output. Furthermore, in addition to the process identification information, the first process execution unit 53 outputs a set value for each condition for executing the type of process identified by the process identification information.

  Furthermore, when the process is being executed, the first process execution unit 53 outputs data identification information for specifying the data that is the process target. For example, when the first display control unit 61 is executing an image display process, the first process execution unit 53 identifies the data displayed on the display unit 161 with respect to the process identification information of the image display process. Information is output to the first air tag transmitter 55. In addition to the data identification information of the processing target data, the first display control unit 61 outputs data identification information of all data that can be displayed on the display unit 161 among the one or more data stored in the HDD 115. May be.

  The processes that can be executed by the first process execution unit 53 are not limited to these. For example, a character recognition process that converts a character image included in the image into text, and a sharpening that emphasizes the contour in the image. Processing and image processing such as binarization processing for binarizing the image may be included.

  FIG. 11 is a block diagram illustrating an example of an outline of functions of a CPU provided in the electronic paper device according to the present embodiment. The functions shown in FIG. 11 are functions formed in the CPU 401 when the CPU 401 included in the electronic paper device 400 executes a program stored in the flash memory 403 and the CD-ROM 413A. Referring to FIG. 11, CPU 401 includes a second command receiving unit 451, a second process execution unit 453, a second air tag transmission unit 455, and a device side position detection control unit 457.

  The apparatus side position detection control unit 457 controls the position detection unit 411 and acquires the current position measured by the position detection unit 411. The apparatus side position detection control unit 457 outputs position information indicating the acquired current position to the second air tag transmission unit 455.

  The second air tag transmission unit 455 receives position information from the apparatus side position detection control unit 457 and receives processing information from the second process execution unit 453. Hereinafter, the process information output by the second process execution unit 453 is also referred to as second process information. The second process information includes the type of process that can be executed by the second process execution unit 453 and the set value for each condition for executing the type of process. Instead of the set value, an attribute of the set value may be used. Furthermore, when the second process execution unit 453 is executing a process, the second process information further includes data identification information. The second air tag transmission unit 455 generates air tag information including device identification information for identifying the electronic paper device 400, position information indicating the current position, and second processing information output from the second processing execution unit 453. Then, the air tag information is transmitted to the server 300 via the wireless LAN I / F 409. The format of the air tag information transmitted by the second air tag transmission unit 455 is the same as the format shown in FIG.

  The second command receiving unit 451 receives a command received by the wireless LAN I / F 409 from the outside. The second command receiving unit 451 outputs a command received from the outside to the second processing execution unit 453. Second command reception unit 451 receives a command transmitted from MFP 100, 101, 102 or portable information device 200 (described later) to electronic paper device 400. The command format is the same as the format shown in FIGS. The second command receiving unit 451 may receive data together with the command. When receiving the command and data, the second command reception unit 451 outputs the command and data combination to the second process execution unit 453.

  The second process execution unit 453 includes a second display control unit 461, a second transmission / reception control unit 463, a second data storage unit 465, and a second command transmission unit 467. The second display control unit 461 controls the display unit 405 and causes the display unit 405 to display an image of data. The image displayed on the display unit 405 by the second display control unit 461 includes an image of data stored in the flash memory 403 and an image of data received from the outside. For example, when the user operating the electronic paper device 400 operates the operation unit 407 and inputs an operation for displaying an image of data stored in the flash memory 403, the second display control unit 461 displays the display unit. In 405, an image of data stored in the flash memory 403 is displayed. In this case, the second process execution unit 453 sets the image data displayed by the second display control unit 461 as a processing target. In addition, when the process identification information included in the command input from the second command receiving unit 451 indicates an image display process, the second display control unit 461 determines that the image of data input together with the command is included in the command Is displayed on the display unit 405 in accordance with the set value set in.

  When the process identification information included in the command input from the second command receiving unit 451 indicates the data transmission process, the second transmission / reception control unit 463 sets the data input together with the command as a condition included in the command. Send according to the set value. For example, if the condition that defines the transmission method is email transmission and the condition that defines the transmission destination is an email address, the email address is the destination, an email with data attached is created, and the created email is The data is transmitted to the electronic mail server via the LAN I / F 409. The e-mail server address may be registered in advance. Further, when the condition that determines the transmission method indicates file transfer and the condition that determines the transmission destination indicates an IP address, the wireless LAN I / F 409 is controlled to transmit data to the IP address using the FTP protocol.

  The second transmission / reception control unit 463 receives data according to the set value set in the condition included in the command when the process identification information included in the command input from the second command receiving unit 451 indicates a data reception process. To do. For example, data specified by the data identification information set in the data specifying item included in the command is downloaded by controlling the wireless LAN I / F 409. The data identification information set in the data specifying item is, for example, a URL.

  When the process identification information included in the command input from the second command receiving unit 451 indicates the data storage process, the second data storage unit 465 sets the data input together with the command as a condition included in the command. Store according to the set value. For example, when the condition for determining the storage destination indicates the flash memory 403, the data input together with the command is stored in the flash memory 403.

  The second command transmission unit 467 is included in the command according to the set value set in the condition included in the command when the process identification information included in the command input from the second command reception unit 451 indicates a remote operation process. The remote operation command included in the command is transmitted to the device set as the condition. When the process identification information included in the command input from the first command receiving unit 51 indicates remote operation processing, the conditions included in the command include a remote operation device item that determines a device to be remotely operated, and a remote operation command item. And a remote operation data item that specifies data to be processed by the remote operation target device.

  For example, in the command input from the second command receiving unit 451, the device identification information of the MFP 100 is set in the remote operation device item, and the conditions for determining the processing identification information and image formation conditions of the image forming process are set in the remote operation command item. An example will be described in which a set value is set for each, and data identification information of image data displayed by the second display control unit 461 is set in the remote operation data item. The second command transmission unit 467 generates a new command based on the command input from the second command reception unit 451. Specifically, the processing identification information of the image forming process set in the item of the remote operation command of the command input from the second command receiving unit 451 and the setting value for each condition that defines the image forming condition are set as a new command. A new command is generated by setting each of the process identification information item and the condition item. Then, the generated new command and the image data displayed by the second display control unit 461 set in the remote operation data item of the command input from the second command receiving unit 451 are remotely operated. The data is transmitted to the MFP 100 specified by the device identification information set in the device item via the wireless LAN I / F 409.

  As described above, the processes that can be executed by the second process execution unit 453 are the image display process, the data transmission process, the data reception process, the data storage process, and the remote operation process. Therefore, the second process execution unit 453 outputs process identification information for identifying each of the image display process, the data transmission process, the data reception process, the data storage process, and the remote operation process as information indicating the type of process. . Furthermore, in addition to the process identification information, the second process execution unit 453 outputs a set value for each condition for executing the type of process identified by the process identification information.

  Furthermore, when the process is being executed, the second process execution unit 453 outputs data identification information for specifying the data that is the target of the process. For example, when the second display control unit 461 is executing the image display process, the second process execution unit 453 identifies the data displayed on the display unit 405 with respect to the process identification information of the image display process. Information is output to the second air tag transmitter 455. In addition to the data identification information of the processing target data, the second display control unit 461 outputs data identification information of all data that can be displayed on the display unit 405 among one or more data stored in the flash memory 403. You may do it.

  Note that the processes that can be executed by the second process execution unit 453 are not limited to these. For example, a character recognition process that converts a character image included in the image into text, and a sharpening that emphasizes the outline in the image. Processing and image processing such as binarization processing for binarizing the image may be included.

  FIG. 12 is a block diagram illustrating an example of an overview of the functions of the CPU provided in the server according to the present embodiment. The functions illustrated in FIG. 12 are functions formed in the CPU 301 when the CPU 301 included in the server 300 executes a program stored in the ROM 302 or the HDD 304. Referring to FIG. 12, CPU 301 includes an air tag information receiving unit 351, an air tag information registering unit 353, a transmission request receiving unit 355, an extracting unit 357, and an air tag information returning unit 359.

  The air tag information reception unit 351 receives air tag information received from the outside by the communication unit 305 and outputs the received air tag information to the air tag information registration unit 353. The air tag information is received from any of MFPs 100, 101, and 102 and electronic paper apparatus 400 that function as an information processing apparatus. The air tag information includes device identification information, position information, and processing information. Further, the air tag information may include data identification information. The process information includes the type of process and a set value for each condition for executing the process for each type.

  The air tag information registration unit 353 stores the air tag information input from the air tag information reception unit 351 in the HDD 304. The air tag information registration unit 353 stores only the latest air tag information for each device. Specifically, the air tag information registration unit 353 determines that the air tag information having the same device identification information as the device identification information of the air tag information device input from the air tag information receiving unit 351 is already stored in the HDD 304. Air tag information stored in the HDD 304 is updated by an air tag information device input from the receiving unit 351.

  The transmission request receiving unit 355 controls the communication unit 305 and receives a transmission request transmitted from the outside. In the present embodiment, a case where portable information device 200 described later transmits a transmission request will be described as an example. In this case, the transmission request receiving unit 355 receives a transmission request from the portable information device 200. Although details of the transmission request will be described later, it includes position information indicating the current position of the device that has transmitted the transmission request, here, the portable information device 200. The transmission request reception unit 355 outputs an extraction instruction including the position information included in the received transmission request to the extraction unit 357.

  The extraction unit 357 extracts air tag information satisfying a predetermined condition from the air tag information stored in the HDD 304 by the air tag information registration unit 353 in response to an extraction instruction input from the transmission request reception unit 355. Specifically, air tag information in which position information within a predetermined distance is set from the position specified by the position information included in the extraction instruction is extracted from the air tag information stored in the HDD 304. In other words, only the air tag information transmitted from the MFPs 100, 101, 102 and the electronic paper device 400 that are within a predetermined distance from the portable information device 200 is extracted. The predetermined distance can be arbitrarily determined. The predetermined distance is preferably a distance that allows a user operating portable information device 200 to touch the device with his / her hand. In addition, when the mobile information device 200 captures an image of the device to be operated, the mobile information device 200 may be slightly retracted from the device, so the distance that can be touched by the hand by one or two steps is added. It may be a distance. When there are a plurality of pieces of air tag information set with position information within a predetermined distance from the position specified by the position information included in the extraction instruction, the extraction unit 357 extracts all of them. The extraction unit 357 outputs the extracted one or more pieces of air tag information to the air tag information return unit 359. Further, when the air tag information is not extracted, the extraction unit 357 outputs an error signal to the air tag information return unit 359.

  When one or more pieces of air tag information are input from the extraction unit 357, the air tag information return unit 359 is a device that has transmitted a transmission request for one or more pieces of air tag information input from the extraction unit 357, here, a portable information device 200 is transmitted via the communication unit 305. In addition, when an error signal is input from the extraction unit 357, the air tag information return unit 359 transmits the error signal to the device that has transmitted the transmission request via the communication unit 305.

  FIG. 13 is a block diagram illustrating an example of an overview of functions of a CPU provided in the portable information device according to the present embodiment. The functions shown in FIG. 13 are functions formed in the CPU 201 when the CPU 201 included in the portable information device 200 executes a remote control program stored in the flash memory 203 or the CD-ROM 210A. Referring to FIG. 13, the CPU 201 includes an imaging control unit 251 that controls the camera 202, a display control unit 253 that controls the display unit 206, a portable side position detection control unit 255 that controls the position detection unit 209, and an orientation An azimuth detection control unit 257 that controls the detection unit 210, an air tag request unit 261, an air tag reception unit 263, a subject identification unit 265, and a remote operation unit 267 are included.

  When the shutter button provided in the operation unit 207 is instructed by the user, the imaging control unit 251 controls the camera 202 to cause the camera 202 to capture an image. Then, the imaging control unit 251 accepts a captured image that the camera 202 images and outputs a subject. Here, the subject of the camera 202 is the MFP 100 and the electronic paper device 400 that are remote operation targets. The imaging control unit 251 outputs a captured image output from the camera 202 to the display control unit 253 and outputs an imaging signal indicating that the image is captured to the portable side position detection control unit 255 and the azimuth detection control unit 257. Note that an imaging signal may be output when the camera 202 is activated. For example, the camera 202 may display a moving image on the display unit 206 in order to determine the imaging range before the user instructs the shutter button. In this case, the imaging signal is continuously output while the camera 202 is activated and the moving image output by the camera 202 is displayed on the display unit 206.

  The display control unit 253 controls the display unit 206 in response to the input of the captured image from the imaging control unit 251 to display the captured image on the display unit 206. Thereby, the user who operates the portable information device 200 can check the subject imaged by the camera 202.

  The azimuth detection control unit 257 controls the azimuth detection unit 210 in response to an imaging signal input from the imaging control unit 251, causes the azimuth detection unit 210 to detect the imaging direction of the camera 202, and the azimuth detection unit 210 outputs Get the direction to do. The direction detection control unit 257 outputs the direction information indicating the acquired direction to the subject specifying unit 265.

  The portable side position detection control unit 255 controls the position detection unit 411 in response to the input of the imaging signal from the imaging control unit 251, causes the position detection unit 209 to measure the current position, and the position detection unit 411 outputs it. Get the current position. The apparatus-side position detection control unit 457 outputs position information indicating the acquired current position to the air tag requesting unit 261 and the subject specifying unit 265.

  The air tag request unit 261 transmits a transmission request including the position information to the server 300 via the wireless LAN I / F 208 in response to the input of the position information from the portable side position detection control unit 255 and receives the air tag. The reception instruction is output to the unit 263. The portable information device 200 may store the IP address of the server 300 in advance.

  The server 300 that receives the transmission request returns one or more air tag information or an error signal as described above. When the wireless LAN I / F 208 receives one or more air tag information or error signals from the server 300 after the reception instruction is input from the air tag requesting unit 261, the air tag receiving unit 263 acquires one or more air tag information or error signals. . The air tag receiving unit 263 outputs the acquired one or more pieces of air tag information or error signals to the subject specifying unit 265.

  The subject specifying unit 265 receives position information from the mobile-side position detection control unit 255, direction information from the direction detection control unit 257, and one or more air tag information or error signals from the air tag reception unit 263. When one or more pieces of air tag information are input from the air tag receiving unit 263, the subject specifying unit 265 is position information located in a direction specified by the azimuth information from a position specified by the position information from the one or more pieces of air tag information. One or more pieces of air tag information including are extracted. The air tag information includes device identification information, position information, and processing information. The subject specifying unit 265 specifies a device specified by the device identification information set in each of the extracted one or more pieces of air tag information as a subject. The subject specifying unit 265 outputs the extracted one or more pieces of air tag information to the remote operation unit 267.

  Hereinafter, a case where the air tag information of the MFP 100 and the air tag information of the electronic paper device 400 are extracted by the subject specifying unit 265 and output to the remote operation unit 267 will be described. In this case, the user uses the camera 202 to capture the MFP 100 and the electronic paper device 400 within the imaging range. Therefore, images on MFP 100 and electronic paper device 400 are displayed on display unit 206. In the following description, air tag information including device identification information of the electronic paper device 400 is referred to as first air tag information, and air tag information including device identification information of the MFP 100 is referred to as second air tag information.

  The remote operation unit 267 receives one or more pieces of air tag information from the subject specifying unit 265. Remote operation unit 267 includes a data specifying unit 271, a process specifying unit 273, an identification information display unit 275, and a third command transmission unit 277. The data specifying unit 271 specifies candidate data that can be a processing target. The data specifying unit 271 uses, as candidate data, data specified by the data identification information set in the processing target items included in the first air tag information and the second air tag information, and device identification information, data identification information, Are output to the identification information display unit 275.

  The process specifying unit 273 specifies candidate processes that can be candidates for execution. The process specifying unit 273 uses the process specified by the process identification information set in the condition items included in the first air tag information and the second air tag information as a candidate process, and sets the combination of the apparatus identification information and the process identification information. Is output to the identification information display unit 275.

  The identification information display unit 275 receives a set of device identification information and data identification information for each candidate data from the data specifying unit 271, and sets a set of device identification information and processing identification information for each candidate process from the processing specifying unit 273. Entered. The identification information display unit 275 displays a first identification image corresponding to the candidate data and a second identification image corresponding to the candidate process on the display unit 206 in order to notify the user of the candidate data and the candidate process. indicate. When there are a plurality of candidate data, the identification information display unit 275 displays a plurality of first identification images respectively corresponding to the plurality of candidate data. Further, when there are a plurality of candidate processes, the identification information display unit 275 displays a plurality of second identification images respectively corresponding to the plurality of candidate processes.

  The first identification image may be an image of data identification information, or may be an image obtained by reducing an image of data identified by the data identification information. The identification information display unit 275 displays device identification information paired with the data identification information on the display unit 206, and displays the first identification image in the vicinity of the displayed device identification information.

  The second identification image may be an image of the name of the process identified by the process identification information, or may be an image designed for the process. The identification information display unit 275 displays the device identification information paired with the processing identification information on the display unit 206, and displays the second identification image in the vicinity of the displayed device identification information.

  The identification information display unit 275 displays the second identification image corresponding to the first air-ertag information in order to indicate to the user which of the first air-artag information and the second air-tag information the second identification image corresponds to. Are displayed side by side in the upper part of the display unit 206, and the second identification image corresponding to the second air arc tag information is preferably displayed side by side in the lower part of the display unit 206. Further, in order to indicate whether the second identification image corresponds to the first air tag information or the second air tag information, the apparatus identification information may be added to the second identification image, The shape or color of the second identification image may be made different between the first air tag information and the second air tag information.

  When the operation for associating the first identification image with the second identification image is input to the operation unit 207 after displaying the first identification image and the second identification image, the identification information display unit 275 displays the first identification image and the second identification image. A set of data identification information and device identification information corresponding to candidate data specified by one identification image, and a set of process identification information and device identification information corresponding to candidate processing specified by the second identification image, Output to the third command transmitter 277. The operation for associating the first identification image with the second identification image is, for example, an operation of dragging and dropping the first identification image onto the second identification image. Further, the operation for associating the first identification image with the second identification image may be an operation for instructing the second identification image following the operation for instructing the first identification image. The operation for instructing the first identification image may be performed following the operation for instructing the identification image. In any case, any operation that can identify one of the one or more first identification images and one of the one or more second identification images may be used.

  When the combination of data identification information and device identification information and the combination of processing identification information and device identification information are input from the identification information display unit 275, the third command transmission unit 277 converts the data specified by the data identification information. On the other hand, a command for causing the device specified by the device identification information paired with the processing identification information to execute the processing specified by the processing identification information is generated. The third command transmission unit 277 is one of the device identified by the device identification information paired with the data identification information and the device identified by the device identification information paired with the processing identification information. Then, the data is transmitted via the wireless LAN I / F 208. Hereinafter, a device specified by device identification information paired with data identification information is referred to as a remote control device, and a device specified by device identification information paired with processing identification information is referred to as a remote control device. Air tag information including a set of data identification information and device identification information input from the identification information display unit 275 is referred to as air tag information corresponding to the first identification image, and processing identification information input from the identification information display unit 275 The air tag information including the set of device identification information is referred to as air tag information corresponding to the second identification image.

<When remote control device and remote control are the same>
When the remote control device and the remote control are the same, the air tag information corresponding to the first identification image and the air tag information corresponding to the second identification information are the same. The third command transmission unit 277 generates a first command. The third command transmission unit 277 displays on the display unit 206 a screen for accepting the setting value of the attribute set in the condition item among the processing information included in the air tag information corresponding to the second identification image, and the user Accepts a setting value input to the operation unit 207.

  The third command transmission unit 277 sets the processing identification information set in the processing information item of the air tag information corresponding to the second identification image in the processing identification information item, the condition item, and the data specifying item of the first command. The first command is generated by setting the set value received for each condition and the data identification information input from the identification information display unit 275, respectively. Then, the third command transmission unit 277 transmits the generated first command to the device specified by the device identification information input from the identification information display unit 275 via the wireless LAN I / F 208.

<When a remote control device is different from a remote control device and a command is transmitted to the remote control device>
The third command transmission unit 277 generates a second command. The third command transmission unit 277 displays on the display unit 206 a screen for accepting the setting value of the attribute set in the condition item among the processing information included in the air tag information corresponding to the second identification image, and the user Accepts a setting value input to the operation unit 207.

  The third command transmission unit 277 includes the processing identification information set in the item of processing information included in the air tag information corresponding to the second identification image, the processing identification information in the processing identification information item and the condition item of the remote operation command, and the condition A remote operation command is generated by setting the set value received for each time.

  Next, the third command transmission unit 277 is set in the item of device identification information of the air tag information corresponding to the second identification image in the item of remote operation device, the item of remote operation command, and the item of remote operation data. A condition item is generated by setting the device identification information, the remote operation command, and the data identification information set in the processing target item of the air tag information corresponding to the first identification image. Furthermore, the second command transmission unit 277 generates the second command by setting the processing identification information of the remote operation processing and the generated condition item in the processing identification information item and the condition item, respectively. . Then, the third command transmission unit 277 transmits the generated second command to the remote control device via the wireless LAN I / F 208.

<When a remote control device is different from a remote control device and a command is transmitted to the remote control device>
The third command transmission unit 277 generates a third command. The third command transmission unit 277 displays on the display unit 206 a screen for accepting the setting value of the attribute set in the condition item among the processing information included in the air tag information corresponding to the second identification image, and the user Accepts a setting value input to the operation unit 207.

  The third command transmission unit 277 sets the processing set in the processing information item included in the air tag information corresponding to the second identification image in the processing identification information item, the condition item, and the data specifying item of the remote operation command. By setting the identification information, the set value accepted for each condition, and the data identification information set in the processing target item included in the air tag information corresponding to the first identification image, the third command is set. Generate. Then, the third command transmission unit 277 transmits the generated third command to the remote control device via the wireless LAN I / F 208.

  Here, the case where the data displayed on the electronic paper device 400 is image-formed by the MFP 100 will be specifically described. In this case, the electronic paper device 400 is a remote operation device, and the MFP 100 is a remote control device. First, when the user takes an image of electronic paper device 400 and MFP 100 as an imaging range with camera 202 of portable information device 200, an image of electronic paper device 400 and MFP 100 is displayed on display unit 206. Further, the thumbnail of the data of the image displayed on the electronic paper device 400 is displayed as the first identification image on the display unit 206, and the image indicating the image forming process that can be executed by the MFP 100 is displayed as the second identification image. The

  If the user drags the first identification image and drops it in a state of being superimposed on the second identification image, portable information device 200 displays a screen for setting image forming conditions for MFP 100 to form an image. Displayed on the unit 206. When the user sets image formation conditions, portable information device 200 generates a remote operation command that causes MFP 100 to form an image. When the portable information device 200 transmits a command to the electronic paper device 400 that is a remote operation device, the portable information device 200 generates a second command including the remote operation command and transmits the generated second command to the electronic paper device 400. . The second command includes process identification information of remote operation processing, apparatus identification information of MFP 100, a remote operation command, and data identification information of data displayed on electronic paper apparatus 400.

  When the electronic paper device 400 receives the second command from the portable information device 200, the electronic paper device 400 is identified by the remote operation command set in the remote operation command item item of the second command and the data identification information set in the remote operation data item. The data (data displayed on the display unit 206) is transmitted to the MFP 100 specified by the device identification information set in the remote operation device item via the wireless LAN I / F 208.

  When MFP 100 receives a remote operation command and data from electronic paper apparatus 400, MFP 100 processes the data according to the remote operation command. Specifically, the image forming process specified by the process identification information set in the process identification information item of the remote operation command is determined according to the set value for each image formation condition set in the remote operation command condition item. , Form an image of the received data.

  In addition, when transmitting a command to MFP 100 that is a remote control device, portable information device 200 generates a third command and transmits the generated third command to MFP 100. The third command includes a remote operation command and data identification information of data displayed on the electronic paper device 400.

  In MFP 100, when the third command is received from portable information device 200, data is processed in accordance with the third command. Specifically, MFP 100 downloads data specified by the data identification information set in the data identification item of the third command from electronic paper device 400, and processes set in the processing identification information item of the third command The image of the data downloaded from the electronic paper device 400 is formed in accordance with the set value for each image forming condition set in the condition item of the third command for the image forming process specified by the identification information.

  Therefore, if the user places the data desired to be printed on the electronic paper device 400 on the MFP 100 and shoots them with the camera 202 of the portable information device 200, the electronic paper device 400 and the MFP 100 are connected. Can be identified. Further, by inputting an operation for associating the first identification image and the second identification image displayed on the portable information device 200, the data specified by the first identification image is designated as data to be processed. Can be designated as a process for executing the process specified by the second identification image. For this reason, it is not necessary to display a screen for designating data, or to display a screen for designating a device for outputting data, and the operation becomes easy.

  FIG. 14 is a flowchart illustrating an example of the flow of MFP control processing. The MFP control process is a process executed by the CPU 111 when the CPU 111 provided in each of the MFPs 100, 101, and 102 in the present embodiment executes the MFP control program stored in the ROM 113, the HDD 115, and the CD-ROM 118.

  Referring to FIG. 14, CPU 111 determines whether position information has been received (step S01). For example, when a user who manages MFP 100 inputs position information from operation unit 163, the position information is received. If position information is accepted, the process proceeds to step S02; otherwise, the process proceeds to step S05.

  In step S02, the position information received in step S01 is stored in HDD 115, and the process proceeds to step S03. In step S03, air tag information is generated. The air tag information includes device identification information for identifying MFP 100, position information stored in HDD 115 in step S02, and processing information. The processing information includes types of processing that can be executed by MFP 100 and setting values that can be set for each condition for executing processing for each type. Note that the attribute of the set value may be used instead of the set value. Further, when MFP 100 is executing a process, the process information includes data identification information for identifying data that is a target of the process that MFP 100 is executing. For example, when MFP 100 displays a preview of an image of data stored in HDD 115 on display unit 161, the processing information includes data identification information of the data. Therefore, step S03 and step S04 may be executed every time the position of MFP 100 is changed and every time data that is processed by MFP 100 is changed.

  In the next step S04, the air tag information generated in step S03 is transmitted to the server 300 via the communication I / F unit 112. The IP address of the server 300 may be stored in the HDD 115 in advance.

  Then, it is determined whether or not the communication I / F unit 112 has received a command (step S05). In the present embodiment, commands may be received from MFPs 101 and 102, portable information device 200, or electronic paper device 400.

  In the next step S06, the command is executed, and the process returns to step S01. The command includes process identification information for identifying the process and a set value for each item of the condition for executing the process. Specifically, when the process identification information included in the command indicates image formation processing, the image of the data input together with the command is set according to the set value for each image formation condition set in the condition item included in the command. An image is formed on a sheet. In addition, when the command includes a data specific item, the data specified by the data identification information set in the data specific item is acquired, and the image of the acquired data is set as the condition item included in the command. An image is formed on the sheet according to the set value for each image forming condition.

  When the process identification information included in the command indicates a data transmission process, an image is formed on a sheet of data input together with the command according to a set value for each condition set in the condition item included in the command. When the process identification information included in the command indicates a data reception process, data is received according to the setting value for each condition set in the condition item included in the command included in the command. For example, data specified by the data identification information set in the data specifying item included in the command is downloaded by controlling the communication I / F unit 112. The data identification information set in the data specific item is, for example, a URL (Uniform Resource Locator). Further, when the process identification information included in the command indicates a data storage process, data input together with the command is stored according to the set value for each condition set in the condition item included in the command.

  Further, when the process identification information included in the command indicates a remote operation process, the remote operation command is transmitted according to the setting value for each condition set in the condition item included in the command. When the process identification information included in the command indicates remote operation processing, the item of the condition included in the command is processed by the remote operation device item that determines the remote operation target device, the remote operation command, and the remote operation target device. Remote operation data items for specifying data to be targeted. For this reason, the communication I / F unit transmits a remote operation command and data specified by the data identification information set in the remote operation data item to the device specified by the device identification information set in the remote operation device item. 112 to transmit.

  FIG. 15 is a flowchart illustrating an example of the flow of the electronic paper control process. The electronic paper control process is a process executed by the CPU 401 when the CPU 401 included in the electronic paper device 400 according to the present embodiment executes a program stored in the flash memory 403 and the CD-ROM 413A.

  Referring to FIG. 15, CPU 401 detects a position (step S401). The position detector 411 is controlled, and the current position measured by the position detector 411 is acquired. Then, it is determined whether or not the position has been changed (step S402). It is determined whether or not the position detected in step S401 executed this time is different from the position detected in step S401 executed before this time. If the position has been changed, the process proceeds to step S404; otherwise, the process proceeds to step S403. In step S403, it is determined whether display data has been changed. If the data displayed on display unit 405 has been changed, the process proceeds to step S404; otherwise, the process proceeds to step S407.

  In step S404, display data is specified. Data identification information of the data displayed on the display unit 405 is acquired. In other words, the data identification information of the data to be processed by the electronic paper device 400 is acquired.

  In the next step S405, air tag information is generated. The air tag information includes device identification information for identifying the electronic paper device 400, position information detected in step S401, and processing information. The processing information includes types of processing that can be executed by the electronic paper device 400 and setting values that can be set for each condition for executing processing for each type. Note that the attribute of the set value may be used instead of the set value. Furthermore, when the electronic paper device 400 is executing processing, the processing information includes data identification information for identifying data that is the target of the processing that the electronic paper device 400 is executing. Specifically, the processing information includes data identification information of the data specified in step S404.

  In the next step S406, the air tag information generated in step S405 is transmitted to the server 300 via the wireless LAN I / F 409. The IP address of the server 300 may be stored in the flash memory 403 in advance.

  In step S407, it is determined whether or not the wireless LAN I / F 409 has received a command. In the present embodiment, commands may be received from MFPs 100, 101, 102 and portable information device 200.

  In the next step S408, the command is executed, and the process returns to step S401. The command includes process identification information for identifying the process and a set value for each item of the condition for executing the process. Specifically, when the process identification information included in the command indicates image display processing, the image of the data input together with the command is set according to the setting value for each image forming condition set in the condition item included in the command. It is displayed on the display unit 405. When the process identification information included in the command indicates a data transmission process, the data input together with the command is transmitted according to the set value set in the condition item included in the command. When the process identification information included in the command indicates a data reception process, data is received according to the set value set in the condition item included in the command. When the process identification information included in the command indicates a data storage process, the data input together with the command is stored according to the set value set in the condition item included in the command.

  Further, when the process identification information included in the command indicates a remote operation process, the remote operation command is transmitted according to the setting value for each condition set in the condition item included in the command. When the process identification information included in the command indicates remote operation processing, the item of the condition included in the command is processed by the remote operation device item that determines the remote operation target device, the remote operation command, and the remote operation target device. Remote operation data items for specifying data to be targeted. For this reason, the wireless LAN I / F 409 is used to send a remote operation command and data specified by the data identification information set in the remote operation data item to the device specified by the device identification information set in the remote operation device item. Send through.

  FIG. 16 is a flowchart showing an example of the flow of air tag information management processing. The air tag information management process is a process executed by the CPU 301 when the CPU 301 included in the server 300 executes a program stored in the ROM 302 or the HDD 304.

  Referring to FIG. 16, CPU 301 determines whether air tag information has been received (step S301). If communication unit 305 has received the air tag information, the process proceeds to step S302; otherwise, the process proceeds to step S303. In the present embodiment, air tag information is received from any of MFPs 100, 101, and 102 and electronic paper apparatus 400 that function as information processing apparatuses. The air tag information includes device identification information, position information, and processing information. Further, the air tag information may include data identification information.

  In step S302, the air tag information received in step S301 is registered, and the process proceeds to step S303. Only the latest air tag information is stored in the HDD 304 for each device. Specifically, when the air tag information having the same device identification information as the device identification information of the device included in the air tag information received in step S301 is already stored in the HDD 304, the air tag information device received in step S301. The air tag information stored in the HDD 304 is updated.

  In step S303, it is determined whether a transmission request has been received. In the present embodiment, it is determined whether communication unit 305 has received a transmission request from portable information device 200. The transmission request includes position information indicating the current position of the portable information device 200 that has transmitted the transmission request. If a transmission request is received, the process proceeds to step S304; otherwise, the process returns to step S301.

  In step S304, the position information of portable information device 200 that has transmitted the transmission request is acquired. The position information included in the transmission request received in step S303 is extracted. Then, air tag information in which position information within a predetermined distance is set from the position specified by the position information acquired in step S304 is extracted from the air tag information stored in the HDD 304. In other words, only the air tag information transmitted from the MFPs 100, 101, 102 and the electronic paper device 400 that are within a predetermined distance from the portable information device 200 is extracted.

  In step S306, air tag information is returned, and the process returns to step S301. Specifically, one or more pieces of air tag information extracted in step S305 are transmitted via the communication unit 305 to the portable information device 200 that has transmitted the transmission request. If air tag information is not extracted in step S305, an error signal is transmitted via the communication unit 305 to the portable information device 200 that has transmitted the transmission request.

  FIG. 17 is a flowchart illustrating an example of the flow of remote control processing. The remote control process is a process executed by the CPU 201 when the CPU 201 included in the portable information device 200 executes a remote control program stored in the flash memory 203 or the CD-ROM 210A.

  Referring to FIG. 17, CPU 201 determines whether or not imaging has been started (step S201). When the camera 202 is activated, it is determined that imaging has started. The process waits until imaging starts, and if imaging starts, the process proceeds to step S202. In step S202, the azimuth is detected. The direction detection unit 210 is controlled to detect the imaging direction of the camera 202, and the direction output from the direction detection unit 210 is acquired. In step S203, the position is detected. The position detection unit 411 is controlled to cause the position detection unit 209 to measure the current position, and the current position output by the position detection unit 411 is acquired.

  In step S204, a transmission request is transmitted. The transmission request including the position detected in step S203 is transmitted to the server 300 via the wireless LAN I / F 208. The flash memory 203 may store the IP address of the server 300 in advance. In the next step S205, the process waits until air tag information is received from the server 300. If air tag information is received, the process proceeds to step S206. When an error signal is input from the server 300, an error message is displayed on the display unit 206, and the process ends. The error message is, for example, “No corresponding device exists”.

  In step S206, an object is specified. Specifically, among the one or more pieces of air tag information received from the server 300 in step S205, one or more pieces of position information including the position information located in the direction of the azimuth detected in step S202 from the position detected in step S203. Extract air tag information. Then, the device identified by the device identification information set in each of the one or more extracted air tag information is specified as the object. Thereby, the device imaged as a subject by the camera 202 is specified as the object. If the user captures any of MFPs 100, 101, and 102 and electronic paper apparatus 400 with camera 202, the captured apparatus is specified as an object. Therefore, the user does not need to input an operation such as specifying device identification information in order to select an object. Here, a case where MFP 100 and electronic paper apparatus 400 are specified as objects will be described as an example. Further, air tag information including the device identification information of the electronic paper device 400 is referred to as first air tag information, and air tag information including the device identification information of the MFP 100 is referred to as second air tag information.

  In step S207, one of the objects specified in step S206 is selected as a processing target. Then, it is determined whether or not an item to be processed is set in the air tag information of the selected object (step S208). If the process target item is set, the process proceeds to step S209; otherwise, the process proceeds to step S211. In step S209, candidate data is specified. The data specified by the data identification information set in the processing target item included in the air tag information is specified as candidate data. Then, the first identification image corresponding to the candidate data is displayed on the display unit 206 (step S210), and the process proceeds to step S211.

  In step S211, candidate processing is specified. The process specified by the process identification information set in the condition item included in the air tag information is specified as a candidate process. Then, the second identification image corresponding to the candidate process is displayed on the display unit 206 (step S212), and the process proceeds to step S213.

  In step S213, it is determined whether there is an object that has not been selected as a processing target in step S207 among the one or more objects specified in step S206. If there is an object not selected as a processing target, the process returns to step S207. If not, the process proceeds to step S214.

  For example, in the electronic paper device 400, when an image of data stored in the flash memory 403 is displayed on the display unit 405, a first identification image corresponding to the data is displayed on the display unit 206. Further, in MFP 100, five second identification images corresponding to executable image display processing, image formation processing, data transmission processing, data reception processing, and data storage processing are displayed on display unit 206. Furthermore, four second identification images corresponding to the image display process, data transmission process, data reception process, and data storage process that can be executed by the electronic paper device 400 are displayed on the display unit 206. In order to indicate to the user whether the second identification image corresponds to MFP 100 or electronic paper apparatus 400, the second identification image corresponding to MFP 100 is displayed side by side on display unit 206, and electronic paper apparatus 400 is displayed. It is preferable that the second identification images corresponding to the above are displayed side by side in the upper part of the display unit 206. Further, in order to indicate which of the MFP 100 and the electronic paper device 400 the second identification image corresponds to, the device identification information may be added to the second identification image, or the second identification image Different shapes or colors may be used.

  In the stage where the process proceeds to step S214, one or more first identification images corresponding to one or more candidate data and one or more second identification images respectively corresponding to one or more candidate processes are displayed on the display unit. 206 is displayed.

  In step S214, it is determined whether or not one of the one or more first identification images has been dragged. If an operation for instructing one of the one or more first identification images for a predetermined time is received, it is determined that the first identification image has been dragged. If any of the one or more first identification images is dragged, the process proceeds to step S215. If not, the process proceeds to step S219.

  In step S215, it is determined whether or not the dragged first identification image is moved and overlaps any one of the one or more second identification images. If the dragged first identification image overlaps any one of one or more second identification images, the process proceeds to step S216; otherwise, the process proceeds to step S228.

  In step S216, it is determined whether the air tag information corresponding to the first identification image and the air tag information corresponding to the second identification image are the same. If the air tag information is the same, the process proceeds to step S217. If they are different, the process proceeds to step S218.

  Here, the device specified by the device identification information included in the air tag information corresponding to the first identification image is a remote control device, and is specified by the device identification information included in the air tag information corresponding to the second identification image. The device is a remote control device. When the air tag information corresponding to the first identification image and the air tag information corresponding to the first identification image are the same, the remote operation device and the remote control are the same.

  In step S217, a first command is generated, and the process proceeds to step S218. Specifically, a screen for accepting the setting value of the attribute set in the condition item among the processing information included in the air tag information corresponding to the first identification image dragged in step S214 is displayed on display unit 206. Then, the setting value input by the user to the operation unit 207 is received. Then, the processing identification information set in the processing information item of the air tag information corresponding to the first identification image is set in the processing identification information item of the first command, and each condition is set in the condition item of the first command. By setting the received set value and setting the data identification information set in the item to be processed of the air tag information corresponding to the first identification image in the data specifying item of the first command, Generate a command.

  In step S218, the first command generated in step S217 is identified by the device identification information set in the device identification information item of the air tag information corresponding to the first identification image dragged in step S214. The data is transmitted to the controller device via the wireless LAN I / F 208, and the process proceeds to step S228.

  In step S219, a second command is generated, and the process proceeds to step S220. Based on the air tag information corresponding to the first identification image dragged in step S214 and the air tag information corresponding to the second identification image determined to overlap with the first identification image dragged in step S215, A second command is generated. Specifically, a screen for accepting the setting value of the attribute set in the condition item among the processing information included in the air tag information corresponding to the second identification image is displayed on the display unit 206, and the user operates the operation unit. The setting value input to 207 is accepted. Then, in the process identification information item of the remote operation command, the process identification information set in the process information item included in the air tag information corresponding to the second identification image is set, and in the condition item of the remote operation command, A remote operation command is generated by setting a set value accepted for each condition.

  Then, in the item of the remote operation device, set the device identification information set in the device identification information item of the air tag information corresponding to the second identification image, set the remote operation command in the item of the remote operation command, A condition item is generated by setting the data identification information set in the item to be processed of the air tag information corresponding to the first identification image in the item of remote operation data. Further, the second command is generated by setting the remote operation processing processing identification information in the second command processing identification information item and setting the generated condition item in the second command condition item. To do.

  In step S220, the second command generated in step S219 is transmitted to the remote control device specified by the device identification information included in the air tag information corresponding to the first identification image via the wireless LAN I / F 208. Then, the process proceeds to step S228.

  On the other hand, in step S221, it is determined whether any one or more second identification images are dragged. If an operation for instructing one of the one or more second identification images for a predetermined time is received, it is determined that the second identification image is dragged. If any of the one or more second identification images is dragged, the process proceeds to step S222; otherwise, the process proceeds to step S228.

  In step S222, it is determined whether the dragged second identification image is moved and overlaps any one of the one or more first identification images. If the dragged second identification image overlaps any one of the one or more first identification images, the process proceeds to step S223; otherwise, the process proceeds to step S228.

  In step S223, it is determined whether the air tag information corresponding to the second identification image is the same as the air tag information corresponding to the first identification image. If the air tag information is the same, the process proceeds to step S224. If the air tag information is different, the process proceeds to step S226.

  In step S224, a first command is generated, and the process proceeds to step S225. Specifically, a screen for accepting the setting value of the attribute set in the condition item among the processing information included in the air tag information corresponding to the second identification image dragged in step S221 is displayed on the display unit 206. Then, the setting value input by the user to the operation unit 207 is received. Then, the processing identification information set in the processing information item of the air tag information corresponding to the second identification image is set in the processing identification information item of the first command, and the condition item of the first command is set for each condition. The first command is set by setting the received set value and setting the data identification information set in the processing target item of the air tag information corresponding to the second identification image in the data specifying item of the first command. Is generated.

  In step S225, the first command generated in step S224 is identified by the device identification information set in the device identification information item of the air tag information corresponding to the second identification image dragged in step S221. The data is transmitted to the controller device via the wireless LAN I / F 208, and the process proceeds to step S228.

  In step S226, a third command is generated, and the process proceeds to step S227. Based on the air tag information corresponding to the second identification image dragged in step S221 and the air tag information corresponding to the first identification image determined to overlap with the second identification image dragged in step S222, A third command is generated. Specifically, a screen for accepting the setting value of the attribute set in the condition item among the processing information included in the air tag information corresponding to the second identification image dragged in step S221 is displayed on the display unit 206. Then, the setting value input by the user to the operation unit 207 is received. Then, the processing identification information set in the processing information item of the air tag information corresponding to the second identification image is set in the processing identification information item of the third command, and the condition item of the third command is set for each condition. By setting the accepted set value and setting the data identification information set in the item to be processed of the air tag information corresponding to the first identification image in the data specific item of the third command, the third command Is generated.

  In step S227, the third command generated in step S226 is identified by the device identification information set in the device identification information item of the air tag information corresponding to the second identification image dragged in step S221. The data is transmitted to the controller device via the wireless LAN I / F 208, and the process proceeds to step S228.

  In step S228, it is determined whether an end instruction has been accepted. If an operation for instructing an end key provided in the operation unit 207 is accepted, it is determined that an end instruction has been accepted. If an end instruction is accepted, the process ends. If not, the process returns to step S214.

  FIG. 18 is a diagram illustrating an example of a remote operation screen displayed on the portable information device. A remote operation screen 601 indicates a screen displayed on the display unit 206 when the camera 202 images the MFP 100 and the electronic paper device 400 as subjects. Referring to FIG. 18, remote operation screen 601 includes a region 603 for displaying a subject image obtained by imaging a subject. Area 603 includes portable information device 200 and MFP 100 as subjects.

  Further, remote operation screen 601 includes an area 605 for displaying information related to electronic paper device 400 above area 601, and an area 607 for displaying information related to MFP 100 below area 601.

  The area 605 includes a first identification image 611 and four second identification images 613. The first identification image 611 is a thumbnail obtained by reducing the image of the data displayed on the display unit 405 when the electronic paper device 400 performs display processing. The four second identification images 613 include process identification information “image display”, “data storage”, “data transmission”, and “data reception” of four processes corresponding to the four processes that can be executed by the electronic paper device 400, respectively. Each.

  Region 607 includes five second identification images. The five second identification images include process identification information “image display”, “image formation”, “data transmission”, “data reception”, and “data” corresponding to each of the five processes that can be executed by the MFP 100. Including "memory".

  When the user drags the first identification image 611 in the area 605 with a finger for a predetermined time and moves the finger, the processing identification information of the “image formation” in the area 607 is moved to the first identification image 611. A case will be described in which an operation of dropping is performed by moving the finger until it overlaps the second identification image on which is displayed and releasing the finger from the display unit 206. The portable information device 200 generates a remote operation command for causing the MFP 100 to form an image for the MFP 100, and generates the remote operation command generated for the MFP 100 and the image data displayed on the electronic paper device 400. A second command to be transmitted to the MFP 100 is generated for the electronic paper device 400, and the second command generated for the electronic paper device 400 is transmitted to the electronic paper device 400. Accordingly, the electronic paper device 400 executes remote operation processing according to the second command received from the portable information device 200, and the portable information device 200 includes the remote operation command included in the second command and the electronic paper device 400. Is transmitted to the MFP 100. The MFP 100 executes image forming processing according to a remote operation command received from the electronic paper device 400, and forms an image of data received from the electronic paper device 400 on a sheet.

  As described above, when the device that stores data and the device that outputs data are used as subjects, and the image is captured by the camera 202, the first identification image corresponding to the data and the second identification information corresponding to the output processing are obtained. Since it is displayed on the display unit 206, an operation for searching for data to be processed and an operation for specifying an output device and a process are facilitated.

  In addition, by dragging and dropping the first identification information and associating it with the second identification information, “processing corresponding to the second identification information can be performed on the data corresponding to the first identification information with a simple operation. Therefore, data can be output with a simple operation.

  In this embodiment, the case where the data displayed on electronic paper apparatus 400 is image-formed by MFP 100 has been described as an example. However, when the number of subjects is one, only the subject device is used. Can be operated remotely.

  Further, the data to be processed is not limited to data stored in the device that is the subject, and may be data stored in the portable information device 200. Specifically, data stored in the portable information device 200 may be processed by any one of the electronic paper device 400 and the MFPs 100, 101, and 101 that are information processing devices. For example, when the MFP 100 is photographed with the camera 202 as a subject, process identification information “image display”, “image formation”, “data transmission”, “data reception” of five processes corresponding to the five processes that can be executed by the MFP 100, respectively. "And" Data storage "are displayed as the second identification image. In this state, if the icon of the data stored in the portable information device 200 is displayed, and the icon is dragged and dropped on the five second identification images, the data stored in the portable information device 200 is displayed. Can be processed by the MFP 100.

  As described above, in the remote control system 1 according to the present embodiment, when the portable information device 200 captures an image of a subject, the image of the subject is displayed on the display unit 206 and an orientation indicating the direction in which the subject is imaged is detected. The position of the device itself is detected, and the air tag information transmitted from the MFPs 100, 101, 102 and the electronic paper device 400, which are information processing devices, to the server 300 is acquired from the server 300. The portable information device 200 identifies the information processing device as the subject based on the air tag information acquired from the server 300, the detected position of the device itself, and the detected orientation, and the identified information The information processing apparatus is remotely operated based on the processing information included in the air tag information corresponding to the processing apparatus. For example, when the electronic paper device 400 is specified as a subject, the electronic paper device 400 is remotely operated based on processing information included in air tag information transmitted from the electronic paper device 400 to the server 300. For this reason, since the target of remote operation is specified by imaging the electronic paper device 400, the operation of specifying the device that is the target of remote operation can be facilitated.

  Further, when the portable information device 200 specifies the electronic paper device 400 and the MFP 100 as subjects, the portable information device 200 causes the MFP 100 to form an image of data displayed on the electronic paper device 400. For this reason, the two devices can be remotely operated simultaneously.

  Further, portable information device 200 displays a first identification image corresponding to the data displayed on electronic paper device 400 identified as the subject, and a second corresponding to the processing that can be executed by MFP 100 identified as the subject. When an operation for displaying the identification image and associating the first identification image with the second identification image is input, a process specified by the second identification image is performed on data corresponding to the first identification image. A second command to be executed by MFP 100 is transmitted to electronic paper apparatus 400. For this reason, an operation for specifying data to be processed is easy. In addition, an operation for specifying MFP 100 to execute processing and an operation for specifying processing to be executed by MFP 100 are easy. Further, the two devices can be remotely operated by a simple operation that associates the first identification image and the second identification image displayed on one screen.

  Further, when an operation for associating the first identification image with the second identification image is input, MFP 100 is caused to execute a process specified by the second identification image with respect to data corresponding to the first identification image. The third command is transmitted to MFP 100. For this reason, an operation for specifying data to be processed is easy. In addition, an operation for specifying MFP 100 to execute processing and an operation for specifying processing to be executed by MFP 100 are easy. Further, the two devices can be remotely operated by a simple operation that associates the first identification image and the second identification image displayed on one screen.

  In the above-described embodiment, the remote control system 1 has been described. However, the portable information device 200 performs a remote control method for causing the portable information device 200 to execute the remote control processing shown in FIG. It goes without saying that the invention can be specified as a remote control program to be executed by the CPU 201 provided.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 remote control system, 2 network, 100, 101, 102 MFP, 200 portable information device, 300 server, 400 electronic paper device, 500 wireless station, 51 command reception unit, 53 processing execution unit, 55 air tag transmission unit, 57 position setting Unit, 61 display control unit, 63 image formation control unit, 65 transmission / reception control unit, 67 data storage unit, 69 command transmission unit, 110 main circuit, 111 CPU, 112 communication I / F unit, 113 ROM, 114 RAM, 115 HDD , 116 facsimile unit, 117 external storage device, 118 CD-ROM, 120 automatic document feeder, 130 document reading unit, 140 image forming unit, 150 paper feeding unit, 155 post-processing unit, 160 operation panel, 161 display unit, 163 Operation unit, 201 CPU, 202 camera, 203 flash Mori, 204 Wireless communication unit, 205 Call unit, 206 Display unit, 207 Operation unit, 208 Wireless LAN I / F, 209 Position detection unit, 210 Direction detection unit, 211 External storage device, 251 Imaging control unit, 253 Display control unit, 255 Mobile position detection control unit, 257 Direction detection control unit, 261 Air tag request unit, 263 Air tag reception unit, 265 Subject identification unit, 267 Remote operation unit, 271 Data identification unit, 273 Process identification unit, 275 Identification information display unit, 277 Command transmission unit, 301 CPU, 302 ROM, 303 RAM, 304 HDD, 305 communication unit, 306 display unit, 307 operation unit, 351 air tag information reception unit, 353 air tag information registration unit, 355 transmission request reception unit, 357 extraction unit 359 Air tag information reply unit, 401 CPU, 403 hula Memory, 405 display unit, 407 operation unit, 409 wireless LAN I / F, 411 position detection unit, 413 external storage device, 451 command reception unit, 453 processing execution unit, 455 air tag transmission unit, 457 device side position detection control unit, 461 2nd display control part, 463 2nd transmission / reception control part, 465 2nd data storage part, 467 2nd command transmission part.

Claims (8)

A remote control system comprising a server, a plurality of information processing devices, and a portable information device,
Each of the plurality of information processing apparatuses includes a process execution unit that executes a process;
Device-side position detecting means for detecting the position of the device itself;
Air tag transmission means for transmitting air tag information including apparatus identification information for identifying the own apparatus, the detected position information, and processing information relating to processing executable by the processing execution means to the server, ,
The plurality of information processing apparatuses include a first information processing apparatus that executes a process of displaying data, and a second information processing apparatus that can execute a process of outputting data,
The portable information device includes an imaging unit for imaging a subject;
An azimuth detecting means for detecting an azimuth indicating a direction in which the imaging means images the subject;
Display means for displaying an image of the subject imaged by the imaging means;
Mobile-side position detecting means for detecting the position of the own device;
Air tag information acquisition means for acquiring air tag information transmitted from the information processing apparatus to the server;
Based on the acquired air tag information, the position detected by the portable side position detecting means, and the orientation detected by the orientation detecting means, the information processing apparatus is specified as a subject to be imaged by the imaging means. Subject identification means;
Remote operation means for remotely operating the information processing device based on the processing information included in the air tag information corresponding to the specified information processing device ,
When the first information processing apparatus and the second information processing apparatus are specified by the subject specifying means, the remote operation means transmits data displayed on the first information processing apparatus to the second information processing apparatus. Remote control system for output . The remote control means includes data specifying means for specifying data displayed on the first information processing apparatus based on processing information included in first air tag information corresponding to the first information processing apparatus;
Processing specifying means for specifying a process executable by the second information processing device based on processing information included in second air tag information corresponding to the second information processing device;
Identification image display means for displaying a first identification image corresponding to the data specified by the data specifying means and a second identification image corresponding to the process specified by the process specifying means;
When an operation for associating the first identification image with the second identification image is input, a process specified by the second identification image with respect to data corresponding to the first identification image is performed. a command to be executed by the second information processing apparatus, including, a benzalkonium command transmitting means to transmit either one of said first information processing apparatus and the second information processing apparatus, a remote according to claim 1 Control system. The remote operation means includes processing information display means for displaying an identification image corresponding to the processing information;
Command transmitting means for transmitting a command for causing the information processing apparatus to execute processing based on processing information corresponding to the identification image when the displayed identification image is instructed by a user. Item 2. The remote control system according to Item 1. A portable information device capable of communicating with a server,
The server stores device identification information for identifying an object, absolute position of the object, and air tag information including processing information related to the object,
There are a plurality of the objects, and the plurality of objects includes a first information processing apparatus that executes a process of displaying data, and a second information processing apparatus that can execute a process of outputting data,
Imaging means for imaging a subject;
An azimuth detecting means for detecting an azimuth indicating a direction in which the imaging means images the subject;
Display means for displaying an image of the subject imaged by the imaging means;
Mobile-side position detecting means for detecting the position of the own device;
Air tag information acquisition means for acquiring the air tag information from the server;
Subject identification that identifies the object as a subject to be imaged by the imaging means based on the acquired air tag information, the position detected by the portable side position detection means, and the orientation detected by the orientation detection means Means,
Remote operation means for remotely operating the object based on the processing information included in the air tag information corresponding to the identified object ,
The remote operation means outputs the data displayed on the first information processing apparatus to the second information processing apparatus when the first and second information processing apparatuses are specified by the subject specifying means. A portable information device. The remote control means includes data specifying means for specifying data displayed on the first information processing apparatus based on processing information included in first air tag information corresponding to the first information processing apparatus;
Processing specifying means for specifying a process executable by the second information processing device based on processing information included in second air tag information corresponding to the second information processing device;
Identification image display means for displaying a first identification image corresponding to the data specified by the data specifying means and a second identification image corresponding to the process specified by the process specifying means;
When an operation for associating the first identification image with the second identification image is input, a process specified by the second identification image with respect to data corresponding to the first identification image is performed. a command to be executed by the second information processing apparatus, including, a benzalkonium command transmitting means to transmit either one of said first information processing apparatus and the second information processing apparatus, portable according to claim 4 Information device. The remote operation means includes identification image display means for displaying an identification image corresponding to the processing information,
If the displayed identification image is instructed by the user, based on the processing information corresponding to the identification image includes a command transmitting means for transmitting a command for executing a process on the object, Claim 4 The portable information device described in 1. A remote control method executed by a portable information device capable of communicating with a server,
The server stores device identification information for identifying an object, absolute position of the object, and air tag information including processing information related to the object,
There are a plurality of the objects, and the plurality of objects includes a first information processing apparatus that executes a process of displaying data, and a second information processing apparatus that can execute a process of outputting data,
An imaging step for imaging a subject;
An azimuth detection step for detecting an azimuth indicating a direction in which the subject is imaged in the imaging step;
A display step for displaying an image of the subject imaged in the imaging step;
A portable side position detecting step for detecting the position of the own device;
An air tag information acquisition step of acquiring the air tag information from the server;
A subject that identifies the object as the subject imaged in the imaging step based on the acquired air tag information, the position detected in the portable side position detection step, and the orientation detected in the orientation detection step Specific steps,
See containing and a remote control step of remotely controlling the object based on the processing information included in Eatagu information corresponding to the identified object,
In the remote operation step, when the first and second information processing devices are specified in the subject specifying step, the data displayed on the first information processing device is output to the second information processing device. Remote control method to let you . A remote control program executed by a computer that controls a portable information device capable of communicating with a server,
The server stores device identification information for identifying an object, absolute position of the object, and air tag information including processing information related to the object,
There are a plurality of the objects, and the plurality of objects includes a first information processing apparatus that executes a process of displaying data, and a second information processing apparatus that can execute a process of outputting data,
An imaging step for imaging a subject;
An azimuth detection step for detecting an azimuth indicating a direction in which the subject is imaged in the imaging step;
A display step for displaying an image of the subject imaged in the imaging step;
A portable side position detecting step for detecting the position of the own device;
An air tag information acquisition step of acquiring the air tag information from the server;
A subject that identifies the object as the subject imaged in the imaging step based on the acquired air tag information, the position detected in the portable side position detection step, and the orientation detected in the orientation detection step Specific steps,
A remote control step of remotely operating the object based on the processing information included in the air tag information corresponding to the identified object ;
In the remote operation step, when the first and second information processing devices are specified in the subject specifying step, the data displayed on the first information processing device is output to the second information processing device. remote control program that Ru is.

Images