JP6561495B2 - Image processing apparatus, remote control system, remote control method, and remote control program - Google Patents

Description

The present invention relates to an image processing device, a remote control system, a remote control method, and a remote control program, and in particular, an image processing device remotely controlled by a remote operation device, a remote control system including the remote operation device and the image processing device, The present invention relates to a remote control method and a remote control program executed by the remote control control device.

  In recent years, a technique for remotely controlling a multifunction peripheral (hereinafter referred to as “MFP”) with a portable information device such as a smartphone or a tablet terminal is known. An operation screen for operating the MFP can be displayed on the portable information device, and the MFP can be remotely controlled by the portable information device. For example, in JP 2012-93940 A, the operated terminal receives from the mobile terminal a display screen control unit that creates a mobile terminal screen in which the operated terminal screen is modified based on the display attribute information of the mobile terminal. The mobile terminal includes an encoding unit that encodes the mobile terminal screen using the encoding method and an operation processing unit that executes an operation specified by position information received from the mobile terminal. When a decoding unit that decodes the terminal screen and outputs it to the touch screen and a touch operation on the touch screen displaying the mobile terminal screen is detected, position information indicating the touch position on the mobile terminal screen is displayed as its own display attribute information. And a position information correction unit for correcting the position information on the operated terminal screen based on the display attribute information of the operated terminal received from the operated terminal. There has been described.

  In the portable information device, an application program for remote control can be executed and image data stored in the MFP to be remotely controlled can be browsed. However, this browsing screen is generated in the MFP, and the image data is not captured in the portable information device.

  On the other hand, in some cases, an application program for editing image data may be installed in the portable information device separately from an application program for remotely controlling the MFP. In this case, it is desired that the image data stored in the MFP is captured in the portable information device, the application program for editing the image data is executed on the portable information device, and the image data captured from the MFP 100 is edited.

However, in the remote operation system described in Japanese Patent Application Laid-Open No. 2012-93940, the portable information device only displays the portable terminal screen and returns position information indicating the touch position on the portable terminal screen. The task of executing the application program to recognize the position where the image data is stored even if the mobile terminal screen including the image of the image data stored in the remotely controlled MFP can be displayed I can't. For this reason, it is impossible to notify the task that executes the application program for editing the image data of the position where the image data is stored. As described above, in the portable information device, there is a problem that it is difficult to link a task for executing an application program for editing image data and a task for executing an application program for remotely controlling the MFP.
JP 2012-93940 A

  The present invention has been made to solve the above-described problems, and one object of the present invention is to provide an image processing apparatus capable of linking two application programs executed on a remote operation device. That is.

  Another object of the present invention is to provide a remote control method capable of linking two application programs executed by a remote operation device.

  Another object of the present invention is to provide a remote control program capable of linking two application programs executed by a remote operation device.

In order to achieve the above-described object, according to one aspect of the present invention, an image processing apparatus is an image processing apparatus that can be remotely controlled by a remote control device, and includes a plurality of images included in a single image data. A data identification image generated based on one page selected from among the pages, a start instruction image for accepting an operation in which a user operating the remote control device instructs the remote control device to start the application program, and The operation screen generating means for generating the operation screen including the operation screen transmitting means for transmitting the generated operation screen to the remote operation device, and the position information indicating the position in the transmitted operation screen is received from the remote operation device. Accordingly, an operation determining means for determining an operation by a user who operates the remote operation device based on a position in the operation screen specified by the position information. A transmission target determining means for determining a portion of the page specified by the data identification image among the plurality of pages included in the image data to be transmitted, activation instruction operation for instructing the start instruction image by the operation determining means are determined The image data transmitting means for transmitting the transmission target to the remote control device.

According to this aspect, a data identification image, an operation screen that the user operating the remote operation device and an activation instruction image for receiving the operation of instructing the start of the application program to the remote operation device, a remote operation device When the activation instruction operation for instructing the activation instruction image is determined as an operation by the user operating the remote operation device, the portion of the page specified by the data identification image among the plurality of pages included in the image data is determined. To the remote control device. For this reason, it is possible to cause the remote operation device to process the portion of the page that is being browsed as the data identification image by the user who operates the remote operation device . As a result, it is possible to provide an image processing apparatus capable of linking two application programs executed on the remote operation device.

Preferably, the operation screen generation unit selects one of a plurality of pages included in the image data in accordance with the operation determined by the operation determination unit .

Preferably, when the data identification image is an image generated from a part of the page corresponding to the data identification image among the plurality of pages, the transmission target determining unit includes the data identification image included in the page corresponding to the data identification image. The part corresponding to is determined as a transmission target.

According to this aspect, it is possible to cause the remote operation device to process the same portion as the data identification image of the page viewed by the user operating the remote operation device as the data identification image.

Preferably, the image data transmitting means, in response to the start instruction operation is determined, the transmission target, and transmits to the remote control device.

According to this aspect, it is possible that the user of the far隔操operation apparatus for processing image data being viewed to the remote operation device.

According to another aspect of the present invention, there is provided a remote control system including the above-described image processing device and a remote operation device, wherein the operation screen generation unit is configured to issue a command associated with the activation instruction image and activate an application program In addition, the remote operation device generates an operation screen including the display control means for displaying the operation screen received from the image processing device, and the position detection means for detecting the position instructed by the user in the displayed operation screen. Position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus; and start means for starting the application program according to a command associated with the start instruction image when the detected position is in the start instruction image In response to receiving image data from the image processing device, the activated application program is executed. In that the task includes a takeover means for processing the received image data, the.

  According to this aspect, an operation screen associated with the activation instruction image and further including a command for activating the application program is transmitted to the remote operation device, and the remote operation device indicates the activation instruction at the position designated by the user in the operation screen. In the case of an image, the application program is activated in accordance with a command associated with the activation instruction image, and when image data is received, the image data is processed by a task that executes the activated application program. For this reason, an application program can be started in the remote operation device, and image data can be processed in the portable information device.

According to still another aspect of the present invention, there is provided a remote control system including the above-described image processing device and a remote operation device, wherein the operation for instructing the activation instruction image is determined by the operation determination means. And a command transmission means for transmitting a command for starting an application program to the remote operation device. The remote operation device includes a display means for displaying an operation screen received from the image processing device, and an operation screen. A position detecting means for detecting a position designated by the user, a position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus, and a command received from the image processing apparatus , Starting means for starting the application program according to the received command, and receiving image data from the image processing apparatus In response, the task of executing the application program activated, comprises a takeover means for processing the received image data, the.

  According to this aspect, a command for starting the application program is transmitted to the remote operation device in response to the determination of the start instruction operation for instructing the start instruction image as an operation by the user operating the remote operation device. For this reason, an application program can be started in the remote operation device, and image data can be processed in the portable information device.

Preferably, the remote control device further includes state determination means for determining whether or not an application program for processing image data is being executed, and the image data transmission means is determined to be being executed by the state determination means. If you, in response to the data instruction operation for instructing the data identification image image by the operation determination means has been determined, the transmission target, and transmits to the remote control device.

According to this aspect, if the remote operation device is executing an application program for processing the image data, data instruction operation for instructing the data identification image image by the user to operate the remote control device determines In response, at least a portion of the image data is transmitted to the remote control device. For this reason, when the remote operation device is executing an application program, the task for executing the application program can process the image data.

According to still another aspect of the present invention, there is provided a remote control system including the above-described image processing device and a remote operation device, wherein the remote operation device displays an operation screen received from the image processing device. A position detecting means for detecting a position designated by the user in the operation screen, a position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus, and an application program for processing the image data Detecting means for detecting whether or not the image processing is being executed, a notification means for notifying the image processing apparatus that the image processing apparatus is executing when the state detecting means detects that the execution is being performed, If the image data is received from the image processing device, the task is executed to execute the application program whose running state is detected. Comprising a takeover means, for processing the image data.

  According to this aspect, since it is notified that the application program is being executed by the remote operation device, it can be determined whether or not the application program is being executed by the remote operation device.

According to another aspect of the present invention, the image processing device is an image processing device that can be remotely controlled by a remote operation device, and is selected from a plurality of pages included in a single image data. An operation screen generating means for generating an operation screen including a data identification image generated based on one page, an operation screen transmitting means for transmitting the generated operation screen to the remote operation device, and in the transmitted operation screen An operation determining means for determining an operation by a user operating the remote operation device based on the position in the operation screen specified by the position information in response to receiving position information indicating the position of the remote operation device; a transmission target determining means for determining a portion of the page specified by the data identification image among the plurality of pages included in the image data to be transmitted, the remote operation device has to process the image data Instructions and state determining means for determining a whether a running state to execute an application program, if it is determined that the running state by the state determining means, the data identification image image by the operation determination means Image data transmission means for transmitting a transmission target to the remote operation device in response to the determination of the data instruction operation to be performed.

According to this aspect, the operation screen including the data identification image is transmitted to the remote operation device, and when the remote remote operation device is executing an application program for processing the image data, the user who operates the remote operation device depending on the data instruction operation for instructing the data identification image image is determined by the transmission portion of the page specified by the data identification image among the plurality of pages included in the image data to the remote operation device To do. For this reason, when the remote operation device is executing an application program, the task for executing the application program is caused to process a portion of the page specified by the data identification image among a plurality of pages included in the image data. be able to. As a result, it is possible to provide an image processing apparatus capable of linking two application programs executed on the remote operation device.

According to still another aspect of the present invention, there is provided a remote control system including the above-described image processing device and a remote operation device, wherein the remote operation device displays an operation screen received from the image processing device. A position detecting means for detecting a position designated by the user in the operation screen, a position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus, and an application program for processing the image data A state detection unit that detects whether or not the state is being executed, a notification unit that notifies the image processing apparatus that the state is being executed when the state detection unit detects the state being executed, and a state that is being executed Is detected, the status of executing the application program in which the running state is detected in response to the reception of the image data from the image processing apparatus. In comprises a takeover means for processing the received image data, the.

  According to this aspect, since it is notified that the application program is being executed by the remote operation device, it can be determined whether or not the application program is being executed by the remote operation device.

  Preferably, when the operation screen transmitted by the operation screen transmitting means includes a plurality of data identification images, the apparatus further includes transmission target determining means for determining image data specified by the instructed data identification image as a transmission target.

  According to this aspect, when the operation screen includes a plurality of data identification images, the image data specified by the data identification image instructed by the user operating the remote operation device is determined as a transmission target. The image data instructed by the operating user can be processed by the remote operation device.

  Preferably, a memory amount acquiring unit that acquires a memory amount that can be used by the remote control device to process the image data to be transmitted, and the determined data amount of the image data to be transmitted with respect to the memory amount If larger, it further comprises a reduction means for reducing the amount of image data to be transmitted.

  According to this aspect, image data can be transmitted with a data amount that can be processed by the remote control device.

According to still another aspect of the present invention, a remote control method is a remote control method executed by an image processing device that can be remotely controlled by a remote control device, and includes a plurality of remote control methods included in a single image data. A data identification image generated based on one page selected from among the pages, a start instruction image for accepting an operation in which a user operating the remote control device instructs the remote control device to start the application program, and An operation screen generation step for generating an operation screen including the operation screen transmission step for transmitting the generated operation screen to the remote operation device, and position information indicating the position in the transmitted operation screen is received from the remote operation device. Depending on the situation, the operation for determining the operation by the user operating the remote control device based on the position in the operation screen specified by the position information A constant step, a transmission target determining step of determining a portion of the page to be transmitted which is specified by the data identification image among the plurality of pages included in the image data, start instruction operation for instructing the start instruction image in operation determining step If determined Ru, including transmission target, and an image data transmission step of transmitting to the remote control device.

  According to this aspect, it is possible to provide a remote control method capable of linking two application programs executed by the remote operation device.

According to still another aspect of the present invention, a remote control method is a remote control method executed by an image processing apparatus that can be remotely controlled by a remote control device, and the image data of a single image data An operation screen generating step for generating an operation screen including a data identification image generated based on one page selected from a plurality of pages included in the operation, and an operation for transmitting the generated operation screen to the remote operation device The remote operation device is operated based on the position in the operation screen specified by the position information in response to receiving the screen transmission step and the position information indicating the position in the operation screen transmitted from the remote operation device. feed determines the operation determining step of determining a user interaction, the portion of the page specified by the data identification image from among the plurality of pages included in the image data to be transmitted And the target determination step, if the remote operation device to be determined and a state determining step of determining whether the running state of executing an application program for processing the image data, and executing state in the state determination step , including in response to the data instruction operation for instructing the data identification image image Te operation determination step odor is determined, the transmission target, and an image data transmission step of transmitting to the remote control device.

  According to this aspect, it is possible to provide a remote control method capable of linking two application programs executed by the remote operation device.

According to still another aspect of the present invention, the remote control program is a remote control program executed by a computer that controls an image processing device that can be remotely controlled by a remote control device, and is a single image. To receive a data identification image generated based on one page selected from a plurality of pages included in the data and a user who operates the remote operation device to instruct the remote operation device to start an application program An operation screen generation step for generating an operation screen including the start instruction image, an operation screen transmission step for transmitting the generated operation screen to the remote operation device, and position information indicating a position in the transmitted operation screen In response to reception from the operation device, the remote operation device is operated based on the position in the operation screen specified by the position information. Start instruction and the operation determining step of determining a user interaction, a transmission target determining step of determining a portion of the page to be transmitted which is specified by the data identification image among the plurality of pages included in the image data, the operation determining step of If start instruction operation for instructing the image Ru is determined, the transmission target, and executes an image data transmission step of transmitting to the remote control device, to the computer.

  According to this aspect, it is possible to provide a remote control method capable of linking two application programs executed by the remote operation device.

According to still another aspect of the present invention, the remote control program is a remote control program executed by a computer that controls an image processing device that can be remotely controlled by a remote control device, and is a single image. An operation screen generating step for generating an operation screen including a data identification image generated based on one page selected from a plurality of pages included in the data , and transmitting the generated operation screen to the remote operation device The remote operation device is operated based on the position in the operation screen specified by the position information in response to receiving the operation screen transmission step and the position information indicating the position in the transmitted operation screen from the remote operation device. an operation determination step of determining an operation by users, Department of pages specified by the data identification images among the plurality of pages included in the image data A transmission target determination step of determining a transmission target and a state determination step that the remote operation device determines whether a running state to execute an application program for processing the image data, during the execution in the state decision step If it is determined that the state, in response to the data instruction operation for instructing the data identification image image Te operation determination step odor is determined, the transmission target, and an image data transmission step of transmitting to the remote control device, To run on a computer.

  According to this aspect, it is possible to provide a remote control method capable of linking two application programs executed by the remote operation device.

It is a figure showing the whole remote control system outline in one of the embodiments of the present invention. 1 is a perspective view showing an appearance of an MFP. 2 is a block diagram illustrating an example of an outline of a hardware configuration of an MFP. FIG. It is a top view which shows an example of an operation panel. It is a block diagram which shows an example of the outline | summary of the hardware constitutions of a portable information device. 3 is a block diagram illustrating an example of functions of a CPU provided in the MFP according to the first embodiment. FIG. It is a figure which shows an example of a BOX screen. It is a figure which shows an example of a preview screen. It is a block diagram which shows an example of the outline | summary of the function of CPU with which the portable information device in 1st Embodiment is provided. It is a flowchart which shows an example of the flow of the remote control process in 1st Embodiment. It is a flowchart which shows an example of the flow of the transmission target determination process in 1st Embodiment. 6 is a flowchart illustrating an example of a flow of image data transmission processing according to the first embodiment. It is a flowchart which shows an example of the flow of the remote operation processing in 1st Embodiment. FIG. 11 is a block diagram illustrating an example of functions of a CPU provided in an MFP according to a first modification. It is a block diagram which shows an example of the outline | summary of the function of CPU with which the portable information device in a 1st modification is provided. It is a flowchart which shows an example of the flow of the transmission target determination process in a 1st modification. It is a flowchart which shows an example of the flow of the remote operation process in a 1st modification. FIG. 10 is a block diagram illustrating an example of functions of a CPU provided in an MFP according to a second embodiment. It is a block diagram which shows an example of the outline | summary of the function of CPU with which the portable information device in 2nd Embodiment is provided. It is a flowchart which shows an example of the flow of the image data transmission process in 2nd Embodiment. It is a flowchart which shows an example of the flow of the remote operation process in 2nd Embodiment. FIG. 10 is a block diagram illustrating an example of functions of a CPU provided in an MFP according to a third embodiment. It is a block diagram which shows an example of the function of CPU with which the portable information device in 3rd Embodiment is provided. It is a flowchart which shows an example of the flow of the remote control processing in 3rd Embodiment. It is a flowchart which shows an example of the flow of the image data transmission process in 3rd Embodiment. It is a flowchart which shows an example of the flow of the remote operation processing in 3rd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an overall outline of a remote control system according to one embodiment of the present invention. Referring to FIG. 1, remote control system 1 includes multifunction peripherals (hereinafter referred to as “MFP”) 100, 100A, 100B functioning as remote control devices, personal computer (hereinafter referred to as “PC”) 300, wireless communication, and the like. Station 5 and portable information devices 200, 200A, 200B. MFPs (Multi Function Peripherals) 100, 100 </ b> A, 100 </ b> B, the PC 300, and the wireless station 5 are connected to the network 3. The portable information devices 200, 200 </ b> A, 200 </ b> B are connected to the network 3 through the wireless station 5.

  The network 3 is a local area network (LAN), and the connection form may be wired or wireless. The network 3 is not limited to a LAN, and may be a wide area network (WAN), a public switched telephone network (PSTN), the Internet, or the like.

  The PC 300 is a general computer. A printer driver program corresponding to the MFPs 100, 100A, and 100B is installed in the PC 300. By executing the printer driver program, the MFPs 100, 100A, and 100B are controlled to perform image forming processing on the MFPs 100, 100A, and 100B. An original reading process or the like can be executed.

  Since the hardware configurations and functions of the MFPs 100, 100A, and 100B are the same, the MFP 100 will be described as an example unless otherwise specified. MFPs 100, 100A, and 100B can perform processing in cooperation by communicating with each other, and a user can operate without being aware of whether MFPs 100, 100A, and 100B are different. For example, a job that is transmitted from the PC 300 to the MFP 100A when the user operates the PC 300 is temporarily stored in the MFP 100A. Thereafter, when the user operates MFP 100, MFP 100 inquires of MFPs 100A and 100B whether there is a job of the user who has logged in MFP 100, acquires job identification information of the job transmitted from PC 300 to MFP 100A from MFP 100A, and Notify the user of the job identification information of the job. When the user selects the job identification information and instructs printing, MFP 100 acquires the job from MFP 100A and prints it.

  The portable information devices 200, 200A, and 200B are computers that are carried and used by the user, such as smartphones and PDAs (Personal Digital Assistants). Since the portable information devices 200, 200A, and 200B have the same hardware configuration and functions, the portable information device 200 will be described as an example unless otherwise specified. Here, the portable information device 200 is a smartphone, and has a wireless LAN function and a call function. For this reason, the portable information device 200 is connected to the cellular phone network by wirelessly communicating with the cellular phone base station, and can make a call.

  In remote control system 1 according to the present embodiment, portable information devices 200, 200A, and 200B remotely control MFPs 100, 100A, and 100B, respectively. In this case, each of portable information devices 200, 200A, and 200B functions as a remote control device that remotely controls MFPs 100, 100A, and 100B, and each of MFPs 100, 100A, and 100B is remotely controlled by any one of portable information devices 200, 200A, and 200B. Functions as a remote control device to be controlled. Portable information devices 200, 200A, and 200B are installed with a remote operation program for remotely controlling MFPs 100, 100A, and 100B. The remote operation program is an application program that is common to MFPs 100, 100A, and 100B, and is compatible with any of MFPs 100, 100A, and 100B. On the other hand, each of MFPs 100, 100A, and 100B is remotely controlled by one of portable information devices 200, 200A, and 200B, and a remote control program for executing processing is installed. Here, a case where portable information device 200 remotely controls MFP 100 will be described as an example.

  In the present embodiment, a case where a remote operation program for remotely controlling MFPs 100, 100A, and 100B is installed in portable information device 200 will be described as an example, but for remotely controlling MFPs 100, 100A, and 100B. The remote operation program may be installed in the PC 300. In this case, the user can remotely control any of MFPs 100, 100 A, and 100 B using PC 300 in the same manner as when remotely controlling any of MFPs 100, 100 A, and 100 B using portable information device 200. Is possible.

  FIG. 2 is a perspective view showing the appearance of the MFP. FIG. 3 is a block diagram illustrating an example of an outline of the hardware configuration of the MFP. 2 and 3, MFP 100 includes a main circuit 110, a document reading unit 130 for reading a document, an automatic document transport device 120 for transporting a document to document reading unit 130, and a document reading unit. An image is formed by an image forming unit 140 for forming an image on a sheet or the like based on image data output by the manuscript 130 reading and outputting a document, a paper feeding unit 150 for supplying the image to the image forming unit 140, and an image. A post-processing unit 155 that processes paper and an operation panel 160 as a user interface are included.

  The post-processing unit 155 executes a sorting process for sorting and discharging one or more sheets on which images are formed by the image forming unit 140, a punching process for punch hole processing, and a staple process for driving staple needles.

  The main circuit 110 includes a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a mass storage device, a facsimile unit 116, and a CD-ROM 118. External storage device 117. CPU 111 is connected to automatic document feeder 120, document reading unit 130, image forming unit 140, paper feeding unit 150, post-processing unit 155, and operation panel 160, and controls the entire MFP 100.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 includes an operation screen storage area. The operation screen storage area is an area for storing an operation screen displayed on the display unit 161. The RAM 114 temporarily stores read data (image data) continuously sent from the document reading unit 130.

  Communication I / F unit 112 is an interface for connecting MFP 100 to network 3. The CPU 111 communicates with the PC 300 or the portable information devices 200, 200A, and 200B via the communication I / F unit 112 to transmit and receive data. The communication I / F unit 112 can communicate with a computer connected to the Internet via the network 3.

  The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to the PSTN or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or outputs it to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 116 on a sheet. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN.

  The external storage device 117 is loaded with a CD-ROM (Compact Disk ROM) 118. The CPU 111 can access the CD-ROM 118 via the external storage device 117. The CPU 111 loads the program recorded on the CD-ROM 118 attached to the external storage device 117 to the RAM 114 and executes it. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, but an optical disc (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, It may be a semiconductor memory such as a mask ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM).

  Further, the program executed by the CPU 111 is not limited to the program recorded on the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network 3 may rewrite the program stored in the HDD 115 of the MFP 100 or may add a new program and write it. Further, MFP 100 may download a program from another computer connected to network 3 and store the program in HDD 115. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  Operation panel 160 is provided on the upper surface of MFP 100. FIG. 4 is a plan view showing an example of the operation panel. Note that the dotted line in FIG. 4 is added to indicate an area in the operation panel 160 where the hard key unit 167 is arranged, and does not actually exist. Referring to FIGS. 3 and 4, operation panel 160 includes a display unit 161 and an operation unit 163. The display unit 161 is, for example, a liquid crystal display device (LCD), and displays an instruction menu for a user, information about acquired image data, and the like.

  The operation unit 163 includes a touch panel 165 and a hard key unit 167. The touch panel 165 is provided to overlap the display unit 161 on the upper surface or the lower surface of the display unit 161. Hard key portion 167 includes a plurality of hard keys. The hard key is, for example, a contact switch. The touch panel 165 detects a position designated by the user on the display surface of the display unit 161. When the user operates the MFP 100, the user often takes an upright posture, and thus the display surface of the display unit 161, the operation surface of the touch panel 165, and the hard key unit 167 are arranged facing upward. This is because the user can easily visually recognize the display surface of the display unit 161 and the user can easily instruct the operation unit 163 with a finger.

  FIG. 5 is a block diagram illustrating an example of an outline of a hardware configuration of the portable information device. Referring to FIG. 5, portable information device 200 in the present embodiment includes a CPU 201 for controlling the entire portable information device 200, a camera 202, a flash memory 203 for storing data in a nonvolatile manner, and a calling unit. 205 includes a wireless communication unit 204 connected to 205, a display unit 206 that displays information, an operation unit 207 that receives user operations, a wireless LAN I / F 208, an acceleration sensor 210, and an external storage device 211.

  The display unit 206 is a display device such as a liquid crystal display (LCD) or an organic ELD, and displays an instruction menu for a user, information about acquired image data, and the like. The operation unit 207 includes a main key 207A and a touch panel 207B. When the user instructs the display surface of the display unit 206, the operation unit 207 outputs the position of the display surface detected by the touch panel 207B to the CPU 201. Based on the position detected by the touch panel 207B, the CPU 201 detects a position designated by the user in the screen displayed on the display unit 206. Based on the screen displayed on the display unit 206 and the position detected by the touch panel 207 </ b> B, the CPU 201 accepts input of various instructions, data such as characters and numbers by user operations. For example, when a screen including a numeric keypad image is displayed on the display unit 206, a number corresponding to the key displayed at the position detected by the touch panel 207B is received.

  The camera 202 includes a lens and a photoelectric conversion element. The light focused by the lens is imaged on the photoelectric conversion element. The photoelectric conversion element photoelectrically converts the received light and outputs image data to the CPU 201. The photoelectric conversion element is a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge Coupled Device) sensor, or the like.

  The wireless communication unit 204 performs wireless communication with a mobile phone base station connected to a telephone communication network. The wireless communication unit 204 connects the portable information device 200 to a telephone communication network and enables a call using the call unit 205. The radio communication unit 204 decodes a voice signal obtained by demodulating the radio signal received from the mobile phone base station and outputs the decoded signal to the call unit 205. Further, the wireless communication unit 204 encodes the voice input from the call unit 205 and transmits it to the mobile phone base station. The call unit 205 includes a microphone and a speaker, and outputs sound input from the wireless communication unit 204 from the speaker, and outputs sound input from the microphone to the wireless communication unit 204. Further, the wireless communication unit 204 is controlled by the CPU 201, connects the portable information device 200 to an electronic mail server, and transmits and receives electronic mail.

  The wireless LAN I / F 208 is an interface for communicating with the wireless station 5 and connecting the portable information device 200 to the network 3. By registering the IP (Internet Protocol) addresses of PC 300 and MFPs 100, 100A, and 100B in portable information device 200, portable information device 200 can communicate with PC 300 and MFPs 100, 100A, and 100B, and data Can be sent and received. In the present embodiment, a case where portable information device 200 communicates with PC 300, MFPs 100, 100A, and 100B using wireless LAN I / F 208 will be described as an example. However, other communication methods may be used for communication. It may be. Specifically, when portable information device 200, PC 300, and MFPs 100, 100A, and 100B are mounted with short-range wireless devices such as Bluetooth (registered trademark), portable information device 200 is connected to PC 300, MFPs 100, 100A, and 100A. You may make it communicate one-to-one with either of 100B.

  The flash memory 203 stores a program executed by the CPU 201 or data necessary for executing the program. The CPU 201 loads the program recorded in the flash memory 203 to the RAM included in the CPU 201 and executes it.

  The acceleration sensor 210 is a three-axis acceleration sensor that measures acceleration in three directions of the X axis, the Y axis, and the Z axis that are orthogonal to each other. The acceleration sensor 210 outputs the detected acceleration to the CPU 201.

  The external storage device 211 is detachable from the portable information device 200, and a CD-ROM 211A storing a remote operation program can be attached thereto. The CPU 201 can access the CD-ROM 211A via the external storage device 211. The CPU 201 can load a remote operation program recorded on the CD-ROM 211A attached to the external storage device 211 into a RAM included in the CPU 201 and execute it.

  The program recorded in the flash memory 203 or the CD-ROM 210A has been described as a program executed by the CPU 201. However, a program in which another computer connected to the network 3 rewrites the program stored in the flash memory 203, Alternatively, it may be a new program written additionally. Further, the portable information device 200 may be a program downloaded from another computer connected to the network 3. The program here includes not only a program directly executable by the CPU 201 but also a source program, a compressed program, an encrypted program, and the like.

  The medium for storing the program executed by the CPU 201 is not limited to the CD-ROM 211A, and may be a semiconductor memory such as an optical disk (MO / MD / DVD), IC card, optical card, mask ROM, EPROM, or EEPROM. Good.

  When MFP 100 in the present embodiment controls communication I / F unit 112 to receive a connection request from any of portable information devices 200, 200A, and 200B, a communication path with the device that has transmitted the connection request , And communicate with a device that has established a communication path for remote control. Hereinafter, a case where a communication path is established with the portable information device 200 and is remotely controlled by the portable information device 200 will be described as an example. In this case, portable information device 200 is a remote operation device that remotely controls MFP 100.

  FIG. 6 is a block diagram illustrating an example of functions of the CPU provided in the MFP according to the first embodiment. The functions shown in FIG. 6 are functions formed in CPU 111 when CPU 111 provided in MFP 100 executes a remote control program stored in ROM 113, HDD 115, and CD-ROM 118. Referring to FIG. 6, CPU 111 provided in MFP 100 receives position information from operation screen generation unit 51 that generates an operation screen, operation screen transmission unit 53 that transmits the operation screen to portable information device 200, and portable information device 200. Position information receiving unit 55 for receiving, operation determining unit 57 for determining an operation by a user operating portable information device 200, timing determining unit 59, and transmission target determining unit for determining image data to be transmitted to portable information device 200 63, a reduction unit 65 that reduces the amount of data to be transmitted, a size acquisition unit 67, a transmission availability determination unit 71, a URL generation unit 69, and an image data transmission unit 75 that transmits image data to the portable information device 200 ,including.

  The case where the CPU 111 executes the remote control program will be described as an example. However, instead of the CPU 111, the operation screen generation unit 51, the operation screen transmission unit 53, and the position formed by the CPU 111 executing the remote control program, Information receiving unit 55, operation determining unit 57, timing determining unit 59, transmission target determining unit 63, reduction unit 65, size acquisition unit 67, URL generation unit 69, transmission availability determination unit 71, image You may make it comprise with the circuit which implement | achieves the function similar to the data transmission part 75. FIG. As the circuit in this case, for example, a relay circuit can be used.

  The operation screen generation unit 51 generates an operation screen to be displayed on the portable information device 200 that is a remote operation device. When the operation screen generation unit 51 generates the operation screen, the operation screen generation unit 51 outputs the generated operation screen to the operation screen transmission unit 53, the operation determination unit 57, the transmission target determination unit 63, and the timing determination unit 59. The operation screen generation unit 51 generates an operation screen including an activation instruction image and a command associated with the activation instruction image. The activation instruction image is an image indicating an area instructing portable information device 200 to activate the application program. The command includes a position on the operation screen of the start instruction image and a command for starting the application program.

  There are a plurality of types of operation screens generated by the operation screen generation unit 51. Here, a case where the operation screen generation unit 51 generates a BOX screen or a preview screen will be described as an example. The BOX screen or preview screen is at least one data identification image of image data stored in the HDD 115, image data stored in another MFP 100A, 100B, or image data stored in a computer connected to the LAN 3 or the Internet. Is a screen for displaying.

  The BOX screen is a screen from which one or more image data can be selected. The BOX screen includes one or more data identification images for identifying each of the one or more image data. The data identification image is an image of at least a part of the image data, an image of data identification information for identifying the image data, or an image obtained by combining them. The data identification information is, for example, a file name. At least a part of the image data included in the BOX screen is an image obtained by reducing the entire image of the first page or an image obtained by enlarging or reducing a part when the image data is composed of a plurality of pages. When the image data is stored in the HDD 115, the operation screen generation unit 51 reads out the image data from the HDD 115 to generate at least a part of the image data, and the image data is stored in the HDD 115. If not, the image data is acquired from the device that stores the image data, and at least a part of the acquired image data is generated.

  The preview screen includes a data identification image for identifying one image data. While the BOX screen includes one or more data identification images, the preview screen is different from the BOX screen in that there is one data identification image. In addition, when the image data includes a plurality of pages, at least a part of the image data included in the preview screen is an image of the first page in that it is all or a part of one of the plurality of pages. It is different from the BOX screen that is a reduced image.

  Further, the image data identified by the data identification image included in the preview screen is similar to the BOX screen, the image data stored in the HDD 115, the image data stored in the other MFPs 100A and 100B, or the LAN 3 or the Internet. In addition to the image data stored in the connected computer, the document reading unit 130 includes image data that is read and output.

  The operation screen generating unit 51 generates a preview screen when the operation determining unit 57 determines an operation for instructing display of the preview screen. When generating the preview screen, the operation screen generating unit 51 generates a preview screen having a button for accepting an operation for selecting a page by the user or an operation for switching pages. The operation screen generation unit 51 generates a pre-new screen, and when an operation instructing a button included in the preview screen is determined by an operation determination unit 57 described later, the operation screen generation unit 51 displays the page from a plurality of pages according to the operation by the user. A target page is specified, and a preview screen including an image obtained by enlarging or reducing all or at least a part of the specified page as a data identification image is generated.

  FIG. 7 is a diagram illustrating an example of a BOX screen. Referring to FIG. 7, BOX screen 300 includes an area 303 for displaying a folder position, an area 305 for displaying a data identification image, and an activation instruction image 321. The activation instruction image 321 includes a character string “application”. In the area 303, a directory indicating the position of one folder among a plurality of storage areas of the HDD 115 is displayed. The area 305 includes five data identification images 311 to 315. The data identification images 311 to 315 are data identification images respectively corresponding to five image data stored in the folder specified by the directory displayed in the area 303. The data identification images 311 to 315 include images obtained by reducing the image data image. The data identification images 311 to 315 may be a combination of an image obtained by reducing the image data image and a character string image having the file name of the image data, or only a character string image having the file name of the image data. Also good.

  FIG. 8 is a diagram illustrating an example of a preview screen. Referring to FIG. 8, preview screen 400 includes an area 401 for displaying a data identification image, a start instruction image 321, an enlarge button 421, and a reduce button 423. The activation instruction image 321 includes a character string “application”. The area 401 includes a data identification image 411, a page return button 403, and a page feed button 405. The data identification image 411 is an image of at least a part of a page designated by the user from among a plurality of pages of image data designated by the user. When the button 403 is instructed, the page immediately before the page corresponding to the data identification image 411 is selected, and the data identification image 411 is changed to the image of the newly selected page. When the button 405 is instructed, a page immediately after the page corresponding to the data identification image 411 is selected, and the data identification image 411 is changed to an image of the newly selected page.

  When the enlarge button 421 is designated, the data identification image 411 is changed to an image obtained by enlarging a part of the corresponding page. When the reduction button 423 is instructed, the data identification image 411 is changed to an image obtained by reducing all or part of the corresponding page.

  Returning to FIG. 6, the operation screen transmission unit 53 transmits the operation screen input from the operation screen generation unit 51 to the portable information device 200 which is a remote operation device via the communication I / F unit 112. Although details of functions of portable information device 200 functioning as a remote operation device will be described later, when an operation screen is received from MFP 100, the operation screen is displayed on display unit 206, and if the user indicates that the operation screen is displayed, It returns position information indicating the instructed position on the screen.

  The position information receiving unit 55 receives the position information from the portable information device 200 by controlling the communication I / F unit 112 after the operation screen transmitting unit 53 transmits the operation screen to the portable information device 200. The position information receiving unit 55 outputs the received position information to the operation determining unit 57.

  The operation determining unit 57 determines the operation of the user who operates the remote operation device in response to the position information input from the position information receiving unit 55 after the operation screen is input from the operation screen generating unit 51. Specifically, the operation determination unit 57 determines the operation of the user who operates the remote operation device based on the position specified by the position information in the operation screen. The operation determination unit 57 includes a start instruction operation determination unit 81 and a data instruction operation determination unit 83.

  The start instruction operation determination unit 81 determines the start instruction operation if the position specified by the position information in the operation screen is within the start instruction image included in the operation screen. The activation instruction operation is an operation for instructing an activation instruction image included in the operation screen. For example, when the BOX screen 300 shown in FIG. 7 is transmitted to the portable information device 200, the activation instruction operation is determined when position information indicating the position in the activation instruction image 321 is received. In addition, when the preview screen 400 illustrated in FIG. 8 is transmitted to the portable information device 200, the activation instruction operation is determined when position information indicating the position in the activation instruction image 321 is received. In response to determining the activation instruction operation, activation instruction operation determination unit 81 outputs an activation instruction signal indicating that the activation instruction operation has been accepted to data instruction operation determination unit 83 and timing determination unit 59. The activation instruction signal includes screen identification information for identifying the operation screen.

  The data instruction operation determination unit 83 determines the data instruction operation if the position specified by the position information in the operation screen is within the data identification image included in the operation screen. The data instruction operation is an operation for instructing a data identification image included in the operation screen. For example, when the BOX screen 300 shown in FIG. 7 is transmitted to the portable information device 200, when the position information indicating the position in one of the data identification images 311 to 315 is received, the data instruction Determine the operation. When the preview screen 400 shown in FIG. 8 is transmitted to the portable information device 200, the data instruction operation is determined when position information indicating the position in the data identification image 411 is received. In response to determining the data instruction operation, the data instruction operation determination unit 83 outputs a data instruction signal indicating that the image data has been instructed to the timing determination unit 59. The data instruction signal includes screen identification information for identifying the operation screen and data identification information of image data corresponding to the data identification image.

  The timing determination unit 59 receives an operation screen from the operation screen generation unit 51. When the operation screen input from the operation screen generation unit 51 is a BOX screen including a plurality of data identification images, the timing determination unit 59 receives an activation instruction signal including screen identification information of the BOX screen from the activation instruction operation determination unit 81. After the input, in response to the data instruction signal including the screen identification information of the BOX screen being input from the data instruction operation determining unit 83, a transmission instruction is output to the transmission target determining unit 63 and the image data transmitting unit 75. . The transmission instruction includes data identification information included in the data instruction signal.

  In addition, when the operation screen input from the operation screen generation unit 51 is a BOX screen including a plurality of data identification images, the timing determination unit 59 receives a data instruction including the screen identification information of the BOX screen from the data instruction operation determination unit 83. After the input of the signal, in response to the input of the start instruction signal including the screen identification information of the BOX screen from the start instruction operation determining unit 81, a transmission instruction is sent to the transmission target determining unit 63 and the image data transmitting unit 75. Output. The transmission instruction includes data identification information included in the data instruction signal.

  In addition, when the operation screen input from the operation screen generation unit 51 is a preview screen including a single data identification image, the timing determination unit 59 starts from the activation instruction operation determination unit 81 including the screen identification information of the preview screen. In response to the input of the instruction signal, a transmission instruction is output to the transmission target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information of the data identification image included in the operation screen. In addition, when the operation screen input from the operation screen generation unit 51 is a BOX screen including a single data identification image, the timing determination unit 59 starts from the activation instruction operation determination unit 81 including the screen identification information of the BOX screen. In response to the input of the instruction signal, a transmission instruction is output to the transmission target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information of one data identification image included in the BOX screen.

  The transmission target determination unit 63 is a target to be transmitted to the portable information device 200 that is a remote operation device in response to an operation screen input from the operation screen generation unit 51 and a transmission instruction input from the timing determination unit 59. The target data is determined, and the target data determined as the transmission target is output to the reduction unit 65. The transmission target determining unit 63 includes a page specifying unit 85 and an overall specifying unit 87.

  The page specifying unit 85 includes a part specifying unit 89. When the operation screen input from the operation screen generation unit 51 is a preview screen including one data identification image, the page specifying unit 85 acquires and acquires image data specified by the data identification information included in the transmission instruction. Of the image data of each of one or more pages included in the image data that has been processed, the image data of the portion of the page corresponding to the data identification image included in the preview screen is determined as a transmission target. The part specifying unit 89 determines a part corresponding to the data identification image included in the preview screen among the image data of the determined part of the page as a transmission target. For example, when the data identification image included in the preview screen is an image obtained by enlarging a part of the page, partial data corresponding to the data identification image is determined as a transmission target in the image data of the page. Since the data identification image is an image obtained by enlarging or reducing a part of the page image data, the portion corresponding to the data identification image in the page image data is the portion from which the data identification image is generated. The page specifying unit 85 determines the partial data as a transmission target when the partial specifying unit 89 determines the partial data as a transmission target, and displays an image when the partial specifying unit 89 does not determine the partial data as candidate data. The image data of the page specified from the data is determined as a transmission target.

  When the operation screen input from the operation screen generating unit 51 is a BOX screen including a plurality of data identification images, the overall specifying unit 87 determines image data specified by the data identification information included in the transmission instruction as a transmission target. Then, the determined image data is determined as a transmission target.

  The size acquisition unit 67 acquires the size of image data that can be processed by the portable information device 200 that is a remote control device. For example, the portable information device 200 is inquired of the size of image data that can be processed via the communication I / F unit 112, and the size of image data that can be processed is received from the portable information device 200. The size acquisition unit 67 outputs the acquired processable image data size to the reduction unit 65.

  The reduction unit 65 receives the image data determined as the transmission target from the transmission target determination unit 63 and the size of image data that can be processed from the size acquisition unit 67. The reduction unit 65 determines whether or not to convert the image data to be transmitted by comparing the size of the image data to be transmitted with the size of the processable image data input from the size acquisition unit 67. The reduction unit 65 converts the size of the image data to be transmitted to be equal to or smaller than the size of the image data that can be processed from the size acquisition unit 67. When converting the image data input from the transmission target determination unit 63, the reduction unit 65 newly determines the converted image data as a transmission target, and outputs the transmission target image data to the transmission permission determination unit 71. . When the image data input from the transmission target determination unit 63 is not converted, the reduction unit 65 outputs the image data input from the transmission target determination unit 63 to the transmission availability determination unit 71.

  The reduction unit 65 includes a reduction unit 91 and a trimming unit 93. The reduction unit 91 reduces image data to be transmitted. The reduction unit 91 determines the reduction magnification from the size of the image data to be transmitted and the size of the processable image data input from the size acquisition unit 67.

  The trimming unit 93 trims a part of each image of one or more pages included in the image data to be transmitted. The trimming unit 93 determines the size of the portion to be trimmed from the size of the image data to be transmitted and the size of the processable image data input from the size acquisition unit 67.

  The transmission permission / inhibition determination unit 71 determines whether or not image data can be transmitted to the portable information device 200 that is a remote operation device in response to input of image data to be transmitted from the reduction unit. Specifically, the transmission permission / non-permission determining unit 71 acquires the free capacity of the RAM 114 and determines whether or not there is a memory capacity required for transmitting image data to be transmitted via the communication I / F unit 112. Judging. When determining that transmission is possible, the transmission permission / inhibition determination unit 71 outputs the data to be transmitted to the image data transmission unit 75, and when determining that transmission is not possible, the image data to be transmitted is output to the URL generation unit 69.

  The URL generation unit 69 stores the transmission target image data in the HDD 115 in response to the input of the transmission target image data from the transmission permission determination unit 71, and sets the URL of the stored transmission target image data as the image data. The data is output to the transmission unit 75. In addition, when the URL generation unit 69 receives a request including the URL of the image data to be transmitted from the portable information device 200, the URL generation unit 69 reads the image data to be transmitted specified by the URL from the HDD 115 and transmits it to the remote operation device. In this case, the URL generation unit 69 transmits the image data to be transmitted to the remote control device while the RAM 114 has free space.

  When the transmission target image data is input from the transmission permission determination unit 71, the image data transmission unit 75 controls the communication I / F unit 112 to transmit the transmission target image data to the portable information device 200 which is a remote control device. Send to. When the URL is input from the URL generation unit 69, the image data transmission unit 75 controls the communication I / F unit 112 to transmit the URL to the portable information device 200 that is a remote operation device.

  FIG. 9 is a block diagram illustrating an example of an overview of functions of a CPU provided in the portable information device according to the first embodiment. The functions shown in FIG. 9 are functions formed in the CPU 201 when the CPU 201 included in the portable information device 200 executes a remote operation program stored in the flash memory 203 or the CD-ROM 211A. Referring to FIG. 9, the CPU 201 includes an operation screen reception unit 251, a display control unit 253, a position detection unit 255, a position information transmission unit 257, an activation unit 259, an image data reception unit 261, and a takeover unit. H.263.

  Operation screen receiving unit 251 receives an operation screen from a remote control device to be remotely operated among MFPs 100, 100A, and 100B. Here, a case where MFP 100 is a remote control device will be described. Specifically, operation screen reception unit 251 controls wireless LAN I / F 208 and transmits a connection request to MFP 100 when the user operates operation unit 207 and inputs an instruction to remotely operate MFP 100. A communication path with MFP 100 is established. When wireless LAN I / F 208 receives an operation screen from MFP 100, operation screen receiving unit 251 outputs the operation screen to display control unit 253 and activation unit 259A.

  When the operation screen is input from the operation screen receiving unit 251, the display control unit 253 controls the display unit 206, displays the operation screen on the display unit 206, and outputs the operation screen to the position detection unit 255. When the position detection unit 255 controls the touch panel 207B to detect a position designated by the user in the operation screen displayed on the display unit 206, the position detection unit 255 displays position information indicating the position detected in the operation screen. The data is output to the transmission unit 257 and the activation unit 259.

  The activation unit 259 specifies the position of the activation instruction image in the operation screen input from the operation screen reception unit 251. Specifically, since the command included in the operation screen includes the position of the activation instruction image in the operation screen, the position of the activation instruction image in the operation screen is based on the position of the activation instruction image in the operation screen. To decide. Then, the activation unit 259 determines whether or not the position specified by the position information input from the position detection unit 255 is within the activation instruction image. If the position specified by the position information input from the position detection unit 255 is within the activation instruction image, the activation unit 259 activates the application program based on the command. Specifically, the operation system is requested to start an application program. When the application program is activated, the activation unit 259 outputs task identification information for identifying a task that executes the application program to the takeover unit 263.

  The command included in the operation screen may determine the application program, the remote operation program may determine the application program, or the application program may be determined by setting by the user. The application program may be a program predetermined as a program for processing image data.

  Image data receiving unit 261 controls wireless LAN I / F 208 and receives image data from MFP 100 via a communication path established with MFP 100 that is a remote control device. In response to receiving the image data, the image data receiving unit 261 outputs the received image data to the takeover unit 263.

  In response to the input of the image data from the image data receiving unit 261, the takeover unit 263 outputs the image data to the task specified by the task identification information input from the activation unit 259. As a result, the image data is input to the task for executing the application program activated by the activation unit 259, and the task processes the image data. For example, when the application program has a function of editing image data, the user can edit the image data instructed by MFP 100.

  FIG. 10 is a flowchart illustrating an example of the flow of remote control processing according to the first embodiment. The remote control process is a process executed by CPU 111 when CPU 111 provided in MFP 100 executes a remote control program stored in ROM 113, HDD 115, and CD-ROM 118. Referring to FIG. 10, CPU 111 determines whether a connection request has been received (step S01). It is determined whether communication I / F unit 112 has received a connection request from any of portable information devices 200, 200A, and 200B. The process waits until a connection request is received. If a connection request is received, the process proceeds to step S02. Here, a case where a connection request is received from portable information device 200 will be described as an example.

  In step S02, a communication path is established with portable information device 200. Then, an operation screen to be processed is determined (step S03). When the process proceeds from step S02, it is immediately after the portable information device 200 that is a remote control device is connected. In this case, the operation screen to be transmitted first is determined by default, and is determined as the operation screen.

  In the next step S04, an operation screen is transmitted. When the process proceeds from step S03, the operation screen determined in step S03 is transmitted. Specifically, the communication I / F unit 112 is controlled to transmit an operation screen to the portable information device 200 that is a remote operation device via the communication path established in step S02.

  In step S05, it is determined whether position information has been received. The communication I / F unit 112 is controlled to determine whether or not position information has been received from the portable information device 200 that is a remote operation device via the communication path established in step S02. If position information has been received, the process proceeds to step S06; otherwise, the process proceeds to step S18. In step S18, it is determined whether or not the communication path established in step S02 has been disconnected. If the communication path is disconnected, the process ends. If not, the process returns to step S05.

  In step S06, an operation is determined based on the position information. The operation is specified by the image included in the position specified by the position information in the operation screen transmitted in step S04. If the position specified by the position information on the operation screen is within the start instruction image, the start instruction operation is specified. If the position specified by the position information in the operation screen is within the data identification image, the data instruction operation is specified. In addition to the activation instruction image and the data identification image, the operation screen may include a plurality of images associated with operations different from the activation instruction operation and the data instruction operation. For example, the operation screen may include a transition image associated with a screen transition operation instructing a transition to another screen and an execution instruction image associated with an execution instruction operation instructing execution of processing. If the position specified by the position information in the operation screen is within the transition image, the screen transition operation is specified, and if within the execution instruction image, the execution instruction operation is specified.

  In the preview screen, as shown in FIG. 8, an enlarge button 421 associated with the enlarge operation, a reduce button 423 associated with the reduce operation, a page return button 403 associated with the page return operation, A page feed button 405 associated with the page feed operation. If the position specified by the position information on the operation screen is within the enlargement button 421, the enlargement instruction operation is specified. If the position is within the reduction button 423, the reduction operation is specified. If it is within the page feed button 405, the page feed operation is specified.

  In the next step S07, it is determined whether or not the specified operation is a data instruction operation. If so, the process proceeds to step S08; otherwise, the process proceeds to step S10. In step S08, the instruction flag is set to ON, and the process proceeds to step S09. The instruction flag is a flag indicating whether or not a data instruction operation is accepted, and is set to OFF until the data instruction operation is accepted after the operation screen is displayed, and is set to ON after the data instruction operation is accepted. . In step S09, image data specified by the data identification image corresponding to the data instruction operation is determined, and the process proceeds to step S12.

  In step S10, it is determined whether or not the identified operation is a start instruction operation. If so, the process proceeds to step S11; otherwise, the process proceeds to step S15. In step S11, the activation flag is set to ON, and the process proceeds to step S12. The activation flag is a flag indicating whether or not an activation instruction operation has been accepted. The activation flag is set to OFF until the activation instruction operation is accepted after the operation screen is displayed, and is set to ON after the activation instruction operation is accepted. .

  In step S12, a transmission target determination process is executed, and the process proceeds to step S13. Although details of the transmission target determination process will be described later, this is a process of determining image data to be transmitted to the portable information device 200 which is a remote operation device. In step S13, it is determined whether or not image data to be transmitted has been determined as a result of executing the transmission target determination process. If image data to be transmitted is determined, the process proceeds to step S14. If not, the process returns to step S05. In step S14, an image data transmission process is executed, and the process returns to step S03. Details of the image data transmission processing will be described later.

  The process proceeds to step S15 if the operation determined in step S06 is neither a data instruction operation nor a start instruction operation. In step S15, a process corresponding to the operation determined in step S06 is executed, and the process proceeds to step S16. When the screen transition operation is determined, the operation screen specified by the screen transition operation is determined. When the execution instruction operation is determined, the process specified by the execution instruction operation is executed, and the operation screen after the process is executed is determined. When the enlargement instruction operation is determined, an image obtained by enlarging a part of the page corresponding to the data identification image in the preview screen is generated as a new data identification image. When the reduction instruction operation is determined, an image obtained by reducing a part of the page corresponding to the data identification image in the preview screen is generated as a new data identification image. When the page return operation is determined, a new data identification image is generated based on the image data of the page preceding the page corresponding to the data identification image in the preview screen. When the page turning operation is determined, a new data identification image is generated based on the image data of the page after the page corresponding to the data identification image in the preview screen.

  In step S16, an operation screen after the process executed in step S15 is generated, and the process proceeds to step S17. If an operation screen corresponding to the screen transition operation is determined in step S15, an operation screen after the transition is generated, and if a process corresponding to the execution instruction operation is executed in step S15, the operation screen after executing the processing Is generated. When a new data identification image is generated in response to the enlargement instruction operation, the reduction instruction operation, the page return operation, or the page feed operation in step S15, an operation screen including the newly generated data identification image is generated. In step S17, the operation screen generated in step S16 is transmitted to the remote operation device, and the process returns to step S05.

  FIG. 11 is a flowchart illustrating an example of a flow of a transmission target determination process according to the first embodiment. The transmission target determination process is a process executed in step S10 of FIG. Referring to FIG. 11, in step S31, CPU 111 determines whether or not the operation screen transmitted to portable information device 200 that is a remote operation device includes a plurality of data identification images. If an operation screen including a plurality of data identification images is transmitted, the process proceeds to step S32. If not, the process proceeds to step S35. In step S32, it is determined whether or not the activation flag is set to ON. If the activation flag is set to ON, the process proceeds to step S33. If not, the process returns to the remote control process. In step S33, it is determined whether or not the instruction flag is set to ON. If the instruction flag is set to ON, the process proceeds to step S34; otherwise, the process returns to the remote control process. In step S34, image data corresponding to the data identification image specified by the data instruction operation is determined as a transmission target, and the process returns to the remote control process. The process proceeds to step S34 when the operation screen is transmitted in step S04 or step S17 of the remote control process shown in FIG. 10 and then the data instruction operation and the start instruction operation are determined in step S06. If the data instruction operation is determined in step S06, step S09 is executed. Therefore, in step S34, the image data determined in step S09 is determined as a transmission target.

  In step S35, it is determined whether or not the activation flag is set to ON. If the activation flag is set to ON, the process proceeds to step S36. If not, the process returns to the remote control process. In step S36, it is determined whether or not the operation screen transmitted to portable information device 200 that is a remote control device is a preview screen. If the preview screen is transmitted, the process proceeds to step S37; otherwise, the process proceeds to step S41. When the process proceeds to step S41, the operation screen transmitted to portable information device 200 that is a remote control device is a BOX screen, and the BOX screen includes one data identification image. In step S41, image data specified by one data identification image included in the BOX screen is determined as a transmission target, and the process returns to the remote control process.

  When the process proceeds to step S37, the operation screen transmitted to portable information device 200 that is a remote control device is a preview screen. In step S37, a page corresponding to the data identification image included in the preview screen is specified from one or more pages included in the image data specified by the data identification image included in the preview screen. When the image data has a plurality of pages, an image obtained by reducing the image of the page selected from the plurality of pages when generating the preview screen is set as the data identification image. Therefore, the page corresponding to the data identification image is a page selected from a plurality of pages when generating the preview screen. Further, when the image data has one page, an image obtained by reducing the image of one page included in the image data when generating the preview screen is set as the data identification image. Therefore, when the image data is only one page, the page corresponding to the data identification image is a page included in the image data.

  In step S38, it is determined whether or not the data identification image included in the operation screen transmitted to portable information device 200, which is a remote control device, is part of the page specified in step S37. If the data identification image is a partial image of the page, the process proceeds to step S39; otherwise, the process proceeds to step S40. The data identification image included in the preview screen may be an image obtained by enlarging a part of the page.

  In step S39, the image data of the part corresponding to the data identification image in the image data of the page specified in step S37 is determined as a transmission target, and the process returns to the remote control process. In step S40, the image data of the page specified in step S37 is determined as a transmission target, and the process returns to the remote control process.

  FIG. 12 is a flowchart illustrating an example of the flow of image data transmission processing in the first embodiment. The image data transmission process is a process executed in step S14 of FIG. In step S12 before the image data transmission process is executed, image data to be transmitted is determined.

  Referring to FIG. 12, CPU 111 acquires the size of image data that can be processed by portable information device 200 that is a remote control device from portable information device 200 (step S <b> 51). Then, the size of the image data determined as the transmission target is compared with the size of the image data that can be processed by the portable information device 200 (step S52). If the size of the image data is larger than the size of the image data that can be processed by portable information device 200, the process proceeds to step S53. If not, step S53 is skipped and the process proceeds to step S54.

  In step S53, the size of the image data determined as the transmission target is reduced. Specifically, the size of the image data is made smaller than the size of the image data that can be processed by the portable information device 200 by reducing the resolution by reducing the image data. Further, the size of the image data is made smaller than the size of the image data that can be processed by the portable information device 200 by trimming the image data. When the image data includes a plurality of pages, trimming is performed for each of the plurality of pages. The trimming range may be a predetermined range from the position specified by the data instruction operation when the data instruction operation is accepted. Further, when a data instruction operation is not accepted, a predetermined range may be set from the center of the page.

  In step S54, it is determined whether or not the image data determined as the transmission target can be transmitted. Specifically, the free space of the RAM 114 is acquired, and it is determined that the image data can be transmitted when there is a memory capacity required to transmit the data to be transmitted via the communication I / F unit 112. However, when the memory capacity is insufficient, it is determined that the image data cannot be transmitted. If it is determined that image data can be transmitted, the process proceeds to step S55; otherwise, the process proceeds to step S56. In step S55, the image data determined as the transmission target is transmitted to portable information device 200, which is a remote operation device, via communication I / F unit 112, and the process returns to the remote control process.

  In step S56, the image data determined as the transmission target is stored in HDD 115. Then, the URL of the image data stored in the HDD 115 is generated, and the process proceeds to step S58. In step S58, the generated URL is transmitted to portable information device 200, which is a remote operation device, via communication I / F unit 112, and the process returns to the remote control process.

  FIG. 13 is a flowchart illustrating an example of the flow of remote operation processing according to the first embodiment. The remote operation process is a process executed by the CPU 201 when the CPU 201 included in each of the portable information devices 200, 200A, and 200B executes a remote operation program stored in the flash memory 203 or the CD-ROM 211A. Here, a case where the portable information device 200 executes remote operation processing will be described as an example.

  Referring to FIG. 13, CPU 201 determines whether a remote operation instruction has been accepted (step S101). If the operation unit 207 receives a remote operation instruction input by the user, the remote operation instruction is received. The process waits until a remote operation instruction is accepted (NO in step S101). If a remote operation instruction is accepted (YES in step S101), the process proceeds to step S102. The remote operation instruction includes an instruction for specifying a remote control device to be remotely operated. Here, a case where MFP 100 is specified as a remote control device will be described as an example.

  In step S102, a connection request is transmitted to MFP 100, which is a remote control device. The wireless LAN I / F 208 is controlled to transmit a connection request in order to establish a communication path with the MFP 100. Then, it is determined whether or not a communication path has been established (step S103). A communication path is established by negotiating with the MFP 100. Step S102 is repeated until the communication path is established (NO in step S103). If the communication path is established (YES in step S103), the process proceeds to step S104.

  In step S104, it is determined whether an operation screen has been received. It is determined whether or not wireless LAN I / F 208 has received an operation screen from MFP 100 via the communication path established in step S103. If the operation screen is received, the process proceeds to step S105; otherwise, the process proceeds to step S117. In step S117, it is determined whether or not the communication path established in step S103 has been disconnected. If the communication path is disconnected, the process ends. If not, the process returns to step S104.

  In step S105, the received operation screen is displayed on display unit 206, and the process proceeds to step S106. In step S106, the position of the activation instruction image is specified. The position of the activation instruction image in the operation screen is specified based on the position of the activation instruction image included in the command in the operation screen.

  In the next step S107, it is determined whether or not a position designated by the user on the display surface of the display unit 206 has been detected. Based on the output of touch panel 207B, it is determined whether or not the position designated by the user on the display surface of display unit 206 has been detected. If the position designated by the user is detected, the process proceeds to step S108; otherwise, the process proceeds to step S111. In step S108, position information indicating the position on the operation screen is transmitted to MFP 100, which is a remote control device. Specifically, based on the position on the display surface detected by the touch panel 207B, the position on the operation screen displayed on the display unit 206 is specified, and the wireless LAN I / F 208 is controlled to indicate the specified position. The position information is transmitted via the communication path established in step S103.

  In the next step S109, it is determined whether or not the position detected in step S107 is within the activation instruction image on the operation screen. If the detected position is within the activation instruction image, it is determined that the activation instruction image has been instructed, and the process proceeds to step S110. If not, the process returns to step S107. In step S110, the application program is started based on the command included in the operation screen received in step S104, and the process returns to step S107. Specifically, the operation system is requested to start an application program.

  On the other hand, in step S111, as in step S104, it is determined whether an operation screen has been received. If the operation screen is received, the process proceeds to step S112; otherwise, the process proceeds to step S114. In step S112, the received operation screen is displayed on display unit 206, and the process proceeds to step S113. In step S113, as in step S106, the position of the activation instruction image is specified based on the command included in the operation screen received in step S111, and the process returns to step S107.

  In step S114, it is determined whether image data has been received. It is determined whether or not wireless LAN I / F 208 has received image data from MFP 100 via the communication path established in step S103. If image data is received, the process proceeds to step S115; otherwise, the process proceeds to step S116. In step S115, the image data is output to the task that executes the application program, and the process returns to step S107. Image data is output to the task that executes the application program started in step S110. Thereby, the task that executes the application program started in step S110 processes the image data. For example, when the application program has a function of editing image data, the user can edit the image data instructed by MFP 100.

  In step S116, as in step S117, it is determined whether or not the communication path established in step S103 has been disconnected. If the communication path is disconnected, the process ends. If not, the process returns to step S107.

<First Modification>
In the remote control system in the first modification, MFP 100 that is a remote control device determines the state of portable information device 200 that is a remote operation device. Hereinafter, differences from the remote control system 1 according to the first embodiment will be described.

  FIG. 14 is a block diagram illustrating an example of functions of the CPU provided in the MFP according to the first modification. Referring to FIG. 14, the difference from the function shown in FIG. 6 is that state determination unit 61 is added and timing determination unit 59 is changed to timing determination unit 59A. Other functions are the same as those shown in FIG.

  The state determination unit 61 determines the state of the portable information device 200 that is a remote control device. Specifically, the portable information device 200 is inquired about the state, and an execution state signal is received from the portable information device 200. The execution status signal indicates whether the portable information device 200 is executing an application program for processing image data. If the execution state signal received from the portable information device 200 indicates that the application program for processing the image data is being executed, the state determination unit 61 outputs an execution signal to the timing determination unit 59A. If the portable information device 200 does not indicate that the application program for processing the image data is being executed, no execution signal is output to the timing determination unit 59A.

  The timing determination unit 59A receives an operation screen from the operation screen generation unit 51. When the operation screen input from the operation screen generation unit 51 includes a plurality of data identification images, the timing determination unit 59A is a case of a BOX screen including a plurality of data identification images. When the execution signal is not input, after the start instruction signal including the screen identification information of the BOX screen is input from the start instruction operation determination unit 81, the screen identification information of the BOX screen is included from the data instruction operation determination unit 83. In response to the input of the data instruction signal, a transmission instruction is output to the transmission target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information included in the data instruction signal.

  In addition, the timing determination unit 59A is a data instruction when the operation screen input from the operation screen generation unit 51 includes a plurality of data identification images and no execution signal is input from the state determination unit 61. After the data instruction signal including the screen identification information of the BOX screen is input from the operation determination unit 83, transmission is performed in response to the input of the activation instruction signal including the screen identification information of the BOX screen from the activation instruction operation determination unit 81. A transmission instruction is output to the target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information included in the data instruction signal.

  In addition, the timing determination unit 59A is a data instruction when the operation screen input from the operation screen generation unit 51 includes a plurality of data identification images and an execution signal is input from the state determination unit 61. In response to the input of the data instruction signal including the screen identification information of the BOX screen from the operation determination unit 83, the activation instruction signal including the screen identification information of the BOX screen is not input from the activation instruction operation determination unit 81. A transmission instruction is output to the transmission target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information included in the data instruction signal.

  Further, the timing determination unit 59A is a case where the operation screen input from the operation screen generation unit 51 includes a single data identification image, in this case, a BOX screen or a preview screen including one data identification image. When the execution signal is not input from the state determination unit 61, the transmission target determination unit 63 and the activation instruction signal including the screen identification information of the BOX screen are input from the activation instruction operation determination unit 81. A transmission instruction is output to the image data transmission unit 75. The transmission instruction includes data identification information of the data identification image included in the operation screen.

  Further, the timing determination unit 59A is a case where the operation screen input from the operation screen generation unit 51 includes a single data identification image, and when the execution signal is input from the state determination unit 61, the data In response to the input of the data instruction signal including the screen identification information of the BOX screen from the instruction operation determination unit 83, the activation instruction signal including the screen identification information of the BOX screen is not input from the activation instruction operation determination unit 81. Also, a transmission instruction is output to the transmission target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information included in the data instruction signal.

  FIG. 15 is a block diagram illustrating an example of an outline of functions of a CPU provided in the portable information device according to the first modification. Referring to FIG. 15, the difference from the function shown in FIG. 9 is that a state detection unit 265 and a notification unit 267 are added, and the takeover unit 263 is changed to a takeover unit 263A. Other functions are the same as those shown in FIG.

  The state detection unit 265 detects an application program different from the remote operation program executed by the CPU 201. The state detection unit 265 outputs an execution signal to the notification unit 267 and the takeover unit 263 when there is an application program for processing image data among the detected application programs. The in-execution signal includes task identification information for identifying a task that executes an application program for processing image data.

  The notification unit 267 processes the image data in response to the wireless LAN I / F unit 208 receiving a signal for inquiring the state from the MFP 100 that is the remote control device after the execution signal is input from the state detection unit 265. An execution state signal indicating that the application program for executing is being executed is returned. Notification unit 267 processes image data when wireless LAN I / F unit 208 receives a signal for inquiring a state from MFP 100 that is a remote control device in a state where an execution signal is not input from state detection unit 265. An execution state signal indicating that the application program is not being executed is returned.

  Even when the task identification information is not input from the activation unit 259, the takeover unit 263A receives the image data from the image data reception unit 261 when the execution signal is input from the state detection unit 265. Accordingly, the image data is output to the task specified by the task identification information included in the execution signal. As a result, image data is input to a task that executes an application program that is detected to be executed by the state detection unit 265, and the task processes the image data. For example, when the application program has a function of editing image data, the user can edit the image data instructed by MFP 100.

  CPU 111 provided in MFP 100 in the first modified example executes the same processing except for the remote control processing shown in FIG. 10 and the transmission target determination processing executed in step S15.

  FIG. 16 is a flowchart illustrating an example of a flow of a transmission target determination process in the first modification. Referring to FIG. 16, the difference from the transmission target determination process shown in FIG. 11 is that step S45 is added before step S31, and steps S46 to S48 are added after step S31. The other processing is the same as the transmission target determination processing shown in FIG. 11, and therefore description thereof will not be repeated here.

  Referring to FIG. 16, CPU 111 provided in MFP 100 in the first modified example determines the state of portable information device 200 that is a remote operation device in step S <b> 45. Specifically, the portable information device 200 is inquired about the state, and an execution state signal is received from the portable information device 200. Then, based on the execution state signal, it is determined whether portable information device 200 is executing an application program for processing image data.

  When the process proceeds to step S46, the operation screen includes a plurality of data identification images. In step S46, the process branches depending on whether portable information device 200 is executing an application program for processing image data. If portable information device 200 is executing an application program for processing image data, step S32 is skipped and the process proceeds to step S33, but portable information device 200 executes an application program for processing image data. If not, the process proceeds to step S32.

  If it is determined in step S31 that the operation screen includes a single data identification image, the process branches depending on whether or not the portable information device 200 is executing an application program for processing image data in step S47. . If portable information device 200 is executing an application program for processing image data, the process proceeds to step S48. If portable information device 200 is not executing an application program for processing image data, the process is performed. Proceed to step S35.

  In step S48, it is determined whether or not the instruction flag is set to ON. If the instruction flag is set to ON, the process proceeds to step S36; otherwise, the process returns to the remote control process.

  FIG. 17 is a flowchart illustrating an example of the flow of remote operation processing in the first modification. Referring to FIG. 17, the difference from the remote operation processing shown in FIG. 13 is that steps S118 to S120 are added after step S116. Other processes are the same as those shown in FIG.

  If it is determined in step S116 that the communication path is not disconnected, the process proceeds to step S118. In step S 118, it is determined whether an inquiry about the state is received from MFP 100. If a status inquiry is received, the process proceeds to step S119; otherwise, the process returns to step S107.

  In step S119, a state in which an application program executed by the CPU 201 is executed is detected. Specifically, an application program different from the remote operation program executed by the CPU 201 is detected.

  Then, the detected state is notified to MFP 100 (step S120), and the process returns to step S107. If there is an application program for processing image data among the application programs detected in step S119, an execution state signal indicating that the application program for processing image data is being executed is transmitted. If there is no application program for processing image data, an execution state signal indicating that the application program for processing image data is not being executed is transmitted.

  As described above, MFP 100 in the first embodiment functions as an image processing device and is remotely controlled by portable information device 200 that is a remote operation device. In addition, MFP 100 is associated with one or more data identification images, a start instruction image for accepting an operation for instructing portable information device 200 to start an application program by a user operating portable information device 200, and a start instruction image. Then, an operation screen including a command for starting the application program is generated and transmitted to the portable information device 200. When the position instructed by the user in the operation screen is within the activation instruction image, the portable information device 200 activates the application program according to the command associated with the activation instruction image. On the other hand, when an activation instruction operation for instructing an activation instruction image is determined as an operation by a user operating portable information device 200, MFP 100 determines one of one or more pieces of image data identified by one or more data identification images. At least a part of one piece of image data is transmitted to the portable information device 200. For this reason, at least a part of the image data can be processed by the application program started by the portable information device 200.

  When the operation screen transmitted to the portable information device 200 includes a plurality of data identification images, at least part of the image data identified by the data identification image instructed by the user operating the portable information device 200 To device 200. For this reason, the portable information device 200 can process the image data determined by the user who operates the portable information device 200.

  Further, since MFP 100 transmits at least part of the image data to portable information device 200 in response to detection of the data instruction operation after the activation instruction operation is determined, the image data is transferred from MFP 100 to the portable information. The transmission timing to device 200 can be synchronized between MFP 100 and portable information device 200.

  In addition, after the data instruction operation is determined, MFP 100 transmits at least a part of the image data to portable information device 200 in response to the determination of the activation instruction operation. The transmission timing to device 200 can be synchronized between MFP 100 and portable information device 200.

  Further, when the operation screen transmitted to portable information device 200 includes a single data identification image, MFP 100 is identified by the single data identification image included in the operation screen in response to the activation instruction operation being determined. At least a part of the image data to be transmitted is transmitted to portable information device 200. For this reason, it is possible to cause the portable information device 200 to process image data being browsed by the portable information device 200.

  Further, when the operation screen includes a single data identification image, MFP 100 transmits a portion of the page corresponding to the data identification image among one or more pages included in the image data specified by the data identification image. Determine and send. For this reason, it is possible to cause the portable information device 200 to process the portion of the page that the user operating the portable information device 200 is browsing as the data identification image.

  Further, when the data identification image is an image generated from a part of the page corresponding to the data identification image among one or more pages included in the image data specified by the data identification image, MFP 100 uses the data identification image. Of the specified image data, the portion corresponding to the data identification image included in the page corresponding to the data identification image is transmitted to the portable information device 200. For this reason, the portable information device 200 can process the same part as the data identification image among the pages viewed by the user operating the portable information device 200 as the data identification image.

  Further, when the operation screen includes a plurality of data identification images, MFP 100 transmits image data specified by the instructed data identification image to portable information device 200. For this reason, the portable information device 200 can process all of the image data.

  In addition, the MFP 100 acquires a memory amount that can be used by the portable information device 200 to process image data, and reduces the data amount of the image data when the data amount of the image data is larger than the memory amount. . Therefore, it is possible to transmit image data having a data amount that can be processed by the portable information device 200.

  In addition, when MFP 100 in the first modification determines that portable information device 200 is executing an application program for processing image data, one or more data identification images can be stored even if activation instruction operation is not determined. In response to the determination of the data instruction operation for instructing one of them, at least part of the image data identified by the instructed data identification image is transmitted to the portable information device 200. For this reason, when the portable information device 200 is executing an application program, the task that executes the application program can process the image data.

<Second Embodiment>
In the remote control system 1 according to the first embodiment, the command is associated with the activation instruction image included in the operation screen transmitted from the MFP 100 as the remote control device to the portable information device 200 as the remote operation device. In the remote control system 1 according to the second embodiment, the command is not associated with the activation instruction image included in the operation screen transmitted from the MFP 100 as the remote control device to the portable information device 200 as the remote operation device. . Hereinafter, the remote control system 1 according to the second embodiment will be described while referring to differences from the remote control system 1 according to the first embodiment.

  FIG. 18 is a block diagram illustrating an example of the functions of the CPU provided in the MFP according to the second embodiment. Referring to FIG. 18, the difference from the function shown in FIG. 6 is that command transmission unit 99 is added, operation screen generation unit 51 and timing determination unit 59 are changed to operation screen generation unit 51B and timing determination unit 59B. It is a changed point. Other functions are the same as those shown in FIG.

  The operation screen generation unit 51B generates an operation screen including an activation instruction image. The operation screen generated by the operation screen generation unit 51B is different in that the operation screen generation unit 51 in the first embodiment generates an operation screen including a command, but does not include a command. Other functions are the same as those of the operation screen generator 51 in the first embodiment.

  The timing determination unit 59B receives an operation screen from the operation screen generation unit 51B. When the operation screen input from the operation screen generation unit 51B includes a plurality of data identification images, the timing determination unit 59B in this case, from the activation instruction operation determination unit 81 in the case of a BOX screen including a plurality of data identification images. After the activation instruction signal including the screen identification information of the BOX screen is input, the command transmission unit 99 transmits the data instruction signal including the screen identification information of the BOX screen from the data instruction operation determining unit 83. A transmission instruction is output to the target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information included in the data instruction signal.

  In addition, when the operation screen input from the operation screen generation unit 51B includes a plurality of data identification images, the timing determination unit 59B receives a data instruction signal including the screen identification information of the BOX screen from the data instruction operation determination unit 83. In response to the activation instruction signal including the screen identification information of the BOX screen from the activation instruction operation determination unit 81, a transmission instruction is sent to the command transmission unit 99, the transmission target determination unit 63, and the image data transmission unit 75. Is output. The transmission instruction includes data identification information included in the data instruction signal.

  In addition, when the operation screen input from the operation screen generation unit 51B is a preview screen including a single data identification image, the timing determination unit 59B starts from the start instruction operation determination unit 81 including the screen identification information of the preview screen. In response to the input of the instruction signal, a transmission instruction is output to the command transmission unit 99, the transmission target determination unit 63, and the image data transmission unit 75. The transmission instruction includes data identification information of the data identification image included in the operation screen. In addition, when the operation screen input from the operation screen generation unit 51B is a BOX screen including a single data identification image, the timing determination unit 59B starts from the start instruction operation determination unit 81 including the screen identification information of the BOX screen. In response to the input of the instruction signal, a transmission instruction is output to the command transmission unit 99, the transmission target determination unit 63, and the image data transmission unit 75. The transmission instruction includes data identification information of one data identification image included in the BOX screen.

  The command transmission unit 99 transmits an activation command via the communication I / F unit 112 to the portable information device 200 that is a remote operation device in response to a transmission instruction input from the timing determination unit 59B. The activation command is a command that instructs the portable information device 200 to activate an application program that processes image data. Information relating to an application program that processes image data installed in the portable information device 200 may be acquired from the portable information device 200, and the command may be used to instruct execution of the application program. Further, the application program to be activated by the portable information device 200 may be determined when the portable information device 200 receives the activation command without specifying the application program by the activation command.

  FIG. 19 is a block diagram illustrating an example of an outline of functions of a CPU provided in the portable information device according to the second embodiment. Referring to FIG. 19, the difference from the function shown in FIG. 9 is that a command receiving unit 271 is added and the activation unit 259 is changed to an activation unit 259B. Other functions are the same as those shown in FIG.

  Command receiving unit 271 controls wireless LAN I / F 208 to receive an activation command from MFP 100 via a communication path established with MFP 100 that is a remote control device. In response to receiving the activation command, the command reception unit 271 outputs an activation instruction to the activation unit 259B.

  The activation unit 259B activates an application program capable of processing image data in response to an activation instruction input from the command reception unit 271. Specifically, the operation system is requested to start an application program. When the application program is activated, the activation unit 259B outputs task identification information for identifying a task that executes the application program to the takeover unit 263. The activation unit 259B may activate the application program specified by the command reception unit 271 by the activation command, or may execute a predetermined application program.

  CPU 111 provided in MFP 100 in the second embodiment executes the same processing except for the remote control processing shown in FIG. 10 and the image data transmission processing executed in step S17.

  FIG. 20 is a flowchart illustrating an example of the flow of image data transmission processing according to the second embodiment. Referring to FIG. 20, the difference from the image data transmission process shown in FIG. 12 is that step S50 is added before step S51. The other processing is the same as the image data transmission processing shown in FIG. 12, and therefore description thereof will not be repeated here.

  Referring to FIG. 20, CPU 111 provided in MFP 100 in the second embodiment transmits an activation command to portable information device 200 that is a remote operation device in step S50, and advances the process to step S51.

  FIG. 21 is a flowchart illustrating an example of the flow of remote operation processing according to the second embodiment. Referring to FIG. 17, the difference from the remote operation process in the first embodiment shown in FIG. 13 is that step S109, step S110 and step S113 are deleted, and step S121 and step S122 after step S116. Is added. Other processes are the same as those shown in FIG.

  If it is determined in step S116 that the communication path is not disconnected, the process proceeds to step S121. In step S121, it is determined whether an activation command is received from MFP 100 or not. If an activation command is received, the process proceeds to step S122; otherwise, the process returns to step S107.

  In step S122, an application program capable of processing image data is activated, and the process returns to step S107. Specifically, the operation system is requested to start an application program.

<Second Modification>
The remote control system 1 in the second modification example is similar to the remote control system 1 in the first modification example of the first embodiment. The remote control system MFP 100 is a remote control device of the portable information device 200. The state is judged. For this reason, the functions of CPU 111 provided in MFP 100 in the second modification of the second embodiment are the same as the functions of CPU 111 provided in MFP 100 in the first embodiment in the first modification. Similarly, the state determination unit 61 may be added to the function of the CPU 111 included in the MFP 100 according to the second embodiment illustrated in FIG. 18, and the timing determination unit 59 may be changed to the timing determination unit 59A.

  Further, the function of the CPU 201 provided in the portable information device 200 in the second modification of the second embodiment is the function of the CPU 201111 provided in the portable information device 200 in the first embodiment in the first modification. In the same way as when the change is made, the state detection unit 265 and the notification unit 267 are added to the functions of the CPU 111 of the MFP 100 in the second embodiment shown in FIG. 19, and the takeover unit 263 is changed to the takeover unit 263A. do it.

  Further, the CPU 111 provided in the MFP 100 in the second modification example performs the remote control process in the first embodiment shown in FIG. 10, the transmission target determination process executed in step S15, and the image data executed in step S17. The same process is executed except for the transmission process. In step S15, the same process as the transmission target determination process in the first modification of the first embodiment shown in FIG. 16 is executed. In step S17, the second embodiment shown in FIG. The same processing as the image data transmission processing is executed. In step S50, when an execution state signal indicating that an application program for processing image data is not being executed is received from portable information device 200, an activation command is transmitted, and image is received from portable information device 200. When an execution state signal indicating that an application program for processing data is being executed is received, the activation command is not transmitted.

  The remote operation process in the second modification example is the same as that in the first modification example shown in FIG. 17 after NO is determined in step S121 of the remote operation process in the second embodiment shown in FIG. What is necessary is just to add the process similar to step S118-step S120 of a remote operation process.

  The MFP 100 according to the second embodiment sends a command for starting an application program to the portable information device 200 in response to the activation instruction operation for instructing the activation instruction image being determined by the user operating the portable information device 200. And at least a part of the image data specified by one of the one or more data identification images is transmitted to the portable information device 200. For this reason, the portable information device 200 can start an application program, and the portable information device 200 can process image data.

  Further, when MFP 100 in the second modification determines that portable information device 200 is executing an application program for processing image data, one or more data identification images can be stored even if activation instruction operation is not determined. In response to the determination of the data instruction operation for instructing one of them, at least part of the image data identified by the instructed data identification image is transmitted to the portable information device 200. For this reason, when the portable information device 200 is executing an application program, the image data is processed by a task for executing the application program without transmitting a command for starting the application program to the portable information device 200. be able to.

<Third Embodiment>
In remote control system 1 in the first and second embodiments, the operation screen transmitted from MFP 100 as the remote control device to portable information device 200 as the remote operation device includes an activation instruction image. In the remote control system 1 according to the third embodiment, the operation screen transmitted from the MFP 100 serving as the remote control device to the portable information device 200 serving as the remote operation device does not include an activation instruction image. Hereinafter, the remote control system 1 according to the third embodiment will be described while referring to differences from the remote control system 1 according to the first embodiment.

  FIG. 22 is a block diagram illustrating an example of functions of the CPU provided in the MFP according to the third embodiment. The functions shown in FIG. 22 are different from the functions of the CPU of the MFP in the first modification of the first embodiment shown in FIG. 14 in that the operation screen generation unit 51, the operation determination unit 57, and the timing determination unit 59A is the point that the operation screen generation unit 51C, the operation determination unit 57C, and the timing determination unit 59C are changed. Other functions are the same as those shown in FIG.

  The operation screen generation unit 51C generates an operation screen. The operation screen generated by the operation screen generation unit 51C includes the activation instruction image and the command, whereas the operation screen generation unit 51 in the first embodiment generates the operation screen including the activation instruction image and the command. There are no differences. Other functions are the same as those of the operation screen generator 51 in the first embodiment.

  The operation determination unit 57C determines the operation of the user who operates the remote operation device in response to the position information input from the position information reception unit 55 after the operation screen is input from the operation screen generation unit 51C. Specifically, the operation determination unit 57C determines the operation of the user who operates the remote operation device based on the position specified by the position information in the operation screen. The operation determining unit 57C includes a data instruction operation determining unit 83.

  The data instruction operation determination unit 83 determines the data instruction operation if the position specified by the position information in the operation screen is within the data identification image included in the operation screen. The data instruction operation is an operation for instructing a data identification image included in the operation screen. In response to determining the data instruction operation, the data instruction operation determination unit 83 outputs a data instruction signal indicating that the image data has been instructed to the timing determination unit 59C. The data instruction signal includes screen identification information for identifying the operation screen and data identification information of image data corresponding to the data identification image.

  The timing determination unit 59C receives an operation screen from the operation screen generation unit 51C. When the in-execution signal is input from the state determination unit 61, the timing determination unit 59C transmits in response to the data instruction signal including the screen identification information of the BOX screen input from the data instruction operation determination unit 83. A transmission instruction is output to the target determination unit 63 and the image data transmission unit 75. The transmission instruction includes data identification information included in the data instruction signal.

  When the execution signal is not input from the state determination unit 61, the timing determination unit 59 </ b> C receives the data instruction signal including the screen identification information of the BOX screen from the data instruction operation determination unit 83. In addition, a transmission instruction is not output to the image data transmission unit 75.

  FIG. 23 is a block diagram illustrating an example of functions of a CPU provided in the portable information device according to the third embodiment. The function shown in FIG. 23 is different from the function of the CPU provided in the portable information device in the first modification of the first embodiment shown in FIG. 15 in that the activation unit 259 and the takeover unit 263A are the activation unit 259C. And the change to the takeover part 263C. Other functions are the same as those shown in FIG.

  Activating unit 259C activates the application program in accordance with an operation by a user who operates portable information device 200. Specifically, the activation unit 259C requests the operation system to start the application program in response to the operation unit 206 detecting an operation for starting the application program by the user. The task for executing the application program activated by the activation unit 259C is detected by the state detection unit 265.

  When the execution signal is input from the state detection unit 265, the takeover unit 263C performs a task specified by the task identification information included in the execution signal in response to the input of the image data from the image data reception unit 261. Output image data. As a result, image data is input to a task that executes an application program that is detected to be executed by the state detection unit 265, and the task processes the image data. For example, when the application program has a function of editing image data, the user can edit the image data instructed by MFP 100.

  FIG. 24 is a flowchart illustrating an example of the flow of remote control processing according to the third embodiment. Referring to FIG. 24, the difference from the remote control process in the first embodiment shown in FIG. 10 is that step S10 and step S11 are deleted, and step S12 is changed to step S12A. is there. Other processing is the same as the processing shown in FIG. 10, and therefore description thereof will not be repeated here. In step S07, it is determined whether or not the operation determined in step S06 is a data instruction operation. If it is a data instruction operation, the process proceeds to step S08; otherwise, the process proceeds to step S15.

  In step S12A, the transmission target determination process in the third embodiment is executed, and the process proceeds to step S13.

  FIG. 25 is a flowchart illustrating an example of the flow of a transmission target determination process in the third embodiment. The transmission target determination process in the third embodiment is a process executed in step S12A in FIG. Referring to FIG. 25, CPU 111 provided in MFP 100 in the third embodiment determines the state of portable information device 200 that is a remote operation device in step S61, and advances the process to step S62. Specifically, the portable information device 200 is inquired about the state, and an execution state signal is received from the portable information device 200. Then, based on the execution state signal, it is determined whether portable information device 200 is executing an application program for processing image data.

  In step S62, it is determined whether or not the instruction flag is set to ON. If the instruction flag is set to ON, the process proceeds to step S63. If not, the process returns to the remote control process. In step S63, the process branches depending on whether or not portable information device 200 is executing an application program for processing image data. If portable information device 200 is executing an application program for processing image data, the process proceeds to step S64. If portable information device 200 is not executing an application program for processing image data, the process is remotely performed. Return to control processing.

  In step S64, it is determined whether or not the operation screen transmitted to portable information device 200 that is a remote operation device includes a plurality of data identification images. If an operation screen including a plurality of data identification images is transmitted, the process proceeds to step S65. If not, the process proceeds to step S66.

  The process proceeds to step S65 when the operation screen transmitted to the portable information device 200, which is a remote operation device, includes a single data identification image. In step S65, the image data determined in step S09 in FIG. 24 is determined as a transmission target, and the process returns to the remote control process.

  The processing from step S66 to step S71 is the same as the processing from step S36 to step S41 of the transmission target determination processing in the first embodiment shown in FIG. Therefore, description is not repeated here.

  FIG. 26 is a flowchart illustrating an example of the flow of remote operation processing according to the third embodiment. Referring to FIG. 26, the difference from the remote operation process in the first embodiment shown in FIG. 13 is that step S109, step S110 and step S113 are deleted, and step S118 to step S120 after step S116. Step S133 and Step S134 are added, and Step S131 and Step S132 are added after Step S101. Other processes are the same as those shown in FIG.

  If a remote operation instruction is accepted in step S101 (YES in step S101), the process proceeds to step S102. If no remote operation instruction is accepted, the process proceeds to step S131. In step S131, it is determined whether an application activation instruction is accepted. When the operation unit 207 receives an operation for starting an application program input by a user, an application start instruction is received. If an application activation instruction is accepted, the process proceeds to step S132; otherwise, the process returns to step S101. In step S132, the application program determined by the application activation instruction is activated, and the process returns to step S101. Specifically, the operation system is requested to start an application program.

  If it is determined in step S116 that the communication path is not disconnected, the process proceeds to step S118. In step S 118, it is determined whether an inquiry about the state is received from MFP 100. If a status inquiry is received, the process proceeds to step S119; otherwise, the process proceeds to step S133.

  In step S119, a state in which an application program executed by the CPU 201 is executed is detected. Then, the detected state is notified to MFP 100 (step S120), and the process returns to step S107.

  In step S133, as in step S131, it is determined whether an application activation instruction has been accepted. If an application activation instruction is accepted, the process proceeds to step S134; otherwise, the process returns to step S107. In step S134, the application program determined by the application activation instruction is activated, and the process returns to step S107.

  When MFP 100 according to the third embodiment transmits an operation screen including one or more data identification images to portable information device 200 and portable information device 200 determines that an application program for processing image data is being executed. Transmits at least a part of the image data identified by the instructed data identification image to the portable information device 200 in response to the determination of the data instruction operation instructing one of the one or more data identification images To do. For this reason, when the portable information device 200 is executing an application program, the task that executes the application program can process the image data.

  In the above-described embodiment, the MFP 100 has been described as an example of the remote control device. However, the remote control processing illustrated in FIGS. 10 to 12, 16, 20, 24, and 25 is performed on the MFP 100. As a remote control method to be executed, a remote control program for causing the CPU 111 to control the MFP 100 to execute the remote control method, and the remote operation processing shown in FIG. 13, FIG. 17, FIG. Needless to say, the invention can be understood as a remote operation method to be executed and a remote operation program for causing the CPU 201 that controls the portable information device 200 to execute the remote operation method.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
The image processing apparatus according to claim 16, wherein the reduction unit includes a reduction unit that reduces a resolution of the image data to be transmitted.
(2) The image processing apparatus according to (16) or (1), wherein the reduction unit includes a trimming unit that trims a part of the image data to be transmitted.

1 remote control system, 3 network, 5 radio station, 100, 100A, 100B MFP, 110 main circuit, 111 CPU, 112 communication I / F unit, 113 ROM, 114 RAM, 115 HDD, 116 facsimile unit, 117 external storage device , 120 automatic document feeder, 130 document reading unit, 140 image forming unit, 150 paper feeding unit, 155 post-processing unit, 160 operation panel, 161 display unit, 163 operation unit, 165 touch panel, 165 hard key unit, 167 hard key Part, 200, 200A, 200B portable information device, 201 CPU, 202 camera, 203 flash memory, 204 wireless communication part, 205 call part, 206 display part, 207 operation part, 207A main key, 207B touch panel, 208 wireless LAN I / F 210 acceleration Sensor, 211 external storage device, 51 operation screen generation unit, 51, 51A to 51C operation screen generation unit, 53 operation screen transmission unit, 55 position information reception unit, 57, 57C operation determination unit, 59, 59A to 59C timing determination unit 61 state determination unit, 63 transmission target determination unit, 65 reduction unit, 67 size acquisition unit, 69 URL generation unit, 71 transmission availability determination unit, 75 image data transmission unit, 81 activation instruction operation determination unit, 83 data instruction operation determination Part, 85 page specification part, 87 whole specification part, 89 partial specification part, 91 reduction part, 93 trimming part, 99 command transmission part, 251 operation screen reception part, 253 display control part, 255 position detection part, 257 position information transmission Part, 259, 259A, 259B, 259C starting part, 261 image data receiving part, 263, 263A, 263C taking over part, 2 5 state detector, 267 notification unit, 271 command receiving unit.

Claims (16)

An image processing device that can be remotely controlled by a remote control device,
A data identification image generated based on one page selected from a plurality of pages included in a single image data , and a user operating the remote operation device to start an application program to the remote operation device An operation screen generating means for generating an operation screen including an activation instruction image for receiving an operation to be instructed;
Operation screen transmission means for transmitting the generated operation screen to the remote operation device;
In response to receiving position information indicating the position in the transmitted operation screen from the remote operation device, the remote operation device is operated based on the position in the operation screen specified by the position information. An operation determining means for determining an operation by the user;
Transmission target determining means for determining, as a transmission target, a portion of a page specified by the data identification image among a plurality of pages included in the image data;
An image processing apparatus comprising: image data transmission means for transmitting the transmission target to the remote operation device when an activation instruction operation for instructing the activation instruction image is determined by the operation determination means. The image processing apparatus according to claim 1, wherein the operation screen generation unit selects one of a plurality of pages included in the image data in accordance with an operation determined by the operation determination unit. The transmission target decision means, said data identification images, if the image generated from a portion of the page corresponding to the data identification image among the plurality of pages included before Kiga image data, before Symbol data identification images determining the portion corresponding to the data identification image contained in the corresponding page in the transmission target, the image processing apparatus according to claim 1 or 2. It said image data transmission means, the start instruction operation in response to be determined, the transmission target is transmitted to the remote operation apparatus, an image processing apparatus according to any one of claims 1-3. A remote control system comprising the image processing device according to claim 1 and the remote control device,
The operation screen generating means generates an operation screen that is associated with the start instruction image and further includes a command for starting the application program,
The remote operation device includes display control means for displaying an operation screen received from the image processing device;
Position detecting means for detecting a position instructed by a user in the displayed operation screen;
Position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus;
If the detected position is in the start instruction image, start means for starting the application program according to a command associated with the start instruction image;
Wherein the image processing apparatus in response to the image data is received, the the tasks that perform the activated application program, a remote control system and a takeover means for processing the received image data. A remote control system comprising the image processing device according to claim 1 and the remote control device,
The image processing apparatus further includes command transmission means for transmitting a command for starting the application program to the remote operation device in response to an operation for instructing the activation instruction image being determined by the operation determination means. ,
The remote operation device includes display means for displaying an operation screen received from the image processing device;
Position detecting means for detecting a position designated by the user in the operation screen;
Position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus;
In response to receiving the command from the image processing apparatus, an activation unit that activates the application program according to the received command;
A remote control system comprising: a handover unit that causes a task for executing the activated application program to process the received image data in response to reception of image data from the image processing apparatus. A state determining means for determining whether or not the remote control device is executing an application program for processing image data;
Said image data transmission unit, if it is determined that the running by the state determining means, in response to the data instruction operation for instructing the pre Kide over data identification image image by the operation determination means has been determined, the the transmission target, transmitting to the remote control device, an image processing apparatus according to any one of claims 1-4. A remote control system comprising the image processing device according to claim 7 and the remote control device,
The remote operation device includes display means for displaying an operation screen received from the image processing device;
Position detecting means for detecting a position designated by the user in the operation screen;
Position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus;
State detecting means for detecting whether or not the application program for processing the image data is being executed;
A notification means for notifying the image processing apparatus that the running state is detected when the running state is detected by the state detecting means;
When the execution state is detected, the received image data is sent to a task for executing the application program in which the execution state is detected in response to reception of image data from the image processing apparatus. A remote control system comprising: takeover means for processing. An image processing device that can be remotely controlled by a remote control device,
Operation screen generation means for generating an operation screen including a data identification image generated based on one page selected from a plurality of pages included in a single image data;
Operation screen transmission means for transmitting the generated operation screen to the remote operation device;
In response to receiving position information indicating the position in the transmitted operation screen from the remote operation device, the remote operation device is operated based on the position in the operation screen specified by the position information. An operation determining means for determining an operation by the user;
Transmission target determining means for determining, as a transmission target, a portion of a page specified by the data identification image among a plurality of pages included in the image data;
State determining means for determining whether or not the remote control device is in an executing state of executing an application program for processing image data;
If it is determined the the running state by the state determining means, in response to the data instruction operation for instructing the pre Kide over data identification image image by the operation determination means has been determined, the transmission target, the An image processing apparatus comprising: image data transmitting means for transmitting to a remote operation device. A remote control system comprising the image processing device according to claim 9 and the remote control device,
The remote operation device includes display means for displaying an operation screen received from the image processing device;
Position detecting means for detecting a position designated by the user in the operation screen;
Position information transmitting means for transmitting position information indicating the detected position to the image processing apparatus;
State detecting means for detecting whether or not the application program for processing the image data is being executed;
A notification means for notifying the image processing apparatus that the running state is detected when the running state is detected by the state detecting means;
When the execution state is detected, the received image data is sent to a task for executing the application program in which the execution state is detected in response to reception of image data from the image processing apparatus. A remote control system comprising: takeover means for processing. A memory amount acquiring means for acquiring a memory amount that can be used by the remote control device to process the image data to be transmitted;
Before Kioku If the data amount of the image data signal subject is large relative to the amount of memory, it claims 1～4,7 and 9 and reducing means for reducing the data amount of the image data of the transmission target, further comprising An image processing apparatus according to any one of the above. When the memory area used to transmit the image data to be transmitted is insufficient, the image data transmitting means assigns an address indicating the position where the image data to be transmitted is stored to the image data to be transmitted. instead it is transmitted to the remote operation apparatus, the image processing apparatus according to any one of claims 1～4,7 and 9. A remote control method executed by an image processing apparatus capable of being remotely controlled by a remote control device,
A data identification image generated based on one page selected from a plurality of pages included in a single image data , and a user operating the remote operation device to start an application program to the remote operation device An operation screen generation step for generating an operation screen including an activation instruction image for receiving an operation to be instructed;
An operation screen transmission step of transmitting the generated operation screen to the remote operation device;
In response to receiving position information indicating the position in the transmitted operation screen from the remote operation device, the remote operation device is operated based on the position in the operation screen specified by the position information. An operation determination step for determining an operation by the user;
A transmission target determination step for determining a transmission target for a portion of a page specified by the data identification image among a plurality of pages included in the image data;
A remote control method comprising: an image data transmission step of transmitting the transmission target to the remote operation device when an activation instruction operation for instructing the activation instruction image is determined in the operation determination step. A remote control method executed by an image processing apparatus capable of being remotely controlled by a remote control device,
An operation screen generating step for generating an operation screen including a data identification image generated based on one page selected from a plurality of pages included in a single image data;
An operation screen transmission step of transmitting the generated operation screen to the remote operation device;
In response to receiving position information indicating the position in the transmitted operation screen from the remote operation device, the remote operation device is operated based on the position in the operation screen specified by the position information. An operation determination step for determining an operation by the user;
A transmission target determination step for determining a transmission target for a portion of a page specified by the data identification image among a plurality of pages included in the image data;
A state determination step of determining whether or not the remote operation device is in an executing state of executing an application program for processing image data;
If it is determined the the running state in the state determination step, in response to the data instruction operation for instructing the pre Kide over data identification image image in the operation determining step is determined, the transmission target, the A remote control method comprising: transmitting image data to the remote control device. A remote control program executed by a computer for controlling an image processing apparatus that can be remotely controlled by a remote control device,
A data identification image generated based on one page selected from a plurality of pages included in a single image data , and a user operating the remote operation device to start an application program to the remote operation device An operation screen generation step for generating an operation screen including an activation instruction image for receiving an operation to be instructed;
An operation screen transmission step of transmitting the generated operation screen to the remote operation device;
In response to receiving position information indicating the position in the transmitted operation screen from the remote operation device, the remote operation device is operated based on the position in the operation screen specified by the position information. An operation determination step for determining an operation by the user;
A transmission target determination step for determining a transmission target for a portion of a page specified by the data identification image among a plurality of pages included in the image data;
If start instruction operation for instructing the start instruction image in the operation determining step Ru is determined, the remote control program for executing the transmission target, and an image data transmission step of transmitting to said remote control device, to the computer. A remote control program executed by a computer for controlling an image processing apparatus that can be remotely controlled by a remote control device,
An operation screen generating step for generating an operation screen including a data identification image generated based on one page selected from a plurality of pages included in a single image data;
An operation screen transmission step of transmitting the generated operation screen to the remote operation device;
In response to receiving position information indicating the position in the transmitted operation screen from the remote operation device, the remote operation device is operated based on the position in the operation screen specified by the position information. An operation determination step for determining an operation by the user;
A transmission target determination step for determining a transmission target for a portion of a page specified by the data identification image among a plurality of pages included in the image data;
A state determination step of determining whether or not the remote operation device is in an executing state of executing an application program for processing image data;
If the it is determined that the running state in the state determination step, in response to the data instruction operation for instructing the pre Kide over data identification image in the operation determining step is determined, the transmission target, the remote A remote control program for causing the computer to execute an image data transmission step to be transmitted to the operating device.

Images