JP6657994B2 - Program, mobile terminal, and system - Google Patents

Description

  The present invention relates to a program for a mobile terminal that causes a specified input device and output device specified by a user to execute a cooperative operation.

  Patent Literature 1 describes a portable terminal program in which a combination of an input device and an output device designated by a user is registered in advance, and the input device and the output device of the registered combination execute a cooperative operation. . The cooperative operation indicates, for example, that the mobile terminal receives target data from the input device that has performed the input operation, and causes the output device to execute an output operation on the received target data. According to the program having the above configuration, it is possible to easily execute a routine cooperation operation repeatedly executed.

JP-A-2015-012518

  However, with the program having the above configuration, when it is desired to temporarily execute the output operation on a different output device in the cooperative operation, the cooperative operation must be started after changing the registered combination, and the user operation is complicated. There is a problem of becoming.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a program for a portable terminal that causes a registered input device and output device to execute a cooperative operation, wherein the output device can be easily switched. To provide a program.

  A program according to an embodiment of the present specification can be read by a mobile terminal including a terminal memory, an input interface, and a communication interface. The program causes the mobile terminal to execute a registration process of storing cooperative operation information including input device information and at least one of output device information and extraction instruction information in the terminal memory. The input device information is information for identifying an input device specified through the input interface. The output device information is information for identifying an output device specified through the input interface. The extraction instruction information corresponds to a reception of an instruction operation for instructing extraction of the output device information from information image data through the input interface. The program is identified by a receiving process of receiving a designation operation for designating one of the cooperative operation information stored in the terminal memory through the input interface, and the input device information included in the specified cooperative operation information. And causing the portable terminal to execute an input instruction process of transmitting input instruction information through the communication interface. The input instruction information is information for instructing execution of an input operation for inputting target data to be transmitted to the mobile terminal to the input device. The program receives the target data as a response to the input instruction information, a reception process of receiving the target data from the input device through the communication interface, and determines whether the extraction instruction information is included in the specified cooperative operation information. The portable terminal is caused to execute a determination process of determining and an extraction process of extracting the output device information from the information image data in response to the determination process determining that the extraction instruction information is included. The information image data is image data generated by an image reading device reading an image recorded on an object. The program causes the portable terminal to execute an output instruction process of transmitting output instruction information through the communication interface to the output device identified by the output device information extracted in the extraction process. The output instruction information includes the target data received in the reception processing and is information for instructing execution of an output operation for outputting the target data.

  According to the above configuration, it is possible to cause the input device identified by the input device information included in the cooperation operation information and the output device identified by the output device information extracted from the information image data to execute the cooperation operation. That is, the output device can be easily switched by the information reading device generating the information image data including the desired output device information.

  A program according to another embodiment of the present specification can be read by a portable terminal including a terminal memory, an input interface, and a communication interface. The program causes the portable terminal to execute a registration process of storing cooperative operation information including input device information and output device information in the terminal memory. The input device information is information for identifying an input device specified through the input interface. The output device information is information for identifying an output device specified through the input interface. The program is identified by a receiving process of receiving a designation operation for designating one of the cooperative operation information stored in the terminal memory through the input interface, and the input device information included in the specified cooperative operation information. And causing the portable terminal to execute an input instruction process of transmitting input instruction information through the communication interface. The input instruction information is information for instructing execution of an input operation for inputting target data to be transmitted to the mobile terminal to the input device. The program executes, on the portable terminal, a reception process of receiving the target data as a response to the input instruction information from the input device through the communication interface, and an extraction process of extracting the output device information from information image data. Let it. The information image data is image data generated by an image reading device reading an image recorded on an object. The program, in response to not extracting the output device information in the extraction process, to the output device identified by the output device information included in the specified cooperative operation information, through the communication interface, And causing the mobile terminal to execute a first output instruction process of transmitting output instruction information. The output instruction information includes the target data received in the reception processing and is information for instructing execution of an output operation for outputting the target data. The program, in response to extracting the output device information in the extraction process, to each of the output device identified by the output device information and the extracted output device information included in the specified cooperative operation information And causing the mobile terminal to execute a second output instruction process of transmitting output instruction information through the communication interface.

  According to the above configuration, when the fixedly designated input device and output device execute the cooperative operation, the temporary addition of the output device can be realized by a simple operation.

FIG. 1 is a schematic diagram of a system 100 according to the present embodiment. FIG. 2A is a block diagram of the MFP 10, and FIG. 2B is a block diagram of the portable terminal 50. 3A and 3B show examples of data stored in the data storage area 62B. FIG. 3A shows a linked operation list, FIG. 3B shows a page list corresponding to the documents 141 to 143, and FIG. Shows a page list corresponding to. FIG. 4 is a flowchart of the registration process. FIG. 5 is a flowchart of the cooperation instruction process. FIG. 6A is a flowchart of the ID acquisition process A, and FIG. 6B is a flowchart of the ID acquisition process B. 7A and 7B are display examples of the display 53, wherein FIG. 7A shows a registration screen before an input device and an output device are designated, and FIG. 7B shows an input selection screen. 8A and 8B show display examples on the display 53, wherein FIG. 8A shows a registration screen after an input device is designated, and FIG. 8B shows an output selection screen. FIG. 9 is a display example of the display 53, in which (A) shows a registration screen after an input device and an output device are designated, and (B) shows an operation selection screen. 10A and 10B show an example of a document to be read by the scanner 12. FIG. 10A shows documents 141 to 143 in which a QR code (registered trademark) 141Q is added only to a front page, and FIG. Documents 151 to 153 to which codes 151Q and 152Q are added are shown.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be appropriately changed without changing the gist of the present invention. For example, the execution order of each process described below can be appropriately changed without changing the gist of the present invention.

  FIG. 1 is a schematic diagram of a system 100 according to the present embodiment. A system 100 shown in FIG. 1 includes multifunction peripherals 10A and 10B (hereinafter, these may be collectively referred to as “multifunction peripheral 10”), a portable terminal 50, and a server 80. . The MFP 10, the mobile terminal 50, and the server 80 can communicate with each other via a communication network. A specific example of the communication network is not particularly limited. For example, the communication network may be the Internet 101, a wired LAN (for Local Area Network), a wireless LAN 102, or a combination thereof.

  The MFP 10 and the mobile terminal 50 belong to the wireless LAN 102. That is, the MFP 10 and the portable terminal 50 can communicate with each other via an access point (not shown) of the wireless LAN 102. The wireless LAN 102 is connected to the Internet 101 through a router 102A. Further, the server 80 is connected to the Internet 101. That is, the MFP 10 and the portable terminal 50 can communicate with the server 80 from the router 102A via the Internet 101.

[MFP 10]
As shown in FIG. 2A, the MFP 10 includes a printer 11, a scanner 12, a display 23, an input I / F (short for InterFace) 24, a communication I / F 25, and a CPU (Central Processing). It mainly includes a unit 31), a memory 32, and a communication bus 33. The components of the multifunction peripheral 10 are interconnected via a communication bus 33. The configurations of the multifunction peripherals 10A and 10B may be the same or different.

[Printer 11, Scanner 12]
The printer 11 performs a recording operation for recording an image represented by image data on a sheet. As a recording method of the printer 11, a known method such as an ink jet method or an electrophotographic method can be adopted. The scanner 12 performs a reading operation of reading an image recorded on a document and generating image data. Note that the multifunction peripheral 10 may further include a facsimile unit that can execute a facsimile transmission operation and a facsimile reception operation for transmitting and receiving image data according to a facsimile protocol. Further, the multifunction peripheral 10 may include only one of the printer 11 and the scanner 12, and may not include the other.

[Display 23]
The display 23 has a display surface for displaying various information. As the display 23, a liquid crystal display (abbreviation for Liquid Crystal Display), an organic EL display (abbreviation for Organic Electro-Luminescence Display), or the like can be used.

[Input I / F24]
The input I / F 24 is a user interface that receives an input operation by a user. Specifically, the input I / F 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Further, the input I / F 24 may have a film-shaped touch sensor superimposed on the display surface of the display 23. That is, the display 23 may be configured as a touch panel display. An operation of designating an object displayed on the display surface of the display 23 and an operation of inputting a character string or a number string are examples of an input operation.

  The “object” refers to an image that can be specified by the user operating the input I / F 24. As an example, the object may be a character string, an icon, a button, a link, or the like displayed on the display 23. The object may be specified by pressing the direction key or the enter button of the input I / F 24. When the input I / F 24 is a touch panel, the object displayed on the display 23 may be specified by touching a display position.

  The input I / F 24 implemented as a touch panel outputs position information indicating a position on the display surface touched by the user. Note that “touch” in this specification includes all operations for bringing an input medium into contact with a display surface. That is, a tap operation for separating the touched input medium from the display surface within a predetermined time, a long touch operation, a slide operation for sliding the touched input medium on the display surface, a flick operation, a pinch-in operation, a pinch-out operation, etc. This is an example.

  Even if the input medium does not touch the display surface, bringing the input medium close to a position where the distance between the input medium and the display surface is very small may be included in the concept of the “touch” described above. Further, the input medium may be a user's finger, a touch pen, or the like. The user operation of tapping the position of the icon displayed on the display 53 is an example of a specifying operation for specifying the icon.

[Communication I / F25]
The communication I / F 25 is an interface capable of communicating with an external device via a communication network. That is, the MFP 10 outputs various information to the external device through the communication I / F 25 and receives various information from the external device through the communication I / F 25. Although a specific communication procedure of the communication I / F 25 is not particularly limited, for example, Wi-Fi (a registered trademark of Wi-Fi Alliance) can be adopted.

[CPU 31]
The CPU 31 controls the overall operation of the MFP 10. The CPU 31 acquires various programs described later from the memory 32 based on various information output from the input I / F 24, various information acquired from an external device through the communication I / F 25, and executes the programs. The CPU 31 and the memory 32 constitute an example of a control unit.

[Memory 32]
The memory 32 has a program storage area 32A and a data storage area 32B. An OS (Operating System) 34 and an apparatus program 35 are stored in the program storage area 32A. Note that the device program 35 may be a single program or an aggregate of a plurality of programs. The same applies to other programs. The data storage area 32B stores data or information necessary for executing the device program 35.

  Note that “data” and “information” in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by a computer without considering the meaning of each bit. On the other hand, "information" indicates that the operation of the computer branches depending on the meaning of each bit. Further, the "instruction" is a control signal for prompting the destination device to perform the next operation, and may include information, or may have the property of information itself. There is also.

  Further, even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer, "data" and "information" are the same as long as they are recognized as having the same meaning and content. Is treated as For example, information indicating “two” is stored as text information of ASCII code “0x32” in one computer, and is stored as binary information of “10” in binary notation in another computer. May be done.

  However, the distinction between “data” and “information” is not strict, and exceptional handling is allowed. For example, data may be temporarily handled as information, or information may be temporarily handled as data. Also, what is treated as data in one device may be treated as information in another device. Further, information may be extracted from data, or data may be extracted from information.

  The memory 32 includes, for example, RAM (abbreviation of Random Access Memory), ROM (abbreviation of Read Only Memory), EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), and HDD (abbreviation of Hard Driving machine, Hard Driving machine). It is configured by a portable storage medium such as a removable USB memory, a buffer included in the CPU 31, or a combination thereof.

  Note that the memory 32 may be a computer-readable storage medium. The computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROMs and DVD-ROMs in addition to the above examples. Further, a non-transitory medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server or the like on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but is a non-transitory computer-readable storage medium. Not included in the medium.

  The programs stored in the program storage area 32A are executed by the CPU 31. However, in this specification, the operation of each program may be described with the CPU 31 omitted. That is, in the following description, a description to the effect that "the program A executes the process A" may indicate that "the CPU 31 executes the process A described in the program A". The same applies to the mobile terminal 50.

  The program stored in the program storage area 32A determines an event and operates according to the determination result. However, in this specification, the operation of each program may be described without making a determination. That is, in the following description, the description to the effect that "the program executes the process A according to the condition A" is "determining whether or not the program satisfies the condition A. The program is affirmatively determined. Executing the process A in response to the The same applies to the mobile terminal 50.

  The program stored in the program storage area 32A specifies, acquires, extracts, determines, or selects data or the like. When the program specifies data or the like, for example, data that matches a condition is specified from a plurality of data or the like, and the data itself or information for identifying the data or the like is stored in a predetermined storage area. Refers to the process of storing. The information for identifying data or the like is, for example, identification information for identifying the data or the like, an index of an array in which the data or the like is stored, a pointer of a storage area in which the data or the like is stored, or the like. The same applies to a process in which a program acquires, extracts, determines, or selects data or the like. The same applies to the mobile terminal 50.

  The OS 34 basically provides an API (abbreviation for Application Programming Interface) for controlling the printer 11, the scanner 12, the display 23, the input I / F 24, the communication I / F 25, and the like, which are hardware constituting the MFP 10. It is a program. That is, each of the above-described programs controls each hardware by calling an API provided by the OS 34. However, in this specification, the operation of each program may be described with the OS 34 omitted. That is, in the following description, a description to the effect that “the program B controls the hardware C” may indicate that “the program B controls the hardware C through the API of the OS 34”. The same applies to the mobile terminal 50.

[Mobile terminal 50]
The portable terminal 50 mainly includes a display 53, an input I / F 54, a communication I / F 55, a camera 56, a CPU 61, a memory 62, and a communication bus 63, as shown in FIG. Prepare. The display 53, the input I / F 54, the communication I / F 55, the CPU 61, the memory 62, and the communication bus 63 included in the portable terminal 50 are the display 23, the input I / F 24, the communication I / F 25, and the CPU 31 included in the MFP 10. , The memory 32, and the communication bus 33, and a description thereof will be omitted.

  The mobile terminal 50 is, for example, a mobile phone, a smartphone, a tablet terminal, or the like. More specifically, the display 53 of the portable terminal 50 preferably has a display screen size of 12 inches or less, more preferably 8 inches or less. The input I / F 54 of the mobile terminal 50 is preferably a touch panel overlaid on the display screen of the display 53. The memory 62 is an example of a terminal memory, and the CPU 61 and the memory 62 are examples of a control unit.

[Camera 56]
The camera 56 captures an image of a subject and generates image data. The operation of the camera 56 is controlled by, for example, a camera program (not shown) stored in the program storage area 62A. That is, the camera program causes the display 53 to display an image photographed by the camera 56 and a [shooting] icon. Further, the image displayed on the display 53 changes as the direction of the camera 56 changes. Then, the camera program causes the data storage area 62B to store the image data indicating the image displayed on the display 53 in response to receiving the user operation for designating the [shooting] icon through the input I / F 54.

  The program storage area 62A of the memory 62 stores the OS 64 and the terminal program 65. The OS 64 may be, for example, Android (registered trademark of Google Inc.) OS, IOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like.

  The terminal program 65 is a program that causes an input device and an output device designated by a user to execute a cooperative operation. The input device is a device that performs an input operation of inputting target data to be transmitted to the mobile terminal 50. The output device is a device that performs an output operation of outputting target data received from the mobile terminal 50. That is, the terminal program 65 receives target data from the input device by causing the input device to execute an input operation. Next, the terminal program 65 causes the output device to execute an output operation by outputting the target data received from the input device to the output device. The MFP 10 and the server 80 are devices that can be input devices and output devices.

  The input operation of the MFP 10 functioning as the input device indicates, for example, causing the scanner 12 to generate target data to be transmitted to the mobile terminal 50. The input operation of the server 80 functioning as an input device refers to, for example, reading target data to be transmitted to the mobile terminal 50 from a memory included in the server 80 (hereinafter, sometimes referred to as a “server memory”). Having the scanner 12 generate the target data and reading the target data from the server memory are examples of inputting the target data to the input device. The output operation of the MFP 10 functioning as an output device refers to, for example, causing the printer 11 to record an image represented by target data received from the mobile terminal 50 on a sheet. The output operation of the server 80 functioning as an output device indicates, for example, storing target data received from the mobile terminal 50 in a server memory.

  The data storage area 62B of the portable terminal 50 can store a cooperative operation list, for example, as shown in FIG. The cooperative operation list includes one or more cooperative operation records. The cooperative operation record includes an input device ID, an output device ID, and extraction instruction information associated with each other. The cooperative operation record is an example of cooperative operation information.

  The input device ID is an example of input device information for identifying an input device specified through the input I / F 54. The output device ID is an example of output device information for identifying an output device specified through the input I / F 54. In the present embodiment, the MFP 10A is identified by the device ID “MFP-A”, the MFP 10B is identified by the device ID “MFP-B”, and the server 80 is identified by the device ID “Server C”. Note that the input device ID and the output device ID may be, for example, in a URL (Uniform Resource Locator) format.

  The extraction instruction information is information indicating that an instruction operation for instructing extraction of the output device ID from the information image data has been received through the input I / F 54 in a registration process described later. The extraction instruction information according to the present embodiment includes the “scanner QR” corresponding to the instruction to extract the output device ID from the information image data generated by the scanner 12 or the output device ID from the information image data generated by the camera 56. “Camera QR” corresponding to the instruction to be extracted.

  The cooperation operation record includes the input device ID. On the other hand, the cooperation operation record does not have to include one of the output device ID and the extraction instruction information, and may include both the output device ID and the extraction instruction information. Further, the number of output device IDs and extraction instruction information included in the cooperative operation record is not limited to one, and may be plural. When the terminal program 65 is installed, no cooperative operation record is stored in the data storage area 62B. Then, in the registration process described later, the terminal program 65 registers the cooperative operation record generated according to the user's instruction in the cooperative operation list.

  The data storage area 62B can store a page list, for example, as shown in FIGS. 3B and 3C. The page list includes one or more page records. The page record includes the page data, the first output device ID, and the second output device ID associated with each other. The page data is data included in the target data received from the input device. The page data is, for example, image data indicating an image recorded on a one-page document read by the scanner 12. The first output device ID is an output device ID included in the cooperation record specified by the user. The second output device ID is an output device ID acquired in an ID acquisition process B described later. The page list is temporarily generated by the terminal program 65 in a cooperation instruction process described later.

[Server 80]
The server 80 is a so-called storage server. More specifically, the server 80 stores, for example, data received from the mobile terminal 50 in a server memory, reads data specified by the mobile terminal 50 from the server memory, and transmits the data to the mobile terminal 50. The server 80 provides services such as “Evernote (registered trademark of Evernote Corporation)”, “Dropbox (registered trademark of DropBox, Inc.)”, and “Google Drive (Google is a registered trademark of Google, Inc.)”. It may be provided.

[Operation of System 100]
The operation of the system 100 according to the present embodiment will be described with reference to FIGS.

[registration process]
First, the terminal program 65 can execute a registration process. The registration process is a process of registering a cooperative operation record generated according to a user's instruction in a cooperative operation list. The details of the registration process will be described with reference to FIG.

  First, the terminal program 65 displays a registration screen on the display 53 (S11). FIG. 7A is an example of a registration screen displayed first in the registration process. The registration screen illustrated in FIG. 7A includes a [+ input] icon 111, a [+ output] icon 112, and a [registration] icon 113. [+ Input] icon 111 corresponds to an instruction to specify an input device. [+ Output] icon 112 corresponds to an instruction to specify an output device. [Registration] icon 113 corresponds to an instruction to register a cooperative operation record in the cooperative operation list. Then, the terminal program 65 receives a user operation on the registration screen through the input I / F 54 (S12).

  Next, in response to receiving the designation of the [+ input] icon 111 shown in FIG. 7A through the input I / F 54 (S12: [+ input] icon), the terminal program 65 displays the input selection screen. It is displayed on the display 53 (S13). FIG. 7B is an example of the input selection screen. The input selection screen shown in FIG. 7B includes input icons 121, 122, and 123. Then, the terminal program 65 receives a user operation on the input selection screen through the input I / F 54 (S14).

  The input icons 121, 122, and 123 correspond to the MFPs 10A, 10B and the server 80 that can be input devices. The input icons 121 to 123 describe the device ID of the corresponding device. The names of the corresponding devices may be described in the input icons 121 to 123. The device ID of the device that can be the input device may be registered in the terminal program 65 in advance, or may be searched on the communication network using SNMP (abbreviation for Simple Network Management Protocol) or the like.

  Next, in response to, for example, accepting the designation of the input icon 121 through the input I / F 54 (S14: Yes), the terminal program 65 sets the device ID corresponding to the designated input icon 121 to the data as the input device ID. It is temporarily stored in the storage area 62B (S15). The specification of the input icons 121 to 123 is an example of a user operation for specifying an input device. Then, the terminal program 65 causes the display 53 to display the registration screen shown in FIG. 8A (S11). The registration screen shown in FIG. 8A differs from the registration screen shown in FIG. 7A in that it includes an [MFP-A] icon 114 instead of [+ input] icon 111. [MFP-A] icon 114 corresponds to the input device ID temporarily stored in step S15.

  Next, in response to receiving the designation of the [+ output] icon 112 shown in FIG. 8A through the input I / F 54 (S12: [+ output] icon), the terminal program 65 displays the output selection screen. It is displayed on the display 53 (S16). FIG. 8B is an example of the output selection screen. The output selection screen shown in FIG. 8B includes output icons 131, 132, 133 and extraction instruction icons 134, 135. Then, the terminal program 65 receives a user operation on the output selection screen through the input I / F 54 (S17).

  The output icons 131, 132, and 133 correspond to the MFPs 10A and 10B that can be output devices and the server 80. The details of the output icons 131 to 133 may be the same as those of the input icons 121 to 123. The extraction instruction icon 134 corresponds to an instruction to execute a process of extracting the output device ID from the information image data generated by the scanner 12 of the input device. The extraction instruction icon 135 corresponds to an instruction to execute a process of extracting the output device ID from the information image data generated by the camera 56 of the mobile terminal 50.

  As an example, in response to receiving the designation of the extraction instruction icon 135 via the input I / F 54 (S17: Yes), the terminal program 65 extracts the extraction instruction information “camera QR” corresponding to the designated extraction instruction icon 135. The data is temporarily stored in the data storage area 62B (S18). The designation of the extraction instruction icon 135 is an example of an instruction operation for instructing extraction of the output device ID from the information image data generated by the camera 56. Then, the terminal program 65 causes the display 53 to display the registration screen shown in FIG. 9A (S11). The registration screen shown in FIG. 9A is different from the registration screen shown in FIG. 8A in that the registration screen further includes a [camera QR] icon 115. The [camera QR] icon 115 corresponds to the extraction instruction information “camera QR” temporarily stored in step S18.

  As another example, in response to the designation of the output icon 133 being received through the input I / F 54 (S17: Yes), the terminal program 65 sets the device ID “server C” corresponding to the designated output icon 133 to The data is temporarily stored in the data storage area 62B as the designated device ID (S18). The designation of the output icons 131 to 133 is an example of a user operation for designating an output device. Then, the terminal program 65 displays the registration screen on the display 53 (S11). Although illustration is omitted, the registration screen in this case includes a [server C] icon instead of the [camera QR] icon 115 in FIG. 9A.

  As yet another example, in response to receiving the designation of the extraction instruction icon 134 through the input I / F 54 (S17: Yes), the terminal program 65 extracts the extraction instruction information “scanner” corresponding to the designated extraction instruction icon 134. QR ”is temporarily stored in the data storage area 62B (S18). The designation of the extraction instruction icon 134 is an example of an instruction operation for instructing extraction of the output device ID from the information image data generated by the scanner 12. Then, the terminal program 65 displays the registration screen on the display 53 (S11). Although illustration is omitted, the registration screen in this case includes a [scanner QR] icon instead of the [camera QR] icon 115 in FIG. 9A.

  Next, in response to receiving the designation of the [+ output] icon 112 shown in FIG. 9A through the input I / F 54 (S12 [+ output] icon), the terminal program 65 proceeds to steps S16 to S18. Execute the process. That is, the user can specify a plurality of icons 131 to 135 included in the output selection screen by causing the terminal program 65 to repeatedly execute the processing of steps S16 to S18.

  Further, in response to the designation of the [Registration] icon 113 shown in FIG. 9A being received through the input I / F 54 (S12: [Registration] icon), the terminal program 65 temporarily stores in Steps S15 and S18. The cooperative operation record including the performed information is added to the cooperative operation list (S19). That is, in the above-described example, a cooperative operation record including the input device ID “MFP-A” and the extraction instruction information “camera QR” is added to the cooperative operation list. The order in which the [+ input] icon 111 and the [+ output] icon 112 are specified on the registration screen is not limited to the example described above.

[Cooperation instruction processing]
Further, the terminal program 65 can execute a cooperation instruction process. The coordination instruction process is a process for causing an input device and an output device to execute a coordination operation according to a coordination operation record specified by a user. The details of the cooperation instruction process will be described with reference to FIG.

  First, the terminal program 65 displays an operation selection screen on the display 53 (S21). FIG. 9B is an example of the operation selection screen. The operation selection screen shown in FIG. 9B includes cooperation icons 137 and 138. The cooperation icon 137 corresponds to the cooperation record in the first line shown in FIG. The cooperation icon 137 corresponds to the cooperation record in the second line shown in FIG. Then, the terminal program 65 receives a user operation on the operation selection screen through the input I / F 54 (S22). The process in step S22 is an example of a reception process.

[Process when designating cooperative icon 137]
Here, processing when the cooperation icon 137 is specified will be described. More specifically, the terminal program 65 according to the present embodiment specifies an output device from the document 141 shown in FIG. 10A and outputs target data corresponding to the documents 142 and 143 shown in FIG. The data is generated by the scanner 12 of the multifunction peripheral 10A, and the target data generated by the scanner 12 is output to the output device specified from the document 141.

  In response to receiving the designation of the cooperation icon 137 through the input I / F 54 (S22: Yes), the terminal program 65 reads the cooperation operation record corresponding to the specified cooperation icon 137 from the data storage area 62B. The specification of the cooperation icon 137 corresponding to the cooperation operation record including the extraction instruction information “camera QR” is an example of a second instruction operation. Then, the terminal program 65 determines whether or not the read cooperation operation record includes the extraction instruction information “camera QR” (S23). The process in step S23 is an example of a determination process.

  Next, the terminal program 65 executes the ID acquisition process A in response to determining that the read cooperation operation record includes the extraction instruction information “camera QR” (S23: Yes) (S24). The ID acquisition process A is a process of causing the camera 56 to generate information image data and obtaining an output device ID from the generated information image data. The details of the ID acquisition processing A will be described with reference to FIG. The mobile terminal 50 including the camera 56 is an example of an image reading device.

[ID acquisition processing A]
First, the terminal program 65 activates a camera program (not shown) (S41). Next, the camera program causes the camera 56 to generate image data in response to receiving a user operation for designating the [shooting] icon through the input I / F 54, and provides the generated image data to the terminal program 65. (S42: Yes). The terminal program 65 may execute, for example, an API for activating the camera program as a so-called plug-in, obtain a path of the image data as a return value of the API, and read the image data based on the obtained path. . On the other hand, the camera program terminates the processing without specifying the path of the image data as a return value in response to receiving a user operation for instructing termination of the camera program through the input I / F 54.

  Next, the terminal program 65 determines whether or not the image data acquired from the camera program includes a QR (abbreviation for Quick Response) code (S43). If the document 141 is properly photographed by the camera 56, it is determined that a QR code is included (S43: Yes). The determination as to whether or not the image data contains a QR code can be realized by a known method such as detecting cutout symbols at three corners.

  The QR code can include character string information. That is, the terminal program 65 can extract the character string information by analyzing the QR code by a known method. The QR code according to the present embodiment includes an output device ID as character string information. The QR code is an example of the information image, and the image data including the QR code is an example of the information image data. Note that a specific example of the information image is not limited to the QR code, but may be a barcode or a character string image described in a predetermined format.

  Next, in response to determining that the QR code 141Q is not included in the image data generated by the camera 56 (S43: No), the terminal program 65 does not acquire the path of the image data from the camera program. In response to this, the processing after step S41 is executed again. On the other hand, in response to determining that the image data generated by the camera 56 includes the QR code 141Q (S43: Yes), the terminal program 65 extracts the output device ID from the QR code 141Q (S44). ). Then, the terminal program 65 temporarily stores the output device ID extracted from the QR code 141Q in the data storage area 62B. In the present embodiment, it is assumed that the output device ID “server C” has been extracted. The process in step S44 is an example of an extraction process.

  Next, returning to FIG. 5, the terminal program 65 acquires the input device ID “MFP-A” from the read cooperation operation record. Then, the terminal program 65 transmits the input instruction information to the multifunction peripheral 10A identified by the input device ID “MFP-A” through the communication I / F 55 (S25). The input instruction information is information for instructing the multifunction peripheral 10A as an input device to execute an input operation. That is, the input instruction information according to the present embodiment is information for instructing the scanner 12 of the multifunction peripheral 10A to execute a scanning operation. The process in step S25 is an example of an input instruction process.

  Although illustration is omitted, the device program 35 of the multifunction peripheral 10A receives input instruction information from the portable terminal 50 through the communication I / F 25. Then, the device program 35 causes the multifunction peripheral 10A to execute an input operation according to the received input instruction information. More specifically, the scanner 12 of the multifunction peripheral 10A reads images recorded on the originals 142 and 143 set on, for example, an ADF (Auto Document Feeder) and generates scan data indicating the images. Note that the scan data generated here includes two page data corresponding to the originals 142 and 143, respectively. The scan data is an example of target data to be transmitted to the mobile terminal 50. Then, the device program 35 transmits the scan data to the portable terminal 50 through the communication I / F 25 as a response to the input instruction information.

  Next, the terminal program 65 of the mobile terminal 50 receives the scan data, which is a response to the input instruction information, as target data from the multifunction peripheral 10A via the communication I / F 25 (S26). Then, the terminal program 65 temporarily stores the received scan data in the data storage area 62B. Next, the terminal program 65 determines whether or not the read cooperative operation record includes the extraction instruction information “scanner QR” (S27). The process in step S26 is an example of a reception process, and the process in step S27 is an example of a determination process. Next, the terminal program 65 skips the processing of steps S28 to S30 in response to determining that the read instruction record does not include the extraction instruction information “scanner QR” (S27: No). The processing of steps S28 to S30 will be described later.

  Then, the terminal program 65 transmits the output instruction information to the server 80 identified by the output device ID “server C” extracted in step S44 via the communication I / F 55 (S31). The output instruction information includes the scan data received in step S26 as target data. The output instruction information is information for instructing execution of an output operation for outputting target data. That is, the output instruction information according to the present embodiment is information for instructing the server 80 to store the target data in the server memory. The process in step S31 is an example of an output instruction process.

  On the other hand, although not shown, the server 80 receives the output instruction information from the mobile terminal 50. Then, the server 80 stores the target data included in the output instruction information in the server memory. The mobile terminal 50 and the server 80 may communicate with each other, for example, according to a procedure based on HTTP (HyperText Transfer Protocol). That is, in step S31, the terminal program 65 may transmit the output instruction information to the server 80 as an HTTP request.

[Process at the time of designating the cooperation icon 138]
Next, processing when the cooperation icon 138 is specified will be described. More specifically, the terminal program 65 according to the present embodiment converts the target data corresponding to the originals 141 to 143 shown in FIG. 10A or the originals 151 to 153 shown in FIG. The output device is specified from the target data generated by the scanner 12, and the target data generated by the scanner 12 is output to the specified output device. It should be noted that a detailed description of the common points with the case where the cooperation icon 138 is specified is omitted, and the description will focus on the differences.

  In response to receiving the designation of the cooperation icon 138 through the input I / F 54 (S22: Yes), the terminal program 65 reads the cooperation operation record corresponding to the specified cooperation icon 138 from the data storage area 62B. The specification of the cooperation icon 138 corresponding to the cooperation operation record including the extraction instruction information “scanner QR” is an example of a first instruction operation. Then, the terminal program 65 does not execute the ID acquisition processing A (S24) in response to determining that the read instruction record does not include the extraction instruction information “camera QR” (S23: No). , And performs the processing from step S25.

  Next, the terminal program 65 obtains the input device ID “MFP-B” from the read cooperation operation record. Then, the terminal program 65 transmits the input instruction information to the MFP 10B identified by the input device ID “MFP-B” through the communication I / F 55 (S25). Then, the terminal program 65 receives the scan data from the multifunction peripheral 10B via the communication I / F 25 as a response to the input instruction information (S26). Then, the terminal program 65 temporarily stores the received scan data in the data storage area 62B.

  As an example, scan data obtained when the scanners 12 read the originals 141 to 143 include a plurality of page data corresponding to the originals 141 to 143 (hereinafter, page data corresponding to the original xxx is referred to as “page data xxx”). Yes.) Although the detailed description is omitted in the section of “Processing at the time of specifying the cooperation icon 137”, the terminal program 65 determines in step S26 that each of the page data 141 to 143 is stored as shown in FIG. Add multiple page records, including one, to the page list. As another example, the scan data obtained when the scanner 12 reads the originals 151 to 153 includes a plurality of page data 151 to 153. Thus, the terminal program 65 adds, to the page list, a plurality of page records each including one of the page data 151 to 153, for example, as shown in FIG.

  Further, as shown in FIGS. 3B and 3C, the terminal program 65 includes the output device ID “server C” included in the read cooperative operation record as the first output device ID in the page record. On the other hand, if the output device ID is not included in the read cooperative operation record, this process is skipped. Further, the page data 141, 151, 152 include QR codes 141Q, 151Q, 152Q. That is, the scan data generated by the scanner 12 includes page data and information image data. The multifunction peripheral 10 including the scanner 12 is an example of a device that also serves as an input device and an image reading device.

  Next, the terminal program 65 executes the ID acquisition processing B in response to determining that the read instruction record includes the extraction instruction information “scanner QR” (S27: Yes) (S28). The ID acquisition process B is a process of acquiring an output device ID from information image data generated by an input device. Referring to FIG. 6B, details of ID acquisition processing B will be described by taking as an example a case where scan data corresponding to originals 141 to 143 is received and a case where scan data corresponding to originals 151 to 153 are received. Will be described.

[ID Acquisition Processing B for Scan Data of Documents 141 to 143]
The terminal program 65 determines whether the page data 141 includes a QR code (S51). Next, in response to determining that the page data 141 includes the QR code 141Q (S51: Yes), the terminal program 65 extracts the output device ID and the range information from the QR code 141Q (S52). . Then, the terminal program 65 temporarily stores the output device ID and the range information in the data storage area 62B in association with each other. In the present embodiment, it is assumed that the output device ID “MFP-A” and the range information “all pages” have been extracted. The process in step S52 is an example of an extraction process.

  The range information is information for indicating any one of the plurality of page data. More specifically, “all pages” indicating all page data included in the scan data or “current page” indicating only page data including a QR code from which the range information is extracted is set as the range information. Alternatively, information indicating a part of a plurality of page data (for example, “1 to 3 pages”) may be set in the range information.

  Next, the terminal program 65 determines the set value of the range information extracted in step S52 (S53). Then, in response to determining that “all pages” is set in the range information (S53: all pages), the terminal program 65 associates the range information with the range information as shown in FIG. The obtained output device ID “MFP-A” is associated with all the page data 141 to 143 included in the scan data as the second output device ID.

  Further, the terminal program 65 excludes the page data 141 including the QR code 141Q from the target data (S55). That is, for example, the terminal program 65 deletes a page record including the page data 141 from the page list, or adds a deletion flag to the page record including the page data 141. The process in step S55 is an example of a first exclusion process. Then, the terminal program 65 ends the ID acquisition processing B without executing the processing in step S51 for the page data 142 and 143.

  Next, returning to FIG. 5, the terminal program 65 determines whether or not the output device ID is associated with all the page data (S29). Then, in response to determining that the output device ID is not associated with at least one page data (S29: No), the terminal program 65 executes the ID acquisition process A (S30). As another example, in step S30, the terminal program 65 may cause the display 53 to display the output selection screen illustrated in FIG. 8 and accept a user operation for designating the output icons 131 to 133 through the input I / F 54.

  Then, the terminal program 65 associates the output device ID extracted in step S44 or the output device ID specified through the output selection screen with the page data not associated with the output device ID. On the other hand, the terminal program 65 skips the processing of step S30 in response to determining that the output device ID is associated with all the page data (S29: Yes).

  Next, the terminal program 65 executes an output instruction process according to the page list shown in FIG. 3B (S31). More specifically, the terminal program 65 communicates with the server 80 identified by the first device ID “server C” and the MFP 10A identified by the second device ID “MFP-A” via the communication I / F 55. Transmit the output instruction information. The output instruction information transmitted to the server 80 includes, as target data, page data 142 and 143 associated with the first device ID “server C”. The output instruction information transmitted to the multifunction peripheral 10A includes page data 142 and 143 associated with the second device ID “MFP-A” as target data. On the other hand, the page data 141 excluded from the target data in step S55 is not included in any output instruction information.

  On the other hand, although not shown, the server 80 receives the output instruction information from the mobile terminal 50. Then, the server 80 stores the target data included in the output instruction information in the server memory. Similarly, the device program 35 of the multifunction peripheral 10A receives the output instruction information from the mobile terminal 50 through the communication I / F 25. Then, the device program 35 causes the printer 11 to execute a printing operation on the target data included in the output instruction information.

[ID acquisition processing B for scan data of originals 151 to 153]
Upon determining that the page data 151 includes the QR code 151Q (S51: Yes), the terminal program 65 extracts the output device ID and the range information from the QR code 151Q (S52). In the present embodiment, it is assumed that the output device ID “MFP-A” and the range information “current page” have been extracted.

  Next, in response to determining that “current page” is set in the range information (S53: current page), the terminal program 65 responds to the range information as shown in FIG. The assigned output device ID “MFP-A” is associated with the page data 151 including the QR code 151Q as the second output device ID (S56). Further, the terminal program 65 excludes the QR code 151Q from the page data 151 (S57). The terminal program 65, for example, paints the position of the QR code 151Q with the background color (for example, white) of the document 151. The process in step S57 is an example of a second exclusion process.

  Further, in response to determining that the page data 152 includes the QR code 152Q (S51: Yes), the terminal program 65 outputs the output device ID “MFP-B” and the range information “current” from the QR code 152Q. Page "is extracted (S52). Then, as shown in FIG. 3C, the terminal program 65 associates the extracted output device ID “MFP-B” with the page data 152 as the second output device ID (S56), The code 152Q is excluded (S57).

  Next, in response to determining that the QR code is not included in the page data 153 (S51: No), the terminal program 65 skips the processing of steps S52 to S57. That is, as shown in FIG. 3C, the page data 153 is not associated with the second output device ID. Then, the terminal program 65 ends the ID acquisition processing B in response to the end of the processing for all the page data 151 to 153 included in the scan data (S58: Yes).

  Next, the terminal program 65 executes the processing after step S29. Steps S29 and S30 will not be described again. Then, in step S31, the terminal program 65 executes an output instruction process according to the page list shown in FIG. More specifically, the terminal program 65 includes the server 80 identified by the first device ID “server C” and the MFPs 10A and 10B identified by the second device IDs “MFP-A” and “MFP-B”. Then, the output instruction information is transmitted through the communication I / F 55. The output instruction information transmitted to the server 80 includes, as target data, page data 151 to 153 associated with the first device ID “server C”. The output instruction information transmitted to the multifunction peripheral 10A includes, as target data, page data 151 associated with the second device ID “MFP-A”. The output instruction information transmitted to the MFP 10B includes, as target data, page data 152 associated with the second device ID “MFP-B”.

  On the other hand, although not shown, the server 80 receives the output instruction information from the mobile terminal 50. Then, the server 80 stores the target data included in the output instruction information in the server memory. Similarly, the device programs 35 of the MFPs 10A and 10B receive the output instruction information from the portable terminal 50 through the communication I / F 25. Then, the device program 35 of the multifunction peripherals 10A and 10B causes the printer 11 to execute a printing operation on the target data included in the output instruction information.

[Operation and effect of the present embodiment]
According to the above embodiment, it is possible to cause the input device identified by the input device ID included in the cooperation operation record and the output device identified by the output device ID extracted from the information image data to execute the cooperation operation. it can. That is, the output device can be easily switched by the image reading device generating the information image data including the desired output device ID. In addition, since both the output device ID and the extraction instruction information can be included in the cooperative operation record, the output operation can be performed between the output device that is fixedly designated and the output device that can be dynamically changed through the information image data. Can be executed.

  Further, according to the above embodiment, the user can specify which of the scanner 12 and the camera 56 to generate the information image data through the extraction instruction icons 134 and 135 during the registration process. As a result, information image data can be obtained by an appropriate method in accordance with a user's usage mode described later. However, information image data may be acquired from only one of the scanner 12 and the camera 56.

  As a first mode of use, consider a process in which a document held by a user is read by a scanner 12 and scan data generated by the scanner 12 is stored in any of a plurality of servers. In such a case, a plurality of manuscripts each having a QR code recorded thereon are prepared in advance near the multifunction peripheral 10. The QR code recorded on each document includes any one of the device IDs of the plurality of servers. The user, for example, causes the scanner 12 to collectively read the original 141 corresponding to the desired server 80 and the originals 142 and 143 on which the images to be stored in the server 80 are recorded, so that the page data 142 and 143 are stored in the server 80. Can be stored.

  That is, according to this method, it is possible to extract the output device ID from one of the page data and make the output device identified by the extracted output device ID execute the output operation for all the page data. However, the page data 141 in this case is data that does not need to be originally subjected to an output operation. Therefore, as in the above embodiment, the page data 141 including the information image data is excluded from the target data, and the output device performs the output operation only on the target data 142 and 143 after the page data 141 is excluded. It is desirable.

  As a second use mode, consider a process in which a plurality of documents owned by a user are read by a scanner 12, and an output operation for each of a plurality of page data generated by the scanner 12 is executed by a different output device. In such a case, a plurality of stickers on each of which a QR code is recorded are prepared near the multifunction peripheral 10 in advance. The QR code recorded on each sticker includes a device ID of one of the plurality of output devices. The user, for example, affixes a sticker to which the desired QR codes 151Q and 152Q are added to the originals 151 and 152 and causes the scanner 12 to read the originals 151 to 153 together, thereby causing the server 80 to read the page data 151 to 153. The MFP 10A can cause the MFP 10A to execute the printing operation on the page data 151 and execute the printing operation on the page data 152.

  That is, according to this method, it is possible to cause different output devices to execute an output operation for a plurality of originals 151 to 153 read by the scanner 12 collectively. In other words, the output operation for only the page data 151 and 152 from which the output device ID is extracted is performed by the output device IDs “MFP-A” and “MFP-B” extracted from the page data 151 and 152. The identified output device can be executed. However, the QR codes 151Q and 152Q included in the page data 151 and 152 are data that does not need to be originally subjected to an output operation. Therefore, it is desirable to cause the output device to execute an output operation on the page data 151 and 152 after excluding the information image data as in the above embodiment.

  In the above-described first and second usage modes, the information image data and the target data are received from the input device by causing the scanner 12 to read the originals 141, 151, and 152 including the QR codes 141Q, 151Q, and 152Q. be able to. This eliminates the need for an independent process for acquiring information image data. Further, according to the above-described embodiment, when the output device ID cannot be obtained in the ID obtaining process B, the ID obtaining process A is executed. For example, in the first use mode, when only the originals 142 and 143 are read by the scanner 12, the camera 56 is prompted to photograph the original 141. This eliminates the need to restart the process from the beginning even if the process is executed in an incorrect procedure.

  As a third mode of use, consider a process in which one of the multiple MFPs 10A and 10B executes a print operation for specific data stored in the server 80. In this case, a sticker on which a QR code including each device ID is recorded is attached to each of the MFPs 10A and 10B. Then, the user can cause the multifunction peripheral 10A to execute a print operation on the data stored in the server 80 by, for example, photographing the sticker attached to the multifunction peripheral 10A by the camera 56. That is, when the information data cannot be included in the target data in advance as in the third usage mode, it is desirable that the camera 56 generate the information image data.

  In the above embodiment, the example of the cooperative operation record including at least one of the output device ID and the extraction instruction information has been described, but the data structure of the cooperative operation record is not limited to this. As another example, all the cooperation operation records include the input device ID and the output operation ID, and do not need to include the extraction instruction information. Then, the terminal program 65 may always execute at least one of the ID acquisition processing A and the ID acquisition processing B in the cooperation instruction processing.

  Then, in response to the fact that the output device ID has not been acquired in the ID acquisition process A or the ID acquisition process B, the terminal program 65 sends a communication I / O to the output device identified by the output device ID included in the cooperation record. What is necessary is just to transmit output instruction information through F55. This process is an example of a first output instruction process. Further, in response to the acquisition of the output device ID in the ID acquisition process A or the ID acquisition process B, the terminal program 65 outputs the output device identified by the output device ID included in the cooperative operation record and the extraction process (S44, The output instruction information may be transmitted to the output device identified by the output device ID extracted in S52) via the communication I / F 55. This process is an example of a second output instruction process. According to the above-described processing, when an input device and an output device that are fixedly designated perform a cooperative operation, temporary addition of an output device can be realized by a simple operation.

  Further, the combination of the input device and the output device is not limited to the above-described example. As an example, the multifunction peripheral 10A may be specified as an input device, and the multifunction peripheral 10B may be specified as an output device. As another example, a first server (not shown) may be designated as an input device, and a second server (not shown) may be designated as an output device. Further, specific examples of the input operation and the output operation are not limited to the above-described examples. For example, an operation of facsimile transmitting target data to a facsimile device designated as an output device and an operation of transmitting an e-mail attached with the target data to a mail server designated as an output device are examples of output operations.

  Further, in the multifunction peripheral 10 and the portable terminal 50 of the above-described embodiment, the various programs stored in the program storage areas 32A and 62A of the memories 32 and 62 are executed by the CPUs 31 and 61, so that the control unit of the present invention The example in which each processing to be executed is realized has been described. However, the configuration of the control unit is not limited to this, and a part or all of the control unit may be implemented by hardware such as an integrated circuit (also referred to as an integrated circuit (IC)).

  Furthermore, the present invention can be realized not only as the multifunction peripheral 10 and the portable terminal 50 but also as a program that causes the multifunction peripheral 10 and the mobile terminal 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include a storage unit mounted on a server that can be connected to the MFP 10 and the portable terminal 50 through a communication network, in addition to a CD-ROM, a DVD-ROM, and the like. The program stored in the storage unit of the server may be distributed as information or a signal indicating the program through a communication network such as the Internet.

10 Multifunction machine 11 Printer 12 Scanner 23, 53 Display 24, 54 Input I / F
25, 55 ... Communication I / F
31, 61 ... CPU
32, 62 memory 35 device program 50 portable terminal 56 camera 65 terminal program

Claims (15)

A program readable by a mobile terminal including a terminal memory, an input interface, a communication interface, and a camera ,
The program causes the portable terminal to execute a registration process of storing, in the terminal memory, cooperative operation information including input device information and at least one of output device information and extraction instruction information, and the input device information includes the input device information. The output device information is information for identifying the input device specified through the interface, the output device information is information for identifying the output device specified through the input interface, the extraction instruction information, from the information image data Corresponding to receiving an instruction operation for instructing extraction of the output device information through the input interface,
The program is
A designation operation for designating one of the cooperative operation information stored in the terminal memory, and a reception process of receiving a first instruction operation or a second instruction operation through the input interface;
The input device identified by the input device information included in the specified cooperative operation information, causing the mobile terminal to execute an input instruction process of transmitting input instruction information through the communication interface, wherein the input instruction information is , What information der for instructing the execution of the input operation for inputting the target data used for cooperative operation with the output device to the input device, and the target data by scanning an image recorded on a document A scan operation for generating scan data including the information image data is information for causing a scanner to execute as the input operation, the scanner is the input device,
The program is
A determining process of determining whether or not the specified cooperative operation information includes the extraction instruction information;
When the first instruction operation is received in the reception processing in response to the determination processing determining that the extraction instruction information is included, the output is performed from the information image data generated by the scanner. When the device information is extracted and the second instruction operation is received in the reception process, the output device information is extracted from the information image data generated by the camera that activated the camera and captured the object. And the extraction process to be executed by the portable terminal,
The program causes the portable terminal to execute an output instruction process of transmitting output instruction information through the communication interface to the output device identified by the output device information extracted in the extraction process, and the output instruction information includes: A program as information for instructing execution of an output operation for outputting the target data input by the scanner. The program is
As a response to the input instruction information, the mobile terminal executes the reception process of receiving the scan data including a plurality of page data each corresponding to one page of a multi-page document from the scanner through the communication interface,
In the extraction processing, the output device information and range information associated with the output device information are extracted from the scan data, and the range information indicates a part of the plurality of page data. Information for
In the output instruction processing, the program outputs the output instruction information for executing the output operation targeting only the page data indicated by the range information, the output device information associated with the range information. in the output device identified, the program according to claim 1 for transmitting through the communication interface. The program is
As a response to the input instruction information, the mobile terminal executes the reception process of receiving the scan data including a plurality of page data each corresponding to one page of a multi-page document from the scanner through the communication interface,
In the extracting process, the output device information is extracted from one of the page data,
In the output instruction process, the output instruction information for executing the output operation on all the page data included in the scan data in the output instruction process is the output device information extracted in the extraction process. the output device identified, the program according to claim 1 or 2 transmits through the communication interface. The program, prior to the output instruction process, performs a first exclusion process of excluding, from the plurality of page data received in the reception process, the page data including the information image data from a target of the output operation. The program according to claim 3 , which is executed by a portable terminal. The program,
Prior Symbol extraction process to extract the output device information from the page data,
In the output instruction process, the output instruction information for performing the output operation only on the page data from which the output device information is extracted in the extraction process is identified by the output device information. The program according to claim 2 , wherein the program is transmitted to an output device through the communication interface. The program according to claim 5 , wherein the program causes the mobile terminal to execute a second exclusion process for excluding the information image data from the page data from which the output instruction information has been extracted, prior to the output instruction process. The program accepts the first instruction operation in said receiving process, and in the extraction process when the do not contain the information image data to the target data, the taken a and activating the camera the object program according to any one of claims 1 to 6 from the information image data generated by the camera to extract the output device information. A terminal memory, an input interface, a program readable by a mobile terminal having a communication interface,
The program causes the mobile terminal to execute a registration process of storing cooperative operation information including input device information and output device information in the terminal memory, and the input device information includes an input device specified through the input interface. The output device information is information for identifying an output device specified through the input interface,
The program is
A receiving process of receiving, via the input interface, a designation operation for designating one of the cooperative operation information stored in the terminal memory;
The input device identified by the input device information included in the specified cooperative operation information, causing the mobile terminal to execute an input instruction process of transmitting input instruction information through the communication interface, wherein the input instruction information is Information for instructing execution of an input operation for inputting the target data used for the cooperative operation with the output device to the input device,
The program,
An extraction process of extracting the output device information from the information image data is executed to the portable terminal, the information image data is image data that the image reading device is generated by reading an image recorded on the object,
The program, in response to not extracted the output device information by the extraction process, the output device identified by the output device information is included in the specified work together information, through the communication interface a first output instruction processing for transmitting the output instruction information is executed to the portable terminal, wherein the output instruction information is information for instructing the execution of the output operation to output the object data inputted by said input device Yes,
The program, in response to extracting the output device information in the extraction process, to each of the output device identified by the output device information and the extracted output device information included in the specified cooperative operation information A program for causing the mobile terminal to execute a second output instruction process of transmitting output instruction information through the communication interface. The portable terminal includes a camera that functions as the image reading device,
The program, in the extraction process, a program according to claim 8 for extracting the output device information from the information image data generated by the camera that photographed and activating the camera the object.   The program includes, in the output instruction process when the specified cooperative operation information includes the output device information, the output device identified by the output device information included in the cooperative operation information; 10. The program according to claim 1, further comprising transmitting the target data through The program is
In the extraction processing, the output device information in the form of a URL (Uniform Resource Locator) is extracted,
The program according to any one of claims 1 to 10 , wherein in the output instruction processing, the output instruction information is transmitted by HTTP (HyperText Transfer Protocol) via the communication interface.   A mobile terminal including a terminal memory, an input interface, a communication interface, a camera, and a computer,
  The computer is
  Input device information, executes a registration process of storing the cooperation operation information including at least one of output device information and extraction instruction information in the terminal memory, the input device information, the input device specified through the input interface The output device information is information for identifying, the output device information is information for identifying the output device specified through the input interface, the extraction instruction information, extraction of the output device information from information image data In response to receiving an instruction operation to instruct through the input interface,
  A designation operation for designating one of the cooperative operation information stored in the terminal memory, and a reception process of receiving a first instruction operation or a second instruction operation through the input interface;
  The input device identified by the input device information included in the specified cooperative operation information, an input instruction process of transmitting input instruction information through the communication interface is executed, and the input instruction information is output from the output device. And information for instructing the input device to execute an input operation for inputting the target data used in the cooperation operation with the target data and the information image data by scanning an image recorded on a document. A scan operation to generate scan data including, is information for causing the scanner to execute as the input operation, the scanner is the input device,
  A determining process of determining whether or not the specified cooperative operation information includes the extraction instruction information;
  When the first instruction operation is received in the reception processing in response to the determination processing determining that the extraction instruction information is included, the output is performed from the information image data generated by the scanner. When the device information is extracted and the second instruction operation is received in the reception process, the output device information is extracted from the information image data generated by the camera that activated the camera and captured the object. Extraction processing,
  To the output device identified by the output device information extracted in the extraction process, an output instruction process of transmitting output instruction information through the communication interface, and the output instruction information is input by the scanner. A mobile terminal, which is information for instructing execution of an output operation for outputting the target data.   Terminal memory, input interface, and communication interface. A mobile terminal comprising: a computer;
  The computer is
  An input device information and a registration process for storing cooperative operation information including output device information in the terminal memory are executed, and the input device information is information for identifying an input device specified through the input interface. The output device information is information for identifying an output device specified through the input interface,
  A receiving process of receiving, via the input interface, a designation operation for designating one of the cooperative operation information stored in the terminal memory;
  The input device identified by the input device information included in the specified cooperative operation information, an input instruction process of transmitting input instruction information through the communication interface is executed, and the input instruction information is output from the output device. It is information for instructing execution of an input operation for inputting the target data used for the cooperative operation to the input device,
  Performing an extraction process of extracting the output device information from the information image data, wherein the information image data is image data generated by reading an image recorded on an object by an image reading device,
  In response to not extracting the output device information in the extraction process, transmitting output instruction information to the output device identified by the output device information included in the specified cooperative operation information through the communication interface Performing the first output instruction process, the output instruction information is information for instructing execution of an output operation of outputting the target data input by the input device,
  In response to the extraction of the output device information in the extraction processing, the communication interface is provided for each of the output devices identified by the output device information and the extracted output device information included in the specified cooperative operation information. A portable terminal that executes a second output instruction process of transmitting output instruction information through the mobile terminal.   A system including an input device, a mobile terminal, and an output device,
  The mobile terminal includes a terminal memory, an input interface, a communication interface, a camera, and a computer,
  The computer executes a registration process of storing in the terminal memory cooperative operation information including input device information and at least one of output device information and extraction instruction information, and the input device information is specified through the input interface. The output device information is information for identifying the output device specified through the input interface, and the extraction instruction information is the output device from information image data. Corresponding to receiving an instruction operation for instructing information extraction through the input interface,
  The computer is
  A designation operation for designating one of the cooperative operation information stored in the terminal memory, and a reception process of receiving a first instruction operation or a second instruction operation through the input interface;
  The input device identified by the input device information included in the specified cooperative operation information, an input instruction process of transmitting input instruction information through the communication interface is executed, and the input instruction information is output from the output device. It is information for instructing execution of an input operation for inputting the target data used for the cooperative operation to the input device,
  The input device is a scanner that performs a scan operation of generating scan data including the target data and the information image data by scanning an image recorded on a document according to the input instruction information. ,
  The computer is
  A determining process of determining whether or not the specified cooperative operation information includes the extraction instruction information;
  When the first instruction operation is received in the reception processing in response to the determination processing determining that the extraction instruction information is included, the scan data included in the scan data generated by the scanner is used. Extracting the output device information from the information image data, and when the second instruction operation is received in the reception processing, activates the camera, and from the information image data generated by the camera that has photographed the target object An extraction process for extracting the output device information;
  To the output device identified by the output device information extracted in the extraction process, an output instruction process of transmitting output instruction information through the communication interface, and the output instruction information is input by the scanner. Information for instructing execution of an output operation for outputting the target data,
  A system that performs an output operation of outputting the target data input by the scanner according to the output instruction information.   A system including an input device, a mobile terminal, and an output device,
  The portable terminal has a terminal memory, an input interface, and a communication interface. And a computer,
  The computer is
  An input device information and a registration process for storing cooperative operation information including output device information in the terminal memory are executed, and the input device information is information for identifying an input device specified through the input interface. The output device information is information for identifying an output device specified through the input interface,
  A receiving process of receiving, via the input interface, a designation operation for designating one of the cooperative operation information stored in the terminal memory;
  The input device identified by the input device information included in the specified cooperative operation information, an input instruction process of transmitting input instruction information through the communication interface is executed, and the input instruction information is output from the output device. It is information for instructing execution of an input operation for inputting the target data used for the cooperative operation to the input device,
  The input device generates the target data according to the input instruction information,
  Performing an extraction process of extracting the output device information from the information image data, wherein the information image data is image data generated by reading an image recorded on an object by an image reading device,
  In response to not extracting the output device information in the extraction process, transmitting output instruction information to the output device identified by the output device information included in the specified cooperative operation information through the communication interface Performing the first output instruction process, the output instruction information is information for instructing execution of an output operation of outputting the target data input by the input device,
  In response to the extraction of the output device information in the extraction process, the output device information included in the specified cooperative operation information and the output device identified by the extracted output device information, the communication interface Performing a second output instruction process of transmitting output instruction information through, the output instruction information is information for instructing execution of an output operation of outputting the target data input by the input device,
  A system that executes an output operation of outputting the target data input by the input device according to the output instruction information.