JP6724386B2 - Program, mobile terminal, and system - Google Patents

Description

The present invention relates to a program of a mobile terminal that causes an input device and an output device designated by a user to execute a cooperative operation.

Patent Literature 1 describes a program of a mobile terminal in which a combination of an input device and an output device designated by a user is registered in advance and the input device and the output device of the registered combination execute a cooperative operation. .. The cooperative operation means, for example, that the mobile terminal receives the target data from the input device that has performed the input operation, and the mobile terminal causes the output device to perform the output operation for the received target data. According to the program having the above-described configuration, it is possible to easily execute the repeatedly executed routine cooperative operation.

Japanese Unexamined Patent Publication No. 2015-012518

In the program having the above configuration, it is possible to register the execution condition of the cooperative operation together with the combination of the input device and the output device. However, when it is desired to temporarily execute the cooperative operation under different execution conditions, the registered execution condition must be changed before starting the cooperative operation, which causes a problem that the user operation becomes complicated.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a program for a mobile terminal that causes a registered input device and output device to execute a cooperative operation, and to facilitate execution conditions for the cooperative operation. To provide a modifiable program.

The program described in this specification can be read by a mobile terminal including a terminal memory, an input interface, and a communication interface. The program causes the portable terminal to execute a registration process for storing the cooperation operation information including the input device information and the output device information in the terminal memory. The input device information is information for identifying the input device designated through the input interface. The output device information is information for identifying the output device designated through the input interface. The program is identified by a reception process of receiving a designation operation for designating one of the cooperation operation information stored in the terminal memory through the input interface, and the input device information included in the specified cooperation operation information. The mobile terminal executes the input instruction process of transmitting the input instruction information through the communication interface to the input device. The input instruction information is information for instructing execution of an input operation that causes the input device to input target data to be transmitted to the mobile terminal. The program causes the mobile terminal to execute a reception process of receiving the target data from the input device through the communication interface as a response to the input instruction information and an extraction process of extracting condition information from the information image data. The information image data is image data generated by an image reading device reading an image recorded on an object. The condition information is information indicating an execution condition of an output operation for outputting the target data. The program causes the portable device to execute an output instruction process of transmitting output instruction information through the communication interface to the output device identified by the output device information included in the specified cooperation operation information. The output instruction information is information for instructing the execution of the output operation according to the execution condition indicated by the condition information extracted by the extraction processing, including the target data received by the reception processing.

According to the above configuration, the output device can be caused to execute the output operation according to the execution condition indicated by the condition information extracted from the information image data. That is, the execution condition of the output operation can be easily switched by the information reading device generating the information image data including the desired condition information.

FIG. 1 is a schematic diagram of a system 100 according to this embodiment. 2A is a block diagram of the multi-function device 10, and FIG. 2B is a block diagram of the mobile terminal 50. 3A and 3B are examples of data stored in the data storage area 62B. FIG. 3A is a linked operation list, FIG. 3B is a page list corresponding to the originals 141 to 143, and FIG. 3C is originals 151 to 153. Shows a page list corresponding to. FIG. 4 is a flowchart of the registration process. FIG. 5 is a flowchart of the cooperation instruction process. 6A is a flowchart of the condition information acquisition process A, and FIG. 6B is a flowchart of the condition information acquisition process B. 7A and 7B are display examples of the display 53, where FIG. 7A shows a registration screen before an input device and an output device are designated, and FIG. 7B shows an input selection screen. 8A and 8B show display examples of the display 53. FIG. 8A shows a registration screen after the input device is designated, and FIG. 8B shows an output selection screen. 9A and 9B show display examples of the display 53. FIG. 9A shows a registration screen after the input device and the output device are designated, and FIG. 9B shows an operation selection screen. 10A and 10B show examples of originals to be read by the scanner 12. FIG. 10A shows originals 141 to 143 in which the QR code (registered trademark) 141Q is added only to the front page, and FIG. Documents 151 to 153 to which codes 151Q and 152Q are added are shown.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be appropriately changed without changing the gist of the present invention. For example, the execution order of each process described below can be appropriately changed without changing the gist of the present invention.

FIG. 1 is a schematic diagram of a system 100 according to this embodiment. The system 100 shown in FIG. 1 is composed of multi-function peripherals 10A and 10B (hereinafter, these may be collectively referred to as “multi-function peripheral 10”), a mobile terminal 50, and a server 80. .. The multifunction device 10, the mobile terminal 50, and the server 80 can communicate with each other via a communication network. The specific example of the communication network is not particularly limited, but may be, for example, the Internet 101, a wired LAN (abbreviation of Local Area Network), a wireless LAN 102, or a combination thereof.

The multifunction device 10 and the portable terminal 50 belong to the wireless LAN 102. That is, the multi-function device 10 and the portable terminal 50 can communicate with each other via an access point (not shown) of the wireless LAN 102. The wireless LAN 102 is connected to the Internet 101 via the router 102A. Further, the server 80 is connected to the internet 101. That is, the multi-function device 10 and the portable terminal 50 can communicate with the server 80 from the router 102A via the Internet 101.

[Complex machine 10]
As shown in FIG. 2A, the multifunction device 10 includes a printer 11, a scanner 12, a display 23, an input I/F (abbreviation of InterFace) 24, a communication I/F 25, and a CPU (Central Processing). Mainly includes an abbreviation of Unit 31, a memory 32, and a communication bus 33. The constituent elements of the multi-function peripheral 10 are connected to each other through the communication bus 33. The configurations of the multifunction peripherals 10A and 10B may be the same or different.

[Printer 11, Scanner 12]
The printer 11 executes a recording operation for recording an image represented by image data on a sheet. As the recording method of the printer 11, a known method such as an inkjet method or an electrophotographic method can be adopted. The scanner 12 performs a reading operation of reading an image recorded on a document and generating image data. The multifunction device 10 may further include a FAX unit capable of executing a FAX transmission operation and a FAX reception operation of transmitting and receiving image data according to the FAX protocol. The multifunction device 10 may include only one of the printer 11 and the scanner 12 and may not include the other.

[Display 23]
The display 23 has a display surface for displaying various information. As the display 23, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be adopted.

[Input I/F 24]
The input I/F 24 is a user interface that receives an input operation by the user. Specifically, the input I/F 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Furthermore, the input I/F 24 may include a film-shaped touch sensor that is superimposed on the display surface of the display 23. That is, the display 23 may be configured as a touch panel display. The operation of designating an object displayed on the display surface of the display 23 and the operation of inputting a character string or a number string are examples of input operations.

The "object" refers to an image that can be designated by the user operating the input I/F 24. As an example, the object may be a character string displayed on the display 23, an icon, a button, a link, or the like. The object may be designated by pressing the direction key of the input I/F 24 or the enter button. When the input I/F 24 is a touch panel, the object displayed on the display 23 may be designated by touching the display position.

The input I/F 24, which is realized as a touch panel, outputs position information indicating the position touched by the user on the display surface. It should be noted that the term “touch” in this specification includes all operations of bringing the input medium into contact with the display surface. That is, a tap operation for separating the touched input medium from the display surface within a predetermined time, a long touch operation, a slide operation for sliding the touched input medium on the display surface, a flick operation, a pinch-in operation, a pinch-out operation, etc. Is an example.

Further, even if the input medium does not touch the display surface, bringing the input medium close to a position where the distance between the input medium and the display surface is very small may be included in the concept of “touch”. Furthermore, the input medium may be a user's finger, a touch pen, or the like. The user operation of tapping the position of the icon displayed on the display 53 is an example of a specifying operation for specifying the icon.

[Communication I/F 25]
The communication I/F 25 is an interface capable of communicating with an external device via a communication network. That is, the multifunction peripheral 10 outputs various information to the external device through the communication I/F 25 and receives various information from the external device through the communication I/F 25. The specific communication procedure of the communication I/F 25 is not particularly limited, but Wi-Fi (registered trademark of Wi-Fi Alliance) can be adopted, for example.

[CPU 31]
The CPU 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires various programs to be described later from the memory 32 and executes them based on various information output from the input I/F 24, various information acquired from an external device through the communication I/F 25, and the like. The memory 32 is an example of a device memory, and the CPU 31 and the memory 32 configure an example of a control unit.

[Memory 32]
The memory 32 has a program storage area 32A and a data storage area 32B. An OS (abbreviation of Operating System) 34 and a device program 35 are stored in the program storage area 32A. The device program 35 may be a single program or an aggregate of a plurality of programs. The same applies to other programs. The data storage area 32B stores data or information required to execute the device program 35.

It should be noted that "data" and "information" in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by a computer without considering the meaning of each bit. On the other hand, “information” refers to information in which the operation of the computer branches depending on the meaning of each bit. Further, the “instruction” is a control signal for prompting the destination device to perform the next operation, and may include information, or have a property as information itself. There is also.

Further, “data” and “information” have the same data and information as long as they are recognized as the same meaning content even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer. Treated as. For example, information indicating "two" is stored as text information of "0x32" in ASCII code in one computer, and is stored as binary information of "10" in binary notation in another computer. May be done.

However, the above-mentioned distinction between "data" and "information" is not strict, and exceptional handling is also allowed. For example, data may be temporarily treated as information, or information may be temporarily treated as data. What is treated as data in one device may be treated as information in another device. Furthermore, information may be extracted from the data or data may be extracted from the information.

The memory 32 is, for example, a RAM (abbreviation for Random Access Memory), a ROM (abbreviation for Read Only Memory), an EEPROM (abbreviation for Electrically Erasable Programmable Read-Only Memory), a combined HDD (hard drive), and a HDD (HardD). It is configured by a removable storage medium such as a removable USB memory, a buffer included in the CPU 31, or the like, or a combination thereof.

The memory 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transmission medium. In addition to the above examples, the non-transmission medium also includes a recording medium such as a CD-ROM and a DVD-ROM. The non-transmission medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server or the like on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage medium. Not included in the media.

The program stored in the program storage area 32A is executed by the CPU 31. However, in this specification, the operation of each program may be described by omitting the CPU 31. That is, in the following description, the description to the effect that “the program A executes the process A” may mean that “the CPU 31 executes the process A described in the program A”. The same applies to the mobile terminal 50.

In addition, the program stored in the program storage area 32A determines an event and operates according to the determination result. However, in this specification, the operation of each program may be described by omitting the determination. That is, in the following description, the description that "the program executes the process A according to the condition A" is "determines whether the program is the condition A. The program is a positive determination." According to the above, the process A is executed”. The same applies to the mobile terminal 50.

Further, the program stored in the program storage area 32A specifies, acquires, extracts, determines, or selects data and the like. When the program specifies the data etc., for example, the data matching the condition is specified from the plurality of data etc., and the information for identifying the data etc. itself or the data etc. is stored in a predetermined storage area. Refers to the process of storing. The information for identifying the data or the like is, for example, identification information for identifying the data or the like, an index of an array in which the data or the like is stored, a pointer of a storage area in which the data or the like is stored, or the like. The same applies to the process in which the program acquires, extracts, determines, or selects data or the like. The same applies to the mobile terminal 50.

The OS 34 is a base that provides an API (abbreviation of Application Programming Interface) for controlling the printer 11, the scanner 12, the display 23, the input I/F 24, the communication I/F 25, and the like, which are the hardware configuring the multifunction peripheral 10. It is a program. That is, each program described above controls each hardware by calling the API provided by the OS 34. However, in this specification, the operation of each program may be described by omitting the OS 34. That is, in the following description, the description that "the program B controls the hardware C" may mean that "the program B controls the hardware C through the API of the OS 34". The same applies to the mobile terminal 50.

[Mobile device 50]
As shown in FIG. 2B, the mobile terminal 50 mainly includes a display 53, an input I/F 54, a communication I/F 55, a camera 56, a CPU 61, a memory 62, and a communication bus 63. Prepare The display 53, the input I/F 54, the communication I/F 55, the CPU 61, the memory 62, and the communication bus 63 included in the mobile terminal 50 are the display 23, the input I/F 24, the communication I/F 25, and the CPU 31 included in the multifunction peripheral 10. , The memory 32, and the communication bus 33 have the same configurations, and the description thereof will be omitted.

The mobile terminal 50 is, for example, a mobile phone, a smartphone, a tablet terminal, or the like. More specifically, the display 53 of the mobile terminal 50 preferably has a display screen size of 12 inches or less, and more preferably 8 inches or less. The input I/F 54 of the mobile terminal 50 is preferably a touch panel overlaid on the display screen of the display 53. The memory 62 is an example of a terminal memory, and the CPU 61 and the memory 62 are an example of a control unit.

[Camera 56]
The camera 56 photographs a subject and generates image data. The operation of the camera 56 is controlled by, for example, a camera program (not shown) stored in the program storage area 62A. That is, the camera program causes the display 53 to display the image captured by the camera 56 and the [capture] icon. Further, the image displayed on the display 53 is changed following the change of the orientation of the camera 56. Then, the camera program stores the image data showing the image displayed on the display 53 in the data storage area 62B in response to the user operation for designating the [shooting] icon being received through the input I/F 54.

The program storage area 62A of the memory 62 stores an OS 64 and a terminal program 65. The OS 64 may be, for example, Android (registered trademark of Google Inc.) OS, iOS (registered trademark of Cico Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like.

The terminal program 65 is a program that causes the input device and the output device designated by the user to execute the cooperative operation. The input device is a device that executes an input operation of inputting target data to be transmitted to the mobile terminal 50. The output device is a device that performs an output operation of outputting the target data received from the mobile terminal 50. That is, the terminal program 65 receives the target data from the input device by causing the input device to perform the input operation. Next, the terminal program 65 causes the output device to execute the output operation by outputting the target data received from the input device to the output device. The multifunction machine 10 and the server 80 are devices that can be an input device and an output device.

The input operation of the multi-function device 10 functioning as an input device refers to, for example, causing the scanner 12 to generate target data to be transmitted to the mobile terminal 50. The input operation of the server 80 functioning as an input device refers to, for example, reading target data to be transmitted to the mobile terminal 50 from a memory included in the server 80 (hereinafter, also referred to as “server memory”). Making the scanner 12 generate the target data and reading the target data from the server memory are examples of inputting the target data to the input device.

The output operation of the multi-function peripheral 10 functioning as an output device means, for example, causing the printer 11 to record an image represented by the target data received from the portable terminal 50 on a sheet. The output operation of the server 80 functioning as an output device is, for example, storing the target data received from the portable terminal 50 in the server memory, or a download URL (Uniform Resource Locator) for downloading the target data stored in the server memory. (Abbreviation) means to notify by e-mail.

The data storage area 62B of the portable terminal 50 can store a linked operation list, as shown in FIG. 3(A), for example. The cooperation operation list includes one or more cooperation operation records. The cooperation operation record includes an input device ID, an output device ID, and condition information that are associated with each other. The cooperation operation record is an example of cooperation operation information.

The input device ID is an example of input device information for identifying the input device designated through the input I/F 54. The output device ID is an example of output device information that identifies the output device specified through the input I/F 54. In this embodiment, the multifunction device 10A is identified by the device ID “MFP-A”, the multifunction device 10B is identified by the device ID “MFP-B”, and the server 80 is identified by the device ID “server C”. The input device ID and the output device ID may be in the URL format, for example. The condition information is information indicating the execution condition of the output operation to be executed by the output device identified by the corresponding output device ID.

As an example, the execution condition of the output operation (that is, the print operation) executed by the multi-function peripheral 10 is the size information specifying the size of the sheet (for example, A4, A5, etc.) and the number of sheets for recording the same target image Number information for specifying (for example, one copy, two copies, etc.), layout information for specifying the number of target images to be recorded on one sheet (for example, 2 in 1, 4 in 1, etc.), face of the sheet for recording the target image ( For example, it is recording surface information or the like for specifying (one side, both sides).

As another example, the execution condition of the output operation for storing the target data in the server memory is storage destination information indicating an area (for example, a file path) of the server memory storing the target data, a file of the target data stored in the server memory. Format information indicating a format (for example, JPEG, TIFF, PDF, etc.). As still another example, the execution condition of the output operation of transmitting the download URL of the target data by e-mail is address information or the like that specifies the transmission destination of the e-mail.

The output device ID included in the cooperation operation record is not limited to one and may be plural. Further, different condition information may be associated with a plurality of output device IDs included in the same cooperation operation record. When the terminal program 65 is installed, no cooperation operation record is stored in the data storage area 62B. Then, the terminal program 65 registers the cooperative operation record generated according to the user's instruction in the cooperative operation list in the registration process described later.

The data storage area 62B can store a page list, as shown in FIGS. 3B and 3C, for example. The page list includes one or more page records. The page record includes page data and condition information associated with each other. The page data is data included in the target data received from the input device. The page data is, for example, image data showing an image recorded on a one-page original read by the scanner 12. The condition information is information indicating the execution condition of the output operation for the corresponding page data. The condition information is the condition information included in the cooperation operation record or the condition information acquired in the condition information acquisition processes A and B described later. The page list is temporarily generated by the terminal program 65 in the cooperation instruction process described later.

Although not shown, the data storage area 62B stores a camera flag and a scan flag. The camera flag has a first value “ON” corresponding to the instruction to extract the condition information from the information image data generated by the camera 56, or the condition information from the information image data generated by the camera 56. The second value "OFF" is set, which corresponds to the fact that extraction is not instructed. The scanner flag has a first value “ON” corresponding to the instruction to extract the condition information from the information image data generated by the input device, or the condition information from the information image data generated by the input device. The second value "OFF" is set, which corresponds to the fact that extraction is not instructed. The second value “OFF” is set in the camera flag and the scanner flag at the time of starting the cooperation instruction process described later.

[Server 80]
The server 80 is a so-called storage server. More specifically, for example, the server 80 stores the data received from the mobile terminal 50 in the server memory, reads the data designated by the mobile terminal 50 from the server memory, and transmits the data to the mobile terminal 50. The server memory is an example of a device memory. The server 80 provides services such as "Evernote (registered trademark of Evernote Corporation)", "Dropbox (registered trademark of DropBox, Inc.)", "Google Drive (Google is a registered trademark of Google, Inc.)", and the like. It may be provided.

[Operation of system 100]
The operation of the system 100 according to the present embodiment will be described with reference to FIGS. 4 to 6.

[registration process]
First, the terminal program 65 can execute a registration process. The registration process is a process of registering the cooperation operation record generated according to the user's instruction in the cooperation operation list. The details of the registration process will be described with reference to FIG.

First, the terminal program 65 displays a registration screen on the display 53 (S11). FIG. 7A is an example of the registration screen displayed first in the registration process. The registration screen shown in FIG. 7A includes a [+input] icon 111, a [+output] icon 112, and a [registration] icon 113. The [+input] icon 111 corresponds to an instruction to specify an input device. The [+output] icon 112 corresponds to an instruction to specify an output device. The [Register] icon 113 corresponds to an instruction to register the cooperative operation record in the cooperative operation list. Then, the terminal program 65 receives a user operation on the registration screen through the input I/F 54 (S12).

Next, when the terminal program 65 receives the designation of the [+input] icon 111 shown in FIG. 7A through the input I/F 54 (S12: [+input] icon), the input selection screen is displayed. It is displayed on the display 53 (S13). FIG. 7B is an example of the input selection screen. The input selection screen shown in FIG. 7B includes input icons 121, 122, 123. Then, the terminal program 65 receives a user operation on the input selection screen through the input I/F 54 (S14).

The input icons 121, 122, 123 correspond to the multifunction peripherals 10A, 10B and the server 80, which can be input devices. In addition, the device IDs of the corresponding devices are described in the input icons 121 to 123. The names of the corresponding devices may be described in the input icons 121 to 123. The device ID of a device that can be an input device may be registered in advance in the terminal program 65, or may be searched for on the communication network using SNMP (abbreviation of Simple Network Management Protocol) or the like.

Next, when the terminal program 65 receives the designation of the input icon 121 through the input I/F 54 (S14: Yes), the device ID corresponding to the designated input icon 121 is set as the input device ID and is data. It is temporarily stored in the storage area 62B (S15). The designation of the input icons 121 to 123 is an example of a user operation for designating an input device. Then, the terminal program 65 displays the registration screen shown in FIG. 8A on the display 53 (S11). The registration screen shown in FIG. 8A differs from the registration screen shown in FIG. 7A in that it includes a [MFP-A] icon 114 instead of the [+input] icon 111. The [MFP-A] icon 114 corresponds to the input device ID temporarily stored in step S15.

Next, when the terminal program 65 receives the designation of the [+output] icon 112 shown in FIG. 8A through the input I/F 54 (S12: [+output] icon), the output selection screen is displayed. It is displayed on the display 53 (S16). FIG. 8B is an example of the output selection screen. The output selection screen shown in FIG. 8B includes output icons 125, 126, 127. The output icons 125, 126, 127 correspond to the multifunction peripherals 10A, 10B and the server 80, which can be output devices. The details of the output icons 125 to 127 may be the same as the input icons 121 to 123. Then, the terminal program 65 receives a user operation on the output selection screen through the input I/F 54 (S17).

Next, the terminal program 65 designates the device ID “server C” corresponding to the designated output icon 127 in response to the designation of the output icon 127 received through the input I/F 54 (S17: Yes). The device ID is temporarily stored in the data storage area 62B (S18). The designation of the output icons 125 to 127 is an example of a user operation for designating an output device. Then, the terminal program 65 displays the registration screen shown in FIG. 9A on the display 53 (S11). The registration screen shown in FIG. 9(A) differs from the registration screen shown in FIG. 8(A) in that it further includes a [Server C] icon 115. The [Server C] icon 115 corresponds to the output device ID “Server C” temporarily stored in step S18.

Next, when the terminal program 65 receives the designation of the [+output] icon 112 shown in FIG. 9A through the input I/F 54 (S12 [+output] icon), steps S16 to S18 are performed. Execute the process. That is, the user can specify the plurality of icons 131 to 135 included in the output selection screen by causing the terminal program 65 to repeatedly execute the processes of steps S16 to S18.

Further, the terminal program 65 receives the designation of the [registration] icon 113 shown in FIG. 9A through the input I/F 54 (S12: [registration] icon), and temporarily stores it in steps S15 and S18. A cooperation operation record including the information thus set is added to the cooperation operation list (S19). That is, in the above-described example, the cooperation operation record including the input device ID “MFP-A”, the output device ID “server C”, and the condition information indicating the default condition is added to the cooperation operation list. Note that the order of designating the [+input] icon 111 and the [+output] icon 112 on the registration screen is not limited to the above example.

The default condition is set in advance in the terminal program 65 as an execution condition of an output operation to be executed by the output device identified by the corresponding output device ID, for example. However, the condition information included in the cooperation operation record in step S19 is not limited to indicating the default condition. In the registration process, for example, the terminal program 65 may display a screen for accepting the input of the execution condition on the display 53 and accept the input of the execution condition through the input I/F 54. The execution condition received through the input I/F 54 in the registration process is an example of the user condition.

[Cooperation instruction processing]
Further, the terminal program 65 can execute the cooperation instruction process. The cooperation instruction process is a process for causing the input device and the output device to execute the cooperation operation according to the cooperation operation record specified by the user. Details of the cooperation instruction process will be described with reference to FIG.

First, the terminal program 65 displays an operation selection screen on the display 53 (S21). FIG. 9B is an example of the operation selection screen. The operation selection screen shown in FIG. 9B includes cooperation icons 131 and 132 and radio buttons 133 and 134. Then, the terminal program 65 receives a user operation on the operation selection screen through the input I/F 54 (S22). The process of step S22 is an example of a reception process. In the present embodiment, the following processing will be described assuming that one of the radio buttons 133 and 134 is checked and the cooperation icon 131 is designated.

The cooperation icon 131 corresponds to the cooperation operation record on the first line shown in FIG. The cooperation icon 132 corresponds to the cooperation operation record on the second line shown in FIG. The radio button 133 corresponds to an instruction to execute a process of extracting condition information from the information image data generated by the camera 56. The radio button 134 corresponds to the instruction to execute the process of extracting the condition information from the information image data generated by the input device. Only one of the radio buttons 133 and 134 may be checked, or neither of them may be checked.

[Processing when radio button 133 is checked]
First, the processing when the radio button 133 is checked will be described. More specifically, the terminal program 65 according to the present embodiment extracts condition information from the original document 141 shown in FIG. 10A, and obtains target data corresponding to the original documents 142 and 143 shown in FIG. 10A. The data is generated by the scanner 12 of the multifunction peripheral 10A, and the target data generated by the scanner 12 is output to the server 80 according to the extracted execution condition.

The terminal program 65 changes the setting value of the camera flag from one of the first value “ON” and the second value “OFF” to the other in response to receiving the tap at the position of the radio button 133 through the input I/F 54. Switch. That is, the camera flag is set to the first value “ON” when the radio button 133 is checked, and is set to the second value “OFF” when the radio button 133 is not checked. The user operation of checking the radio button 133 is an example of the second instruction operation. In response to the designation of the cooperation icon 131 received through the input I/F 54 (S22: Yes), the terminal program 65 reads the cooperation operation record corresponding to the specified cooperation icon 131 from the data storage area 62B.

Next, the terminal program 65 determines the set value of the camera flag (S23). Then, the terminal program 65 executes the condition information acquisition processing A in response to the determination that the first value “ON” is set in the camera flag (S23: Yes) (S24). The condition information acquisition process A is a process of causing the camera 56 to generate information image data and acquiring condition information from the generated information image data. Details of the condition information acquisition process A will be described with reference to FIG. The mobile terminal 50 including the camera 56 is an example of an image reading device.

[Condition information acquisition process A]
First, the terminal program 65 activates a camera program (not shown) (S41). Next, the camera program causes the camera 56 to generate image data and provides the generated image data to the terminal program 65 in response to receiving a user operation for designating the [shooting] icon through the input I/F 54. (S42: Yes). The terminal program 65 may execute, for example, an API for activating the camera program as a so-called plug-in, acquire a path of image data as a return value of the API, and read the image data based on the acquired path. .. On the other hand, the camera program ends the process without designating the path of the image data as the return value in response to the user operation instructing the end of the camera program being accepted through the input I/F 54.

Next, the terminal program 65 determines whether the image data acquired from the camera program contains a QR (abbreviation of Quick Response) code (S43). If the document 141 is properly photographed by the camera 56, it is determined that the QR code is included (S43: Yes). The determination as to whether or not the image data includes a QR code can be realized by a known method such as detecting the cutout symbols at the three corners.

The QR code can include character string information. That is, the terminal program 65 can extract the character string information by analyzing the QR code by a known method. The QR code according to this embodiment includes condition information as character string information. The QR code is an example of an information image, and the image data including the QR code is an example of information image data. The specific example of the information image is not limited to the QR code and may be a barcode or a character string image described in a predetermined format.

Next, the terminal program 65 determines that the image data generated by the camera 56 does not include the QR code 141Q (S43: No), or does not acquire the image data path from the camera program. In response to this, the processes of step S41 and thereafter are executed again. On the other hand, when the terminal program 65 determines that the image data generated by the camera 56 includes the QR code 141Q (S43: Yes), the condition information is extracted from the QR code 141Q (S44). ..

Then, the terminal program 65 temporarily stores the condition information extracted from the QR code 141Q in the data storage area 62B. The execution condition indicated by the condition information extracted in step S44 is an example of the extraction condition. The extraction condition according to this embodiment is storage destination information indicating a storage destination of target data. The process of step S44 is an example of the extraction process.

Next, returning to FIG. 5, the terminal program 65 acquires the input device ID “MFP-A” from the read cooperation operation record. Then, the terminal program 65 transmits the input instruction information to the multifunction peripheral 10A identified by the input device ID "MFP-A" through the communication I/F 55 (S25). The input instruction information is information for instructing the multifunction peripheral 10A, which is an input device, to execute an input operation. That is, the input instruction information according to the present embodiment is information for instructing the scanner 12 of the multifunction peripheral 10A to execute the scan operation. The process of step S25 is an example of the input instruction process.

Although illustration is omitted, the device program 35 of the multifunction peripheral 10A receives the input instruction information from the mobile terminal 50 through the communication I/F 25. Then, the device program 35 causes the multifunction peripheral 10A to perform the input operation according to the received input instruction information. More specifically, the scanner 12 of the multifunction peripheral 10A reads an image recorded on the originals 142 and 143 set in an ADF (Abbreviation for Auto Document Feeder), for example, and generates scan data indicating the image. The scan data generated here includes two page data corresponding to the originals 142 and 143, respectively. The scan data is an example of target data to be transmitted to the mobile terminal 50. Then, the device program 35 transmits the scan data as a response to the input instruction information to the mobile terminal 50 through the communication I/F 25.

Next, the terminal program 65 of the mobile terminal 50 receives the scan data, which is a response to the input instruction information, as target data from the multifunction peripheral 10A through the communication I/F 25 (S26: Yes). Then, the terminal program 65 temporarily stores the received scan data in the data storage area 62B. The process of step S26 is an example of the receiving process. Next, the terminal program 65 determines the setting value of the scanner flag (S27). Then, the terminal program 65 skips the process of step S28 in response to determining that the second value “OFF” is set in the scanner flag (S27: No). The process of step S28 will be described later.

Next, the terminal program 65 acquires the output device ID “server C” from the read cooperation operation record. Then, the terminal program 65 transmits the output instruction information through the communication I/F 55 to the server 80 identified by the output device ID “server C” (S29). The output instruction information includes the target data received in step S26 and the condition information indicating the extraction condition extracted in step S44. The output instruction information is information for instructing to perform the output operation for the target data according to the execution condition indicated by the condition information. That is, the output instruction information according to the present embodiment is information for instructing the server 80 to store the target data in the area of the server memory indicated by the storage destination information. The process of step S29 is an example of the output instruction process.

On the other hand, although not shown, the server 80 receives the output instruction information from the mobile terminal 50. Then, the server 80 stores the target data included in the output instruction information in the area of the server memory indicated by the storage destination information. The mobile terminal 50 and the server 80 may communicate with each other in a procedure based on HTTP (abbreviation of HyperText Transfer Protocol), for example. That is, the terminal program 65 may transmit the output instruction information to the server 80 as an HTTP request in step S29.

[Processing when radio button 134 is checked]
Next, the processing when the radio button 134 is checked will be described. More specifically, the terminal program 65 according to the present embodiment sets the target data corresponding to the originals 141 to 143 shown in FIG. 10A or the originals 151 to 153 shown in FIG. The scanner 12 generates the condition information from the target data generated by the scanner 12, and causes the output device to execute the output operation for the target data generated by the scanner 12 according to the extraction condition. It should be noted that detailed description of the common points to the case where the radio button 133 is checked is omitted, and the differences will be mainly described.

The terminal program 65 changes the setting value of the scanner flag from one of the first value “ON” and the second value “OFF” to the other in response to receiving the tap at the position of the radio button 134 through the input I/F 54. Switch. That is, the scanner flag is set to the first value “ON” when the radio button 134 is checked, and is set to the second value “OFF” when the radio button 134 is not checked. The user operation of checking the radio button 134 is an example of the first instruction operation. In response to the designation of the cooperation icon 131 received through the input I/F 54 (S22: Yes), the terminal program 65 reads the cooperation operation record corresponding to the specified cooperation icon 131 from the data storage area 62B.

Next, the terminal program 65 does not execute the condition information acquisition processing A (S24) in response to determining that the second value “OFF” is set in the camera flag (S23: No), The processing after S25 is executed. Next, the terminal program 65 transmits the input instruction information to the multifunction peripheral 10A through the communication I/F 55 (S25). Next, the terminal program 65 receives scan data, which is a response to the input instruction information, as target data from the multifunction peripheral 10B through the communication I/F 25 (S26: Yes). Then, the terminal program 65 temporarily stores the received scan data in the data storage area 62B.

As an example, the scan data when the documents 141 to 143 are read by the scanner 12 is a plurality of page data corresponding to each of the documents 141 to 143 (hereinafter, the page data corresponding to the document xxx is referred to as “page data xxx”). Including). Although detailed description is omitted in the section of [Processing when Radio Button 133 is Checked], the terminal program 65 at step S26, as shown in FIG. Add multiple page records, including one of 143, to the page list. As another example, the scan data when the originals 151 to 153 are read by the scanner 12 includes a plurality of page data 151 to 153. Therefore, the terminal program 65 adds a plurality of page records each including one of the page data 151 to 153 to the page list, as shown in FIG. 3C, for example.

Further, as shown in FIGS. 3B and 3C, the terminal program 65 includes the condition information “default condition” included in the read cooperation operation record in the page record. Further, the page data 141, 151, 152 include QR codes 141Q, 151Q, 152Q. That is, the scan data generated by the scanner 12 includes page data and information image data. The multifunction device 10 including the scanner 12 is an example of a device that also serves as an input device and an image reading device.

Next, the terminal program 65 executes the condition information acquisition process B (S28) in response to determining that the first value “ON” is set in the scanner flag (S27: Yes). The condition information acquisition process B is a process of acquiring condition information from the information image data generated by the input device. With reference to FIG. 6B, the condition information acquisition process B of the condition information acquisition process B will be described by taking as an example the case where scan data corresponding to the originals 141 to 143 is received and the case where scan data corresponding to the originals 151 to 153 are received. The details will be described.

[Condition Information Acquisition Process B for Scan Data of Documents 141 to 143]
The terminal program 65 determines whether the page data 141 includes a QR code (S51). Next, in response to determining that the page data 141 includes the QR code 141Q (S51: Yes), the terminal program 65 extracts condition information and range information from the QR code 141Q (S52). Then, the terminal program 65 associates the extracted condition information and range information and temporarily stores them in the data storage area 62B. In the present embodiment, it is assumed that the condition information “extraction condition” and the range information “all pages” are extracted. The process of step S52 is an example of the extraction process.

The range information is information for indicating any one of the plurality of page data. More specifically, the range information is set to “all pages” indicating all page data included in the scan data or “current page” indicating only page data including the QR code from which the range information is extracted. Alternatively, information indicating a part of a plurality of page data (for example, “1 to 3 pages” or the like) may be set in the range information.

Next, the terminal program 65 determines the set value of the range information extracted in step S52 (S53). Then, when the terminal program 65 determines that “all pages” is set in the range information (S53: all pages), it is associated with the range information as shown in FIG. The obtained condition information “extraction condition” is associated with all the page data 141 to 143 included in the scan data. That is, in all the page records shown in FIG. 3B, the condition information is replaced with the “extract condition” from the “default condition”. The extraction condition according to this embodiment is storage destination information indicating a storage destination of target data.

Further, the terminal program 65 excludes the page data 141 including the QR code 141Q from the target data (S55). That is, the terminal program 65, for example, deletes a page record including the page data 141 from the page list or adds a deletion flag to the page record including the page data 141. The process of step S55 is an example of the first exclusion process. Then, the terminal program 65 ends the condition information acquisition process B without executing the process of step S51 for the page data 142 and 143.

Next, returning to FIG. 5, the terminal program 65 acquires the output device ID “server C” from the read cooperation operation record. Then, the terminal program 65 transmits the output instruction information generated according to the page list shown in FIG. 3B to the server 80 identified by the output device ID “server C” through the communication I/F 55 (S29). .. The output instruction information transmitted here includes page data 142 and 143 that are target data, and condition information “extraction condition”. That is, this output instruction information is information for instructing the server 80 to store the page data 142, 143 in the area of the server memory indicated by the storage destination information. On the other hand, the page data 141 excluded from the target data in step S55 is not included in the output instruction information.

[Condition Information Acquisition Process B for Scan Data of Documents 151 to 153]
In response to determining that the page data 151 includes the QR code 151Q (S51: Yes), the terminal program 65 extracts the condition information and the range information from the QR code 151Q (S52). In this embodiment, it is assumed that the condition information “extraction condition A” and the range information “current page” are extracted. The extraction condition A according to this embodiment is storage destination information indicating a storage destination different from the default condition.

Next, the terminal program 65 responds to the range information as shown in FIG. 3C in response to the determination that the “current page” is set in the range information (S53: current page). The attached condition information “extraction condition A” is associated with the page data 151 including the QR code 151Q (S56). That is, in the page record including the page data 151, the condition information is replaced with "extraction condition A" from "default condition". The terminal program 65 also excludes the QR code 151Q from the page data 151 (S57). The terminal program 65 fills the position of the QR code 151Q with the background color (for example, white) of the original 151, for example. The process of step S57 is an example of the second exclusion process.

In addition, in response to determining that the page data 152 includes the QR code 152Q (S51: Yes), the terminal program 65 extracts from the QR code 152Q the condition information “extraction condition B” and the range information “current page”. Is extracted (S52). Then, as shown in FIG. 3C, the terminal program 65 associates the extracted condition information “extraction condition B” with the page data 152 (S56) and excludes the QR code 152Q from the page data 152 (S57). ). That is, in the page record including the page data 152, the condition information is replaced with “extraction condition B” from “default condition”. The extraction condition B according to this embodiment is storage destination information indicating a storage destination different from the default condition and the extraction condition A.

Next, the terminal program 65 skips the processes of steps S52 to S57 in response to determining that the page data 153 does not include the QR code (S51: No). That is, as shown in FIG. 3C, the condition information is not replaced in the page record including the page data 153. Then, the terminal program 65 ends the condition information acquisition processing B in response to the completion of the processing for all the page data 151 to 153 included in the scan data (S58: Yes).

Next, the terminal program 65 acquires the output device ID “server C” from the read cooperation operation record. Then, the terminal program 65 transmits the output instruction information generated according to the page list shown in FIG. 3C to the server 80 identified by the output device ID “server C” through the communication I/F 55 (S29). .. The output instruction information transmitted here is page data 151, 152, 153 that are target data, condition information “extraction condition A” associated with the page data 151, and condition information associated with the page data 152. It includes “extraction condition B” and condition information “default condition” associated with the page data 153.

On the other hand, although not shown, the server 80 receives the output instruction information from the mobile terminal 50. Then, the server 80 stores the target data included in the output instruction information in the area of the server memory indicated by the storage destination information. More specifically, the server 80 stores the page data 151 in the area indicated by the extraction condition A, the page data 152 in the area indicated by the extraction condition B, and the page data 153 in the area indicated by the default condition. Remember.

[Operation and effect of this embodiment]
According to the above embodiment, it is possible to cause the output device to execute the output operation according to the execution condition indicated by the condition information extracted from the information image data. That is, the execution condition of the output operation can be easily switched by the information reading device generating the information image data including the desired condition information.

In addition, according to the above-described embodiment, it is possible to allow the user to specify which of the scanner 12 and the camera 56 is to generate the information image data through the radio buttons 133 and 134. As a result, the information image data can be acquired by an appropriate method according to the usage mode of the user described later. However, the information image data may be acquired from only one of the scanner 12 and the camera 56.

As a first usage mode, let us consider a process of causing the scanner 12 to read a document possessed by a user and saving the scan data generated by the scanner 12 in any of a plurality of folders prepared in advance in the server memory. In such a case, a plurality of originals, each having a QR code recorded therein, are prepared near the multifunction device 10. The QR code recorded on each document includes storage destination information of any of the plurality of folders. For example, the user causes the scanner 12 to collectively read the original document 141 corresponding to a desired folder and the original documents 142 and 143 on which the images to be stored in the server 80 are recorded, thereby causing the server 80 to read the page data 142 and 143. Can be memorized.

That is, according to this method, the condition information can be extracted from one of the page data, and the output operation targeting all the page data can be executed in accordance with the extraction condition indicated by the extracted condition information. However, the page data 141 in this case is originally data that does not need to be the target of the output operation. Therefore, as in the above embodiment, the page data 141 including the information image data is excluded from the target data, and the output device performs the output operation only on the target data 142 and 143 after the page data 141 is excluded. Is desirable.

As a second mode of use, let us consider a process in which the scanner 12 reads a plurality of documents possessed by the user, and causes the output device to execute an output operation for each of the plurality of page data generated by the scanner 12 under different execution conditions. In such a case, a plurality of stickers, each having a QR code recorded therein, are prepared in advance near the multifunction machine 10. The QR code recorded on each sticker contains different condition information. For example, the user attaches a sticker to which desired QR codes 151Q and 152Q are attached to the originals 151 and 152, and causes the scanners 12 to collectively read the originals 151 to 153, so that pages are displayed in the folder indicated by the extraction condition A. The data 151 can be stored, the page data 152 can be stored in the folder indicated by the extraction condition B, and the page data 153 can be stored in the folder indicated by the default condition.

That is, according to this method, it is possible to cause the output device to execute the output operation for the plurality of originals 151 to 153 read collectively by the scanner 12 under different execution conditions. In other words, it is possible to cause the output device to execute the output operation targeting only the page data 151 and 152 from which the condition information is extracted, according to the execution conditions A and B extracted from the page data 151 and 152. On the other hand, the output operation for the page data 153 from which the condition information has not been extracted is executed according to the default condition. However, the QR codes 151Q and 152Q included in the page data 151 and 152 are data that originally do not need to be the target of the output operation. Therefore, as in the above embodiment, it is desirable to cause the output device to execute the output operation for the page data 151 and 152 after the information image data is excluded.

In the above-described first and second usage modes, the information image data is received together with the target data from the input device by causing the scanner 12 to read the originals 141, 151, 152 including the QR codes 141Q, 151Q, 152Q. be able to. This eliminates the need for an independent process for acquiring the information image data. Further, when the output device ID cannot be acquired in the condition information acquisition process B, the output operation is executed according to the default condition.

As a third usage mode, consider a process of causing the multifunction peripheral 10 to execute a print operation for specific data stored in the server 80 according to any of a plurality of execution conditions. A plurality of originals, each having a QR code recorded therein, are prepared near the multifunction peripheral 10. The QR code recorded on each original includes condition information different from each other. The user can cause the multifunction peripheral 10 to execute the print operation for the data stored in the server 80 by photographing the document corresponding to the desired condition information with the camera 56, for example, according to the desired extraction condition. That is, when it is not possible to previously include the information image data in the target data as in the third usage mode, it is desirable that the camera 56 generate the information image data.

The terminal program 65 according to the above-described embodiment may further include the extraction instruction information in the cooperation operation record according to the instruction of the user in the registration process. The extraction instruction information is set with a first value “ON” corresponding to the instruction to extract the condition information from the information image data or a second value “OFF” corresponding to the instruction not to extract the condition information from the information image data. .. Then, in the cooperation instruction process, the terminal program 65 executes one of the condition information extraction processes A and B when the first value “ON” is set in the extraction instruction information and the second value “in” in the extraction instruction information. The condition information extraction processes A and B may not be executed when "OFF" is set.

The data format of the condition information included in the output instruction information may be, for example, an image format showing the QR code itself extracted from the information image data, or a text format extracted from the QR code. A binary format (for example, a bit string indicating a plurality of flag information) obtained by further processing the textual condition information may be used.

The combination of the input device and the output device is not limited to the above example. As an example, the multifunction device 10A may be designated as the input device and the multifunction device 10B may be designated as the output device. As another example, a first server (not shown) may be designated as an input device, and a second server (not shown) may be designated as an output device. Furthermore, specific examples of the input operation and the output operation are not limited to the above example. For example, the operation of transmitting the target data by FAX to the FAX device designated as the output device and the operation of transmitting the e-mail with the target data attached to the mail server designated as the output device are examples of the output operation. The execution condition when the FAX transmission or the electronic mail transmission is used as the output operation may be, for example, address information (for example, FAX number, mail address, etc.) that specifies the transmission destination.

Further, in the multifunction device 10 and the portable terminal 50 of the above-described embodiment, the various programs stored in the program storage areas 32A and 62A of the memories 32 and 62 are executed by the CPUs 31 and 61, so that the control unit of the present invention operates. The example in which each process to be executed is realized has been described. However, the configuration of the control unit is not limited to this, and a part or all of the control unit may be realized by hardware such as an integrated circuit (also referred to as IC (Integrated Circuit)).

Further, the present invention can be realized not only as the multifunction peripheral 10 and the mobile terminal 50, but also as a program that causes the multifunction peripheral 10 and the mobile terminal 50 to execute processing. Then, the program may be recorded and provided in a non-transitory recording medium. The non-transitory recording medium may include a CD-ROM, a DVD-ROM, and the like, as well as a storage unit mounted in a server that can be connected to the multifunction peripheral 10 and the mobile terminal 50 via a communication network. Then, the program stored in the storage unit of the server may be distributed as information or a signal indicating the program through a communication network such as the Internet.

10... Multifunction device 11... Printer 12... Scanner 23, 53... Display 24, 54... Input I/F
25, 55... Communication I/F
31, 61... CPU
32, 62... Memory 35... Device program 50... Mobile terminal 56... Camera 65... Terminal program

Claims (16)

A program readable by a mobile terminal including a terminal memory, an input interface, a communication interface, and a camera ,
The program causes the portable terminal to execute a registration process of storing cooperative operation information including input device information and output device information in the terminal memory, and the input device information is the input device specified through the input interface. The output device information is information for identifying the output device specified through the input interface,
The program is
A receiving process for receiving a designation operation for designating one of the cooperation operation information stored in the terminal memory and a first instruction operation or a second instruction operation through the input interface;
The input device identified by the input device information included in the specified cooperation operation information causes the mobile terminal to execute an input instruction process of transmitting input instruction information through the communication interface. , Information for instructing execution of an input operation for inputting target data used for cooperative operation with the output device to the input device , wherein the input instruction information is to scan an image recorded on a document. In the scan operation for generating the scan data including the target data and the information image data, the information for causing the scanner to perform as the input operation, the scanner is the input device,
The program extracts condition information from the information image data when the first instruction operation is accepted in the acceptance process, and controls the camera when the second instruction operation is accepted in the acceptance process. Execution of an output operation of causing the mobile terminal to execute an extraction process of extracting the condition information from the information image data generated by the camera that has been activated and photographed the object, and the condition information outputs the target data. It is information that indicates the conditions,
The program causes the portable device to execute an output instruction process of transmitting output instruction information through the communication interface to the output device identified by the output device information included in the specified cooperation operation information, and outputs the output instruction information. instruction information, the program is information for instructing the execution of the output operation in accordance with the execution condition indicated by the condition information extracted in the previous SL extraction process. The program is
As a response to the input instruction information, the portable terminal is caused to execute a receiving process of receiving the scan data including a plurality of page data each corresponding to one page of a document having a plurality of pages from the scanner through the communication interface,
In the extraction processing, the condition information and range information associated with the condition information are extracted from the scan data, and the range information indicates a part of the page data among a plurality of the page data. Information,
In the output instruction process, the program executes the output operation targeting only the page data indicated by the range information according to an execution condition indicated by the condition information associated with the range information. The program according to claim 1 , wherein the output instruction information to be instructed is transmitted to the output device through the communication interface. The program is
As a response to the input instruction information, the portable terminal is caused to execute a receiving process of receiving the scan data including a plurality of page data each corresponding to one page of a document having a plurality of pages from the scanner through the communication interface,
In the extraction processing, extracting the condition information from one of the page data,
The program instructs the output instruction process to execute the output operation targeting all the page data included in the scan data according to the execution condition indicated by the condition information extracted in the extraction process. the output instruction information, the program according to claim 1 or 2, transmitted to the output device through the communication interface to. The program, prior to the output instruction process, performs a first exclusion process of excluding the page data including the information image data from the target of the output operation among the plurality of page data received in the reception process. The program according to claim 3 , which is executed by a mobile terminal. The program,
Prior Symbol extraction process to extract the condition information from said page data,
In the output instruction process, the output operation targeting only the page data from which the condition information is extracted in the extraction process is executed according to the execution condition indicated by the condition information extracted from the page data itself. It said output indication information indicating a program according to any of claims 2 4 to be transmitted to the output device through the communication interface. The program according to claim 5 , wherein the program causes the mobile terminal to execute a second exclusion process for excluding the information image data from the page data from which the condition information is extracted, prior to the output instruction process. A program readable by a mobile terminal having a terminal memory, an input interface, and a communication interface,
The program causes the portable terminal to execute a registration process of storing cooperative operation information including input device information and output device information in the terminal memory, and the input device information is the input device specified through the input interface. The output device information is information for identifying the output device specified through the input interface,
The program includes a receiving process for receiving a specifying operation for specifying one of the cooperative operation information stored in the terminal memory through the input interface,
The input device identified by the input device information included in the specified cooperation operation information causes the mobile terminal to execute an input instruction process of transmitting input instruction information through the communication interface. , Information for instructing execution of an input operation that causes the input device to input target data used for a cooperative operation with the output device,
The program causes the mobile terminal to execute an extraction process of extracting condition information from information image data, and the information image data is image data generated by an image reading apparatus reading an image recorded on an object, The condition information is information indicating an execution condition of an output operation for outputting the target data,
The program issues an output instruction through the communication interface to the output device identified by the output device information included in the specified cooperation operation information in response to not extracting the condition information in the extraction processing. Causing the mobile terminal to execute a first output instruction process for transmitting information, and the output instruction information is information for instructing execution of an output operation for outputting the target data input by the input device,
The program outputs an output including the extracted condition information to the output device identified by the output device information included in the specified cooperation operation information in response to the extraction of the condition information in the extraction processing. A program for causing the mobile terminal to execute a second output instruction process of transmitting instruction information through the communication interface. The mobile terminal includes a camera that functions as the image reading device,
8. The program according to claim 7, wherein the program extracts the condition information from the information image data generated by the camera that has activated the camera and photographed an object in the extraction processing. The output instruction information, image format, text format, or a binary format the condition information further program according to any one of including請 Motomeko 1 8 of. In the output operation of storing the object data in the device memory the output device comprises, wherein the condition information includes any one of claims 1 to 9 including a storage destination information indicating an area of the device memory for storing the target data The program described in. In the output operation for notifying information for downloading the target data stored in the device memory by e-mail, the condition information, in claim 1 0, further comprising address information identifying the destination of the e-mail The listed program. In the output operation of recording a target image indicated by the target data on a sheet, the condition information is size information that specifies the size of the sheet, copy number information that specifies the number of sheets recording the same target image, the target image layout information specifying the number of recording on one sheet, and the recording surface information specifying the surface of the sheet for recording the target image according to any one of claims 1 to 9 comprising at least one program. A mobile terminal including a terminal memory, an input interface, a communication interface, a camera, and a computer,
The computer executes a registration process for storing cooperation operation information including input device information and output device information in the terminal memory, and the input device information identifies an input device designated through the input interface. The output device information is information for identifying the output device specified through the input interface,
The computer is
A receiving process for receiving a specifying operation for specifying one of the cooperative operation information stored in the terminal memory, and a first instructing operation or a second instructing operation through the input interface;
Input instruction processing for transmitting input instruction information through the communication interface to the input device identified by the input device information included in the specified cooperation operation information is executed, and the input instruction information is the output device. Is information for instructing execution of an input operation for inputting target data used in a cooperative operation with the input device, wherein the input instruction information is the target data obtained by scanning an image recorded on a document. And a scan operation for generating scan data including information image data, which is information for causing the scanner to execute as the input operation, wherein the scanner is the input device,
The computer extracts condition information from the information image data when the first instruction operation is accepted in the acceptance process, and activates the camera when the second instruction operation is accepted in the acceptance process. And performing an extraction process for extracting the condition information from the information image data generated by the camera that has photographed the object, the condition information being information indicating an execution condition of an output operation for outputting the object data. Yes,
The computer executes an output instruction process of transmitting output instruction information through the communication interface to the output device identified by the output device information included in the specified cooperation operation information, and the output instruction information is A mobile terminal, which is information for instructing execution of the output operation according to the execution condition indicated by the condition information extracted in the extraction processing. A mobile terminal comprising a terminal memory, an input interface, a communication interface, and a computer,
The computer executes a registration process for storing cooperation operation information including input device information and output device information in the terminal memory, and the input device information identifies an input device designated through the input interface. The output device information is information for identifying the output device specified through the input interface,
The computer is
Acceptance processing for accepting a designation operation for designating one of the cooperation operation information stored in the terminal memory through the input interface,
Input instruction processing for transmitting input instruction information through the communication interface to the input device identified by the input device information included in the specified cooperation operation information is executed, and the input instruction information is the output device. Is information for instructing execution of an input operation that causes the input device to input target data used for a cooperative operation with
The computer executes an extraction process of extracting condition information from the information image data, the information image data is image data generated by an image reading device reading an image recorded on an object, and the condition information is , Information indicating the execution condition of the output operation for outputting the target data,
In response to not extracting the condition information in the extraction processing, the computer instructs the output device identified by the output device information included in the specified cooperation operation information to output through the communication interface. A first output instruction process for transmitting information is executed, the output instruction information is information for instructing execution of an output operation for outputting the target data input by the input device,
The computer outputs an output including the extracted condition information to the output device identified by the output device information included in the specified cooperation operation information in response to the extraction of the condition information in the extraction processing. A mobile terminal that executes a second output instruction process of transmitting instruction information through the communication interface. A system comprising an input device, a mobile terminal, and an output device,
The mobile terminal includes a terminal memory, an input interface, a communication interface, a camera, and a computer,
The computer executes a registration process for storing cooperation operation information including input device information and output device information in the terminal memory, and the input device information identifies an input device designated through the input interface. The output device information is information for identifying the output device specified through the input interface,
The computer is
A receiving process for receiving a specifying operation for specifying one of the cooperative operation information stored in the terminal memory, and a first instructing operation or a second instructing operation through the input interface;
Input instruction processing for transmitting input instruction information through the communication interface to the input device identified by the input device information included in the specified cooperation operation information is executed, and the input instruction information is the output device. Is information for instructing execution of an input operation that causes the input device to input target data used for a cooperative operation with
The input device is a scanner, and performs a scan operation of generating scan data including the target data and information image data by scanning an image recorded on a document according to the input instruction information.
The computer extracts the condition information from the information image data when the first instruction operation is accepted in the acceptance process, and activates the camera when the second instruction operation is accepted in the acceptance process. And performing an extraction process for extracting the condition information from the information image data generated by the camera that has photographed the object, the condition information being information indicating an execution condition of an output operation for outputting the object data. Yes,
The computer executes an output instruction process of transmitting output instruction information through the communication interface to the output device identified by the output device information included in the specified cooperation operation information, and the output instruction information is It is information for instructing execution of the output operation according to the execution condition indicated by the condition information extracted in the extraction processing,
The output device executes the output operation according to the output instruction information, and outputs the target data input by the scanner according to the execution condition indicated by the output instruction information. A system comprising an input device, a mobile terminal, and an output device,
The mobile terminal includes a terminal memory, an input interface, a communication interface, and a computer,
The computer executes a registration process for storing cooperation operation information including input device information and output device information in the terminal memory, and the input device information identifies an input device designated through the input interface. The output device information is information for identifying the output device specified through the input interface,
The computer is
Acceptance processing for accepting a designation operation for designating one of the cooperation operation information stored in the terminal memory through the input interface,
Input instruction processing for transmitting input instruction information through the communication interface to the input device identified by the input device information included in the specified cooperation operation information is executed, and the input instruction information is the output device. Is information for instructing execution of an input operation that causes the input device to input target data used for a cooperative operation with
The input device generates the target data according to the input instruction information,
The computer executes an extraction process of extracting condition information from the information image data, the information image data is image data generated by an image reading device reading an image recorded on an object, and the condition information is , Information indicating the execution condition of the output operation for outputting the target data,
In response to not extracting the condition information in the extraction processing, the computer instructs the output device identified by the output device information included in the specified cooperation operation information to output through the communication interface. A first output instruction process for transmitting information is executed, the output instruction information is information for instructing execution of an output operation for outputting the target data input by the input device,
In response to the extraction of the condition information in the extraction processing, the computer outputs to the output device identified by the output device information included in the specified cooperation operation information, the output including the extracted condition information. Executing second output instruction processing for transmitting instruction information through the communication interface,
The output device outputs the target data input by the input device in accordance with the output instruction information transmitted in the first output instruction process, in accordance with the execution condition instructed by the output instruction information. Executing the operation and outputting the target data input by the input device according to the execution condition instructed by the output instruction information, in accordance with the output instruction information transmitted in the second output instruction processing, A system that performs output operations.