JP2020074113A - program - Google Patents

Abstract

To provide a program of a portable terminal for causing a registered input device and output device to execute a cooperative operation, that is, a program capable of easily designating a desired input device and output device.SOLUTION: A terminal program causes a portable terminal to execute: first determination processing (S13 to S15) for determining a designation device designated via an input I/F as an input device or an output device; second determination processing (S17) for determining a connection device subjected to proximity wireless connection to an NFC communication IF as the input device or the output device; registration processing (S16/S19) for storing cooperative operation information indicating the input device or the output device; first reception processing for receiving a designating operation to designate the cooperative operation information; input instruction processing for transmitting input instruction information to the input device indicated by the designated cooperative operation information; reception processing for receiving object data from the input device as a response to the input instruction information; and output instruction processing for transmitting output instruction information to the output device indicated by the designated cooperative operation information.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a program of a mobile terminal that causes an input device and an output device designated by a user to perform a cooperative operation.

  Patent Literature 1 describes a program of a mobile terminal in which a combination of an input device and an output device designated by a user is registered in advance and the input device and the output device of the registered combination perform a cooperative operation. .. The cooperative operation means, for example, that the mobile terminal receives the target data from the input device that has performed the input operation, and the mobile terminal causes the output device to perform the output operation for the received target data. According to the program having the above-described configuration, it is possible to easily execute a routine cooperative operation that is repeatedly executed.

Japanese Unexamined Patent Publication No. 2005-012518

  The program configured as described above causes, for example, a list of devices that can communicate with the mobile terminal to be displayed on the display, and allows the user to specify an input device and an output device from the devices displayed in the list. However, when many devices are displayed in a list, it is troublesome for the user to find and specify a desired device.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a program for a mobile terminal that causes a registered input device and output device to perform cooperative operation, and to provide a desired input device and output device. It is to provide a program that can be easily specified.

  A program according to an aspect of the present specification includes a memory, an input interface, a first communication interface that performs near field wireless communication with an external device, and a wireless communication range that is longer than the near field wireless communication with an external device. It can be read by a mobile terminal having a second communication interface for communication. The program includes a first determination process for determining, as an input device or an output device, a designated device designated through the input interface among the plurality of external devices that can communicate through the second communication interface, and the second communication. Among the plurality of external devices capable of communicating through the interface, the portable terminal is caused to execute a second determination process of determining the connection device, which is connected in proximity wireless communication with the first communication interface, as the input device or the output device. It is possible. The program causes the portable terminal to execute a registration process of storing the cooperation operation information including the input device information and the output device information in the memory. The input device information is information for identifying the input device determined in the first determination process or the second determination process. The output device information is information for identifying the output device determined in the first determination process or the second determination process. The program is identified by a first receiving process for receiving a designation operation for designating one of the cooperation operation information stored in the memory through the input interface, and the input device information included in the specified cooperation operation information. The input device performs the input instruction process of transmitting the input instruction information through the second communication interface to the portable terminal. The input instruction information is information for executing an input operation that causes the input device to input target data to be transmitted to the mobile terminal. The program is identified by a reception process of receiving the target data from the input device through the second communication interface as a response to the input instruction information, and the output device information included in the specified cooperation operation information. The output device causes the portable terminal to execute an output instruction process of transmitting output instruction information through the second communication interface. The output instruction information is information for executing an output operation of outputting the target data received in the reception process.

  According to the above configuration, the user can specify the input device and the output device to execute the cooperative operation through the input interface, and bring the mobile terminal close to a range where close proximity wireless communication with a desired external device is possible. Can also be specified. Thereby, for example, the external device in front of the user can be easily designated.

  A program according to another aspect of the present specification has a communication distance longer than the close proximity wireless communication with a memory, an input interface, a first communication interface that performs close proximity wireless communication with an external device, and an external device. It is readable by a mobile terminal having a second communication interface for wireless communication. The program causes the portable terminal to execute a first acceptance process of accepting a designation operation for designating one of the cooperation operation information stored in the memory through the input interface. The cooperation operation information includes at least one of input device information for identifying an input device and output device information for identifying an output device. The program receives, in response to receiving the specified operation in the first reception process, an instruction to execute a cooperative operation according to the specified cooperative operation information, through the input interface or the first communication interface. 2 accepting process, and in response to accepting the execution instruction through the first communication interface in the second accepting process, the connection device connected in proximity wireless communication with the first communication interface is connected to the input device or the output device. The mobile terminal is caused to execute a first determination process for determining the device. The execution instruction through the first communication interface causes the connection device, which is one of the plurality of external devices that can communicate through the second communication interface, to perform close proximity wireless connection with the first communication interface. is there. The program transmits input instruction information through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information or the input device determined in the first determination process. The portable terminal is caused to execute the input instruction processing. The input instruction information is information for executing an input operation that causes the input device to input target data to be transmitted to the mobile terminal. The program is identified by a reception process of receiving the target data from the input device through the second communication interface as a response to the input instruction information, and the output device information included in the specified cooperation operation information. The portable terminal is caused to execute the output instruction process of transmitting the output instruction information through the second communication interface to the output device or the output device determined in the first determination process. The output instruction information is information for executing an output operation of outputting the target data received in the reception process.

  According to the above configuration, by bringing the mobile terminal closer to the desired external device, the cooperative operation is executed using the external device as a temporary input device or output device. Thereby, for example, the cooperative operation in which the external device in front of the user's eyes is temporarily used as the input device or the output device can be executed with a small number of operations.

FIG. 1 is a schematic diagram of a system 100 according to this embodiment. 2A is a block diagram of the multi-function device 10, and FIG. 2B is a block diagram of the mobile terminal 50. 3A and 3B are examples of data stored in the data storage areas 32B and 62B. FIG. 3A is device information of the multifunction device 10A, FIG. 3B is device information of the multifunction device 10B, and FIG. Show a list. FIG. 4 is a flowchart of the registration process. FIG. 5 is a flowchart of the NFC registration process. FIG. 6 is a flowchart of the cooperation instruction process. 7A and 7B are display examples of the display 53, where FIG. 7A shows a registration screen and FIG. 7B shows a device selection screen. FIG. 8 is a display example of the display 53, (A) shows an operation selection screen, and (B) shows a cooperation operation screen corresponding to a cooperation operation record including both an input device ID and an output device ID. 9A and 9B are display examples of the display 53. FIG. 9A shows a cooperative operation screen corresponding to a cooperative operation record including only the output device ID, and FIG. 9B corresponds to a cooperative operation record including only the input device ID. The cooperation operation screen is shown.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be appropriately changed without changing the gist of the present invention. For example, the execution order of each process described below can be appropriately changed without changing the gist of the present invention.

  FIG. 1 is a schematic diagram of a system 100 according to this embodiment. The system 100 shown in FIG. 1 includes multifunction devices 10A and 10B (hereinafter, these may be collectively referred to as “multifunction device 10”), a mobile terminal 50, and a server 80. .. The multi-function device 10, the mobile terminal 50, and the server 80 can communicate with each other via a communication network. The specific example of the communication network is not particularly limited, but may be, for example, the Internet 101, a wired LAN, a wireless LAN 102, or a combination thereof.

  The multifunction device 10 and the mobile terminal 50 belong to the wireless LAN 102. That is, the multi-function device 10 and the portable terminal 50 can communicate with each other via an access point (not shown) of the wireless LAN 102. Further, the wireless LAN 102 is connected to the Internet 101 via the router 102A. Further, the server 80 is connected to the internet 101. That is, the multi-function device 10 and the portable terminal 50 can communicate with the server 80 from the router 102A via the Internet 101.

  As shown in FIG. 2A, the multi-function device 10 includes a printer 11, a scanner 12, a display 23, an input I / F 24, an NFC communication I / F 25, a Wi-Fi communication I / F 26, It mainly includes a CPU 31, a memory 32, and a communication bus 33. The respective constituent elements of the multifunction peripheral 10 are connected to each other via the communication bus 33. The configurations of the multifunction peripherals 10A and 10B may be the same or different.

  The printer 11 executes a print operation for recording an image represented by image data on a sheet. As a recording method of the printer 11, a known method such as an inkjet method or an electrophotographic method can be adopted. The scanner 12 performs a scanning operation of reading an image recorded on a document and generating image data. The multifunction device 10 may further include a FAX unit capable of executing the FAX transmission operation and the FAX reception operation. The multifunction device 10 may include only one of the printer 11 and the scanner 12 and may not include the other.

  The input I / F 24 is a user interface that receives an input operation by the user. Specifically, the input I / F 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Furthermore, the input I / F 24 may include a film-shaped touch sensor that is superimposed on the display surface of the display 23. The operation of designating an object displayed on the display surface of the display 23 and the operation of inputting a character string or a numerical string are examples of user operations. The “object” is, for example, a character string displayed on the display 23, an icon, a button, a link, or the like.

  The input I / F 24, which is realized as a touch sensor, outputs position information indicating the position touched by the user on the display surface. It should be noted that the term “touch” in this specification includes all operations for bringing the input medium into contact with the display surface. In addition, even if the input medium does not touch the display surface, "hover" or "floating touch" that brings the input medium close to a position where the distance between the input surface and the display surface is very small is referred to as the above-mentioned "touch" concept. May be included. Further, the input medium may be a user's finger, a touch pen, or the like. The user operation of tapping the position of the icon displayed on the display 23 is an example of a specifying operation for specifying the icon.

  The NFC communication I / F 25 is an example of a first communication interface capable of transmitting / receiving a wireless signal to / from an external device. That is, the multi-function peripheral 10 transmits various information to the mobile terminal 50 through the NFC communication I / F 25 and receives various information from the mobile terminal 50 through the NFC communication I / F 25. Note that the communication range of wireless communication through the NFC communication I / F 25 (hereinafter referred to as “NFC communication”) is the wireless communication through the Wi-Fi communication I / F 26 (hereinafter referred to as “Wi-Fi communication”). It is narrower than the communication range. The communication speed of NFC communication is slower than the communication speed of Wi-Fi communication.

  The NFC communication I / F 25 is an interface for performing wireless communication in the near field wireless system. The NFC communication I / F 25 performs wireless communication conforming to the NFC standard. NFC communication is an example of near field communication. The NFC communication I / F 25 is equipped with an IC chip having a memory that stores information to be transferred to and from an external device. The NFC standard is an example of a close proximity wireless transfer protocol. Further, the TransferJet (registered trademark of TransferJet Consortium) standard may be adopted instead of the NFC standard.

  The Wi-Fi communication I / F 26 is an example of a second communication interface capable of communicating with an external device. The multi-function device 10 outputs various information to the mobile terminal 50 through the Wi-Fi communication I / F 26 and receives various information from the mobile terminal 50 through the Wi-Fi communication I / F 26. The communication distance of Wi-Fi communication is longer than the communication distance of NFC communication. The communication speed of Wi-Fi communication is faster than the communication speed of NFC communication.

  The Wi-Fi communication I / F 26 is capable of indirect wireless communication by wirelessly communicating with an external device through a communication network. More specifically, the Wi-Fi communication I / F 26 can wirelessly communicate with an external device via a relay device such as an access point. Further, the Wi-Fi communication I / F 26 may be capable of direct wireless communication by wirelessly communicating with an external device without passing through a relay device. Among Wi-Fi communications, wireless communication that does not pass through a relay device is referred to as “Wi-Fi direct communication”. Although the specific communication procedure of the Wi-Fi communication I / F 26 is not particularly limited, for example, Wi-Fi may be adopted for indirect wireless communication and Wi-Fi direct may be adopted for direct wireless communication.

  The CPU 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires various programs, which will be described later, from the memory 32 based on various information output from the input I / F 24, various information received from an external device through the communication I / Fs 25 and 26, and executes the programs. The CPU 31 and the memory 32 form an example of a control unit.

  The memory 32 has a program storage area 32A and a data storage area 32B. An OS 34 and a device program 35 are stored in the area 32A. The device program 35 may be a single program or an aggregate of a plurality of programs. The area 32B stores data or information necessary for executing the device program 35. The memory 32 is configured by, for example, a RAM, a ROM, an EEPROM, an HDD, a portable storage medium such as a USB memory that is attached to and detached from the multifunction device 10, a buffer included in the CPU 31, or the like, or a combination thereof.

  The memory 32 may be a computer-readable storage medium. The computer-readable storage medium is a non-transmission medium. In addition to the above examples, the non-transmission medium also includes a recording medium such as a CD-ROM and a DVD-ROM. The non-transmission medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server or the like on the Internet 101 is a computer-readable signal medium that is a kind of computer-readable medium, but can be read by a non-transitory computer. Not included in storage media. The same applies to the memory 62 of the mobile terminal 50 described later.

  The area 32B can store device information including a device ID and a motion ID, as shown in FIG. 3 (A) or FIG. 3 (B). The device ID is an example of device identification information for identifying the multifunction peripheral 10. In this embodiment, the multifunction device 10A is identified by the device ID “MFP-A”, and the multifunction device 10B is identified by the device ID “MFP-B”. The action ID is an example of action identification information for identifying an action that can be executed by the multifunction machine 10 identified by the corresponding device ID. The print operation is identified by the operation ID “print”, and the scan operation is identified by the operation ID “scan”.

  FIG. 3A is an example of the device information stored in the area 32B of the multi-function peripheral 10A, and shows that the multi-function peripheral 10A can execute the print operation and the scan operation. FIG. 3B is an example of the device information stored in the area 32B of the multi-function peripheral 10B and shows that the multi-function peripheral 10B can execute the scan operation. The device information is set, for example, by the manufacturer of the multifunction device 10 before shipping.

  As shown in FIG. 2B, the portable terminal 50 communicates with the display 53, the input I / F 54, the NFC communication I / F 55, the Wi-Fi communication I / F 56, the CPU 61, the memory 62, and the communication. The bus 63 is mainly provided. The display 53, the input I / F 54, the NFC communication I / F 55, the Wi-Fi communication I / F 56, the CPU 61, the memory 62, and the communication bus 63 included in the mobile terminal 50 are the display 23 and the input I included in the multifunction peripheral 10. / F24, NFC communication I / F25, Wi-Fi communication I / F26, CPU 31, memory 32, and communication bus 33 have the same configurations, and therefore description thereof will be omitted. The CPU 61 and the memory 62 are an example of a control unit.

  The mobile terminal 50 is, for example, a mobile phone, a smartphone, a tablet terminal, or the like. More specifically, the display 53 of the mobile terminal 50 preferably has a display screen size of 12 inches or less, more preferably 8 inches or less. Further, it is desirable that the input I / F 54 of the portable terminal 50 is a touch sensor that is overlaid on the display screen of the display 53.

  The area 62A stores an OS 64 and a terminal program 65. The OS 64 may be, for example, Android (registered trademark of Google inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like.

  The terminal program 65 is a program that causes the input device and the output device designated by the user to execute the cooperative operation. The input device is a device that executes an input operation of inputting target data to be transmitted to the mobile terminal 50. The output device is a device that performs an output operation of outputting the target data received from the mobile terminal 50. That is, the terminal program 65 receives the target data from the input device by causing the input device to perform the input operation. Next, the terminal program 65 causes the output device to execute the output operation by transmitting the target data received from the input device to the output device. The multifunction device 10 and the server 80 are devices that can be an input device and an output device.

  The input operation of the multifunction device 10 functioning as an input device refers to, for example, an operation in which the scanner 12 generates target data to be transmitted to the mobile terminal 50. The input operation of the server 80 functioning as an input device refers to, for example, an operation of reading target data to be transmitted to the mobile terminal 50 from a memory included in the server 80 (hereinafter, also referred to as “server memory”). The operation of causing the scanner 12 to generate the target data and the operation of reading the target data from the server memory are examples of the operation of inputting the target data to the input device. The multifunction device 10 including the FAX unit may perform an input operation of transmitting the target data received by the FAX unit to the mobile terminal 50.

  The output operation of the multi-function device 10 functioning as an output device refers to, for example, an operation in which the printer 11 records an image indicated by target data received from the portable terminal 50 on a sheet. The output operation of the server 80 functioning as an output device refers to, for example, an operation in which the server 80 stores the target data received from the portable terminal 50 in the server memory. Further, the multifunction device 10 including the FAX unit may execute an output operation in which the FAX unit transmits the target data received from the portable terminal 50 by FAX.

  The area 62B can store a linked operation list, for example, as shown in FIG. The cooperation operation list includes one or more cooperation operation records. The cooperation operation record includes at least one of an input device ID and an output device ID that are associated with each other. The cooperation operation record is an example of cooperation operation information. The cooperation operation record according to this embodiment can include one or less input device IDs and two or less output device IDs. However, the number of output device IDs included in the cooperation operation record may be one, or may be three or more.

  The input device ID is an example of input device information for identifying the input device designated through the input I / F 54 or the NFC communication I / F 55. The output device ID is an example of output device information for identifying the output device designated through the input I / F 54 or the NFC communication I / F 55. The input device ID and the output device ID may be in the URL format, for example. When the terminal program 65 is installed, no cooperation operation record is stored in the area 62B. Then, the terminal program 65 registers the cooperative operation record generated in accordance with the instruction of the user in the cooperative operation list in the registration processing described later.

  The server 80 is a so-called storage server. More specifically, for example, the server 80 stores the data received from the mobile terminal 50 in the server memory, reads the data designated by the mobile terminal 50 from the server memory, and transmits the data to the mobile terminal 50. In the present embodiment, the server 80 is identified by the device ID “server C”. The server 80 provides services such as "Evernote (registered trademark of Evernote Corporation)", "Dropbox (registered trademark of DropBox, Inc.)", "Google Drive (Google is a registered trademark of Google, Inc.)", and the like. It may be provided.

  In this specification, a device capable of communicating in the procedure conforming to the NFC standard is referred to as “NFC device”, and communication performed in the procedure conforming to the NFC standard is referred to as “NFC communication”. That is, the multi-function peripheral 10 and the mobile terminal 50 are examples of NFC devices.

  The NFC communication I / F 55 of the mobile terminal 50 in the present embodiment executes the Poll operation. The Poll operation is an operation of repeatedly outputting a polling signal at a predetermined time interval and monitoring a response signal which is a response to the polling signal. On the other hand, the NFC communication I / F 25 of the multifunction machine 10 in the present embodiment executes the Listen operation. The Listen operation is an operation of monitoring a polling signal and outputting a response signal on condition that the polling signal is received.

  The NFC communication I / F 25 of the multifunction device 10 receives the polling signal output by the NFC communication I / F 55 of the portable device 50 due to the proximity of the multifunction device 10 and the mobile terminal 50, and the NFC communication I / F of the multifunction device 10 The NFC communication I / F 55 of the portable terminal 50 receives the response signal output by F25. As a result, an NFC communication link (hereinafter referred to as “NFC link”) is established between the multi-function device 10 and the portable terminal 50 by a predetermined procedure according to the NFC standard. After that, the multi-function device 10 and the portable terminal 50 transmit and receive information and the like through this NFC link.

[Operation of system 100]
The operation of the system 100 according to the present embodiment will be described with reference to FIGS. 4 to 6. At the start of the processing shown in FIGS. 4 and 6, the NFC communication I / F 25 of the multifunction device 10 has already executed the Listen operation, and the NFC communication I / F 55 of the portable terminal 50 has executed the Poll operation. Not yet.

  The flowchart in this specification basically shows the processing of the CPUs 31 and 61 according to the instructions described in the program. That is, the processes such as “determination”, “extraction”, “selection”, and “control” in the following description represent the processes of the CPUs 31 and 61. The processing by the CPU 61 also includes hardware control via the OS 64. Further, “data” in this specification is represented by a computer-readable bit string. Data having substantially the same meaning and different formats are treated as the same data. The same applies to "information" in this specification.

[registration process]
First, the terminal program 65 can execute a registration process. The registration process is a process of registering the cooperation operation record generated according to the user's instruction in the cooperation operation list. Details of the registration process will be described with reference to FIG.

  First, the terminal program 65 displays the registration screen shown in FIG. 7A on the display 53 (S11). Then, the terminal program 65 receives a user operation on the registration screen through the input I / F 54 (S12). Further, the terminal program 65 causes the NFC communication I / F 55 to start the Poll operation. That is, the NFC communication I / F 55 repeatedly outputs the polling signal at a predetermined time interval.

  The registration screen includes a message "Tap the icon or hold it over the device.", A [+ input] icon 111, a [+ output] icon 112, and a [registration] icon 113. The [+ input] icon 111 corresponds to an instruction to specify an input device. The [+ output] icon 112 corresponds to an instruction to specify an output device. The [Register] icon 113 corresponds to an instruction to register the cooperative operation record in the cooperative operation list.

  Next, the terminal program 65 displays the device selection screen shown in FIG. 7B in response to receiving the designation of the [+ input] icon 111 through the input I / F 54 (S12: [+] icon). It is displayed on 53 (S13). Then, the terminal program 65 receives a user operation on the device selection screen through the input I / F 54 (S14). Further, the terminal program 65 causes the NFC communication I / F 55 to end the Poll operation.

  The device selection screen when the [+ input] icon 111 is specified includes the device icons 121, 122, and 123. The device icons 121, 122, 123 correspond to the multifunction peripherals 10A, 10B and the server 80, which can be input devices. The device icons 121 to 123 describe the device ID of the corresponding device. The device icons 121 to 123 may describe the name of the corresponding device.

  The terminal program 65 may search the multifunction peripheral 10 belonging to the wireless LAN 102 using a protocol such as SNMP, and receive the device ID and the operation ID from the multifunction peripheral 10 discovered through the Wi-Fi communication I / F 26. Further, the terminal program 65 may read the device ID of the server 80 from the area 62B when the account of the server 80 is stored in the area 62B. The device ID of a device that can be an input device may be registered in the terminal program 65 in advance.

  Next, the terminal program 65 is identified by the device ID “MFP-B” corresponding to the device icon 122, for example, in response to receiving the designation of the device icon 122 through the input I / F 54 (S14: Yes). The machine 10B (hereinafter sometimes referred to as "designated device") is determined as the input device (S15). That is, the terminal program 65 temporarily stores the device ID “MFP-B” corresponding to the specified device icon 122 in the area 62B as the input device ID. Then, the terminal program 65 displays the registration screen on the display 53 (S11). The registration screen displayed here differs from the registration screen shown in FIG. 7A in that it includes a [MFP-B] icon in place of the [+ input] icon 111. The [MFP-B] icon corresponds to the input device ID temporarily stored in step S15.

  Further, the terminal program 65 executes the processes of steps S13 to S15 in response to the designation of the [+ output] icon 112 received through the input I / F 54 (S12: [+] icon). In the following, a detailed description of the common points with the case where the [+ input] icon 111 is designated is omitted, and the differences will be mainly described. The designation of the device icons 121 to 123 is an example of a user operation for designating an input device or an output device. The processing of steps S13 to S15 is an example of the first determination processing.

  The device selection screen when the [+ output] icon 112 is specified includes device icons 121 and 123 corresponding to the multifunction machine 10A that can be an output device and the server 80. In addition, the terminal program 65 causes the server 80 identified by the device ID “server C” corresponding to the device icon 123, for example, in response to receiving the designation of the device icon 123 through the input I / F 54 (S14: Yes). , Output device is determined (S15). That is, the terminal program 65 temporarily stores the device ID “server C” corresponding to the specified device icon 123 as the output device ID in the area 62B. Then, the terminal program 65 displays the registration screen on the display 53 (S11). The registration screen displayed here is different from the registration screen shown in FIG. 7A in that the registration screen further includes a [Server C] icon. The [Server C] icon corresponds to the output device ID temporarily stored in step S15.

  Further, the terminal program 65 receives the designation of the [registration] icon 113 through the input I / F 54 (S12: [registration] icon), and in step S15, or in steps S35, S37, S39, and S40 described below. A cooperation operation record including the temporarily stored information is added to the cooperation operation list (S16). Further, the terminal program 65 may include the registration information received in step S31 described below in the cooperation operation record. The same applies to step S19 described later. The processing of steps S16 and S19 is an example of registration processing.

  Although not shown, the terminal program 65 may include the operation ID and the operation parameter in the cooperative operation record. As an example, when the device ID of the multifunction peripheral 10B is stored as the input device ID, the terminal program 65 includes the operation ID “scan” and the operation parameter (for example, reading resolution) of the scan operation in the cooperative operation record. .. As another example, when the device ID of the server 80 is stored as the output device ID, the terminal program 65 operates in cooperation with the operation ID “memory storage” and the operation parameter (for example, folder name) of the memory storage operation. Include in record. The operation ID of the server 80 may be registered in the terminal program 65 in advance. The terminal program 65 may allow the user to specify the operation parameter to be included in the cooperation operation record in a step (not shown).

  On the other hand, the terminal program 65 receives a response signal from the multifunction peripheral 10A through the NFC communication I / F 55 that is executing the Poll operation, for example, when the user brings the mobile terminal 50 closer to the multifunction peripheral 10A (S12: to the device). Hold over). Next, the terminal program 56 establishes an NFC link with the multifunction peripheral 10A that is the transmission source of the response signal. Receiving a response signal from the multi-function peripheral 10A or establishing the NFC link is an example of the NFC communication I / F 55 and the multi-function peripheral 10A being connected by close proximity wireless transfer.

  Next, the terminal program 65 executes the NFC registration process in response to the NFC communication I / F 55 and the multifunction peripheral 10A being in close proximity wireless connection (S17). The NFC registration process is a process of determining the multifunction peripheral 10A (hereinafter, also referred to as a “connection device”) that is connected to the NFC communication I / F 55 via close proximity wireless transfer as an input device or an output device. In step S12, the operation of bringing the portable terminal 50 closer to the range where NFC communication with the multifunction peripheral 10A is possible is an example of an operation of designating the multifunction peripheral 10A as an input device or an output device through the NFC communication I / F 55. The process of step S17 is an example of the second determination process. Details of the NFC registration process will be described with reference to FIG.

  First, the terminal program 65 receives the connection information from the multifunction peripheral 10A that is connected to the proximity wireless communication through the NFC communication I / F 55. The connection information is information necessary for making a Wi-Fi direct connection with the multifunction peripheral 10A. The connection information may be, for example, an IP address, a MAC address, an SSID, or the like. Then, the terminal program 65 makes a Wi-Fi direct connection with the multifunction peripheral 10A using the received connection information (S31). Further, the terminal program 65 causes the NFC communication I / F 55 to end the Poll operation.

  Next, the terminal program 65 receives the device information from the multifunction peripheral 10A through the Wi-Fi communication I / F 56 directly connected to the Wi-Fi (S32). Then, the terminal program 65 temporarily stores the connection information received in step S31 and the device information received in step S32 in the area 62B in association with each other. Note that the terminal program 65 may receive both the connection information and the device information from the multifunction peripheral 10A via the NFC communication I / F 55 in step S31.

  Next, the terminal program 65 determines the operation that can be executed by the multifunction peripheral 10A that is the connection device (S33, S36). That is, the terminal program 65 determines whether or not the device information received in step S32 includes the action ID “scan” corresponding to the input action, and whether or not the action ID “print” corresponding to the output action is included. To judge. The processing of steps S33 and S36 is an example of the first determination processing.

  In addition, the terminal program 65 determines whether the input device has already been determined (S34). That is, the terminal program 65 determines whether the input device ID is temporarily stored in the area 62B. The state in which the input device has already been determined is an example of the first determined state. The process of step S34 is an example of the second determination process.

  Furthermore, the terminal program 65 determines whether or not the number of output devices that has already been determined reaches a threshold value (for example, 2) (S38). That is, the terminal program 65 determines whether the number of output device IDs temporarily stored in the area 62B has reached the threshold value. The state in which the number of output devices that has already been determined reaches the threshold value is an example of the second determined state. The process of step S38 is an example of the third determination process.

  Then, the terminal program 65 determines that the connection device is the input device in response to the determination that the multifunction peripheral 10A can execute the input action and is not in the first determination state (S33: input action & S34: No). (S35). That is, the terminal program 65 temporarily stores the device ID “MFP-A” of the multifunction peripheral 10A as the input device ID in the area 62B.

  In addition, the terminal program 65 is capable of executing only the input operation, and in response to determining that the input program is in the first determined state (S33: input operation & S34: Yes & S36: No), the already determined input device is connected to the connection device. (S37). That is, the terminal program 65 overwrites the input device ID already stored in the area 62B with the device ID “MFP-A” of the multifunction peripheral 10A.

  In addition, the terminal program 65 is capable of executing both the input operation and the output operation, and in response to determining that the terminal program 65 is in the first determined state and not in the second determined state (S33: input operation & S34: Yes & S36: Yes & S38. : No), the connection device is determined as the output device (S39). Alternatively, the terminal program 65 determines that the connected device is the output device in response to the determination that it is possible to execute only the output operation and is not in the second determined state (S33: Output operation only & S38: No) (S39). ). That is, the terminal program 65 temporarily stores the device ID “MFP-A” of the multifunction peripheral 10A as the output device ID in the area 62B.

  Further, the terminal program 65 can execute both the input operation and the output operation, and in response to determining that the terminal program 65 is in the first determined state and the second determined state (S33: input operation & S34: Yes & S36: Yes & S38: Yes), one of the output devices is changed to the connection device (S40). Alternatively, in response to the terminal program 65 determining that it is capable of executing only the output operation and is in the second determination state (S33: output operation only & S38: Yes), one of the output devices is set as the connection device. Change (S40). That is, the terminal program 65 overwrites one of the output device IDs already stored in the area 62B with the device ID “MFP-A” of the multifunction peripheral 10A.

  As an example, in step S40, the terminal program 65 may change the first determined output device among the plurality of already determined output devices to the connection device. As another example, the terminal program 65 may accept, through the input I / F 54, a user operation for designating one of the plurality of output devices already determined in step S40. Then, the terminal program 65 may change the designated output device to a connection device.

  The terminal program 65 may inquire of the user through the display 53 whether or not to change the input device or the output device, prior to the processing of steps S37 and S40. Then, the terminal program 65 may execute the processes of steps S37 and S40 in response to receiving a user operation instructing to change the input device or the output device through the input I / F 54.

  Next, returning to FIG. 4, the terminal program 65 determines whether both the input device and the output device have been determined in response to the execution of the NFC registration process (S17) (S18). That is, the terminal program 65 determines whether both the input device ID and the output device ID are temporarily stored in the area 62B. The process of step S18 is an example of the fourth determination process. Then, in response to determining that one of the input device and the output device has not been determined yet (S18: No), the terminal program 65 executes the processes of step S11 and thereafter.

  On the other hand, when the terminal program 65 determines that both the input device and the output device are determined as a trigger (S18: Yes), the cooperative operation record including the input device ID and the output device ID temporarily stored in the area 62B. Is added to the linked operation list (S19). Further, the terminal program 65 causes the input device and the output device indicated by the cooperation operation record registered in step S19 to execute the cooperation operation (S20). That is, when the terminal program 65 determines that both the input device and the output device have been determined, the terminal program 65 executes the processes of steps S19 and S20 without waiting for an instruction from the user. In step S20, the terminal program 65 executes the processes of steps S56, S57, and S58 described below.

  As described above, the user of the mobile terminal 50 can specify the icons 111 to 113 and 121 to 123 displayed on the display 53 through the input I / F 54, and the mobile terminal 50 within a range where NFC communication with an external device is possible. Can be added to the cooperation operation list by one or both of bringing the operations close to each other. It should be noted that the terminal program 65 includes a cooperative operation record including both the input device ID and the output device ID, a cooperative operation record including only the input device ID of the input device ID and the output device ID, the input device ID and the output device ID. A cooperative operation record including only the output device ID can be added to the cooperative operation list according to the user's instruction.

[Cooperation instruction processing]
Further, the terminal program 65 can execute the cooperation instruction process. The cooperation instruction process is a process of causing the input device and the output device to execute the cooperation operation according to the cooperation operation record specified by the user. Details of the cooperation instruction process will be described with reference to FIG. 6.

  First, the terminal program 65 displays the operation selection screen shown in FIG. 8A on the display 53 (S51). The operation selection screen includes cooperation icons 131, 132, 133. Each of the cooperation icons 131 to 133 corresponds to one of the cooperation operation records shown in FIG. Further, in the cooperation icons 131 to 133, the input device ID and the output device ID included in the corresponding cooperation operation record are described. Then, the terminal program 65 receives a user operation on the operation selection screen through the input I / F 54 (S52). The process of step S52 is an example of the first reception process.

  In response to the designation of the cooperation icon 133 received through the input I / F 54 (S52: input / output device exists), the terminal program 65 reads a cooperation operation record corresponding to the specified cooperation icon 133 from the cooperation operation list. Next, the terminal program 65 causes the display 53 to display the cooperative operation screen shown in FIG. 8B (S53). In the cooperative operation screen shown in FIG. 8B, the message “Tap [Start] or hold it over the output device.” And the input device ID “MFP-B” included in the read cooperative operation record. ”, An output device ID“ Server C ”, and a [Start] icon 140.

  Further, the terminal program 65 causes the NFC communication I / F 55 to start the Poll operation. Then, the terminal program 65 receives an instruction to execute the cooperative operation according to the specified cooperative operation record through the input I / F 54 or the NFC communication I / F 55 (S54). The process of step S54 is an example of the second reception process.

  Next, the terminal program 65 acquires the input device ID “MFP-B” from the read cooperation operation record in response to receiving the designation of the “start” icon 140 through the input I / F 54 (S54: start icon). To do. Then, the terminal program 65 transmits the input instruction information through the Wi-Fi communication I / F 56 to the multifunction machine 10B identified by the acquired input device ID "MFP-B" (S56).

  The input instruction information is information for instructing the multifunction device 10B, which is an input device, to execute an input operation. That is, the input instruction information according to the present embodiment is information for instructing the scanner 12 of the multifunction peripheral 10B to execute the scan operation. The input instruction information includes, for example, a motion ID and a motion parameter included in the cooperative motion record. The process of step S56 is an example of the input instruction process. The designation of the [start] icon 140 is an example of an execution instruction through the input I / F 54.

  On the other hand, although illustration is omitted, the device program 35 of the multifunction peripheral 10B receives the input instruction information from the portable terminal 50 through the Wi-Fi communication I / F 26. Then, the device program 35 causes the multifunction peripheral 10B to perform the input operation according to the received input instruction information. More specifically, the scanner 12 of the multi-function peripheral 10B reads the image recorded on the document set on the scanner 12 to generate the target data. Then, the device program 35 transmits the target data as a response to the input instruction information to the mobile terminal 50 through the Wi-Fi communication I / F 26.

  Next, the terminal program 65 of the mobile terminal 50 receives the target data, which is a response to the input instruction information, from the multifunction peripheral 10B through the Wi-Fi communication I / F 56 (S57). Then, the terminal program 65 temporarily stores the received target data in the area 62B. The process of step S57 is an example of the receiving process.

  Note that in steps S56 and S57, the communication between the mobile terminal 50 and the multi-function device 10 may be indirect wireless communication or direct wireless communication. When the mobile terminal 50 and the multifunction device 10 directly wirelessly communicate with each other, the terminal program 65 uses the connection information included in the cooperative operation record to perform the Wi-Fi direct connection with the multifunction device 10 and the Wi-Fi direct connection Wi. -It may communicate with the multifunction peripheral 10 through the Fi communication I / F 56. The same applies to steps S58, S65, S66, and S71 described below.

  Next, the terminal program 65 acquires the output device ID “server C” from the read cooperation operation record. Then, the terminal program 65 transmits the output instruction information to the server 80 identified by the output device ID “server C” through the Wi-Fi communication I / F 56 (S58). The output instruction information is information for instructing the server 80, which is an output device, to execute the output operation. The output instruction information according to the present embodiment is information for instructing the server 80 to store the target data in the server memory. The output instruction information includes, for example, the operation ID and the operation parameter included in the cooperation operation record, and the target data. The process of step S58 is an example of the output instruction process.

  On the other hand, although not shown, the server 80 receives the output instruction information from the mobile terminal 50. Then, the server 80 stores the target data included in the output instruction information in the server memory. A program (not shown) having a function of communicating with the server 80 may be installed in the mobile terminal 50, and the terminal program 65 may instruct the program to transmit the output instruction information. Then, the program may transmit the output instruction information to the server 80 according to the instruction of the terminal program 65.

  On the other hand, the terminal program 65 is read in response to the close proximity wireless connection between the NFC communication I / F 55 and the multifunction peripheral 10A (S54: NFC link) while the cooperative operation screen is displayed on the display 53. Instead of the server 80 indicated by the cooperation operation record, the multifunction peripheral 10A is determined as a temporary output device (S55). More specifically, the terminal program 65 overwrites the output device ID “server C” included in the read cooperation operation record with the device ID “MFP-A” of the multifunction peripheral 10A that is connected in proximity wireless communication. However, the cooperation operation record included in the cooperation operation list is not changed. Note that, for example, the terminal program 65 does not execute the process of step S55 in response to determining that the output device ID included in the cooperation operation record is the same as the device ID of the device connected in proximity wireless communication, The same processing as when the Start icon 140 is designated may be executed.

  In step S54, bringing the portable terminal 50 closer to a range where NFC communication with the multifunction peripheral 10A is possible is to specify an output device through the NFC communication I / F 55, and an example of an execution instruction through the NFC communication I / F 55. is there. The process of step S55 is an example of the first determination process. Further, the terminal program 65 causes the NFC communication I / F 55 to end the Poll operation.

  Then, the terminal program 65 executes the processes of steps S56 to S58. The only difference from the above processing is that the destination of the output instruction information is the multifunction peripheral 10A. The output instruction information in this case is information for instructing the multifunction peripheral 10A to perform the print operation for the target data. That is, the output instruction information in this case includes the operation ID and the operation parameter included in the cooperation operation record, and the target data.

  On the other hand, although not shown, the device program 35 of the multifunction peripheral 10A receives the output instruction information from the portable terminal 50 through the Wi-Fi communication I / F 26. The device program 35 causes the multifunction peripheral 10A to perform the output operation according to the received output instruction information. More specifically, the printer 11 of the multifunction peripheral 10A records the image indicated by the target data included in the output instruction information on the sheet.

  Further, in response to the designation of the cooperation icon 132 received through the input I / F 54 (S52: output device only), the terminal program 65 reads a cooperation operation record corresponding to the specified cooperation icon 132 from the cooperation operation list. .. Next, the terminal program 65 causes the display 53 to display the cooperative operation screen shown in FIG. 9A (S59). The cooperation operation screen shown in FIG. 9A shows a message "Hold over the input device.", An input device ID "*" and an output device ID "server C" included in the read cooperation operation record. including. The input device ID “*” indicates that the input device has not yet been determined. Then, the terminal program 65 causes the NFC communication I / F 55 to start the Poll operation.

  Next, the terminal program 65 determines the multifunction device 10A as a temporary input device in response to the close proximity wireless connection between the NFC communication I / F 55 and the multifunction device 10A (S60: Yes) (S61). More specifically, the terminal program 65 includes, as the input device ID, the device ID “MFP-A” of the multifunction peripheral 10A that is connected in the proximity wireless communication in the read cooperation operation record. However, the cooperation operation record included in the cooperation operation list is not changed.

  In step S60, bringing the portable terminal 50 closer to a range where NFC communication with the multifunction peripheral 10A is possible is to specify an input device through the NFC communication I / F 55, and an example of an execution instruction through the NFC communication I / F 55. is there. The process of step S60 is an example of the first determination process. Further, the terminal program 65 causes the NFC communication I / F 55 to end the Poll operation.

  Then, the terminal program 65 executes the processes of steps S56 to S58. That is, the terminal program 65 causes the multifunction peripheral 10A, which is the input device determined in step S61, to perform the input operation, and outputs to the server 80 identified by the output device ID “server C” included in the read cooperation operation record. Perform an action.

  Further, in response to the designation of the cooperation icon 131 received through the input I / F 54 (S52: input device only), the terminal program 65 reads a cooperation operation record corresponding to the specified cooperation icon 131 from the cooperation operation list. .. Next, the terminal program 65 causes the display 53 to display the cooperative operation screen shown in FIG. 9B (S62). In the cooperative operation screen shown in FIG. 9B, the message “Tap [Start] or hold it over the output device.” And the input device ID “MFP-B” included in the read cooperative operation record. And the output device ID “*”. The output device ID “*” indicates that the output device has not yet been determined.

  Further, the terminal program 65 causes the NFC communication I / F 55 to start the Poll operation. Then, the terminal program 65 receives an instruction to execute the cooperative operation according to the specified cooperative operation record through the input I / F 54 or the NFC communication I / F 55 (S63). The process of step S63 is an example of the second reception process.

  Next, the terminal program 65 determines the multifunction peripheral 10A as a temporary output device in response to the close proximity wireless connection between the NFC communication I / F 55 and the multifunction peripheral 10A (S63: NFC link) (S64). .. More specifically, the terminal program 65 includes, as the output device ID, the device ID “MFP-A” of the multifunction peripheral 10A that is connected to the close proximity wireless transfer in the read cooperation operation record. However, the cooperation operation record included in the cooperation operation list is not changed.

  In step S64, bringing the portable terminal 50 closer to a range where NFC communication with the multifunction peripheral 10A is possible is to specify an output device through the NFC communication I / F 55, and an example of an execution instruction through the NFC communication I / F 55. is there. The process of step S64 is an example of the first determination process. On the other hand, when the terminal program 65 receives the designation of the [start] icon 140 through the input I / F 54 (S63: start icon), the process of step S64 is skipped. Further, the terminal program 65 causes the NFC communication I / F 55 to end the Poll operation.

  Then, the terminal program 65 executes the processes of steps S65 and S66. That is, the terminal program 65 causes the multifunction peripheral 10B identified by the input device ID “MFP-B” included in the read cooperation action record to perform the input action. The processes of steps S65 and S66 may be the same as steps S56 and S57.

  Next, the terminal program 65 determines whether the output device has already been determined (S67). More specifically, the terminal program 65 determines whether or not the read cooperation operation record includes the output device ID. When the process of step S64 is executed, the cooperation operation record includes the output device ID. On the other hand, when the process of step S64 is skipped, the cooperation operation record does not include the output device ID. Then, in response to the determination that the output device has not been determined yet (S67: No), the terminal program 65 causes the display 53 to display a proximity instruction screen (not shown) (S68). The proximity instruction screen includes, for example, a message "Please hold over the output device." Further, the terminal program 65 causes the NFC communication I / F 55 to start the Poll operation.

  Next, the terminal program 65 determines the multifunction device 10A as a temporary output device in response to the close proximity wireless connection between the NFC communication I / F 55 and the multifunction device 10A (S69: Yes) (S70). More specifically, the terminal program 65 includes, as the output device ID, the device ID “MFP-A” of the multifunction peripheral 10A that is connected to the close proximity wireless transfer in the read cooperation operation record. However, the cooperation operation record included in the cooperation operation list is not changed. Further, the terminal program 65 causes the NFC communication I / F 55 to end the Poll operation.

  In step S69, bringing the mobile terminal 50 closer to a range where NFC communication with the multifunction peripheral 10A is possible is an example of designating an output device through the NFC communication I / F 55. The process of step S70 is an example of the second determination process. On the other hand, when the terminal program 65 determines that the output device has already been determined (S67: Yes), the processes of steps S68 to S70 are skipped. Then, the terminal program 65 executes the process of step S71. That is, the terminal program 65 causes the output device determined in step S64 or step S70 to execute the output operation. The process of step S71 may be the same as that of step S58.

  Note that the terminal program 65 may inquire the user through the display 53 whether or not to temporarily change the input device or the output device, prior to the processing of steps S55, S61, S64, and S70. Then, the terminal program 65 executes the processes of steps S55, S61, S64, and S70 in response to receiving the user operation for instructing the temporary change of the input device or the output device through the input I / F 54. Good. Further, the terminal program 65 may update the read-out cooperation operation record so as to include the device ID of the device connected in proximity wireless communication in steps S55, S61, S64, and S70.

[Operation and effect of this embodiment]
According to the registration processing according to the above-described embodiment, the user can specify the input device and the output device to execute the cooperative operation through the input I / F 54, and the close proximity wireless communication with the desired external device is possible. It can also be designated by bringing the mobile terminal 50 closer to the range. Thereby, for example, the external device in front of the user can be easily designated.

  Further, according to the NFC registration processing according to the above-described embodiment, the connection device is suitable for either the input device or the output device depending on the operation that the connection device can perform and the determination status of the input device and the output device. Is decided. In the above embodiment, the example in which the determination to the input device is prioritized is shown, but the determination to the output device may be prioritized. Furthermore, the timing at which the NFC communication I / F 55 executes the Poll operation is not limited to the timing at which the registration screen is displayed. For example, the terminal program 65 may cause the NFC communication I / F 55 to execute the Poll operation while displaying the device selection screen.

  As an example, the terminal program 65 displays the device selection screen by designating the [+ input] icon 111, and when the NFC communication I / F 55 and the external device are in close proximity wireless connection, the external device concerned is displayed. May be determined as the input device. As another example, the terminal program 65 responds to the fact that the NFC communication I / F 55 and the external device are connected in close proximity wireless communication in a state where the device selection screen is displayed by designating the [+ output] icon 112. The external device may be determined as the output device.

  Further, according to the above-described embodiment, the cooperative operation record is registered and the cooperative operation is executed in response to the determination of both the input device and the output device by the NFC registration process. That is, since the close proximity wireless connection is further used as a trigger for starting the cooperative operation, for example, the cooperative operation using an external device in front of the user's eyes can be executed with a small number of operations. However, one of steps S19 and S20 may be omitted.

  Further, according to the cooperation instruction processing according to the above-described embodiment, by bringing the mobile terminal close to the desired external device, the cooperation operation using the external device as a temporary input device or output device is executed. Thereby, for example, the cooperative operation in which the external device in front of the user's eyes is temporarily used as the input device or the output device can be executed with a small number of operations.

  As an example, when a cooperation operation record including both an input device ID and an output device ID is specified, an external device connected by close proximity wireless transfer is determined as a temporary output device instead of the output device indicated by the cooperation operation record. To be done. However, both the output device indicated by the cooperation operation record and the external device connected by the close proximity wireless transfer may be caused to execute the output operation.

  As another example, when the cooperation operation record including only the output device ID is designated, the external device connected to the close proximity wireless transfer is determined as the temporary input device. As a result, when it is desired to fix the output device and frequently switch the input device to execute the cooperative operation, the input device can be switched with a small number of operations.

  As still another example, when the cooperation operation record including only the input device ID is designated, the external device connected by the close proximity wireless transfer is determined as the temporary output device. As a result, when the input device is fixed and the output device is frequently switched to execute the cooperative operation, the output device can be switched with a small number of operations.

  Further, in the cooperation instruction process according to the above-described embodiment, the timing at which the NFC communication I / F 55 executes the Poll operation is not limited to the above example. For example, the NFC communication I / F 55 may be caused to start the Poll operation in response to the input operation or the output operation not being normally completed, and the external device connected in proximity wireless communication may be caused to execute the input operation or the output operation.

  As an example, the terminal program 65 causes the NFC communication I / F 55 to start the Poll operation in response to not receiving the target data in the reception process (S57 / S66). Next, the terminal program 65 determines an external device, which is connected to the NFC communication I / F 55 via close proximity wireless transfer, as a temporary input device. This process is an example of the third determination process. Then, the terminal program 65 may cause the determined input device to execute the input operation. Note that the case where the target data cannot be received is, for example, the case where the Ack for the input instruction information cannot be received, or the case where the target data cannot be received even after a predetermined time has elapsed after the input instruction information was transmitted.

  As another example, the terminal program 65 causes the NFC communication I / F 55 to start a Poll operation in response to not receiving a response (for example, Ack) to the output instruction information from the output device through the Wi-Fi communication I / F 56. .. Next, the terminal program 65 determines an external device, which is connected to the NFC communication I / F 55 via close proximity wireless transfer, as a temporary output device. This process is an example of the fourth determination process. Then, the terminal program 65 may cause the determined output device to execute the output operation.

  Further, in the multifunction device 10 and the portable terminal 50 of the above-described embodiment, various programs stored in the program storage areas 32A and 62A of the memories 32 and 62 are executed by the CPUs 31 and 61, so that the control unit of the present invention operates. The example in which each process to be executed is realized has been described. However, the configuration of the control unit is not limited to this, and part or all of the configuration may be realized by hardware such as an integrated circuit.

  Furthermore, the present invention can be realized not only as the multifunction peripheral 10 and the mobile terminal 50, but also as a program that causes the multifunction peripheral 10 and the mobile terminal 50 to execute processing. Then, the program may be provided by being recorded in a non-transitory recording medium. The non-transitory recording medium may include a CD-ROM, a DVD-ROM, and the like, as well as a storage unit mounted in a server that can be connected to the multifunction peripheral 10 and the mobile terminal 50 via a communication network. Then, the program stored in the storage unit of the server may be distributed as information or a signal indicating the program through a communication network such as the Internet 101.

10 ... Multifunction device 11 ... Printer 12 ... Scanner 23, 53 ... Display 24, 54 ... Input I / F
25, 55 ... NFC communication I / F
26, 56 ... Wi-Fi communication I / F
31, 61 ... CPU
32, 62 ... Memory 35 ... Device program 50 ... Mobile terminal 65 ... Terminal program

Claims (13)

A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program is
A first determination process of determining, as an input device or an output device, a designated device designated through the input interface among the plurality of external devices that can communicate through the second communication interface;
Among the plurality of external devices that can communicate through the second communication interface, the portable device includes a second determination process that determines the connection device, which is in close proximity wireless connection with the first communication interface, as the input device or the output device. It is possible to make the terminal execute
The program causes the mobile terminal to execute a registration process of storing cooperation operation information including input device information and output device information in the memory, and the input device information is stored in the first determination process or the second determination process. The output device information is information for identifying the determined input device, the output device information is information for identifying the output device determined in the first determination process or the second determination process,
The program is
A first acceptance process for accepting a designation operation for designating one of the cooperation operation information stored in the memory through the input interface;
The input device identified by the input device information included in the specified cooperation operation information is caused to execute the input instruction process of transmitting the input instruction information through the second communication interface, and the mobile terminal executes the input instruction. The information is information for executing an input operation that causes the input device to input target data used for a linked operation with the output device,
The program is
The output device identified by the output device information included in the specified cooperation operation information is caused to cause the portable terminal to execute output instruction processing for transmitting output instruction information through the second communication interface, and the output instruction information is output. Is information for executing an output operation for outputting the target data,
The program, in the second determination process,
A first determination process of determining an operation executable by the connection device in response to close proximity wireless connection between the first communication interface and the connection device;
A second determination process of determining whether the input device is in the first determination state or not is executed, and the first determination state is a state in which the input device is already determined in the first determination process or the second determination process. Yes,
A program for determining the connection device as the input device in response to determining that the input operation is executable in the first determination process and determining that the input operation is not in the first determination state in the second determination process.   In the second determination processing, the program has already determined that only the input operation can be executed in the first determination processing, and that the second determination processing determines that the input operation is in the first determination state. The program according to claim 1, wherein the determined input device is changed to the connection device. The program, in the second determination process,
The mobile terminal is caused to execute a third determination process for determining whether or not the second determination state is present, and the second determination state is the number of the output devices already determined in the first determination process or the second determination process. It has reached the threshold,
It is determined in the first determination processing that both the input operation and the output operation are executable, the second determination processing determines that the first determination state is present, and the third determination processing is not in the second determination state. The program according to claim 1, wherein the connection device is determined as the output device in accordance with the determination made in the determination processing.   In the second determination processing, the program determines in the first determination processing that both the input operation and the output operation can be executed, and determines in the second determination processing that it is in the first determination state, The program according to claim 3, wherein one of the output devices is changed to the connection device in response to the third determination processing determining that the second determination state is set.   In the second determination processing, the program determines that only the output operation can be executed in the first determination processing, and determines in the third determination processing that the output operation is not in the second determination state. The program according to claim 3, wherein a connection device is determined as the output device.   In the second determination processing, the program determines in the first determination processing that only the output operation can be executed, and determines that the second determination state is in the third determination processing. The program according to claim 3, wherein one of the output devices is changed to the connection device. A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program is
A first determination process of determining, as an input device or an output device, a designated device designated through the input interface among the plurality of external devices that can communicate through the second communication interface;
Among the plurality of external devices that can communicate through the second communication interface, the portable device includes a second determination process that determines the connection device, which is in close proximity wireless connection with the first communication interface, as the input device or the output device. It is possible to make the terminal execute
The program causes the mobile terminal to execute a registration process of storing cooperation operation information including input device information and output device information in the memory, and the input device information is stored in the first determination process or the second determination process. The output device information is information for identifying the determined input device, the output device information is information for identifying the output device determined in the first determination process or the second determination process,
The program is
A first acceptance process for accepting a designation operation for designating one of the cooperation operation information stored in the memory through the input interface;
The input device identified by the input device information included in the specified cooperation operation information causes the mobile terminal to execute an input instruction process of transmitting input instruction information through the second communication interface, and the input instruction The information is information for executing an input operation that causes the input device to input target data used for a linked operation with the output device,
The program is
The output device identified by the output device information included in the specified cooperation operation information is caused to cause the portable terminal to execute output instruction processing for transmitting output instruction information through the second communication interface, and the output instruction information is output. Is information for executing the output operation for outputting the target data,
The program is
In response to the execution of the second determination process, the mobile terminal is caused to execute a fourth determination process of determining whether or not both the input device and the output device have been determined,
A program that causes the mobile terminal to further execute the input instruction process for the determined input device and the output instruction process for the determined output device, triggered by the determination that both are determined in the fourth determination process. . A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program causes the mobile terminal to execute a first receiving process of receiving a designation operation for designating one of the cooperation operation information stored in the memory through the input interface, and the cooperation operation information identifies an input device. Including at least one of input device information and output device information for identifying the output device,
The program is
A second reception process for receiving, through the input interface or the first communication interface, an instruction to execute a cooperative operation according to the specified cooperative operation information, in response to receiving the specified operation in the first reception process. ,
Deciding, as the input device or the output device, a connection device that is in close proximity wireless connection with the first communication interface in response to receiving the execution instruction through the first communication interface in the second reception process. 1 the determination process is executed by the mobile terminal, and the execution instruction through the first communication interface causes the connection device, which is one of the plurality of external devices that can communicate through the second communication interface, to be executed. To establish a close proximity wireless connection with the first communication interface,
The program transmits input instruction information through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information or the input device determined in the first determination process. The input instruction information to be executed by the portable terminal, the input instruction information is information for executing an input operation for inputting target data used for a linked operation with the output device to the input device,
The program is
An output instruction process for transmitting output instruction information through the second communication interface to the output device identified by the output device information included in the specified cooperation operation information or the output device determined in the first determination process. And the output instruction information is information for executing an output operation of outputting the target data,
The program determines the connection device as the output device in the first determination process when the cooperation operation information including both the input device information and the output device information is specified in the first reception process. program. A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program causes the mobile terminal to execute a first receiving process of receiving a designation operation for designating one of the cooperation operation information stored in the memory through the input interface, and the cooperation operation information identifies an input device. Including at least one of input device information and output device information for identifying the output device,
The program is
A second reception process for receiving, through the input interface or the first communication interface, an instruction to execute a cooperative operation according to the specified cooperative operation information, in response to receiving the specified operation in the first reception process. ,
Deciding, as the input device or the output device, a connection device that is in close proximity wireless connection with the first communication interface in response to receiving the execution instruction through the first communication interface in the second reception process. 1 the determination process is executed by the mobile terminal, and the execution instruction through the first communication interface causes the connection device, which is one of the plurality of external devices that can communicate through the second communication interface, to be executed. To establish a close proximity wireless connection with the first communication interface,
The program transmits input instruction information through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information or the input device determined in the first determination process. The input instruction information to be executed by the portable terminal, the input instruction information is information for executing an input operation for inputting target data used for a linked operation with the output device to the input device,
The program is
An output instruction process for transmitting output instruction information through the second communication interface to the output device identified by the output device information included in the specified cooperation operation information or the output device determined in the first determination process. And the output instruction information is information for executing an output operation of outputting the target data,
In the first determination process, when the cooperation operation information including only the output device information of the input device information and the output device information is specified in the first acceptance process, the program determines the connection device. A program for determining the input device. A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program causes the mobile terminal to execute a first receiving process of receiving a designation operation for designating one of the cooperation operation information stored in the memory through the input interface, and the cooperation operation information identifies an input device. Including at least one of input device information and output device information for identifying the output device,
The program is
A second reception process for receiving, through the input interface or the first communication interface, an instruction to execute a cooperative operation according to the specified cooperative operation information, in response to receiving the specified operation in the first reception process. ,
Deciding, as the input device or the output device, a connection device that is in close proximity wireless connection with the first communication interface in response to receiving the execution instruction through the first communication interface in the second reception process. 1 the determination process is executed by the mobile terminal, and the execution instruction through the first communication interface causes the connection device, which is one of the plurality of external devices that can communicate through the second communication interface, to be executed. To establish a close proximity wireless connection with the first communication interface,
The program transmits input instruction information through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information or the input device determined in the first determination process. The input instruction information to be executed by the portable terminal, the input instruction information is information for executing an input operation for inputting target data used for a linked operation with the output device to the input device,
The program is
An output instruction process for transmitting output instruction information through the second communication interface to the output device identified by the output device information included in the specified cooperation operation information or the output device determined in the first determination process. And the output instruction information is information for executing an output operation of outputting the target data,
In the first determination process, when the cooperation operation information including only the input device information among the input device information and the output device information is designated in the first acceptance process, the program determines the connection device. A program for determining the output device. A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program causes the mobile terminal to execute a first receiving process of receiving a designation operation for designating one of the cooperation operation information stored in the memory through the input interface, and the cooperation operation information identifies an input device. Including at least one of input device information and output device information for identifying the output device,
The program is
A second reception process for receiving, through the input interface or the first communication interface, an instruction to execute a cooperative operation according to the specified cooperative operation information, in response to receiving the specified operation in the first reception process. ,
Deciding, as the input device or the output device, a connection device that is in close proximity wireless connection with the first communication interface in response to receiving the execution instruction through the first communication interface in the second reception process. 1 the determination process is executed by the mobile terminal, and the execution instruction through the first communication interface causes the connection device, which is one of the plurality of external devices that can communicate through the second communication interface, to be executed. To establish a close proximity wireless connection with the first communication interface,
The program transmits input instruction information through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information or the input device determined in the first determination process. The input instruction information to be executed by the portable terminal, the input instruction information is information for executing an input operation for inputting target data used for a linked operation with the output device to the input device,
The program is
An output instruction process for transmitting output instruction information through the second communication interface to the output device identified by the output device information included in the specified cooperation operation information or the output device determined in the first determination process. And the output instruction information is information for executing an output operation of outputting the target data,
The program is
The cooperation operation information including only the input device information of the input device information and the output device information is specified in the first reception process, and the execution instruction through the input interface is received in the second reception process. In response to this, the portable terminal is caused to execute a second determination process of determining the connection device, which is in close proximity wireless connection with the first communication interface, as the output device,
In the input instruction process, the input instruction information is transmitted through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information,
A program that, in the output instruction process, transmits the output instruction information to the output device determined in the second determination process through the second communication interface. A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program causes the mobile terminal to execute a first receiving process of receiving a designation operation for designating one of the cooperation operation information stored in the memory through the input interface, and the cooperation operation information identifies an input device. Including at least one of input device information and output device information for identifying the output device,
The program is
A second reception process for receiving, through the input interface or the first communication interface, an instruction to execute a cooperative operation according to the specified cooperative operation information, in response to receiving the specified operation in the first reception process. ,
Deciding, as the input device or the output device, a connection device that is in close proximity wireless connection with the first communication interface in response to receiving the execution instruction through the first communication interface in the second reception process. 1 the determination process is executed by the mobile terminal, and the execution instruction through the first communication interface causes the connection device, which is one of the plurality of external devices that can communicate through the second communication interface, to be executed. To establish a close proximity wireless connection with the first communication interface,
The program transmits input instruction information through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information or the input device determined in the first determination process. The input instruction information to be executed by the portable terminal, the input instruction information is information for executing an input operation for inputting target data used for a linked operation with the output device to the input device,
The program is
An output instruction process for transmitting output instruction information through the second communication interface to the output device identified by the output device information included in the specified cooperation operation information or the output device determined in the first determination process. And the output instruction information is information for executing an output operation of outputting the target data,
The program is responsive to not receiving a response to the input instruction information from the input device through the second communication interface,
A third determination process for determining the connection device, which is wirelessly connected to the first communication interface, as the input device;
A program for causing the mobile terminal to execute the input instruction process for the input device determined in the third determination process. A mobile phone comprising a memory, an input interface, a first communication interface for performing near field communication with an external device, and a second communication interface for performing wireless communication with the external device, the communication distance being longer than the near field communication. A program readable by a terminal,
The program causes the mobile terminal to execute a first receiving process of receiving a designation operation for designating one of the cooperation operation information stored in the memory through the input interface, and the cooperation operation information identifies an input device. Including at least one of input device information and output device information for identifying the output device,
The program is
A second reception process for receiving, through the input interface or the first communication interface, an instruction to execute a cooperative operation according to the specified cooperative operation information, in response to receiving the specified operation in the first reception process. ,
Deciding, as the input device or the output device, a connection device that is in close proximity wireless connection with the first communication interface in response to receiving the execution instruction through the first communication interface in the second reception process. 1 the determination process is executed by the mobile terminal, and the execution instruction through the first communication interface causes the connection device, which is one of the plurality of external devices that can communicate through the second communication interface, to be executed. To establish a close proximity wireless connection with the first communication interface,
The program transmits input instruction information through the second communication interface to the input device identified by the input device information included in the specified cooperation operation information or the input device determined in the first determination process. The input instruction information to be executed by the portable terminal, the input instruction information is information for executing an input operation for inputting target data used for a linked operation with the output device to the input device,
In response to the program not receiving a response to the output instruction information, which is information for executing the output operation of outputting the target data, from the output device through the second communication interface,
A fourth determination process of determining the connection device, which is wirelessly connected to the first communication interface, as the output device;
A program for causing the portable terminal to execute an output instruction process of transmitting the output instruction information through the second communication interface to the output device determined in the fourth determination process.