JP2017169033A - program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program of a mobile terminal capable of allowing an image processing apparatus near-field radio connected with the mobile terminal to execute various operations by a simple operation.SOLUTION: A terminal program allows a mobile terminal to execute: a storing processing (S23) of storing a WF record in a memory; a specifying processing of specifying an image processing apparatus near-field radio connected with an NFC communication I/F as a designation device (S12: holding up to the device); a reception processing (S13) of receiving connection information and device information from the designation device; an extraction processing (S13) of extracting the WF record including an operation ID included in the device information of the WF record stored in the memory; an execution instruction processing (S17) of transmitting execution instruction information to the designation device through a Wi-Fi communication I/F by using the received connection information.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a program for a portable terminal that operates an image processing apparatus using close proximity wireless communication.

  In recent years, a technique has been developed in which a portable terminal controls an image processing apparatus using close proximity wireless communication such as NFC. For example, Patent Document 1 discloses a portable terminal that receives information indicating a printer communication method by NFC communication and transmits print data to the printer using the communication method indicated by the received information.

JP 2007-166538 A

  However, it is difficult to say that the technique described in Patent Document 1 sufficiently satisfies the user's desire to cause a communication partner of close proximity wireless communication to perform various operations through a mobile terminal.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a portable terminal capable of causing an image processing apparatus connected to a portable terminal and a proximity wireless connection to execute various operations with a simple operation. To provide a program.

  The program described in this specification performs wireless communication having a communication distance longer than that of the proximity wireless communication between the memory, the input interface, the first communication interface that performs close proximity wireless communication with the external device, and the external device. It can be read by a portable terminal equipped with the second communication interface. The program causes the portable terminal to execute storage processing for storing workflow information including operation identification information in the memory. The operation identification information is information for identifying the operation designated by the user from among a plurality of operations on the image data. The program causes the portable terminal to execute a specifying process for specifying an image processing apparatus connected in proximity to the first communication interface as a specified apparatus and a receiving process for receiving apparatus information from the specified apparatus. The device information includes connection information necessary for communicating with the designated device through the second communication interface, and the operation identification information of the operation that can be executed by the designated device. The program uses an extraction process for extracting the workflow information including the operation identification information received in the reception process from the workflow information stored in the memory, and the connection information received in the reception process. Then, the portable terminal is caused to execute execution instruction processing for transmitting execution instruction information to the designated device through the second communication interface. The execution instruction information is information for instructing execution of the operation identified by the operation identification information included in the workflow information extracted by the extraction process.

  According to the above configuration, even if the workflow information is not registered for each image processing apparatus, the operation defined in the workflow information not including the apparatus identification information can be executed by the image processing apparatus holding the portable terminal. That is, various operations can be executed by the designated device with a simple operation.

FIG. 1 is a schematic diagram of a system 100 according to the present embodiment. FIG. 2A is a block diagram of the multifunction device 10, and FIG. 2B is a block diagram of the portable terminal 50. 3A and 3B are examples of data stored in the memories 32 and 62. FIG. 3A shows device information of the multifunction peripheral 10A, and FIG. 3B shows a WF list. FIG. 4 is a flowchart of the main process. FIG. 5 is a flowchart of the NFC determination process. FIG. 6 is a flowchart of the WF registration process. FIG. 7A is a flowchart of the output WF determination process, and FIG. 7B is a flowchart of the input WF determination process. FIG. 8 is a display example of the display 53, where (A) shows the main screen and (B) shows the WF selection screen. FIG. 9 is a display example of the display 53, where (A) shows a device selection screen and (B) shows an operation selection screen. FIG. 10 is a display example of the display 53, where (A) shows a setting screen and (B) shows a data selection screen. FIG. 11 is a display example of the display 53, where (A) shows an output destination selection screen and (B) shows an output WF selection screen.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it is needless to say that the embodiment of the present invention can be changed as appropriate without departing from the gist of the present invention. For example, the execution order of each process described below can be changed as appropriate without departing from the scope of the present invention.

  FIG. 1 is a schematic diagram of a system 100 according to the present embodiment. A system 100 illustrated in FIG. 1 includes multifunction devices 10A and 10B (hereinafter, these may be collectively referred to as “multifunction device 10”), a portable terminal 50, and a server 80. . The multifunction device 10, the portable terminal 50, and the server 80 can communicate with each other via a communication network. Although the specific example of a communication network is not specifically limited, For example, the internet 101, wired LAN, wireless LAN102, or these combination may be sufficient.

  The multifunction machine 10 and the portable terminal 50 belong to the wireless LAN 102. That is, the multifunction device 10 and the portable terminal 50 can communicate with each other via an access point (not shown) of the wireless LAN 102. The wireless LAN 102 is connected to the Internet 101 through the router 102A. Further, the server 80 is connected to the Internet 101. That is, the multifunction device 10 and the portable terminal 50 can communicate with the server 80 via the Internet 101 from the router 102A.

  As shown in FIG. 2A, the multifunction machine 10 includes a printer 11, a scanner 12, a display 23, an input I / F 24, an NFC communication I / F 25, and a Wi-Fi (Wi-Fi Alliance). (Registered trademark) Communication I / F 26, CPU 31, memory 32, and communication bus 33 are mainly provided. Each component constituting the multi-function device 10 is connected to each other through a communication bus 33. The configurations of the multifunction peripherals 10A and 10B may be the same or different. The multifunction machine 10 is an example of an image processing apparatus. The printer 11 and the scanner 12 are an example of an operation unit.

  The printer 11 executes a printing operation for recording an image indicated by the image data on a sheet. As a recording method of the printer 11, a known method such as an ink jet method or an electrophotographic method can be employed. The scanner 12 executes a scan operation for reading an image recorded on a document and generating image data (hereinafter referred to as “scan data”). Note that the multifunction machine 10 may further include a FAX unit capable of executing a FAX transmission operation and a FAX reception operation. The multifunction machine 10 may include only one of the printer 11 and the scanner 12 and may not include the other.

  The print operation is an example of an output operation for outputting image data. However, a specific example of the output operation is not limited to the print operation, and may be, for example, a FAX transmission operation that transmits the image data by FAX to an external device. The scan operation is an example of an input operation that generates image data. However, a specific example of the input operation is not limited to the scan operation, and may be a FAX reception operation for receiving image data from an external device by FAX.

  The input I / F 24 is a user interface that receives an input operation by a user. Specifically, the input I / F 24 includes a button, and outputs various operation signals associated with the pressed button to the CPU 31. Further, the input I / F 24 may include a film-like touch sensor superimposed on the display surface of the display 23. An operation for designating an object displayed on the display surface of the display 23 and an operation for inputting a character string or a numeric string are examples of user operations. The “object” is, for example, a character string, icon, button, link or the like displayed on the display 23.

  The input I / F 24 implemented as a touch sensor outputs position information indicating the position on the display surface touched by the user. Note that “touch” in this specification includes all operations for bringing an input medium into contact with a display surface. In addition, even if the input medium is not touching the display surface, “hover” or “floating touch” that brings the input medium close to a position where the distance to the display surface is very small is based on the concept of “touch” described above. May be included. Furthermore, the input medium may be a user's finger or a touch pen. The user operation of tapping the position of the icon displayed on the display 23 is an example of a specifying operation for specifying the icon.

  The NFC communication I / F 25 is an example of a first communication interface that can transmit and receive a radio signal to and from an external device. That is, the multifunction machine 10 transmits various information to the mobile terminal 50 through the NFC communication I / F 25 and receives various information from the mobile terminal 50 through the NFC communication I / F 25. The communication range of wireless communication through the NFC communication I / F 25 (hereinafter referred to as “NFC communication”) is wireless communication through the Wi-Fi communication I / F 26 (hereinafter referred to as “Wi-Fi communication”). The communication range is narrower. Further, the communication speed of NFC communication is slower than the communication speed of Wi-Fi communication.

  The NFC communication I / F 25 is an interface for performing wireless communication by a close proximity wireless communication method. The NFC communication I / F 25 performs wireless communication conforming to the NFC standard. The NFC standard is, for example, a standard of ISO / IEC21481 or 18092. In this specification, a device that can communicate with a procedure compliant with the NFC standard is referred to as “NFC device”, and communication performed according to a procedure compliant with the NFC standard is referred to as “NFC communication”. NFC communication is an example of proximity wireless communication. The NFC communication I / F 25 is mounted with an IC chip having a memory for storing information to be exchanged with an external device. The NFC standard is an example of a proximity wireless communication protocol. Instead of the NFC standard, the TransferJet (registered trademark of TransferJet Consortium) standard may be adopted.

  The Wi-Fi communication I / F 26 is an example of a second communication interface that can communicate with an external device. The multifunction device 10 outputs various information to the mobile terminal 50 through the Wi-Fi communication I / F 26 and receives various information from the mobile terminal 50 through the Wi-Fi communication I / F 26. Note that the communication distance of Wi-Fi communication is longer than the communication distance of NFC communication. Further, the communication speed of Wi-Fi communication is faster than the communication speed of NFC communication.

  The Wi-Fi communication I / F 26 performs wireless communication conforming to the Wi-Fi standard. The Wi-Fi communication I / F 26 is capable of indirect wireless communication that wirelessly communicates with an external device through a communication network. More specifically, the Wi-Fi communication I / F 26 can wirelessly communicate with an external device via a relay device such as an access point. The Wi-Fi communication I / F 26 may be capable of direct wireless communication that wirelessly communicates with an external device without going through a relay device. Direct wireless communication is wireless communication based on, for example, Wi-Fi Direct (registered trademark of Wi-Fi Alliance) standard. Wireless communication that does not pass through a relay device in Wi-Fi communication is referred to as “Wi-Fi direct communication”. The specific communication procedure of the Wi-Fi communication I / F 26 is not particularly limited. For example, Wi-Fi may be employed for indirect wireless communication and Wi-Fi direct may be employed for direct wireless communication.

  The CPU 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires and executes various programs, which will be described later, from the memory 32 based on various information output from the input I / F 24, various information received from an external device through the communication I / Fs 25 and 26, and the like. The CPU 31 and the memory 32 constitute an example of a controller.

  The memory 32 stores an OS 34 and a device program 35. The device program 35 may be a single program or a collection of a plurality of programs. The memory 32 stores data or information necessary for executing the device program 35. The memory 32 is configured by, for example, a RAM, a ROM, an EEPROM, an HDD, a portable storage medium such as a USB memory attached to or detached from the multifunction machine 10, a buffer provided in the CPU 31, or a combination thereof.

  The memory 32 may be a computer readable storage medium. A computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROM and DVD-ROM in addition to the above examples. A non-transitory medium is also a tangible medium. On the other hand, an electrical signal that carries a program downloaded from a server on the Internet 101 is a computer-readable signal medium that is a kind of computer-readable medium, but can be read by a non-transitory computer. Not included in storage media. The same applies to the memory 62 of the portable terminal 50 described later.

  For example, as shown in FIG. 3A, the memory 32 can store device information including an operation ID and capability information. The device information includes one or more sets of corresponding operation IDs and capability information. FIG. 3A is an example of device information of the multifunction peripheral 10A. Although illustration of device information of the multifunction machine 10B is omitted, it may be the same as or different from the multifunction machine 10A. The device information is set before shipment by the manufacturer of the multifunction machine 10, for example.

  The operation ID is an example of operation identification information for identifying an operation that can be executed by the multifunction machine 10. In the present embodiment, the print operation is identified by “print”, and the scan operation is identified by “scan”. The capability information indicates a variation of the execution condition of the operation identified by the corresponding operation ID. The size information indicates the size of a sheet on which an image is recorded by a printing operation. The color information indicates the color of the image recorded on the sheet by the printing operation. The resolution information indicates the resolution of scan data generated by the scan operation. The format information indicates the format of the scan data generated by the scan operation.

  That is, in the example of FIG. 3A, the multi-function peripheral 10A prints an image in either “monochrome” or “color” on any of the sheets “A4”, “A3”, and “L”. It is possible to execute an operation and a scan operation for generating scan data having a resolution of “300 dpi” or “600 dpi” in a file format of “TIFF” or “PDF”. Note that the execution condition indicated by the capability information is not limited to the above example.

  As shown in FIG. 2B, the portable terminal 50 communicates with a display 53, an input I / F 54, an NFC communication I / F 55, a Wi-Fi communication I / F 56, a CPU 61, and a memory 62. A bus 63 is mainly provided. The display 53, the input I / F 54, the NFC communication I / F 55, the Wi-Fi communication I / F 56, the CPU 61, the memory 62, and the communication bus 63 that are included in the portable terminal 50 are the display 23, input I, and the like that are included in the multifunction device 10. / F24, NFC communication I / F25, Wi-Fi communication I / F26, CPU 31, memory 32, and communication bus 33, the description is omitted. The CPU 61 and the memory 62 are an example of a controller.

  The mobile terminal 50 is, for example, a mobile phone, a smartphone, or a tablet terminal. More specifically, the display 53 of the mobile terminal 50 desirably has a display screen size of 12 inches or less, more preferably 8 inches or less. The input I / F 54 of the portable terminal 50 is preferably a touch sensor superimposed on the display screen of the display 53.

  The memory 62 stores an OS 64 and a terminal program 65. The OS 64 may be, for example, Android (registered trademark of Google Inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like.

  The memory 62 can include a WF list, for example, as shown in FIG. The WF list includes one or more WF records. The WF record includes a WF-ID, a device ID, an operation ID, and condition information associated with each other. However, the WF record may not include the device ID. When the terminal program 65 is installed, no WF record is stored in the memory 62. The terminal program 65 registers the WF record generated according to the user's instruction in the WF list in the WF registration process described later.

  The WF-ID is an example of WF identification information that identifies a WF record. The device ID is an example of device identification information for identifying the multifunction machine 10. In the present embodiment, the MFP 10A is identified by “MFP-A”, and the MFP 10B is identified by “MFP-B”. The condition information is information indicating the execution condition of the operation identified by the corresponding operation ID.

  The WF record is an example of workflow information that defines the content of an operation (hereinafter, referred to as “workflow”) to be executed by the multifunction machine 10. The workflow indicates an operation identified by an operation ID executed according to the execution condition indicated by the condition information. As an example, for a WF record including WF-ID “001”, a print operation for recording a monochrome image on A4 size paper is defined as a workflow. As another example, for a WF record including WF-ID “002”, a scan operation for generating scan data with a resolution of 600 dpi in the TIFF format is defined as a workflow.

  The WF record including the operation ID of the output operation is an example of first workflow information (hereinafter referred to as “output WF record”), and the workflow defined by the output WF record is referred to as “output WF”. . On the other hand, the WF record including the operation ID of the input operation is an example of second workflow information (hereinafter referred to as “input WF record”), and the workflow defined by the input WF record is expressed as “input WF”. .

  In the example of FIG. 3B, a WF record including WF-IDs “001”, “003”, and “004” is an output WF record, and a WF record including WF-ID “002” is an input WF record. . In the WF list according to the present embodiment, only one output WF record including the same device ID can be registered, and only one input WF record including the same device ID can be registered. However, it is not limited to this configuration.

  Further, although not shown in the figure, the memory 62 may be provided with a data folder. For example, photo data, document data, presentation data, spreadsheet data, and the like may be stored in the data folder. Various data stored in the data folder is data that can be designated data.

  The server 80 is a so-called storage server. More specifically, the server 80 stores, for example, data received from the external device in the server memory, reads data specified by the external device from the server memory, and transmits the data to the portable terminal 50. In the present embodiment, the server 80 is identified by the device ID “server C”. The server 80 provides services such as “Evernote (registered trademark of Evernote Corporation)”, “Dropbox (registered trademark of DropBox, Inc.)”, “Google Drive (Google is a registered trademark of Google, Inc.)”. It may be provided.

  The NFC communication I / F 55 of the mobile terminal 50 in the present embodiment executes a poll operation. The poll operation is an operation of repeatedly outputting a polling signal at a predetermined time interval and monitoring a response signal that is a response to the polling signal. On the other hand, the NFC communication I / F 25 of the multifunction machine 10 according to the present embodiment executes a Listen operation. The Listen operation is an operation of monitoring a polling signal and outputting a response signal on condition that the polling signal is received.

  When the multifunction device 10 and the portable terminal 50 approach each other, the NFC communication I / F 25 of the multifunction device 10 receives the polling signal output from the NFC communication I / F 55 of the portable device 50, and the NFC communication I / F of the multifunction device 10. The NFC communication I / F 55 of the portable terminal 50 receives the response signal output by F25. Thus, an NFC communication link (hereinafter referred to as “NFC link”) is established between the multifunction device 10 and the portable terminal 50 by a predetermined procedure according to the NFC standard. Thereafter, the multifunction device 10 and the portable terminal 50 transmit and receive information and the like through this NFC link. Note that the multifunction device 10 may execute the poll operation, and the portable terminal 50 may execute the listen operation.

[Operation of System 100]
The operation of the system 100 according to the present embodiment will be described with reference to FIGS. 4, the NFC communication I / F 25 of the multifunction device 10 has already performed the Listen operation, and the NFC communication I / F 55 of the portable terminal 50 has performed the Poll operation. And

  The flowchart in this specification basically shows the processing of the CPUs 31 and 61 in accordance with the instructions described in the program. That is, processes such as “determination”, “extraction”, “selection”, “calculation”, “decision”, “specification”, and “control” in the following description represent processes of the CPUs 31 and 61. The processing by the CPU 61 includes hardware control via the OS 64. Further, “data” in this specification is represented by a bit string readable by a computer. Data having substantially the same semantic content but different formats are handled as the same data. The same applies to “information” in this specification.

  First, the terminal program 65 displays the main screen shown in FIG. 8A on the display 53 (S11). The main screen includes a message “tap the icon or hold it over the device”, an [output WF] icon 111, an [input WF] icon 112, and a [register] icon 113. [Output WF] icon 111 corresponds to an execution instruction for output WF determination processing, [Input WF] icon 112 corresponds to an execution instruction for input WF determination processing, and [Register] icon 113 corresponds to an execution instruction for WF registration processing. To do. Then, the terminal program 65 receives a user operation on the main screen through the input I / F 54 or the NFC communication I / F 55 (S12).

  The terminal program 65 receives a response signal from the multifunction device 10A through the NFC communication I / F 55 that is executing the poll operation when the user brings the portable terminal 50 close to the multifunction device 10A, for example (S12: hold over the device). . Next, the terminal program 65 establishes an NFC link with the MFP 10A that is the transmission source of the response signal. Receiving a response signal from the multifunction device 10A or establishing an NFC link is an example of the proximity wireless connection between the NFC communication I / F 55 and the multifunction device 10A.

  Then, the terminal program 65 identifies the multi-function peripheral 10A connected in close proximity as a designated device. More specifically, the terminal program 65 receives the device ID “MFP-A” from the multi-function peripheral 10A connected via close proximity wireless communication through the NFC communication I / F, and stores the received device ID in the memory 62 as the designated device ID. This process is an example of a specific process. The designated device ID is an example of designated device identification information. The operation of bringing the portable terminal 50 close to a range where NFC communication with the multifunction device 10A is possible is an example of an operation of designating the multifunction device 10A as a designated device through the NFC communication I / F 55.

  Further, the terminal program 65 executes NFC determination processing (S13). The NFC determination process is a process of determining a WF record (hereinafter referred to as “designated WF record”) that defines a workflow to be executed by a designated device connected by close proximity wireless communication. Details of the NFC determination process will be described with reference to FIG.

  First, the terminal program 65 receives connection information from the multi-function peripheral 10 </ b> A connected in close proximity via the NFC communication I / F 55. The connection information is information necessary for making a Wi-Fi direct connection with the MFP 10A. The connection information may be, for example, an IP address, a MAC address, or an SSID. Then, the terminal program 65 makes a Wi-Fi direct connection with the MFP 10A using the received connection information (S31).

  Next, the terminal program 65 receives device information from the multifunction peripheral 10A through the Wi-Fi direct connection Wi-Fi communication I / F 56 (S32). Then, the terminal program 65 temporarily stores the received device information in the memory 62 in association with the designated device ID. Note that the terminal program 65 may receive both the connection information and the device information from the multifunction machine 10A through the NFC communication I / F 55 in S31. The process of receiving connection information and device information is an example of a reception process.

  Next, the terminal program 65 extracts a WF record that satisfies the first condition from the WF records included in the WF list (S33). Then, the terminal program 65 determines the number of WF records extracted in S33 (S34). In response to determining that there is no WF record that matches the first condition (S34: 0), the terminal program 65 determines whether there are other search conditions (S35). Then, in response to determining that the second search condition exists (S35: Yes), the terminal program 65 extracts a WF record that matches the second condition (S36 → S33). Further, in response to determining that there is no WF record that matches the second condition (S34: 0), the terminal program 65 extracts a WF record that matches the third condition (S35: Yes → S36 → S33). . The process of S33 is an example of an extraction process.

  The first condition according to the present embodiment is a condition that the WF record includes the designated device ID. The second condition according to the present embodiment is a condition that the WF record does not include the device ID and includes the operation ID included in the device information received in S32. The third condition according to the present embodiment is a condition that the WF record includes a device ID different from the designated device ID and includes an operation ID included in the device information received in S32.

  However, the execution order of the extraction processing using each extraction condition is not limited to the above example. For example, a WF record that matches the second condition may be extracted in the first S33. In this case, the extraction process using the first condition and the third condition may be omitted. Furthermore, the extraction condition in S33 is not limited to the above example. As an example, the extraction condition in S33 in the NFC determination process executed in S76 may be that the WF record includes the designated device ID and the operation ID of the output operation. As another example, the extraction condition in S33 in the NFC determination process executed in S86 may be that the WF record includes the designated device ID and the operation ID of the input operation.

  In the WF list shown in FIG. 3B, if the designated device ID is “MFP-A”, the WF record including the WF-ID “001” and “002” matches the first condition, and the WF-ID “003” A WF record including “” matches the second condition, and a WF record including WF-ID “004” satisfies the third condition. On the other hand, when a multifunction device 10C (not shown) identified by the device ID “MFP-C” is newly installed and the portable terminal 50 is held over the multifunction device 10C, none of the extraction conditions is met. In the present embodiment, the following description is continued assuming that a WF record including WF-IDs “001” and “002” is extracted.

  In response to determining that a plurality of WF records have been extracted in S33, in other words, in response to determining that both the output WF record and the input WF record have been extracted in S33 (S34: It is determined whether or not the specified data ID is stored in the memory 62 and whether or not the output destination ID is stored in the memory 62 (S38 & S40). The process of S38 and S40 is an example of a determination process. In addition, the execution order of S38 and S40 is not limited to the example of FIG. 5, A reverse order may be sufficient.

  The designated data ID is an example of data identification information that identifies designated data to be output. The designated data ID is stored in the memory 62 in S72 described later. That is, the terminal program 65 determines in S38 whether or not the process of S72 has been executed. The output destination ID is output destination identification information for identifying a designated output destination that is an output destination of generated data generated by an input operation. The output destination ID is stored in the memory 62 in S82 described later. That is, the terminal program 65 determines in S40 whether or not the process of S82 has been executed.

  Then, in response to determining that the designated data ID is stored in the memory 62, in other words, in response to determining that the process of S72 has been executed, the terminal program 65 (S38: Yes). The output WF record extracted in S33 is determined as the designated WF record (S39). That is, the terminal program 65 temporarily stores the WF-ID “001” of the designated WF record in the memory 62. Note that when a plurality of output WF records are extracted in S33, the terminal program 65 may determine a designated WF record according to a user operation through an output WF selection screen described later.

  On the other hand, in response to determining that the output destination ID is stored in the memory 62, in other words, in response to determining that the process of S82 has been executed, the terminal program 65 (S40: Yes). The input WF record extracted in S33 is determined as the designated WF record (S41). That is, the terminal program 65 temporarily stores the WF-ID “002” of the designated WF record in the memory 62. Note that when a plurality of input WF records are extracted in S33, the terminal program 65 may determine a designated WF record according to a user operation through an input WF selection screen described later.

  In addition, the terminal program 65 determines that neither the processing of S72 or S82 has been executed in response to determining that both the specified data ID and the output destination ID are not stored in the memory 62. Accordingly (S38: No & S40: No), the WF selection screen shown in FIG. 8B is displayed on the display 53 (S42). Then, the terminal program 65 receives a user operation for the WF selection screen through the input I / F 54 (S43). The process of S43 is an example of a third reception process.

  The WF selection screen is a screen for prompting selection of one of the plurality of WF records extracted in S33. The WF selection screen includes WF icons 121 and 122 corresponding to the WF record extracted in S33. The WF icon 121 corresponds to a WF record including WF-ID “001”, and the WF icon 122 corresponds to a WF record including WF-ID “002”. The WF icons 121 and 122 describe the contents of a workflow defined by the corresponding WF record.

  Then, in response to receiving a user operation for designating one of the WF icons 121 and 122 through the input I / F 54 (S43: Yes), the terminal program 65 selects a WF record corresponding to the designated WF icon, The designated WF record is determined (S44). That is, the terminal program 65 temporarily stores the WF-ID of the designated WF record in the memory 62.

  On the other hand, when the terminal program 65 determines that there is one WF record extracted in S33 (S34: 1), the terminal program 65 determines the WF record as a designated WF record (S37). That is, the terminal program 65 temporarily stores the WF-ID of the designated WF record in the memory 62. Further, the terminal program 65 executes the WF registration process in response to determining that no WF record that matches any of the plurality of extraction conditions is registered in the WF list (S35: No) (S45). The WF registration process is a process for registering a new WF record in the WF list. Details of the WF registration process will be described with reference to FIG.

  First, the terminal program 65 determines whether or not the designated device ID is stored in the memory 62 (S51). Then, in response to determining that the designated device ID “001” is stored in the memory 62 (S51: Yes), the terminal program 65 sets the designated device ID “MFP-A” as a new WF record. The device ID to be included is determined (S52).

  On the other hand, when the terminal program 65 determines that the designated device ID is not stored in the memory 62 (S51: No), the device selection screen shown in FIG. 9A is displayed on the display 53 (S53). ). The device selection screen is a screen that prompts the user to specify a device ID to be included in a new WF record. The device selection screen includes device icons 131 and 132 and a [skip] icon 133. Then, the terminal program 65 receives a user operation on the device selection screen through the input I / F 54 (S54).

  The device icons 131 and 132 correspond to the multifunction machines 10A and 10B that can be designated devices. The terminal program 65 may search for the multifunction machine 10 belonging to the wireless LAN 102 using a protocol such as SNMP and receive the device ID and the device information from the multifunction machine 10 discovered through the Wi-Fi communication I / F 26. The [Skip] icon 133 corresponds to an instruction not to designate a designated device.

  Next, the terminal program 65, for example, in response to receiving the designation of the device icon 131 through the input I / F 54 (S54: device icon), the device ID “MFP” of the MFP 10A corresponding to the designated device icon 131. -A "is determined as the device ID to be included in the new WF record (S55). That is, the terminal program 65 temporarily stores the device ID and device information of the multifunction peripheral 10 </ b> A in the memory 62. On the other hand, the terminal program 65 determines not to include the device ID in the new WF record in response to accepting the designation of the [skip] icon 133 through the input I / F 54 (S54: skip icon) (S56).

  Next, the terminal program 65 determines how many operation IDs are included in the device information stored in the memory 62 in association with the device ID determined to be included in the new WF record (S57). Then, in response to determining that the device information includes only one operation ID (S57: 1), the terminal program 65 determines the device ID as the operation ID included in the new WF record ( S58).

  On the other hand, the terminal program 65 displays the operation selection screen shown in FIG. 9B on the display 53 in response to determining that the apparatus information includes a plurality of operation IDs (S57: plural) ( S59). The operation selection screen is a screen that prompts the user to specify an operation ID to be included in a new WF record. The operation selection screen includes operation icons 141 and 142 corresponding to the operation ID included in the device information. The operation icon 141 corresponds to a print operation, and the operation icon 142 corresponds to a scan operation. Further, the terminal program 65 causes the display 53 to display an operation selection screen including a plurality of operation icons corresponding to predetermined operations in response to the device information not being temporarily stored in S56 (S57: 0). (S59). Then, the terminal program 65 receives a user operation on the operation selection screen through the input I / F 54 (S60).

  Next, the terminal program 65 receives the operation ID “print” of the print operation corresponding to the specified operation icon 141, for example, in response to receiving the specification of the operation icon 141 through the input I / F 54 (S60: Yes). The operation ID to be included in the new WF record is determined (S61). That is, the terminal program 65 temporarily stores the operation ID “print” in the memory 62. The process of S57 to S61 is an example of a determination process for determining an operation ID to be included in a new WF record.

  Next, the terminal program 65 displays the setting screen shown in FIG. 10A on the display 53 (S62). The setting screen is a screen that prompts the user to specify the execution condition of the operation identified by the operation ID determined in S57 to S61. The setting screen includes check boxes 151, 152, 153, 154, and 155 each corresponding to one of the execution conditions, and a [OK] icon 156. Then, the terminal program 65 receives a user operation on the setting screen through the input I / F 54 (S63).

  FIG. 10A is an example of a setting screen when it is determined in S52 and S55 that the apparatus ID “MFP-A” is included in a new WF record. The check boxes 151 to 155 correspond to execution conditions indicated by the capability information of the device information stored in the memory 62 in association with the device ID “MFP-A”. That is, in S62 and S63 when the processes of S52 and S55 are executed, designation of execution conditions can be accepted within the capability information range. On the other hand, although illustration is omitted, on the setting screen when the process of S56 is executed, a check box corresponding to a predetermined execution condition is displayed. [Determination] icon 156 corresponds to a WF record registration instruction.

  Then, in response to accepting the designation of the [OK] icon 156 through the input I / F 54 (S63: Yes), the terminal program 65 adds condition information indicating the execution condition corresponding to the checked check box to a new one. Decide to include in WF record. That is, the terminal program 65 temporarily stores the condition information in the memory 62.

  Then, the terminal program 65 creates a WF record including the newly assigned WF-ID, the device ID determined in S52 and S53, the operation ID determined in S58 and S61, and the condition information determined in S63. Register in the WF list (S64). On the other hand, the terminal program 65 registers the WF record including the operation ID and the condition information and not including the device ID in the WF list in S64 when the process of S56 is executed. The process of S64 is an example of a storage process.

  Further, the terminal program 65 may determine when the WF registration designation process is executed. If the terminal program 65 determines that the WF registration process has been executed in S45, the terminal program 65 may determine the WF record registered in the WF list in S64 as the designated WF record. On the other hand, if the terminal program 65 determines that the WF registration process has been executed in S23, the terminal program 65 may not determine the designated WF record. Further, when the terminal program 65 determines that the WF registration process has been executed in S23 and determines that the device ID is included in the WF record registered in the WF list in S64, the terminal program 65 registered in the WF list in S64. The WF record may be determined as the designated WF record. Further, the terminal program 65 may determine whether or not to make the WF record registered in the WF list in S64 a designated WF record according to a user operation through the input I / F 54.

  Next, returning to FIG. 4, the terminal program 65 determines which of the output WF record and the input WF record is determined as the designated WF record in the NFC determination process (S13) (S14). When the terminal program 65 determines that the output WF record is determined as the designated WF record (S14: output), the data selection screen shown in FIG. 10B is displayed on the display 53 (S15). The data selection screen is a screen for prompting specification of specified data. The data selection screen includes data icons 161, 162, and 163. The data icons 161 to 163 correspond to, for example, data stored in the data folder or data stored in the server memory of the server 80. Then, the terminal program 65 receives a user operation for the data selection screen through the input I / F 54 (S16).

  Next, the terminal program 65 determines the data “photograph.JPEG” corresponding to the data icon 161 as designated data, for example, in response to accepting the designation of the data icon 161 through the input I / F 54 (S16: Yes). . That is, the terminal program 65 temporarily stores the data ID of the designated data “photograph.JPEG” in the memory 62 as the designated data ID. The process of S16 is an example of a first reception process. Then, the terminal program 65 transmits the execution instruction information to the multifunction peripheral 10A, which is the designated device, via the Wi-Fi communication I / F 56 that is directly connected via Wi-Fi (S17). The execution instruction information in this case is information for instructing execution of the output WF defined by the designated WF record. This process is an example of a first execution instruction process.

  When the output WF record including the WF-ID “001” is the designated WF record, the execution instruction information includes an output WF that records the image indicated by the designated data “Photo.JPEG” as a monochrome image on an A4 size sheet. Is information for instructing the designated device to execute the operation. The execution instruction information in this case includes designated data, and an operation ID and condition information included in the designated WF record. On the other hand, although illustration is omitted, the device program 35 of the multifunction peripheral 10A receives the execution instruction information from the portable terminal 50 through the Wi-Fi communication I / F 56 connected in Wi-Fi direct connection. The apparatus program 35 that has received the execution instruction information causes the printer 11 to execute the output WF in accordance with the execution instruction information.

  On the other hand, the terminal program 65 displays the output destination selection screen shown in FIG. 11A on the display 53 in response to determining that the input WF record is determined as the designated WF record (S14: input) (S18). ). The output destination selection screen is a screen that prompts specification of a specified output destination. The output destination selection screen includes output destination icons 171, 172, and 173. The output destination icon 171 corresponds to the memory 62 of the portable terminal 50, the output destination icon 172 corresponds to the server 80, and the output destination icon 173 corresponds to the multifunction machine 10B. Then, the terminal program 65 receives a user operation for the output destination selection screen through the input I / F 54 (S19).

  Next, the terminal program 65 determines, for example, that the server 80 corresponding to the output destination icon 172 is designated as the designated output destination in response to receiving the designation of the output destination icon 172 through the input I / F 54 (S19: Yes). That is, the terminal program 65 temporarily stores the device ID “server C” of the designated output destination in the memory 62 as the output destination ID. The process of S19 is an example of a second reception process. Then, the terminal program 65 transmits the execution instruction information to the multifunction peripheral 10A, which is the designated device, via the Wi-Fi communication I / F 56 that is directly connected via Wi-Fi (S17). The execution instruction information in this case is information for instructing execution of the input WF defined by the designated WF record. This process is an example of a second execution instruction process.

  When the input WF record including the WF-ID “002” is the designated WF record, the execution instruction information designates the execution of the input WF that transmits the scan data in the TIFF format at 600 dpi and the server 80 that is the designated output destination. This is information for instructing the apparatus. The execution instruction information in this case includes the operation ID and condition information included in the designated WF record, and the output destination ID. On the other hand, although illustration is omitted, the device program 35 of the multifunction peripheral 10A receives the execution instruction information from the portable terminal 50 through the Wi-Fi communication I / F 56 connected in Wi-Fi direct connection. Then, the apparatus program 35 that has received the execution instruction information causes the scanner 12 to execute the input WF according to the execution instruction information.

  On the other hand, the terminal program 65 executes the output WF determination process in response to accepting the designation of the [output WF] icon 111 included in the main screen through the input I / F 54 (S12: tap operation & S20: output WF icon). (S21). The output WF determination process is a process for determining one of the output WF records registered in the WF list as a designated WF record. Details of the output WF determination processing will be described with reference to FIG.

  First, the terminal program 65 displays the data selection screen shown in FIG. 10B on the display 53 (S71). Then, for example, in response to receiving the designation of the data icon 162 through the input I / F 54 (S72: Yes), the terminal program 65 determines the data “estimate.PDF” corresponding to the data icon 162 as designated data. To do. That is, the terminal program temporarily stores the data ID of the data “quotation sheet.PDF” in the memory 62 as the designated data ID. The processing of S71 and S72 may be the same as S15 and S16.

  Next, the terminal program 65 displays the output WF selection screen shown in FIG. 11B on the display 53 (S73). The output WF selection screen is a screen that prompts one designation of the output WF record. The output WF selection screen includes a message “tap the icon or hold it over the device” and WF icons 181 and 182 corresponding to the output WF record including the operation ID, and corresponds to the input WF record. Does not include WF icon. The WF icon 181 corresponds to an output WF record including WF-ID “001”, and the WF icon 182 corresponds to an output WF record including WF-ID “004”. Then, the terminal program 65 accepts a user operation for the output WF selection screen through the input I / F 54 or the NFC communication I / F 55 (S74).

  Next, the terminal program 65 determines the output WF record corresponding to the WF icon 181 as the designated WF record in response to, for example, accepting the designation of the WF icon 181 through the input I / F 54 (S74: WF icon). (S75). In addition, the terminal program 65 determines the device ID included in the designated WF record as the designated device ID. That is, the terminal program 65 temporarily stores the WF-ID of the designated WF record in the memory 62.

  On the other hand, the terminal program 65 receives a response signal from the multifunction device 10A through the NFC communication I / F 55 that is executing the poll operation, for example, when the user brings the portable terminal 50 close to the multifunction device 10A (S74: device). Hold over). Next, the terminal program 65 establishes an NFC link with the MFP 10A that is the transmission source of the response signal. Then, the terminal program 65 identifies the multi-function peripheral 10A connected in close proximity as a designated device. These processes may be the same as in the case where the close proximity wireless connection is made with the multifunction machine 10A in S12. Then, the terminal program 65 executes NFC determination processing (S76).

  Further, the terminal program 65 executes the input WF determination process in response to receiving the designation of the [input WF] icon 112 included in the main screen through the input I / F 54 (S12: tap operation & S20: input WF icon). (S22). The input WF determination process is a process for determining one of the input WF records registered in the WF list as a designated WF record. Details of the input WF determination process will be described with reference to FIG.

  First, the terminal program 65 displays the output destination selection screen shown in FIG. 11A on the display 53 (S81). Then, the terminal program 65 determines, for example, that the multifunction device 10B corresponding to the output destination icon 173 is designated as the designated output destination in response to receiving the designation of the output destination icon 173 through the input I / F 54 (S82: Yes). . That is, the device ID “MFP-B” of the multifunction machine 10B is temporarily stored in the memory 62 as the output destination ID. The processing of S81 and S82 may be the same as S18 and S19.

  Next, the terminal program 65 displays an input WF selection screen (not shown) on the display 53 (S83). The input WF selection screen is a screen that prompts one designation of the input WF record. The input WF selection screen is different from the output WF selection screen shown in FIG. 11B in that it includes a WF icon corresponding to the input WF record included in the WF list and does not include a WF icon corresponding to the output WF record. However, it is common in other points. Further, the processing after S84 is common to the processing after S74.

  That is, the terminal program 65 executes one of S21 and S22 in response to the [output WF] icon 111 or the [input WF] icon 112 being designated. Then, the terminal program 65 causes the designated device to execute the workflow defined in the designated WF record determined in one of S21 and S22. The process of S17 is an example of an execution instruction process.

  Further, the terminal program 65 receives the designation of the [Registration] icon 113 included in the main screen through the input I / F 54 (S12: tap operation & S20: registration icon), and the WF registration process shown in FIG. Is executed (S23). And the terminal program 65 performs the process after S11 according to completion | finish of WF registration process (S23).

[Operational effects of this embodiment]
According to the above-described embodiment, by registering a WF record in the WF list in advance, it is possible to cause the multifunction device 10 to execute various workflows only by holding the portable terminal 50 over the multifunction device 10. In other words, a particularly advantageous effect can be expected when the MFP 10 repeatedly executes the same workflow. Further, according to the above embodiment, when a plurality of WF records including the same device ID are registered, an appropriate WF record is selected depending on which one of designated data and a designated output destination is designated. .

  Further, according to the above-described embodiment, when there is no WF record that matches the first condition, the WF record that matches the second condition is extracted. As a result, even if the WF record is not registered for each multifunction device 10, the workflow defined in the WF record that does not include the device ID can be executed by the multifunction device 10 that holds the portable terminal 50. This further simplifies the user operation for causing the designated device to execute the workflow.

  Furthermore, according to the above embodiment, when there is no WF record that matches the second condition, the WF record that matches the third condition is extracted. As a result, the workflow defined in the WF record associated with the other multifunction device 10 can be temporarily executed by the designated device. Note that the terminal program 65 may cause the user to select, via the input I / F 54, whether to execute the execution instruction process or the WF registration process in response to the extraction of the WF record that matches the third condition. .

  Accordingly, the user can select whether to cause the designated device to execute the workflow according to the WF record associated with another multifunction device 10 or to newly register the WF record associated with the designated device. In addition to specifying the [Register] icon 113, a WF record associated with the multifunction device 10 is registered in response to holding the portable terminal 50 over the multifunction device 10 for which there is no executable WF record. Therefore, user operations required for the WF registration process can be simplified.

  More specifically, the terminal program 65 may cause the display 53 to display a first icon corresponding to the execution instruction of the execution instruction process and a second icon corresponding to the execution instruction of the WF registration process. Then, in response to receiving the designation of the first icon through the input I / F 54, the terminal program 65 may cause the designation device to execute the workflow defined in the WF record that matches the extracted third condition. . On the other hand, in response to accepting the designation of the second icon through the input I / F 54, the terminal program 65, the designated device ID specified in S12, the operation ID included in the extracted WF record that matches the third condition, A WF record including condition information may be registered in the WF list.

  Note that the workflow according to the above embodiment is defined by an action ID that is an example of action identification information and condition information associated with the action ID. However, the specific example of the operation identification information is not limited to the above example, and may include the operation unit identification information for identifying the operation unit for executing the workflow and the above-described condition information. That is, the workflow may be defined only by the operation identification information.

  Further, in the multifunction machine 10 and the portable terminal 50 according to the above-described embodiment, the various programs stored in the memories 32 and 62 are executed by the CPUs 31 and 61, thereby realizing each process executed by the controller of the present invention. An example was explained. However, the configuration of the controller is not limited to this, and part or all of the configuration may be realized by hardware such as an integrated circuit.

  Furthermore, the present invention may be realized not only as the multifunction device 10 and the portable terminal 50 but also as a program that causes the multifunction device 10 and the portable terminal 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include a storage unit mounted on a server that can be connected to the MFP 10 and the portable terminal 50 through a communication network, in addition to a CD-ROM, a DVD-ROM, and the like. And the program memorize | stored in the memory | storage part of the server may be distributed through communication networks, such as the internet 101, as the information or signal which shows the said program.

10: MFP 11 ... Printer 12 ... Scanner 23, 53 ... Display 24, 54 ... Input I / F
25, 55 ... NFC communication I / F
26, 56 ... Wi-Fi communication I / F
31, 61 ... CPU
32, 62 ... Memory 35 ... Device program 50 ... Portable terminal 65 ... Terminal program

Claims (6)

A portable device comprising: a memory; an input interface; a first communication interface that performs close proximity wireless communication with an external device; and a second communication interface that performs wireless communication with an external device having a communication distance longer than the close proximity wireless communication. A program readable by a terminal,
The program causes the portable terminal to execute storage processing for storing workflow information including operation identification information in the memory, and the operation identification information includes the operation designated by the user from among a plurality of operations on image data. Information to identify,
The program
A specifying process for specifying an image processing apparatus connected in proximity to the first communication interface as a designated apparatus;
The portable terminal executes reception processing for receiving device information from the designated device, and the device information is executed by the designated device and connection information necessary for communicating with the designated device through the second communication interface. Including the action identification information of the possible actions,
The program
An extraction process for extracting the workflow information including the operation identification information received in the reception process from the workflow information stored in the memory;
Using the connection information received in the reception process, the portable terminal is caused to execute an execution instruction process for transmitting execution instruction information to the designated device through the second communication interface, and the execution instruction information is extracted from the extraction process. A program which is information for instructing execution of the operation identified by the operation identification information included in the workflow information extracted in step (b). The program
A first accepting process for accepting a user operation for designating designated data to be processed by an output operation through the input interface;
It is possible to cause the portable terminal to execute one of a second reception process of receiving a user operation for specifying a specified output destination that is an output destination of generated data generated by an input operation through the input interface,
The program includes a determination process for determining which of the first reception process and the second reception process has been executed in response to the extraction of both the first workflow information and the second workflow information by the extraction process. The first workflow information is the workflow information including the operation identification information of the output operation, and the second workflow information is the workflow information including the operation identification information of the input operation. Yes,
In the execution instruction process, the program
In response to determining in the determination process that the first reception process has been executed, the execution instruction information for instructing execution of the output operation for the specified data is transmitted through the second communication interface. Causing the portable terminal to execute a first execution instruction process to be transmitted to the designated device;
The execution instruction information for instructing to output the generated data generated by the input operation to the designated output destination in response to determining in the determination process that the second reception process has been executed, The program according to claim 1, which causes the portable terminal to execute a second execution instruction process transmitted to the designated device through a second communication interface. The program
A user operation for designating one of the extracted first workflow information and the second workflow information in response to determining in the determination process that neither the first reception process nor the second reception process has been executed. , Causing the portable terminal to execute a third reception process that is received through the input interface,
In response to the first workflow information being designated in the third reception process, the portable terminal is caused to execute the first reception process and the first execution instruction process,
The program according to claim 2, wherein the portable terminal is caused to execute the second reception process and the second execution instruction process in response to the second workflow information being designated in the third reception process. The workflow information includes condition information indicating an execution condition of the operation identified by the operation identification information,
The program, in the execution instruction process, transmits the execution instruction information instructing execution of the operation according to the execution condition identified by the condition information to the designated device through the second communication interface. The program according to any one of 1 to 3. In response to the fact that the workflow information cannot be extracted by the extraction process,
A determination process for determining the operation identification information to be included in the workflow information;
5. The mobile terminal according to claim 1, wherein the storage terminal stores the workflow information including the operation identification information determined in the determination process and the device identification information of the designated device in the memory. The program described in The second communication interface is:
Indirect wireless communication wirelessly communicating with an external device via a relay device;
Direct wireless communication to wirelessly communicate with an external device without going through the relay device is possible,
The program according to any one of claims 1 to 5, wherein in the execution instruction process, the execution instruction information is transmitted to the designated device by the direct wireless communication using the connection information.