JP6725036B2 - Program and terminal device - Google Patents

Description

The present invention relates to a program readable by a mobile terminal. The program causes the mobile terminal to perform a process for causing the image processing device to perform an operation on the image data.

2. Description of the Related Art Conventionally, there is known an application that allows a user to specify content data and causes an image processing apparatus to execute an operation for the specified content data. For example, the application described in Patent Document 1 causes the user to specify the image data stored in the mobile terminal and causes the printer to print the image represented by the image data.

JP 2012-203742 A

The application of the mobile terminal is designed, for example, on the premise of personal use for easily printing the image data, and therefore a simple configuration in which the functions to be implemented are narrowed down is desirable. Further, since the screen size of a mobile terminal that executes the application is smaller than that of a PC or the like, a user interface that allows simple and intuitive operation is desirable.

2. Description of the Related Art In recent years, so-called "multi-function peripherals" in which a scanner unit, a FAX unit and the like are mounted on a printer have become widespread. In order to allow the user to effectively use the functions of the multi-function peripheral, it is required to utilize the application of the mobile terminal as a lead wire for guiding the user to each function installed in the multi-function peripheral. Further, it is desirable that the application of the mobile terminal is further equipped with a user interface that allows a user to select a printer or a multifunction peripheral that executes an operation for image data.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a program including a user interface suitable for selecting an image processing apparatus that executes an operation on image data.

The program described in this specification can be read by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit. The program causes the portable terminal to execute a first display process of displaying a first screen including a device designation object and a motion object on the display unit. The device designation object corresponds to designation of a designation device which is one of a plurality of image processing devices having an operation unit capable of performing an operation on image data. The motion object corresponds to a motion that can be executed by the image processing device. The program includes a reception process of receiving a user operation for designating an object through the operation unit, and a first determination process of determining whether device identification information for identifying the designated device is stored in the storage unit. Let the mobile device execute. The program causes the portable terminal to execute the first designation process in response to the user operation for designating the device designation object being accepted by the acceptance process. The program accepts a user operation designating the action object in the accepting process, and determines that the device identifying information is stored in the first determining process to cause the designating device to perform the designated action. The mobile terminal is caused to execute an execution preparation process for preparing for execution. The specified operation is an operation corresponding to the specified operation object. The program accepts a user operation for designating the action object in the acceptance process and determines in the first determination process that the device identification information is not stored, and then executes the second designation process in the mobile device. Make the terminal execute. The first specifying process corresponds to a first specifying process for specifying the image processing device that can communicate with the communication unit and can be specified as the specifying device, and the image processing device specified in the first specifying process. In response to a first selection screen display process for displaying a first selection screen including a device object on the display unit and a user operation for designating the device object received in the reception process, the specified device object is displayed. A first storage process of storing the device identification information of the corresponding image processing device in the storage unit. The second specifying process includes a second specifying process of specifying the image processing device capable of executing the specifying operation among the image processing devices that can communicate with the communication unit and can be specified as the specifying device; Second selection screen display processing for displaying a second selection screen including the device object corresponding to the image processing apparatus identified in the second identification processing on the display unit, and user operation for designating the device object as the reception processing And a second storage process of storing the device identification information of the image processing device corresponding to the specified device object in the storage unit in response to the reception of the second process.

According to the above configuration, by designating the device designation object before designating the designated action, it is possible to provide the first conducting wire for instructing the designated action to the designated device selected from a wide variety of options. On the other hand, by designating the motion object before designating the designated device, it is possible to provide the designated device suitable for the designated motion with the second conducting wire for instructing the designated motion. That is, the user conducts an intuitive operation as to which of the device designation object and the action object is designated first, and the first conducting wire suitable for the user who operates the program while paying attention to which of the designated devices is to be operated. Also, it is possible to properly use the second conductor suitable for the user who operates the program in consideration of the operation to be executed by the designated device.

FIG. 1 is a schematic configuration diagram of a system 100 according to the embodiment. 2A is a block diagram of the multi-function device 10, and FIG. 2B is a block diagram of the mobile terminal 50. FIG. 3 is an example of information stored in the data storage areas 32B and 62B. (A) is a FAX list, (B) is designated device information, (C) is a designated operation ID, and (D). Shows a list of second support operation IDs. FIG. 4 is a flowchart of the standard activation process. FIG. 5 is a flowchart of the first device selection process. FIG. 6A is a flowchart of the second device selection process, and FIG. 6B is a flowchart of the print preparation process. FIG. 7 is a flowchart of the FAX preparation process. FIG. 8 is a flowchart of the external activation process. 9A and 9B are display examples of the display unit 53, where FIG. 9A shows a menu screen and FIG. 9B shows a main screen. 10A and 10B are display examples of the display unit 53. FIG. 10A shows an unselected notification screen 130 superimposed on the main screen, and FIG. 10B shows a device selection screen when the multifunction peripherals 10A and 10B are specified. Show. 11A and 11B are display examples of the display unit 53. FIG. 11A is a device selection screen when only the multifunction peripheral 10A is specified, and FIG. 11B is a device icon 135, 136 with operation identification images 137-139. The added device selection screen is shown. 12A and 12B show display examples of the display unit 53, where FIG. 12A shows a data selection screen and FIG. 12B shows a preview screen in the standard startup process. 13A and 13B are display examples of the display unit 53, where FIG. 13A shows an operation selection screen and FIG. 13B shows a FAX transmission screen. 14A and 14B are display examples of the display unit 53, where FIG. 14A shows a FAX selection screen and FIG. 14B shows a FAX preview screen. FIG. 15 is a display example of a preview screen in the external activation process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be appropriately changed without changing the gist of the present invention. For example, the execution order of each process described below can be appropriately changed without changing the gist of the present invention.

FIG. 1 is a schematic diagram of a system 100 according to this embodiment. The system 100 shown in FIG. 1 is composed of multi-function peripherals 10A and 10B (hereinafter, these may be collectively referred to as “multi-function peripheral 10”) and a mobile terminal 50. The multifunction device 10 and the mobile terminal 50 are configured to be communicable via the communication network 101. The communication network 101 may be, for example, a wired LAN (abbreviation of Local Area Network), a wireless LAN, or a combination thereof.

[Complex machine 10]
As shown in FIG. 2A, the multifunction device 10 includes a printer unit 11, a scanner unit 12, a FAX unit 13, a display unit 23, an operation unit 24, a communication unit 25, and a CPU (Central Processing). A unit (abbreviation of Unit) 31, a storage unit 32, and a communication bus 33 are mainly provided. The constituent elements of the multi-function peripheral 10 are connected to each other through the communication bus 33. The multifunction device 10 is an example of an image processing device.

[Printer unit 11, scanner unit 12, FAX unit 13]
The printer unit 11 executes a print operation for recording an image represented by image data on a recording sheet. The recording paper is an example of a sheet or a recording medium. As the recording method of the printer unit 11, a known method such as an inkjet method or an electrophotographic method can be adopted. The scanner unit 12 executes a scanning operation of reading an image recorded on a document and generating image data. The FAX unit 13 executes a FAX transmission operation and a FAX reception operation of transmitting and receiving image data in a method based on the FAX protocol. The printer unit 11, the scanner unit 12, and the FAX unit 13 are examples of operation units.

The printing operation and the FAX transmission operation among the plurality of operations described above are examples of the output operation for outputting the image data. The output operation performed by the multifunction machine 10 is not limited to these. As another example of the output operation, the multifunction peripheral 10 performs a FAX preview transmission operation of transmitting the image data to the mobile terminal 50 through the communication unit 25 in order to display the image represented by the image data received by the FAX reception operation. You may execute. As still another example of the output operation, the multi-function peripheral 10 may execute a label print operation of recording a disk-shaped image (hereinafter referred to as “label image”) on the surface of a CD-ROM or the like. .. Further, the scanning operation and the FAX receiving operation of the above-described plurality of operations are examples of the forming operation for forming the image data. Further, the FAX transmission operation and the FAX reception operation are executed by the FAX unit 13.

In addition, the multi-function device 10 may be capable of performing a combined operation that is a combination of a plurality of operations. For example, a copy operation of recording the image data generated by the scan operation on a recording sheet by the print operation, a scan FAX operation of FAX-transmitting the image data generated by the scan operation by the FAX transmission operation, and an image data FAX-received by the FAX reception processing. The FAX print operation of recording on a recording sheet by the print operation is an example of a composite operation.

The operations that can be executed by the multifunction peripherals 10A and 10B may be different. The multifunction peripheral 10A according to the present embodiment can execute a print operation, a scan operation, a FAX transmission operation, a FAX reception operation, a FAX preview transmission operation, and a label print operation. On the other hand, the multifunction peripheral 10B according to the present embodiment can execute the print operation and the label print operation. Further, the image processing device is not limited to the one capable of performing a plurality of operations, and may be capable of performing only a single operation.

The MIB (abbreviation of Management Information Base) of the multifunction device 10 may define, for example, a device ID that identifies the multifunction device 10 and an action ID that identifies an action that the multifunction device 10 can perform. .. The device ID is an example of device identification information, and the action ID is an example of action identification information. In this embodiment, the multifunction device 10A is identified by the device ID “MFP-A”, and the multifunction device 10B is identified by the device ID “MFP-B”. Hereinafter, the device ID and the operation ID registered in the MIB may be referred to as “device information”.

[Display 23]
The display unit 23 includes a display screen that displays various types of information. As the display unit 23, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be adopted.

[Operation unit 24]
The operation unit 24 receives a user operation for designating an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Furthermore, the operation unit 24 may include a film-shaped touch sensor that is superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display.

The “object” refers to an image that can be specified by the user operating the operation unit 24. As an example, the object may be a character string displayed on the display unit 23, an icon, a button, a link, or the like. The object may be designated by pressing a direction key of the operation unit 24 or a decision button. When the operation unit 24 is a touch panel, the object displayed on the display unit 23 may be designated by touching the display position.

The operation unit 24 implemented as a touch panel outputs position information indicating a position on the display screen touched by the user. It should be noted that the term “touch” in this specification includes all operations for bringing an input medium into contact with the display screen. That is, the tap operation for separating the touched input medium from the display screen within a predetermined time, the long touch operation, the slide operation for sliding the touched input medium on the display screen, the flick operation, the pinch-in operation, the pinch-out operation, etc. Is an example.

Further, even if the input medium does not touch the display screen, bringing the input medium close to a position where the distance from the display screen is very small may be included in the concept of the “touch”. Furthermore, the input medium may be a user's finger, a touch pen, or the like. Hereinafter, tapping of the position of the icon displayed on the display unit 53 will be described as an example of a user operation for designating the icon.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 101. That is, the multifunction device 10 outputs various information to the mobile terminal 50 through the communication unit 25 and receives various data or various information from the mobile terminal 50 through the communication unit 25. The specific communication procedure of the communication unit 25 is not particularly limited, but Wi-Fi (registered trademark of Wi-Fi Alliance) can be used, for example.

[CPU 31]
The CPU 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires various programs described below from the storage unit 32 and executes the programs, based on various information output from the operation unit 24, various information acquired from the external device through the communication unit 25, and the like. That is, the CPU 31 and the storage unit 32 configure an example of the control unit.

[Memory unit 32]
The storage unit 32 has a program storage area 32A and a data storage area 32B. An OS (abbreviation of Operating System) 34 and a device program 35 are stored in the program storage area 32A. The device program 35 may be a single program or an aggregate of a plurality of programs. The data storage area 32B stores data or information required to execute the device program 35.

It should be noted that "data" and "information" in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by a computer without considering the meaning of each bit. On the other hand, “information” refers to information in which the operation of the computer branches depending on the meaning of each bit. Further, the “instruction” is a control signal for prompting the destination device to perform the next operation, and may include information, or have a property as information itself. There is also.

Further, “data” and “information” have the same data and information as long as they are recognized as the same meaning content even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer. Treated as. For example, information indicating "two" is stored as text information of "0x32" in ASCII code in one computer, and is stored as binary information of "10" in binary notation in another computer. May be done.

However, the above-mentioned distinction between "data" and "information" is not strict, and exceptional handling is also allowed. For example, data may be temporarily treated as information, or information may be temporarily treated as data. What is treated as data in one device may be treated as information in another device. Furthermore, information may be extracted from the data or data may be extracted from the information.

The storage unit 32 is, for example, a RAM (abbreviation of Random Access Memory), a ROM (abbreviation of Read Only Memory), an EEPROM (abbreviation of Electrically Erasable Programmable vCPU), and a HDD (HD). It is configured by a buffer or the like or a combination thereof.

The storage unit 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transmission medium. In addition to the above examples, the non-transmission medium also includes a recording medium such as a CD-ROM and a DVD-ROM. The non-transmission medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server or the like on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage medium. Not included in the media.

The program stored in the program storage area 32A is executed by the CPU 31. However, in this specification, the operation of each program may be described by omitting the CPU 31. That is, in the following description, the description to the effect that “the program A executes the process A” may mean that “the CPU 31 executes the process A described in the program A”. The same applies to the mobile terminal 50 described below.

In addition, the program stored in the program storage area 32A determines an event and operates according to the determination result. However, in this specification, the operation of each program may be described by omitting the determination. That is, in the following description, the description that "the program executes the process A according to the condition A" is "determines whether the program is the condition A. The program is a positive determination." According to the above, the process A is executed”. The same applies to the mobile terminal 50 described below.

Further, the program stored in the program storage area 32A specifies, acquires, extracts, determines, or selects data and the like. When the program specifies the data etc., for example, the data matching the condition is specified from the plurality of data etc., and the information for identifying the data etc. itself or the data etc. is stored in a predetermined storage area. Refers to the process of storing. The information for identifying the data or the like is, for example, identification information for identifying the data or the like, an index of an array in which the data or the like is stored, a pointer of a storage area in which the data or the like is stored, or the like. The same applies to the process in which the program acquires, extracts, determines, or selects data or the like. The same applies to the mobile terminal 50 described below.

The OS 34 is an abbreviation of API (Application Programming Interface) for controlling the printer unit 11, the scanner unit 12, the FAX unit 13, the display unit 23, the operation unit 24, the communication unit 25, and the like, which are the hardware configuring the multifunction peripheral 10. ) Is the basic program. That is, each program described above controls each hardware by calling the API provided by the OS 34. However, in this specification, the operation of each program may be described by omitting the OS 34. That is, in the following description, the description that "the program B controls the hardware C" may mean that "the program B controls the hardware C through the API of the OS 34". The same applies to the mobile terminal 50 described below.

As shown in FIG. 3A, the data storage area 32B can store FAX specifying information and FAX data associated with the FAX specifying information. Hereinafter, the entire information shown in FIG. 3A may be referred to as a “FAX list”, and a set of FAX identification information and FAX data associated with each other in the FAX list may be referred to as a “FAX record”. is there. That is, the FAX list can include a plurality of FAX records. FIG. 3A shows an example of the FAX list of the multifunction peripheral 10A.

The FAX data is image data received by the multifunction peripheral 10A from the external device via the FAX unit 13. The FAX identification information is information for causing the multifunction peripheral 10A to individually identify FAX data. The FAX identification information is, for example, a data ID which is data identification information for identifying the FAX data to the multifunction peripheral 10A, a reception date and time of the FAX data identified by the data ID, and transmission of the FAX data identified by the data ID. And the sender's phone number that identifies the origin.

The device program 35 of the multifunction peripheral 10A adds the FAX record to the FAX list in response to the execution of the FAX reception operation. More specifically, the device program 35 receives the FAX data and the transmission source telephone number from the external device through the FAX unit 13 by the FAX receiving operation. In addition, the device program 35 generates a unique data ID in the FAX list and acquires the reception date and time from a system clock (not shown) in response to execution of the FAX reception operation. Then, the device program 35 adds a FAX record including these to the FAX list. The FAX reception operation is automatically executed by the multifunction peripheral 10A without receiving an instruction from the mobile terminal 50 or the like.

The device program 35 can read, edit, or delete the data stored in the data storage area 32B by executing the access API provided by the OS 34. A data ID for identifying the data to be accessed is specified as an argument in the access API. The data ID is information in a format used to specify data in the access API. The data ID is, for example, a file path or URI. On the other hand, part or all of the data stored in the data storage area 32B may be stored in an external server (not shown) such as a cloud server. That is, the device program 35 may transmit various data to the external server through the communication unit 25 and receive various data from the external server through the communication unit 25. The data ID in this case may be in the form of a URL for downloading data from an external server, for example. The same applies to the mobile terminal 50.

[Mobile device 50]
As shown in FIG. 2B, the mobile terminal 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 61, a storage unit 62, and a communication bus 63. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the mobile terminal 50 include the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, which are included in the multifunction peripheral 10. The configuration is similar to that of the storage unit 32 and the communication bus 33, and thus the description thereof is omitted. The CPU 61 and the storage unit 62 are an example of a control unit.

The mobile terminal 50 is, for example, a mobile phone, a smartphone, a tablet terminal, or the like. More specifically, the display unit 53 of the mobile terminal 50 preferably has a display screen size of 12 inches or less, and more preferably 8 inches or less. Further, the operation unit 54 of the portable terminal 50 is preferably a touch panel overlaid on the display screen of the display unit 53.

The display unit 53 of the portable terminal 50 is divided into a common display area 80 and a program display area 81, as shown in FIGS. In the common display area 80, a status bar is displayed by the OS 64 regardless of the display content of the program display area 81. Various information is displayed on the status bar by the OS 64. In the status bar, for example, the title of the screen displayed in the program display area 81, the icon indicating the remaining battery level of the mobile terminal 50, the icon indicating the communication state of the communication unit 55, and the push received by the mobile terminal 50 from the external service. An icon or the like indicating the notification is displayed. In the program display area 81, a screen generated by the program running in the foreground is displayed.

Hereinafter, when it is described that “the program causes the display unit 53 to display a screen”, the program screen is displayed in the program display area 81 and the status bar is displayed in the common display area 80. The program screen is a screen displayed in the program display area 81 according to a program instruction. However, the display unit 53 can switch between a partial screen mode in which the display area is divided into a common display area 80 and a program display area 81, and a full screen mode in which the entire display area is the program display area 81. Good.

The program storage area 62A of the storage unit 62 stores an OS 64, a terminal program 65, a map program 66, and a label editing program 67. The data storage area 62B stores various information shown in FIGS. 3(B) to 3(D). Further, a data folder may be provided in the data storage area 62B. Photo data, document data, presentation data, spreadsheet data, etc. may be stored in the data folder, for example.

The OS 64 may be, for example, Android (registered trademark of Google Inc.) OS, iOS (registered trademark of Cico Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like. The OS 64 can execute a plurality of programs installed in the mobile terminal 50 in parallel. The plurality of programs are virtually executed in parallel by a time division multiplexing method, for example. Further, the OS 64 executes one of a plurality of programs executed in parallel in the foreground, and executes the other programs in the background.

The terminal program 65 is a program that causes a designated device to execute a designated operation for designated data. The designated data refers to image data designated by the user. The designated action refers to the action designated by the user. The designation device refers to the multifunction machine 10 designated by the user. The terminal program 65 can receive the designation data, the designation operation, and the user operation for designating the designation device through the operation unit 54. Hereinafter, data identification information for identifying designated data will be referred to as “designated data ID”, operation identification information for identifying designated operation will be referred to as “designated action ID”, and device identification information for identifying a designated device will be referred to as “designated device ID”. Sometimes referred to as "ID".

The terminal program 65 supports one or more operations. The operation supported by the terminal program 65 is an example of the first support operation. That is, the first support operation refers to an operation in which the terminal program 65 can execute the execution preparation process described later. In other words, the first support operation refers to an operation that can be the designated operation. The first support operation according to this embodiment is a print operation, a scan operation, a copy operation, a FAX transmission operation, and a FAX preview transmission operation. The action ID of the first support action may be referred to as “first support action ID”.

The terminal program 65 is activated by the OS 64 that receives a user operation on a menu screen described later, or by the map program 66 or the label editing program 67. Further, the terminal program 65 activates the map program 66 and the label editing program 67 by executing a plugin API for activating an application as a plugin. Hereinafter, the map program 66 and the label editing program 67 activated by the plug-in API may be referred to as “plug-in”.

The map program 66 and the label editing program 67 are examples of activation source programs that are activated by the OS 64 and that execute the explicit shared API with the specified information as an argument to activate the terminal program 65. The map program 66 and the label editing program 67 are examples of external programs that are activated as so-called plug-ins by the terminal program 65 and provide the designation information to the terminal program 65 as return values of the plug-in API. Furthermore, the map program 66 and the label editing program 67 may execute the plug-in API having the designation information as an argument to start the terminal program 65. The designation information includes at least one of a designation data ID, a designation operation ID, and a designation device ID.

The map program 66 according to the present embodiment allows the user to specify an arbitrary area of the map image, stores the image data indicating the map image of the specified area in the data storage area 32B, and stores the data ID of the stored image data. Is provided to the terminal program 65 as the designated data ID. Further, the map program 66 allows the user to specify one of the print operation and the FAX transmission operation, and provides the operation ID of the specified operation to the terminal program 65 as the specified operation ID.

Further, the label editing program 67 according to the present embodiment edits the label image according to the user operation, stores the label image data indicating the label image in the data storage area 32B, and specifies the data ID of the stored label image data. The data ID is provided to the terminal program 65. Further, the label editing program 67 allows the user to specify one of the print operation and the label print operation, and provides the operation ID of the specified operation to the terminal program 65 as the specified operation ID.

The operation supported by the map program 66 and the label editing program 67 is an example of the second support operation. The second support operation of the map program 66 according to this embodiment is a print operation and FAX transmission. That is, the second support operation refers to an operation that can be an operation to be executed by the specified device with respect to the specified data specified by the user operation on the plug-in. The second support operation of the label editing program 67 according to this embodiment is a print operation and a label print operation. Hereinafter, the action ID of the second support action can be referred to as a “second support action ID”.

The OS 64 provides the program installed in the portable terminal 50 with the sharing function of activating the second program designated by the first program and providing the designation information designated by the first program to the second program. The first program can use the sharing function, for example, by executing an API provided by the OS 64 (hereinafter, referred to as “shared API”). More specifically, the first program executes the shared API by using the program ID and the designation information of the second program as arguments. The sharing function of the Android OS is an example of the sharing function.

The sharing source application executes the explicit sharing API with the information specifying the predetermined application, the URI, the type, and the action as arguments in response to the user's instruction to use the sharing function. You may start the application of the predetermined sharing destination. The URI is information indicating the location of shared data. The type is information indicating the data format of shared data. The action is information indicating the type of processing (for example, browsing, editing, transmitting, printing, etc.) on the shared data to be executed by the sharing destination application. The URI, type, and action are examples of the designation information provided from the sharing source application to the sharing destination application.

In the present embodiment, for example, the terminal program 65 may be set as a predetermined sharing destination application in the map program 66 that is the sharing source application. More specifically, the setting file referred to by the map program 66 at the time of start-up, or the source code of the map program 66 may include information specifying the terminal program 65. The same applies to the label editing program 67 which is another example of the sharing source application.

In addition, the sharing source application may execute the implicit sharing API by using the URI, the type, and the action as arguments in response to receiving the user operation instructing the use of the sharing function through the operation unit 54. As a result, the OS 64 displays a list of applications that have been declared to the OS 64 as being able to execute the process indicated by the action on the shared data in the data format indicated by the type among the applications installed in the mobile terminal 50. You may display on the part 53 and start the application designated by the user from the list.

The data storage area 62B can store designated device information as shown in FIG. The designated device information includes a device ID that identifies the designated device and an action ID that identifies an operation that can be performed by the designated device. The action ID included in the designated device information is an example of the designated action ID. The designated device information is stored in the data storage area 62B by the terminal program 65. Note that the designated device information may or may not be stored in the data storage area 62B at the time of starting a standard startup process and an external startup process described later.

Further, the data storage area 62B can store a designated action ID as shown in FIG. The designated action ID is temporarily stored in the data storage area 62B by the terminal program 65 that has received a user operation designating the designated action. The designated action ID is not stored in the data storage area 62B at the start of the standard activation process and the external activation process.

Further, as shown in FIG. 3D, the data storage area 62B can store a program ID for identifying the program and a second support operation ID associated with the program ID. In the example of FIG. 3D, the program ID “001” identifies the map program 66, and the program ID “002” identifies the label editing program 67. The program ID and the second support operation ID corresponding to each other may be stored in the data storage area 62B when the terminal program 65 is installed, or may be stored in the data storage area 62B when the map program 66 and the label editing program 67 are installed. Good.

[Operation of system 100]
The operation of the system 100 according to the present embodiment will be described with reference to FIGS. 4 to 8.

First, the OS 64 of the mobile terminal 50 causes the display unit 53 to display a menu screen. FIG. 9A is an example of a menu screen. The menu screen shown in FIG. 9A includes a plurality of program icons 111, 112, 113, 114, 115. The program icons 111 to 115 correspond to the programs installed in the mobile device 50. For example, the program icon 111 corresponds to the terminal program 65, the program icon 112 corresponds to the map program 66, and the program icon 113 corresponds to the label editing program 67.

Then, the OS 64 receives the designation of one of the program icons 111 to 115 through the operation unit 54. The OS 64 activates the terminal program 65 in response to the designation of the program icon 111 received through the operation unit 54. The designation of the program icon 111 is an example of a user operation for instructing the activation of the terminal program 65. The terminal program 65 of the mobile terminal 50 executes standard startup processing in response to being booted from the OS 64. The details of the standard startup process will be described with reference to FIG.

[Standard startup processing]
First, the terminal program 65 causes the display unit 53 to display the main screen, which is an example of the first screen (S11). FIG. 9B is an example of the main screen. The main screen includes operation icons 121, 122, 123, 124, a status icon 125, plug-in icons 126, 127, and a device icon 128. Further, the terminal program 65 receives a user operation on the main screen through the operation unit 54 (S12). The process of step S11 is an example of the first display process, and the process of step S12 is an example of the reception process.

The motion icon 121 is an example of a motion object corresponding to a print motion. The motion icon 122 is an example of a motion object corresponding to a scan motion. The operation icon 123 is an example of a composite operation object corresponding to a copy operation that combines a print operation and a scan operation. The operation icon 124 is an example of an inclusion object corresponding to both the FAX transmission operation and the FAX preview transmission operation. The status icon 125 corresponds to an instruction to display a status screen showing the state of the designated device. Description of the details of the status screen is omitted. The plug-in icon 126 corresponds to an instruction to execute the plug-in API and activate the map program 66. The plug-in icon 127 corresponds to an instruction to execute the plug-in API and activate the label editing program 67.

The terminal program 65 determines which operation icon, out of the operation icons 121 to 124 corresponding to the support operation ID, to include in the main screen based on the designated device information stored in the data storage area 62B. More specifically, the terminal program 65 includes, in the main screen, the operation icon corresponding to the operation ID included in the designated device information among the operation icons 121 to 124 that can be displayed on the display unit 53. On the other hand, the terminal program 65 includes the operation icons 121 to 124 corresponding to all the support operation IDs in the main screen in response to the specified device information not being stored in the data storage area 62B.

That is, the terminal program 65 includes the operation icon 121 in the main screen in response to the operation ID “print” being included in the designated device information. On the other hand, the terminal program 65 does not include the operation icon 121 in the main screen because the operation ID “print” is not included in the designated device information. Similarly, the terminal program 65 includes the operation icon 122 in the main screen in response to the operation ID “scan” being included in the designated device information. On the other hand, the terminal program 65 does not include the operation icon 122 in the main screen because the operation ID “scan” is not included in the designated device information.

In addition, the terminal program 65 includes the operation icon 123 in the main screen when both the operation ID “print” and the operation ID “scan” are included in the designated device information. On the other hand, the terminal program 65 does not include the operation icon 123 in the main screen when at least one of the operation ID “print” and the operation ID “scan” is not included in the designated device information. The print operation is an example of the first operation, the scan operation is an example of the second operation, the operation ID “print” is an example of the first operation information, and the operation ID “scan” is an example of the second operation information. is there.

Further, the terminal program 65 includes the operation icon 124 in the main screen in response to the specified device information including at least one of the operation ID “FAX transmission” and the operation ID “FAX preview transmission”. On the other hand, the terminal program 65 does not include the operation icon 124 in the main screen because the specified device information does not include both the operation ID “FAX transmission” and the operation ID “FAX preview transmission”. The FAX transmission operation is an example of a third operation, the FAX preview transmission operation is an example of a fourth operation, the operation ID “FAX transmission” is an example of third operation information, and the operation ID “FAX preview transmission” is an example. 4 is an example of operation information.

Furthermore, the terminal program 65 includes the plug-in icon 126 in the main screen in response to the map program 66 being installed in the mobile terminal 50. On the other hand, the terminal program 65 does not include the plug-in icon 126 in the main screen because the map program 66 is not installed in the mobile terminal 50. Similarly, the terminal program 65 includes the plug-in icon 127 in the main screen when the label editing program 67 is installed in the mobile terminal 50. On the other hand, the terminal program 65 does not include the plug-in icon 127 in the main screen because the label editing program 67 is not installed in the mobile terminal 50.

The device icon 128 is an example of a device designation object corresponding to designation of a designated device which is one of the multifunction peripherals 10A and 10B. In response to the designated device information being stored in the data storage area 62B, the terminal program 65 sets the device ID “MFP-A” included in the designated device information, as shown in FIG. 9B. It is described in the device icon 128 as the designated device ID at the present time. On the other hand, the terminal program 65 describes, in the device icon 128, a character string of "unselected" indicating that the specified device is not specified at the present time in response to the fact that the specified device information is not stored in the data storage area 62B. To do.

Next, when the terminal program 65 receives the designation of one of the motion icons 121 to 124 through the operation unit 54 (S12: motion icon), the terminal program 65 sets the motion ID corresponding to the designated motion icon to the designated motion ID. Is temporarily stored in the data storage area 62B (S13). Further, the terminal program 65 receives the designation of one of the plug-in icons 126 and 127 through the operation unit 54, and then, in response to receiving the designation of one of the plug-in icons 126, sets the second support action ID of the program corresponding to the designated plug-in icon Is temporarily stored in the data storage area 62B (S13).

The designated action ID stored in step S13 is until the execution instruction process described later is executed, another action icon 121 to 124 or the plug-in icon 126 is designated, or the terminal program 65 is terminated. Up to the data storage area 62B. The user operation of designating the motion icon is an example of the user operation of designating the motion. The process of step S13 is an example of the storage process or the third storage process.

Next, the terminal program 65 determines whether or not the designated device information is stored in the data storage area 62B (S14). The case where the designated device information is stored in the data storage area 62B is, for example, the case where a first device selection process described below or a second device selection process described below has been executed in the past. On the other hand, the case where the designated device information is not stored in the data storage area 62B is, for example, the case where the first device selection process or the second device selection process has never been executed in the past. The process of step S14 is an example of the first determination process. Then, in response to determining that the designated device information is stored in the data storage area 62B (S14: Yes), the terminal program 65 executes the execution preparation process corresponding to the designated operation icon (S15). ..

The execution preparation process is a process of preparing for the designated device to execute the designated operation. The execution preparation process includes, for example, a process of accepting designation of designated data, a process of accepting designation of execution conditions of a designated action, a process of confirming an image of an execution result of the designated action, and the like. The execution conditions of the designated operation include, for example, the number of copies of recording paper on which an image is recorded by the print operation, the reading resolution in the scan operation, the FAX number for specifying the external device of the FAX transmission destination in the FAX transmission operation, and the like.

As an example, the terminal program 65 receives the designation of the operation icon 121 through the operation unit 54, and in response to determining that the specified device information is stored in the data storage area 62B (S12: operation icon & S14: Yes). A print preparation process, which is an example of the execution preparation process, is executed. As another example, the terminal program 65 receives the designation of the operation icon 124 through the operation unit 54, and in response to determining that the designated device information is stored in the data storage area 62B (S12: movement icon & S14: Yes), a FAX preparation process, which is an example of the execution preparation process, is executed. Details of the print preparation process and the FAX preparation process will be described later with reference to FIGS.

Although not shown, the execution preparation process when the operation icon 122 is specified is a process of accepting, for example, the specification of the reading resolution of the scan operation, the specification of the storage destination of the image data generated by the scan operation, and the like. May be. Although not shown, the execution preparation process when the operation icon 123 is specified includes, for example, the specification of the scanning resolution of the scan operation and the layout of the image (for example, 2 in 1) recorded on the recording paper by the print operation. It may be a process of receiving the designation.

On the other hand, in response to the terminal program 65 accepting the designation of the operation icon through the operation unit and determining that the designated device information is not stored in the data storage area 62B (S12: operation icon & S14: No), the second An unselected notification screen 130, which is an example of a screen, is displayed on the display unit 53 (S16). Then, the terminal program 65 receives a user operation on the unselected notification screen 130 through the operation unit 54 (S17). The process of step S16 is an example of the second display process, and the process of step S17 is an example of the reception process.

FIG. 10(A) is an example of the unselected notification screen 130, which is a pop-up window superimposed and displayed on the main screen. The unselected notification screen 130 includes a message “It is necessary to select a multifunction device. Do you want to select it?”, a [Select now] icon 131, and a [Select later] icon 132. The [select now] icon 131 is an example of a first object corresponding to selecting a designated device, and the [select later] icon 132 is an example of a second object corresponding to not selecting a designated device.

Next, the terminal program 65 executes the second device selection process in response to the designation of the [select now] icon 131 received through the operation unit 54 (S17: [select now] icon) (S18). .. Then, the terminal program 65 uses the designated device information newly stored in the data storage area 62 in the second device selection processing to execute the processing from step S11. On the other hand, when the terminal program 65 receives the designation of the [select later] icon 132 via the operation unit 54 (S17: [select later] icon), the terminal program 65 executes the second device selection process without executing the step. The processing after S11 is executed. The second device selection process is an example of the second designation process. Details of the second device selection processing will be described later with reference to FIG.

Further, the terminal program 65 determines whether or not the designated operation ID is stored in the data storage area 62B in response to the designation of the device icon 128 received through the operation unit 54 (S12: device icon) (S19). ). As an example, if the device icon 128 is specified after one of the operation icons 121 to 124 or the plug-in icons 126 and 127 is specified, it is determined in step S19 that the specified operation ID is stored. As another example, when the device icon 128 is specified before the operation icons 121 to 124 or the plug-in icons 126 and 127 are specified, it is determined in step S19 that the specified operation ID is not stored. The process of step S19 is an example of the second determination process.

Then, in response to the terminal program 65 accepting the designation of the device icon 128 through the operation unit 54 and determining that the designated operation ID is not stored in the data storage area 62B (S12: device icon & S19: No), A first device selection process is executed (S20). The first device selection process is an example of the first designation process. Details of the first device selection processing will be described later with reference to FIG. On the other hand, in response to the terminal program 65 accepting the designation of the device icon 128 through the operation unit 54 and determining that the designated operation ID is stored in the data storage area 62B (S12: device icon & S19: Yes), A second device selection process is executed (S21). Then, the terminal program 65 uses the designated device information newly stored in the data storage area 62B in the first device selection process or the second device selection process to execute the processes in and after step S11.

[First device selection process]
The terminal program 65 searches for a plurality of multifunction peripherals 10 that can communicate with each other through the communication unit 55 and can be designated as the designated device (S31). Specifically, the terminal program 65 uses SNMP (abbreviation of Simple Network Management Protocol) to broadcast the transmission request information to the communication network 101 through the communication unit 55, for example. The transmission request information is information for requesting the transmission of the device information stored in the MIB of the device that can be designated as the designated device. That is, only the device that can be designated as the designated device returns the device information. Next, the terminal program 65 receives the device information transmitted by the multifunction peripheral 10 as a response to the transmission request information from the multifunction peripheral 10 through the communication unit 55. In step S31 of the present embodiment, the mobile terminal 50 is assumed to have received the device information from the multifunction peripheral 10A, 10B. The device information received from the multi-function peripheral 10 includes an operation ID indicating an operation that can be executed by the multi-function peripheral 10. The process of step S31 is an example of the receiving process. The search for a plurality of communicable multifunction peripherals 10 may be performed by another known method.

Next, the terminal program 65 determines whether or not the plug-in is installed in the mobile terminal 50 (S32). Then, in response to the determination that the plug-in is installed (S32: Yes), the terminal program 65 selects the first support of the multifunction peripherals 10A and 10B that is the transmission source of the device information received in step S31. The multifunction peripherals 10A and 10B capable of executing any one of the operation and the second support operation are specified (S33). On the other hand, the terminal program 65, in response to determining that the plug-in is not installed (S32: No), can execute any one of the first support operations of the multifunction machines 10A and 10B. 10A is specified (S34). The process of step S32 is an example of a third determination process, and the processes of steps S31, S33, S34 are an example of a first specifying process.

As an example, in step S33, the terminal program 65 transmits the device information in response to one of the first support operation ID and the second support operation ID being included in the device information received in step S31. The original multi-function peripheral 10 may be specified as the multi-function peripheral 10 that can execute any one of the first support operation and the second support operation. As another example, the terminal program 65 may request the multifunction device 10 to return the device information including one of the first support operation ID and the second support operation ID in step S31. Then, in step S33, the terminal program 65 specifies the multifunction machine 10 that is the transmission source of the device information received in step S31 as the multifunction machine 10 that can execute either one of the first support operation and the second support operation. You may. Similar processing may be executed in step S34.

Next, the terminal program 65 causes the display unit 53 to display a device selection screen, which is an example of a first selection screen (S35). Then, the terminal program 65 receives a user operation on the device selection screen through the operation unit 54 (S36). The process of step S35 is an example of a first selection screen display process, and the process of step S36 is an example of a reception process.

FIG. 10B is an example of the device selection screen when the multifunction peripherals 10A and 10B are specified in step S33. The device selection screen shown in FIG. 10B includes device icons 135 and 136. On the other hand, FIG. 11A is an example of the device selection screen when only the multifunction peripheral 10A is specified in step S34. The device selection screen shown in FIG. 11A includes only the device icon 135. The device icons 135 and 136 correspond to the multifunction peripherals 10A and 10B identified in steps S33 and S34. Further, the device icons 135 and 136 describe the device IDs of the corresponding multifunction peripherals 10A and 10B.

Then, for example, in response to receiving the designation of the device icon 136 through the operation unit 54 (S36: Yes), the terminal program 65 stores the device information of the multifunction peripheral 10B corresponding to the device icon 136 in the data storage area 62B. The stored designated device information is updated (S37). The user operation of designating the device icon 136 is an example of the user operation of designating the multifunction peripheral 10B as the designation device. The process of step S37 is an example of the first storage process.

[Second device selection process]
The terminal program 65 searches for a plurality of multifunction machines 10 that can communicate with each other through the communication unit 55 and can be designated as a designated device (S41). Next, the terminal program 65 identifies the multifunction machine 10 that can execute the designated operation from the multifunction machines 10A and 10B that are the transmission sources of the device information received in step S41 (S42). Then, the terminal program 65 causes the display unit 53 to display the device selection screen, which is an example of the second selection screen (S43). The device selection screen includes a device icon corresponding to the multifunction machine 10 identified in step S42. The process of step S41 is an example of the receiving process, the processes of steps S41 and S42 are an example of the second specifying process, and the process of step S43 is an example of the second selection screen display process.

As an example, after the operation icon 121 is specified, that is, in the second device selection process when the specified operation ID “print” is stored, the terminal program 65 executes the print operation of the multifunction peripherals 10A and 10B. Only possible multifunction devices 10A are specified (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display unit 53 to display a device selection screen including only the device icon 135 (S43).

As another example, after the operation icon 123 is specified, that is, in the second device selection process when the specified operation ID “copy” is stored, the terminal program 65 causes the print operation of the multifunction peripherals 10A and 10B to be performed. Only the multifunction peripheral 10A capable of executing both the scan operation and the scan operation is specified (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display unit 53 to display a device selection screen including only the device icon 135 (S43).

As another example, in the second device selection process after the operation icon 124 is specified, that is, when the specified operation IDs “FAX transmission” and “FAX preview transmission” are stored, the terminal program 65 causes the multifunction peripheral 10A to operate. Among 10B, only the multifunction peripheral 10A capable of executing at least one of the FAX transmission operation and the FAX preview transmission operation is specified (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display unit 53 to display a device selection screen including only the device icon 135 (S43).

As still another example, after the plug-in icon 127 is designated, that is, in the second device selection process when the designated operation IDs “print” and “label print” are stored, the terminal program 65 causes the multifunction peripheral 10A to perform processing. 10B, the multifunction device 10A capable of executing all the designated operations and the multifunction device 10B capable of performing only a part of the designated operations are specified (S42). Then, the terminal program 65 causes the display unit 53 to display a device selection screen including the device icons 135 and 136 as shown in FIG. 11B (S43).

In the device selection screen shown in FIG. 11B, the device icon 135 corresponding to the multifunction machine 10A capable of executing all the designated operations is the device icon 135 corresponding to the multifunction machine 10B capable of performing only a part of the designated operations. It is displayed above 136. That is, the terminal program 65 replaces the device icon 135 corresponding to the multifunction peripheral 10A having a large number of executable second support operations with the device icon 136 corresponding to the multifunction peripheral 10B having a small number of executable second support operations. Display with priority.

Further, in the device selection screen shown in FIG. 11B, the device icon 135 has operation identification images 137 and 138 attached thereto, and the device icon 136 has an operation identification image 139 attached thereto. The operation identification images 137 to 139 are images showing the second support operation that the corresponding multifunction peripherals 10A and 10B can execute. More specifically, the operation identification image 137 shows a print operation, and the operation identification images 138, 139 show a label print operation.

Then, for example, in response to receiving the designation of the device icon 136 through the operation unit 54 (S44: Yes), the terminal program 65 stores the device information of the multifunction peripheral 10B corresponding to the device icon 136 in the data storage area 62B. The stored designated device information is updated (S45). The process of step S45 is an example of the second storage process.

The first device selection process is a process of causing the user to specify the specified device in a state where the specified operation is not specified. On the other hand, the second device selection process is a process of causing the user to specify the specified device in the state where the specified operation is specified. That is, the first device selection process and the second device selection process are common in that the user selects the designated device, and differ in whether or not the designated operation is designated at the time of executing each process.

In the first device selection process and the second device selection process, for example, the processes of steps S31 and S41, the processes of steps S35 and S43, the processes of steps S36 and S44, and the processes of steps S37 and S45 are common. It may be. More specifically, the device selection screens displayed in steps S35 and S45 may have the same screen layout and the same display mode of the device icon. The user operation accepted in steps S36 and S44 may be common.

[Print preparation processing]
First, the terminal program 65 displays a data selection screen on the display unit 53 (S51). FIG. 12A is an example of the data selection screen. The data selection screen shown in FIG. 12A includes a plurality of data icons 141, 142, 143. The data icons 141 to 143 correspond to, for example, various data stored in a data folder or various data stored in a server (not shown) on the Internet. Then, the terminal program 65 receives a user operation on the data selection screen through the operation unit 54 (S52). The process of step S52 is an example of a reception process.

Next, the terminal program 65, for example, in response to receiving the designation of the data icon 141 via the operation unit 54 (S52: Yes), determines the data “photograph.JPEG” corresponding to the data icon 141 as the designated data. The user operation of designating the data icon is an example of the user operation of designating the designated data. Next, the terminal program 65 displays a preview screen on the display unit 53 (S53). Further, the terminal program 65 receives a user operation on the preview screen through the operation unit 54 (S54). The process of step S54 is an example of a reception process.

FIG. 12B is an example of the preview screen. The preview screen shown in FIG. 12B includes a preview image 145 and a [print] icon 146. The preview image 145 is an image showing the result of causing the designated device to perform the designated operation for the designated data. The preview image 145 according to the present embodiment shows an image in which the image represented by the data “photograph.JPEG” is recorded on a recording sheet. The [print] icon 146 is an example of an execution instruction object corresponding to an instruction to execute a designated operation. That is, the [print] icon 146 corresponds to an instruction to cause the designated device to execute the print operation for the designated data.

Next, in response to the designation of the [Print] icon 146 received through the operation unit 54 (S54: Yes), the terminal program 65 transmits the print instruction information to the multifunction peripheral 10A, which is the designation device, through the communication unit 55. (S55). The print instruction information is information for executing the print operation for the designated data. The print instruction information includes, for example, designated data or a designated data ID for identifying the designated data, and a designated operation ID “print”. The process of step S55 is an example of the execution instruction process. The file path of the designated data or the URL of the designated data stored in the server is an example of the designated data ID.

On the other hand, although illustration is omitted, the device program 35 of the multifunction peripheral 10A receives the print instruction information from the portable terminal 50 through the communication unit 25. Then, the device program 35 causes the printer unit 11 to execute the print operation according to the received print instruction information.

[FAX preparation processing]
The terminal program 65 displays the operation selection screen on the display unit 53 (S61). FIG. 13A is an example of the operation selection screen. The operation selection screen shown in FIG. 13A includes operation icons 148 and 149. The operation icon 148 is an example of an operation object corresponding to the FAX transmission operation, and the operation icon 149 is an example of an operation object corresponding to the FAX preview transmission operation. Then, the terminal program 65 receives a user operation on the operation selection screen through the operation unit 54 (S62). The process of step S62 is an example of a reception process.

The terminal program 65 sets the operation icon 148 in a mode in which the operation icon 148 can be specified in response to the operation ID “FAX transmission” included in the specified device information. On the other hand, the terminal program 65 renders the operation icon 148 unspecifiable (for example, grayed out or hidden) when the specified device information does not include the operation ID “FAX transmission”. Similarly, the terminal program 65 sets the operation icon 149 in a mode in which the operation icon 149 can be specified in response to the operation ID “send FAX preview” included in the specified device information. On the other hand, the terminal program 65 renders the operation icon 149 undesignable (for example, grayed out or hidden) in response to the operation ID “FAX preview transmission” not being included in the specified device information.

Next, the terminal program 65 stores data in response to the designation of the action icon 148 in a specifiable manner through the operation unit 54 (S62: FAX transmission icon), with the action ID “FAX transmission” as the designated action ID. The area 62B is temporarily stored. Next, the terminal program 65 displays the FAX transmission screen on the display unit 53 (S63). Then, the terminal program 65 receives a user operation on the FAX transmission screen through the operation unit 54 (S64). The process of step S64 is an example of a reception process.

FIG. 13B is an example of a FAX transmission screen. The FAX transmission screen shown in FIG. 13B includes acquisition source icons 151 and 152. The acquisition source icon 151 is an example of an execution instruction object corresponding to an instruction to cause the scanner unit 12 to perform a scan operation and to cause the FAX unit 13 to FAX-transmit the image data generated by the scan operation. The acquisition source icon 152 is an example of an execution instruction object corresponding to an instruction to cause the FAX unit 13 to FAX-transmit the image data stored in the data storage area 62B.

The terminal program 65 sets the acquisition source icon 151 to be specifiable in response to the designation device information including the operation ID “scan”. On the other hand, the terminal program 65 renders the acquisition source icon 151 undesignable (for example, grayed out or hidden) when the designated device information does not include the operation ID “scan”. On the other hand, the terminal program 65 makes the acquisition source icon 152 always specifiable. Further, the FAX transmission screen may further include an acquisition source icon corresponding to an instruction to acquire the image data stored in the server on the Internet.

Next, when the terminal program 65 receives the designation of the acquisition source icon 151 in a specifiable manner through the operation unit 54 (S64: scan icon), the terminal program 65 sends a fax to the designated device, the multifunction peripheral 10A, through the communication unit 55. The instruction information is transmitted (S67). The FAX instruction information is information for executing a FAX transmission operation for designated data. The process of step S67 is an example of the execution instruction process.

The FAX instruction information transmitted by designating the acquisition source icon 151 includes an operation ID “FAX transmission” and scan instruction information instructing execution of a scan operation. That is, the FAX instruction information is information for causing the scanner unit 12 to perform a scan operation and causing the FAX unit 13 to perform a FAX transmission operation in which the image data generated by the scan operation is designated data. Although not shown, the terminal program 65 accepts a user operation for designating transmission destination information (for example, a FAX number) for identifying the external device of the FAX transmission destination through the operation unit 54, and transmits the transmission destination information to the FAX. Include in instruction information.

On the other hand, although illustration is omitted, the device program 35 of the multifunction peripheral 10A receives the FAX instruction information from the portable terminal 50 through the communication unit 25. Then, the device program 35 causes the scanner unit 12 to perform the scan operation in accordance with the scan instruction information included in the FAX instruction information. The scanner unit 12 reads an image recorded on a document set on a contact glass (not shown) or an ADF (abbreviation of Auto Document Feeder), and generates image data indicating the image. Further, the device program 35 causes the FAX unit 13 to execute the FAX transmission operation for the image data generated by the scanning operation by the scanner unit 12. That is, the FAX unit 13 FAX-transmits the image data generated by the scanning operation to the external device identified by the destination information included in the FAX instruction information.

Further, the terminal program 65 causes the display unit 53 to display, for example, the data selection screen shown in FIG. 12A in response to receiving the designation of the acquisition source icon 152 through the operation unit 54 (S64: local icon). (S65). Then, the terminal program 65 receives a user operation on the data selection screen through the operation unit 54 (S66). The processing of steps S65 and S66 may be the same as the processing of steps S51 and S52.

Next, the terminal program 65 determines, for example, when the designation of the data icon 141 is received through the operation unit 54 (S66: Yes), the data “photograph.JPEG” corresponding to the data icon 141 is designated data. Then, the terminal program 65 transmits the FAX instruction information to the multifunction peripheral 10A, which is the designated device, through the communication unit 55 (S67). The FAX instruction information transmitted by designating the acquisition source icon 152 includes designation data or a designation data ID, an operation ID “FAX transmission”, and transmission destination information.

On the other hand, although illustration is omitted, the device program 35 of the multifunction peripheral 10A receives the FAX instruction information from the portable terminal 50 through the communication unit 25. Then, the device program 35 causes the FAX unit 13 to execute the FAX transmission operation according to the FAX instruction information. That is, the FAX unit 13 instructs the external device, which is identified by the destination information included in the FAX instruction information, the designation data included in the FAX instruction information or the designation data ID included in the FAX instruction information. Send data by fax.

Further, in response to the designation of the operation icon 149 received through the operation unit 54 (S62: FAX preview icon), the terminal program 65 displays the plurality of FAX specifying information included in the FAX list stored in the multifunction peripheral 10A. , Through the communication unit 55 from the multifunction peripheral 10A which is the designated device (S68). More specifically, the terminal program 65 transmits the transmission request information requesting the transmission of the FAX specifying information to the multifunction peripheral 10A through the communication unit 55. Next, the terminal program 65 receives the FAX specifying information transmitted as a response to the transmission request information from the multifunction peripheral 10A through the communication unit 55. Then, the terminal program 65 temporarily stores the received FAX specifying information in the data storage area 62B.

Next, the terminal program 65 displays the FAX selection screen on the display unit 53 (S69). FIG. 14A is an example of the FAX selection screen. The FAX selection screen shown in FIG. 14A includes a plurality of FAX icons 155 and 156. FAX icons 155 and 156 are examples of execution instruction objects corresponding to FAX preview transmission operations. The FAX icons 155 and 156 correspond to each of the plurality of FAX specifying information received in step S68. Further, the FAX icons 155 and 156 describe the reception date and time and the transmission source telephone number included in the corresponding FAX specifying information. Then, the terminal program 65 receives a user operation on the FAX selection screen through the operation unit 54 (S70). The process of step S70 is an example of a reception process.

Next, the terminal program 65 transmits the transmission instruction information through the communication unit 55 to the multifunction peripheral 10A, which is the designated device, in response to receiving the designation of the FAX icon 155 through the operation unit 54 (S70: Yes), for example ( S71). The transmission instruction information is an example of execution instruction information for instructing transmission of the FAX data 1 specified by the FAX specifying information corresponding to the FAX icon 155. The transmission instruction information includes, for example, the operation ID “FAX preview transmission” and the data ID “001” included in the FAX specifying information corresponding to the FAX icon 155. The process of step S71 is an example of the execution instruction process.

On the other hand, although not shown, the device program 35 of the multifunction peripheral 10A receives the transmission instruction information from the mobile terminal 50 through the communication unit 25. Then, the device program 35 reads the FAX data 1 identified by the data ID “001” included in the transmission instruction information from the FAX list, and transmits the FAX data 1 to the mobile terminal 50 through the communication unit 25.

Next, the terminal program 65 receives the FAX data 1 from the multifunction peripheral 10A through the communication unit 55 (S72: Yes). Next, the terminal program 65 displays the FAX preview screen on the display unit 53 (S73). FIG. 14B is an example of the FAX preview screen. The FAX preview screen shown in FIG. 14B includes a FAX image 160 and operation icons 161 and 162. Then, the terminal program 65 receives a user operation on the FAX preview screen through the operation unit 54 (S74). The process of step S74 is an example of a reception process.

The FAX image 160 is an image represented by the FAX data 1 received in step S72. Further, the FAX header included in the FAX image 160 includes, for example, the reception date and time and the transmission source telephone number included in the corresponding FAX specifying information. The operation icon 161 corresponds to an instruction to end the display of the FAX preview screen. The operation icon 162 is an example of an execution instruction object corresponding to a print operation execution instruction for the FAX data 1. It should be noted that the terminal program 65 is configured to be able to specify the operation icon 162 when the specified device information includes the operation ID “print”. On the other hand, the terminal program 65 renders the operation icon 162 undesignable (for example, grayed out or hidden) in response to the operation ID “print” not being included in the specified device information.

Next, the terminal program 65 ends the display of the FAX preview screen in response to the designation of the operation icon 161 received through the operation unit 54 (S74: OK icon). On the other hand, when the terminal program 65 receives the designation of the operation icon 162 of the specifiable mode through the operation unit 54 (S74: print icon), the terminal program 65 causes the communication unit 55 to send the print instruction information to the multifunction peripheral 10A, which is the designation device. Is transmitted (S75). The print instruction information includes, for example, the operation ID “print” and the designated data ID of the FAX data 1 or the designated data ID for identifying the FAX data 1. The process of step S75 and the process of the multifunction peripheral 10A that receives the print instruction information may be the same as step S55.

Although illustration is omitted, for example, when the plug-in icon 126 is specified, the terminal program 65 executes the plug-in API in step S15 to execute the map program 66 corresponding to the specified plug-in icon 126. To start. As a result, the OS 64 executes the terminal program 65 in the background and the map program 66 in the foreground. Note that the same processing is executed when the plug-in icon 127 is specified.

The map program 66 acquires map image data including the current position of the mobile terminal 50 acquired from GPS (abbreviation of Global Positioning System) from a server (not shown) through the communication unit 55, for example. Specifically, the map program 66 requests the server for map image data through the communication unit 55, and receives the map image data returned from the server through the communication unit 55. Next, the map program 66 displays a map designation screen on the display unit 53. The map designation screen includes, for example, a map image indicated by the map image data acquired from the server, a [print] icon, and a [FAX transmission] icon.

Next, the map program 66 receives a user operation on the map designation screen through the operation unit 54. The map program 66 changes the map image displayed on the map designation screen in response to the user operation at the position of the map image received through the operation unit 54. The map program 66 acquires map image data indicating the changed map image from the server. The map image displayed on the map designation screen is, for example, slid following a slide operation, reduced following a pinch-in operation, and enlarged following a pinch-out operation.

Further, the map program 66 receives the designation of the [print] icon through the operation unit 54, and stores the map image data indicating the map image displayed on the map designation screen in the data storage area 62B as the designation data. Store temporarily. Then, the map program 66 provides the designated data ID for identifying the temporarily stored map image data and the designated operation ID “print” to the terminal program 65 as a return value of the plug-in API. The file name or file path is an example of the designated data ID. On the other hand, when the [FAX transmission] icon is designated, the designated action ID “FAX transmission” is provided to the terminal program 65 as the return value of the plug-in API, instead of the designated action ID “print”.

As a result, the OS 64 ends the map program 66 and executes the terminal program 65 again in the foreground. Further, the terminal program 65 acquires the designated data ID and the designated operation ID from the map program 66 as a return value of the plug-in API. Then, with respect to the designated data identified by the designated data ID acquired from the map program 66, the terminal program 65 causes the designated device identified by the device ID included in the designated device information to perform the designated operation obtained from the map program 66. The specified operation identified by the ID is executed. Further, the terminal program 65 may display a preview screen on the display unit 53 before causing the designated device to execute the designated operation.

[External start processing]
Further, the map program 66 may be activated by the OS 64 to execute the above-described processing when a user operation for designating the program icon 112 on the menu screen shown in FIG. 9A is received through the operation unit 54. it can. Then, the map program 66 executes the explicit sharing API with the specified data ID and the specified operation ID “print” as arguments in response to receiving the specification of the [print] icon through the operation unit 54, and The program 65 is activated. Further, the map program 66 executes the explicit sharing API with the specified data ID and the specified action ID “FAX transmission” as arguments in response to the designation of the [FAX transmission] icon received through the operation unit 54. , Activates the terminal program 65.

As a result, the OS 64 ends the map program 66 and executes the terminal program 65 in the foreground. The terminal program 65 started from the map program 66 due to the user operation on the map program 66 executes the external starting process shown in FIG. The designation of the [print] icon or the [FAX transmission] icon is an example of a user operation on the map program 66 that instructs to activate the terminal program 65. The details of the external activation process will be described with reference to FIG. The external activation process may be executed when activated by a plug-in API established by the provider of the terminal program 65, instead of the explicit sharing API.

First, the terminal program 65 acquires, as the designation information, the designated data ID and the designated operation ID designated in the argument of the API executed by the map program 66 (S81). Then, the terminal program 65 temporarily stores the acquired designated data ID and designated operation ID in the data storage area 62B. Here, it is assumed that the designated operation ID “print” has been acquired. Next, the terminal program 65 determines whether or not the designated device information is stored in the data storage area 62B (S82). The process of step S81 is an example of an acquisition process, and the process of step S82 is an example of a first determination process.

Next, in response to the determination that the designated device information is stored (S82: Yes), the terminal program 65 causes the display unit 53 to display a preview screen, which is an example of the third screen (S84). Then, the terminal program 65 receives a user operation on the preview screen through the operation unit 54 (S85). The process of step S84 is an example of the third display process, and the process of step S85 is an example of the reception process. On the other hand, in response to the determination that the designated device information is not stored (S82: No), the terminal program 65 executes the second device selection process prior to the third display process (S83).

FIG. 15 is an example of a preview screen in the external activation process. The preview screen shown in FIG. 15 includes a preview image 165, a device icon 166, and a [print] icon 167. In the preview image 165, the designated action identified by the designated action ID obtained in step S81 is identified by the device ID included in the designated device information with respect to the image data identified by the designated data ID obtained in step S81. 3 is an image showing a result of execution by a designated device. The device icon 166 is an example of a device designation object. The [print] icon 167 is an example of the execution instruction object corresponding to the execution instruction of the print operation which is the designated operation. The screen layout of the preview screen in the external startup process differs from the screen layout of the preview screen in the standard startup process in that it includes the device icon 166.

Next, the terminal program 65 executes the processes of step S83 and subsequent steps in response to the designation of the device icon 166 received through the operation unit 54 (S85: device icon). On the other hand, when the terminal program 65 receives the designation of the [print] icon 167 through the operation unit 54 (S85: [Print] icon), it transmits the print instruction information to the designated device through the communication unit 55 (S86). .. The process of step S86 is an example of the execution instruction process and may be the same as the process of step S55.

[Operation and effect of the embodiment]
According to the above-described embodiment, the first device selection process is executed by designating the device icon 128 before designating the designating operation. This makes it possible to provide the first conducting wire for instructing the designated operation to the designated device selected from a wide variety of options. On the other hand, the second device selection process is executed by designating the operation icon after designating the designated device, or by designating the motion icons 121 to 124 and the plug-in icons 126, 127 before designating the designated device. It Thereby, the second conducting wire for instructing the designated operation to the designated device suitable for the designated operation can be provided.

That is, the user is aware of which device is designated as the designated device by an intuitive operation of designating either the device icon 128 and the operation icons 121 to 124 or the plug-in icons 126 and 127 first, and then the terminal program 65. It is possible to properly use the first conducting wire suitable for the user who operates the terminal and the second conducting wire suitable for the user who operates the terminal program 65 in consideration of the operation to be executed by the designated device.

Further, according to the above embodiment, the operation icons 121 to 124 included in the main screen are updated based on the designated device information updated by the first device selection process or the second device selection process. That is, it is possible to provide a conductive wire for utilizing the operation that can be performed by the new designated device in response to the switching of the designated device. That is, the user who has designated the designated device through the first conducting wire can be provided with a conducting wire for all the operations that the new designated device can perform. Further, the first conducting wire for changing the designated device can be provided again to the user who has designated the designated device through the first conducting wire but does not display the operation icons 121 to 124 corresponding to the desired operation. On the other hand, the user who has selected the designated device through the second conducting wire can be provided not only with the designated action that has already been designated, but also with a conducting line for another action that can be performed by the new designated device.

Further, according to the above embodiment, the display layout of the device selection screen and the like are made common in the first device selection process and the second device selection process. As a result, the same usability can be provided to both the user who selects the designated device through the first conducting wire and the user who selects the designated device through the second conducting wire. That is, it is possible to provide usability in which a user who uses one of the conducting wires does not feel any discomfort even when using the other conducting wire.

In addition, according to the above-described embodiment, a flexible second device that allows the user to immediately select a designated device capable of executing an operation desired by the user or to select it later by a user operation on the unselected notification screen. Conductors can be provided.

Further, according to the above-described embodiment, the device selection screen of the first device selection process displays the device icon corresponding to the multifunction peripheral 10 that can execute at least one of the first support operation and the second support operation. .. This allows the user to specify the specifying device capable of executing at least one of the first support operation and the second support operation through the first conducting wire.

Further, according to the above-described embodiment, in the second device selection process when the plug-in icon is specified, the user can preferentially select the specified device capable of executing the second support operation. Accordingly, it is possible to provide the third conductive wire suitable for causing the designated device to execute the operation for the image data designated through the plug-in. Further, according to the above-described embodiment, the action identification images 137 to 139 are added to the device icons 135 and 136 on the device selection screen of the second device selection process. Accordingly, the third conducting wire suitable for selecting the designated device can be provided after making the user recognize the second support operation that the corresponding multifunction device 10 can execute.

However, the terminal program 65 may specify only the multifunction peripheral 10 that can execute all of the plurality of designated operations in steps S41 and S42. Then, the terminal program 65 may allow the user to designate one of the multifunction peripherals 10 capable of executing all of the plurality of designated operations as the designated device. On the other hand, in steps S41 and S42, the terminal program 65 may specify the multifunction peripheral 10 that can execute a part of the plurality of designated operations when there is no multifunction peripheral 10 that can execute all the designated operations. .. Then, the terminal program 65 may cause the user to designate one of the multifunction peripherals 10 capable of executing a part of the plurality of designation operations as the designation device.

Further, according to the above-described embodiment, when the external activation process is executed in the state where the designated device information is not stored, the second device selection process is executed prior to the third display process. Accordingly, it is possible to provide the fourth conductor suitable for allowing the user to preferentially select the designated device that can execute the operation supported by the cooperation of the terminal program 65 and the activation source program.

Further, in the multifunction machine 10 and the portable terminal 50 of the above-described embodiment, the various programs stored in the program storage areas 32A and 62A of the storage units 32 and 62 are executed by the CPUs 31 and 61, so that the control unit of the present invention. An example has been described in which each process executed by is realized. However, the configuration of the control unit is not limited to this, and a part or all of the control unit may be realized by hardware such as an integrated circuit (also referred to as IC (Integrated Circuit)).

Further, the present invention can be realized not only as the multifunction peripheral 10 and the mobile terminal 50, but also as a program that causes the multifunction peripheral 10 and the mobile terminal 50 to execute processing. Then, the program may be recorded and provided in a non-transitory recording medium. The non-transitory recording medium may include a CD-ROM, a DVD-ROM, and the like, as well as a storage unit mounted in a server that can be connected to the multifunction peripheral 10 and the mobile terminal 50 through the communication network 101. The program stored in the storage unit of the server may be distributed as information or a signal indicating the program through the communication network 101 such as the Internet.

10... Multifunction device 11... Printer unit 12... Scanner unit 13... FAX unit 25, 55... Communication unit 31, 61... CPU
35... Device program 65... Terminal program 50... Mobile terminal 53... Display unit 54... Operation unit 62... Storage unit

Claims (19)

A program readable by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit,
The program is
A designation that is the designated image processing device in response to receiving an operation for designating one of the image processing devices from the image processing devices that can be communicated and designated through the communication unit through the operation unit. It is possible to execute a first designation process for storing the device identification information of the device in the storage unit,
It is possible to cause the mobile terminal to execute a first determination process of determining whether or not the device identification information for identifying the designated device is stored in the storage unit,
The program is
Causing the mobile terminal to execute a first display process of displaying a first screen on the display unit in order to receive an operation for designating an operation;
In response to the first determination processing determining that the device identification information is stored when the first screen is displayed on the display unit and an operation for designating the operation is accepted through the operation unit. , Identifying the designated action, which is the action designated by the operation received through the operation unit, by the device identification information stored in the storage unit in the first designation process executed before the first display process. The mobile terminal to execute an execution preparation process for preparing the specified device to execute ,
When the first screen is displayed on the display unit and an operation for designating the operation is received through the operation unit, it is determined in the first determination process that the device identification information is not stored. Second display processing for displaying a second screen including a device object corresponding to the image processing apparatus that can be designated as the designated apparatus on the display unit ,
The operation for specifying the pre-Symbol device object in response to reception through the operation unit, the second designation process for designating the device identification information of which is the image processing apparatus corresponding to the specified the device object the specified device and,
A program for causing the designated device identified by the device identification information designated in the second designation process to execute the execution preparation process for preparing to perform the designated operation . The program is
The mobile terminal is caused to execute a reception process of receiving operation identification information for identifying an operation that can be performed by the designated device from the designated device through the communication unit,
In the first display process, corresponding to the action identification information received in the receiving process among the action objects that can be displayed on the display unit by the program and that can be executed by the image processing apparatus. Displaying the first screen including the motion object on the display unit,
The program according to claim 1, which causes the mobile terminal to execute the first display process again after the execution of the first specification process or the second specification process. In the first screen and the second screen, the screen layout and the display mode of the device object are common to each other,
The program according to claim 1 or 2, wherein the operation of designating the device object is common to the first designating process and the second designating process. The program displays the second screen in response to the first determination processing determining that the device identification information is not stored when the operation of designating the motion object is accepted through the operation unit. A second object corresponding to selecting the designated device, and a second object corresponding to not selecting the designated device. Including and
The program is
In response to receiving an operation of designating the first object through the operation unit, the mobile terminal is caused to execute the second designation processing,
The program according to claim 2, which causes the mobile terminal to execute the first display process in response to receiving an operation of designating the second object through the operation unit. A program readable by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit,
The program is
A designation that is the designated image processing device in response to receiving an operation for designating one of the image processing devices from the image processing devices that can be communicated and designated through the communication unit through the operation unit. It is possible to execute a first designation process for storing the device identification information of the device in the storage unit,
It is possible to cause the mobile terminal to execute a first determination process of determining whether or not the device identification information for identifying the designated device is stored in the storage unit,
The program is
A reception process of receiving operation identification information for identifying an operation that the specified device can execute from the specified device through the communication unit;
Of the motion objects that can be displayed on the display unit and that can be executed by the image processing apparatus, a first screen that includes the motion object that corresponds to the motion identification information received in the reception process. Causing the mobile terminal to execute a first display process to be displayed on the display unit,
The program is
When the first determination processing determines that the device identification information is stored when the first screen is displayed on the display unit and an operation of designating the motion object is accepted through the operation unit. Then, the portable terminal is caused to execute an execution preparation process for preparing the specified device to execute the specified operation that is the operation specified by the operation received through the operation unit, and the operation unit specifies the operation object. If the device identification information is not stored, the second display process for displaying the second screen on the display unit is executed by the mobile terminal in response to the determination by the first determination process. , The second screen includes, as the device objects, a first object corresponding to selecting the designated device and a second object corresponding to not selecting the designated device,
The program is
The device identification information of the designated device, which is the image processing device corresponding to the designated first object, is stored in the storage unit in response to the operation of designating the first object being received through the operation unit. To execute the second designated process,
After the execution of the first designation processing or the second designation processing, or in response to receiving an operation of designating the second object through the operation unit, the mobile terminal re-executes the first display processing. program. The program is
A storage process of storing the action identification information in the storage unit in response to receiving an operation of designating the action object through the operation unit;
A second determination process of determining whether or not the motion identification information is stored in the storage unit;
In response to the operation of designating the device designation object included in the first screen accepted through the manipulation unit and the second determination processing determining that the motion identification information is not stored, the first designation processing To the mobile terminal,
The second designation process is executed on the mobile terminal in response to the operation of designating the device designation object being accepted through the operation unit and the second determination process determining that the motion identification information is stored. The program according to claim 2, 4, or 5 . In the first designation process, the image processing device capable of executing at least one of a plurality of first support operations among the image processing devices capable of communicating through the communication unit can be designated as the designation device. includes a first identification processing for identifying the device, the first support operation program according to any one of claims 1 to 6 of the program is executable operating said execution preparation processing. The image processing device is capable of performing operations on image data,
The program determines whether or not an external program is stored in the storage unit that causes the user to specify the image data and notifies the program of data identification information for identifying the specified image data. Let the mobile terminal execute processing,
The program is
In the first specific processing when the third determination processing determines that the external program is not stored, the image processing apparatus capable of executing at least one of the plurality of first support operations, Specify as a device that can be specified as a specified device,
The image capable of executing at least one of the plurality of first support operations and second support operations in the first specific processing when the third determination processing determines that the external program is stored. The program according to claim 7 , wherein a processing device is specified as a device that can be designated as the designated device, and the second support operation is an operation that the external program can cause the designated device to execute through the program. .. A program readable by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit,
The program is
A designation that is the designated image processing device in response to receiving an operation for designating one of the image processing devices from the image processing devices that can be communicated and designated through the communication unit through the operation unit. It is possible to execute a first designation process for storing the device identification information of the device in the storage unit,
It is possible to cause the mobile terminal to execute a first determination process of determining whether or not the device identification information for identifying the designated device is stored in the storage unit,
The program is
Causing the mobile terminal to execute a first display process of displaying a first screen on the display unit in order to receive an operation for designating an operation;
In response to the first determination processing determining that the device identification information is stored when the first screen is displayed on the display unit and an operation for designating the operation is accepted through the operation unit. , The portable terminal is caused to execute an execution preparation process for preparing the specified device to execute a specified action specified by an operation received through the operation unit, and the device identification information is stored if the device identification information is not stored. 1 second display processing for displaying a second screen including a device object corresponding to the image processing apparatus that can be designated as the designation apparatus on the display unit according to the determination made in the 1 determination processing; A second designation process of storing the device identification information of the designated device, which is the image processing device corresponding to the designated device object, in the storage unit in response to receiving the operation to be performed through the operation unit; Run
In the first designation process, the image processing device capable of executing at least one of a plurality of first support operations among the image processing devices communicable via the communication unit can be designated as the designation device. A first specifying process for specifying a device, wherein the first support operation is an operation capable of executing the execution preparation process by the program;
The image processing device is capable of performing operations on image data,
The program determines whether or not an external program is stored in the storage unit that causes the user to specify the image data and notifies the program of data identification information for identifying the specified image data. Let the mobile terminal execute processing,
The program is
In the first specific processing when the third determination processing determines that the external program is not stored, the image processing apparatus capable of executing at least one of the plurality of first support operations, Specify as a device that can be specified as a specified device,
The image capable of executing at least one of the plurality of first support operations and second support operations in the first specific processing when the third determination processing determines that the external program is stored. The program according to claim 1, wherein the processing device is specified as a device that can be designated as the designated device, and the second support operation is an operation that the external program can cause the designated device to execute through the program. The first screen may include a plug-in object corresponding to the external program, and the external program may cause the designated device to execute a plurality of the second support operations.
The second designation process identifies the image processing device capable of executing all of the plurality of second support operations as a device capable of being designated as the designation device in response to designation of the plug-in object. The program according to claim 8 or 9 , which includes a second specifying process. The first screen may include a plug-in object corresponding to the external program, and the external program may cause the designated device to execute a plurality of the second support operations.
In the second display processing, the device object corresponding to the image processing apparatus having a large number of executable second support operations is preferentially displayed on the display unit,
The second designation processing identifies the image processing apparatus capable of executing at least one of the plurality of second support operations in response to an operation of designating the plug-in object being received by the operation unit. The program according to claim 8 or 9 , which includes a second specifying process for performing. The program, in the above second display processor, an image showing the corresponding one of said image processing apparatus capable of executing the second support operation, the program according to claim 11 to be added to the device object. The first screen may include a complex action object corresponding to a complex action in which the first action and the second action are combined,
The second identification processing, the in response to the combined operation object is specified, any of claims 10 to 12 for identifying the executable the image processing apparatus both of the first operation and the second operation The program described in. Said first screen comprises a capsule containing the object that corresponds to both the third operation and the fourth operation,
The second identification processing, in response to the contained object is specified, any one of claims 10 to identify the third operation and the image processing apparatus capable of executing at least one of said fourth operation 13 The program described in. The image processing device is capable of performing operations on image data,
The program, in response to being started from the starting source program due to an operation to the starting source program,
An acquisition process for acquiring data identification information for identifying the image data and operation identification information for identifying the designated operation from the boot source program;
Causing the mobile terminal to execute the first determination process,
The program causes the mobile terminal to execute a third display process for displaying a third screen on the display unit in response to determining in the first determination process that the device identification information is stored, The third screen includes a preview image showing a result of causing the designated device to perform the designated action identified by the action identification information on the image data identified by the data identification information,
3. The program causes the mobile terminal to execute the second designation process prior to the third display process in response to the determination in the first determination process that the device identification information is not stored. 4. The program according to any one of 4 and 6 . A program readable by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit,
The program is
In response to accepting, through the operation unit, an operation for designating any one of the image processing devices that is communicable and specifiable through the communication unit and capable of executing an operation for image data. A first designation process for storing device identification information of a designated device that is the designated image processing device in the storage unit,
It is possible to cause the mobile terminal to execute a first determination process of determining whether or not the device identification information for identifying the designated device is stored in the storage unit,
The program is
A reception process of receiving operation identification information for identifying an operation that the specified device can execute from the specified device through the communication unit;
Of the motion objects that can be displayed on the display unit and that can be executed by the image processing apparatus, a first screen that includes the motion object that corresponds to the motion identification information received in the reception process. Causing the mobile terminal to execute a first display process to be displayed on the display unit,
In response to the first determination processing determining that the device identification information is stored when the first screen is displayed on the display unit and an operation for designating the operation is accepted through the operation unit. , The portable terminal is caused to execute an execution preparation process for preparing the specified device to execute a specified action that is an action specified by an operation received through the operation unit, and the device identification information is stored if the device identification information is not stored. 1 second display processing for displaying a second screen including a device object corresponding to the image processing apparatus that can be designated as the designation apparatus on the display unit according to the determination made in the 1 determination processing; A second designation process of storing the device identification information of the designated device, which is the image processing device corresponding to the designated device object, in the storage unit in response to receiving the operation to be performed through the operation unit; Run
After executing the first specifying process or the second specifying process, the portable terminal is caused to execute the first display process again,
The program, in response to being started from the starting source program due to an operation to the starting source program,
An acquisition process for acquiring data identification information for identifying the image data and operation identification information for identifying the designated operation from the boot source program;
Causing the mobile terminal to execute the first determination process,
The program causes the mobile terminal to execute a third display process for displaying a third screen on the display unit in response to determining in the first determination process that the device identification information is stored, The third screen includes a preview image showing a result of causing the designated device to perform the designated action identified by the action identification information on the image data identified by the data identification information,
The program is a program for causing the portable terminal to execute the second designation process prior to the third display process in response to the determination in the first determination process that the device identification information is not stored. The program is
In the execution preparation process, an execution instruction object corresponding to the execution instruction of the designated operation is displayed on the display unit,
In response to receiving an operation for designating the execution instruction object through the operation unit, the mobile terminal is caused to execute an execution instruction process for transmitting execution instruction information to the designation device through the communication unit. The program according to any one of claims 1 to 16 , wherein the program is information for instructing execution of the designated operation. A mobile terminal comprising: a communication unit, a display unit, an operation unit, and a control unit having a storage unit,
The control unit is
A designation that is the designated image processing device in response to receiving an operation for designating one of the image processing devices from the image processing devices that can be communicated and designated through the communication unit through the operation unit. A first designation process of storing device identification information of a device in the storage unit;
A first determination process of determining whether or not the device identification information is stored in the storage unit;
A first display process for displaying a first screen on the display unit to accept an operation for designating an operation;
In response to the first determination processing determining that the device identification information is stored when the first screen is displayed on the display unit and an operation for designating the operation is accepted through the operation unit. , Identifying the designated action, which is the action designated by the operation received through the operation unit, by the device identification information stored in the storage unit in the first designation process executed before the first display process. And an execution preparation process for preparing the specified device for execution,
When the first screen is displayed on the display unit and an operation for designating the operation is received through the operation unit, it is determined in the first determination process that the device identification information is not stored. Second display processing for displaying a second screen including a device object corresponding to the image processing apparatus that can be designated as the designated apparatus on the display unit,
Storing the device identification information of the designated device, which is the image processing device corresponding to the designated device object, in the storage unit in response to receiving an operation for designating the device object through the operation unit; 2 designation processing,
A terminal device that executes the execution preparation process for preparing the specified device identified by the device identification information stored in the storage unit in the second specification process to execute the specified operation . A terminal device comprising: a communication unit, a display unit, an operation unit, and a control unit having a storage unit,
The control unit is
A designation that is the designated image processing device in response to receiving an operation for designating one of the image processing devices from the image processing devices that can be communicated and designated through the communication unit through the operation unit. A first designation process of storing device identification information of a device in the storage unit;
A first determination process of determining whether or not the device identification information is stored in the storage unit;
A reception process of receiving operation identification information for identifying an operation that the specified device can execute from the specified device through the communication unit;
Of the motion objects that can be displayed on the display unit and that can be executed by the image processing apparatus, a first screen that includes the motion object that corresponds to the motion identification information received in the reception process. A first display process to be displayed on the display unit,
When the first determination processing determines that the device identification information is stored when the first screen is displayed on the display unit and an operation of designating the motion object is accepted through the operation unit. An execution preparation process for preparing the specified device to execute a specified operation, which is an operation specified by the operation received through the operation unit ,
When the operation of designating the motion object is accepted through the operation unit, the second screen is displayed on the display unit in response to the determination in the first determination process that the device identification information is not stored. A second display process is executed, and the second screen includes a first object corresponding to selecting the designated device and a second object corresponding to not selecting the designated device,
The device identification information of the designated device, which is the image processing device corresponding to the designated first object, is stored in the storage unit in response to the operation of designating the first object being received through the operation unit. Perform the second designated process to
A terminal device that re-executes the first display process after executing the first designation process or the second designation process, or in response to an operation of designating the second object being received through the operation unit .