JP2020173828A - program - Google Patents

Abstract

To provide a program that includes a user interface suitable for selecting an image processing apparatus that is caused to execute an operation for image data.SOLUTION: A program causes a portable terminal to execute first display processing of displaying a first screen including an apparatus icon and operation icons (S11), in response to receiving a user operation to designate the apparatus icon (S12: apparatus icon), first device selection processing (S20), in response to receiving a user operation to designate the operation icon and determining that apparatus identification information is stored (S12: operation icon & S14: Yes), execution preparation processing of preparing the designated operation that is caused to be executed by the designated apparatus (S15), and in response to receiving a user operation to designate an operation object and determining that the apparatus identification information is not stored (S12: operation icon & S14: No), second device selection processing (S18).SELECTED DRAWING: Figure 4

Description

The present invention relates to a program readable by a mobile terminal. The program causes the mobile terminal to execute a process for causing the image processing device to execute an operation on the image data.

Conventionally, there has been known an application that causes a user to specify content data and causes an image processing device to execute an operation on the specified content data. For example, the application described in Patent Document 1 causes a user to specify image data stored in a mobile terminal, and causes a printer to print an image indicated by the image data.

Japanese Unexamined Patent Publication No. 2012-203742

Since mobile terminal applications are designed for personal use, for example, to easily print image data, a simple configuration with narrowed down the functions to be implemented is desirable. Further, since the screen size of the mobile terminal that executes the application is smaller than that of a PC or the like, a user interface capable of simple and intuitive operation is desirable.

In recent years, so-called "multifunction peripherals" in which a scanner unit, a fax unit, or the like are mounted on a printer have become widespread. Then, in order for the user to effectively use the functions of the multifunction device, it is required to utilize the application of the mobile terminal as a lead wire for guiding the user to each function implemented in the multifunction device. Further, it is desirable that the application of the mobile terminal further implements a user interface that allows the user to select a printer or a multifunction device to execute an operation on image data.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a program having a user interface suitable for selecting an image processing device for performing an operation on image data.

The program described in the present specification can be read by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit. The program causes the mobile terminal to execute a first display process for displaying a first screen including a device designation object and an operation object on the display unit. The device designation object corresponds to the designation of a designated device which is one of a plurality of image processing devices having an operation unit capable of executing an operation on image data. The motion object corresponds to an action that the image processing apparatus can perform. The program includes a reception process for receiving a user operation for designating an object through the operation unit, and a first determination process for determining whether or not device identification information for identifying the designated device is stored in the storage unit. Let the mobile terminal execute it. The program causes the mobile terminal to execute the first designation process in response to the reception of the user operation for designating the device designation object in the reception process. The program receives the user operation for designating the operation object in the reception process, and determines in the first determination process that the device identification information is stored, so that the program performs the designated operation in the designated device. Prepare to execute The mobile terminal is made to execute the execution preparation process. The designated action is an action corresponding to the designated action object. The program receives the user operation for designating the operation object in the reception process, and performs the second designation process in response to the determination in the first determination process that the device identification information is not stored. Let the terminal execute it. The first designated process corresponds to the first specific process for specifying the image processing device that can communicate through the communication unit and can be designated as the designated device, and the image processing device specified in the first specific process. In response to the first selection screen display process for displaying the first selection screen including the device object on the display unit and the user operation for designating the device object in the reception process, the designated device object is displayed. The first storage process of storing the device identification information of the corresponding image processing device in the storage unit is included. The second designation process includes the second identification process for specifying the image processing device capable of executing the designated operation among the image processing devices that can communicate through the communication unit and can be designated as the designated device. The reception process includes a second selection screen display process for displaying the second selection screen including the device object corresponding to the image processing device specified in the second specific process on the display unit, and a user operation for designating the device object. Including the second storage process of storing the device identification information of the image processing device corresponding to the designated device object in the storage unit according to the reception in.

According to the above configuration, by designating the device designation object before designating the designated operation, it is possible to provide a first lead wire for instructing the designated device selected from abundant choices to perform the designated operation. On the other hand, by designating the operation object before designating the designated device, it is possible to provide a second lead wire for instructing the designated device suitable for the designated operation to perform the designated operation. That is, the first lead wire suitable for the user who operates the program consciously of which designated device is to be specified by the intuitive operation of which of the device designation object and the operation object is designated first. The second lead wire suitable for the user who operates the program can be properly used in consideration of the operation to be executed by the designated device.

FIG. 1 is a schematic configuration diagram of the system 100 according to the embodiment. 2A and 2B are a block diagram of the multifunction device 10 and FIG. 2B is a block diagram of the mobile terminal 50. FIG. 3 is an example of information stored in the data storage areas 32B and 62B, in which (A) is a fax list, (B) is designated device information, (C) is a designated operation ID, and (D). Shows a list of second support operation IDs. FIG. 4 is a flowchart of the standard start processing. FIG. 5 is a flowchart of the first device selection process. FIG. 6A is a flowchart of the second device selection process, and FIG. 6B is a flowchart of the print preparation process. FIG. 7 is a flowchart of the FAX preparation process. FIG. 8 is a flowchart of the external activation process. 9A and 9B are display examples of the display unit 53, in which FIG. 9A shows a menu screen and FIG. 9B shows a main screen. 10A and 10B are display examples of the display unit 53, in which FIG. 10A is an unselected notification screen 130 superimposed on the main screen, and FIG. 10B is a device selection screen when the multifunction devices 10A and 10B are specified. Shown. 11A and 11B are display examples of the display unit 53. FIG. 11A shows a device selection screen when only the multifunction device 10A is specified, and FIG. 11B shows operation identification images 137 to 139 on the device icons 135 and 136. The added device selection screen is shown. 12A and 12B are display examples of the display unit 53, in which FIG. 12A shows a data selection screen and FIG. 12B shows a preview screen in a standard startup process. 13A and 13B are display examples of the display unit 53, in which FIG. 13A shows an operation selection screen and FIG. 13B shows a fax transmission screen. 14A and 14B are display examples of the display unit 53, in which FIG. 14A shows a fax selection screen and FIG. 14B shows a fax preview screen. FIG. 15 is a display example of the preview screen in the external startup process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. It goes without saying that the embodiments described below are merely examples of the present invention, and the embodiments of the present invention can be appropriately changed without changing the gist of the present invention. For example, the execution order of each process described later can be appropriately changed without changing the gist of the present invention.

FIG. 1 is a schematic view of the system 100 according to the present embodiment. The system 100 shown in FIG. 1 is composed of multifunction devices 10A and 10B (hereinafter, these may be collectively referred to as "multifunction device 10") and a mobile terminal 50. The multifunction device 10 and the mobile terminal 50 are configured to be able to communicate through the communication network 101. The communication network 101 may be, for example, a wired LAN (abbreviation for Local Area Network), a wireless LAN, or a combination thereof.

[Multifunction device 10]
As shown in FIG. 2A, the multifunction device 10 includes a printer unit 11, a scanner unit 12, a fax unit 13, a display unit 23, an operation unit 24, a communication unit 25, and a CPU (Central Processing). A unit (abbreviation of Unit) 31, a storage unit 32, and a communication bus 33 are mainly provided. The components constituting the multifunction device 10 are connected to each other through the communication bus 33. The multifunction device 10 is an example of an image processing device.

[Printer unit 11, scanner unit 12, FAX unit 13]
The printer unit 11 executes a printing operation of recording an image indicated by image data on recording paper. The recording paper is an example of a sheet or a recording medium. As the recording method of the printer unit 11, a known method such as an inkjet method or an electrophotographic method can be adopted.
The scanner unit 12 executes a scanning operation of reading an image recorded on a document and generating image data. The FAX unit 13 executes a FAX transmission operation and a FAX reception operation for transmitting and receiving image data in a method compliant with the FAX protocol. The printer unit 11, the scanner unit 12, and the fax unit 13 are examples of operating units.

Of the plurality of operations described above, the print operation and the fax transmission operation are examples of output operations for outputting image data. The output operation executed by the multifunction device 10 is not limited to these.
As another example of the output operation, the multifunction device 10 performs a FAX preview transmission operation of transmitting the image data to the mobile terminal 50 through the communication unit 25 in order to display the image indicated by the image data received in the FAX reception operation. You may do it. As still another example of the output operation, the multifunction device 10 may execute a label print operation of recording a disk-shaped image (hereinafter, referred to as “label image”) on the surface of a CD-ROM or the like. .. Further, the scanning operation and the FAX receiving operation among the above-mentioned plurality of operations are examples of the forming operation of forming image data. Further, the FAX transmission operation and the FAX reception operation are executed by the FAX unit 13.

Further, the multifunction device 10 may be capable of executing a combined operation in which a plurality of operations are combined.
For example, a copy operation in which the image data generated by the scan operation is recorded on the recording paper by the print operation, a scan FAX operation in which the image data generated by the scan operation is transmitted by FAX in the FAX transmission operation, and an image data received by FAX in the FAX reception process. The fax printing operation of recording on recording paper in the printing operation is an example of a combined operation.

The operations that can be executed by the multifunction devices 10A and 10B may be different. The multifunction device 10A according to the present embodiment can execute a print operation, a scan operation, a fax transmission operation, a fax reception operation, a fax preview transmission operation, and a label print operation. On the other hand, the multifunction device 10B according to the present embodiment can execute the printing operation and the label printing operation. Further, the image processing device is not limited to those capable of executing a plurality of operations, and may be capable of executing only a single operation.

In the MIB (abbreviation of Management Information Base) of the multifunction device 10, for example, a device ID for identifying the multifunction device 10 and an operation ID for identifying an operation that the multifunction device 10 can perform may be defined. .. The device ID is an example of device identification information, and the operation ID is an example of operation identification information. In the present embodiment, the multifunction device 10A is identified by the device ID "MFP-A", and the multifunction device 10B is identified by the device ID "MFP-B". Hereinafter, the device ID and the operation ID registered in the MIB may be referred to as "device information".

[Display unit 23]
The display unit 23 includes a display screen for displaying various information. As the display unit 23, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminence Display), and the like can be adopted.

[Operation unit 24]
The operation unit 24 accepts an operation of a user who specifies an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Further, the operation unit 24 may have a film-like touch sensor superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display.

The "object" refers to an image that can be specified by the user by operating the operation unit 24. As an example, the object may be a character string, an icon, a button, a link, or the like displayed on the display unit 23. The object may be specified by pressing the direction key or the enter button on the operation unit 24. When the operation unit 24 is a touch panel, the object displayed on the display unit 23 may be designated by touching the display position.

The operation unit 24 realized as a touch panel outputs position information indicating a position on the display screen touched by the user. The term "touch" in the present specification includes all operations of bringing the input medium into contact with the display screen. That is, the tap operation for separating the touched input medium from the display screen within a predetermined time, the long touch operation, the slide operation for sliding the touched input medium on the display screen, the flick operation, the pinch-in operation, the pinch-out operation, etc. are touch operations. This is an example.

Further, even if the input medium does not touch the display screen, bringing the input medium close to a position where the distance from the display screen is very small may be included in the above-mentioned concept of "touch". Further, the input medium may be a user's finger, a stylus, or the like. Hereinafter, tapping at the position of the icon displayed on the display unit 53 will be described as an example of a user operation for designating the icon.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 101. That is, the multifunction device 10 outputs various information to the mobile terminal 50 through the communication unit 25, and receives various data or various information from the mobile terminal 50 through the communication unit 25. The specific communication procedure of the communication unit 25 is not particularly limited, but for example, Wi-Fi (registered trademark of Wi-Fi Alliance) can be adopted.

[CPU31]
The CPU 31 controls the overall operation of the multifunction device 10. The CPU 31 acquires and executes various programs described later from the storage unit 32 based on various information output from the operation unit 24 and various information acquired from the external device through the communication unit 25. That is, the CPU 31 and the storage unit 32 form an example of the control unit.

[Storage 32]
The storage unit 32 has a program storage area 32A and a data storage area 32B. The OS (abbreviation of Operating System) 34 and the device program 35 are stored in the program storage area 32A. The device program 35 may be a single program or a collection of a plurality of programs. Data or information necessary for executing the device program 35 is stored in the data storage area 32B.

It should be noted that "data" and "information" in the present specification are common in that they are bits or bit strings that can be handled by a computer. "Data" refers to data that can be handled without the computer considering the meaning and content of each bit. On the other hand, "information" refers to information in which the operation of a computer branches depending on the meaning and content indicated by each bit. Further, the "instruction" is a control signal for prompting the destination device to perform the next operation, may include information, and has the property of information itself. There is also.

In addition, "data" and "information" are the same data and information as long as they are recognized as having the same meaning even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer. Treated as. For example, information indicating that there are "two" is held as text format information "0x32" in ASCII code on one computer, and as binary format information "10" in binary notation on another computer. May be done.

However, the above distinction between "data" and "information" is not strict, and exceptional handling is permitted. For example, the data may be temporarily treated as information, or the information may be temporarily treated as data. Further, what is treated as data in one device may be treated as information in another device. Furthermore, information may be extracted from the data, or data may be extracted from the information.

The storage unit 32 includes, for example, a RAM (abbreviation of Random Access Memory), a ROM (abbreviation of Read Only Memory), an EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), a CPU (abbreviation of Disk 31), and an HDD (abbreviation of HDD). It is composed of a buffer or the like or a combination thereof.

The storage unit 32 may be a storage medium that can be read by a computer.
A computer-readable storage medium is a non-transitory medium. In addition to the above examples, the non-transitory medium also includes recording media such as a CD-ROM and a DVD-ROM. The non-transitory medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium, which is a kind of computer-readable medium, but is a storage that can be read by a non-transitory computer. Not included in the medium.

The program stored in the program storage area 32A is executed by the CPU 31. However, in the present specification, the operation of each program may be described by omitting the CPU 31. That is, in the following description, the description to the effect that "the program A executes the process A" may refer to "the CPU 31 executes the process A described in the program A". The same applies to the mobile terminal 50 described later.

Further, the program stored in the program storage area 32A determines an event and operates according to the determination result. However, in the present specification, the operation of each program may be described without making a judgment. That is, in the following description, the description to the effect that "the program executes the process A according to the condition A" is "determine whether or not the program is the condition A. The program is an affirmative judgment." Depending on the situation, the process A may be executed. " The same applies to the mobile terminal 50 described later.

Further, the program stored in the program storage area 32A identifies, acquires, extracts, determines, or selects data or the like. When a program specifies data or the like, for example, data that meets the conditions is specified from a plurality of data or the like, and the data or the like or information for identifying the data or the like is stored in a predetermined storage area. Refers to the process of memorizing. The information for identifying the data or the like is, for example, identification information for identifying the data or the like, an index of an array in which the data or the like is stored, a pointer of a storage area in which the data or the like is stored, or the like. The same applies to the process in which the program acquires, extracts, determines, or selects data or the like. The same applies to the mobile terminal 50 described later.

OS34 is an abbreviation for API (Application Programming Interface) for controlling the printer unit 11, the scanner unit 12, the fax unit 13, the display unit 23, the operation unit 24, the communication unit 25, etc., which are the hardware constituting the multifunction device 10. ) Is a basic program that provides. That is, each of the above programs controls each hardware by calling the API provided by the OS 34. However, in this specification, the operation of each program may be described by omitting OS34. That is, in the following description, the description to the effect that "program B controls hardware C" may refer to "program B controls hardware C through the API of OS34". The same applies to the mobile terminal 50 described later.

As shown in FIG. 3A, the data storage area 32B can store the FAX specific information and the FAX data associated with the FAX specific information. Hereinafter, the entire information shown in FIG. 3A may be referred to as a "FAX list", and a set of FAX specific information and FAX data associated with each other in the FAX list may be referred to as a "FAX record". is there. That is, the fax list can include a plurality of fax records.
FIG. 3A shows an example of a fax list of the multifunction device 10A.

The FAX data is image data received by the multifunction device 10A from an external device through the FAX unit 13. The FAX specific information is information for causing the multifunction device 10A to individually specify the FAX data. The FAX specific information includes, for example, a data ID which is data identification information for causing the multifunction device 10A to identify the FAX data, a reception date and time of the FAX data identified by the data ID, and a transmission of the FAX data identified by the data ID. Includes a source phone number that identifies the source.

The device program 35 of the multifunction device 10A adds a fax record to the fax list in response to executing the fax reception operation. More specifically, the device program 35 receives the fax data and the source telephone number from the external device through the fax unit 13 by the fax receiving operation. Further, the device program 35 generates a unique data ID in the FAX list according to the execution of the FAX reception operation, and acquires the reception date and time from the system clock (not shown). Then, the device program 35 adds a fax record containing these to the fax list. The fax reception operation is automatically executed by the multifunction device 10A regardless of the instruction from the mobile terminal 50 or the like.

The device program 35 can read, edit, or delete the data stored in the data storage area 32B by executing the access API provided by the OS 34. A data ID for identifying the data to be accessed is specified as an argument in the access API. The data ID is information in a format used to specify data in the access API. The data ID is, for example, a file path or a URI. On the other hand, a part or all of the data stored in the data storage area 32B may be stored in an external server (not shown) such as a cloud server. That is, the device program 35 may transmit various data to the external server through the communication unit 25 and receive various data from the external server through the communication unit 25. The data ID in this case may be in the form of a URL for downloading data from an external server, for example. The same applies to the mobile terminal 50.

[Mobile terminal 50]
As shown in FIG. 2B, the mobile terminal 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 61, a storage unit 62, and a communication bus 63. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the mobile terminal 50 are the display unit 23, the operation unit 24, the communication unit 25, and the CPU 31 included in the multifunction device 10. Since the configuration is the same as that of the storage unit 32 and the communication bus 33, the description thereof will be omitted. The CPU 61 and the storage unit 62 are examples of control units.

The mobile terminal 50 is, for example, a mobile phone, a smartphone, a tablet terminal, or the like. More specifically, the display unit 53 of the mobile terminal 50 preferably has a display screen size of 12 inches or less, more preferably 8 inches or less. Further, it is desirable that the operation unit 54 of the mobile terminal 50 is a touch panel superimposed on the display screen of the display unit 53.

As shown in FIGS. 9 to 15, the display unit 53 of the mobile terminal 50 is divided into a common display area 80 and a program display area 81. In the common display area 80, the status bar is displayed by the OS 64 regardless of the display contents of the program display area 81. Various information is displayed on the status bar depending on the OS64. In the status bar, for example, the title of the screen displayed in the program display area 81, the icon indicating the remaining battery level of the mobile terminal 50, the icon indicating the communication status of the communication unit 55, and the push received by the mobile terminal 50 from the external service. An icon or the like indicating a notification is displayed. In the program display area 81, a screen generated by a program running in the foreground is displayed.

Hereinafter, when it is described that "the program causes the display unit 53 to display the screen", it is assumed that the program screen is displayed in the program display area 81 and the status bar is displayed in the common display area 80. The program screen is a screen displayed in the program display area 81 according to the instruction of the program. However, the display unit 53 can switch between a partial screen mode in which the display area is divided into a common display area 80 and a program display area 81, and a full screen mode in which the entire display area is the program display area 81. May be good.

The program storage area 62A of the storage unit 62 stores the OS 64, the terminal program 65, the map program 66, and the label editing program 67. Further, the data storage area 62B stores various information shown in FIGS. 3 (B) to 3 (D). Further, a data folder may be provided in the data storage area 62B. For example, photo data, document data, presentation data, spreadsheet data, and the like may be stored in the data folder.

OS64 may be, for example, Android (registered trademark of Google inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, and the like. The OS 64 can execute a plurality of programs installed in the mobile terminal 50 in parallel. A plurality of programs are virtually executed in parallel by a time division multiplexing method, for example. Further, the OS 64 executes one of a plurality of programs executed in parallel in the foreground, and executes the other programs in the background.

The terminal program 65 is a program that causes a designated device to execute a designated operation for designated data. The designated data refers to image data designated by the user. The designated action refers to the action specified by the user. The designated device refers to the multifunction device 10 designated by the user. The terminal program 65 can accept the designated data, the designated operation, and the user operation for designating the designated device through the operation unit 54. Hereinafter, the data identification information that identifies the designated data is referred to as "designated data ID", the action identification information that identifies the designated action is referred to as "designated action ID", and the device identification information that identifies the designated device is referred to as "designated device". It may be written as "ID".

The terminal program 65 supports one or more operations. The operation supported by the terminal program 65 is an example of the first supported operation. That is, the first support operation refers to an operation in which the terminal program 65 can execute the execution preparation process described later. In other words, the first support operation refers to an operation that can be a designated operation. The first support operation according to the present embodiment is a print operation, a scan operation, a copy operation, a fax transmission operation, and a fax preview transmission operation. The operation ID of the first support operation may be referred to as "first support operation ID".

The terminal program 65 is started by the OS 64 that accepts the user operation for the menu screen described later, or by the map program 66 or the label editing program 67. Further, the terminal program 65 starts the map program 66 and the label editing program 67 by executing the plug-in API for starting the application as a plug-in. Hereinafter, the map program 66 and the label editing program 67 activated by the plug-in API may be referred to as "plug-ins".

The map program 66 and the label editing program 67 are examples of startup programs that are started by OS64 and execute an explicit shared API that takes specified information as an argument to start the terminal program 65. Further, the map program 66 and the label editing program 67 are examples of external programs that are started by the terminal program 65 as so-called plug-ins and provide designated information to the terminal program 65 as a return value of the plug-in API. Further, the map program 66 and the label editing program 67 may execute the plug-in API that takes the specified information as an argument to start the terminal program 65. The designated information includes at least one of a designated data ID, a designated operation ID, and a designated device ID.

The map program 66 according to the present embodiment causes the user to specify an arbitrary area of the map image, stores the image data indicating the map image of the designated area in the data storage area 32B, and stores the data ID of the stored image data. Is provided to the terminal program 65 as a designated data ID. Further, the map program 66 causes the user to specify one of the print operation and the fax transmission operation, and provides the terminal program 65 with the operation ID of the designated operation as the designated operation ID.

Further, the label editing program 67 according to the present embodiment edits the label image according to the user operation, stores the label image data indicating the label image in the data storage area 32B, and specifies the data ID of the stored label image data. It is provided to the terminal program 65 as a data ID. Further, the label editing program 67 causes the user to specify one of the print operation and the label print operation, and provides the terminal program 65 with the operation ID of the designated operation as the designated operation ID.

The operation supported by the map program 66 and the label editing program 67 is an example of the second support operation. The second support operation of the map program 66 according to the present embodiment is a print operation and a fax transmission. That is, the second support operation refers to an operation that can be an operation that causes the designated device to execute the designated data designated by the user operation on the plug-in. The second support operation of the label editing program 67 according to the present embodiment is a print operation and a label print operation. Hereinafter, the operation ID of the second support operation can be expressed as "second support operation ID".

The OS 64 provides the program installed in the mobile terminal 50 with a sharing function that starts the second program designated by the first program and provides the designated information specified by the first program to the second program. The first program can use the sharing function, for example, by executing the API provided by OS64 (hereinafter, referred to as "shared API"). More specifically, the first program executes the shared API with the program ID and the specified information of the second program as arguments. The sharing function of Android OS is an example of the sharing function.

The sharing source application executes an explicit sharing API with predetermined application-identifying information, URI, type, and action as arguments in response to the user being instructed to use the sharing function. You may start a predetermined sharing destination application. The URI is information indicating the location of the shared data. The type is information indicating the data format of the shared data. The action is information indicating the type of processing (for example, viewing, editing, sending, printing, etc.) for the shared data to be executed by the sharing destination application. URIs, types, and actions are examples of designated information provided by the sharing source application to the sharing destination application.

In the present embodiment, for example, the terminal program 65 may be set as a predetermined sharing destination application in the map program 66 which is the sharing source application. More specifically, the information for identifying the terminal program 65 may be described in the setting file that the map program 66 refers to at startup or the source code of the map program 66. The same applies to the label editing program 67, which is another example of the sharing source application.

Further, the sharing source application may execute the implicit sharing API with the URI, type, and action as arguments in response to receiving the user operation instructing the use of the sharing function through the operation unit 54. As a result, the OS 64 displays a list of applications that are declared in the OS 64 that the processing indicated by the action can be executed for the shared data in the data format indicated by the type among the applications installed in the mobile terminal 50. It may be displayed in the unit 53 and the application specified by the user may be started from the list.

The data storage area 62B can store the designated device information as shown in FIG. 3 (B). The designated device information includes a device ID that identifies the designated device and an operation ID that identifies an operation that the designated device can perform. The operation ID included in the designated device information is an example of the designated operation ID. The designated device information is stored in the data storage area 62B by the terminal program 65. The designated device information may or may not be stored in the data storage area 62B at the start of the standard startup process and the external startup process described later.

Further, the data storage area 62B can store the designated operation ID as shown in FIG. 3C. The designated operation ID is temporarily stored in the data storage area 62B by the terminal program 65 that has received the user operation for designating the designated operation. The designated operation ID is not stored in the data storage area 62B at the start of the standard activation process and the external activation process.

Further, as shown in FIG. 3D, the data storage area 62B can store the program ID that identifies the program and the second support operation ID associated with the program ID. In the example of FIG. 3D, the program ID “001” identifies the map program 66 and the program ID “002” identifies the label editing program 67. The corresponding program ID and the second support operation ID may be stored in the data storage area 62B when the terminal program 65 is installed, or stored in the data storage area 62B when the map program 66 and the label editing program 67 are installed. May be good.

[Operation of system 100]
The operation of the system 100 according to the present embodiment will be described with reference to FIGS. 4 to 8.

First, the OS 64 of the mobile terminal 50 causes the display unit 53 to display the menu screen. FIG. 9A is an example of a menu screen. The menu screen shown in FIG. 9A includes a plurality of program icons 111, 112, 113, 114, 115. The program icons 111 to 115 correspond to the programs installed in the mobile terminal 50. For example, the program icon 111 corresponds to the terminal program 65, the program icon 112 corresponds to the map program 66, and the program icon 113 corresponds to the label editing program 67.

Then, the OS 64 accepts one designation of the program icons 111 to 115 through the operation unit 54. The OS 64 activates the terminal program 65 in response to receiving the designation of the program icon 111 through the operation unit 54. The designation of the program icon 111 is an example of a user operation instructing the start of the terminal program 65. The terminal program 65 of the mobile terminal 50 executes a standard startup process in response to being started from the OS 64. The details of the standard start-up process will be described with reference to FIG.

[Standard startup process]
First, the terminal program 65 causes the display unit 53 to display the main screen, which is an example of the first screen (S11). FIG. 9B is an example of the main screen. The main screen includes operation icons 121, 122, 123, 124, status icons 125, plug-in icons 126, 127, and device icons 128. Further, the terminal program 65 receives a user operation on the main screen through the operation unit 54 (S12). The process of step S11 is an example of the first display process, and the process of step S12 is an example of the reception process.

The operation icon 121 is an example of an operation object corresponding to the print operation. The operation icon 122 is an example of an operation object corresponding to the scanning operation. The operation icon 123 is an example of a composite operation object corresponding to a copy operation that combines a print operation and a scan operation. The operation icon 124 is an example of an inclusion object corresponding to both a fax transmission operation and a fax preview transmission operation. The status icon 125 corresponds to an instruction to display a status screen indicating the status of the designated device. The details of the status screen will be omitted. The plug-in icon 126 corresponds to an instruction to execute the plug-in API and start the map program 66. The plug-in icon 127 corresponds to an instruction to execute the plug-in API and start the label editing program 67.

The terminal program 65 determines which of the operation icons 121 to 124 corresponding to the support operation ID is to be included in the main screen based on the designated device information stored in the data storage area 62B. More specifically, the terminal program 65 includes an operation icon corresponding to the operation ID included in the designated device information among the operation icons 121 to 124 that can be displayed on the display unit 53 on the main screen. On the other hand, the terminal program 65 includes the operation icons 121 to 124 corresponding to all the support operation IDs in the main screen according to the fact that the designated device information is not stored in the data storage area 62B.

That is, the terminal program 65 includes the operation icon 121 in the main screen according to the operation ID “print” included in the designated device information. On the other hand, the terminal program 65 does not include the operation icon 121 in the main screen because the operation ID "print" is not included in the designated device information. Similarly, the terminal program 65 includes the operation icon 122 in the main screen according to the operation ID “scan” included in the designated device information. On the other hand, the terminal program 65 does not include the operation icon 122 in the main screen because the operation ID "scan" is not included in the designated device information.

Further, the terminal program 65 includes the operation icon 123 in the main screen according to the fact that both the operation ID “print” and the operation ID “scan” are included in the designated device information. On the other hand, the terminal program 65 does not include the operation icon 123 in the main screen because at least one of the operation ID “print” and the operation ID “scan” is not included in the designated device information. The print operation is an example of the first operation, the scan operation is an example of the second operation, the operation ID "print" is an example of the first operation information, and the operation ID "scan" is an example of the second operation information. is there.

Further, the terminal program 65 includes the operation icon 124 in the main screen according to the fact that at least one of the operation ID “FAX transmission” and the operation ID “FAX preview transmission” is included in the designated device information. On the other hand, the terminal program 65 does not include the operation icon 124 in the main screen because both the operation ID "FAX transmission" and the operation ID "FAX preview transmission" are not included in the designated device information. The FAX transmission operation is an example of the third operation, the FAX preview transmission operation is an example of the fourth operation, the operation ID "FAX transmission" is an example of the third operation information, and the operation ID "FAX preview transmission" is the first. 4 This is an example of operation information.

Further, the terminal program 65 includes the plug-in icon 126 in the main screen depending on the map program 66 installed in the mobile terminal 50. On the other hand, the terminal program 65 does not include the plug-in icon 126 in the main screen because the map program 66 is not installed in the mobile terminal 50. Similarly, the terminal program 65 includes the plug-in icon 127 on the main screen depending on whether the label editing program 67 is installed on the mobile terminal 50. On the other hand, the terminal program 65 does not include the plug-in icon 127 in the main screen because the label editing program 67 is not installed in the mobile terminal 50.

The device icon 128 is an example of a device designation object corresponding to the designation of the designated device, which is one of the multifunction devices 10A and 10B. The terminal program 65 sets the device ID “MFP-A” included in the designated device information as shown in FIG. 9B in response to the designated device information being stored in the data storage area 62B. It is described in the device icon 128 as the designated device ID at the present time. On the other hand, the terminal program 65 describes an "unselected" character string indicating that the designated device is not specified at the present time in the device icon 128 in response to the fact that the designated device information is not stored in the data storage area 62B. To do.

Next, the terminal program 65 assigns an operation ID corresponding to the designated operation icon to the designated operation ID in response to receiving one designation of the operation icons 121 to 124 through the operation unit 54 (S12: operation icon). Is temporarily stored in the data storage area 62B (S13). Further, in response to receiving one designation of the plug-in icons 126 and 127 through the operation unit 54, the terminal program 65 sets the second support operation ID of the program corresponding to the designated plug-in icon as the designated operation ID. Is temporarily stored in the data storage area 62B (S13).

The designated operation ID stored in step S13 is until another operation icon 121 to 124 or the plug-in icon 126 is specified until the execution instruction process described later is executed, or the terminal program 65 is terminated. Is held in the data storage area 62B until. The user operation for specifying the operation icon is an example of the user operation for specifying the specified operation.
The process of step S13 is an example of the third storage process.

Next, the terminal program 65 determines whether or not the designated device information is stored in the data storage area 62B (S14). The case where the designated device information is stored in the data storage area 62B is, for example, a case where the first device selection process described later or the second device selection process described later is executed in the past. On the other hand, the case where the designated device information is not stored in the data storage area 62B is, for example, a case where the first device selection process or the second device selection process has never been executed in the past. The process of step S14 is an example of the first determination process. Then, the terminal program 65 executes the execution preparation process corresponding to the designated operation icon in response to the determination that the designated device information is stored in the data storage area 62B (S14: Yes) (S15). ..

The execution preparation process is a process of preparing for the designated device to execute the designated operation. The execution preparation process includes, for example, a process of accepting the designation of designated data, a process of accepting the specification of execution conditions of the specified operation, a process of confirming an image of the execution result of the specified operation, and the like. The execution condition of the designated operation includes, for example, the number of copies of recording paper on which an image is recorded by the printing operation, the reading resolution in the scanning operation, the FAX number for specifying the external device of the FAX transmission destination in the FAX transmission operation, and the like.

As an example, the terminal program 65 receives the designation of the operation icon 121 through the operation unit 54, and determines that the designated device information is stored in the data storage area 62B (S12: operation icon & S14: Yes). , Execute the print preparation process which is an example of the execution preparation process. As another example, the terminal program 65 receives the designation of the operation icon 124 through the operation unit 54, and determines that the designated device information is stored in the data storage area 62B (S12: operation icon & S14: Yes), the FAX preparation process, which is an example of the execution preparation process, is executed. Details of the print preparation process and the FAX preparation process will be described later with reference to FIGS. 6 (B) and 7.

Although not shown, the execution preparation process when the operation icon 122 is specified is, for example, a process of accepting the specification of the reading resolution of the scanning operation, the specification of the save destination of the image data generated by the scanning operation, and the like. You may. Further, although not shown, the execution preparation process when the operation icon 123 is specified is, for example, the specification of the reading resolution of the scanning operation and the layout of the image recorded on the recording paper by the printing operation (for example, 2in1). It may be a process of accepting the designation.

On the other hand, the terminal program 65 receives the designation of the operation icon through the operation unit and determines that the designated device information is not stored in the data storage area 62B (S12: operation icon & S14: No). The unselected notification screen 130, which is an example of the screen, is displayed on the display unit 53 (S16). Then, the terminal program 65 receives the user operation on the unselected notification screen 130 through the operation unit 54 (S17). The process of step S16 is an example of the second display process, and the process of step S17 is an example of the reception process.

FIG. 10A is an example of the unselected notification screen 130, which is a pop-up window displayed on the main screen. The unselected notification screen 130 includes a message "You need to select a multifunction device. Do you want to select it?", A [Select now] icon 131, and a [Select later] icon 132. The [Select Now] icon 131 is an example of the first object corresponding to selecting the designated device, and the [Select Later] icon 132 is an example of the second object corresponding to not selecting the designated device.

Next, the terminal program 65 executes the second device selection process in response to the designation of the [select now] icon 131 through the operation unit 54 (S17: [select now] icon) (S18). .. Then, the terminal program 65 executes the processes after step S11 by using the designated device information newly stored in the data storage area 62 in the second device selection process. On the other hand, the terminal program 65 receives the designation of the [select later] icon 132 through the operation unit 54 (S17: [select later] icon), and steps without executing the second device selection process. The processing after S11 is executed. The second device selection process is an example of the second designated process. Details of the second device selection process will be described later with reference to FIG. 6A.

Further, the terminal program 65 determines whether or not the designated operation ID is stored in the data storage area 62B in response to receiving the designation of the device icon 128 through the operation unit 54 (S12: device icon) (S19). ). As an example, when the device icon 128 is specified after one of the operation icons 121 to 124 or the plug-in icons 126 and 127 is specified, it is determined in step S19 that the designated operation ID is stored. As another example, when the device icon 128 is specified before the operation icons 121 to 124 or the plug-in icons 126 and 127 are specified, it is determined in step S19 that the designated operation ID is not stored. The process of step S19 is an example of the second determination process.

Then, the terminal program 65 receives the designation of the device icon 128 through the operation unit 54 and determines that the designated operation ID is not stored in the data storage area 62B (S12: device icon & S19: No). The first device selection process is executed (S20). The first device selection process is an example of the first designated process. Details of the first device selection process will be described later with reference to FIG. On the other hand, the terminal program 65 accepts the designation of the device icon 128 through the operation unit 54 and determines that the designated operation ID is stored in the data storage area 62B (S12: device icon & S19: Yes). The second device selection process is executed (S21). Then, the terminal program 65 executes the processes after step S11 by using the designated device information newly stored in the data storage area 62B in the first device selection process or the second device selection process.

[First device selection process]
The terminal program 65 searches for a plurality of multifunction devices 10 that can communicate with each other through the communication unit 55 and can be designated as designated devices (S31). Specifically, the terminal program 65 broadcasts transmission request information to the communication network 101 through the communication unit 55 by using, for example, SNMP (abbreviation of Simple Network Management Protocol). The transmission request information is information for requesting transmission of device information stored in the MIB of a device that can be designated as a designated device. That is, only the device that can be designated as the designated device returns the device information. Next, the terminal program 65 receives the device information transmitted by the multifunction device 10 as a response to the transmission request information from the multifunction device 10 through the communication unit 55. In step S31 of the present embodiment, it is assumed that the mobile terminal 50 receives the device information from the multifunction devices 10A and 10B. The device information received from the multifunction device 10 includes an operation ID indicating an operation that can be executed by the multifunction device 10. The process of step S31 is an example of the reception process.
The search for the plurality of multifunction devices 10 capable of communicating may be performed by another well-known method.

Next, the terminal program 65 determines whether or not the plug-in is installed in the mobile terminal 50 (S32). Then, the terminal program 65 determines that the plug-in is installed (S32: Yes), and the first support among the multifunction devices 10A and 10B that are the sources of the device information received in step S31. The multifunction devices 10A and 10B capable of executing any one of the operation and the second support operation are specified (S33). On the other hand, the terminal program 65 is a multifunction device capable of executing any one of the first support operations among the multifunction devices 10A and 10B in response to the determination that the plug-in is not installed (S32: No). Identify 10A (S34). The process of step S32 is an example of the third determination process, and the process of steps S31, S33, and S34 is an example of the first specific process.

As an example, in step S33, the terminal program 65 transmits the device information according to the fact that any one of the first support operation ID and the second support operation ID is included in the device information received in step S31. The original multifunction device 10 may be specified as the multifunction device 10 capable of executing any one of the first support operation and the second support operation. As another example, the terminal program 65 may request the multifunction device 10 to return the device information including any one of the first support operation ID and the second support operation ID in step S31. Then, in step S33, the terminal program 65 specifies the multifunction device 10 that is the source of the device information received in step S31 as the multifunction device 10 that can execute any one of the first support operation and the second support operation. You may. The same process may be executed in step S34.

Next, the terminal program 65 causes the display unit 53 to display the device selection screen, which is an example of the first selection screen (S35). Then, the terminal program 65 accepts the user operation for the device selection screen through the operation unit 54 (S36). The process of step S35 is an example of the first selection screen display process, and the process of step S36 is an example of the reception process.

FIG. 10B is an example of a device selection screen when the multifunction devices 10A and 10B are specified in step S33. The device selection screen shown in FIG. 10B includes device icons 135 and 136. On the other hand, FIG. 11A is an example of a device selection screen when only the multifunction device 10A is specified in step S34. The device selection screen shown in FIG. 11A includes only the device icon 135. The device icons 135 and 136 correspond to the multifunction devices 10A and 10B specified in steps S33 and S34. Further, the device IDs of the corresponding multifunction devices 10A and 10B are described in the device icons 135 and 136.

Then, the terminal program 65 has already stored the device information of the multifunction device 10B corresponding to the device icon 136 in the data storage area 62B in response to receiving the designation of the device icon 136 through the operation unit 54 (S36: Yes). The stored designated device information is updated (S37). The user operation for designating the device icon 136 is an example of a user operation for designating the multifunction device 10B as a designated device. The process of step S37 is an example of the first storage process.

[Second device selection process]
The terminal program 65 searches for a plurality of multifunction devices 10 that can communicate with each other through the communication unit 55 and can be designated as designated devices (S41). Next, the terminal program 65 identifies the multifunction device 10 capable of executing the designated operation among the multifunction devices 10A and 10B that are the sources of the device information received in step S41 (S42). Then, the terminal program 65 causes the display unit 53 to display the device selection screen, which is an example of the second selection screen (S43). The device selection screen includes a device icon corresponding to the multifunction device 10 identified in step S42. The process of step S41 is an example of a reception process, the processes of steps S41 and S42 are an example of a second specific process, and the process of step S43 is an example of a second selection screen display process.

As an example, in the second device selection process after the operation icon 121 is specified, that is, when the designated operation ID “print” is stored, the terminal program 65 executes the print operation among the multifunction devices 10A and 10B. Only the possible multifunction devices 10A are specified (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display unit 53 to display a device selection screen including only the device icon 135 (S43).

As another example, in the second device selection process after the operation icon 123 is specified, that is, when the specified operation ID “copy” is stored, the terminal program 65 performs a print operation among the multifunction devices 10A and 10B. Only the multifunction device 10A capable of performing both the scanning operation and the scanning operation is specified (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display unit 53 to display a device selection screen including only the device icon 135 (S43).

As another example, in the second device selection process after the operation icon 124 is specified, that is, when the specified operation IDs “FAX transmission” and “FAX preview transmission” are stored, the terminal program 65 uses the multifunction device 10A. Of 10B, only the multifunction device 10A capable of executing at least one of the FAX transmission operation and the FAX preview transmission operation is specified (S42).
Then, as shown in FIG. 11A, the terminal program 65 causes the display unit 53 to display a device selection screen including only the device icon 135 (S43).

As yet another example, in the second device selection process after the plug-in icon 127 is specified, that is, when the specified operation IDs "print" and "label print" are stored, the terminal program 65 uses the multifunction device 10A. Of the 10Bs, the multifunction device 10A capable of executing all the designated operations and the multifunction device 10B capable of executing only a part of the designated operations are specified (S42). Then, as shown in FIG. 11B, the terminal program 65 causes the display unit 53 to display the device selection screen including the device icons 135 and 136 (S43).

In the device selection screen shown in FIG. 11B, the device icon 135 corresponding to the multifunction device 10A capable of executing all the specified operations is the device icon corresponding to the multifunction device 10B capable of executing only a part of the specified operations. It is displayed above 136. That is, the terminal program 65 uses the device icon 135 corresponding to the multifunction device 10A having a large number of executable second support operations as the device icon 136 corresponding to the multifunction device 10B having a small number of executable second support operations. Display with priority.

Further, in the device selection screen shown in FIG. 11B, the operation identification image 137 and 138 are added to the device icon 135, and the operation identification image 139 is added to the device icon 136. The operation identification images 137 to 139 are images showing the second support operation that can be executed by the corresponding multifunction devices 10A and 10B. More specifically, the motion identification image 137 shows a print motion, and the motion identification images 138 and 139 show a label print motion.

Then, the terminal program 65 has already stored the device information of the multifunction device 10B corresponding to the device icon 136 in the data storage area 62B in response to receiving the designation of the device icon 136 through the operation unit 54 (S44: Yes). The stored designated device information is updated (S45). The process of step S45 is an example of the second storage process.

The first device selection process is a process of causing a user to specify a designated device in a state where a designated operation is not specified. On the other hand, the second device selection process is a process of causing the user to specify the designated device in a state where the designated operation is designated. That is, the first device selection process and the second device selection process are common in that the user selects the designated device, and differ in whether or not the designated operation is specified at the time of execution of each process.

In the first device selection process and the second device selection process, for example, the processes of steps S31 and S41, the processes of steps S35 and S43, the processes of steps S36 and S44, and the processes of steps S37 and S45 are common. There may be. More specifically, the device selection screens displayed in steps S35 and S45 may have the same screen layout and device icon display mode. Further, the user operations received in steps S36 and S44 may be common.

[Print preparation process]
First, the terminal program 65 causes the display unit 53 to display the data selection screen (S51).
FIG. 12A is an example of a data selection screen. The data selection screen shown in FIG. 12A includes a plurality of data icons 141, 142, 143. The data icons 141 to 143 correspond to, for example, various data stored in a data folder or various data stored in a server (not shown) on the Internet. Then, the terminal program 65 receives the user operation for the data selection screen through the operation unit 54 (S52). The process of step S52 is an example of the reception process.

Next, the terminal program 65 determines the data "photograph.JPEG" corresponding to the data icon 141 as the designated data in response to the reception of the designation of the data icon 141 through the operation unit 54 (S52: Yes). The user operation for specifying the data icon is an example of the user operation for specifying the specified data. Next, the terminal program 65 causes the display unit 53 to display the preview screen (S53). Further, the terminal program 65 receives a user operation on the preview screen through the operation unit 54 (S54). The process of step S54 is an example of the reception process.

FIG. 12B is an example of a preview screen. The preview screen shown in FIG. 12B includes a preview image 145 and a [print] icon 146. The preview image 145 is an image showing the result of causing the designated device to execute the designated operation for the designated data.
The preview image 145 according to the present embodiment shows an image in which the image shown in the data “photograph.JPEG” is recorded on a recording paper. The [Print] icon 146 is an example of an execution instruction object corresponding to an execution instruction of the specified operation. That is, the [Print] icon 146 corresponds to an instruction to cause the designated device to perform a print operation on the designated data.

Next, the terminal program 65 transmits the print instruction information to the multifunction device 10A, which is the designated device, through the communication unit 55 in response to receiving the designation of the [print] icon 146 through the operation unit 54 (S54: Yes). (S55). The print instruction information is information for executing a print operation on the designated data. The print instruction information includes, for example, designated data or a designated data ID that identifies the designated data, and a designated operation ID “print”. The process of step S55 is an example of the execution instruction process. The file path of the designated data or the URL of the designated data stored in the server is an example of the designated data ID.

On the other hand, although not shown, the device program 35 of the multifunction device 10A receives print instruction information from the mobile terminal 50 through the communication unit 25. Then, the device program 35 causes the printer unit 11 to execute a print operation according to the received print instruction information.

[FAX preparation process]
The terminal program 65 causes the display unit 53 to display the operation selection screen (S61). FIG. 13A is an example of the operation selection screen. The operation selection screen shown in FIG. 13A includes operation icons 148 and 149. The operation icon 148 is an example of an operation object corresponding to the FAX transmission operation, and the operation icon 149 is an example of an operation object corresponding to the FAX preview transmission operation. Then, the terminal program 65 accepts the user operation on the operation selection screen through the operation unit 54 (S62). The process of step S62 is an example of the reception process.

The terminal program 65 makes the operation icon 148 a mode in which the operation icon 148 can be specified according to the operation ID "FAX transmission" included in the designated device information. On the other hand, the terminal program 65 makes the operation icon 148 unspecified (for example, grayed out, hidden) according to the fact that the operation ID "FAX transmission" is not included in the designated device information. Similarly, the terminal program 65 makes the operation icon 149 a mode in which the operation icon 149 can be specified according to the operation ID “FAX preview transmission” included in the designated device information. On the other hand, the terminal program 65 makes the operation icon 149 unspecified (for example, grayed out, hidden) in response to the fact that the operation ID "FAX preview transmission" is not included in the designated device information.

Next, the terminal program 65 stores the operation ID “FAX transmission” as the designated operation ID in response to the reception of the designation of the operation icon 148 in the specifiable mode through the operation unit 54 (S62: FAX transmission icon). Temporarily store in area 62B. Next, the terminal program 65 causes the display unit 53 to display the FAX transmission screen (S63). Then, the terminal program 65 receives a user operation on the FAX transmission screen through the operation unit 54 (S64). The process of step S64 is an example of the reception process.

FIG. 13B is an example of a fax transmission screen. The fax transmission screen shown in FIG. 13B includes acquisition source icons 151 and 152. The acquisition source icon 151 is an example of an execution instruction object corresponding to an instruction to cause the scanner unit 12 to execute a scanning operation and to fax the image data generated by the scanning operation to the FAX unit 13. The acquisition source icon 152 is an example of an execution instruction object corresponding to an instruction to fax the image data stored in the data storage area 62B to the FAX unit 13.

The terminal program 65 makes it possible to specify the acquisition source icon 151 according to the operation ID "scan" included in the designated device information. On the other hand, the terminal program 65 makes the acquisition source icon 151 unspecified (for example, grayed out, hidden) according to the fact that the operation ID "scan" is not included in the designated device information. On the other hand, the terminal program 65 makes the acquisition source icon 152 always specifiable. Further, the FAX transmission screen may further include an acquisition source icon or the like corresponding to an instruction to acquire image data stored in a server on the Internet.

Next, the terminal program 65 faxes the designation of the acquisition source icon 151 in the specifiable mode to the multifunction device 10A, which is the designated device, through the communication unit 55 in response to the reception of the designation of the acquisition source icon 151 through the operation unit 54 (S64: scan icon). The instruction information is transmitted (S67). The fax instruction information is information for executing a fax transmission operation for the designated data. The process of step S67 is an example of the execution instruction process.

The FAX instruction information transmitted by designating the acquisition source icon 151 includes the operation ID "FAX transmission" and the scan instruction information instructing the execution of the scan operation. That is, this FAX instruction information is information for causing the scanner unit 12 to execute a scanning operation and causing the FAX unit 13 to execute a FAX transmission operation using the image data generated by the scanning operation as designated data. Although not shown, the terminal program 65 accepts a user operation for designating a destination information (for example, a FAX number) for identifying an external device of a FAX destination through an operation unit 54, and receives the destination information by FAX. Include in instruction information.

On the other hand, although not shown, the device program 35 of the multifunction device 10A receives the fax instruction information from the mobile terminal 50 through the communication unit 25. Then, the device program 35 causes the scanner unit 12 to execute the scanning operation according to the scanning instruction information included in the FAX instruction information. The scanner unit 12 reads an image recorded on a document set in a contact glass (not shown) or an ADF (abbreviation of Auto Document Feeder), and generates image data indicating the image. Further, the device program 35 causes the FAX unit 13 to execute a FAX transmission operation for the image data generated by the scanning operation by the scanner unit 12. That is, the FAX unit 13 faxes the image data generated by the scanning operation to the external device identified by the transmission destination information included in the FAX instruction information.

Further, the terminal program 65 causes the display unit 53 to display the data selection screen shown in FIG. 12A, for example, in response to receiving the designation of the acquisition source icon 152 through the operation unit 54 (S64: local icon). (S65). Then, the terminal program 65 receives a user operation on the data selection screen through the operation unit 54 (S66). The processing of steps S65 and S66 may be the same as the processing of steps S51 and S52.

Next, the terminal program 65 determines, for example, the data “photograph.JPEG” corresponding to the data icon 141 as the designated data in response to the reception of the designation of the data icon 141 through the operation unit 54 (S66: Yes). Then, the terminal program 65 transmits the FAX instruction information to the multifunction device 10A, which is a designated device, through the communication unit 55 (S67). The FAX instruction information transmitted by designating the acquisition source icon 152 includes the designated data or the designated data ID, the operation ID "FAX transmission", and the destination information.

On the other hand, although not shown, the device program 35 of the multifunction device 10A receives the fax instruction information from the mobile terminal 50 through the communication unit 25. Then, the device program 35 causes the FAX unit 13 to execute the FAX transmission operation according to the FAX instruction information. That is, the FAX unit 13 specifies the external device identified by the destination information included in the FAX instruction information, which is identified by the designated data included in the FAX instruction information or the designated data ID included in the FAX instruction information. Fax the data.

Further, the terminal program 65 receives the designation of the operation icon 149 through the operation unit 54 (S62: FAX preview icon), and receives a plurality of FAX specific information included in the FAX list stored in the multifunction device 10A. , Received from the multifunction device 10A, which is a designated device, through the communication unit 55 (S68). More specifically, the terminal program 65 transmits the transmission request information requesting the transmission of the FAX specific information to the multifunction device 10A through the communication unit 55.
Next, the terminal program 65 receives the FAX specific information transmitted as a response to the transmission request information from the multifunction device 10A through the communication unit 55. Then, the terminal program 65 temporarily stores the received FAX specific information in the data storage area 62B.

Next, the terminal program 65 causes the display unit 53 to display the FAX selection screen (S69).
FIG. 14A is an example of a fax selection screen. The fax selection screen shown in FIG. 14A includes a plurality of fax icons 155 and 156. The FAX icons 155 and 156 are examples of execution instruction objects corresponding to the FAX preview transmission operation. The FAX icons 155 and 156 correspond to each of the plurality of FAX specific information received in step S68. Further, the fax icons 155 and 156 describe the reception date and time and the sender telephone number included in the corresponding fax specific information. Then, the terminal program 65 accepts the user operation for the FAX selection screen through the operation unit 54 (S70). The process of step S70 is an example of the reception process.

Next, the terminal program 65 transmits transmission instruction information to the multifunction device 10A, which is the designated device, through the communication unit 55, for example, in response to receiving the designation of the FAX icon 155 through the operation unit 54 (S70: Yes). S71). The transmission instruction information is an example of execution instruction information instructing the transmission of the FAX data 1 specified by the FAX specific information corresponding to the FAX icon 155. The transmission instruction information includes, for example, the operation ID “FAX preview transmission” and the data ID “001” included in the FAX specific information corresponding to the FAX icon 155. The process of step S71 is an example of the execution instruction process.

On the other hand, although not shown, the device program 35 of the multifunction device 10A receives transmission instruction information from the mobile terminal 50 through the communication unit 25. Then, the device program 35 reads the FAX data 1 identified by the data ID "001" included in the transmission instruction information from the FAX list, and transmits the FAX data 1 to the mobile terminal 50 through the communication unit 25.

Next, the terminal program 65 receives the fax data 1 from the multifunction device 10A through the communication unit 55 (S72: Yes). Next, the terminal program 65 causes the display unit 53 to display the FAX preview screen (S73). FIG. 14B is an example of a fax preview screen. The fax preview screen shown in FIG. 14B includes a fax image 160 and operation icons 161 and 162. Then, the terminal program 65 accepts the user operation for the FAX preview screen through the operation unit 54 (S74). The process of step S74 is an example of the reception process.

The FAX image 160 is an image shown in the FAX data 1 received in step S72. Further, the FAX header included in the FAX image 160 includes, for example, a reception date and time and a sender telephone number included in the corresponding FAX specific information. The operation icon 161 corresponds to an instruction to end the display of the FAX preview screen. The operation icon 162 is an example of an execution instruction object corresponding to an execution instruction of a print operation for FAX data 1. The terminal program 65 makes the operation icon 162 a mode in which the operation icon 162 can be specified according to the operation ID "print" included in the designated device information. On the other hand, the terminal program 65 makes the operation icon 162 undesignable (for example, grayed out, hidden) according to the fact that the operation ID "print" is not included in the designated device information.

Next, the terminal program 65 ends the display of the FAX preview screen in response to receiving the designation of the operation icon 161 through the operation unit 54 (S74: OK icon).
On the other hand, the terminal program 65 receives the designation of the operation icon 162 in the specifiable mode through the operation unit 54 (S74: print icon), and receives the print instruction information on the multifunction device 10A which is the designated device through the communication unit 55. Is transmitted (S75). The print instruction information includes, for example, an operation ID “print” and a designated data ID that identifies the designated data FAX data 1 or FAX data 1. The process of step S75 and the process of the multifunction device 10A that has received the print instruction information may be the same as in step S55.

Further, although not shown, when the plug-in icon 126 is specified, for example, the terminal program 65 executes the plug-in API in step S15 to execute the map program 66 corresponding to the designated plug-in icon 126. Start it. As a result, the OS 64 executes the terminal program 65 in the background and the map program 66 in the foreground. The same process is executed when the plug-in icon 127 is specified.

The map program 66, for example, acquires map image data including the current position of the mobile terminal 50 acquired from GPS (abbreviation of Global Positioning System) from a server (not shown) through the communication unit 55. Specifically, the map program 66 requests the map image data from the server through the communication unit 55, and receives the map image data returned from the server through the communication unit 55. Next, the map program 66 causes the display unit 53 to display the map designation screen. The map designation screen includes, for example, a map image indicated by map image data acquired from a server, a [print] icon, and a [FAX transmission] icon.

Next, the map program 66 receives a user operation on the map designation screen through the operation unit 54. The map program 66 changes the map image to be displayed on the map designation screen in response to receiving the user operation at the position of the map image through the operation unit 54. The map program 66 acquires map image data indicating the changed map image from the server. The map image displayed on the map designation screen is, for example, slid according to the slide operation, reduced according to the pinch-in operation, and enlarged following the pinch-out operation.

Further, the map program 66 receives the designation of the [print] icon through the operation unit 54, and receives the map image data indicating the map image displayed on the map designation screen as the designated data in the data storage area 62B. Temporarily memorize. Then, the map program 66 provides the terminal program 65 with the designated data ID and the designated operation ID “print” that identify the temporarily stored map image data as the return value of the plug-in API. The file name or file path is an example of the designated data ID. On the other hand, when the [FAX transmission] icon is specified, the designated operation ID "FAX transmission" is provided to the terminal program 65 as the return value of the plug-in API instead of the designated operation ID "print".

As a result, the OS 64 terminates the map program 66 and executes the terminal program 65 again in the foreground. Further, the terminal program 65 acquires the designated data ID and the designated operation ID from the map program 66 as the return value of the plug-in API. Then, the terminal program 65 requests the designated device identified by the device ID included in the designated device information for the designated data identified by the designated data ID acquired from the map program 66, and the designated operation acquired from the map program 66. The specified operation identified by the ID is executed. Further, the terminal program 65 may display the preview screen on the display unit 53 before causing the designated device to execute the designated operation.

[External startup process]
Further, the map program 66 may be started by the OS 64 to execute the above-described processing when a user operation for designating the program icon 112 on the menu screen shown in FIG. 9A is received through the operation unit 54. it can. Then, the map program 66 executes an explicit shared API with the designated data ID and the designated operation ID "print" as arguments in response to the designation of the [print] icon being received through the operation unit 54, thereby causing the terminal. Start program 65. Further, the map program 66 executes an explicit shared API with the designated data ID and the designated operation ID "FAX transmission" as arguments in response to the designation of the [FAX transmission] icon being received through the operation unit 54. , Activate the terminal program 65.

As a result, the OS 64 terminates the map program 66 and executes the terminal program 65 in the foreground. The terminal program 65 activated from the map program 66 due to the user operation on the map program 66 executes the external activation process shown in FIG. The designation of the [Print] icon or the [FAX transmission] icon is an example of a user operation on the map program 66 instructing to start the terminal program 65. The details of the external startup process will be described with reference to FIG. The external activation process may be executed when it is activated by the plug-in API established by the provider of the terminal program 65 instead of the explicit shared API.

First, the terminal program 65 acquires the designated data ID and the designated operation ID specified in the arguments of the API executed by the map program 66 as designated information (S81). Then, the terminal program 65 temporarily stores the acquired designated data ID and designated operation ID in the data storage area 62B. Here, it is assumed that the designated operation ID "print" has been acquired. Next, the terminal program 65 determines whether or not the designated device information is stored in the data storage area 62B (S82). The process of step S81 is an example of the acquisition process, and the process of step S82 is an example of the first determination process.

Next, the terminal program 65 causes the display unit 53 to display a preview screen, which is an example of the third screen, in response to the determination that the designated device information is stored (S82: Yes). Then, the terminal program 65 accepts the user operation for the preview screen through the operation unit 54 (S85). The process of step S84 is an example of the third display process, and the process of step S85 is an example of the reception process. On the other hand, the terminal program 65 executes the second device selection process prior to the third display process (S83) in response to the determination that the designated device information is not stored (S82: No).

FIG. 15 is an example of a preview screen in the external startup process. The preview screen shown in FIG. 15 includes a preview image 165, a device icon 166, and a [print] icon 167. In the preview image 165, with respect to the image data identified by the designated data ID acquired in step S81, the designated operation identified by the designated operation ID acquired in step S81 is identified by the device ID included in the designated device information. It is an image showing the result of having the designated device execute. The device icon 166 is an example of a device designation object. The [Print] icon 167 is an example of an execution instruction object corresponding to an execution instruction of the print operation which is a designated operation. The screen layout of the preview screen in the external startup process is different from the screen layout of the preview screen in the standard startup process in that the device icon 166 is included.

Next, the terminal program 65 executes the processes after step S83 in response to receiving the designation of the device icon 166 through the operation unit 54 (S85: device icon). On the other hand, the terminal program 65 transmits print instruction information to the designated device through the communication unit 55 in response to receiving the designation of the [print] icon 167 through the operation unit 54 (S85: [print] icon) (S86). .. The process of step S86 is an example of the execution instruction process, and may be the same as the process of step S55.

[Action and effect of the embodiment]
According to the above embodiment, the first device selection process is executed by designating the device icon 128 before designating the designated operation. Thereby, it is possible to provide the first lead wire for instructing the designated operation to the designated device selected from abundant options. On the other hand, the second device selection process is executed by specifying the operation icon after specifying the designated device, or by specifying the operation icons 121 to 124 and the plug-in icons 126 and 127 before specifying the designated device. To. As a result, it is possible to provide a second lead wire for instructing the designated operation to the designated device suitable for the designated operation.

That is, the user is conscious of which designated device is to be designated by the intuitive operation of which of the device icon 128 and the operation icons 121 to 124 or the plug-in icons 126 and 127 is designated first, and the terminal program 65. The first lead wire suitable for the user who operates the terminal program 65 and the second lead wire suitable for the user who operates the terminal program 65 while being aware of the operation to be executed by the designated device can be used properly.

Further, according to the above embodiment, the operation icons 121 to 124 included in the main screen are updated based on the designated device information updated by the first device selection process or the second device selection process. That is, it is possible to provide a lead wire for utilizing the operation that can be executed by the new designated device in response to the switching of the designated device. That is, the user who has designated the designated device through the first lead wire can be provided with a lead wire for the entire operation in which the new designated device can be executed. Further, the user who has designated the designated device through the first lead wire but does not display the operation icons 121 to 124 corresponding to the operation to be used can be provided with the first lead wire for changing the designated device again. On the other hand, to the user who selects the designated device through the second lead wire, not only the already designated designated operation but also the lead wire to another operation that can be executed by the new designated device can be further provided.

Further, according to the above embodiment, the display layout of the device selection screen and the like are standardized in the first device selection process and the second device selection process. Thereby, the same usability can be provided to both the user who selects the designated device through the first lead wire and the user who selects the designated device through the second lead wire. That is, it is possible for a user who uses one of the wires to provide usability that does not cause any discomfort even if the other wire is used.

Further, according to the above embodiment, a flexible second second device in which the designated device capable of executing the desired operation by the user can be immediately selected or later selected by the user operation on the unselected notification screen. A wire can be provided.

Further, according to the above embodiment, the device icon corresponding to the multifunction device 10 capable of executing at least one of the first support operation and the second support operation is displayed on the device selection screen of the first device selection process. .. As a result, the user can be made to specify a designated device capable of executing at least one of the first support operation and the second support operation through the first lead wire.

Further, according to the above embodiment, in the second device selection process when the plug-in icon is designated, the user can preferentially select a designated device capable of executing a large number of second support operations. This makes it possible to provide a third lead wire suitable for causing the designated device to perform an operation on the designated image data through the plug-in. Further, according to the above embodiment, the operation identification images 137 to 139 are added to the device icons 135 and 136 on the device selection screen of the second device selection process. As a result, it is possible to provide a third lead wire suitable for selecting the designated device after making the user aware of the second support operation that can be executed by the corresponding multifunction device 10.

However, the terminal program 65 may specify only the multifunction device 10 capable of executing all of the plurality of designated operations in steps S41 and S42. Then, the terminal program 65 may cause the user to designate one of the multifunction devices 10 capable of executing all of the plurality of designated operations as the designated device. On the other hand, in steps S41 and S42, the terminal program 65 may specify the multifunction device 10 capable of executing a part of a plurality of designated operations when there is no multifunction device 10 capable of executing all the designated operations. .. Then, the terminal program 65 may cause the user to designate one of the multifunction devices 10 capable of executing a part of the plurality of designated operations as the designated device.

Further, according to the above embodiment, when the external activation process is executed in a state where the designated device information is not stored, the second device selection process is executed prior to the third display process. As a result, it is possible to provide a fourth lead wire suitable for allowing the user to preferentially select a designated device capable of executing an operation supported by cooperation between the terminal program 65 and the activation source program.

Further, in the multifunction device 10 and the mobile terminal 50 of the above embodiment, the control unit of the present invention is executed by the CPUs 31 and 61 executing various programs stored in the program storage areas 32A and 62A of the storage units 32 and 62. Explained an example in which each process executed by is realized. However, the configuration of the control unit is not limited to this, and a part or all of the control unit may be realized by hardware such as an integrated circuit (also referred to as an IC (abbreviation of Integrated Circuit)).

Further, the present invention can be realized not only as a multifunction device 10 and a mobile terminal 50, but also as a program for causing the multifunction device 10 and the mobile terminal 50 to execute a process. Then, the program may be recorded and provided on a non-transitory recording medium. The non-transitory recording medium may include a storage unit mounted on a server that can be connected to the multifunction device 10 and the mobile terminal 50 through the communication network 101, in addition to a CD-ROM, a DVD-ROM, and the like. Then, the program stored in the storage unit of the server may be distributed as information or a signal indicating the program through a communication network 101 such as the Internet.

10 ... Multifunction device 11 ... Printer unit 12 ... Scanner unit 13 ... FAX unit 25, 55 ... Communication unit 31, 61 ... CPU
35 ... Device program 65 ... Terminal program 50 ... Mobile terminal 53 ... Display unit 54 ... Operation unit 62 ... Storage unit

Next, the terminal program 65 assigns an operation ID corresponding to the designated operation icon to the designated operation ID in response to receiving one designation of the operation icons 121 to 124 through the operation unit 54 (S12: operation icon). Is temporarily stored in the data storage area 62B (S13). Further, in response to receiving one designation of the plug-in icons 126 and 127 through the operation unit 54, the terminal program 65 sets the second support operation ID of the program corresponding to the designated plug-in icon as the designated operation ID. Is temporarily stored in the data storage area 62B (S13). S13 is an example of motion storage processing.

On the other hand, the terminal program 65 receives the designation of the operation icon through the operation unit and determines that the designated device information is not stored in the data storage area 62B (S12: operation icon & S14: No), and the third The unselected notification screen 130, which is an example of the screen, is displayed on the display unit 53 (S16). Then, the terminal program 65 receives the user operation on the unselected notification screen 130 through the operation unit 54 (S17). The process of step S16 is an example of the third display process, and the process of step S17 is an example of the reception process.

[Second device selection process]
The terminal program 65 searches for a plurality of multifunction devices 10 that can communicate with each other through the communication unit 55 and can be designated as designated devices (S41). Next, the terminal program 65 identifies the multifunction device 10 capable of executing the designated operation among the multifunction devices 10A and 10B that are the sources of the device information received in step S41 (S42). Then, the terminal program 65 displays the device selection screen, which is an example of the second screens at display unit 53 (S43). The device selection screen includes a device icon corresponding to the multifunction device 10 identified in step S42. Processing in step S41 is an example of a reception process, the process of steps S41, S42 is an example of a second identification processing, the processing in step S43 is an example of a second Display processing.

Then, the terminal program 65 has already stored the device information of the multifunction device 10B corresponding to the device icon 136 in the data storage area 62B in response to the reception of the designation of the device icon 136 through the operation unit 54 (S44: Yes). The stored designated device information is updated (S45). The process of step S45 is an example of device storage process.

Claims (14)

A program that can be read by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit.
The program causes the mobile terminal to execute a first display process for displaying a first screen including a device-designated object and an operation object on the display unit, and the device-designated object is an operation unit capable of executing an operation on image data. Corresponds to the designation of the designated device which is one of the plurality of image processing devices having the above, and the motion object corresponds to the action which the image processing device can perform.
The program
Reception processing that accepts user operations that specify objects through the operation unit,
The mobile terminal is made to execute the first determination process of determining whether or not the device identification information for identifying the designated device is stored in the storage unit.
The program causes the mobile terminal to execute the first designation process in response to the reception of the user operation for designating the device designation object in the reception process.
The program accepts the user operation for designating the operation object in the reception process, and determines in the first determination process that the device identification information is stored, so that the designated operation is sent to the designated device. The mobile terminal is made to execute the execution preparation process for preparing to be executed, and the designated operation is an operation corresponding to the designated operation object.
The program receives the user operation for designating the operation object in the reception process, and performs the second designation process in response to the determination in the first determination process that the device identification information is not stored. Let the terminal run
The first designation process is
A first specific process for specifying the image processing device that can communicate through the communication unit and can be designated as the designated device.
The first selection screen display process for displaying the first selection screen including the device object corresponding to the image processing device specified in the first specific process on the display unit, and
A first storage process for storing the device identification information of the image processing device corresponding to the designated device object in the storage unit in response to the reception of the user operation for designating the device object in the reception process. Including
The second designation process is
Among the image processing devices that can communicate through the communication unit and can be designated as the designated device, a second specific process that specifies the image processing device that can execute the designated operation, and
A second selection screen display process for displaying a second selection screen including the device object corresponding to the image processing device specified in the second specific process on the display unit, and a second selection screen display process.
A second storage process for storing the device identification information of the image processing device corresponding to the designated device object in the storage unit in response to the reception of the user operation for designating the device object in the reception process. Programs that include. The program
The mobile terminal is made to execute a reception process of receiving operation identification information from the designated device through the communication unit, and the operation identification information is information for identifying an operation that can be executed by the designated device.
In the first display process, among the motion objects that the program can display on the display unit, the first screen including the motion object corresponding to the motion identification information received in the reception process is displayed. Display on the display
The program according to claim 1, wherein the mobile terminal re-executes the first display process after executing the first designated process or the second designated process. The first selection screen and the second selection screen have the same screen layout and display mode of the device object.
The program according to claim 1 or 2, wherein the user operation for designating the device object is common to the first designated process and the second designated process. The program receives the user operation for designating the operation object in the reception process, and determines in the first determination process that the device identification information is not stored, so that the display unit displays the second screen. The mobile terminal is made to execute the second display process to be displayed on the mobile terminal, and the second screen includes a first object corresponding to selecting the designated device and a second object corresponding to not selecting the designated device. Including
The program
In response to receiving the user operation for designating the first object in the reception process, the mobile terminal is made to execute the second designation process.
The program according to any one of claims 1 to 3, which causes the mobile terminal to execute the first display process in response to receiving the user operation for designating the second object in the reception process. The program
A third storage process for storing the action identification information for identifying the designated action in the storage unit in response to the reception of the user operation for designating the action object in the reception process.
A second determination process for determining whether or not the operation identification information is stored in the storage unit, and
In response to the fact that the user operation for designating the device designation object is accepted in the reception process and the second determination process determines that the operation identification information is not stored, the first designation process is performed on the mobile terminal. Let it run
In response to the fact that the user operation for designating the device designation object is accepted in the reception process and the second determination process determines that the operation identification information is stored, the second designation process is performed on the mobile terminal. The program according to claim 4, which is to be executed. The program uses the designated device as the image processing device capable of executing at least one of a plurality of first support operations among the image processing devices capable of communicating through the communication unit in the first specific process. The program according to any one of claims 1 to 5, wherein the first support operation is an operation in which the program can execute the execution preparation process. The program makes the user specify the image data, and determines whether or not an external program for notifying the program of data identification information for identifying the designated image data is stored in the storage unit. Let the mobile terminal execute the process
The program
The image processing apparatus capable of executing at least one of the plurality of first support operations in the first specific process when it is determined in the third determination process that the external program is not stored is described as described above. Specify as a device that can be specified as a designated device,
The image capable of executing at least one of a plurality of the first support operation and the second support operation in the first specific process when it is determined in the third determination process that the external program is stored. The program according to claim 6, wherein the processing device is specified as a device that can be designated as the designated device, and the second support operation is an operation that the external program can be executed by the designated device through the program. .. The first screen can include a plug-in object which is the operation object corresponding to the external program, and the external program can cause the designated device to execute a plurality of the second support operations. And
The program specifies the image processing device capable of executing all of the plurality of the second support operations as the device that can be designated as the designated device in the second specific process when the plug-in object is specified. The program according to claim 7. The first screen can include a plug-in object which is the operation object corresponding to the external program, and the external program can cause the designated device to execute a plurality of the second support operations. And
The program
In the second specific process when the user operation for designating the plug-in object is accepted by the operation unit, the image processing device capable of executing at least one of the plurality of the second support operations is specified.
The program according to claim 7, wherein in the second selection screen display process, the device object corresponding to the image processing device having a large number of executable second support operations is preferentially displayed. The program according to claim 9, wherein the program adds an image showing the second support operation that can be executed by the corresponding image processing device to the device object in the second selection screen display process. The first screen can include a composite motion object which is the motion object corresponding to the composite motion in which the first motion and the second motion are combined.
The program is any of claims 1 to 10 that specifies the image processing apparatus capable of performing both the first operation and the second operation in the second specific process when the combined operation object is specified. The program described in Crab. The first screen includes an inclusion object which is the motion object corresponding to both the third motion and the fourth motion.
The program is any of claims 1 to 11 that specifies the image processing apparatus capable of executing at least one of the third operation and the fourth operation in the second specific processing when the inclusion object is specified. The program described in Crab. The program is launched from the launcher program due to a user operation on the launcher program.
An acquisition process for acquiring data identification information for identifying the image data specified by the user and operation identification information for identifying the specified operation from the activation source program, and
Let the mobile terminal execute the first determination process,
The program causes the mobile terminal to execute a third display process for displaying the third screen on the display unit in response to the determination in the first determination process that the device identification information is stored. The third screen includes a preview image showing the result of causing the designated device to execute the designated operation identified by the motion identification information with respect to the image data identified by the data identification information.
Claim 1 for causing the mobile terminal to execute the second designated process prior to the third display process in response to the determination in the first determination process that the device identification information is not stored in the program. The program described in any of 12 to 12. The program
In the execution preparation process, the execution instruction object corresponding to the execution instruction of the designated operation is displayed on the display unit.
In response to receiving the user operation for designating the execution instruction object in the reception process, the mobile terminal is made to execute the execution instruction process of transmitting the execution instruction information to the designated device through the communication unit, and the execution instruction information is executed. Is the program according to any one of claims 1 to 13, which is information for instructing execution of the designated operation.

Images