JP7322930B2 - program - Google Patents

Description

The present invention relates to a program readable by a mobile terminal. The program causes the portable terminal to execute processing for causing the image processing device to execute an operation on image data.

Conventionally, there has been known an application that allows a user to specify content data and causes an image processing apparatus to perform an operation on the specified content data. For example, the application described in Patent Document 1 allows a user to specify image data stored in a mobile terminal, and causes a printer to print an image indicated by the image data.

JP 2012-203742 A

Mobile terminal applications, for example, are designed on the assumption that they are for personal use, such as printing image data easily. Moreover, since the screen size of a mobile terminal that executes the application is smaller than that of a PC or the like, a user interface that enables simple and intuitive operation is desirable.

2. Description of the Related Art In recent years, a so-called "multifunction machine" having a scanner unit, a FAX unit, etc. installed in a printer has become popular. In order to allow the user to effectively use the functions of the MFP, there is a demand to utilize the application of the mobile terminal as a lead that leads the user to each function implemented in the MFP. In addition, it is desirable that the mobile terminal application further include a user interface that allows the user to select a printer or a multi-function peripheral for executing operations on image data.

SUMMARY OF THE INVENTION An object of the present invention is to provide a program having a user interface suitable for selecting an image processing apparatus for executing an operation on image data.

A program described in this specification can be read by a mobile terminal including a communication unit, a display unit, an operation unit, and a storage unit. The program causes the portable terminal to execute a first display process of displaying a first screen including a device designation object and an action object on the display unit. The device designation object corresponds to designation of a designated device, which is one of a plurality of image processing devices having an action unit capable of executing an action on image data. The action object corresponds to an action executable by the image processing device. The program comprises receiving processing for receiving a user operation for designating an object through the operation unit, and first determination processing for determining whether or not device identification information for identifying the designated device is stored in the storage unit. Run it on your mobile device. The program causes the portable terminal to execute a first designation process in response to receiving a user operation designating the device designation object in the reception process. The program receives a user operation for designating the action object in the receiving process, and transmits the designated action to the designated device in response to determining in the first determination process that the device identification information is stored. The portable terminal is caused to execute an execution preparation process for preparing to be executed. The specified action is an action corresponding to the specified action object. The program receives a user operation designating the action object in the receiving process, and executes the second designating process in response to determining in the first determining process that the device identification information is not stored. let the terminal run it. The first specifying process corresponds to a first specifying process of specifying the image processing device that can communicate through the communication unit and that can be specified as the specified device, and the image processing device specified in the first specifying process. a first selection screen display process for displaying a first selection screen including a device object on the display unit; and a first storage process of storing the device identification information of the corresponding image processing device in the storage unit. The second specifying process includes: a second specifying process of specifying the image processing device capable of executing the specified operation among the image processing devices that can communicate through the communication unit and can be specified as the specified device; a second selection screen display process for displaying on the display unit a second selection screen including the device object corresponding to the image processing apparatus specified by the second specifying process; and a second storage process of storing the device identification information of the image processing device corresponding to the designated device object in the storage unit in response to the reception in the storage unit.

According to the above configuration, by designating the device designating object before designating the designated action, it is possible to provide the first lead wire for instructing the designated action to the designated device selected from a wide variety of options. On the other hand, by designating the action object before designating the designated device, it is possible to provide a second lead for directing the designated action to the designated device suitable for the designated action. That is, the user can intuitively determine which of the device-designating object and the action object is to be designated first, and is conscious of which device is to be designated. And, the second conductor suitable for the user who operates the program can be properly used while being conscious of the operation to be executed by the designated device.

FIG. 1 is a schematic configuration diagram of a system 100 according to an embodiment. In FIG. 2, (A) is a block diagram of the MFP 10, and (B) is a block diagram of the portable terminal 50. As shown in FIG. FIG. 3 shows examples of information stored in the data storage areas 32B and 62B, in which (A) is a FAX list, (B) is designated device information, (C) is a designated operation ID, and (D) indicates a list of second support action IDs. FIG. 4 is a flowchart of standard start-up processing. FIG. 5 is a flowchart of the first device selection process. FIG. 6A is a flowchart of second device selection processing, and FIG. 6B is a flowchart of print preparation processing. FIG. 7 is a flowchart of FAX preparation processing. FIG. 8 is a flowchart of the external activation process. FIG. 9 shows an example of display on the display unit 53, where (A) shows a menu screen and (B) shows a main screen. 10A and 10B show display examples of the display unit 53. FIG. 10A shows the unselected notification screen 130 superimposed on the main screen, and FIG. show. 11A and 11B show display examples of the display unit 53, in which (A) shows a device selection screen when only the multifunction device 10A is specified, and (B) shows operation identification images 137 to 139 in device icons 135 and 136. Fig. 3 shows an attached device selection screen; 12A and 12B show display examples of the display unit 53, where (A) shows a data selection screen and (B) shows a preview screen in the standard activation process. 13A and 13B show display examples of the display unit 53, where (A) shows an operation selection screen and (B) shows a FAX transmission screen. 14A and 14B show display examples of the display unit 53, where (A) shows a FAX selection screen and (B) shows a FAX preview screen. FIG. 15 is a display example of the preview screen in the external activation process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. It should be noted that the embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be modified as appropriate without changing the gist of the present invention. For example, the execution order of each process to be described later can be changed as appropriate without changing the gist of the present invention.

FIG. 1 is a schematic diagram of a system 100 according to this embodiment. A system 100 shown in FIG. 1 includes multifunction devices 10A and 10B (hereinafter collectively referred to as “multifunction device 10”) and a mobile terminal 50 . The MFP 10 and the mobile terminal 50 are configured to be able to communicate with each other through the communication network 101 . The communication network 101 may be, for example, a wired LAN (abbreviation for Local Area Network), a wireless LAN, or a combination thereof.

[MFP 10]
As shown in FIG. 2A, the MFP 10 includes a printer section 11, a scanner section 12, a FAX section 13, a display section 23, an operation section 24, a communication section 25, and a CPU (Central Processing Unit). Unit) 31 , a storage section 32 and a communication bus 33 . Each component constituting the multi-function device 10 is interconnected through a communication bus 33 . The MFP 10 is an example of an image processing device.

[Printer unit 11, scanner unit 12, FAX unit 13]
The printer unit 11 executes a print operation for recording an image indicated by image data on recording paper. A recording sheet is an example of a sheet or a recording medium. As a recording method of the printer unit 11, a known method such as an inkjet method or an electrophotographic method can be adopted. The scanner unit 12 performs a scanning operation of reading an image recorded on a document and generating image data. The FAX unit 13 executes a FAX transmission operation and a FAX reception operation for transmitting and receiving image data in accordance with the FAX protocol. The printer unit 11, scanner unit 12, and FAX unit 13 are examples of operation units.

Among the plurality of operations described above, the print operation and the FAX transmission operation are examples of the output operation for outputting image data. Note that the output operations executed by the MFP 10 are not limited to these. As another example of the output operation, the MFP 10 performs a FAX preview transmission operation of transmitting the image data to the mobile terminal 50 via the communication unit 25 in order to display the image indicated by the image data received in the FAX reception operation. may be executed. As still another example of the output operation, the multi-function device 10 may execute a label print operation of recording a disc-shaped image (hereinafter referred to as a "label image") on the surface of a CD-ROM or the like. . Also, the scanning operation and the FAX receiving operation among the plurality of operations described above are examples of forming operations for forming image data. Furthermore, a FAX transmission operation and a FAX reception operation are performed by the FAX unit 13 .

Also, the multi-function device 10 may be capable of executing a multi-function operation in which a plurality of operations are combined. For example, a copy operation in which image data generated in a scanning operation is recorded on recording paper in a print operation, a scan-fax operation in which image data generated in a scan operation is faxed in a fax transmission operation, and an image data received by fax in a fax reception process. A FAX print operation for recording on recording paper in a print operation is an example of a compound operation.

Operations that can be executed by the MFPs 10A and 10B may differ. The MFP 10A according to the present embodiment can execute print operation, scan operation, FAX transmission operation, FAX reception operation, FAX preview transmission operation, and label print operation. On the other hand, the MFP 10B according to the present embodiment can execute a print operation and a label print operation. Also, the image processing device is not limited to being capable of executing a plurality of operations, and may be capable of executing only a single operation.

The MIB (abbreviation for Management Information Base) of the multifunction device 10 may define, for example, a device ID that identifies the multifunction device 10 and an action ID that identifies an action that the multifunction device 10 can execute. . The device ID is an example of device identification information, and the action ID is an example of action identification information. In this embodiment, the MFP 10A is identified by the device ID "MFP-A", and the MFP 10B is identified by the device ID "MFP-B". Hereinafter, the device ID and operation ID registered in the MIB may be referred to as "device information".

[Display unit 23]
The display unit 23 has a display screen for displaying various information. As the display unit 23, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be adopted.

[Operation unit 24]
The operation unit 24 receives a user's operation to designate an object displayed on the display screen of the display unit 23 . Specifically, the operation unit 24 has buttons and outputs various operation signals associated with the pressed buttons to the CPU 31 . Furthermore, the operation unit 24 may have a film-like touch sensor superimposed on the display screen of the display unit 23 . That is, the display unit 23 may be configured as a touch panel display.

Note that the “object” refers to an image that can be designated by the user by operating the operation unit 24 . As an example, the object may be a character string, icon, button, link, etc. displayed on the display unit 23 . The object may be designated by pressing a direction key or an enter button on the operation unit 24 . If the operation unit 24 is a touch panel, the object displayed on the display unit 23 may be specified by touching the display position.

The operation unit 24 implemented as a touch panel outputs position information indicating the position on the display screen touched by the user. It should be noted that "touch" in this specification includes all operations of bringing an input medium into contact with the display screen. That is, a tap operation, a long touch operation, a slide operation, a flick operation, a pinch-in operation, a pinch-out operation, etc., in which the touched input medium is moved away from the display screen within a predetermined time, a long touch operation, a slide operation in which the touched input medium is slid on the display screen, etc. is an example.

Also, even if the input medium does not touch the display screen, bringing the input medium close to the display screen at a very small distance may be included in the aforementioned concept of "touch." Furthermore, the input medium may be a user's finger, a touch pen, or the like. Hereinafter, tapping the position of an icon displayed on the display unit 53 will be described as an example of user operation for designating the icon.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 101 . That is, the MFP 10 outputs various information to the mobile terminal 50 through the communication section 25 and receives various data or information from the mobile terminal 50 through the communication section 25 . A specific communication procedure of the communication unit 25 is not particularly limited, but for example, Wi-Fi (registered trademark of Wi-Fi Alliance) can be adopted.

[CPU31]
The CPU 31 controls the overall operation of the MFP 10 . The CPU 31 acquires various programs, which will be described later, from the storage unit 32 based on various information output from the operation unit 24 and various information acquired from an external device through the communication unit 25, and executes them. That is, the CPU 31 and the storage section 32 constitute an example of a control section.

[Storage unit 32]
The storage unit 32 has a program storage area 32A and a data storage area 32B. The program storage area 32A stores an OS (Operating System) 34 and a device program 35 . Note that the device program 35 may be a single program or an aggregate of a plurality of programs. Data or information necessary for executing the device program 35 is stored in the data storage area 32B.

In this specification, "data" and "information" are common in that they are bits or bit strings that can be handled by a computer. "Data" refers to anything that can be handled by a computer without considering the semantic content indicated by each bit. On the other hand, "information" indicates that the operation of the computer branches depending on the meaning indicated by each bit. Furthermore, the "instruction" is a control signal for prompting the destination device to perform the next operation, and may contain information, and itself has the property of information. There is also

In addition, "data" and "information" are the same data and information as long as they are recognized as having the same meaning and content, even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer. treated as For example, information indicating “two” is stored as text format information “0x32” in ASCII code on one computer, and stored as binary format information “10” in binary notation on another computer. may be

However, the above distinction between "data" and "information" is not strict, and exceptional handling is permitted. For example, data may be temporarily treated as information, or information may be temporarily treated as data. Also, what is handled as data in one device may be handled as information in another device. Furthermore, information may be extracted from data, and data may be extracted from information.

The storage unit 32 includes, for example, RAM (abbreviation of Random Access Memory), ROM (abbreviation of Read Only Memory), EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), HDD (abbreviation of Hard Disk Drive), CPU 31 has It is configured by a buffer or the like, or a combination thereof.

Note that the storage unit 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. In addition to the above examples, non-transitory media include recording media such as CD-ROMs and DVD-ROMs. A non-transitory medium is also a tangible medium. On the other hand, an electrical signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium, which is a kind of computer-readable medium, but is a non-transitory computer-readable storage. Not included in media.

The programs stored in the program storage area 32A are executed by the CPU 31. FIG. However, in this specification, the operation of each program may be described by omitting the CPU 31 . That is, in the following description, the description to the effect that "the program A executes the process A" may refer to "the CPU 31 executes the process A described in the program A". The same applies to the mobile terminal 50, which will be described later.

Also, the program stored in the program storage area 32A judges the event and operates according to the judgment result. However, in this specification, the operation of each program may be described by omitting the judgment. That is, in the following description, the description to the effect that ``the program executes the process A according to the condition A'' means ``the program determines whether the condition A is satisfied. It may also refer to "executing the process A according to". The same applies to the mobile terminal 50, which will be described later.

The programs stored in the program storage area 32A specify, acquire, extract, determine, or select data or the like. The program identifies data etc., for example, by identifying data that satisfies a condition from among a plurality of data etc., and storing the data itself or information for identifying the data etc. in a predetermined storage area. It refers to the process of memorizing. The information for identifying the data etc. is, for example, identification information for identifying the data etc., the index of the array in which the data etc. is stored, the pointer of the storage area in which the data etc. is stored, and the like. The same applies to the process by which the program obtains, extracts, determines, or selects data or the like. The same applies to the mobile terminal 50, which will be described later.

The OS 34 is an API (Application Programming Interface) for controlling the printer unit 11, the scanner unit 12, the FAX unit 13, the display unit 23, the operation unit 24, the communication unit 25, etc., which are the hardware constituting the MFP 10. ) is the basic program that provides That is, each program described above controls each hardware by calling an API provided by the OS 34 . However, in this specification, the operation of each program may be explained by omitting the OS 34 . That is, in the following description, the description to the effect that "the program B controls the hardware C" may refer to "the program B controls the hardware C through the API of the OS34". The same applies to the mobile terminal 50, which will be described later.

As shown in FIG. 3A, the data storage area 32B can store FAX identification information and FAX data associated with the FAX identification information. Hereinafter, the entire information shown in FIG. 3A may be referred to as "FAX list", and a set of FAX identification information and FAX data associated with each other in the FAX list may be referred to as "FAX record". be. That is, a fax list can contain multiple fax records. FIG. 3A shows an example of the FAX list of the MFP 10A.

The FAX data is image data received by the MFP 10A from an external device via the FAX unit 13 by FAX. The FAX identification information is information for making the multi-function device 10A individually identify FAX data. The FAX identification information includes, for example, a data ID that is data identification information for identifying the FAX data by the multifunction device 10A, the reception date and time of the FAX data identified by the data ID, and the transmission of the FAX data identified by the data ID. and a source phone number that identifies the source.

The device program 35 of the MFP 10A adds a FAX record to the FAX list in response to executing the FAX reception operation. More specifically, the device program 35 receives the FAX data and the sender's telephone number from the external device through the FAX unit 13 by the FAX receiving operation. In addition, the device program 35 generates a unique data ID in the FAX list and acquires the date and time of reception from the system clock (not shown) in response to the execution of the FAX reception operation. The device program 35 then adds FAX records containing these to the FAX list. Note that the FAX reception operation is automatically executed by the multifunction device 10A regardless of an instruction from the mobile terminal 50 or the like.

The device program 35 can read, edit, or delete the data stored in the data storage area 32B by executing the access API provided by the OS 34. FIG. A data ID for identifying data to be accessed is specified as an argument to the access API. A data ID is information in a format used to designate data to an access API. A data ID is, for example, a file path or a URI. On the other hand, part or all of the data stored in the data storage area 32B may be stored in an external server (not shown) such as a cloud server. That is, the device program 35 may transmit various data to the external server through the communication section 25 and receive various data from the external server through the communication section 25 . The data ID in this case may be, for example, in the form of a URL for downloading data from an external server. The same applies to the mobile terminal 50 as well.

[Mobile terminal 50]
The portable terminal 50 mainly includes a display section 53, an operation section 54, a communication section 55, a CPU 61, a storage section 62, and a communication bus 63, as shown in FIG. 2B. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the mobile terminal 50 are connected to the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, Since it has the same configuration as the storage unit 32 and the communication bus 33, the description is omitted. The CPU 61 and storage unit 62 are an example of a control unit.

The mobile terminal 50 is, for example, a mobile phone, a smart phone, a tablet terminal, or the like. More specifically, the display unit 53 of the mobile terminal 50 preferably has a display screen size of 12 inches or less, more preferably 8 inches or less. Moreover, it is desirable that the operation unit 54 of the portable terminal 50 is a touch panel superimposed on the display screen of the display unit 53 .

The display unit 53 of the mobile terminal 50 is divided into a common display area 80 and a program display area 81, as shown in FIGS. A status bar is displayed in the common display area 80 by the OS 64 regardless of what is displayed in the program display area 81 . Various information is displayed on the status bar by the OS 64 . The status bar includes, for example, the title of the screen displayed in the program display area 81, an icon indicating the remaining battery level of the mobile terminal 50, an icon indicating the communication status of the communication unit 55, and push buttons received by the mobile terminal 50 from an external service. An icon or the like indicating notification is displayed. The program display area 81 displays a screen generated by the program being executed in the foreground.

Hereinafter, when it is described that "the program causes the display unit 53 to display a screen", the program screen is displayed in the program display area 81 and the status bar is displayed in the common display area 80. FIG. A program screen is a screen displayed in the program display area 81 according to a program instruction. However, the display unit 53 can be switched between a partial screen mode in which the display area is divided into a common display area 80 and a program display area 81, and a full screen mode in which the entire display area is the program display area 81. good too.

A program storage area 62A of the storage unit 62 stores an OS 64, a terminal program 65, a map program 66, and a label editing program 67. FIG. Further, the data storage area 62B stores various information shown in FIGS. 3(B) to 3(D). Furthermore, a data folder may be provided in the data storage area 62B. The data folder may store, for example, photo data, document data, presentation data, spreadsheet data, and the like.

The OS 64 may be, for example, Android (registered trademark of Google inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like. The OS 64 can concurrently execute multiple programs installed in the mobile terminal 50 . A plurality of programs are virtually executed in parallel by, for example, time-division multiplexing. Also, the OS 64 executes one of a plurality of programs executed in parallel in the foreground and executes the other programs in the background.

The terminal program 65 is a program that causes a designated device to execute a designated operation for designated data. Designated data refers to image data designated by a user. A specified action refers to an action specified by a user. A designated device refers to the MFP 10 designated by the user. The terminal program 65 can accept user operations for designating designated data, designated actions, and designated devices through the operation unit 54 . Hereinafter, data identification information for identifying designated data will be referred to as "designated data ID", action identification information for identifying a designated action will be referred to as "designated action ID", and device identification information for identifying a designated device will be referred to as "designated device It is sometimes written as ID.

Terminal program 65 supports one or more operations. The operation supported by the terminal program 65 is an example of the first support operation. That is, the first support operation refers to an operation that allows the terminal program 65 to execute an execution preparation process, which will be described later. In other words, the first support action refers to an action that can be a designated action. The first support operation according to this embodiment is a print operation, a scan operation, a copy operation, a FAX transmission operation, and a FAX preview transmission operation. The action ID of the first support action may be referred to as "first support action ID".

The terminal program 65 is activated by the OS 64 that receives a user operation on a menu screen, which will be described later, or by the map program 66 or label editing program 67 . Furthermore, the terminal program 65 activates the map program 66 and the label editing program 67 by executing the plug-in API for activating applications as plug-ins. Hereinafter, the map program 66 and label editing program 67 activated by the plug-in API may be referred to as "plug-in".

The map program 66 and the label editing program 67 are examples of starting programs that are started by the OS 64 and execute an explicit shared API with specified information as an argument to start the terminal program 65 . Also, the map program 66 and the label editing program 67 are examples of external programs that are activated by the terminal program 65 as so-called plug-ins, and that provide specified information to the terminal program 65 as return values of the plug-in API. Furthermore, the map program 66 and the label editing program 67 may execute a plug-in API with specified information as an argument to activate the terminal program 65 . The specified information includes at least one of a specified data ID, a specified action ID, and a specified device ID.

The map program 66 according to the present embodiment allows the user to specify an arbitrary area of the map image, stores image data representing the map image of the specified area in the data storage area 32B, and stores the data ID of the image data stored in the data storage area 32B. is provided to the terminal program 65 as the specified data ID. Further, the map program 66 allows the user to designate one of the print operation and the FAX transmission operation, and provides the terminal program 65 with the operation ID of the designated operation as the designated operation ID.

Further, the label editing program 67 according to the present embodiment edits the label image according to the user's operation, stores the label image data representing the label image in the data storage area 32B, and designates the data ID of the stored label image data. It is provided to the terminal program 65 as a data ID. Also, the label editing program 67 allows the user to designate one of the print operation and the label print operation, and provides the terminal program 65 with the operation ID of the designated operation as the designated operation ID.

The operation supported by the map program 66 and label editing program 67 is an example of the second support operation. The second support operation of the map program 66 according to this embodiment is print operation and FAX transmission. That is, the second support operation refers to an operation that can be an operation to be executed by the specified device with respect to specified data specified by a user's operation on the plug-in. Also, the second support operation of the label editing program 67 according to this embodiment is a print operation and a label print operation. Hereinafter, the action ID of the second support action may be referred to as "second support action ID".

The OS 64 provides the programs installed in the portable terminal 50 with a shared function of activating the second program specified by the first program and providing specified information specified by the first program to the second program. The first program can use the shared function by, for example, executing an API provided by the OS 64 (hereinafter referred to as "shared API"). More specifically, the first program executes the shared API using the program ID and the specified information of the second program as arguments. The sharing functionality of the Android OS is an example of sharing functionality.

In response to the user's instruction to use the sharing function, the sharing source application executes the explicit sharing API using predetermined information specifying the application, URI, type, and action as arguments. A predetermined sharing destination application may be activated. URI is information indicating the location of shared data. The type is information indicating the data format of shared data. The action is information indicating the type of processing (for example, browsing, editing, sending, printing, etc.) for shared data to be executed by the application of the sharing destination. URI, type, and action are examples of specifying information provided from a sharing source application to a sharing destination application.

In the present embodiment, for example, the terminal program 65 may be set as a predetermined sharing destination application in the map program 66 that is the sharing source application. More specifically, the information specifying the terminal program 65 may be described in the setting file referred to by the map program 66 when it is activated or in the source code of the map program 66 . The same applies to the label editing program 67, which is another example of the sharing source application.

In addition, the sharing source application may execute an implicit sharing API using the URI, type, and action as arguments in response to receiving a user operation instructing use of the sharing function through the operation unit 54 . As a result, the OS 64 displays a list of the applications installed in the portable terminal 50 that declare to the OS 64 that the processing indicated by the action can be executed on the shared data in the data format indicated by the type. The application may be displayed on the unit 53 and an application specified by the user from the list may be activated.

The data storage area 62B can store designated device information as shown in FIG. 3(B). The designated device information includes a device ID that identifies the designated device and an action ID that identifies an action executable by the designated device. The action ID included in the designated device information is an example of the designated action ID. The designated device information is stored in the data storage area 62B by the terminal program 65. FIG. Note that the designated device information may or may not be stored in the data storage area 62B at the start of standard activation processing and external activation processing, which will be described later.

Also, the data storage area 62B can store a designated action ID as shown in FIG. 3(C). The designated action ID is temporarily stored in the data storage area 62B by the terminal program 65 that receives the user's operation for designating the designated action. Note that the designated action ID is not stored in the data storage area 62B at the start of the standard activation process and the external activation process.

Further, the data storage area 62B can store a program ID for identifying a program and a second support operation ID associated with the program ID, as shown in FIG. 3(D). In the example of FIG. 3D, the program ID "001" identifies the map program 66 and the program ID "002" identifies the label edit program 67. FIG. The program ID and the second support operation ID corresponding to each other may be stored in the data storage area 62B when the terminal program 65 is installed, or may be stored in the data storage area 62B when the map program 66 and the label editing program 67 are installed. good too.

[Operation of system 100]
The operation of the system 100 according to this embodiment will be described with reference to FIGS. 4 to 8. FIG.

First, the OS 64 of the mobile terminal 50 causes the display unit 53 to display a menu screen. FIG. 9A is an example of the menu screen. The menu screen shown in FIG. 9A includes a plurality of program icons 111, 112, 113, 114, 115. The menu screen shown in FIG. Program icons 111 to 115 correspond to programs installed on mobile terminal 50 . For example, program icon 111 corresponds to terminal program 65 , program icon 112 corresponds to map program 66 , and program icon 113 corresponds to label editing program 67 .

Then, the OS 64 accepts designation of one of the program icons 111 to 115 through the operation unit 54. FIG. The OS 64 activates the terminal program 65 in response to receiving the designation of the program icon 111 through the operation unit 54 . Designation of the program icon 111 is an example of a user operation for instructing activation of the terminal program 65 . The terminal program 65 of the mobile terminal 50 executes standard startup processing in response to being started by the OS 64 . Details of the standard activation process will be described with reference to FIG.

[Standard startup process]
First, the terminal program 65 causes the display unit 53 to display a main screen, which is an example of the first screen (S11). FIG. 9B is an example of the main screen. The main screen includes operation icons 121 , 122 , 123 , 124 , status icons 125 , plug-in icons 126 , 127 and device icons 128 . In addition, the terminal program 65 receives a user's operation on the main screen through the operation unit 54 (S12). The process of step S11 is an example of the first display process, and the process of step S12 is an example of the acceptance process.

The action icon 121 is an example of an action object corresponding to the print action. Action icon 122 is an example of an action object corresponding to a scan action. The action icon 123 is an example of a composite action object corresponding to a copy action combining a print action and a scan action. Action icon 124 is an example of a containment object that corresponds to both a send fax action and a send fax preview action. A status icon 125 corresponds to an instruction to display a status screen showing the status of the specified device. Details of the status screen will be omitted. The plug-in icon 126 corresponds to an instruction to run the plug-in API to launch the map program 66. FIG. The plug-in icon 127 corresponds to an instruction to execute the plug-in API and activate the label editing program 67 .

The terminal program 65 determines which of the action icons 121 to 124 corresponding to the support action ID is to be included in the main screen based on the designated device information stored in the data storage area 62B. More specifically, the terminal program 65 includes, on the main screen, the action icon corresponding to the action ID included in the designated device information among the action icons 121 to 124 that can be displayed on the display unit 53 . On the other hand, the terminal program 65 includes action icons 121 to 124 corresponding to all support action IDs on the main screen in response to the fact that the designated device information is not stored in the data storage area 62B.

That is, the terminal program 65 includes the action icon 121 on the main screen in response to the fact that the action ID "print" is included in the designated device information. On the other hand, the terminal program 65 does not include the action icon 121 in the main screen in response to the fact that the action ID "print" is not included in the designated device information. Similarly, the terminal program 65 includes the action icon 122 on the main screen in response to the fact that the action ID "scan" is included in the designated device information. On the other hand, the terminal program 65 does not include the action icon 122 in the main screen in response to the fact that the action ID "scan" is not included in the designated device information.

In addition, the terminal program 65 includes the action icon 123 on the main screen in response to the fact that both the action ID "print" and the action ID "scan" are included in the designated device information. On the other hand, the terminal program 65 does not include the action icon 123 in the main screen in response to the fact that at least one of the action ID "print" and the action ID "scan" is not included in the designated device information. The print operation is an example of the first operation, the scan operation is an example of the second operation, the operation ID "print" is an example of the first operation information, and the operation ID "scan" is an example of the second operation information. be.

In addition, the terminal program 65 includes the action icon 124 on the main screen in response to at least one of the action ID "FAX transmission" and the action ID "FAX preview transmission" being included in the designated device information. On the other hand, the terminal program 65 does not include the action icon 124 in the main screen in response to the fact that both the action ID "FAX transmission" and the action ID "FAX preview transmission" are not included in the designated device information. The FAX transmission operation is an example of the third operation, the FAX preview transmission operation is an example of the fourth operation, the operation ID "FAX transmission" is an example of the third operation information, and the operation ID "FAX preview transmission" is an example of the third operation information. 4 is an example of motion information.

Furthermore, the terminal program 65 includes the plug-in icon 126 on the main screen in response to the map program 66 being installed in the mobile terminal 50 . On the other hand, the terminal program 65 does not include the plug-in icon 126 on the main screen in response to the fact that the map program 66 is not installed in the mobile terminal 50 . Similarly, the terminal program 65 includes the plug-in icon 127 on the main screen in response to the label editing program 67 being installed in the mobile terminal 50 . On the other hand, the terminal program 65 does not include the plug-in icon 127 on the main screen in response to the fact that the label editing program 67 is not installed in the mobile terminal 50 .

The device icon 128 is an example of a device designation object corresponding to designation of a designated device, which is one of the multifunction devices 10A and 10B. In response to the fact that the designated device information is stored in the data storage area 62B, the terminal program 65 changes the device ID "MFP-A" included in the designated device information to Described in the device icon 128 as the currently specified device ID. On the other hand, in response to the fact that the designated device information is not stored in the data storage area 62B, the terminal program 65 writes the character string "unselected" in the device icon 128, indicating that the designated device is not designated at this time. do.

Next, in response to receiving designation of one of the action icons 121 to 124 through the operation unit 54 (S12: action icon), the terminal program 65 sets the action ID corresponding to the designated action icon to the specified action ID. is temporarily stored in the data storage area 62B as (S13). Also, in response to receiving the specification of one of the plug-in icons 126 and 127 through the operation unit 54, the terminal program 65 sets the second support action ID of the program corresponding to the specified plug-in icon to the specified action ID. is temporarily stored in the data storage area 62B as (S13).

Note that the designated action ID stored in step S13 is retained until execution instruction processing (to be described later) is executed, another action icon 121 to 124 or plug-in icon 126 is designated, or the terminal program 65 is terminated. Until then, it is held in the data storage area 62B. A user operation specifying an action icon is an example of a user operation specifying a specified action. The process of step S13 is an example of the third storage process.

Next, the terminal program 65 determines whether or not the designated device information is stored in the data storage area 62B (S14). The case where the designated device information is stored in the data storage area 62B is, for example, the case where the first device selection process described later or the second device selection process described later was executed in the past. On the other hand, when the designated device information is not stored in the data storage area 62B, for example, the first device selection process or the second device selection process has never been executed in the past. The process of step S14 is an example of the first determination process. When the terminal program 65 determines that the designated device information is stored in the data storage area 62B (S14: Yes), the terminal program 65 executes execution preparation processing corresponding to the designated action icon (S15). .

The execution preparation process is a process of making preparations for causing the designated device to execute the designated action. The execution preparation process includes, for example, a process of receiving designation of designated data, a process of receiving designation of execution conditions for the designated action, and a process of confirming an image of the execution result of the designated action. The conditions for executing the designated operation include, for example, the number of copies of recording paper on which an image is recorded by the print operation, the reading resolution in the scan operation, and the FAX number specifying the external device of the FAX transmission destination in the FAX transmission operation.

As an example, the terminal program 65 accepts designation of the action icon 121 through the operation unit 54, and determines that the designated device information is stored in the data storage area 62B (S12: action icon & S14: Yes). , a print preparation process, which is an example of the execution preparation process, is executed. As another example, the terminal program 65 accepts designation of the action icon 124 through the operation unit 54 and determines that the designated device information is stored in the data storage area 62B (S12: action icon & S14: Yes), FAX preparation processing, which is an example of execution preparation processing, is executed. Details of the print preparation process and the FAX preparation process will be described later with reference to FIGS.

Although not shown, the execution preparation process when the action icon 122 is specified is, for example, the process of receiving the specification of the reading resolution of the scanning operation, the specification of the storage destination of the image data generated by the scanning operation, and the like. may Further, although illustration is omitted, the execution preparation processing when the action icon 123 is specified includes, for example, specification of the reading resolution of the scan operation, and layout of the image recorded on the recording paper by the print operation (for example, 2 in 1). It may be a process of receiving designation.

On the other hand, the terminal program 65 accepts the designation of the action icon through the operation unit, and in response to determining that the designated device information is not stored in the data storage area 62B (S12: action icon & S14: No), the second An unselected notification screen 130, which is an example of the screen, is displayed on the display unit 53 (S16). Then, the terminal program 65 receives a user's operation on the non-selection notification screen 130 through the operation unit 54 (S17). The process of step S16 is an example of the second display process, and the process of step S17 is an example of the acceptance process.

FIG. 10A shows an example of the non-selection notification screen 130, which is a pop-up window superimposed on the main screen. The unselected notification screen 130 includes a message “MFP must be selected. Do you want to select it?” The [Select Now] icon 131 is an example of a first object corresponding to selecting a designated device, and the [Select Later] icon 132 is an example of a second object corresponding to not selecting a designated device.

Next, the terminal program 65 executes a second device selection process (S18) in response to receiving the designation of the [select now] icon 131 through the operation unit 54 (S17: [select now] icon). . Then, the terminal program 65 uses the specified device information newly stored in the data storage area 62 in the second device selection process to execute the processes from step S11 onward. On the other hand, when the terminal program 65 accepts the designation of the [Select Later] icon 132 through the operation unit 54 (S17: [Select Later] icon), the terminal program 65 does not execute the second device selection process and performs step The processing after S11 is executed. The second device selection process is an example of the second designation process. Details of the second device selection process will be described later with reference to FIG.

Further, in response to receiving designation of the device icon 128 through the operation unit 54 (S12: device icon), the terminal program 65 determines whether or not the designated action ID is stored in the data storage area 62B (S19 ). As an example, when the device icon 128 is specified after one of the action icons 121 to 124 or the plug-in icons 126 and 127 is specified, it is determined in step S19 that the specified action ID is stored. As another example, when the device icon 128 is specified before the action icons 121 to 124 or the plug-in icons 126 and 127 are specified, it is determined in step S19 that the specified action ID is not stored. The process of step S19 is an example of the second determination process.

Then, the terminal program 65 accepts designation of the device icon 128 through the operation unit 54, and in response to determining that the designated action ID is not stored in the data storage area 62B (S12: device icon & S19: No), A first device selection process is executed (S20). The first device selection process is an example of the first designation process. Details of the first device selection process will be described later with reference to FIG. On the other hand, the terminal program 65 accepts designation of the device icon 128 through the operation unit 54, and in response to determining that the designated action ID is stored in the data storage area 62B (S12: device icon & S19: Yes), A second device selection process is executed (S21). Then, the terminal program 65 uses the specified device information newly stored in the data storage area 62B in the first device selection process or the second device selection process to execute the processes after step S11.

[First device selection process]
The terminal program 65 searches for a plurality of MFPs 10 that can communicate through the communication unit 55 and that can be designated as designated devices (S31). Specifically, the terminal program 65 broadcasts the transmission request information to the communication network 101 through the communication unit 55 using SNMP (Simple Network Management Protocol), for example. The transmission request information is information for requesting transmission of device information stored in the MIB of a device that can be designated as a designated device. That is, only devices that can be designated as designated devices return device information. Next, the terminal program 65 receives from the multifunction device 10 via the communication unit 55 the device information transmitted by the multifunction device 10 in response to the transmission request information. In step S31 of the present embodiment, it is assumed that the mobile terminal 50 has received the device information from the multifunction peripherals 10A and 10B. The device information received from the MFP 10 includes an action ID indicating an action that the MFP 10 can perform. The process of step S31 is an example of the reception process. Note that the search for a plurality of communicable MFPs 10 may be performed by other well-known methods.

Next, the terminal program 65 determines whether or not a plug-in is installed in the mobile terminal 50 (S32). Then, when the terminal program 65 determines that the plug-in is installed (S32: Yes), the terminal program 65 selects one of the multifunction peripherals 10A and 10B, which is the transmission source of the device information received in step S31, as the first support. The MFPs 10A and 10B capable of executing either one of the operation and the second support operation are specified (S33). On the other hand, when the terminal program 65 determines that the plug-in is not installed (S32: No), the terminal program 65 selects one of the MFPs 10A and 10B capable of executing one of the first support operations. 10A is specified (S34). The processing of step S32 is an example of the third determination processing, and the processing of steps S31, S33, and S34 is an example of the first specifying processing.

As an example, in step S33, the terminal program 65 transmits the device information in response to the fact that one of the first support operation ID and the second support operation ID is included in the device information received in step S31. The original MFP 10 may be identified as the MFP 10 capable of executing either one of the first support operation and the second support operation. As another example, the terminal program 65 may request the MFP 10 to return device information including either one of the first support operation ID and the second support operation ID in step S31. Then, in step S33, the terminal program 65 identifies the multifunction device 10 that has transmitted the device information received in step S31 as the multifunction device 10 capable of executing either one of the first support operation and the second support operation. You may Similar processing may be performed in step S34.

Next, the terminal program 65 causes the display unit 53 to display a device selection screen, which is an example of the first selection screen (S35). Then, the terminal program 65 receives a user's operation on the device selection screen through the operation unit 54 (S36). The process of step S35 is an example of the first selection screen display process, and the process of step S36 is an example of the acceptance process.

FIG. 10B is an example of the device selection screen when the MFPs 10A and 10B are specified in step S33. The device selection screen shown in FIG. 10B includes device icons 135 and 136 . On the other hand, FIG. 11A is an example of the device selection screen when only the MFP 10A is specified in step S34. The device selection screen shown in FIG. 11A includes only device icons 135 . Device icons 135 and 136 correspond to the multi-function machines 10A and 10B identified in steps S33 and S34. Also, the device icons 135 and 136 describe the device IDs of the corresponding MFPs 10A and 10B.

Then, for example, in response to receiving the designation of the device icon 136 through the operation unit 54 (S36: Yes), the terminal program 65 stores the device information of the multifunction machine 10B corresponding to the device icon 136 in the data storage area 62B. The stored designated device information is updated (S37). A user operation to designate the device icon 136 is an example of a user operation to designate the multifunction peripheral 10B as the designated device. The process of step S37 is an example of the first storage process.

[Second device selection process]
The terminal program 65 searches for a plurality of MFPs 10 that can communicate through the communication unit 55 and that can be designated as designated devices (S41). Next, the terminal program 65 identifies the multifunction device 10 capable of executing the designated operation among the multifunction devices 10A and 10B that are the transmission sources of the device information received in step S41 (S42). Then, the terminal program 65 causes the display unit 53 to display a device selection screen, which is an example of the second selection screen (S43). The device selection screen includes a device icon corresponding to the MFP 10 specified in step S42. The process of step S41 is an example of a reception process, the processes of steps S41 and S42 are an example of a second specifying process, and the process of step S43 is an example of a second selection screen display process.

As an example, after the action icon 121 is specified, that is, in the second device selection process when the specified action ID "print" is stored, the terminal program 65 executes the print action of the MFPs 10A and 10B. Only possible MFPs 10A are specified (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display section 53 to display a device selection screen including only the device icon 135 (S43).

As another example, in the second device selection process after the action icon 123 is specified, that is, when the specified action ID "copy" is stored, the terminal program 65 selects the print action of the MFPs 10A and 10B. and scan operations are specified only (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display section 53 to display a device selection screen including only the device icon 135 (S43).

As another example, in the second device selection process after the action icon 124 has been specified, that is, when the specified action IDs "FAX transmission" and "FAX preview transmission" are stored, the terminal program 65 causes the MFP 10A to , 10B, only the MFP 10A capable of executing at least one of the FAX transmission operation and the FAX preview transmission operation is specified (S42). Then, as shown in FIG. 11A, the terminal program 65 causes the display section 53 to display a device selection screen including only the device icon 135 (S43).

As still another example, after the plug-in icon 127 is specified, that is, in the case where the specified action IDs "print" and "label print" are stored, in the second device selection process, the terminal program 65 causes the MFP 10A , 10B, the MFP 10A capable of executing all the designated operations and the MFP 10B capable of executing only a part of the designated operations are specified (S42). Then, the terminal program 65 causes the display unit 53 to display a device selection screen including the device icons 135 and 136, as shown in FIG. 11B (S43).

In the device selection screen shown in FIG. 11B, the device icon 135 corresponding to the MFP 10A capable of executing all designated operations is the device icon corresponding to the MFP 10B capable of executing only some of the designated operations. It is displayed above 136. That is, the terminal program 65 selects the device icon 135 corresponding to the MFP 10A, which has a large number of executable second support operations, from the device icon 136 corresponding to the MFP 10B, which has a small number of executable second support operations. display with priority.

In the device selection screen shown in FIG. 11B, action identification images 137 and 138 are added to the device icon 135, and an action identification image 139 is added to the device icon 136. FIG. The action identification images 137 to 139 are images showing second support actions that can be executed by the corresponding multifunction peripherals 10A and 10B. More specifically, action identification image 137 indicates a print action, and action identification images 138 and 139 indicate a label print action.

Then, for example, in response to receiving the specification of the device icon 136 through the operation unit 54 (S44: Yes), the terminal program 65 stores the device information of the multifunction machine 10B corresponding to the device icon 136 in the data storage area 62B. The stored designated device information is updated (S45). The process of step S45 is an example of the second storage process.

The first device selection process is a process of allowing the user to specify a specified device in a state where no specified action has been specified. On the other hand, the second device selection process is a process of allowing the user to designate a designated device in a state where a designated action has been designated. That is, the first device selection process and the second device selection process are common in that the user selects the specified device, but differ in whether or not the specified operation is specified at the time of execution of each process.

In the first device selection process and the second device selection process, for example, the processes of steps S31 and S41, the processes of steps S35 and S43, the processes of steps S36 and S44, and the processes of steps S37 and S45 are common. There may be. More specifically, the device selection screens displayed in steps S35 and S45 may have the same screen layout and device icon display mode. Also, the user operations accepted in steps S36 and S44 may be common.

[Print preparation process]
First, the terminal program 65 causes the display unit 53 to display a data selection screen (S51). FIG. 12A is an example of the data selection screen. The data selection screen shown in FIG. 12(A) includes a plurality of data icons 141, 142, 143. In FIG. Data icons 141 to 143 correspond to, for example, various data stored in a data folder or various data stored in a server (not shown) on the Internet. Then, the terminal program 65 receives a user's operation on the data selection screen through the operation unit 54 (S52). The processing of step S52 is an example of reception processing.

Next, the terminal program 65 determines the data “photograph.JPEG” corresponding to the data icon 141 as the designated data, for example, in response to receiving the designation of the data icon 141 through the operation unit 54 (S52: Yes). A user operation specifying a data icon is an example of a user operation specifying specified data. Next, the terminal program 65 displays a preview screen on the display unit 53 (S53). The terminal program 65 also accepts a user operation on the preview screen through the operation unit 54 (S54). The processing of step S54 is an example of reception processing.

FIG. 12B is an example of the preview screen. The preview screen shown in FIG. 12B includes a preview image 145 and a [Print] icon 146 . The preview image 145 is an image showing the result of causing the specifying device to execute the specifying operation for the specified data. A preview image 145 according to the present embodiment indicates an image obtained by recording an image indicated by data "photograph.JPEG" on recording paper. The [Print] icon 146 is an example of an execution instruction object corresponding to an instruction to execute a specified action. That is, the [Print] icon 146 corresponds to an instruction to cause the specified device to print the specified data.

Next, the terminal program 65 transmits print instruction information through the communication unit 55 to the MFP 10A, which is the designated device, in response to receiving the designation of the [Print] icon 146 through the operation unit 54 (S54: Yes). (S55). The print instruction information is information for executing a print operation for specified data. The print instruction information includes, for example, designated data or a designated data ID that identifies the designated data, and a designated operation ID "print". The process of step S55 is an example of the execution instruction process. The file path of the specified data or the URL of the specified data stored in the server is an example of the specified data ID.

On the other hand, although not shown, the device program 35 of the MFP 10A receives print instruction information from the portable terminal 50 through the communication unit 25. FIG. Then, the device program 35 causes the printer section 11 to execute the print operation according to the received print instruction information.

[FAX preparation processing]
The terminal program 65 displays an operation selection screen on the display unit 53 (S61). FIG. 13A is an example of the action selection screen. The action selection screen shown in FIG. 13A includes action icons 148 and 149 . An action icon 148 is an example of an action object corresponding to a FAX transmission action, and an action icon 149 is an example of an action object corresponding to a FAX preview transmission action. Then, the terminal program 65 receives a user's operation on the action selection screen through the operation unit 54 (S62). The processing of step S62 is an example of reception processing.

It should be noted that the terminal program 65 makes the action icon 148 specifiable in response to the fact that the action ID "FAX transmission" is included in the designated device information. On the other hand, the terminal program 65 makes the action icon 148 unspecifiable (for example, grayed out or not displayed) in response to the fact that the action ID "FAX transmission" is not included in the designated device information. Similarly, the terminal program 65 makes the action icon 149 specifiable in response to the action ID "FAX preview transmission" being included in the specified device information. On the other hand, the terminal program 65 makes the action icon 149 unspecifiable (for example, grayed out or not displayed) in response to the fact that the action ID "FAX preview transmission" is not included in the designated device information.

Next, the terminal program 65 stores the operation ID “FAX transmission” as the specified operation ID in response to the designation of the action icon 148 of the specifiable mode through the operation unit 54 (S62: FAX transmission icon). Temporarily stored in area 62B. Next, the terminal program 65 causes the display unit 53 to display a FAX transmission screen (S63). Then, the terminal program 65 receives a user's operation on the FAX transmission screen through the operation unit 54 (S64). The processing of step S64 is an example of reception processing.

FIG. 13B is an example of a FAX transmission screen. The FAX transmission screen shown in FIG. 13B includes acquisition source icons 151 and 152 . The acquisition source icon 151 is an example of an execution instruction object corresponding to an instruction to cause the scanner unit 12 to perform a scanning operation and to send the image data generated by the scanning operation to the FAX unit 13 by FAX. The acquisition source icon 152 is an example of an execution instruction object corresponding to an instruction to send the image data stored in the data storage area 62B to the FAX unit 13 by FAX.

Note that the terminal program 65 makes the acquisition source icon 151 designable in response to the operation ID “scan” being included in the designated device information. On the other hand, the terminal program 65 makes the acquisition source icon 151 unspecifiable (for example, grayed out or not displayed) in response to the action ID “scan” being not included in the specified device information. On the other hand, the terminal program 65 makes the acquisition source icon 152 always specifiable. Furthermore, the FAX transmission screen may further include an acquisition source icon or the like corresponding to an instruction to acquire image data stored in a server on the Internet.

Next, the terminal program 65 receives the specification of the acquisition source icon 151 of the specifiable mode through the operation unit 54 (S64: scan icon), and sends a fax to the multifunction machine 10A, which is the specified device, through the communication unit 55. Instruction information is transmitted (S67). The FAX instruction information is information for executing a FAX transmission operation for designated data. The process of step S67 is an example of the execution instruction process.

The FAX instruction information transmitted by specifying the acquisition source icon 151 includes the action ID “FAX transmission” and scan instruction information instructing execution of the scan operation. That is, the FAX instruction information is information for causing the scanner section 12 to perform a scanning operation and for causing the FAX section 13 to perform a FAX transmission operation with image data generated by the scanning operation as specified data. Also, although illustration is omitted, the terminal program 65 accepts a user operation for specifying destination information (for example, a FAX number) for identifying an external device of a FAX transmission destination through the operation unit 54, and sends the destination information by FAX. Include in instructional information.

On the other hand, although not shown, the device program 35 of the MFP 10A receives FAX instruction information from the portable terminal 50 through the communication unit 25. FIG. Then, the device program 35 causes the scanner section 12 to perform a scanning operation according to the scanning instruction information included in the FAX instruction information. The scanner unit 12 reads an image recorded on a document set on a contact glass (not shown) or an ADF (abbreviation for Auto Document Feeder), and generates image data representing the image. Further, the device program 35 causes the FAX section 13 to perform a FAX transmission operation for the image data generated by the scanning operation by the scanner section 12 . That is, the FAX unit 13 FAX-transmits the image data generated by the scanning operation to the external device identified by the destination information included in the FAX instruction information.

In addition, the terminal program 65 causes the display unit 53 to display, for example, the data selection screen shown in FIG. (S65). Then, the terminal program 65 receives a user's operation on the data selection screen through the operation unit 54 (S66). The processing of steps S65 and S66 may be the same as the processing of steps S51 and S52.

Next, the terminal program 65 determines the data “photograph.JPEG” corresponding to the data icon 141 as the designated data, for example, in response to receiving the designation of the data icon 141 through the operation unit 54 (S66: Yes). Then, the terminal program 65 transmits the FAX instruction information to the multifunction device 10A, which is the designated device, through the communication unit 55 (S67). The FAX instruction information transmitted by specifying the acquisition source icon 152 includes the specified data or the specified data ID, the action ID "FAX transmission", and the destination information.

On the other hand, although not shown, the device program 35 of the MFP 10A receives FAX instruction information from the portable terminal 50 through the communication unit 25. FIG. Then, the device program 35 causes the FAX section 13 to perform a FAX transmission operation according to the FAX instruction information. That is, the FAX unit 13 sends the specified data included in the FAX instruction information or the specified data ID included in the FAX instruction information to the external device identified by the destination information included in the FAX instruction information. Fax the data.

Also, in response to receiving the designation of the action icon 149 through the operation unit 54 (S62: FAX preview icon), the terminal program 65 selects a plurality of pieces of FAX specifying information included in the FAX list stored in the multifunction device 10A. , through the communication unit 55 from the MFP 10A, which is the designated device (S68). More specifically, the terminal program 65 transmits transmission request information requesting transmission of the FAX-specific information to the multi-function device 10A through the communication unit 55. FIG. Next, the terminal program 65 receives the FAX specification information transmitted as a response to the transmission request information from the multifunction device 10A through the communication unit 55. FIG. Then, the terminal program 65 temporarily stores the received FAX identification information in the data storage area 62B.

Next, the terminal program 65 causes the display unit 53 to display a FAX selection screen (S69). FIG. 14A is an example of the FAX selection screen. The FAX selection screen shown in FIG. 14A includes a plurality of FAX icons 155 and 156. FAX icons 155 and 156 are examples of execution instruction objects corresponding to the FAX preview transmission operation. FAX icons 155 and 156 respectively correspond to the plurality of pieces of FAX-specific information received in step S68. Further, the FAX icons 155 and 156 describe the reception date and time and the sender's telephone number included in the corresponding FAX specifying information. Then, the terminal program 65 receives a user's operation on the FAX selection screen through the operation unit 54 (S70). The processing of step S70 is an example of reception processing.

Next, the terminal program 65, for example, in response to receiving the designation of the FAX icon 155 through the operation unit 54 (S70: Yes), transmits transmission instruction information through the communication unit 55 to the multifunction device 10A, which is the designated device ( S71). The transmission instruction information is an example of execution instruction information that instructs transmission of the FAX data 1 specified by the FAX specification information corresponding to the FAX icon 155 . The transmission instruction information includes, for example, the action ID “FAX preview transmission” and the data ID “001” included in the FAX specification information corresponding to the FAX icon 155 . The process of step S71 is an example of the execution instruction process.

On the other hand, although not shown, the device program 35 of the MFP 10A receives transmission instruction information from the portable terminal 50 through the communication unit 25. FIG. Then, the device program 35 reads the FAX data 1 identified by the data ID “001” included in the transmission instruction information from the FAX list, and transmits the FAX data 1 to the mobile terminal 50 through the communication unit 25 .

Next, the terminal program 65 receives the FAX data 1 from the MFP 10A through the communication unit 55 (S72: Yes). Next, the terminal program 65 displays a FAX preview screen on the display section 53 (S73). FIG. 14B is an example of the FAX preview screen. The FAX preview screen shown in FIG. 14B includes a FAX image 160 and action icons 161 and 162 . Then, the terminal program 65 receives a user's operation on the FAX preview screen through the operation unit 54 (S74). The processing of step S74 is an example of reception processing.

A FAX image 160 is an image indicated by the FAX data 1 received in step S72. Also, the FAX header included in the FAX image 160 includes, for example, the reception date and time and the sender's telephone number included in the corresponding FAX identification information. The action icon 161 corresponds to an instruction to end the display of the FAX preview screen. The action icon 162 is an example of an execution instruction object corresponding to an instruction to execute the print operation for the FAX data 1 . Note that the terminal program 65 makes the action icon 162 specifiable in response to the fact that the action ID "print" is included in the designated device information. On the other hand, the terminal program 65 makes the action icon 162 unspecifiable (for example, grayed out or not displayed) in response to the fact that the action ID "print" is not included in the designated device information.

Next, the terminal program 65 ends the display of the FAX preview screen in response to receiving the specification of the action icon 161 through the operation unit 54 (S74: OK icon). On the other hand, the terminal program 65, in response to receiving the specification of the action icon 162 of the specifiable mode through the operation unit 54 (S74: print icon), sends print instruction information through the communication unit 55 to the MFP 10A, which is the specified device. is transmitted (S75). The print instruction information includes, for example, an operation ID “print” and FAX data 1 as designated data or a designated data ID for identifying the FAX data 1 . The processing of step S75 and the processing of the MFP 10A that received the print instruction information may be the same as that of step S55.

Further, although illustration is omitted, if, for example, the plug-in icon 126 is specified, the terminal program 65 executes the plug-in API in step S15 to activate the map program 66 corresponding to the specified plug-in icon 126. start it up. As a result, the OS 64 executes the terminal program 65 in the background and the map program 66 in the foreground. Similar processing is executed when the plug-in icon 127 is specified.

The map program 66 acquires map image data including the current position of the mobile terminal 50 acquired from GPS (abbreviation of Global Positioning System), for example, from a server (not shown) through the communication unit 55 . Specifically, the map program 66 requests map image data from the server through the communication unit 55 and receives map image data returned from the server through the communication unit 55 . Next, the map program 66 causes the display unit 53 to display a map designation screen. The map designation screen includes, for example, a map image represented by map image data obtained from the server, a [Print] icon, and a [FAX transmission] icon.

Next, the map program 66 receives a user's operation on the map designation screen through the operation unit 54 . The map program 66 changes the map image to be displayed on the map designation screen in response to receiving a user operation at the position of the map image through the operation unit 54 . The map program 66 acquires map image data indicating the map image after change from the server. The map image displayed on the map designation screen is, for example, slid following a slide operation, reduced in size following a pinch-in operation, and enlarged in accordance with a pinch-out operation.

Further, in response to receiving the designation of the [Print] icon through the operation unit 54, the map program 66 stores the map image data representing the map image displayed on the map designation screen as designated data in the data storage area 62B. Temporarily store. Then, the map program 66 provides the terminal program 65 with the specified data ID and the specified action ID "print" for identifying the temporarily stored map image data as return values of the plug-in API. A file name or file path is an example of a designated data ID. On the other hand, when the [FAX transmission] icon is designated, the designated operation ID "FAX transmission" is provided to the terminal program 65 as the return value of the plug-in API instead of the designated operation ID "print".

As a result, the OS 64 terminates the map program 66 and executes the terminal program 65 in the foreground again. The terminal program 65 also acquires the specified data ID and specified action ID from the map program 66 as return values of the plug-in API. Then, the terminal program 65 sends the specified operation acquired from the map program 66 to the specified device identified by the device ID included in the specified device information for the specified data identified by the specified data ID acquired from the map program 66. Executes the specified action identified by the ID. In addition, the terminal program 65 may display a preview screen on the display unit 53 before causing the designated device to execute the designated action.

[External startup process]
Further, the map program 66 can be activated by the OS 64 and execute the above-described processing when a user operation specifying the program icon 112 on the menu screen shown in FIG. can. When the map program 66 accepts the designation of the [Print] icon through the operation unit 54, the map program 66 executes the explicit shared API with the designated data ID and the designated action ID "print" as arguments. Start the program 65. Further, in response to the specification of the [FAX transmission] icon through the operation unit 54, the map program 66 executes the explicit shared API with the specified data ID and the specified action ID "FAX transmission" as arguments. , to start the terminal program 65 .

As a result, the OS 64 terminates the map program 66 and executes the terminal program 65 in the foreground. The terminal program 65 activated by the map program 66 due to the user's operation on the map program 66 executes the external activation process shown in FIG. Designation of the [Print] icon or [Fax transmission] icon is an example of a user operation to the map program 66 instructing to start the terminal program 65 . Details of the external activation process will be described with reference to FIG. Note that the external activation process may be executed when activated by a plug-in API formulated by the provider of the terminal program 65 instead of the explicit shared API.

First, the terminal program 65 acquires the specified data ID and specified action ID specified as arguments of the API executed by the map program 66 as specified information (S81). Then, the terminal program 65 temporarily stores the acquired specified data ID and specified action ID in the data storage area 62B. Here, it is assumed that the specified action ID "print" is acquired. Next, the terminal program 65 determines whether or not the designated device information is stored in the data storage area 62B (S82). The process of step S81 is an example of the acquisition process, and the process of step S82 is an example of the first determination process.

Next, in response to determining that the designated device information is stored (S82: Yes), the terminal program 65 causes the display unit 53 to display a preview screen, which is an example of the third screen (S84). Then, the terminal program 65 receives a user's operation on the preview screen through the operation unit 54 (S85). The process of step S84 is an example of the third display process, and the process of step S85 is an example of the acceptance process. On the other hand, in response to determining that the designated device information is not stored (S82: No), the terminal program 65 executes the second device selection process prior to the third display process (S83).

FIG. 15 is an example of a preview screen in the external activation process. The preview screen shown in FIG. 15 includes a preview image 165, a device icon 166, and a [Print] icon 167. FIG. The preview image 165 shows the specified action identified by the specified action ID acquired in step S81 with respect to the image data identified by the specified data ID acquired in step S81, identified by the device ID included in the specified device information. 10 is an image showing the result of execution by the specified device. The device icon 166 is an example of a device designation object. A [Print] icon 167 is an example of an execution instruction object corresponding to an instruction to execute a print operation, which is a designated operation. The screen layout of the preview screen in the external activation process differs from the screen layout of the preview screen in the standard activation process in that the device icon 166 is included.

Next, the terminal program 65 executes the processing from step S83 onward in response to receiving the specification of the device icon 166 through the operation unit 54 (S85: device icon). On the other hand, the terminal program 65 transmits print instruction information to the designated device through the communication unit 55 in response to receiving the designation of the [Print] icon 167 through the operation unit 54 (S85: [Print] icon) (S86). . The process of step S86 is an example of the execution instruction process, and may be the same as the process of step S55.

[Action and effect of the embodiment]
According to the above embodiment, the first device selection process is performed by specifying the device icon 128 before specifying the specified action. This makes it possible to provide the first lead wire for instructing the specified operation to the specified device selected from among the abundant options. On the other hand, the second device selection process is executed by designating an operation icon after designating a designated device, or by designating operation icons 121 to 124 and plug-in icons 126 and 127 before designating a designated device. be. This makes it possible to provide the second conductor for instructing the designated action to the designated device suitable for the designated action.

That is, the user intuitively selects which of the device icon 128, the operation icons 121 to 124, or the plug-in icons 126 and 127 is first specified, and the terminal program 65 is conscious of which device to specify. , and the second lead suitable for users who operate the terminal program 65 with an awareness of the operation to be executed by the designated device.

Further, according to the above embodiment, the action icons 121 to 124 included in the main screen are updated based on the designated device information updated by the first device selection process or the second device selection process. That is, in response to the switching of the designated device, it is possible to provide a lead for making use of the operations that can be performed by the new designated device. That is, a user who has designated a designated device through a first lead can be provided with a lead to all the actions that can be performed by the new designated device. In addition, the first lead wire for changing the specified device can be provided again to the user who specified the specified device through the first lead wire but did not see the action icons 121 to 124 corresponding to the action to be used. On the other hand, a user who selects a designated device through the second lead can be provided with a lead to other actions that can be executed by a new designated device, in addition to the designated actions that have already been designated.

Further, according to the above embodiment, the display layout of the device selection screen and the like are shared in the first device selection process and the second device selection process. Accordingly, it is possible to provide the same usability to both the user who selects the designated device through the first conductor and the user who selects the designated device through the second conductor. In other words, it is possible to provide usability in which a user who uses one conductor does not feel uncomfortable even when he uses the other conductor.

Further, according to the above-described embodiment, the user can select the specified device capable of performing the operation desired by the user immediately or later by the user's operation on the non-selected notification screen. A lead can be provided.

Further, according to the above-described embodiment, the device icon corresponding to the MFP 10 capable of executing at least one of the first support operation and the second support operation is displayed on the device selection screen of the first device selection process. . This allows the user to specify, through the first lead wire, the specifying device capable of executing at least one of the first support operation and the second support operation.

Further, according to the above embodiment, in the second device selection process when a plug-in icon is specified, it is possible to allow the user to preferentially select a specified device capable of executing many second support operations. Accordingly, it is possible to provide a third conductor suitable for causing the designated device to execute an operation on image data designated through the plug-in. Further, according to the above embodiment, the action identification images 137 to 139 are added to the device icons 135 and 136 on the device selection screen of the second device selection process. With this, it is possible to make the user aware of the second support operation that can be executed by the corresponding multi-function device 10, and to provide the third lead suitable for selecting the designated device.

However, in steps S41 and S42, the terminal program 65 may specify only the MFPs 10 that are capable of executing all of the specified operations. Then, the terminal program 65 may cause the user to designate one of the multifunction peripherals 10 capable of executing all of the plurality of designated operations as the designated device. On the other hand, in steps S41 and S42, the terminal program 65 may specify the multifunction device 10 capable of executing some of the plurality of designated actions when there is no multifunction device 10 capable of executing all of the designated actions. . Then, the terminal program 65 may allow the user to designate one of the multifunction peripherals 10 capable of executing some of the designated operations as the designated device.

Furthermore, according to the above embodiment, the second device selection process is executed prior to the third display process when the external activation process is executed in a state where the designated device information is not stored. As a result, it is possible to provide a suitable fourth lead for allowing the user to preferentially select a designated device capable of executing an operation supported by cooperation between the terminal program 65 and the activation source program.

Further, in the MFP 10 and the mobile terminal 50 of the above embodiment, various programs stored in the program storage areas 32A, 62A of the storage units 32, 62 are executed by the CPUs 31, 61, whereby the control unit of the present invention An example in which each process executed by is realized has been described. However, the configuration of the control unit is not limited to this, and part or all of it may be realized by hardware such as an integrated circuit (IC (abbreviation for Integrated Circuit)).

Furthermore, the present invention can be realized not only as the multi-function device 10 and the mobile terminal 50, but also as a program that causes the multi-function device 10 and the mobile terminal 50 to execute processing. The program may be recorded on a non-transitory recording medium and provided. The non-transitory recording medium may include a CD-ROM, a DVD-ROM, etc., and a storage unit installed in a server connectable to the MFP 10 and the portable terminal 50 via the communication network 101 . Then, the program stored in the storage unit of the server may be distributed through the communication network 101 such as the Internet as information or a signal indicating the program.

REFERENCE SIGNS LIST 10: MFP 11: Printer section 12: Scanner section 13: FAX sections 25, 55: Communication sections 31, 61: CPU
35... Device program 65... Terminal program 50... Portable terminal 53... Display unit 54... Operation unit 62... Storage unit

Claims (15)

A program readable by a mobile terminal comprising a communication unit, a display unit, an operation unit, and a storage unit,
a process of displaying a first screen on the display unit in order to receive a first operation specifying an operation of the image processing apparatus;
Designation by the first operation in response to receiving the first operation through the operation unit and storing designated device information identifying a designated device that is the image processing device designated in advance in the storage unit a process of displaying, on the display unit, a first image for receiving a second operation for causing the designated device to execute the specified action, which is the specified action;
displaying a second screen for receiving a third operation of designating the image processing device in response to the fact that the first operation is received through the operation unit and the designated device information is not stored in the storage unit; processing to display on the part,
a process of displaying on the display unit a second image for receiving a fourth operation for causing the image processing device specified by the third operation to perform the specified action;
When at least one of the first operation and the third operation is received through the operation unit, and the designated operation and the image processing device that executes the designated operation are determined, the first image or the A program for causing the portable terminal to execute, before displaying a second image, a process of displaying a screen for accepting a fifth operation of selecting data on the display unit. A program readable by a mobile terminal comprising a communication unit, a display unit, an operation unit, and a storage unit,
a process of displaying a first screen on the display unit in order to receive a first operation specifying an operation of the image processing apparatus;
Designation by the first operation in response to receiving the first operation through the operation unit and storing designated device information identifying a designated device that is the image processing device designated in advance in the storage unit a process of displaying, on the display unit, a first image for receiving a second operation for causing the designated device to execute the specified action, which is the specified action;
displaying a second screen for receiving a third operation of designating the image processing device in response to the fact that the first operation is received through the operation unit and the designated device information is not stored in the storage unit; processing to display on the part,
a process of displaying on the display unit a second image for receiving a fourth operation for causing the image processing device specified by the third operation to perform the specified action;
causing the mobile terminal to display a screen including a first object indicating that the image processing device is selected and a second object indicating that the image processing device is not selected;
the second image is displayed in response to receiving an operation designating the first object through the operation unit;
A program in which the first image is displayed in response to receiving an operation specifying the second object through the operation unit. In response to receiving at least one of the first operation and the third operation through the operation unit, the portable terminal executes a process of displaying a screen for accepting a fifth operation of selecting data on the display unit. 3. The program according to claim 2, which causes 4. The portable terminal according to claim 1, wherein in response to receiving the fifth operation through the operation unit, the mobile terminal executes a process of displaying on the display unit an image showing a result of the designated operation on the data. program. 5. The program according to any one of claims 1 to 4, which causes the portable terminal to execute a process for accepting designation of the condition of the designated operation. 6. The program according to claim 5, wherein when the specified operation is printing, the condition is at least one of the number of copies of paper and the layout of the image on the paper. 6. The program according to claim 5, wherein when said designated operation is scanning, said condition is at least one of a reading resolution and a storage location of data obtained by said scanning. In response to receiving the second operation through the operation unit, an instruction to execute the designated action is transmitted to the designated device through the communication unit, and in response to receiving the fourth operation through the operation unit, 8. The program according to any one of claims 1 to 7, causing the portable terminal to execute a process of transmitting an execution instruction of the specified action to the image processing device selected by the third operation through the communication unit. causing the mobile terminal to execute a process of searching for an image processing device that can communicate through the communication unit;
9. The program according to any one of claims 1 to 8, wherein the second screen is a screen for accepting the third operation specifying one of the searched image processing apparatuses through the operation unit. 10. The portable terminal according to any one of claims 1 to 9, wherein the identification information of the image processing device designated by the operation unit on the second screen is stored in the storage unit as the designated device information. program. causing the portable terminal to execute a process of acquiring action identification information indicating the action that can be performed by an image processing device that can communicate through the communication unit;
11. The program according to any one of claims 1 to 10, wherein the first screen includes action objects based on the action identification information. the first screen further includes a device object based on the designated device information when the designated device information is stored in the storage unit;
causing the portable terminal to execute a process of storing action identification information indicating the action in the storage unit in response to receiving the first operation, which is an operation specifying the action object, through the operation unit;
12. The first image according to claim 11, wherein the first image is displayed in response to receiving an operation specifying the device object through the operation unit and storing the action identification information in the storage unit. program. 12. The program according to any one of claims 1 to 11, wherein said first screen includes a device object based on said designated device information when said designated device information is stored in said storage unit. 12. Any one of claims 1 to 11, wherein when the specified device information is not stored in the storage unit, the first screen includes a device unspecified object corresponding to the fact that the specified device is not specified. program as described. A mobile terminal comprising a communication unit, a display unit, an operation unit, and a storage unit,
a process of displaying on the display unit a screen for accepting a first operation specifying an operation of the image processing apparatus;
Designation by the first operation in response to receiving the first operation through the operation unit and storing designated device information identifying a designated device that is the image processing device designated in advance in the storage unit a process of displaying, on the display unit, a first image for receiving a second operation for causing the designated device to execute the specified action, which is the specified action;
a screen for accepting a third operation of designating the image processing device is displayed on the display unit in response to the fact that the first operation is received through the operation unit and the designated device information is not stored in the storage unit; processing to display,
a process of displaying on the display unit a second image for receiving a fourth operation for causing the image processing device to perform the designated action specified through the operation unit in the third operation;
When at least one of the first operation and the third operation is received through the operation unit, and the designated operation and the image processing device that executes the designated operation are determined, the first image or the and a process of causing the display unit to display a screen for accepting a fifth operation of selecting data before displaying the second image.

Images