JP6575267B2 - Mobile terminal and program - Google Patents

Description

  The present invention relates to a program that causes an image output apparatus to execute an output operation on image data, and a portable terminal that executes the program.

  Conventionally, a program for causing a printer to execute an operation on image data is known. For example, Patent Literature 1 discloses an application that allows a user to specify image data stored in a mobile terminal and cause a printer to print an image indicated by the specified image data.

  In addition, printers in recent years are used not only for personal use but also for business purposes. Therefore, assuming that a printer used for business purposes is shared by a plurality of users, for each of a plurality of operations that can be executed by the printer, the execution of the operation is restricted and the operation is restricted. There is a case where a function that can be switched to an executable state is implemented.

JP 2012-203742 A

  The application described in Patent Document 1 cannot recognize whether the operation of the image output apparatus is in the locked state. Therefore, there is a case where the operation is not executed by the image output apparatus even though a user operation such as designation of image data is executed. In addition, the application cannot notify the user of the reason why the operation is not executed by the image output apparatus.

  The present invention has been made in view of the above circumstances, and a purpose thereof is a program for causing an image output device to execute an output operation on image data in accordance with a user operation, and the execution of the output operation in the image output device is limited. It is an object of the present invention to provide a program having an interface that allows a user to recognize whether or not a user has been executed.

  The program described in this specification can be read by a portable terminal including a communication unit, a storage unit, a display unit, and an operation unit. The communication unit can communicate with an image output apparatus capable of executing an output operation on image data. The storage unit stores an activation source program and can store device identification information for identifying a designated device that is one of the image output devices. The program is activated from the activation source program due to a user operation on the activation source program, and accepts a user operation for designating an object displayed on the display unit through the operation unit And acquisition processing for acquiring specified data information and specified operation information is executed by the portable terminal. The designated data information is information for identifying first designated data designated by the activation source program through the operation unit. The designated operation information is information for identifying a first designated operation that the image output apparatus performs on the first designated data. The program includes: a state request process for transmitting lock state request information for requesting lock state information to the designated device through the communication unit; and a state reception process for receiving the lock state information from the designated device through the communication unit; A determination process for determining whether the received lock state information indicates a lock state that restricts execution of the first designated operation or an unlocked state that does not restrict execution of the first designated operation; and the lock state In response to determining that the information indicates the unlocked state, the portable terminal is caused to execute a first display process for displaying a first screen including a first output instruction object on the display unit. The program performs a first output instruction process for transmitting first output instruction information to the designation device through the communication unit in response to accepting a user operation for designating the first output instruction object in the acceptance process. Run on a mobile device. The first output instruction information is information for executing the first designation operation on the first designation data. In response to determining that the lock state information indicates the lock state, the program executes notification processing for notifying that the execution of the first designated operation is restricted in the designated device to the mobile terminal. Let

  The mobile terminal described in this specification includes a communication unit, a storage unit, a display unit, an operation unit, and a control unit. The communication unit can communicate with an image output apparatus capable of executing an output operation on image data. The storage unit stores an activation source program and an output program, and can store device identification information for identifying a designated device that is one of the image output devices. The control unit that executes the output program activated from the activation program due to a user operation on the activation source program receives a user operation for designating an object displayed on the display unit through the operation unit. A reception process and an acquisition process for acquiring specified data information and specified operation information are executed. The designated data information is information for identifying first designated data designated by the activation source program through the operation unit. The designated operation information is information for identifying a first designated operation that the image output apparatus performs on the first designated data. The control unit transmits lock state request information for requesting lock state information to the designated device through the communication unit, and state reception processing receives the lock state information from the designated device through the communication unit. A determination process for determining whether the received lock state information indicates a locked state that restricts execution of the first designated operation or an unlocked state that does not restrict execution of the first designated operation; and the lock In response to determining that the state information indicates the unlocked state, a first display process for displaying a first screen including a first output instruction object on the display unit is executed. The control unit performs a first output instruction process for transmitting first output instruction information to the designation device through the communication unit in response to receiving a user operation for specifying the first output instruction object in the reception process. Execute. The first output instruction information is information for executing the first designation operation on the first designation data. In response to determining that the lock state information indicates the lock state, the control unit executes a notification process for notifying that the execution of the first designated operation is restricted in the designated device.

  The program of the present invention informs whether or not the designated operation is locked in the designated device in response to being activated due to the operation of the activation source program by the user of the portable terminal. It is possible to recognize whether or not execution of the designated operation is restricted in the designated device.

FIG. 1 is a schematic configuration diagram of a system 100 according to the embodiment. 2A is a block diagram of the multifunction device 10, and FIG. 2B is a block diagram of the portable terminal 50. FIG. 3 shows an example of information stored in the data storage areas 32B and 62B. (A) shows an SFL list, (B) shows a FAX list, and (C) shows a device information record. FIG. 4 is a flowchart of the standard activation process. FIG. 5 is a flowchart of device selection processing. FIG. 6 is a flowchart of the printing process. FIG. 7 is a flowchart of FAX processing. FIG. 8 is a flowchart of FAX transmission processing. FIG. 9 is a flowchart of the FAX preview process. FIG. 10 is a flowchart of the external activation process. FIG. 11 is a display example of the display unit 53, where (A) shows a menu screen and (B) shows a main screen. FIG. 12 is a display example of the display unit 53, where (A) shows device selection, and (B) shows an error screen 135 superimposed on the main screen. 13A and 13B are display examples of the display unit 53, where FIG. 13A shows a data selection screen and FIG. 13B shows a preview screen. FIG. 14 is a display example of the display unit 53, where (A) shows an operation selection screen and (B) shows a FAX transmission screen. 15A and 15B show display examples of the display unit 53, where FIG. 15A shows a FAX selection screen and FIG. 15B shows a FAX preview screen. 16A and 16B are display examples of the display unit 53, where FIG. 16A shows a preview screen and FIG. 16B shows a device selection screen. FIG. 17 is a display example of the display unit 53, where (A) shows the error screen 170 superimposed on the device selection screen, and (B) shows the preview screen. FIG. 18 is a diagram for explaining a sharing function realized by the sharing API.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it is needless to say that the embodiment of the present invention can be changed as appropriate without departing from the gist of the present invention.

  FIG. 1 is a schematic diagram of a system 100 according to the first embodiment. A system 100 illustrated in FIG. 1 includes multifunction devices 10A and 10B (hereinafter, these may be collectively referred to as “multifunction device 10”) and a portable terminal 50. The multifunction device 10 and the portable terminal 50 are configured to be able to communicate through the communication network 101. The communication network 101 may be, for example, a wired LAN (abbreviation of Local Area Network), a wireless LAN, or a combination thereof.

[Multifunction machine 10]
As shown in FIG. 2A, the multifunction machine 10 includes a printer unit 11, a scanner unit 12, a FAX unit 13, a display unit 23, an operation unit 24, a communication unit 25, and a mounting unit 26. , CPU (abbreviation of Central Processing Unit) 31, storage unit 32, and communication bus 33 are mainly provided. Each component constituting the multi-function device 10 is connected to each other through a communication bus 33. The multifunction machine 10 is an example of an image processing apparatus or an image output apparatus.

[Printer unit 11, scanner unit 12, FAX unit 13]
The printer unit 11 executes a print operation for recording an image indicated by the image data on a recording sheet. The recording paper is an example of a sheet or a recording medium. As a recording method of the printer unit 11, a known method such as an ink jet method or an electrophotographic method can be adopted. The scanner unit 12 performs a scanning operation for reading an image recorded on a document and generating image data. The FAX unit 13 performs a FAX transmission operation and a FAX reception operation for transmitting and receiving image data by a method compliant with the FAX protocol. The printer unit 11, the scanner unit 12, and the FAX unit 13 are examples of operation units.

  Of the plurality of operations described above, the printing operation and the FAX transmission operation are examples of an output operation for outputting image data. The output operation executed by the multifunction machine 10 is not limited to these. As an example of the output operation, the multi-function device 10 may execute a media storage operation for storing image data acquired from the mobile terminal 50 in a portable storage medium attached to the attachment unit 26. As another example of the output operation, the multifunction machine 10 may execute a FAX preview operation for transmitting the image data to the portable terminal 50 in order to display an image indicated by the image data received in the FAX reception operation. . In addition, the scanning operation and the FAX receiving operation among the plurality of operations described above are examples of a forming operation for forming image data.

  Further, the multifunction machine 10 may be capable of executing a composite operation that combines a plurality of operations. For example, a copy operation in which image data generated in a scan operation is recorded on a recording sheet in a print operation, a scan FAX operation in which image data generated in a scan operation is FAX-transmitted in a FAX transmission operation, and image data received by FAX in a FAX reception process A scan print operation for recording on a recording sheet by a print operation is an example of a combined operation.

  Operations that can be executed by the multifunction peripherals 10A and 10B may be different. In the first embodiment, the MFP 10A can execute a print operation, a scan operation, a FAX transmission operation, a FAX reception operation, a FAX preview operation, and a copy operation. The MFP 10B performs a print operation, a FAX transmission operation, and a FAX reception operation. It shall be executable. Further, the image processing apparatus or the image output apparatus is not limited to an apparatus capable of executing a plurality of operations, and may be capable of executing only a single operation.

  In the MIB (abbreviation of Management Information Base) of the multifunction device 10, for example, a device ID for identifying the multifunction device 10 and an operation ID for identifying an operation that can be executed by the multifunction device 10 may be defined. . The device ID is an example of device identification information, and the operation ID is an example of operation identification information. In the first embodiment, the MFP 10A is identified by a device ID “MFP-A”, and the MFP 10B is identified by a device ID “MFP-B”. Hereinafter, the device ID and operation ID registered in the MIB may be referred to as “device information”.

[Display unit 23]
The display unit 23 includes a display screen that displays various types of information. As the display unit 23, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be adopted.

[Operation unit 24]
The operation unit 24 receives a user operation for specifying an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Further, the operation unit 24 may include a film-like touch sensor superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display.

  The “object” refers to an image that can be designated by the user operating the operation unit 24. As an example, the object is a character string displayed on the display unit 23. One of the objects is highlighted when the direction key of the operation unit 24 is pressed, and the object is highlighted by pressing the enter button of the operation unit 24. A light-displayed object may be designated. As another example, the object when the operation unit 24 is a touch panel is an icon, a button, a link, or the like displayed on the display unit 23, and the object displayed at the touch position may be designated.

  The operation unit 24 realized as a touch panel receives a user operation for touching the display screen of the display unit 23. The operation unit 24 outputs position information indicating the position on the display screen touched by the user. The position information can be expressed, for example, as coordinates (x, y) on the xy plane with the upper left corner of the display screen as the origin, the right direction as the positive direction of the x axis, and the downward direction as the positive direction of the y axis. For the touch sensor, a known method such as a capacitance method or a resistance film method can be adopted.

  Note that “touch” in this specification includes all operations for bringing an input medium into contact with a display screen. That is, a tap operation to move the touched input medium away from the display screen within a predetermined time, a long touch operation to make the touched input medium stand still on the display screen, a slide operation to slide the touched input medium on the display screen, a display screen Flick operation where the acceleration of the input medium sliding above the threshold is more than a threshold, pinch-in operation to slide two input media touched at different positions on the display screen toward each other, two touched at different positions on the display screen A pinch-out operation or the like that slides the input medium away from each other is an example of a touch.

  In addition, even if the input medium is not touching the display screen, the concept of “touch” may include bringing the input medium close to a position where the distance from the display screen is very small. Furthermore, the input medium may be a user's finger or a touch pen. Hereinafter, the tap of the position of the icon displayed on the display unit 53 will be described as an example of a user operation for designating the icon.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 101. That is, the multifunction machine 10 outputs various information to the mobile terminal 50 through the communication unit 25 and receives various data or various information from the mobile terminal 50 through the communication unit 25. Although the specific communication procedure of the communication part 25 is not specifically limited, For example, Wi-Fi (registered trademark of Wi-Fi Alliance) is employable.

[Mounting part 26]
The mounting unit 26 is an interface to / from which a portable storage medium is attached / detached. The CPU 31 can read data or information from the portable storage medium attached to the attachment unit 26 or write data or information to the portable storage medium attached to the attachment unit 26. Although the specific example of a portable storage medium is not specifically limited, For example, USB memory, SD card, CD-ROM, DVD-ROM etc. may be sufficient.

[CPU 31]
The CPU 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires and executes various programs, which will be described later, from the storage unit 32 based on various information output from the operation unit 24 and various information acquired from an external device through the communication unit 25. That is, the CPU 31 and the storage unit 32 constitute an example of a control unit.

[Storage unit 32]
The storage unit 32 includes a program storage area 32A and a data storage area 32B. In the program storage area 32A, an OS (abbreviation of Operating System) 34 and a device program 35 are stored. The device program 35 may be a single program or an aggregate of a plurality of programs. Data or information necessary for executing the device program 35 is stored in the data storage area 32B.

  Note that “data” and “information” in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by the computer without taking into account the meaning of each bit. On the other hand, “information” refers to information that the operation of the computer branches depending on the semantic content indicated by each bit. Furthermore, the “instruction” is a control signal for prompting the destination apparatus to perform the next operation, and may include information or itself has a property as information. There is also.

  In addition, even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer, “data” and “information” have the same data and information as long as they are recognized as the same meaning content. Are treated as For example, information indicating “two” is stored as text information “0x32” in ASCII code in one computer, and binary format information “10” in binary notation in another computer. May be.

  However, the distinction between the above “data” and “information” is not strict, and exceptional handling is allowed. For example, data may be temporarily treated as information, or information may be temporarily treated as data. Also, what is handled as data in a certain device may be handled as information in another device. Furthermore, information may be extracted from the data, or data may be extracted from the information.

  The storage unit 32 includes, for example, RAM (abbreviation of Random Access Memory), ROM (abbreviation of Read Only Memory), EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), HDD (abbreviation of Hard CPU) 31 (HDD). It is configured by a buffer or the like or a combination thereof.

  The storage unit 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROM and DVD-ROM in addition to the above examples. A non-transitory medium is also a tangible medium. On the other hand, an electrical signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage. Not included in the media.

  The program stored in the program storage area 32A is executed by the CPU 31. However, in this specification, the operation of each program may be described with the CPU 31 omitted. That is, in the following description, the description that “the program A executes the process A” may indicate that “the CPU 31 executes the process A described in the program A”. The same applies to the portable terminal 50 described later.

  Further, the program stored in the program storage area 32A determines an event and operates according to the determination result. However, in this specification, the operation of each program may be described by omitting the determination. That is, in the following description, the description that “the program executes the process A according to the condition A” is “determining whether or not the program is the condition A. The program is a positive determination. The processing A may be executed according to the above. The same applies to the portable terminal 50 described later.

  The program stored in the program storage area 32A identifies, acquires, extracts, or selects data and the like. For example, the program specifies data, etc., for example, specifies data that satisfies a condition from a plurality of data, and stores the data itself or information for identifying the data in a predetermined storage area. Refers to the process to be memorized. The information for identifying data or the like is, for example, identification information for identifying the data or the like, an index of an array in which the data or the like is stored, a pointer of a storage area in which the data or the like is stored, or the like. The same applies to the process in which the program acquires, extracts, or selects data. The same applies to the portable terminal 50 described later.

  The OS 34 is an API (Application) for controlling the printer unit 11, the scanner unit 12, the FAX unit 13, the display unit 23, the operation unit 24, the communication unit 25, the mounting unit 26, and the like, which are hardware constituting the multifunction machine 10. This is a basic program that provides Programming Interface. That is, each of the above programs controls each hardware by calling an API provided by the OS 34. However, in this specification, the operation of each program may be described with the OS 34 omitted. That is, in the following description, the description “the program B controls the hardware C” may refer to “the program B controls the hardware C through the API of the OS 34”. The same applies to the portable terminal 50 described later.

  As shown in FIG. 3A, the data storage area 32B stores an operation ID and SFL (abbreviation of Secure Function Lock) information associated with the operation ID. Hereinafter, the entire information shown in FIG. 3A may be referred to as “SFL list”, and the operation ID and SFL information associated with each other in the SFL list may be referred to as “SFL record”. FIG. 3A shows an example of the SFL list of the multifunction machine 10A. The SFL list may not include the SFL record of the composite operation, or may include the SFL record of the composite operation separately from the SFL records of the plurality of operations constituting the composite operation.

  The operation ID corresponds to an operation that can be executed by the multifunction machine 10. That is, the SFL list includes the same number of SFL records as the number of operations that can be executed by the multifunction machine 10. The SFL information is an example of lock state information indicating whether or not the operation indicated by the corresponding operation ID is restricted. In the SFL information, either a “lock state” indicating that the corresponding operation is restricted or a “non-lock state” indicating that the corresponding operation is not restricted is set. The SFL information indicates whether the operation indicated by the corresponding operation ID is currently locked or unlocked in the multifunction machine 10.

  The “non-locked state” refers to a state in which the operation is executed in response to receiving an operation execution instruction through the operation unit 24 or the communication unit 25, for example. On the other hand, the “locked state” refers to a state where the operation is not executed even if an operation execution instruction is received through the operation unit 24 and the communication unit 25. Alternatively, the “locked state” is a state in which an operation is executed according to an execution instruction received through one of the operation unit 24 and the communication unit 25 and an operation is not executed according to an execution instruction received through the other of the operation unit 24 and the communication unit 25. Good. Then, the device program 35 of the multifunction machine 10 can accept a user operation for changing SFL information associated with each operation ID through the operation unit 24.

  As an example, when the printing operation is in the locked state, the device program 35 displays an error screen indicating that the printing operation cannot be executed without executing the printing operation in response to receiving the instruction to execute the printing operation. You may display on the display part 23. FIG. However, the locked state is not limited to a state where the corresponding operation cannot be executed at all, and may be a state where a part of the corresponding operation cannot be executed. For example, a state in which monochrome printing can be performed but color printing cannot be performed is an example in which the printing operation is locked.

  As another example, when the printing operation is in the locked state, the apparatus program 35 stores the image data to be printed in the data storage area 32B in response to receiving the printing operation execution instruction. May be. Then, the device program 35 executes a printing operation on the printer unit 11 for the image data stored in the data storage area 32B in response to receiving an input of a PIN (abbreviation of Personal Identification Number) through the operation unit 24. You may let them. As described above, the lock state is not limited to a state in which a certain operation is restricted so that all users cannot execute the multifunction device 10, and a certain operation is given to some users (for example, a PIN is given). It may be limited so that only the (user) can execute the MFP 10.

  As another example, when the printing operation is in an unlocked state, the apparatus program 35 may cause the display unit 53 to display an icon corresponding to an instruction for executing the printing operation. Then, the device program 35 may cause the printer unit 11 to execute a printing operation in response to accepting selection of the icon through the operation unit 24. On the other hand, when the printing operation is in the locked state, the device program 35 does not have to display the icon corresponding to the execution instruction for the printing operation on the display unit 53. That is, the “locked state” may be a state in which an instruction to execute a corresponding operation is not accepted.

  As yet another example, the SFL information may change in conjunction with the login state or non-login state of the multifunction machine 10. The login state is a state in which, for example, only operation permitted for the user to whom the account information is given can be executed when the account information is input to the multifunction machine 10. The non-login state is a state in which, for example, account information has not been input to the multi-function peripheral 10 and only operations permitted to both users who have been given account information and users who have not been given account information can be executed. is there. Further, the operation permitted to be executed in the login state may be different depending on the input account information. For example, only the print operation is permitted in the non-login state, only the print operation and the FAX transmission operation are permitted in the login state using the general account information, and all operations are permitted in the login state using the administrator account information. Also good.

  In the SFL list in the non-login state, the SFL information corresponding to the printing operation may be “unlocked”, and the SFL information corresponding to other operations may be “locked”. In the SFL list in the login state using the general account information, the SFL information corresponding to the print operation and the FAX transmission operation is “unlocked”, and the SFL information corresponding to other operations is “locked”. It may be. That is, all users can cause the multifunction device 10 to execute a printing operation through the operation instruction program 65 described later, regardless of whether the multifunction device 10 is in a login state or a non-login state. In addition, the user who is given general account information can cause the multi-function peripheral 10 to execute a FAX transmission operation through the operation instruction program 65 by inputting the general account information and setting the multi-function peripheral 10 in a login state.

  Further, in the SFL list in the login state using the administrator account information, the SFL information corresponding to all the operations may be “unlocked”. In other words, an administrator who has received an inquiry from a user who has seen an error screen, which will be described later, inputs an administrator account and places the multifunction device 10 in a login state, thereby causing the multifunction device 10 to execute an operation through the operation instruction program 65. This can be temporarily permitted to the user.

  Further, as shown in FIG. 3B, the data storage area 32B can store FAX specifying information and FAX data associated with the FAX specifying information. Hereinafter, the entire information shown in FIG. 3B may be referred to as “FAX list”, and the FAX specifying information and the FAX data associated with each other in the FAX list may be referred to as “FAX record”. That is, the FAX list can include a plurality of FAX records. FIG. 3B shows an example of a FAX list of the multifunction machine 10A.

  The FAX data is image data that is received by the MFP 10A from the external device via the FAX unit 13. The FAX specifying information is information for allowing the MFP 10A to individually specify FAX data. The FAX identification information is, for example, a data ID that is data identification information for causing the MFP 10A to identify FAX data, a reception date and time of FAX data identified by the data ID, and transmission of FAX data identified by the data ID. A sender telephone number that identifies the origin.

  The apparatus program 35 of the multifunction machine 10A adds a FAX record to the FAX list in response to executing the FAX reception operation. More specifically, the apparatus program 35 receives FAX data and a transmission source telephone number from an external apparatus through the FAX unit 13 by FAX reception operation. Further, the apparatus program 35 generates a unique data ID in the FAX list in response to executing the FAX reception operation, and acquires the reception date and time from a system clock (not shown). Then, the apparatus program 35 adds a FAX record including these to the FAX list. Note that the FAX reception operation is automatically executed by the multifunction peripheral 10A regardless of an instruction from the portable terminal 50 or the like.

  The device program 35 can read, edit, or delete data stored in the data storage area 32B by executing an access API provided by the OS 34. In the access API, a data ID for identifying data to be accessed is designated as an argument. The data ID is information in a format used for designating data in the access API. The data ID is, for example, a file path or a URI. On the other hand, part or all of the data stored in the data storage area 32B may be stored in an external server (not shown) such as a cloud server. That is, the device program 35 may transmit various data to the external server through the communication unit 25 and receive various data from the external server through the communication unit 25. The data ID in this case may be in the form of a URL for downloading data from an external server, for example. The same applies to the portable terminal 50.

[Portable terminal 50]
As shown in FIG. 2B, the mobile terminal 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 61, a storage unit 62, and a communication bus 63. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the portable terminal 50 are the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, Since it is the same structure as the memory | storage part 32 and the communication bus 33, description is abbreviate | omitted. The CPU 61 and the storage unit 62 are an example of a control unit.

  The mobile terminal 50 is, for example, a mobile phone, a smartphone, or a tablet terminal. More specifically, it is desirable that the display unit 53 of the mobile terminal 50 has a display screen size of 12 inches or less, more preferably 8 inches or less. The operation unit 54 of the portable terminal 50 is preferably a touch panel overlaid on the display screen of the display unit 53.

  The program storage area 62A of the storage unit 62 stores an OS 64, an operation instruction program 65, and a map program 66. The data storage area 62B can store the device information record shown in FIG. Further, a data folder may be provided in the data storage area 62B. For example, photo data, document data, presentation data, spreadsheet data, and the like may be stored in the data folder.

  As shown in FIG. 3C, the device information record includes a device ID and operation information associated with the device ID. The device ID corresponds to one of a plurality of multifunction peripherals 10A and 10B with which the mobile terminal 50 can communicate. The operation information includes an operation ID of an operation that can be executed by the MFP 10 identified by the corresponding device ID. The device information record is not stored in the data storage area 62B when the operation instruction program 65 is installed in the portable terminal 50, but is stored in the data storage area 62B by a device selection process described later.

  The display unit 53 of the portable terminal 50 is divided into a common display area 80 and a program display area 81 as shown in FIGS. Regardless of the display contents of the program display area 81, the OS 64 displays a status bar in the common display area 80. Various information is displayed on the status bar by the OS 64. In the status bar, for example, the title of the screen displayed in the program display area 81, the icon indicating the remaining battery level of the mobile terminal 50, the icon indicating the communication state of the communication unit 55, the push received by the mobile terminal 50 from the external service An icon or the like indicating notification is displayed. In the program display area 81, a screen generated by a program executed in the foreground is displayed.

  Hereinafter, when it is described that “the program displays the screen on the display unit 53”, the program screen is displayed in the program display area 81 and the status bar is displayed in the common display area 80. The program screen is a screen displayed in the program display area 81 in accordance with a program instruction. However, the display unit 53 can be switched between a partial screen mode in which the display area is divided into a common display area 80 and a program display area 81 and a full screen mode in which the entire display area is the program display area 81. Also good.

  The OS 64 may be, for example, Android (registered trademark of Google Inc.) OS, iOS (registered trademark of Cisco Systems, Inc.), Windows Phone (registered trademark of Microsoft Corporation) Operating System, or the like. The OS 64 can execute a plurality of programs installed in the portable terminal 50 in parallel. The plurality of programs are virtually executed in parallel by, for example, time division multiplexing. The OS 64 executes one of a plurality of programs executed in parallel in the foreground, and executes the other programs in the background.

  The foreground is a state in which, for example, a program screen resulting from the execution of the program is displayed in most of the display area of the display unit 53. The “most part of the display area” may refer to the program display area 81, for example. The background is a state in which, for example, a program screen resulting from execution of a program different from the program is displayed in a large part of the display area of the display unit 53. In other words, the portable terminal 50 can cause the display unit 53 to display only a program screen that depends on the execution of a program that is executed in the foreground among a plurality of programs that are executed in parallel.

  The operation instruction program 65 is a program that causes a designated device to execute a designated operation on designated data. The designated data refers to image data designated by the user. The designated operation indicates an operation designated by the user. The designated device refers to the multifunction device 10 designated by the user. The operation instruction program 65 can accept specified data, a specified operation, and a user operation for specifying a specified device through the operation unit 54. In addition, the operation instruction program 65 can acquire at least one of the designated data ID, the designated operation ID, and the designated device ID from the map program 66. The designated data ID is an example of designated data information for identifying the designated data, the designated operation ID is an example of designated operation information for identifying the designated operation, and the designated device ID is a designation for identifying the designated device. It is an example of apparatus information.

  The map program 66 accepts a user operation for designating at least one of designated data, a designated operation, and a designated device, and designates at least one of the designated data ID, the designated operation ID, and the designated device ID to specify the operation instruction program 65. It is an example of the starting source program which starts. The map program 66 according to the first embodiment causes the user to specify an arbitrary area of the map image, and provides the operation instruction program 65 with image data indicating the map image of the specified area. The specific example of the activation source program is not limited to the map program 66, and may be, for example, a paint program that edits an image in accordance with a user operation and delivers image data indicating the edited image to the operation instruction program 65.

  The map program 66 activates the operation instruction program 65 as a so-called plug-in, for example. More specifically, the map program 66 executes the plug-in API for starting the application as a plug-in using the information specifying the operation instruction program 65, the URI, and the designation information as arguments, and thereby the operation instruction program 65 Start up. The argument specified by the plug-in API may be, for example, intent format information used in the Android OS. As another example, the map program 66 activates the operation instruction program 65 by executing an explicit sharing API described later. The argument specified by the explicit sharing API may be common to the plug-in API.

  The OS 64 provides a sharing function for starting the second program designated by the first program and providing the second program with the designation information designated by the first program for the program installed in the portable terminal 50. For example, the first program can use a shared function by executing an API provided by the OS 64 (hereinafter referred to as “shared API”). More specifically, the first program executes the shared API with the program ID of the second program and the designation information as arguments. Details of the sharing function will be described with reference to FIG.

  First, the sharing source application 41 executes the sharing API of the OS 64 for realizing the sharing function (S1). To execute the implicit sharing API, at least a URI (abbreviation of Uniform Resource Identifier), a type, and an action are obtained as arguments. The argument may be intent format information, for example. The sharing source application 41 may include other information in the argument of the implicit sharing API. The URI is information indicating the location of the shared data. The type is information indicating the data format of the shared data. The action is information indicating the type of processing (for example, browsing, editing, transmission, printing, etc.) for shared data to be executed by the sharing destination application. The URI, type, and action are examples of designation information provided from the sharing source application to the request destination application.

  On the other hand, the applications 42, 43, 44,... That are candidates for sharing destination applications declare in advance to the OS 64 the data format of the shared data that can be processed and the types of processing that can be executed. Therefore, the OS 64 identifies (S2) an application that can execute the process indicated by the action on the shared data in the data format indicated by the type from among the applications 42, 43, 44,. A list of applications is displayed on the display unit 53 (S3). Then, the OS 64 stands by in a state where a user operation for specifying one of the listed applications can be accepted through the operation unit 54 (S4).

  Next, in response to accepting a user operation for designating one of the listed applications through the operation unit 54 (S4), the OS 64 starts the application with the URI, type, and action as arguments. (S5). In the following embodiment, the map program 66 corresponds to the application 41 in FIG. 18, and the operation instruction program 65 corresponds to one of the applications 42 to 44 in FIG.

  Note that the processing in steps S2 to S5 may be executed by a sharing source application. In this case, in step S2, the sharing source application acquires, from the OS 64, information specifying an application that can execute the process indicated by the action on the shared data in the data format indicated by the type. In step S5, the sharing source application starts the application specified by the user operation by executing the explicit sharing API with the information, URI, type, and action specifying the application acquired from the OS 64 as arguments. Can be made. The sharing source application 41 may include other information in the argument of the explicit sharing API.

  Alternatively, the sharing source application executes an explicit sharing API using information, URI, type, and action specifying a predetermined application as arguments in response to the user's instruction to use the sharing function. In this way, a predetermined sharing destination application may be activated. In the first embodiment, for example, the operation instruction program 65 may be set as a predetermined sharing destination application in the map program 66 that is a sharing source application. More specifically, information for specifying the operation instruction program 65 may be described in a setting file that the map program 66 refers to at the time of start-up or the source code of the map program 66.

[Operation of System 100]
The operation of the system 100 according to the first embodiment will be described with reference to FIGS. In the system 100 according to the first embodiment, the portable terminal 50 receives designation data, a designation operation, and a user operation for designating a designation device, and causes the multifunction peripheral 10 that is the designation device to execute a designation operation for the designation data.

  First, the OS 64 of the portable terminal 50 displays a menu screen on the display unit 53 and displays a status bar in the common display area 80. FIG. 11A shows an example of a menu screen. The menu screen shown in FIG. 11A includes a plurality of program icons 111, 112, 113, 114, 115. The program icons 111 to 115 correspond to programs installed on the mobile terminal 50. For example, the program icon 114 corresponds to the operation instruction program 65, and the program icon 115 corresponds to the map program 66.

  Then, the OS 64 receives one designation of the program icons 111 to 115 through the operation unit 54. The OS 64 activates the operation instruction program 65 in response to receiving the designation of the program icon 114 through the operation unit 54, and executes the operation instruction program 65 in the foreground. The designation of the program icon 114 is an example of a user operation that instructs activation of the operation instruction program 65.

  The operation instruction program 65 of the portable terminal 50 executes standard activation processing in response to activation from the OS 64 due to the OS 64 receiving the designation of the program icon 114 through the operation unit 54. The operation instruction program 65 displays various screens for accepting a user operation for designating at least one of designated data, a designated operation, and a designated device in the standard activation process, and accepts a user operation through the screen. Then, the operation instruction program 65 causes the designation device to execute a designation operation on the designation data. Details of the standard activation process will be described with reference to FIG.

[Standard startup processing]
First, the operation instruction program 65 determines whether a device information record is stored in the data storage area 62B (S11). Then, in response to determining that the device information record is stored in the data storage area 62B (S11: Yes), the operation instruction program 65 reads the device information record from the data storage area 62B. Further, the operation instruction program 65 temporarily stores the device ID “MFP-A” included in the device information record in the data storage area 62B as the designated device ID.

  Next, the operation instruction program 65 transmits SFL request information to the multifunction machine 10A, which is a designated device, through the communication unit 55 (S12). The SFL request information is an example of lock state request information for requesting transmission of SFL information. The SFL request information includes an operation ID. The SFL request information transmitted in step S12 includes one of operation IDs included in the device information record. The process in step S12 is an example of a status request process.

  Although not shown, the device program 35 of the multifunction machine 10 </ b> A receives SFL request information from the portable terminal 50 through the communication unit 25. Next, the device program 35 reads SFL information corresponding to the operation ID included in the received SFL request information from the SFL list. Then, the device program 35 transmits the read SFL information to the mobile terminal 50 through the communication unit 25. SFL information is an example of lock state information.

  Next, the operation instruction program 65 receives SFL information from the multifunction machine 10A through the communication unit 55 (S13: Yes). Further, the operation instruction program 65 may temporarily store the received SFL information in the data storage area 62B for use in each process described later. Next, the operation instruction program 65 determines a display mode of icons to be included in the main screen based on the received SFL information (S14 to S17). The operation instruction program 65 repeatedly executes the processes of steps S12 to S17 until the display mode of all icons is determined. On the other hand, when the operation instruction program 65 determines that the device information record is not stored in the data storage area 62B (S11: No), the process of steps S12 to S18 is skipped, and the processes after step S19 are performed. Execute. The process of step S13 is an example of a status reception process, and the processes of steps S14 to S17 are an example of a first determination process.

  Note that while the main screen is displayed, the operation instruction program 65 periodically executes processing equivalent to S12 to S18 in the background to determine the display mode of the icons displayed on the main screen. . When the operation instruction program 65 determines that the display mode of all the operation icons has been determined in the background (S18: Yes), the icon displayed on the main screen is displayed in the newly determined display mode. Switch to.

  Here, the processing of steps S12 to S18 will be described more specifically. In step S12, the operation instruction program 65 includes SFL request information including an operation ID “print”, SFL request information including an operation ID “scan”, SFL request information including an operation ID “FAX transmission”, and an operation ID “FAX preview”. SFL request information including "" is transmitted to the multi function device 10A in an arbitrary order. In addition, the operation instruction program 65 repeatedly executes SFL information corresponding to the operation ID “print”, SFL information corresponding to the operation ID “scan”, SFL information corresponding to the operation ID “FAX transmission”, SFL information corresponding to the operation ID “FAX preview” is received from the MFP 10A.

  Next, in response to the fact that the SFL information corresponding to the operation ID “print” indicates the unlocked state (S14: No), the operation instruction program 65 does not add the key image 126 to the operation icon 121 of the print operation (S15). ). On the other hand, the operation instruction program 65 adds the key image 126 to the operation icon 121 of the print operation in response to the SFL information corresponding to the operation ID “print” indicating the locked state (S14: Yes) (S16). The same applies to the operation icon 122 of the scan operation.

  Also, the operation instruction program 65 responds to the fact that the SFL information corresponding to both the operation ID “print” and the operation ID “scan” indicates a locked state (S14: No), and displays the key image on the operation icon 123 of the copy operation. 126 is not added (S15). On the other hand, in response to the fact that the SFL information corresponding to at least one of the operation ID “print” and the operation ID “scan” indicates the locked state (S14: Yes), the operation instruction program 65 locks the operation icon 123 for the copy operation. The image 126 is added (S16). The print operation is an example of a first operation, and the scan operation is an example of a second operation.

  Further, the operation instruction program 65 responds to the fact that the SFL information corresponding to at least one of the operation ID “FAX transmission” and the operation ID “FAX preview” indicates the unlocked state (S14: No), and the operation icon of the FAX operation. The key image 126 is not added to 124 (S15). On the other hand, in response to the fact that the SFL information corresponding to both the operation ID “FAX transmission” and the operation ID “FAX preview” indicates the locked state (S14: Yes), the operation instruction program 65 displays the operation icon 124 of the FAX operation. A key image 126 is added (S16). The FAX transmission operation is an example of a third operation. The FAX preview operation is an example of a fourth operation that can be executed by the same operation unit as the FAX transmission operation.

  Although not shown, the operation instruction program 65 adds a numeric image 127 indicating the number of FAX records stored in the multifunction machine 10A to the operation icon 124 when the key image 126 is not added to the operation icon 124. Also good. The number of FAX records stored in the MFP 10A is an example of performance information indicating the number of image data received by the FAX unit 13, that is, the operation results of the FAX unit 13. The number image 127 is an example of an image indicating an operation result indicated by the result information.

  More specifically, the operation instruction program 65 transmits inquiry information to the multifunction device 10A through the communication unit 55, and receives record number information indicating the number of FAX records from the multifunction device 10A through the communication unit 55 as a response to the inquiry information. . The inquiry information is an example of performance request information for inquiring about the number of FAX records. The inquiry information includes, for example, an operation ID “FAX reception”. The operation instruction program 65 adds a numerical image 127 corresponding to the number indicated by the record number information to the operation icon 124.

  The operation result indicated by the result information is not limited to the number of FAX records. For example, whether or not new image data is received by FAX within a predetermined time, whether or not a recording sheet on which an image is recorded by a print operation is recorded. It may be the number of sheets, the remaining amount of ink or toner used in the printer unit 11, and the like. That is, the image indicating the operation result is not limited to the operation icon 124, and may be added to another operation object.

  Further, the operation instruction program 65 responds to the fact that the SFL information is not received even after a predetermined time has elapsed since the transmission of the SFL request information in the first determination process executed first in the standard activation process. (S13: No), the key image 126 is not added to the action icon of the action corresponding to the SFL information (S17). For the operation icons 123 and 124, when at least one of the plurality of SFL information corresponding to the operation icons 123 and 124 cannot be received (S13: No), the operation icons 123 and 124 are key images. 126 is not added (S17).

  That is, the operation instruction program 65 that has received the SFL information shown in FIG. 3A does not add the key image 126 to the operation icons 121 and 124, as shown in FIG. A key image 126 is added to 123. In addition, the operation instruction program 65 adds a numeric image 127 to the operation icon 124. The display mode of the operation icon to which the key image 126 is added (hereinafter sometimes referred to as “keyed icon”) is an example of the first mode, and the operation icon to which the key image 126 is not added (hereinafter, referred to as “keyed icon”). The display mode of “may be described as“ keyless icon ”) is an example of the second mode.

  Next, the operation instruction program 65 displays the main screen on the display unit 53 (S19). FIG. 11B is an example of a main screen. The main screen is a screen that is first displayed on the display unit 53 in the standard activation process. Note that the “screen displayed first” does not include, for example, a so-called splash screen for displaying a manufacturer's logo, or a screen for requesting consent to the rules. Then, the operation instruction program 65 receives a user operation for designating an icon included in the main screen through the operation unit 54 (S20, S21). The process of step S19 is an example of a first display process, and the processes of steps S20 and S21 are an example of a reception process.

  The main screen includes an operation icon corresponding to a predetermined operation among operations that can be executed by the designated device. For example, as shown in FIG. 11B, the main screen of the first embodiment includes an operation icon 121 corresponding to the print operation, an operation icon 122 corresponding to the scan operation, an operation icon 123 corresponding to the copy operation, And an operation icon 124 corresponding to both the FAX transmission operation and the FAX preview operation (hereinafter collectively referred to as “FAX operation”). The action icon 123 is an example of a composite object, and the action icon 124 is an example of an inclusion object.

  The main screen shown in FIG. 11B includes operation icons 121 to 124 whose display modes have been determined in the first determination process, a status icon 125, and a device icon 128. The status icon 125 corresponds to an instruction to display a status screen indicating the state of the designated device. Description of the details of the status screen is omitted. The device icon 128 is an example of a switching object corresponding to an instruction to switch the designated device. The device icon 128 describes the designated device ID “MFP-A” at the present time.

  On the other hand, when the operation instruction program 65 determines that the device information record is not stored in the data storage area 62B (S11: No), the operation icons 121 to 124 that cannot be specified through the operation unit 54, and the specified device A main screen including a device icon 128 in which “unselected” characters indicating that “No” is specified may be displayed on the display unit 53. In other words, only the device icon 128 may be designated on the main screen before the processing of steps S12 to S18 is executed.

  Next, the operation instruction program 65 executes a device selection process in response to receiving the designation of the device icon 128 through the operation unit 54 (S20: Yes & S21: device icon) (S22). The device selection process is a process for allowing a user to designate a designated device. Details of the device selection process will be described with reference to FIG.

[Device selection processing]
First, the operation instruction program 65 searches for a plurality of MFPs 10 that can communicate through the communication unit 55 (S31). Specifically, the operation instruction program 65 uses, for example, SNMP (abbreviation of Simple Network Management Protocol) to send transmission request information for requesting transmission of device information stored in the MIB through the communication unit 55. Broadcast to. Next, the operation instruction program 65 receives the device information transmitted from the multifunction device 10 as a response to the transmission request information from the multifunction device 10 through the communication unit 55. In the first embodiment, it is assumed that the multifunction peripherals 10A and 10B are specified. The process in step S31 is an example of a specifying process for specifying a communicable MFP 10. The search for a plurality of communicable MFPs 10 may be performed by other known methods.

  Next, the operation instruction program 65 determines whether or not the designated operation ID has already been temporarily stored in the data storage area 62B (S32). In other words, the operation instruction program 65 determines whether a specified operation has already been specified by a user operation on the operation instruction program 65 or by the map program 66 (S32). Then, the operation instruction program 65 executes the processes of steps S33 to S38 in response to determining that the designated operation ID has already been temporarily stored (S32: Yes). Details of the processes of steps S33 to S38, S42, and S43 will be described later in the description of step S132 of FIG. On the other hand, when the operation instruction program 65 determines that the designated operation ID has not been temporarily stored (S32: No), the operation instruction program 65 skips the processing of steps S33 to S38 and executes the processing after step S39. .

  Next, the operation instruction program 65 displays a device selection screen on the display unit 53 (S39). FIG. 12A is an example of a device selection screen. The device selection screen shown in FIG. 12A includes device icons 131 and 132. The device icons 131 and 132 correspond to the multifunction machines 10A and 10B specified in step S31. The device icons 131 and 132 describe the device IDs of the corresponding multifunction peripherals 10A and 10B. Furthermore, the device icons 131 and 132 when the processes in steps S33 to S38 are not executed are no-key icons. Then, the operation instruction program 65 accepts designation of an icon included in the device selection screen through the operation unit 54 (S40). The process of step S39 is an example of a fifth display process, and the process of step S40 is an example of a reception process.

  Next, when the operation instruction program 65 accepts the designation of the device icon 132 through the operation unit 54 (S40: Yes), for example, the device information received from the multi-function device 10B in step S31 is recorded as a device information record. The device ID “MFP-B” of the MFP 10B corresponding to the device icon 132 is determined as the designated device ID while being stored in the storage area 62B (S41). That is, the operation instruction program 65 temporarily stores the device ID “MFP-B” in the data storage area 62B as the designated device ID. The user operation for designating a device icon is an example of a user operation for designating a designated device. If the specified device ID and device information record are already stored, the operation instruction program 65 overwrites the already stored specified device ID and device information record with the new specified device ID and new device information record. To do. The process of step S41 is an example of a switching process.

  Returning to FIG. 4, the operation instruction program 65 executes the processes of steps S12 to S19 again using the new device information record. Even when the operation instruction program 65 does not accept a user operation through the operation unit 54 until a predetermined time elapses after the main screen is displayed (S20: No), the processing of steps S12 to S19 is performed again. Execute. Note that “execution of the process again” is not limited to, for example, that the process executed for the first time and the process executed for the second time are completely the same. For example, the parameters (for example, device information records) used for each process may be different in the processes of steps S12 to S19 executed for the first time and the processes of steps S12 to S19 executed for the second time or later. Different program modules and functions may be executed.

  Since the multifunction device 10B, which is a new designated device, cannot execute the scan operation and the copy operation, the operation instruction program 65 displays the operation icons 122 and 123 on the main screen to be newly displayed on the display unit 53 in step S19. Display. That is, the main screen includes only operation icons corresponding to operations that can be executed by the designated device. In this case, the operation instruction program 65 does not need to determine the display mode of the operation icons 122 and 123 in steps S13 to S18.

  In addition, the operation instruction program 65, in the first determination process executed after the Nth (N is an integer equal to or greater than 2) times in the standard activation process, does not change the SFL even if a predetermined time elapses after the SFL request information is transmitted. In response to the failure to receive the information (S13: No), the display mode of the action icon corresponding to the SFL information is determined to be the display mode determined in the (N-1) th first determination process. (S17). For example, when the key image 126 is added to the operation icon 122 in the first determination process for the first time, the operation instruction program 65 can receive SFL information corresponding to the device ID “scan” in the first determination process for the second time. In response to the absence (S13: No), the key image 126 is added to the operation icon 122.

  Next, the operation instruction program 65 receives the designation of one of the operation icons 121 to 124 included in the main screen through the operation unit 54 (S20: Yes & S21: operation icon), and the designated icon is unlocked. It is determined whether or not it is an icon (S23). Then, in response to determining that the keyless icon has been designated (S23: Yes), the action instruction program 65 temporarily stores the action ID corresponding to the designated action icon in the data storage area 62B as the designated action ID. The process corresponding to the designated operation icon is executed (S24). The user operation that specifies an action icon is an example of a user operation that specifies a specified action.

  As an example, the operation instruction program 65 receives, for example, the specification of the operation icon 121 to which the key image 126 is not added through the operation unit 54 (S21: operation icon & S23: Yes), and the operation ID “print”. Is temporarily stored in the data storage area 62B as a designated operation ID, and a print process, which is an example of an execution preparation process, is executed. As another example, the operation instruction program 65, for example, in response to receiving the designation of the operation icon 124 to which the key image 126 is not added through the operation unit 54 (S21: operation icon & S23: Yes), FIG. The indicated FAX process is executed.

  On the other hand, the operation instruction program 65 displays the error screen 135 on the display unit 53 in response to determining that the keyed icon has been designated (S23: No) (S25). That is, for example, the operation instruction program 65 displays an error screen when the designation of the operation icons 122 and 123 to which the key image 126 is added is received through the operation unit 54 (S21: operation icon & S23: No). 53 is displayed (S25). The process of step S25 is an example of a sixth display process.

  FIG. 12B is an example of the error screen 135 when the operation icon 122 is designated. An error screen 135 shown in FIG. 12B is a pop-up screen superimposed on the main screen displayed immediately before. The error screen 135 shown in FIG. 12B includes a message “Scanning is locked by the administrator. Please check with the administrator.” And an [OK] icon 136. Then, the operation instruction program 65 displays the main screen again on the display unit 53 in response to accepting the designation of the [OK] icon 136 through the operation unit 54 (S19). That is, the user who sees the message can contact the administrator so that the scanning operation is unlocked, and can tap the [OK] icon 136 to display the main screen again.

[Print processing]
The print process shown in FIG. 6 is an execution preparation process corresponding to a print operation. The execution preparation process is a process for preparing the specified device to execute the specified operation. The execution preparation process includes, for example, a process for accepting designation of designated data, a process for accepting designation of an execution condition for a designated operation, and a process for confirming an image of the execution result of a designated operation. The execution conditions of the designated operation include, for example, the number of recording sheets on which an image is recorded by the printing operation, the reading resolution in the scanning operation, a FAX number that identifies an external device that is a FAX transmission destination in the FAX transmission operation, and the like. Details of the print processing will be described with reference to FIG.

  First, the operation instruction program 65 displays a data selection screen on the display unit 53 (S51). FIG. 13A is an example of a data selection screen. The data selection screen shown in FIG. 13A includes a plurality of data icons 141, 142, and 143. For example, the data icons 141 to 143 correspond to various data stored in the data folder. Then, the operation instruction program 65 accepts designation of an icon included in the data selection screen through the operation unit 54 (S52). The process in step S52 is an example of a reception process.

  Next, the operation instruction program 65 determines the data “photograph. JPEG” corresponding to the data icon 141 as designated data, for example, in response to accepting designation of the data icon 141 through the operation unit 54 (S52: Yes). . That is, the operation instruction program 65 temporarily stores the data ID of the data “PHOTO.JPEG” corresponding to the data icon 141 in the data storage area 62B as the specified data ID. The user operation for designating a data icon is an example of a user operation for designating designated data.

  Next, the operation instruction program 65 displays a preview screen on the display unit 53 (S53). FIG. 13B is an example of a preview screen. The preview screen shown in FIG. 13B includes a preview image 145 and a print icon 146. The preview image 145 is an image showing a result of causing the designation device to execute a designation operation on the designation data. The preview image 145 according to the first embodiment is an image obtained by recording an image represented by data “photograph. JPEG” on a recording sheet. The print icon 146 is an example of an execution instruction object corresponding to an execution instruction for a designated operation. That is, the print icon 146 corresponds to an instruction for causing the designated device to execute a printing operation on the designated data. Further, the operation instruction program 65 accepts designation of an icon included in the preview screen through the operation unit 54 (S54). The process of step S53 is an example of a third display process, and the process of step S54 is an example of a reception process.

  Next, in response to accepting designation of the print icon 146 through the operation unit 54 (S54: Yes), the operation instruction program 65 transmits SFL request information through the communication unit 55 to the multifunction peripheral 10A serving as the designation device ( S55). The SFL request information transmitted in step S55 includes the designated operation ID “print”. In other words, the SFL request information transmitted in step S55 includes the action ID of the action corresponding to the designated execution instruction object. Then, the operation instruction program 65 receives SFL information corresponding to the operation ID “print” from the MFP 10A through the communication unit 55 (S56: Yes). The process of step S55 is an example of a status request process, and the process of step S56 is an example of a status reception process.

  Next, the operation instruction program 65 determines whether the SFL information received in step S56 indicates a locked state or an unlocked state (S57). The process of step S57 is an example of a determination process. Then, in response to determining that the SFL information indicates the unlocked state (S57: No), the operation instruction program 65 transmits the print instruction information to the multifunction peripheral 10A that is the designated device through the communication unit 55 (S58). . The print instruction information is information for executing a print operation for designated data. The print instruction information includes, for example, designated data and a designated operation ID “print”. Alternatively, the print information when the designated data is stored in the external server may include a designated data ID in the URL format instead of the designated data. The process of step S58 is an example of an execution instruction process.

  On the other hand, although not shown, the device program 35 of the multifunction machine 10 </ b> A receives print instruction information from the portable terminal 50 through the communication unit 25. Then, the apparatus program 35 causes the printer unit 11 to execute a printing operation according to the received print instruction information. That is, the printer unit 11 records a photograph indicated by the data “photograph. JPEG” included in the print instruction information on a recording sheet. In addition, the printer unit 11 when the designated data ID is included in the print instruction information receives the designated data identified by the designated data ID from the external server through the communication unit 25, and executes a printing operation on the designated data.

  Further, the operation instruction program 65 can receive the SFL information in response to the determination that the SFL information indicates the locked state (S57: Yes) or even after a predetermined time has elapsed since the SFL request information was transmitted. In response to the absence (S56: No), an error screen is displayed on the display unit 53 (S59). The process of step S59 may be the same as the process of step S25. However, in the error screen displayed in step S59, the “scan operation” of the message shown in FIG. 12B may be replaced with “print operation”. Then, the operation instruction program 65 displays the preview screen on the display unit 53 again in response to accepting the designation of the [OK] icon 136 through the operation unit 54 (S53). The process of step S59 is an example of a sixth display process.

[FAX processing]
The FAX processing shown in FIG. 7 is executed in response to receiving the designation of the operation icon 124 to which the key image 126 is not added through the operation unit 54. Details of the FAX processing will be described with reference to FIG.

  First, the operation instruction program 65 determines the display mode of icons to be included in the operation selection screen based on the SFL information received from the multifunction device 10A as the designated device (S61 to S64). The action selection screen includes an action icon of an action associated with the action icon 124. The operation selection screen according to the first embodiment includes an operation icon 148 corresponding to the FAX transmission operation and an operation icon 149 corresponding to the FAX preview operation, as shown in FIG. 14A, for example. The operation instruction program 65 may use the SFL information received as a response to the SFL request information transmitted in step S12 in steps S61 to S64, or may newly transmit the SFL request information by FAX processing. .

  Next, the operation instruction program 65 adds the key image 126 to the operation icon 148 in response to the SFL information corresponding to the operation ID “FAX transmission” indicating the locked state (S61: Yes & S62: Yes) (S63). . On the other hand, when the operation instruction program 65 indicates that the SFL information corresponding to the operation ID “FAX transmission” indicates an unlocked state (S61: Yes & S62: No), or the SFL information corresponding to the operation ID “FAX transmission” is received. In response to the failure of reception (S61: No), the key image 126 is not added to the operation icon 148 (S64). Similarly, the display mode of the operation icon 149 for the FAX preview operation is determined based on the SFL information corresponding to the operation ID “FAX preview”. The process of steps S61 to S64 is an example of a second determination process.

  Next, the operation instruction program 65 displays an operation selection screen on the display unit 53 (S66). FIG. 14A is an example of the operation selection screen. The operation selection screen shown in FIG. 14A includes operation icons 148 and 149 whose display mode is determined in the second determination process. FIG. 14B shows an example of an operation selection screen including operation icons 148 and 149 to which the key image 126 is not added. Then, the operation instruction program 65 receives a user operation for designating an icon included in the operation selection screen through the operation unit 54 (S67, S68). The process of step S66 is an example of a second display process, and the processes of steps S67 and S68 are an example of a reception process.

  Next, the operation instruction program 65 receives the operation ID “FAX transmission” in response to receiving the designation of the operation icon 148 without the key image 126 through the operation unit 54 (S67: Yes & S69: FAX transmission icon). Temporary storage is performed in the data storage area 62B as the designated operation ID, and a FAX transmission process as an example of an execution preparation process is executed (S70). Further, the operation instruction program 65 specifies the operation ID “FAX preview” in response to receiving the specification of the operation icon 149 to which the key image 126 is not added through the operation unit 54 (S67: Yes & S69: FAX preview icon). An operation ID is temporarily stored in the data storage area 62B, and a FAX preview process, which is an example of an execution preparation process, is executed (S71).

  On the other hand, the operation instruction program 65 displays an error screen on the display unit 53 in response to receiving the designation of the operation icons 148 and 149 to which the key image 126 is added through the operation unit 54 (S67: No) (S68). ). The process of step S68 may be the same as the process of step S25. However, in the error screen displayed in step S68, the “scan operation” of the message shown in FIG. 12B may be replaced with “FAX transmission operation” or “FAX preview operation”. Then, the operation instruction program 65 displays the operation selection screen on the display unit 53 again in response to accepting the designation of the [OK] icon 136 through the operation unit 54 (S66). The process of step S68 is an example of a sixth display process.

[FAX transmission processing]
The FAX transmission process shown in FIG. 8 is an execution preparation process corresponding to the FAX transmission operation. That is, the FAX transmission process is executed in response to accepting the designation of the operation icon 148 without the key image 126 added through the operation unit 54. Details of the FAX transmission processing will be described with reference to FIG.

  First, the operation instruction program 65 determines the display mode of icons to be included in the FAX transmission screen based on the SFL information received from the multifunction device 10A as the designated device (S81 to S84). The FAX transmission screen includes acquisition source icons 151 and 152 corresponding to acquisition sources of FAX data to be faxed to the designated device. For example, as illustrated in FIG. 14B, the FAX transmission screen according to the first embodiment acquires FAX data from the acquisition source icon 151 corresponding to acquiring FAX data from the scanner unit 12 and the data storage area 62 </ b> B. And an acquisition source icon 152 corresponding to The operation instruction program 65 may use the SFL information received as a response to the SFL request information transmitted in step S12 in steps S81 to S84, or may newly transmit the SFL request information by FAX processing. .

  Next, the operation instruction program 65 adds the key image 126 to the acquisition source icon 151 in response to the SFL information corresponding to the operation ID “scan” indicating the locked state (S81: Yes & S82: Yes) (S83). . On the other hand, the operation instruction program 65 can receive the SFL information corresponding to the operation ID “scan” in response to the SFL information corresponding to the operation ID “scan” indicating an unlocked state (S81: Yes & S82: No). In response to the absence (S81: No), the key image 126 is not added to the acquisition source icon 151 (S84). On the other hand, the key image 126 is not added to the acquisition source icon 152. The process of steps S81 to S84 is an example of a third determination process.

  Next, the operation instruction program 65 displays a FAX transmission screen on the display unit 53 (S85). FIG. 14B is an example of a FAX transmission screen. The FAX transmission screen shown in FIG. 14B includes an acquisition source icon 151 whose display mode is determined in the third determination process, and an acquisition source icon 152. The acquisition source icons 151 and 152 are examples of execution instruction icons. FIG. 14B shows an example of a FAX transmission screen including the acquisition source icon 151 to which the key image 126 is added. The FAX transmission screen may further include an acquisition source icon corresponding to an instruction to acquire image data stored in a storage server on the Internet. Then, the operation instruction program 65 receives a user operation for designating an icon included in the FAX transmission screen through the operation unit 54 (S86, S87). The process of step S85 is an example of a third display process, and the processes of steps S86 and S87 are an example of a reception process.

  Next, the operation instruction program 65 receives the designation of the acquisition source icon 151 to which the key image 126 is not added through the operation unit 54 (S86: scan icon & S87: Yes), and is a multifunction device that is a designated device. The FAX instruction information is transmitted to 10A through the communication unit 55 (S88). The FAX instruction information is information for executing a FAX transmission operation for designated data. The process of step S88 is an example of an execution instruction process.

  The FAX instruction information transmitted in step S88 includes an operation ID “FAX transmission” and scan instruction information instructing execution of a scan operation. That is, the FAX instruction information transmitted in step S88 is information for causing the scanner unit 12 to execute a scanning operation and causing the FAX unit 13 to execute a FAX transmission operation using the image data generated by the scanning operation as designated data. It is. Although illustration is omitted, the operation instruction program 65 accepts a user operation for specifying transmission destination information (for example, a FAX number) for identifying an external apparatus as a FAX transmission destination through the operation unit 54, and receives the transmission destination information. Included in FAX instruction information.

  On the other hand, although not shown, the apparatus program 35 of the multifunction machine 10 </ b> A receives FAX instruction information from the portable terminal 50 through the communication unit 25. Then, the apparatus program 35 causes the scanner unit 12 to perform a scanning operation according to the scan instruction information included in the FAX instruction information. The scanner unit 12 reads an image recorded on a document set on a contact glass (not shown) or an ADF (Auto Document Feeder), and generates image data indicating the image. Further, the apparatus program 35 causes the FAX unit 13 to execute a FAX transmission operation for image data generated by the scanning operation by the scanner unit 12. That is, the FAX unit 13 transmits the image data generated by the scanning operation by FAX to the external apparatus identified by the transmission destination information included in the FAX instruction information.

  Further, the operation instruction program 65 displays an error screen on the display unit 53 in response to receiving the designation of the acquisition source icon 151 to which the key image 126 is added through the operation unit 54 (S86: scan icon & S87: No). (S89). The process in step S89 may be the same as the process in step S25. Then, the operation instruction program 65 displays the FAX transmission screen on the display unit 53 again in response to accepting the designation of the [OK] icon 136 through the operation unit 54 (S85). The process of step S89 is an example of a sixth display process.

  Further, the operation instruction program 65 displays the data selection screen shown in FIG. 13A on the display unit 53 in response to the designation of the acquisition source icon 152 being accepted through the operation unit 54 (S86: local icon). (S90). Then, the operation instruction program 65 accepts designation of an icon included in the data selection screen through the operation unit 54 (S91). The process in step S91 is an example of a reception process.

  Next, the operation instruction program 65 determines the data “photograph. JPEG” corresponding to the data icon 141 as designated data, for example, in response to accepting designation of the data icon 141 through the operation unit 54 (S91: Yes). . That is, the operation instruction program 65 temporarily stores the data ID of the data “PHOTO.JPEG” corresponding to the data icon 141 in the data storage area 62B as the specified data ID.

  Then, the operation instruction program 65 transmits FAX instruction information through the communication unit 55 to the multifunction machine 10A that is the designated device (S92). The FAX instruction information transmitted in step S92 includes designated data or designated data ID, an operation ID “FAX transmission”, and transmission destination information. That is, the FAX instruction information transmitted in step S92 is information for instructing execution of a FAX transmission operation for designated data. The process of step S92 is an example of an execution instruction process.

  On the other hand, although not shown, the apparatus program 35 of the multifunction machine 10 </ b> A receives FAX instruction information from the portable terminal 50 through the communication unit 25. Then, the apparatus program 35 causes the FAX unit 13 to execute a FAX transmission operation according to the FAX instruction information. In other words, the FAX unit 13 specifies, for the external device identified by the transmission destination information included in the FAX instruction information, the identification data included in the FAX instruction information or the specification data ID included in the FAX instruction information. Send the data by fax.

  The operation instruction program 65 may execute processing corresponding to steps S55 to S57 immediately before steps S88 and S92. That is, the operation instruction program 65 transmits the SFL request information including the operation ID “FAX transmission” to the multifunction peripheral 10 </ b> A that is the designated device through the communication unit 55. Next, the operation instruction program 65 receives SFL information corresponding to the operation ID “FAX transmission” from the MFP 10 </ b> A through the communication unit 55. Further, the operation instruction program 65 determines whether the SFL information received from the multifunction machine 10A indicates a locked state or an unlocked state.

  Then, in response to determining that the SFL information indicates the unlocked state, the operation instruction program 65 transmits the FAX instruction information to the multifunction machine 10A through the communication unit 55 (S88, S92). On the other hand, when the operation instruction program 65 determines that the SFL information indicates the locked state, or when the SFL information cannot be received even after a predetermined time has elapsed since the transmission of the SFL request information. The error screen is displayed on the display unit 53. In the error screen displayed here, the “scan operation” of the message shown in FIG. 12B may be replaced with “FAX transmission operation”. Then, the operation instruction program 65 displays the FAX transmission screen on the display unit 53 again in response to accepting the designation of the [OK] icon 136 through the operation unit 54.

[FAX preview process]
The FAX preview process shown in FIG. 9 is an execution preparation process corresponding to the FAX preview operation. That is, the FAX preview process is executed in response to accepting the designation of the operation icon 149 to which the key image 126 is not added through the operation unit 54. Details of the FAX preview process will be described with reference to FIG.

  First, the operation instruction program 65 receives a plurality of FAX specifying information included in the FAX list stored in the MFP 10A from the MFP 10A as a designated device through the communication unit 55 (S101). More specifically, the operation instruction program 65 transmits transmission request information for requesting transmission of FAX specifying information to the multifunction machine 10 </ b> A through the communication unit 55. Next, the operation instruction program 65 receives the FAX specifying information transmitted as a response to the transmission request information from the MFP 10 </ b> A through the communication unit 55. Then, the operation instruction program 65 temporarily stores the received FAX specifying information in the data storage area 62B.

  Next, the operation instruction program 65 displays a FAX selection screen on the display unit 53 (S102). FIG. 15A is an example of a FAX selection screen. The FAX selection screen shown in FIG. 15A includes a plurality of FAX icons 155 and 156. FAX icons 155 and 156 are examples of execution instruction objects corresponding to FAX preview processing. FAX icons 155 and 156 correspond to a plurality of FAX specifying information received in step S101. The FAX icons 155 and 156 describe the reception date and time and the transmission source telephone number included in the corresponding FAX identification information. Then, the operation instruction program 65 accepts designation of an icon included in the FAX selection screen through the operation unit 54 (S103). The process of step S102 is an example of a third display process, and the process of step S103 is an example of a reception process.

  Next, the operation instruction program 65 transmits the transmission instruction information through the communication unit 55 to the multifunction peripheral 10 </ b> A that is the designated device, for example, in response to receiving the designation of the FAX icon 155 through the operation unit 54 (S <b> 103: Yes). (S104). The transmission instruction information is an example of execution instruction information that instructs transmission of the FAX data 1 specified by the FAX specifying information corresponding to the FAX icon 155. The transmission instruction information includes, for example, an operation ID “FAX preview” and a data ID “001” included in the FAX specifying information corresponding to the FAX icon 155. The process of step S104 is an example of an execution instruction process.

  On the other hand, although not shown, the device program 35 of the multifunction machine 10 receives transmission instruction information from the portable terminal 50 through the communication unit 25. Then, the apparatus program 35 reads the FAX data 1 identified by the data ID “001” included in the transmission instruction information from the FAX list, and transmits the FAX data 1 to the portable terminal 50 through the communication unit 25.

  The operation instruction program 65 may execute processing corresponding to steps S55 to S57 immediately before step S102. That is, the operation instruction program 65 transmits the SFL request information including the operation ID “FAX preview” to the multifunction peripheral 10 </ b> A that is the designated device through the communication unit 55. Next, the operation instruction program 65 receives SFL information corresponding to the operation ID “FAX preview” from the MFP 10 </ b> A through the communication unit 55. Further, the operation instruction program 65 determines whether the SFL information received from the multifunction machine 10A indicates a locked state or an unlocked state.

  Then, in response to determining that the SFL information indicates the unlocked state, the operation instruction program 65 transmits the transmission instruction information to the multifunction machine 10A through the communication unit 55 (S104). On the other hand, when the operation instruction program 65 determines that the SFL information indicates the locked state, or when the SFL information cannot be received even after a predetermined time has elapsed since the transmission of the SFL request information. The error screen is displayed on the display unit 53. In the error screen displayed here, the “scan operation” of the message shown in FIG. 12B may be replaced with “FAX preview operation”. Then, the operation instruction program 65 displays the FAX selection screen on the display unit 53 again in response to accepting the designation of the [OK] icon 136 through the operation unit 54.

  Next, the operation instruction program 65 receives the FAX data 1 from the multifunction machine 10A through the communication unit 55 (S105: Yes). Next, the operation instruction program 65 determines the display mode of icons to be included in the FAX preview screen based on the SFL information received from the multifunction device 10A that is the designated device (S106 to S109). The FAX preview screen includes operation icons 161 and 162 corresponding to handling of the FAX data received in step S105. For example, as shown in FIG. 15B, the FAX preview screen according to the first embodiment designates an operation icon 161 corresponding to an instruction to end the FAX preview process and a printing operation for the FAX data received in step S105. And an operation icon 162 corresponding to an instruction to be executed. The process of step S105 is an example of a data reception process, and the processes of steps S106 to S109 are an example of a fourth determination process.

  Next, the operation instruction program 65 adds the key image 126 to the operation icon 162 in response to the SFL information corresponding to the operation ID “print” indicating the locked state (S106: Yes & S107: Yes) (S108). On the other hand, the operation instruction program 65 can receive the SFL information corresponding to the operation ID “print” in response to the SFL information corresponding to the operation ID “print” indicating an unlocked state (S106: Yes & S107: No). In response to the absence (S106: No), the key image 126 is not added to the operation icon 161 (S109). On the other hand, the key image 126 is not added to the operation icon 161.

  Next, the operation instruction program 65 displays a FAX preview screen on the display unit 53 (S110). FIG. 15B is an example of a FAX preview screen. The FAX preview screen shown in FIG. 15B includes a FAX image 160, an operation icon 161, and an operation icon 162 whose display mode has been determined in the fourth determination process. Then, the operation instruction program 65 receives a user operation for designating an icon included in the FAX preview screen through the operation unit 54 (S111, S112). The process of step S110 is an example of a fourth display process, and the processes of steps S111 and S112 are an example of a reception process.

  The fax image 160 is an image indicated by the fax data 1 received in step S105. Further, the FAX header included in the FAX image 160 includes, for example, the reception date and time and the transmission source telephone number included in the corresponding FAX specifying information. FIG. 15B shows an example of a FAX preview screen including an operation icon 162 to which the key image 126 is not added. The action icon 162 is an example of a print instruction object.

  Next, the operation instruction program 65 receives the designation of the operation icon 162 to which the key image 126 is not added through the operation unit 54 (S111: Print icon & S112: Yes), and the multifunction device 10A as the designation device. The print instruction information is transmitted through the communication unit 55 (S113). The print instruction information includes, for example, an operation ID “print” and FAX data 1 that is specified data or a specified data ID that identifies FAX data 1. The process of step S113 and the process of the multifunction peripheral 10A that has received the print instruction information may be the same as step S58. Also, the operation instruction program 65 skips the processing of steps S112 and S113 in response to the specification of the operation icon 161 being accepted through the operation unit 54 (S111: OK icon), and ends the FAX preview processing.

  On the other hand, the operation instruction program 65 displays an error screen on the display unit 53 in response to accepting the specification of the operation icon 162 to which the key image 126 is added through the operation unit 54 (S111: print icon & S112: No). (S114). The process of step S114 may be the same as the process of step S25. However, in the error screen displayed in step S114, the “scan operation” of the message shown in FIG. 12B may be replaced with “print operation”. Then, the operation instruction program 65 displays the FAX preview screen on the display unit 53 again in response to accepting the designation of the [OK] icon 136 through the operation unit 54 (S110). The process of step S110 is an example of a sixth display process.

[Effects of Embodiment 1]
In recent years, the number of pieces of information to be specified by the user for causing the multifunction device 10 to execute an operation has increased as the multifunction device 10 has become multifunctional. On the other hand, in the portable terminal 50 having a small display screen, allowing a user to specify a large amount of information through one screen may significantly reduce operability. Therefore, according to the operation instruction program 65 according to the first embodiment, by causing a user to perform user operations on a plurality of hierarchized screens, designation data, a designation operation, and designation of a designation device can be received in order. it can.

  Under the circumstances as described above, according to the first embodiment, the main screen, the operation selection screen, the FAX transmission screen, and the FAX preview screen depending on whether the SFL information is in the locked state or the unlocked state. The display mode of the icons included in is changed. Thereby, it is possible to make the user recognize on each screen whether or not the execution of the operation corresponding to the icon is restricted in the designated device. Further, since an error screen is displayed in response to the designation of the icon with the key image 126 added, the user can clearly recognize that the operation corresponding to the designated icon is restricted in the designated device. be able to.

  Further, according to the first embodiment, not only the operation icons 121 and 122 corresponding to the printing operation and the scanning operation, but also the display mode of the operation icon 123 corresponding to the combined operation combining the printing operation and the scanning operation is the SFL information. To be determined. This not only allows the user to recognize whether or not each of the plurality of operations is restricted, but also allows the user to recognize that the state of each operation affects the execution of the combined operation. .

  Further, according to the first embodiment, the operation icons 124 including the operations that can be executed by the same operation unit are included in the main screen so as not to include a large number of icons on one screen, and are included by the operation icons 124. Operation icons 148 and 149 corresponding to the FAX transmission operation and FAX preview operation are included in the operation selection screen. Then, when all the operations corresponding to the operation icons 148 and 149 included in the operation selection screen are in the locked state, the operation icon 124 to which the key image 126 is added is included in the main screen. In this way, in a program that allows a user to select a desired operation in a hierarchical manner, whether or not a plurality of operations corresponding to the operation icon 124 are restricted by the display mode of the operation icon 124 on the main screen. The user can be inferred whether or not. It can be said that the mobile terminal 50 having a relatively small display screen has a particularly advantageous effect.

  Further, according to the first embodiment, the operation icon 148 corresponding to the FAX transmission operation is included in the upper screen so that a large number of icons are not included in one screen, and is used as an acquisition source of the image data to be FAX transmission target. Corresponding acquisition source icons 151 and 152 are included in the lower screen. In this way, in a program that allows the user to select a desired operation hierarchically, it is generated by the scan operation according to the display mode of the acquisition source icon 151 corresponding to the scan operation that is one of the image data acquisition sources. It is possible to make the user recognize whether or not the execution of the operation of transmitting image data by FAX is restricted. It can be said that the mobile terminal 50 having a relatively small display screen has a particularly advantageous effect.

  Further, according to the first embodiment, the processing after step S12 is executed again in response to the device selection processing being executed, so it is possible to ask the user whether or not each operation is restricted in the new designated device. Can be recognized. Further, according to the first embodiment, the processing after step S12 is executed again in response to the non-operation time during display of the main screen reaching a predetermined time. Can be reflected.

  In the first embodiment, the SFL request information is transmitted again at a predetermined timing (after S20: No / S22) to reflect the update of the SFL information in the multifunction machine 10 on the main screen. The method for receiving the updated SFL information is not limited to this. For example, the SFL request information may request the MFP 10 to transmit the SFL information at a timing when the SFL information is updated. Then, the operation instruction program 65 may execute the processes of steps S14 to S19 again in response to receiving the SFL information from the multi-function device 10 through the communication unit 55 during the display of the main screen.

  Further, according to the first embodiment, if the SFL information cannot be received in the first determination process for the first time, the key image 126 is not added to the corresponding operation icon. If the SFL information cannot be received in the second and subsequent first determination processes, the display mode of the corresponding action icon is determined to be the display mode determined in the most recent first determination process. As a result, for example, when the communication network 102 is temporarily busy, or when the power of the designated device is turned off, the impression that each operation is restricted in the designated device is given to the user. Can be suppressed.

  Furthermore, according to the first embodiment, the SFL information corresponding to the designated operation is confirmed again immediately before steps S58, S88, S92, and S104. For example, whether or not the designated operation is locked during the operation of the portable terminal 50. Can be grasped appropriately. Further, the operation instruction program 65 is similar to the main screen (S19) in that the preview screen (S53), the operation selection screen (S66), the FAX transmission screen (S85), the FAX selection screen (S102), or the FAX preview screen. The SFL request information may be transmitted to the designated device when the user operation is not accepted through the operation unit 54 until a predetermined time elapses after displaying (S110). Then, the operation instruction program 65 determines the display mode of the icon included in the currently displayed screen based on the SFL information received from the designated device, and displays the screen including the icon of the newly determined display mode again. Good.

  In the first embodiment, the keyed icon is an example of the first aspect and the no-key icon is an example of the second aspect. However, the specific example of the display aspect is not limited to this. For example, a character string “lock” may be added to the icon instead of the key image 126. Moreover, the specific example of a 1st aspect and a 2nd aspect may differ with screens. For example, the key image 126 may be added on the main screen, and the character string “lock” may be added on the operation selection screen.

  In the first embodiment, the example in which the operation ID is included in the SFL request information and the SFL information corresponding to the operation ID is received from the multifunction device 10 has been described. However, the method for receiving SFL information is not limited to this. For example, the SFL request information may request transmission of all the SFL records stored in the multifunction machine 10, that is, the SFL list. Then, the operation instruction program 65 may execute processing such as determining an icon display mode based on SFL information corresponding to a desired operation ID in the SFL list received from the multifunction machine 10.

[Embodiment 2]
In recent years, data designation methods have been diversified, and development of an interface suitable for each has been required. For example, an interface for extracting a desired area from a map image and an interface for editing an image to be printed on a surface such as a CD-ROM are greatly different. Therefore, there is a tendency to develop a plurality of programs having a designation interface specialized for a particular designation method.

  On the other hand, the processing for causing the multifunction device 10 to execute the output operation may vary greatly depending on the manufacturer or model of the multifunction device 10. Therefore, in order to execute the processing, it is necessary to develop a program suitable for each multifunction machine 10. However, it is extremely difficult to develop a plurality of programs having a specified interface that is optimal for a specific specification method, and to further implement an optimal process for causing the multifunction peripheral 10 to execute an output operation in each program. . In particular, if an output operation is to be executed by a plurality of MFPs 10 having different specifications, the possibility of affecting the implementation of the specified interface increases due to the optimal processing load for each MFP 10.

  Thus, the operation of the system 100 according to the second embodiment will be described with reference to FIG. A detailed description of the processes common to the first embodiment will be omitted, and the description will focus on the differences. The operation instruction program 65 according to the second embodiment is different from the first embodiment activated from the OS 64 in that the operation instruction program 65 is activated from a map program 66 which is an example of an activation source program.

[Data specification processing]
First, the OS 64 starts the map program 66 in response to accepting the designation of the program icon 115 included in the menu screen shown in FIG. 11A through the operation unit 54, and executes the map program 66 in the foreground. To do. The map program 66 of the portable terminal 50 acquires map image data in response to being activated from the OS 64 due to the OS 64 receiving the designation of the program icon 115 through the operation unit 54. For example, the map program 66 acquires map image data including the current position of the mobile terminal 50 acquired from GPS (abbreviation of Global Positioning System) from a server (not shown) through the communication unit 55. Specifically, the map program 66 requests the map image data from the server through the communication unit 55, and receives the map image data returned from the server through the communication unit 55.

  Next, the map program 66 causes the display unit 53 to display a map designation screen. The map designation screen includes a map image indicated by the map image data acquired from the server, and a [Preview] icon. Then, the map program 66 receives a user operation on the map designation screen through the operation unit 54. And the map program 66 changes the map image displayed on a map designation | designated screen according to having received user operation in the position of a map image through the operation part 54. FIG. The map program 66 acquires map image data indicating the changed map image from the server. The map image displayed on the map designation screen is, for example, slid following the slide operation, reduced following the pinch-in operation, and enlarged following the pinch-out operation.

  Further, the map program 66 receives map image data indicating the map image displayed on the map designation screen in the data storage area 62B as designation data in response to accepting designation of the [preview] icon through the operation unit 54. Temporary storage. Then, the map program 66 executes an API for starting the operation specifying program 65 using the program ID, the specified data ID, and the specified operation ID as arguments. The API executed here may be an API for starting up the operation instruction program 65 as a plug-in, or may be an explicit shared API.

  The API arguments specified by the map program 66 according to the second embodiment include, for example, the program ID of the operation specifying program 65 and the specified data ID for identifying the map image data temporarily stored in the data storage area 62B. And the designated operation ID “print” is designated. However, the designated operation ID may be another output operation such as the operation ID “FAX transmission”, “FAX preview”, or may be omitted from the API argument. As a result, the OS 64 executes the map program 66 in the background and the operation instruction program 65 in the foreground.

[External start processing]
The external activation process shown in FIG. 10 is a process executed by the operation instruction program 65 activated from the map program 66 due to a user operation on the map program 66. The designation of the [Preview] icon is an example of a user operation on the map program 66 that instructs to start the operation instruction program 65. Details of the external activation process will be described with reference to FIG. In the second embodiment, the device information record at the time of execution of the external activation process includes a device ID “MFP-B” and operation information “print”, “FAX transmission”, and “FAX reception”.

  First, the operation instruction program 65 acquires the specified data ID and the specified operation ID specified in the API argument executed by the map program 66 (S121). Then, the operation instruction program 65 temporarily stores the acquired specified data ID and specified operation ID in the data storage area 62B. The designation data ID is information for identifying first designation data that is image data that the map program 66 has received designation through the operation unit 54. The designated operation ID is information for identifying a first designated operation that is an output operation to be executed on the first designated data among a plurality of output operations that can be executed by the multifunction machine 10. The specified operation ID is not included in the API argument, and may be set in advance in the operation instruction program 65. The process of step S121 is an example of an acquisition process.

  Next, the operation instruction program 65 determines whether or not the device information record is stored in the data storage area 62B (S122). Next, in response to determining that the device information record is stored (S122: Yes), the operation instruction program 65 transmits the SFL request information to the multifunction device 10B that is the designated device through the communication unit 55 (S123). ). The SFL request information transmitted in step S123 includes the designated operation ID “print”. Then, the operation instruction program 65 receives SFL information corresponding to the designated operation ID “print” from the MFP 10B through the communication unit 55 (S124: Yes). The process of step S123 is an example of a status request process, and the process of step S124 is an example of a status reception process.

  Next, the operation instruction program 65 determines whether the SFL information corresponding to the designated operation ID “print” indicates a locked state or an unlocked state (S125). In response to determining that the SFL information received in step S124 indicates the locked state (S125: Yes), the operation instruction program 65 displays an error screen on the display unit 53 prior to a preview screen described later (S126). ). The process of step S126 may be the same as the process of step S25. However, in the error screen displayed in step S126, the “scan operation” of the message shown in FIG. 12B may be replaced with “print operation”. The process of step S125 is an example of a determination process, and the process of step S126 is an example of a notification process.

  In addition, the operation instruction program 65 determines that the display mode of the print icon 167 included in the preview screen to be described later cannot be specified through the operation unit 54 (S127). On the other hand, when the operation instruction program 65 determines that the SFL information received in step S124 indicates an unlocked state (S125: No), or a predetermined time has elapsed since the SFL request information was transmitted. If the SFL information is not received (S124: No), the display mode of the print icon 167 included in the preview screen is determined to be a mode that can be specified through the operation unit 54 (S128).

  Next, the operation instruction program 65 displays a preview screen on the display unit 53 (S129). That is, the preview screen according to the second embodiment is displayed regardless of the result of the determination in step S125. FIG. 16A shows an example of a preview screen. The preview screen shown in FIG. 16A includes a preview image 165, a device icon 166, and a print icon 167 of the display mode determined in steps S127 and S128. Then, the operation instruction program 65 accepts designation of an icon included in the preview screen through the operation unit 54 (S130). The process of step S129 is an example of a first display process, and the process of step S130 is an example of a reception process.

  The preview image 165 is an image showing a result of causing the designation device to execute a designation operation on the designation data. The device icon 166 is an example of a switching object corresponding to an instruction to switch the designated device. The print icon 167 is an example of a first output instruction object corresponding to an instruction for causing the designated device to execute a designated operation. FIG. 16A shows an example of a preview screen including a grayed out print icon 167 as an example of the print icon 167 that cannot be specified.

  Next, the operation instruction program 65 executes a device selection process in response to accepting designation of the device icon 166 through the operation unit 54 (S130: device icon) (S132). With reference to FIG. 5, the device selection process according to the second embodiment will be described with a focus on differences from the device selection process described in the first embodiment. The operation instruction program 65 according to the second embodiment is executed in that it determines that the designated operation ID “print” is temporarily stored in the data storage area 62B (S32: Yes), and executes the processes of steps S33 to S38. Different from Form 1.

  First, the operation instruction program 65 according to the second embodiment compares the designated operation ID with the operation ID included in the operation information received from the multifunction machine 10 in step S31. Then, the operation instruction program 65 identifies the multi-function device 10 whose operation information includes the specified operation ID. Note that the operation information may be model information indicating a model of the multifunction machine 10. In this case, the operation instruction program 65 accesses the correspondence information indicating the correspondence relationship between the model information and the operation ID corresponding to the model information, and acquires the operation ID corresponding to the received model information. That is, the correspondence information is also information indicating an operation that can be executed by the multifunction peripheral 10 of the model indicated by the model information. Note that the correspondence information may be stored in the portable terminal 50 or may be stored in a cloud server (not shown).

  As another example, the transmission request information may include a designated operation ID. The device program 35 of the multifunction device 10 may receive the transmission request information from the portable terminal 50 through the communication unit 25, and determine whether or not the designated operation ID included in the transmission request information is stored in the MIB. Then, the device program 35 may transmit the device ID to the portable terminal 50 through the communication unit 25 in response to determining that the designated operation ID is stored in the MIB. On the other hand, the device program 35 does not transmit the device ID to the portable terminal 50 in response to determining that the designated operation ID is not stored in the MIB. Then, the operation instruction program 65 of the portable terminal 50 may specify the multifunction device 10 indicated by the device ID received through the communication unit 55.

  Next, the operation instruction program 65 transmits SFL request information including the designated device ID “print” to the multi function device 10 through the communication unit 55 (S33). Next, the operation instruction program 65 receives SFL information from the multifunction machine 10 through the communication unit 55 (S34: Yes). Next, the operation instruction program 65 determines the display mode of the device icon 131 corresponding to the multifunction device 10 based on the SFL information received from the multifunction device 10 (S35 to S37). Then, the operation instruction program 65 executes the processes of steps S33 to S37 for each of the plurality of MFPs 10A and 10B specified by the specifying process. The process of step S33 is an example of a status request process, the process of step S34 is an example of a status reception process, and the processes of steps S35 to S37 are an example of a first determination process.

  That is, in response to the SFL information corresponding to the operation ID “print” received from the MFP 10A indicating the locked state (S35: Yes), the operation instruction program 65 locks the device icon 131 corresponding to the MFP 10A. The image 126 is added (S36). On the other hand, the operation instruction program 65 determines whether the SFL information corresponding to the operation ID “print” received from the MFP 10A indicates the unlocked state (S35: No) or after transmitting the SFL request information. In response to the fact that the SFL information could not be received from the multifunction device 10A even after the elapse of time (S34: No), the key image 126 is not added to the device icon 131 corresponding to the multifunction device 10A (S37). Similarly, the display mode of the device icon 132 of the multifunction device 10B is determined based on the SFL information corresponding to the operation ID “print” received from the multifunction device 10B.

  Next, the operation instruction program 65 causes the display unit 53 to display a device selection screen including the device icons 131 and 132 having the display mode determined in the first determination process (S39). FIG. 16B shows an example of a device selection screen including a device icon 131 to which the key image 126 is not added and a device icon 132 to which the key image 126 is added. The device selection screen according to the second embodiment is different from the first embodiment in that the device selection screen may include a device icon 132 to which a key image 126 is added, for example, as illustrated in FIG. The process of step S39 in the second embodiment is an example of a second display process.

  Next, the operation instruction program 65 causes the display unit 53 to display an error screen in response to receiving the designation of the device icon 132 to which the key image 126 is added through the operation unit 54 (S40: No) (S42). . FIG. 17A is an example of an error screen 170 when the device icon 132 of FIG. 16B is designated. Then, the operation instruction program 65 accepts designation of an icon included in the error screen 170 through the operation unit 54 (S43). The process of step S42 is an example of a third display process, and the process of step S43 is an example of a reception process.

  An error screen 170 shown in FIG. 17A is a pop-up screen superimposed on the device selection screen displayed immediately before. The error screen 170 shown in FIG. 17A is displayed with a message “Print operation is locked by the administrator. Please check with the administrator.”, An “OK” icon 171, and a “Reselect” icon. 172. [OK] icon 171 is an example of a confirmation object corresponding to confirmation of the content of notification through error screen 170. [Reselection] icon 172 is an example of a redesignated object corresponding to an instruction to redesignate device icons 131 and 132.

  That is, the operation instruction program 65 ends the device selection process without changing the designated device in response to the designation of the [OK] icon 136 being accepted through the operation unit 54 (S43: OK icon), and displays the preview screen. It is displayed again on the display unit 53 (S129). On the other hand, the operation instruction program 65 displays the device selection screen on the display unit 53 again (S39) in response to accepting the designation of the [reselection] icon 172 through the operation unit 54 (S43: reselection icon).

  On the other hand, the operation instruction program 65 executes the switching process (S41) in response to receiving the designation of the device icon 131 to which the key image 126 is not added through the operation unit 54 (S40: Yes), and performs the device selection process. , And the processes after step S123 are executed again. In the device selection process according to the second embodiment, only the multifunction peripheral 10A capable of executing the designated operation can be selected. Therefore, in step S129 executed after step S132, the operation instruction program 65 displays the preview screen shown in FIG. Is displayed on the display unit 53. The preview screen shown in FIG. 17B includes a device icon 166 in which the device ID “MFP-A” of the multifunction peripheral 10A, which is a new designated device, is described, and a print icon 167 that can be designated.

  Next, the operation instruction program 65 prints through the communication unit 55 to the multifunction peripheral 10A, which is the designation device, in response to accepting the designation of the print icon 167 in a specifiable mode through the operation unit 54 (S130: print icon). Instruction information is transmitted (S131). The processing in step S131 and the processing of the multifunction peripheral 10A that has received the print instruction information may be the same as in step S58. The process of step S131 is an example of a first output instruction process. On the other hand, the operation instruction program 65 may cause the display unit 53 to display an error screen in response to accepting the designation of the print icon 167 in a mode that cannot be designated through the operation unit 54, or may do nothing. .

[Effects of Second Embodiment]
According to the second embodiment, the operation instruction program 65 is activated from the map program 66 due to an operation on the map program 66 by the user of the portable terminal 50. Then, in the external activation process, the operation instruction program 65 determines whether or not the designated operation is in the locked state in the designated device, and if it is in the locked state, notifies the user of the portable terminal 50 to that effect. Thereby, it is possible to make the user recognize that the designated operation cannot be executed. In particular, when the map program 66 does not notify the user whether or not the designated operation is in the locked state, the designated operation is in the locked state while the user is operating the map program 66 such as designating designated data. I can not know if it is.

  Here, according to the second embodiment, if the designated operation is in the unlocked state in the designated device, the user of the portable terminal 50 can perform an operation for instructing the designated device to execute the designated operation. On the other hand, if the designated operation is in the locked state in the designated device, the user of the portable terminal 50 can recognize from the notification from the portable terminal 50 that the designated operation cannot be performed on the designated data due to the locked state.

  In addition, according to the device selection process of the second embodiment, among a plurality of communicable multifunction peripherals 10, a multifunction peripheral 10B in which execution of a designated operation is restricted, and a multifunction peripheral 10A in which execution of a designated action is not restricted. Can be recognized by the user. As a result, it is possible to prompt the multifunction peripheral 10A, whose execution of the designated device is not restricted, to be a new designated device.

  Further, according to the second embodiment, an error screen is displayed in response to designation of the device icon 132 to which the key image 126 is added. As a result, the user can recognize that execution of the designated operation is restricted in the designated multifunction machine 10. In addition, since the error screen includes an [OK] icon 171 and a [reselection icon 172], the switching of the designated device is canceled to return to the preview screen, or the device selection screen is displayed to reselect the designated device. The user can select whether to return.

  The operation instruction program 65 is activated from the OS 64 of the mobile terminal 50 without being caused by a user operation on the map program 66 and from the map program 66 due to a user operation on the map program 66. The behavior differs depending on the case. More specifically, the operation instruction program 65 when activated from the OS 64 displays the main screen shown in FIG. 11B in order to allow the user to specify an output operation desired by the user among a plurality of output operations. To do. At this time, the user of the portable terminal 50 can specify the output operation after recognizing whether the output operation is in the locked state or the unlocked state. On the other hand, when the operation instruction program 65 is activated from the map program 66, the user of the portable terminal 50 can instruct execution of the operation if the designated operation is in the unlocked state, and if the designated operation is in the locked state, You can recognize that.

  In the first and second embodiments, the processing related to the display of the preview screen is different in the following points. First, the preview screen displayed in step S53 and the preview screen displayed in step S129 are different depending on the presence or absence of the device icon 166, and are common in other points. That is, the operation instruction program 65 does not include the device icon 166 in the preview screen displayed in the standard activation process, but includes the device icon 166 in the preview screen displayed in the external activation process.

  The operation instruction program 65 causes the display unit 53 to display a preview screen in response to the operation icon 121 without the key image 126 added being designated in the standard activation process (S33: Yes) (S51). When the operation icon 121 to which the key image 126 is added is designated (S33: No), the preview screen is not displayed on the display unit 53. That is, the preview screen in the standard activation process can be displayed only when the SFL information corresponding to the designated operation ID indicates an unlocked state.

  On the other hand, in the external activation process, the operation instruction program 65 displays a preview screen on the display unit 53 regardless of whether or not the SFL information corresponding to the designated operation ID indicates an unlocked state (S129). Instead, in the external activation process, the operation instruction program 65 notifies that the SFL information corresponding to the designated operation ID is in an unlocked state by an error screen (S126) and a grayout (S127) of the print icon 167.

  Therefore, in the second embodiment, the designation data determined in step S52 is used as the second designation data, and is distinguished from the first designation data identified by the designation data ID acquired in step S121. In addition, the action determined in response to the action icon 121 being designated in the first embodiment is set as the second designated action, which is distinguished from the first designated action identified by the designated action ID acquired in step S121. Also, the print icon 146 displayed in step S53 is set as the second output instruction object, and is distinguished from the print icon 167 that is the first output instruction object. Further, the output instruction information output in step S58 is set as second output instruction information, and the output instruction information transmitted in step S131 is distinguished from the first output instruction information. Furthermore, in the second embodiment, steps S14 to S17 in FIG. 4 are the second determination process, step S19 in FIG. 4 is the fourth display process, step S53 in FIG. 6 is the fifth display process, and step S58 in FIG. Is differentiated from the other processes in the second embodiment as the second output process.

  Further, in the MFP 10 and the portable terminal 50 according to the above-described embodiment, the CPU 31 and 61 execute various programs stored in the program storage areas 32A and 62A of the storage units 32 and 62, whereby the control unit of the present invention. An example in which each process executed by is implemented has been described. However, the configuration of the control unit is not limited to this, and part or all of the configuration may be realized by hardware such as an integrated circuit (also referred to as an IC (Integrated Circuit)).

  Furthermore, the present invention may be realized not only as the multifunction device 10 and the portable terminal 50 but also as a program that causes the multifunction device 10 and the portable terminal 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include a storage unit mounted on a server that can be connected to the MFP 10 and the portable terminal 50 through the communication network 101 in addition to a CD-ROM, a DVD-ROM, and the like. And the program memorize | stored in the memory | storage part of the server may be distributed through the communication networks 101, such as the internet, as the information or signal which shows the said program.

DESCRIPTION OF SYMBOLS 10 ... Multifunction machine 11 ... Printer part 12 ... Scanner part 13 ... FAX part 25, 55 ... Communication part 31, 61 ... CPU
35 ... device program 65 ... operation instruction program 66 ... map program 50 ... portable terminal 53 ... display unit 54 ... operation unit 62 ... storage unit

Claims (11)

A program that can be read by a portable terminal including a communication unit, a storage unit, a display unit, and an operation unit, and the communication unit is capable of communicating with an image output device capable of executing an output operation on image data. The storage unit can store device identification information for storing a start source program and identifying a designated device that is one of the image output devices,
The program
It is activated from the activation source program due to a user operation to the activation source program,
A reception process for accepting a user operation for designating an object displayed on the display unit through the operation unit;
The portable terminal is caused to execute acquisition processing for acquiring designated data information and designated operation information, and the designated data information is information for identifying first designated data designated by the activation source program through the operation unit. The designated operation information is information for identifying the first designated operation executed by the image output apparatus on the first designated data and designated by the activation source program ;
The program
Status request processing for transmitting lock status request information for requesting lock status information to the designated device through the communication unit;
A state reception process for receiving the lock state information from the designated device through the communication unit;
A determination process for determining whether the received lock state information indicates a locked state that restricts execution of the first designated operation or an unlocked state that does not restrict execution of the first designated operation;
In response to determining that the locked state information indicates the unlocked state, the portable terminal is caused to execute a first display process for displaying a first screen including a first output instruction object on the display unit,
The program performs a first output instruction process for transmitting first output instruction information to the designation device through the communication unit in response to accepting a user operation for designating the first output instruction object in the acceptance process. The first output instruction information is information for causing the portable terminal to execute the first designation operation on the first designation data,
In response to determining that the lock state information indicates the lock state, the program executes notification processing for notifying that the execution of the first designated operation is restricted in the designated device to the mobile terminal. Program to make. The lock state request information includes the designated operation information acquired in the acquisition process,
The lock state information indicates the lock state indicating that execution of the operation identified by the designated operation information included in the lock state request information is restricted in the designated device, and indicates that the operation is not restricted. The program according to claim 1, which is information indicating any one of the non-lock states. The first display process includes the first screen including the first output instruction object that can be specified through the operation unit in response to determining that the lock state information indicates the non-lock state. It is a process to display on the display unit,
In response to determining that the lock state information indicates the lock state, the notification process displays, on the display unit, the first screen including the first output instruction object that cannot be specified through the operation unit. The program according to claim 1, wherein the program is a process for display. The program
Regardless of the result of the determination process, the portable terminal is caused to execute the first display process,
The program according to any one of claims 1 to 3, which causes the portable terminal to execute the notification process prior to the first display process. The first screen includes a switching object,
The program
In response to accepting a user operation for designating the switching object in the accepting process, a specifying process for specifying a plurality of the image output devices that can communicate through the communication unit;
The state request process for transmitting the lock state request information through the communication unit to each of the plurality of image output devices specified by the specifying process;
The state receiving process for receiving the lock state information through the communication unit from each of the plurality of image output devices specified in the specifying process;
A first determination process for determining a display mode of a device object, which is the object corresponding to each of the plurality of image output devices specified in the specification process, based on the lock state information received in the state reception process; Run it on your mobile device,
In the first determination process, the program includes:
In response to the lock state information indicating the lock state, the device object corresponding to the image output device that is the transmission source of the lock state information is determined as the first mode,
In response to the lock state information indicating the non-lock state, the device object corresponding to the image output device that is the transmission source of the lock state information is determined in a second mode different from the first mode,
The program
A second display process for causing the display unit to display a second screen including a plurality of the device objects in the display mode determined in the first determination process;
The device identification information of the image output device corresponding to the specified device object is stored in response to receiving a user operation specifying the device object of the second aspect in the reception process. Switching processing for overwriting the device identification information already stored in the unit,
The portable terminal causes the portable terminal to execute the state request process, the state reception process, the determination process, and the first display process for the new designated device identified by the device identification information overwritten in the storage unit. The program according to any one of 1 to 4.   The program executes the first designation operation in the image output apparatus corresponding to the designated device object in response to accepting a user operation for designating the device object of the first aspect in the acceptance process. The program according to claim 5, wherein the portable terminal is caused to execute a third display process for causing the display unit to display a third screen for informing that the display is restricted. The third screen includes a redesignation object corresponding to an instruction to redesignate the device object,
The program according to claim 6, wherein the program causes the mobile terminal to execute the second display process in response to accepting a user operation for designating the redesignated object in the accepting process. The third screen includes a confirmation object corresponding to confirming the content of the notification,
The program according to claim 6 or 7, wherein the program causes the portable terminal to execute the first display process again in response to receiving a user operation for designating the confirmation object in the reception process.   The program according to any one of claims 1 to 8, wherein the first screen further includes a preview image indicating a result of executing the first designation operation on the first designation data. In response to being activated by the OS of the mobile terminal that has received a user operation for instructing activation of the program,
The status request processing;
The state reception process;
The portable terminal is caused to execute a second determination process for determining a display mode of a plurality of action objects based on the lock state information received in the state reception process, and the action object is executable by the designated device Corresponding to one of a plurality of pieces of operation identification information for identifying each of the plurality of output operations,
In the second determination process, the program
In response to the lock state information indicating that the action identified by the action identification information is in the locked state, the action object corresponding to the action identification information is determined as the first mode,
In response to the fact that the lock state information indicates that the action identified by the action identification information is the unlocked state, the action object corresponding to the action identification information is changed to a second aspect different from the first aspect. Decide
The program
A fourth display process for causing the display unit to display a fourth screen including a plurality of the motion objects in the display mode determined in the second determination process;
The fifth output instruction object includes a second output instruction object only when a user operation for designating one of the action objects of the second aspect of the first aspect and the second aspect is accepted in the acceptance process. Causing the mobile terminal to execute a fifth display process for displaying a screen on the display unit;
The program performs a second output instruction process for transmitting second output instruction information to the designation device through the communication unit in response to accepting a user operation for designating the second output instruction object in the acceptance process. The second output instruction information, which is executed by a portable terminal, is information for causing the program to execute a second designation operation on second designation data which is image data for which designation is accepted through the operation unit. The specified action is the output action identified by the action identification information corresponding to the action object that has received the designation in the acceptance process among the plurality of action objects included in the fourth screen. 10. The program according to any one of 9. A communication department;
A storage unit;
A display unit;
An operation unit;
A portable terminal comprising a control unit,
The communication unit can communicate with an image output device capable of executing an output operation on image data.
The storage unit stores an activation source program and an output program, and can store device identification information for identifying a designated device that is one of the image output devices,
The control unit that executes the output program started from the boot source program due to a user operation on the boot source program,
A reception process for accepting a user operation for designating an object displayed on the display unit through the operation unit;
Acquisition processing for acquiring designated data information and designated operation information, wherein the designated data information is information for identifying first designated data designated by the activation source program through the operation unit; Operation information is information for identifying the first designated operation executed by the image output device on the first designated data and designated by the activation source program ,
The controller is
Status request processing for transmitting lock status request information for requesting lock status information to the designated device through the communication unit;
A state reception process for receiving the lock state information from the designated device through the communication unit;
A determination process for determining whether the received lock state information indicates a locked state that restricts execution of the first designated operation or an unlocked state that does not restrict execution of the first designated operation;
In response to determining that the lock state information indicates the non-lock state, a first display process for displaying a first screen including a first output instruction object on the display unit is performed.
The control unit performs a first output instruction process for transmitting first output instruction information to the designation device through the communication unit in response to receiving a user operation for specifying the first output instruction object in the reception process. The first output instruction information is information for executing the first designation operation on the first designation data,
In response to determining that the lock state information indicates the lock state, the control unit performs a notification process for notifying that the execution of the first designated operation is restricted in the designated device. .