JP6634880B2 - Program and terminal device - Google Patents

Description

  The present invention relates to a program for operating a terminal device according to a user's instruction through a touch panel.

  2. Description of the Related Art Conventionally, there has been known a terminal application that allows a user to specify content data and causes an image processing apparatus to execute an operation on the specified content data. For example, the application described in Patent Literature 1 instructs a printer to perform a print operation on scanner data in response to a touch of a print button.

JP 2012-203742 A

  A user who uses the application having the above configuration may want to check the status of the printer before touching the print button. However, in many conventional applications, the status of the printer is displayed on the display unit in response to the touch of a button different from the print button, and after confirming the status of the printer, the printer is instructed to perform a printing operation. There is a problem that the user operation until the operation becomes complicated.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a terminal device program capable of confirming the state of an image processing device and instructing the image processing device to operate by a simple operation. To provide.

  The program described in this specification can be executed by a terminal device that includes a display unit having a display surface, a touch sensor that is arranged on the display surface to detect a touch operation, and a communication unit. The communication unit includes: a first display process for displaying an execution instruction object on the display surface; and the communication unit in response to the touch sensor detecting that a first operation on a position of the execution instruction object is executed. And a receiving process for receiving status information from the image processing apparatus through the terminal device. The status information is information indicating a state of the image processing apparatus. The program, based on the status information received in the receiving process, in response to the touch sensor detecting that the first operation for the position of the execution instruction object has changed to a second operation, A first determination process for determining whether or not the image processing apparatus can perform an operation with respect to a command, and an execution instruction for instructing execution of the operation in response to the first determination process determining that the operation can be performed. And an execution instruction process of transmitting information to the image processing apparatus through the communication unit.

  A terminal device described in this specification includes a display unit having a display surface, a touch sensor that is arranged to overlap the display surface and detects a touch operation, a communication unit, and a control unit. The control unit is configured to perform a first display process of displaying an execution instruction object on the display surface, and perform the communication in response to the touch sensor detecting that a first operation on a position of the execution instruction object is performed. And receiving processing for receiving status information from the image processing apparatus through the unit. The status information is information indicating a state of the image processing apparatus. The controller, based on the status information received in the receiving process, in response to the touch sensor detecting that the first operation for the position of the execution instruction object has changed to the second operation, based on the status information, A first determination process for determining whether the image processing apparatus can perform an operation on data, and an execution for instructing execution of the operation in response to the first determination process determining that the operation can be performed. And an execution instruction process of transmitting instruction information to the image processing apparatus through the communication unit.

  According to the configuration, the status information of the image processing apparatus is received by the first operation on the execution instruction object, and whether the operation can be executed is determined based on the status information when the first operation is changed to the second operation. . Then, in response to the determination that the operation is executable, the image processing apparatus is instructed to execute the operation. That is, the user of the terminal device can confirm the state of the image processing apparatus and issue an operation instruction to the image processing apparatus by a simple operation.

FIG. 1 is a block diagram of a multifunction peripheral 10 and a terminal device 50 that constitute a system 100 according to the embodiment. 2A and 2B show examples of data stored in the memory 62. FIG. 2A shows the designated device ID, FIG. 2B shows the condition information, and FIG. 2C shows the condition information updated in S56. FIG. 3 is a flowchart of the main process. FIG. 4A is a flowchart of the data selection process, and FIG. 4B is a flowchart of the preview process. FIG. 5 is a flowchart of the 3D touch process. FIG. 6 is a flowchart of the condition changing process. FIGS. 7A and 7B are display examples of the display unit 53, wherein FIG. 7A shows a main screen and FIG. 7B shows a status screen. FIG. 8 is a display example of the display unit 53, in which (A) is an example of a data selection screen, and (B) is an example of a condition notification screen superimposed on the data selection screen. FIG. 9 shows a display example of the display unit 53, in which (A) shows a condition change screen superimposed on a data selection screen, and (B) shows a preview screen. FIGS. 10A and 10B are display examples of the display unit 53. FIG. 10A shows an individual notification screen superimposed on the preview screen, and FIG. 10B shows an individual change screen superimposed on the preview screen. 11A and 11B are display examples of the display unit 53, in which FIG. 11A shows an overall notification screen superimposed on the preview screen, and FIG. 11B shows an overall change screen superimposed on the preview screen. FIGS. 12A and 12B are display examples of a status notification screen superimposed on a preview screen, wherein FIG. 12A shows a case where a print operation can be executed, and FIG. 12B shows a case where a print operation cannot be executed. FIGS. 13A and 13B are display examples of the display unit 53. FIG. 13A shows a device change screen superimposed on a preview screen, and FIG. 13B shows a help screen superimposed on the preview screen.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be appropriately changed without changing the gist of the present invention. For example, the execution order of each process described below can be appropriately changed without changing the gist of the present invention.

  FIG. 1 is a schematic diagram of a system 100 according to the present embodiment. The system 100 shown in FIG. 1 includes a multifunction device 10 and a terminal device 50. Note that the system 100 may include a plurality of MFPs 10. In addition, the system 100 may include a single function printer, a single function scanner, a single function FAX machine, or the like, instead of the multifunction peripheral 10. The multi-function device 10 and the terminal device 50 are configured to be able to communicate via the communication network 101. The communication network 101 may be, for example, a wired LAN, a wireless LAN, or a combination thereof.

  As shown in FIG. 1, the MFP 10 includes a printer 11, a scanner 12, a facsimile unit 13, a display unit 23, an operation unit 24, a communication unit 25, a CPU 31, a memory 32, a communication bus 33 mainly. The components of the multifunction peripheral 10 are interconnected via a communication bus 33. The multifunction device 10 is an example of an image processing device.

  The printer 11 performs a recording operation for recording an image represented by image data on a sheet. As a recording method of the printer 11, a known method such as an ink jet method or an electrophotographic method can be adopted. The scanner 12 performs a scanning operation of reading an image recorded on a document and generating image data. The facsimile unit 13 performs a facsimile transmission operation of facsimile transmitting image data according to the facsimile protocol and a facsimile reception operation of facsimile receiving the image data according to the facsimile protocol.

  The multifunction peripheral 10 may be capable of executing a copy operation of recording image data generated by the scan operation on a sheet by a print operation, or may output the image data generated by the scan operation to a designated output destination (for example, An operation of outputting to the terminal device 50, a server (not shown), or the like) may be executable. The print operation, the scanner operation, the copy operation, the FAX transmission operation, and the FAX reception operation are examples of the operation of the image processing apparatus. The print operation and the fax transmission operation are examples of the output operation.

  The display unit 23 is a liquid crystal display, an organic EL display, or the like, and has a display surface on which various information is displayed.

  The operation unit 24 is a user interface that receives an input operation by a user. Specifically, the operation unit 24 has a button, and outputs various operation signals associated with the pressed button to the CPU 31. Further, the operation unit 24 may include a film-shaped touch sensor superimposed on the display surface of the display unit 23. An operation of designating an object displayed on the display surface of the display unit 23 and an operation of inputting a character string or a number string are examples of a user operation. The “object” is, for example, a character string, an icon, a button, a link, a radio button, a check box, a pull-down menu, or the like displayed on the display unit 23.

  The operation unit 24 implemented as a touch sensor outputs position information indicating a position on the display surface touched by the user. Note that “touch” in this specification includes all operations for bringing an input medium into contact with a display surface. In addition, even if the input medium does not touch the display surface, the term “hover” or “floating touch” for bringing the input medium close to a position where the distance between the input surface and the display surface is very small is based on the concept of the aforementioned “touch”. May be included. Further, the input medium may be a user's finger, a touch pen, or the like. The user operation of tapping the position of the icon displayed on the display unit 23 is an example of a specifying operation for specifying the icon.

  The communication unit 25 is an interface for communicating with an external device via the communication network 101. That is, the MFP 10 outputs various information to the terminal device 50 through the communication unit 25 and receives various data or various information from the terminal device 50 through the communication unit 25. Although the specific communication procedure of the communication unit 25 is not particularly limited, for example, Wi-Fi (a registered trademark of the Wi-Fi Alliance) can be adopted. However, a specific example of the communication unit 25 is not limited to the above example, and may be, for example, an interface to which a LAN cable or a USB cable is attached and detached.

  The CPU 31 controls the overall operation of the MFP 10. The CPU 31 acquires various programs, which will be described later, from the memory 32 based on various signals output from the operation unit 24 and various information acquired from an external device through the communication unit 25, and executes the programs. That is, the CPU 31 and the memory 32 constitute an example of a control unit.

  The memory 32 has a program storage area 32A and a data storage area 32B. The area 32A stores the OS 34 and the device program 35. Note that the device program 35 may be a single program or an aggregate of a plurality of programs. In the area 32B, data or information necessary for executing the device program 35 is stored. The memory 32 is configured by, for example, a RAM, a ROM, an EEPROM, a HDD, a portable storage medium such as a USB memory that can be attached to and detached from the MFP 10, a buffer included in the CPU 31, or a combination thereof.

  The memory 32 may be a computer-readable storage medium. The computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROMs and DVD-ROMs in addition to the above examples. Further, a non-transitory medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server or the like on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but is a non-transitory computer-readable storage medium. Not included in the medium. The same applies to the memory 62 of the terminal device 50 described later.

  In response to receiving the transmission request information from the terminal device 50 through the communication unit 25, the device program 35 transmits the status information to the terminal device 50 through the communication unit 25 as a response to the transmission request information. The status information is information indicating a state of the MFP 10. More specifically, the status information is information indicating whether the MFP 10 is in a state in which various operations can be executed. The status information includes, for example, some or all of the following items. Various information included in the status information may be stored in the memory 32, or may be detected by a known sensor.

  The status information according to the present embodiment includes ink information and sheet information. The ink information indicates the remaining amount of ink in the ink cartridge mounted on the printer 11. The ink information according to the present embodiment indicates the remaining amount of each of the cyan ink, magenta ink, yellow ink, and black ink. The sheet information indicates the amount of sheets stored in a paper feed tray mounted on the printer 11.

  Further, the status information may include double-sided availability information indicating an ability to record an image on both sides of a sheet. The status information may include aggregation enable / disable information indicating whether or not N (N = 1, 2, 4, 9,...) Images can be aggregated and recorded on one sheet. Good. Further, the status information may include size information indicating the size of the sheet stored in the sheet feeding tray. Further, the status information may include toner information indicating the remaining amount of toner in the toner cartridge mounted on the printer 11 when the printer 11 employs the electrophotographic method.

  Further, the status information may include management information. The management information is information that can be browsed only by the administrator of the multifunction peripheral 10, and may include, for example, performance information indicating the operation performance of the printer 11, security information indicating the content of security set in the printer 11, and the like. . The performance information may indicate, for example, the cumulative number of rotations of the drum mounted on the printer 11, the cumulative number of sheets on which images are recorded by the printer 11, and the like. The security information may indicate, for example, whether or not a so-called SFL (abbreviation of Secure Function Lock) that allows only a specific user to use is set in the multifunction peripheral 10.

  The specific example of the status information described above is an item indicating whether or not the printer 11 can execute the printing operation. However, the items included in the status information are not limited to these items, and the scanner 12 can execute the scanning operation. May be included, or an item indicating whether the FAX unit 13 can execute a FAX transmission operation or a FAX reception operation may be included.

  The terminal device 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 61, a memory 62, and a communication bus 63, as shown in FIG. The display unit 53, the communication unit 55, the CPU 61, the memory 62, and the communication bus 63 included in the terminal device 50 are the same as the display unit 23, the communication unit 25, the CPU 31, the memory 32, and the communication bus 33 included in the MFP 10. Therefore, the description is omitted. The CPU 61 and the memory 62 constitute an example of a control unit. Although a specific example of the terminal device 50 is not particularly limited, it is, for example, a mobile phone, a smartphone, a tablet terminal, or a PC.

  The display unit 53 includes a display surface on which various screens are displayed. The display surface may refer to, for example, a plate-shaped transparent member (for example, a glass plate or the like) exposed on the surface of the terminal device 50. “Displaying various screens on the display surface” refers to, for example, a state where the screen displayed by the display unit 53 is visible to the user through the display surface.

  The operation unit 54 is an input interface for receiving various operations by the user. The operation unit 54 according to the present embodiment includes a film-shaped pressure sensor 54A and a position sensor 54B superimposed on the display surface of the display unit 53. That is, the display unit 23 is configured as a touch panel display. The pressure sensor 54A and the position sensor 54B are an example of a touch sensor that outputs an operation signal according to a touch operation on a display surface of the display unit 53, that is, a glass plate exposed on the surface of the terminal device 50.

  The pressure sensor 54A outputs to the CPU 61 a pressure signal corresponding to the pressure applied to the display surface by the input medium. The pressure sensor 54A outputs a first pressure signal in response to the display surface being pressed with a pressing force less than the first pressure. The pressure sensor 54A outputs a second pressure signal in response to the display surface being pressed with a pressing force equal to or higher than the first pressure and lower than the second pressure. Further, the pressure sensor 54A outputs a third pressure signal in response to the display surface being pressed with a pressing force equal to or higher than the second pressure. Note that the second pressure is higher than the first pressure. Alternatively, the pressure sensor 54A may output a pressure signal indicating the pressure value applied to the display surface to the CPU 61. In this case, the CPU 61 compares the pressure value indicated by the pressure signal with the threshold value.

  The position sensor 54B outputs to the CPU 61 a position signal corresponding to the position on the display surface where pressure is applied by the input medium. The position signal indicates, for example, coordinates (x, y) on an xy plane where the upper left end of the display surface is the origin, the right direction is the positive direction of the x-axis, and the downward direction is the positive direction of the y-axis. In addition, when the touch operation on the display surface is continuously performed, the position sensor 54B repeatedly outputs a position signal every predetermined detection cycle (for example, 10 msec).

  Note that “touch” in this specification includes all operations for bringing an input medium into contact with a display surface. That is, in addition to the above-described tap operation, peak operation, pop operation, slide operation, and flick operation described later, a long touch operation, a pinch-in operation, a pinch-out operation, and the like are examples of the touch operation. The peak operation is an example of a first operation, the pop operation is an example of a second operation, the slide operation or flick operation is an example of a third operation, and the tap operation is an example of a fourth operation.

  More specifically, the operation unit 54 detects that the tap operation on the position indicated by the position signal output from the position sensor 54B has been performed in response to the first pressure signal being output from the pressure sensor 54A. I do. The operation unit 54 detects that the peak operation for the position indicated by the position signal output from the position sensor 54B has been performed in response to the second pressure signal being output from the pressure sensor 54A. The operation unit 54 detects that the pop operation has been performed on the position indicated by the position signal output from the position sensor 54B in response to the third pressure signal being output from the pressure sensor 54A. The operation unit 54 detects that the slide operation or the flick operation has been performed in response to the continuous change of the position indicated by the position signal output from the position sensor 54B.

  The area 62B can store a designated device ID, for example, as shown in FIG. The designated device ID is device identification information for identifying the image processing device designated by the user (hereinafter, referred to as “designated device”). For example, the designated device ID is not stored in the area 62B when the terminal program 65 is installed, but is stored in the area 62B by the terminal program 65 in S13, S46, and the like described later. The area 62B includes communication information (for example, an IP address, a MAC address, an SSID, etc.) for specifying the designated device in the communication network 101, an operation ID for identifying an operation executable by the designated device, and the like, as the designated device ID. The information may be further stored in association with each other.

  In addition, the area 62B can store condition information indicating execution conditions of the printing operation, as shown in FIG. 2B, for example. For example, the condition information is not stored in the area 62B when the terminal program 65 is installed, but is stored in the area 62B by the terminal program 65 in S46, S56, S62 and the like. The condition information according to the present embodiment includes tray information, color information, recording surface information, and layout information. Further, the above-described designated device ID may be included in the condition information. Further, the area 62B may further store condition information indicating execution conditions of the scan operation, the FAX transmission operation, and the FAX reception operation.

  The tray information is information for specifying a tray from which a sheet on which an image is recorded in a print operation is fed. The color information is information indicating a color (for example, “monochrome” or “color”) used for the printing operation. The recording surface information is information indicating a surface of a sheet on which an image is to be recorded (for example, “one side”, “two sides”). The layout information is information indicating the number N (for example, “no aggregation”, “2in1”, “4in1”, etc.) of images to be aggregated and recorded on one sheet. That is, the condition information shown in FIG. 2B indicates that two images are aggregated and recorded in color on one side of the sheet stored in the tray 1. The tray information, the color information, the recording surface information, and the layout information are examples of items included in the condition information.

  Although not shown, a data folder may be provided in the area 62B. The data folder may store, for example, photo data, document data, presentation data, spreadsheet data, and the like. The data stored in the data folder includes one or more page data. The page data is data indicating an image recorded on one sheet when the layout information is “no aggregation”. Although not shown, the area 62B stores information (for example, a continuation flag) necessary for the process executed by the terminal program 65.

  The operation of the system 100 according to the present embodiment will be described with reference to FIGS.

  The flowchart in this specification basically shows the processing of the CPUs 31 and 61 according to the instructions described in the program. That is, the processes such as “determination”, “extraction”, “calculation”, “selection”, and “control” in the following description represent the processes of the CPUs 31 and 61. The processing by the CPU 61 also includes hardware control via the OS 64. Further, “data” in this specification is represented by a bit string that can be read by a computer. Data having substantially the same meaning but different formats is treated as the same data. The same applies to “information” in the present specification.

  The terminal program 65 of the terminal device 50 executes the main processing shown in FIG. 3 in response to being activated by the user. First, the terminal program 65 causes the display 53 to display the main screen shown in FIG. 7A (S11). The main screen includes operation icons 111, 112, 113, 114, a status icon 115, and a device icon 116. Then, the terminal program 65 receives a user operation on the main screen through the operation unit 54 (S12).

  The operation icon 111 corresponds to a print operation, the operation icon 112 corresponds to a scan operation, the operation icon 113 corresponds to a copy operation, and the operation icon 114 corresponds to a FAX transmission operation and a FAX reception operation. The status icon 115 corresponds to an instruction to display a status screen indicating the state of the designated device. The device icon 116 corresponds to an instruction to switch the designated device. The designated device ID “MFP-A” stored in the area 62B is described in the device icon 116 illustrated in FIG. 7A.

  Next, in response to the operation unit 54 detecting a tap operation on the position of the device icon 116 (S12: device icon), the terminal program 65 accepts, via the operation unit 54, a user operation for designating or changing the designated device. (S13). More specifically, the terminal program 65 searches for an image processing device connected to the communication network 101, displays a list of the found image processing devices on the display unit 53, and displays one of the displayed image processing devices. The designated user operation is received through the operation unit 54, and the device ID of the designated image processing device is stored in the area 62B as the designated device ID. Then, the terminal program 65 executes the processing after S11 again. When the designated device is changed in S13, a new designated device ID is described in the device icon 116 on the main screen.

  Next, the terminal program 65 displays the status screen shown in FIG. 7B on the display unit 53 in response to the operation unit 54 detecting a tap operation on the position of the status icon 115 (S12: status icon). (S14). The status screen includes a designated device ID, a communication state, a sheet remaining amount, an ink remaining amount, and an [OK] icon 121. More specifically, the terminal program 65 transmits the transmission request information to the multifunction device 10 as the designated device through the communication unit 55, and receives the status information transmitted from the multifunction device 10 as a response to the transmission request information through the communication unit 55. I do. Then, the terminal program 65 displays on the status screen the state of the MFP 10 indicated by the received status information.

  The device ID is a designated device ID stored in the area 62B. The communication state indicates whether communication with the designated device is possible or not. For example, “online” is displayed when status information is received, and “offline” is displayed when status information is not received. You. In the case of offline, no status information is received, and thus only the item names of the remaining sheet amount and the remaining ink amount are displayed on the status screen. The sheet remaining amount is the remaining amount of the sheet indicated by the sheet information included in the status information. The ink remaining amount is the remaining amount of ink indicated by the ink information included in the status information. Then, in response to the operation unit 54 detecting a tap operation on the position of the [OK] icon 121, the terminal program 65 executes the processing of S11 and subsequent steps again.

  Next, the terminal program 65 determines the print operation as the designated operation, for example, in response to the operation unit 54 detecting a tap operation on the position of the operation icon 111 (S12: print icon). Hereinafter, the process from step S15 will be described on the assumption that the print operation is determined to be the designated operation. However, if another operation is determined to be the designated operation, the process corresponding to each operation is executed. . Then, the terminal program 65 executes a data selection process (S15). The data selection process is a process for allowing a user to select data to be subjected to a printing operation (hereinafter, referred to as “designated data”). The details of the data selection process will be described with reference to FIG.

  First, the terminal program 65 causes the display unit 53 to display the data selection screen shown in FIG. 8A (S21). The data selection screen includes a plurality of data icons 131, 132, and 133. The data icons 131 to 133 are examples of data objects corresponding to various data stored in a data folder or various data stored in a server (not shown) on the Internet, for example. Then, the terminal program 65 receives a user operation on the data selection screen through the operation unit 54 (S22).

  Next, the terminal program 65 executes a 3D touch process in response to, for example, the operation unit 54 detecting a peak operation for the position of the data icon 133 (S22: peak) (S23). The 3D touch refers to a function that can assign different processes to touch operations having different pressing forces (for example, a tap operation, a peak operation, and a pop operation). The 3D touch process is a process of displaying various information and receiving various operations according to the type of touch operation on the icon. The details of the 3D touch processing will be described with reference to FIG.

  First, the terminal program 65 transmits the transmission request information to the multifunction device 10 as the designated device through the communication unit 55, and receives the status information transmitted from the multifunction device 10 as a response to the transmission request information through the communication unit 55 (S41). ). Next, the terminal program 65 causes the display unit 53 to display the condition notification screen shown in FIG. 8B (S42). The condition notification screen according to the present embodiment is a pop-up window that is displayed so as to overlap the data selection screen. The process of S41 is an example of a reception process, and the process of S42 is an example of a second display process. Then, the terminal program 65 receives a user operation on the condition notification screen through the operation unit 54 (S43).

  The condition notification screen is a screen that notifies the execution condition of the printing operation indicated by the condition information stored in the area 62B. Further, on the condition notification screen, the terminal program 65 executes the execution of obstructing the execution of the print operation in the state indicated by the status information received in S41 among the plurality of execution conditions indicated by the condition information stored in the area 62B. [X] image 141 is displayed in association with a condition (hereinafter, referred to as “inhibition condition”). On the other hand, when the inhibition condition does not exist, the [x] image 141 is not displayed on the condition notification screen.

  As an example, the terminal program 65 responds to the fact that the remaining amount of cyan ink indicated by the ink information included in the status information is less than a threshold (for example, 10%), as shown in FIG. It is determined that the color information “color” is the inhibition condition, and the [×] image 141 is displayed in association with the inhibition condition. The same applies to the case where the remaining amount of the magenta ink or the yellow ink is less than the threshold. As another example, the terminal program 65 determines that the tray information “Tray 1” is an inhibition condition in accordance with the fact that the remaining sheet amount of the tray 1 indicated by the sheet information included in the status information is 0%. .

  Displaying the [x] image 141 is an example of specifying the inhibition condition. However, the specific method of specifying the inhibition condition is not limited to this. As an example, the terminal program 65 may highlight the inhibition condition. As another example, the terminal program 65 may display the inhibition condition above the other execution conditions on the condition notification screen. As still another example, the terminal program 65 may display only the impeding condition on the condition notification screen and hide the execution condition that is not the impeding condition.

  Next, in response to the operation unit 54 detecting that the peak operation detected in S22 has been changed to the slide operation (S43: slide), the terminal program 65 changes the condition change screen shown in FIG. Then, it is displayed on the display unit 53 instead of the condition notification screen (S44). The condition change screen according to the present embodiment is a pop-up window displayed so as to overlap the data selection screen. The process of S44 is an example of a fourth display process. Note that the operation unit 54 performs the peak operation in response to the continuous change in the position indicated by the position signal output from the position sensor 54B while the second pressure signal is output from the pressure sensor 54A. Detects a change to a slide operation. Then, the terminal program 65 receives a user operation on the condition change screen through the operation unit 54 (S45).

  The condition change screen is a screen for prompting the change of the inhibition condition. The condition change screen shown in FIG. 9A includes a message “Change color settings to monochrome?”, A [YES] icon 142 and a [NO] icon 143. That is, the condition change screen shown in FIG. 9A is a screen for urging the user to change the color information of the condition information stored in the area 62B from “color” to “monochrome”. Note that the content displayed on the condition change screen differs depending on which execution condition becomes the inhibition condition.

  Next, in response to the operation unit 54 detecting a tap operation on the position of the [YES] icon 142 (S45: Yes), the terminal program 65 stores the content prompted by the condition change screen in the area 62B. The updated condition information is updated (S46). That is, the terminal program 65 according to the present embodiment changes the color information from “color” to “monochrome” in the condition information stored in the area 62B. [YES] The tap operation on the icon 142 is an example of a touch operation for instructing a change in the execution condition. On the other hand, the terminal program 65 skips the process of S46 in response to the operation unit 54 detecting a tap operation on the position of the [NO] icon 143 (S45: No).

  Next, the terminal program 65 determines whether or not the designated device in the state indicated by the status information received in S41 can execute a print operation according to the execution condition indicated by the condition information stored in the area 62B. (S47). When the execution condition is changed in S46, the terminal program 65 determines whether or not the designated device can execute the print operation according to the changed execution condition. The process of S47 is an example of a first determination process.

  For example, in step S47, the terminal program 65 determines whether or not the status information has been received in S41, whether or not the remaining ink amount indicated by the ink information included in the received status information is equal to or greater than a threshold value, and whether or not the received status information is included. It may be determined whether or not the remaining sheet amount indicated by the sheet information is greater than 0%. In addition, the terminal program 65 may compare only the remaining amount of black ink with the threshold value in the case of the color information “monochrome” stored in the area 62B. What is necessary is just to compare with a threshold value.

  Then, the terminal program 65 determines that the designated device can execute the printing operation in response to satisfying all the above conditions (S47: Yes). Then, the terminal program 65 sets the first value “ON” in the continuation flag (S48), and ends the 3D touch process. On the other hand, the terminal program 65 determines that the designated device cannot execute the printing operation when at least one of the above-mentioned conditions is not satisfied (S47: No). Then, the terminal program 65 sets the second value “OFF” to the continuation flag (S49), and ends the 3D touch processing.

  On the other hand, in response to the operation unit 54 detecting that the peak operation detected in S22 has changed to the pop operation (S43: pop), the terminal program 65 executes the processing in S47 and subsequent steps without executing the processing in S44 to S46. Execute the processing of Also, when a slide operation is performed when the inhibition condition does not exist, the processing of S44 to S46 may be skipped. Further, in response to the operation unit 54 detecting that the input medium during the peak operation has been separated from the display surface (S43: separation), the terminal program 65 does not execute the processing of S44 to S48 and executes the processing of S49. Execute the process.

  Next, returning to FIG. 4A, the terminal program 65 determines the set value of the continuation flag (S24). Then, in response to determining that the first value “ON” is set in the continuation flag (S24: ON), the terminal program 65 sets the data “presentation” corresponding to the data icon 133 at the position where the peak operation is detected. .PPT "is determined as the designated data (S25). That is, the terminal program 65 temporarily stores the data ID of the data “Presentation.PPT” associated with the data icon 133 as the designated data ID in the area 62B. The process of S25 is an example of a determination process.

  On the other hand, in response to determining that the second value “OFF” is set in the continuation flag (S24: OFF), the terminal program 65 executes the processing of S21 and subsequent steps again. That is, the terminal program 65 causes the display unit 53 to display the data selection screen by not displaying the screen displayed in S42 and S44 and proceeding to the processing after S25. At this time, the terminal program 65 may cause the display unit 53 to display a message such as “Printing operation for the specified data cannot be performed.” Further, in response to the operation unit 54 detecting a tap operation on the position of the data icon 133 (S22: tap), the terminal program 65 executes the process of S25 without executing the processes of S23 and S24.

  Next, returning to FIG. 3, the terminal program 65 executes a preview process (S16). The preview process is a process for allowing a user to confirm an image of a result of performing a print operation on specified data. The details of the preview process will be described with reference to FIG.

  First, the terminal program 65 causes the display unit 53 to display the preview screen shown in FIG. 9B (S31). The process of S31 is an example of a first display process. The preview screen includes preview images 151, 152, 153, 154, 155, and 156, and a [Start] icon 157. The preview area 158 indicated by a broken line in FIG. 9B includes preview images 151 to 156 and a background area where no preview image is displayed. Then, the terminal program 65 receives a user operation on the preview screen through the operation unit 54 (S32).

  Preview images 151 to 156 are examples of a data object corresponding to one of the page data included in the designated data. [Start] icon 157 is an example of an execution instruction object corresponding to an instruction to cause a designated device to execute a designated operation on designated data according to an execution condition. A check box added to the upper left corner of each of the preview images 151 to 156 indicates whether or not page data corresponding to the preview images 151 to 156 is to be printed.

  That is, in the example of FIG. 9B, page data corresponding to the preview images 151, 154, and 155 are to be subjected to the printing operation, and page data corresponding to the preview images 152, 153, and 156 are not to be subjected to the printing operation. Is shown. In other words, the page data corresponding to the checked preview images 151, 154, 155 is the designated data. The check boxes associated with the preview images 151 to 156 are checked or canceled by a pop operation or the like with respect to the positions of the preview images 151 to 156, as described later.

  Next, in response to the operation unit 54 detecting a peak operation on the preview area 158 (S32: peak of the preview area), the terminal program 65 executes a condition changing process (S36). The condition changing process is a process of causing the user to check the condition information stored in the area 62B and changing the condition information according to the user's instruction. The details of the condition change process will be described with reference to FIG.

  In response to the peak operation detected in S32 being performed at the position of the preview image 152 (S51: preview image), the terminal program 65 displays the individual notification screen shown in FIG. S52). The individual notification screen according to the present embodiment is a pop-up window displayed over the preview screen. The individual notification screen is a screen that notifies an execution condition unique to the page data corresponding to the preview image 152. The individual notification screen shown in FIG. 10A displays tray information “Tray 1” and color information “Color”, and does not display recording surface information and layout information. The process of S52 is an example of a fifth display process. Then, the terminal program 65 receives a user operation on the individual notification screen through the operation unit 54 (S53).

  The “execution condition unique to page data” refers to, for example, an execution condition applied to only one of a plurality of page data. That is, different values can be set for the tray information and the color information for each of the plurality of page data included in the designated data. However, before the processing of S52 is executed, common tray information and color information are associated with all page data, for example, as shown in FIG. 2B. On the other hand, in the recording surface information and the layout information, for example, as shown in FIGS. 2B and 2C, a value common to all the page data included in the designated data is set.

  Next, in response to the operation unit 54 detecting that the peak operation detected in S32 has been changed to the slide operation (S53: slide), the terminal program 65 changes the individual change screen shown in FIG. Then, it is displayed on the display unit 53 instead of the individual notification screen (S54). The individual change screen according to the present embodiment is a pop-up window displayed so as to overlap the preview screen. The individual change screen is a screen that prompts a user to change an execution condition unique to page data corresponding to the preview image 152. Then, the terminal program 65 receives a user operation on the individual change screen through the operation unit 54 (S55).

  The individual change screen shown in FIG. 10B includes radio buttons 161, 162, 163, and 164, a [change] icon 165, and a [cancel] icon 166. The radio buttons 161 and 162 correspond to one of the execution conditions “tray 1” and “tray 2” set in the tray information, and the radio buttons 163 and 164 correspond to the execution conditions “monochrome” and “color” set in the color information. ". [Change] icon 165 corresponds to an instruction to change an execution condition unique to page data. [Cancel] icon 166 corresponds to an instruction not to change the execution condition.

  Next, in response to the operation unit 54 detecting a tap operation on the position of the [change] icon 165 (S55: Yes), the terminal program 65 sets execution conditions corresponding to the checked radio buttons 161 to 164 to: The execution condition unique to the page data corresponding to the preview image 152 is included in the condition information stored in the area 62B (S56).

  For example, when the radio buttons 161 and 163 are checked, the terminal program 65 updates the condition information shown in FIG. 2B as shown in FIG. In the condition information shown in FIG. 2C, color information “monochrome” is associated with page data “page 2” corresponding to preview image 152, and color information is associated with other page data “pages 1, 4, 5”. "Color" is associated. On the other hand, the tray information, the recording surface information, and the layout information have the same value associated with all page data.

  Next, the terminal program 65 includes or excludes the page data corresponding to the preview image 152 from the print operation (S57). More specifically, in response to detecting the peak operation for the position of the unchecked preview image 152 in S32 and S51, the terminal program 65 includes the page data corresponding to the preview image 152 in the print operation. . On the other hand, the terminal program 65 excludes the page data corresponding to the preview image 151 from the print operation in response to detecting the peak operation for the checked position of the preview image 151 in S32 and S51. The process of S57 is an example of a determination process.

  On the other hand, in response to the operation unit 54 detecting a tap operation on the position of the [Cancel] icon 166 (S55: No), the terminal program 65 executes the process of S57 without executing the process of S56. In addition, in response to the operation unit 54 detecting that the peak operation detected in S32 has changed to the pop operation (S53: pop), the terminal program 65 executes the processing in S57 without executing the processing in S54 to S56. Execute the process.

  Further, in response to the peak operation detected in S32 being performed in the background area (S51: background area), the terminal program 65 causes the display unit 53 to display the entire notification screen shown in FIG. 11A (S58). ). The general notification screen according to the present embodiment is a pop-up window that is displayed so as to overlap the preview screen. The general notification screen is a screen that reports an execution condition common to all page data. The overall notification screen shown in FIG. 11A displays recording surface information “one side” and layout information “2in1” and does not display tray information and color information. Then, the terminal program 65 receives a user operation on the general notification screen through the operation unit 54 (S59).

  Next, in response to the operation unit 54 detecting that the peak operation detected in S32 has been changed to a slide operation (S59: slide), the terminal program 65 changes the entire change screen illustrated in FIG. Then, it is displayed on the display unit 53 instead of the general notification screen (S60). The overall change screen according to the present embodiment is a pop-up window displayed so as to overlap the preview screen. The entire change screen is a screen for prompting the user to change an execution condition common to all page data. Then, the terminal program 65 receives a user operation on the entire change screen through the operation unit 54 (S61).

  The entire change screen illustrated in FIG. 11B includes radio buttons 171, 172, 173, 174, and 175, a [change] icon 176, and a [cancel] icon 177. The radio buttons 171 and 172 correspond to one of the execution conditions “single-sided” and “double-sided” set in the recording surface information, and the radio buttons 173 to 175 correspond to the execution conditions “no aggregation” and “2in1” set in the layout information. , "4in1". [Change] icon 176 corresponds to an instruction to change the execution condition common to the page data. [Cancel] icon 177 corresponds to an instruction not to change the execution condition.

  Next, in response to the operation unit 54 detecting a tap operation on the position of the [change] icon 176 (S61: Yes), the terminal program 65 sets execution conditions corresponding to the checked radio buttons 171 to 165 to: An execution condition common to all page data is stored in the area 62B (S62). For example, when the radio buttons 171 and 173 are checked, the terminal program 65 overwrites the layout information of the condition information shown in FIG. 2B from “2in1” to “no aggregation”.

  On the other hand, in response to the operation unit 54 detecting a tap operation on the position of the [Cancel] icon 177 (S61: No), the terminal program 65 ends the condition change process without executing the process of S62. In response to the operation unit 54 detecting that the input medium during the peak operation has been separated from the display surface (S59: separation), the terminal program 65 executes the condition change processing without executing the processing of S60 to S62. finish.

  Next, returning to FIG. 4B, the terminal program 65 executes the processing after S31 again. The preview screen displayed here is different from the preview screen shown in FIG. 9B in that a check box corresponding to the preview image 152 is checked. On the other hand, when the page data is excluded from the target of the printing operation in S57, the check box of the preview image corresponding to the page data is unchecked.

  Next, the terminal program 65 executes a 3D touch process in response to the operation unit 54 detecting a peak operation for the position of the [Start] icon 157 (S32: Start icon & S33: Peak) (S34). The 3D touch process executed in S34 is common to S23, but the screen displayed on the display unit 53 is different. Hereinafter, detailed description of common points with S23 will be omitted, and differences will be mainly described.

  In the 3D touch process executed in S34, the terminal program 65 causes the display unit 53 to display the Stars notification screen shown in FIG. 12 (S42). The status notification screen according to the present embodiment is a pop-up window displayed so as to overlap the preview screen. The status notification screen is a screen for notifying the state of the multifunction peripheral 10 indicated by the status information received in S41. Then, the terminal program 65 receives a user operation on the status notification screen through the operation unit 54 (S43).

  The status notification screen shown in FIG. 12A includes a specified device ID “MFP-A” and a message “[OK] can be printed.” The status screen illustrated in FIG. 12A indicates that the multifunction device 10 as the designated device is in a state where the printing operation can be performed. The terminal program 65 receives the status information in S41, for example, and responds to the fact that the remaining amount of ink indicated by the ink information is equal to or larger than the threshold value and the remaining amount of sheet indicated by the sheet information is equal to or larger than the threshold value. The status notification screen shown in (A) is displayed.

  On the other hand, the status notification screen shown in FIG. 12B includes a designated device ID “MFP-A” and a message “[NG] Offline.” The status screen shown in FIG. 12B indicates that communication with the MFP 10 is not possible. The terminal program 65 displays, for example, a status notification screen shown in FIG. 12B in response to the status information not being received even after the threshold time has elapsed since the transmission of the transmission request information in S41. FIG. 12B is an example of a status notification screen that clearly indicates an item “communication state” that impedes execution of a print operation among a plurality of items indicated by status information.

  Next, in response to the operation unit 54 detecting that the peak operation detected in S33 has changed to a slide operation (S43: slide), the terminal program 65 changes the device change screen illustrated in FIG. Then, it is displayed on the display unit 53 instead of the status notification screen shown in FIG. 12B (S44). The device change screen according to the present embodiment is a pop-up window displayed over the preview screen. Then, the terminal program 65 receives a user operation on the device change screen through the operation unit 54 (S45).

  The device change screen is a screen that prompts the user to designate an image processing apparatus to execute a print operation among image processing apparatuses communicable through the communication unit 55. The device change screen shown in FIG. 13A includes device icons 181 and 182 corresponding to image processing apparatuses “MFP-B” and “MFP-C” (not shown) connected to the communication network 101.

  Next, the terminal program 65 changes the designated device ID “MFP-A” stored in the area 62B in response to, for example, the operation unit 54 detecting a tap operation on the position of the device icon 181 (S45: Yes). The device ID is overwritten with the device ID “MFP-B” associated with the specified device icon 181 (S46). The tap operation on the positions of the device icons 181 and 182 is an example of a touch operation for designating a designated device. Then, the terminal program 65 determines whether or not the new designated device can execute the printing operation (S47). That is, the terminal program 65 receives the status information from the new designated device through the communication unit 55, and executes the process of S47 based on the received status information.

  As another example, the terminal program 65 receives the status information in S41, and in response to the fact that the remaining amount of cyan ink indicated by the ink information is less than the threshold, the terminal program 65 states that "cyan ink is in a low state." A status notification screen including a message may be displayed on the display unit 53 (S42). Then, in response to the operation unit 54 detecting that the peak operation detected in S33 has been changed to the slide operation (S43: slide), the terminal program 65 changes the condition change screen shown in FIG. It may be displayed on the display unit 53 instead of the status notification screen (S44).

  Alternatively, in response to the change of the peak operation detected in S33 to the slide operation (S43: slide), the terminal program 65 replaces the help screen shown in FIG. May be displayed. This process is an example of a third display process. The help screen is a screen showing a procedure for enabling the image processing apparatus to execute a print operation. The help screen according to the present embodiment includes a message “Please replace the cyan ink cartridge./Cartridge ID: C-001” and an “OK” icon 183. Then, in response to the operation unit 54 detecting a tap operation on the position of the [OK] icon 183, the terminal program 65 receives status information from the designated device, and executes the process of S47 based on the received status information. May be.

  Returning to FIG. 4B again, in response to determining that the first value “ON” is set in the continuation flag (S35: ON), the terminal program 65 ends the preview process. In addition, in response to the operation unit 54 detecting a tap operation on the position of the [Start] icon 157 (S32: Start icon & S33: Tap), the terminal program 65 executes the preview without executing the processes of S34 and S35. The process ends.

  On the other hand, when the terminal program 65 determines that the second value “OFF” is set in the continuation flag (S35: OFF), the terminal program 65 executes the processing of S31 and thereafter again. That is, the terminal program 65 causes the display unit 53 to display the preview screen by hiding the screen displayed in S42 and S44 without proceeding to the processing in S17. At this time, the terminal program 65 may cause the display unit 53 to display a message such as “The specified device is in a state where the printing operation cannot be performed.” Alternatively, in response to determining that the second value “OFF” is set in the continuation flag (S35: OFF), the terminal program 65 causes the display unit 53 to display a setting screen for accepting a change in the execution condition, The change in the execution condition received through the operation unit 54 may be reflected in the condition information stored in the area 62B.

  Returning to FIG. 3 again, the terminal program 65 transmits the print instruction information to the designated device via the communication unit 55 (S17). The print instruction information is information for instructing to execute a print operation on the designated data according to the execution condition indicated by the condition information. The print instruction information includes, for example, the specified data specified in S25 and S57, and the condition information stored in the area 62B. Note that when any one of S46, S56, and S62 is executed, the terminal program 65 includes the changed condition information in the print instruction information. The process of S17 is an example of an execution instruction process.

  On the other hand, although not shown, the device program 35 of the MFP 10 receives print instruction information from the terminal device 50 through the communication unit 25. Then, the device program 35 causes the printer 11 to execute a print operation according to the received print instruction information. That is, the printer 11 records an image indicated by the designated data included in the print instruction information on a sheet according to the execution condition indicated by the condition information included in the print instruction information.

[Operation and effect of the present embodiment]
According to the above-described embodiment, status information is received by a peak operation on the [Start] icon 157, and whether the print operation can be executed is determined based on a change in the peak operation to a pop operation. The status of the designated device is also notified to the user of the terminal device 50 through the status notification screen. Then, in response to the determination that the print operation can be performed, the print instruction information is transmitted to the designated device. That is, the user of the terminal device 50 can instruct the execution of the print operation after confirming the state of the designated device by a simple operation of sequentially performing the peak operation and the pop operation on the [Start] icon 157. it can.

  Further, according to the above embodiment, the notification screen is displayed by the peak operation on the data object or the preview image, and the corresponding data is determined as the designated data when the peak operation is changed to the pop operation. That is, the user of the terminal device 50 can specify the specified data after confirming the execution condition by a simple operation of sequentially performing the peak operation and the pop operation.

  Further, according to the above embodiment, the execution condition peculiar to the corresponding page data is changed by the peak operation and the slide operation on the preview image. On the other hand, the execution condition common to all the page data is changed by the peak operation and the slide operation on the background area. Thus, the user of the terminal device 50 can set an appropriate execution condition for each page data by a simple operation.

  The pop-up windows displayed by the peak operation and the slide operation are not limited to the screens shown in FIGS. Hereinafter, processing of the terminal program 65 according to the modification will be described. However, a detailed description of common points with the above-described embodiment will be omitted, and different points will be mainly described.

[Modification 1]
The terminal program 65 according to the first modification responds to the detection of the peak operation for the position of the [Start] icon 157 by the operation unit 54 (S32: Start icon & S33: Peak), and the condition shown in FIG. A notification screen may be displayed on the display unit 53 (S42). Then, the terminal program 65 according to the first modification executes the processing of S17 in response to the operation unit 54 detecting that the peak operation detected in S33 has changed to the pop operation (S43: pop). The processing in S17 is an example of the corresponding processing associated with the [Start] icon 157.

  That is, the execution condition of the corresponding process is notified by the peak operation at the position of the [Start] icon 157, and the corresponding process (S17) is executed when the peak operation is changed to the pop operation. Thus, the user of the terminal device 50 can instruct the execution of the corresponding process after confirming the execution condition by a simple operation of sequentially performing the peak operation and the pop operation on the [Start] icon 157. .

  The terminal program 65 according to the first modification is shown in FIG. 9A in response to the operation unit 54 detecting that the peak operation detected in S33 has changed to a slide operation (S43: slide). The condition change screen may be displayed on the display unit 53 instead of the condition notification screen shown in FIG. 8B (S44). That is, the user of the terminal device 50 can change the execution condition of the corresponding process by the peak operation and the slide operation on the [Start] icon 157.

  Further, the relationship between the corresponding process and the execution condition is not limited to the above-described example. As an example, the execution condition of the scan operation may be notified by the peak operation on the [scan] icon instructing the execution of the scan operation, and the designated device may be instructed to perform the scan operation by changing the peak operation to the pop operation. As another example, the execution condition of the facsimile transmission operation is notified by the peak operation on the [FAX transmission] icon for instructing the execution of the facsimile transmission operation. May be instructed.

  Further, the corresponding process is not limited to a process for causing the image processing apparatus to execute an operation. For example, the terminal device 50 may further include a camera. Then, in response to the operation unit 54 detecting the peak operation for the position of the [shutter] icon, the terminal program 65 may notify the shooting condition through the condition notification screen. In addition, the terminal program 65 may execute a corresponding process of causing the camera to photograph a subject in response to the operation unit 54 detecting that the peak operation for the [shutter] icon has changed to a pop operation. The shooting conditions include resolution, white balance, presence / absence of flash, and the like.

[Modification 2]
Items displayed on the status notification screen may be different depending on the operation mode of the designated device. The operation mode includes an administrator mode when the authentication information assigned to the administrator of the designated device is input to the designated device, and a general mode when the authentication information is not input to the designated device. Then, the device program 35 according to the second modification transmits status information including management information to the terminal device 50 in response to the MFP 10 being in the administrator mode. On the other hand, the device program 35 according to the second modification transmits status information that does not include management information to the terminal device 50 in response to the MFP 10 being in the general mode.

  The authentication information may be input to the terminal program 65 instead of the designated device. That is, the terminal program 65 according to the second modification may operate in the administrator mode or the general mode. The terminal program 65 operating in the administrator mode transmits transmission request information including authentication information to the designated device. On the other hand, the terminal program 65 operating in the general mode transmits transmission request information that does not include authentication information to the designated device. The device program 35 according to the second modification transmits status information including management information to the terminal device 50 as a response to the transmission request information including authentication information. On the other hand, the device program 35 according to the second modification transmits status information that does not include management information to the terminal device 50 as a response to transmission request information that does not include authentication information.

  Further, the terminal program 65 may display the management information on the status notification screen in response to receiving the status information including the management information. On the other hand, the terminal program 65 may display the status notification screen shown in FIG. 12 in response to receiving the status information not including the management information. That is, the terminal program 65 makes the items displayed on the status notification screen different depending on whether the designated device or the terminal program 65 is in the manager mode or not, when the designated device or the terminal program 65 is not in the manager mode. Thereby, appropriate information can be notified to the user according to the operation mode.

[Other Modifications]
The terminal program 65 displays the status notification screen shown in FIG. 12 on the display unit 53 in response to the operation unit 54 detecting the peak operation for the positions of the data icons 131 to 133 (S22: peak → S23). (S42). In addition, in the 3D touch processing executed in S23, the terminal program 65 responds to the operation unit 54 detecting that the peak operation has been changed to the slide operation (S43: slide), and the terminal program 65 illustrated in FIG. The help screen displayed may be displayed on the display unit 53 instead of the condition notification screen shown in FIG. 8B (S44).

  Further, in the above-described embodiment and each of the modified examples, the example in which each pop-up window is displayed by combining the peak operation, the pop operation, and the slide operation has been described. However, the combination of the touch operations is not limited to the above example. For example, a long touch operation may be detected instead of the peak operation, a separation of the input medium may be detected instead of the pop operation, and a flick operation may be detected instead of the slide operation. In this case, the pressure sensor 54A can be omitted.

  Further, in the MFP 10 and the terminal device 50 of the above-described embodiment, the various programs stored in the program storage areas 32A and 62A of the memories 32 and 62 are executed by the CPUs 31 and 61, so that the control unit of the present invention The example in which each processing to be executed is realized has been described. However, the configuration of the control unit is not limited to this, and part or all of the control unit may be realized by hardware such as an integrated circuit.

  Further, the present invention can be realized not only as the multifunction peripheral 10 and the terminal device 50 but also as a program for causing the multifunction peripheral 10 and the terminal device 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include a memory mounted on a server connectable to the MFP 10 and the terminal device 50 via the communication network 101, in addition to a CD-ROM, a DVD-ROM, and the like. Then, the program stored in the memory of the server may be distributed as information or a signal indicating the program through the communication network 101 such as the Internet.

10 Multifunction machine 11 Printer 53 Display unit 54 Operation unit 54A Pressure sensor 54B Position sensors 25 and 55 Communication units 31 and 61 CPU
32, 62: Memory 35: Device program 50: Terminal device 65: Terminal program

Claims (14)

A display unit having a display surface, a touch sensor arranged to overlap the display surface to detect a touch operation, and a program executable by a terminal device including a communication unit,
The program is
First display processing for displaying an execution instruction object on the display surface;
In response to the touch sensor detecting that the first operation with respect to the position of the execution instruction object has been performed, the terminal device performs a reception process of receiving status information from an image processing device through the communication unit. , The status information is information indicating a state of the image processing apparatus,
The program is
In response to the touch sensor detecting that the first operation for the position of the execution instruction object has changed to the second operation, the operation on the image data is performed based on the status information received in the reception process. A first determination process for determining whether the image processing apparatus is executable;
Executing, in the terminal device, execution instruction information for transmitting execution instruction information for instructing execution of the operation to the image processing device through the communication unit, in response to the first determination process determining that the operation is executable. The program to be executed.   The program according to claim 1, wherein the program causes the terminal device to execute a second display process for displaying, on the display surface, a state of the image processing device indicated by the status information received in the reception process.   The program according to claim 2, wherein the program specifies, in the second display processing, an item that hinders execution of the operation among a plurality of items indicated by the status information. The terminal device includes a memory,
A program for enabling the image processing apparatus to execute the operation in response to the touch sensor detecting that the first operation for the position of the execution instruction object has changed to a third operation; 4. The program according to claim 3, wherein the program causes the terminal device to execute a third display process that causes the terminal device to display a message.   The program, in the second display processing, makes display items different between when the program or the image processing apparatus is in an administrator mode and when the program and the image processing apparatus are not in an administrator mode. The program according to any one of 2 to 4. The terminal device includes a memory,
The program is
In response to the touch sensor detecting that the first operation for the position of the execution instruction object has changed to a third operation, the execution condition indicated by the condition information stored in the memory is displayed on the display surface. Causing the terminal device to execute a fourth display process for displaying,
The operation according to the changed execution condition can be executed in response to the touch sensor detecting that the touch operation instructing to change the execution condition displayed in the fourth display process has been executed. Is determined in the first determination process,
6. The execution instruction information for instructing execution of the operation according to the changed execution condition in the execution instruction process when the first determination process determines that the operation is executable. The program according to any of the above.   The program, in the fourth display process, among a plurality of the execution conditions indicated by the condition information, displays a screen that prompts a change of the execution condition that hinders execution of the operation in a state indicated by the status information. The program according to claim 6, which is displayed. The program is
In the fourth display process in a case where the status information cannot be received in the reception process, a screen for prompting the user to specify the image processing device to execute the operation among the image processing devices communicable through the communication unit is displayed. ,
In response to the touch sensor detecting that a touch operation for designating the image processing device has been performed, the first determination process determines whether or not the designated image processing device can perform the operation. ,
The computer-readable storage medium according to claim 7, wherein the execution instruction information is transmitted to a designated image processing apparatus in the execution instruction processing when the first determination processing determines that the operation is executable. The program is
In the first display process, further displaying a data object associated with image data to be output by the image processing apparatus,
A fifth display process for displaying the execution condition of the output operation on the display surface in response to the touch sensor detecting that the first operation on the position of the data object has been executed;
Determining that the image data corresponding to the data object is determined as the target of the output operation in response to the touch sensor detecting that the first operation for the position of the data object has changed to the second operation; And causing the terminal device to execute the process,
9. The program according to claim 6, wherein in the execution instruction process, the execution instruction information for instructing execution of the output operation on the image data determined in the determination process is transmitted. The touch sensor,
A pressure sensor for detecting pressure applied by the input medium;
A position sensor that detects a position where pressure is applied by the input medium,
The program is
Detecting that the pressure sensor has detected a pressure less than a threshold value and that the position sensor has detected a position as the first operation with respect to the position,
10. The method according to claim 4, wherein the third operation detects that the position detected by the position sensor has continuously moved while the pressure sensor is detecting a pressure less than the threshold value. The program described in. The touch sensor,
A pressure sensor for detecting pressure applied by the input medium;
A position sensor that detects a position where pressure is applied by the input medium,
The program is
Detecting that the pressure sensor has detected a pressure less than a threshold value and that the position sensor has detected a position as the first operation for the position,
The program according to any one of claims 1 to 10, wherein the pressure sensor detects a pressure equal to or higher than the threshold value and the position sensor detects a position as the second operation for the position.   The program executes the execution instruction processing without executing the reception processing and the first determination processing in response to the touch sensor detecting that a fourth operation on the position of the execution instruction object has been executed. The program according to any one of claims 1 to 11, which causes the terminal device to execute the following. In response to the touch sensor detecting that the input medium during the first operation has been separated from the display surface, the program does not execute the execution instruction process, and executes the status received in the reception process. The program according to any one of claims 1 to 12 , wherein a second display process for displaying a state of the image processing device indicated by information on the display surface is ended. A display unit having a display surface;
A touch sensor that is arranged on the display surface and detects a touch operation;
A communication unit;
A terminal device comprising: a control unit;
The control unit includes:
First display processing for displaying an execution instruction object on the display surface;
Executing, in response to the touch sensor detecting that the first operation has been performed on the position of the execution instruction object, receiving status information from an image processing apparatus through the communication unit; Is information indicating the state of the image processing apparatus,
The control unit includes:
In response to the touch sensor detecting that the first operation for the position of the execution instruction object has changed to the second operation, the operation on the image data is performed based on the status information received in the reception process. A first determination process for determining whether the image processing apparatus is executable;
A terminal device for executing execution instruction processing for transmitting execution instruction information for instructing execution of the operation to the image processing apparatus through the communication unit in response to the first determination processing determining that the operation is executable .