JP2019139798A - Output instruction program, external program, information processing apparatus, and content processing system - Google Patents

Abstract

To provide a printing program that provides an interface capable of properly selecting print data, without extremely increasing burden of a developer.SOLUTION: A printing program causes a computer to execute: external acquisition processing (S14) which executes an external program for determining print data to be an object of record processing, on the basis of a user operation, and acquires the print data determined in the external program; preview display processing (S15 to S19) for generating a preview image indicating a state that a print image represented by the print data has been recorded on a sheet, and displaying the preview image in a display section; and output processing (S21) that transmits recording instruction information for executing recording processing on the print data in response to reception of a first touch operation for instructing execution of recording processing on the print data (S20: Yes), to an image recording apparatus through a communication section.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a print program capable of causing an image recording apparatus to execute a recording process for print data acquired from a data acquisition source.

  Conventionally, there is known a program capable of causing an image recording apparatus to execute a recording process for recording an image represented by data acquired from a data acquisition source on a sheet. For example, Japanese Patent Laid-Open No. 2004-228561 allows the user to select photo data stored in a mobile terminal, data stored in a storage server, HTML data constituting a WEB page, and the like, and perform recording processing on the selected data. There is disclosed a program that can be executed.

JP 2006-163990 A

  Here, an appropriate interface for allowing the user to select print data differs depending on, for example, the type of data. As an example, in order to select one of a plurality of pieces of photo data, an interface that displays a list of a plurality of icons indicating each piece of photo data and accepts a user operation for selecting one of the icons displayed in the list. Is suitable. As another example, in order to extract a desired region from a map image, an interface that displays a map image and receives a user operation for designating a print range on the map image is suitable.

  However, mounting a plurality of interfaces as described above in one program is a heavy burden for the developer of the program. This problem becomes more prominent as the types of print data to be supported increase.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a printing program that provides an interface capable of appropriately selecting print data without excessively increasing the burden on the developer. It is in.

  (1) A print program according to the present invention includes a display unit, an operation unit, a storage unit capable of storing an external program, and a communication unit, and records an image indicated by print data on a sheet according to a set value. It can be executed by a computer that communicates wirelessly with the image recording apparatus that can execute the recording process. The print program executes the external program for determining the print data to be subjected to the recording process based on a user operation, and acquires the print data determined by the external program; Generating a preview image representing a state in which the print image indicated by the print data is recorded on the sheet, displaying the preview image on the display unit, and instructing execution of the recording process on the print data In response to receiving the first touch operation in the first reception process and the first reception process in which the one touch operation is received via the operation unit in a state where the preview image is displayed on the display unit, Recording instruction information for executing the recording process on the print data is transmitted to the image recording apparatus through the communication unit. To execute the output process, to the computer.

  According to the above configuration, the external acquisition process can be executed using an external program having an appropriate interface according to the type of print data, so even if the number of types of print data to be supported increases, the print program is significantly modified. There is no need to do. In other words, an interface suitable for selecting the print data can be provided without excessively increasing the burden on the developer of the print program.

  The external program in this specification is a program that is separate from the print program and can be executed independently, and is different from a subroutine of the print program. For example, the external program may operate as a so-called plug-in of the printing program.

  (2) For example, the print program includes a list display process for causing the display unit to display a basic object indicating the acquisition source of the print data and an external object indicating the external program stored in the storage unit, and the list In the display process, a second reception process for receiving a second touch operation for selecting one of the objects displayed on the display unit through the operation unit, and the second touch operation for selecting the basic object are performed in the first process. 2 In response to the acceptance in the acceptance process, the designation operation for designating one of the data that can be obtained from the acquisition source indicated by the basic object is accepted through the operation unit, and the data designated by the designation operation A basic acquisition process for acquiring the print data from the acquisition source and the second touch operation for selecting the external object. 2 in response to reception by the reception process to execute, and the external acquisition processing using the external program shown in the external object to the computer.

  (3) Preferably, the print program determines whether or not the external program is stored in the storage unit, and determines that the external program is stored in the storage unit among the external objects. And causing the computer to execute the list display process for causing the display unit to display only the external object indicating the external program determined in (1).

  (4) More preferably, the program includes an identification information acquisition process for acquiring a plurality of program identification information for identifying each of the external programs executable in the external acquisition process, and the external program identified by the program identification information. The computer is caused to execute the determination process for determining whether a program is stored in the storage unit.

  According to the above configuration, since only the external objects indicating executable external programs are displayed, it is easy for the user to find a desired external object from among the displayed objects.

  (5) For example, in the list display process, the printing program causes the display unit to display the first object acquired from the external program as the external object.

  (6) For example, in the list display process, the print program distinguishes the external program from the second object stored in the storage unit or the basic object in order to distinguish the external program from the other external programs. The third object stored in the storage unit is displayed on the display unit as the external object.

  (7) For example, in response to the acquisition of the first object, the printing program causes the display unit to display the first object as the external object and acquire the first object in the list display process. In response to the failure, the second object or the third object is displayed on the display unit as the external object in the list display process.

  (8) Preferably, in the list display process, the print program stores the deleted external program in response to notification from the OS of the computer that the external program has been deleted from the storage unit. The external object shown is hidden.

  According to the above configuration, the external object indicating the uninstalled external program is hidden, so that a desired external object can be easily found by the user.

  (9) Preferably, the print program is the external program that can be installed in the computer in the list display process according to the determination process that the external program is not stored in the storage unit. An informing object for informing that there is a message is displayed on the display unit.

  According to the above configuration, since the user can recognize the presence of a new external program that can be called from the print program, an interface suitable for selecting print data can be provided.

  (10) Preferably, in the external acquisition process, the print program notifies the list of setting values that can be used by the image recording apparatus for the recording process when the external program is executed.

  According to the above configuration, an interface for selecting print data can be customized in the external program in accordance with the function of the image recording apparatus. As a result, an interface more suitable for selecting print data can be provided.

  (11) Preferably, the said memory | storage part can memorize | store the 1st setting value which is the said setting value matched with the said program identification information. In the printing program, the external acquisition process for further acquiring the program identification information of the executed external program from the external program, and the first set value associated with the acquired program identification information are stored in the storage unit And reading the first setting value from the storage unit according to being stored in the storage unit, and causing the display unit to display the preview image generated according to the first setting value read in the reading process. A preview display process; and the output process for transmitting the recording instruction information for executing the recording process on the print data to the image recording apparatus through the communication unit according to the setting value used for generating the preview image. Cause the computer to execute.

  According to the above configuration, it is possible to cause the image recording apparatus to execute the recording process for the print data selected by the user by the external program according to the setting value optimized for each external program.

  (12) More preferably, in the preview display process, the print program is executed in response to obtaining a specified set value that is the set value to be used for the recording process for the print data from the external program. Regardless of whether or not the first setting value is stored in the storage unit, the preview image generated according to the designated setting value is displayed on the display unit.

  According to the above configuration, for example, the recording process is executed according to the setting value designated by the user through the external program. As a result, it is possible to cause the image recording apparatus to execute recording processing according to a more appropriate set value.

  (13) For example, the printing program stores the designated set value in the storage unit as the first set value.

  However, the handling of the designated set value is not limited to the above example, and may be discarded after being used for the recording process for the corresponding print data, for example.

  (14) The external program according to the present invention is executed by the computer in response to an instruction from the printing program according to any one of claims 1 to 13. The external program causes the computer to execute a notification process for notifying the print program of data identification information indicating the print data in response to the operation unit receiving a touch operation designating the print data.

  Although the specific example of an external program is not specifically limited, For example, the desired area on a map may be extracted as print data, and the selected photograph data may be editable.

  (15) An information processing apparatus according to the present invention includes a display unit, an operation unit, a storage unit capable of storing an external program, a communication unit, and a control unit. The communication unit can wirelessly communicate with an image recording apparatus capable of executing a recording process for recording an image indicated by print data on a sheet according to a set value. The controller executes the external program for determining the print data to be subjected to the recording process based on a user operation, and acquires the print data determined by the external program; and Generating a preview image representing a state in which the print image indicated by the print data is recorded on the sheet, displaying the preview image on the display unit, and instructing execution of the recording process on the print data In response to receiving the first touch operation in the first reception process and the first reception process in which the one touch operation is received via the operation unit in a state where the preview image is displayed on the display unit, Output for transmitting recording instruction information for executing the recording process on the print data to the image recording apparatus through the communication unit To run and management.

  (16) A recording system according to the present invention includes an information processing apparatus including a display unit, an operation unit, a storage unit capable of storing an external program, a first communication unit, and a first control unit, and an image indicated by print data. An image recording apparatus including a recording unit capable of executing a recording process for recording on a sheet according to a set value, a second communication unit, and a second control unit. An external acquisition process for executing the external program for determining the print data to be subjected to the recording process based on a user operation and acquiring the print data determined by the external program; Generating a preview image representing a state in which the print image indicated by the print data is recorded on a sheet and displaying the preview image on the display unit; and instructing execution of the recording process on the print data A first receiving operation for receiving the first touch operation through the operation unit in a state where the preview image is displayed on the display unit, and in response to receiving the first touch operation in the first receiving process. Then, recording instruction information for executing the recording process for the print data is transmitted to the image recording apparatus through the first communication unit. To run and that output processing. The second control unit causes the recording unit to execute the recording process indicated by the recording instruction information in response to receiving the recording instruction information from the information processing apparatus through the second communication unit.

  According to the present invention, according to the configuration described above, an interface suitable for selecting the print data can be provided without excessively increasing the burden on the developer.

FIG. 1 is a block diagram of a recording system 100 according to the embodiment. 2A and 2B are examples of information stored in the data storage area 62B. FIG. 2A shows information on an external program that can be executed by the printing program 65, and FIG. 2B shows setting values that can be used by the multifunction device 10. A list is shown. FIG. 3 shows an example of the setting values stored in the data storage area 62B. (A) shows the first setting value, (B) shows the second setting value, and (C) shows the specified setting value. FIG. 4 is a flowchart of image recording processing according to the first embodiment. FIG. 5 is a flowchart of the menu screen display process. FIG. 6 is a display example of the menu screen, where (A) shows a state before the paint program is installed, and (B) shows a state after the paint program is installed. 7A and 7B are display examples of the display unit 53, where FIG. 7A shows a photo data selection screen, and FIG. 7B shows a preview screen when the photo icon 121 is selected. 8A and 8B are display examples of the display unit 53, where FIG. 8A shows a data selection screen and FIG. 8B shows a preview screen when the data icon 131 is selected. FIG. 9 is a display example of the display unit 53, where (A) shows a print area determination screen and (B) shows a preview screen of the map image 142. FIG. 10 is a diagram for explaining a sharing function realized by the sharing API. FIG. 11 is a flowchart of image recording processing according to the second embodiment. FIG. 12 is a display example of the display unit 53, where (A) shows a temporary storage inquiry screen and (B) shows a scan execution screen. FIG. 13 is a display example of the display unit 53, where (A) shows a save destination selection screen and (B) shows a temporary save inquiry screen.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it is needless to say that the embodiment of the present invention can be changed as appropriate without departing from the gist of the present invention.

  FIG. 1 is a schematic diagram of a recording system 100 in the present embodiment. A recording system 100 shown in FIG. 1 includes a multifunction device 10, a portable terminal 50, and a service providing device 70. The multi-function device 10, the portable terminal 50, and the service providing apparatus 70 can communicate with each other via the communication network 102. Specific examples of the communication network 102 are not particularly limited, but may be, for example, the Internet, a mobile communication network, a wired LAN (abbreviation of Local Area Network), a wireless LAN, or a combination thereof.

[Multifunction machine 10]
As shown in FIG. 1, the multifunction machine 10 includes a printer unit 11, a scanner unit 12, a display unit 23, an operation unit 24, a communication unit 25, a CPU 31, a storage unit 32, and a communication bus 33. Is mainly provided. Each component constituting the multi-function device 10 is connected to each other via a communication bus 33. The multifunction device 10 is an example of an image recording device or a reading device.

[Printer 11 and Scanner 12]
The printer unit 11 executes a recording process for recording an image indicated by the image data on a recording sheet that is an example of a sheet. The recording method of the printer unit 11 is not particularly limited. For example, a known method such as an ink jet method or an electrophotographic method can be employed. The scanner unit 12 executes a scan process for reading an image recorded on a recording sheet and generating image data. The multi-function device 10 may further include a FAX function for performing FAX transmission / reception, a copy function for reading an image recorded on a recording sheet and recording it on another recording sheet.

[Display unit 23]
The display unit 23 includes a display screen that displays various types of information. Although the specific configuration of the display unit 23 is not particularly limited, for example, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be employed.

[Operation unit 24]
The operation unit 24 receives a user operation for selecting an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 includes, for example, a push button, and outputs various operation signals associated with the pushed push button to the CPU 31. Further, the operation unit 24 may include a film-like touch sensor superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display. For the touch sensor, a known method such as a capacitance method or a resistance film method can be adopted.

  The “object” refers to an image that can be selected by the user operating the operation unit 24. As an example, the object is a character string displayed on the display unit 23. One of the objects is highlighted when the direction key of the operation unit 24 is pressed, and the object is highlighted by pressing the enter button of the operation unit 24. A light-displayed object may be selected. As another example, an object when the operation unit 24 is a touch panel is an icon, a button, a link, or the like displayed on the display unit 23, and the object displayed at the touch position may be selected.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 102. That is, the multifunction device 10 outputs various information to the mobile terminal 50 or the service providing apparatus 70 through the communication unit 25 and receives various data or various information from the mobile terminal 50 or the service providing apparatus 70 through the communication unit 25. Although the specific communication procedure of the communication part 25 is not specifically limited, For example, Wi-Fi (registered trademark of Wi-Fi Alliance) is employable.

[CPU 31]
A CPU (abbreviation of Central Processing Unit) 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires and executes various programs, which will be described later, from the storage unit 32 based on various information output from the operation unit 24 and various information acquired from an external device through the communication unit 25. That is, the CPU 31 and the storage unit 32 constitute an example of a control unit.

[Storage unit 32]
The storage unit 32 includes a program storage area 32A and a data storage area 32B. In the program storage area 32A, an OS (abbreviation of Operating System) 34 and a control program 35 are stored. The control program 35 may be a single program or an aggregate of a plurality of programs. Data or information necessary for execution of the control program 35 is stored in the data storage area 32B.

  Note that “data” and “information” in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by the computer without taking into account the meaning of each bit. On the other hand, “information” refers to information that the operation of the computer branches depending on the semantic content indicated by each bit. Furthermore, the “instruction” is a control signal for prompting the destination apparatus to perform the next operation, and may include information or itself has a property as information. There is also.

  In addition, even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer, “data” and “information” have the same data and information as long as they are recognized as the same meaning content. Are treated as For example, information indicating “two” is stored as text information “0x32” in ASCII code in one computer, and binary format information “10” in binary notation in another computer. May be.

  However, the distinction between the above “data” and “information” is not strict, and exceptional handling is allowed. For example, data may be temporarily treated as information, or information may be temporarily treated as data. Also, what is handled as data in a certain device may be handled as information in another device. Furthermore, information may be extracted from the data, or data may be extracted from the information.

  The storage unit 32 includes, for example, RAM (abbreviation of Random Access Memory), ROM (abbreviation of Read Only Memory), EEPROM (abbreviation of Electrically Erasable Programmable Read-Only Memory), HDD (abbreviation of Hard CPU) 31 (HDD). It is configured by a buffer or the like or a combination thereof.

  The storage unit 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROM and DVD-ROM in addition to the above examples. A non-transitory medium is also a tangible medium. On the other hand, an electrical signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage. Not included in the media.

  The program stored in the program storage area 32A is executed by the CPU 31. However, in this specification, the operation of each program may be described with the CPU 31 omitted. That is, in the following description, the description that “the program A executes the process A” may indicate that “the CPU 31 executes the process A described in the program A”. The same applies to the portable terminal 50 described later.

  The OS 34 provides an API (abbreviation for Application Programming Interface) for controlling the printer unit 11, the scanner unit 12, the display unit 23, the operation unit 24, the communication unit 25, and the like that are hardware constituting the multifunction machine 10. It is a basic program. That is, each of the above programs controls each hardware by calling an API provided by the OS 34. However, in this specification, the operation of each program may be described with the OS 34 omitted. That is, in the following description, the description “the program B controls the hardware C” may refer to “the program B controls the hardware C through the API of the OS 34”. The same applies to the portable terminal 50 described later.

[Portable terminal 50]
As shown in FIG. 1, the portable terminal 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 61, a storage unit 62, and a communication bus 63. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the portable terminal 50 are the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, Since it is common with the memory | storage part 32 and the communication bus | bath 33, description for the second time is abbreviate | omitted. The CPU 61 and the storage unit 62 are an example of a control unit. The portable terminal 50 is an example of an information processing device. However, a specific example of the information processing apparatus is not limited to the mobile terminal 50 such as a smartphone, a mobile phone, and a tablet terminal, and may be a PC (abbreviation of Personal Computer) or the like.

  The operation unit 54 of the portable terminal 50 includes a film-like touch sensor superimposed on the display screen of the display unit 53. Then, the operation unit 54 receives a user operation for touching the display screen of the display unit 53. The operation unit 54 outputs position information indicating the position on the display screen touched by the user. The position information can be expressed, for example, as coordinates (x, y) on the xy plane with the upper left corner of the display screen as the origin, the right direction as the positive direction of the x axis, and the downward direction as the positive direction of the y axis.

  Note that “touch” in this specification includes all operations for bringing an input medium into contact with a display screen. That is, a tap operation to move the touched input medium away from the display screen within a predetermined time, a long touch operation to make the touched input medium stand still on the display screen, a slide operation to slide the touched input medium on the display screen, a display screen Flick operation where the acceleration of the input medium sliding above the threshold is more than a threshold, pinch-in operation to slide two input media touched at different positions on the display screen toward each other, two touched at different positions on the display screen A pinch-out operation or the like that slides the input medium away from each other is an example of a touch.

  In addition, even if the input medium is not touching the display screen, the concept of “touch” may include bringing the input medium close to a position where the distance from the display screen is very small. Furthermore, the input medium may be a user's finger or a touch pen.

  The communication unit 55 wirelessly communicates with the multifunction device 10 or the service providing apparatus 70 through a mobile communication network or a wireless LAN. Note that the wireless communication of the mobile terminal 50 with the external device is not limited to the wireless communication being performed in the entire communication section between the mobile terminal 50 and the external device. That is, it is only necessary that at least the wireless section is between the mobile terminal 50 and the nearest relay device (for example, an access point, a base station, etc.).

  The program storage area 62A of the storage unit 62 stores an OS 64, a print program 65, and a map program 66. Various types of information shown in FIGS. 2 and 3 are stored in the data storage area 62 </ b> B of the storage unit 62. Furthermore, a photo data folder in which photo data is stored may be provided in the data storage area 62B.

  The print program 65 is a program that causes the multi-function peripheral 10 to perform a recording process for the acquired print data. The map program 66 is a program that allows the user to designate an arbitrary area of the map image and delivers print data indicating the map image of the designated area to the print program 65. The map program 66 is an example of an external program that determines print data to be subjected to recording processing based on a user operation. A specific example of the external program is not limited to the map program 66, and may be, for example, a paint program that edits an image in accordance with a user operation and delivers print data indicating the edited image to the print program 65.

  As shown in FIG. 2A, the data storage area 62B stores a program ID, an application name, installation information, a first icon, a second icon, and a third icon in association with each other. What is necessary is just to acquire the image data which shows a 1st icon from the corresponding external program, for example. The other information or data shown in FIG. 2A may be acquired from a server device (not shown) when the printing program 65 is installed or updated, for example.

  The program ID is an example of program identification information that uniquely identifies an external program. The application name indicates the name of the application realized by the corresponding program. The installation information is information indicating whether or not the corresponding program is installed in the portable terminal 50. The installation means that the CPU 61 of the mobile terminal 50 can execute the program. In the example of FIG. 2A, the map program 66 identified by the program ID “001” has already been installed, and the paint program identified by the program ID “002” has not been installed yet.

  The first icon is an icon for identifying the corresponding external program, and is acquired from the external program. The second icon is an icon for identifying the corresponding external program from other external programs. The third icon is an icon for distinguishing from a basic icon described later. The third icon is used in common for all external programs. The first icon, the second icon, and the third icon are examples of external objects that indicate external programs. Image data representing each icon shown in FIG. 2A is stored in the data storage area 62B.

  As shown in FIG. 2B, the data storage area 62B stores a printer ID and a set value list in association with each other. The printer ID is an example of device identification information that uniquely identifies the multifunction peripheral 10 that can communicate through the communication network 102. The printer ID “printer A” indicates, for example, the multifunction machine 10 shown in FIG. The list of setting values can be acquired from the multifunction machine 10, for example. The data storage area 62B may store a plurality of printer IDs and a plurality of setting value lists corresponding to the printer IDs. In this case, one of the plurality of printer IDs may be designated as the default printer, or each printer ID and program ID may be associated with each other.

  The setting value list is a list of setting values that can be used by the printer unit 11 of the multifunction machine 10 in the recording process. The set value is a value indicating an execution condition when causing the MFP 10 to execute the recording process. The setting values in the example of FIG. 2B are values indicating “paper size” (for example, A4, B4, L plate, etc.), values indicating “paper type” (for example, glossy paper, plain paper, etc.), and A value indicating the “number of colors” (for example, full color, 256 colors, monochrome, etc.). However, specific examples of the setting value are not limited to these, and may include values indicating the paper orientation, resolution, magnification, number of copies, and the like. That is, the printer unit 11 of the multifunction machine 10 can execute the recording process using the setting value selected from the setting value list shown in FIG.

  The data storage area 62B stores a plurality of set values as shown in FIG. FIG. 3A is a diagram illustrating the first setting value associated with the program ID. FIG. 3B is a diagram illustrating the second setting value associated with the format information. FIG. 3C is a diagram showing the designated set value associated with the set value ID.

  The format information is information indicating the data format of the print data. The format information in the example of FIG. 3B includes “PNG” that is an example of the data format of image data, “PDF” that is an example of the data format of document data, and “TXT” that is an example of the data format of text data. Indicates. However, specific examples of the format information are not limited to these.

  The setting value ID is an example of setting value identification information that uniquely identifies the specified setting value. The setting value ID in the example of FIG. 3C is a combination of program IDs “001” and “002” and sub IDs “A” and “B” that uniquely identify the specified setting value for each program ID. Composed. The sub ID is an example of sub identification information. However, a specific example of the set value ID is not particularly limited, and the program ID may not be included as long as the designated set value stored in the data storage area 62B can be uniquely identified. The set value ID including the program ID may be specified only by the external program identified by the program ID. On the other hand, a set value ID that does not include a program ID may be specified by all external programs.

  The first setting value, the second setting value, and the designated setting value are all examples of setting values, but the information that is associated is different. That is, in FIG. 3A to FIG. 3C, it is not prevented that the same set value exists. Each setting value shown in FIGS. 3A to 3C may be programmed in advance in the print program 65, or may be acquired from the server device when the print program 65 is installed or updated. Alternatively, it may be acquired from the server device at an arbitrary timing such as when the printing program 65 is activated.

  Note that the setting values shown in FIGS. 3A to 3C may be acquired by the print program 65 from the server device, or a program for installing or updating the print program 65 may be acquired from the server device. May be. Each set value may be set or changed at any timing by the user. Further, each set value may be stored in an area in the data storage area 62B allocated from the OS 64 to the print program 65 when the print program 65 is installed or updated.

[Service Providing Device 70]
The service providing device 70 is a device that provides a service to be used by the mobile terminal 50. The service providing device 70 exists on the Internet and provides various services in response to requests from the portable terminal 50. The service providing apparatus 70 includes, for example, “Evernote (registered trademark of Evernote Corporation)”, “Dropbox (registered trademark of DropBox, Inc.)”, “Google Drive (Google is a registered trademark of Google, Inc.)”, and the like. It is a storage service.

[Operation of Recording System 100]
The image recording process according to the first embodiment will be described with reference to FIGS. The image recording process is a process for causing the multifunction machine 10 to execute a recording process for print data determined by the portable terminal 50 based on a user operation.

  First, the print program 65 of the portable terminal 50 executes menu screen display processing (S11). The menu screen display process is a process for causing the display unit 53 to display, for example, the menu screen shown in FIG. Details of the menu screen display process will be described with reference to FIG.

  The print program 65 acquires the program ID of the external program from the data storage area 62B shown in FIG. 2A (S31). The process of step S31 is an example of an identification information acquisition process. In step S31, the printing program 65 according to the first embodiment reads the program IDs “001” and “002” shown in FIG. 2A from the data storage area 62B. Note that the acquisition destination of the program ID in step S31 is not limited to the data storage area 62B, and may be a server device (not shown) or the like.

  Next, the print program 65 determines whether or not the external program identified by the program ID acquired in step S31 is stored in the program storage area 62A, and more specifically whether or not the external program is installed. Judgment is made (S32). Specifically, the OS 64 may be inquired as to whether or not the external program identified by the program ID acquired in step S31 is installed, and the response information may be received from the OS 64. Further, it may be compared whether the program ID read from each external program stored in the program storage area 62A matches the program ID acquired in step S31. The process of step S32 is an example of a determination process.

  In response to determining that the external program identified by the acquired program ID is stored in the program storage area 62A (S32: Yes), the print program 65 determines external icons to be included in the menu screen (S33 to S33). S37). On the other hand, when the print program 65 determines that the external program identified by the acquired program ID is not stored in the program storage area 62A (S32: No), the notification icon is included in the menu screen (S38). . The notification icon is an example of a notification object for notifying that there is an external program that can be installed on the mobile terminal 50.

  Specifically, the printing program 65 adopts the first icon in response to the acquisition of the first icon from the external program (S33: Yes) (S34). The first icon may be acquired when the external program is installed, or may be acquired in step S34. For example, the print program 65 may read the first icon from the area in the data storage area 62B allocated from the OS 64 to the external program. The print program 65 may request the first icon from an external program and receive the first icon from the external program. Further, the print program 65 may request the first icon of the external program from the OS 64 and receive the first icon from the external program via the OS 64.

  Further, the printing program 65 cannot acquire the first icon, and the second icon corresponding to the external program is stored in the data storage area 62B (S33: No & S35: Yes), the second icon is displayed. Adopt (S36). The second icon is, for example, an area in the data storage area 62B allocated from the OS 64 to the print program 65 at the same timing or method as the setting values shown in FIGS. 3 (A) to 3 (C). May be stored. Further, the printing program 65 adopts the third icon in response to the fact that the second icon corresponding to the external program is not stored in the data storage area 62B (S35: No) (S37). The third icon can be used in common for all external programs without being associated with a specific program ID.

  Then, the print program 65 executes the processes of steps S32 to S38 for the external program identified by all the program IDs acquired in step S31 (S39: No). The print program 65 according to the first embodiment determines that the map program 66 identified by the program ID “001” is stored in the program storage area 62A, and adopts the first icon acquired from the map program 66. . The print program 65 determines that the paint icon identified by the program ID “002” is not stored in the program storage area 62A, and includes the notification icon in the menu screen.

  Next, the printing program 65 displays a menu screen on the display unit 53 (S40). FIG. 6 is an example of a menu screen. The menu screen shown in FIG. 6A includes a plurality of acquisition source icons 111, 112, 113 and a notification icon 115. The menu screen shown in FIG. 6B includes a plurality of acquisition source icons 111 to 114. Acquisition source icons 111 to 114 are icons indicating a method for acquiring print data. On the menu screen, the acquisition source icons 111 to 114 are displayed as a list, and the notification icon 115 is displayed at a position outside the area where the acquisition source icons 111 to 114 are displayed as a list. The process of step S40 is an example of a list display process.

  The acquisition source icon 111 is associated with a process of acquiring photo data stored in the photo data folder of the data storage area 62B as print data. The acquisition source icon 111 is configured by combining an icon representing a photo data folder and a character string “photo album”. The acquisition source icon 112 is associated with a process of acquiring data stored in the service providing apparatus 70 as print data. The acquisition source icon 112 is configured by combining an icon representing the service providing apparatus 70 and a character string “cloud service”.

  Note that the correspondence between the acquisition source icons 111 and 112 and the process of acquiring print data may be defined in the print program 65, or the definition file defining the correspondence may be read into the print program 65. Good. In addition, the above definition file is stored in an area in the data storage area 62B allocated from the OS 64 to the print program 65 at the same timing or method as the setting values shown in FIGS. 3 (A) to 3 (C). It may be stored.

  Further, the process of acquiring the print data associated with the acquisition source icon is not limited to the above example. As an example, the print program 65 may activate a camera (not shown) mounted on the mobile terminal 50 and acquire photo data taken by the camera as print data. As another example, the print program 65 may acquire Web data provided by a Web server as print data by operating as a Web browser. As yet another example, the print program 65 may acquire mail data stored in a mail server as print data by operating as a mail client. As yet another example, the print program 65 may acquire history data registered in the clipboard of the mobile terminal 50 as print data.

  The acquisition source icon 113 is associated with processing for operating the map program 66 and acquiring print data determined by the map program 66. The acquisition source icon 113 is configured by combining the first icon acquired from the map program 66 and the application name “map application” of the map program 66 shown in FIG. The acquisition source icon 114 is associated with processing for operating the paint program and acquiring print data determined by the paint program. The acquisition source icon 114 is configured by combining the second icon of the paint program shown in FIG. 2A and the application name “image editing application” of the paint program.

  The process of acquiring print data from the photo data folder and service providing apparatus 70 is implemented in advance in the print program 65. That is, the menu screen always includes the acquisition source icons 111 and 112. The acquisition source icons 111 and 112 are examples of basic icons. Also, a process of acquiring photograph data taken by a camera as print data, a process of acquiring Web data provided by a Web server as print data, or a process of acquiring mail data stored in a mail server as print data When implemented in the program 65, an acquisition source icon corresponding to the processing is included in the menu screen. These processes can be executed without calling an external program.

  On the other hand, the process of acquiring the print data determined by the map program 66 and the paint program can be used by the print program 65 only after the program is installed in the portable terminal 50. That is, the menu screen displayed in a state where the map program 66 is installed and the paint program is not installed is acquired corresponding to the map program 66 installed in the portable terminal 50 as shown in FIG. Only the original icon 113 is included. The acquisition source icons 113 and 114 are examples of external icons. The processing associated with the acquisition source icons 113 and 114 is implemented not in the print program 65 but in an external program. In other words, for example, the print program 65 only needs to be equipped with a process of delivering an activation argument to activate an external program and a process of acquiring a return value from the external program.

  The print program 65 waits in a state where a user operation for selecting the acquisition source icons 111 to 114 or the notification icon 115 can be accepted via the operation unit 54 while the menu screen is displayed on the display unit 53 (S43). Then, the print program 65 ends the menu screen display process in response to accepting a user operation for tapping the positions of the icons 111 to 113 and 115 via the operation unit 54 (S43: Yes). The process of step S43 is an example of a second reception process. A user operation of tapping one of the icons 111 to 113 and 115 is an example of a second touch operation.

  The print program 65 stands by in a state where it can accept a deletion notification from the OS 64 while displaying the menu screen on the display unit 53. The deletion notification is a notification indicating that the external program has been deleted from the program storage area 62A, that is, that the external program has been uninstalled. The deletion notification includes, for example, the program ID of the uninstalled external program. Then, the print program 65 corresponds to the external program identified by the program ID among the acquisition source icons 111 to 114 included in the menu screen in response to the deletion notification acquired from the OS 64 (S41: Yes). The acquisition source icon is hidden (S42).

  Returning to FIG. 4, the printing program 65 receives the user operation for tapping the position of the acquisition source icons 111 and 112 included in the menu screen via the operation unit 54 (S12: basic icon). An acquisition process is executed (S13). The basic acquisition process is a process for causing the user to specify one of the data that can be acquired from the acquisition source corresponding to the selected basic icon, and acquiring the specified data as print data. The basic acquisition process is implemented in the print program 65.

  The print program 65 causes the display unit 53 to display a photo data selection screen in the basic acquisition process executed in response to the acquisition source icon 111 being selected. FIG. 7A is an example of a photo data selection screen. The photo data selection screen shown in FIG. 7A includes a plurality of photo icons 121, 122, 123, 124, 125, 126. The photo icons 121 to 126 correspond to photo data stored in the photo data folder. The photo icons 121 to 126 may be so-called thumbnail images in which the image size and resolution of the corresponding photos are reduced.

  Then, the print program 65 stands by in a state where a user operation for selecting one of the photo icons 121 to 126 can be accepted via the operation unit 54 while the photo data selection screen is displayed on the display unit 53. For example, in response to receiving a user operation for tapping the position of the photo icon 121 via the operation unit 54, the print program 65 acquires photo data corresponding to the photo icon 121 from the photo data folder as print data. . In the first embodiment, the format information of the photo data is “PNG”.

  The print program 65 displays a data selection screen to allow the user to select data stored in the service providing apparatus 70 in the basic acquisition process executed in response to the acquisition source icon 112 being selected. This is displayed on the part 53. Specific examples of data stored in the service providing apparatus 70 are not particularly limited, and may be, for example, document data, image data, text data, or the like. FIG. 8A is an example of a data selection screen. The data selection screen shown in FIG. 8A includes a plurality of data icons 131, 132, and 133. The data icons 131 to 133 correspond to data stored in the service providing device 70.

  Then, the print program 65 stands by in a state where a user operation for selecting one of the data icons 131 to 133 can be accepted via the operation unit 54 while the data selection screen is displayed on the display unit 53. For example, in response to receiving a user operation for tapping the position of the data icon 131 via the operation unit 54, the print program 65 uses the PDF data “recipe.pdf” corresponding to the data icon 131 as print data. Received from the service providing apparatus 70 through the communication unit 55.

  Note that the print program 65 may convert the data format of the print data to a server device (not shown) in response to the acquisition of print data in an unsupported data format. For example, the print program 65 transmits conversion instruction information including print data in the first format to the server device via the communication unit 55, and print data converted into a second format different from the first format is transmitted to the server device via the communication unit 55. Receive from. The first format indicates format information of print data for which the print program 65 cannot generate a preview image. The second format indicates format information of print data that allows the print program 65 to generate a preview image.

  On the other hand, the print program 65 executes an external acquisition process in response to receiving a user operation for tapping the position of the acquisition source icon 113 via the operation unit 54 (S12: external icon) (S14). The external acquisition process is a process for acquiring print data determined by an external program. That is, the print program 65 operates the map program 66 corresponding to the acquisition source icon 113 and acquires the print data determined by the map program 66. Note that the printing program 65 may be operated using the map program 66 as a plug-in, or may be operated via the OS 64.

  Note that the print program 65 may deliver the map program 66 using, for example, the set value list shown in FIG. When a plurality of setting value lists are stored in the data storage area 62B shown in FIG. 2B, the print program 65 may use the default printer setting value list as an activation argument or the map program 66. A setting list associated with the program ID may be used as a startup argument. However, a specific example of the activation argument is not limited to this, and may be a list of setting value IDs illustrated in FIG. Further, while the map program 66 is being executed, the printing program 65 may be saved in the background or may be terminated.

  The map program 66 executed by the print program 65 causes the display unit 53 to display a print area determination screen. FIG. 9A is an example of a print area determination screen. The print area determination screen shown in FIG. 9A includes a map display area 141 and a [Preview] icon. Then, the map program 66 stands by in a state where user operations for the map display area 141 and the [preview] icon can be received via the operation unit 54.

  A part of the map image that can be displayed by the map program 66 is displayed in the map display area 141. In the map display area 141 at the time of starting the map program 66, for example, a map image 142 including the current position of the mobile terminal 50 acquired from GPS (abbreviation of Global Positioning System) is displayed. For example, the map program 66 acquires map image data representing the map image 142 to be displayed from a server device (not shown) through the communication unit 55.

  The map program 66 changes the map image 142 displayed on the map display area 141 in response to accepting a user operation at the position of the map display area 141 via the operation unit 54. The map image 142 displayed in the map display area 141 is, for example, slid following the slide operation, reduced following the pinch-in operation, and enlarged following the pinch-out operation. In addition, the map program 66 may receive a user operation for instructing rotation of a map image or setting of a landmark icon and reflect the user operation on the map image 142 included in the map display area 141.

  Further, the map program 66 receives map image data indicating the map image 142 displayed in the map display area 141 in response to receiving a user operation for tapping the position of the [preview] icon via the operation unit 54. The print data is stored in the data storage area 62B. In the first embodiment, the format information of the map image data is “PNG”. Then, the map program 66 notifies the program ID “001” of the map program and the file name of the print data stored in the data storage area 62B to the print program 65 as a return value, and ends. The file name of the print data is an example of data identification information. The process of notifying the program ID or the like is an example of a notification process.

  Note that the information delivered to the print program 65 as a return value is not limited to the above example. As an example, the map program 66 may include a specified setting value that is a setting value to be used for a recording process for print data in the return value. This designated set value may be selected by the map program 66 from a set value list acquired as an activation argument, or may be selected by the user. As another example, the map program 66 may include the setting value ID of the designated setting value to be used for the recording process for the print data in the return value. This set value ID may be selected by the map program 66 from the set value ID acquired as the activation argument, or may be selected by the user.

  Although not shown, the print program 65 displays a screen that prompts the user to install an external program that has not yet been installed in response to receiving a user operation for tapping the position of the notification icon 115 via the operation unit 54. This is displayed on the part 53. For example, the print program 65 installs the paint program in the portable terminal 50 in response to receiving a user operation for instructing the installation of the paint program via the operation unit 54, and the menu screen shown in FIG. Is displayed on the display unit 53. In the menu screen shown in FIG. 6B, the acquisition source icon 114 corresponding to the paint program is displayed, and the notification icon 115 is hidden, and the menu screen shown in FIG. Is different.

  Next, the printing program 65 specifies setting values used for recording processing for the acquired print data (S15, S18). Further, the print program 65 generates a preview image of the print data according to the specified setting value, and causes the display unit 53 to display a preview screen (S16, S17, S19). The print program 65 waits in a state where a user operation for tapping the position of the [print] icon included in the preview screen can be received via the operation unit 54 while the preview screen is displayed on the display unit 53 ( S20).

  The preview image included in the preview screen is an image representing a state where the print image indicated by the print data is recorded on the sheet. The user operation of tapping the position of the [Print] icon included in the preview screen is an example of a first touch operation that instructs execution of a recording process for print data. The process of steps S15 to S19 is an example of a preview display process, and the process of step S20 is an example of a first reception process.

  In the first embodiment, since the first setting value corresponding to the basic acquisition process is not stored in the data storage area 62B shown in FIG. 3A (S15: No), the print data acquired in the basic acquisition process is not stored. The second set value shown in FIG. 3B is used. As an example, when the photograph data corresponding to the photograph icon 121 is acquired as print data, the print program 65 generates a preview image 127 of the photograph data according to the second setting value corresponding to the format information “PNG”. As another example, when PDF data corresponding to the data icon 131 is acquired as print data, the print program 65 generates a preview image 134 of the PDF data according to the second setting value corresponding to the format information “PDF”.

  FIG. 7B is a photo data preview screen corresponding to the photo icon 121. A preview image 127 included in the preview screen of FIG. 7B shows a state in which a photo corresponding to the photo icon 121 is printed in full color on an L-size glossy paper without borders. FIG. 8B is a preview screen of PDF data corresponding to the data icon 131. A preview image 134 included in the preview screen of FIG. 8B shows a state where an image indicated by PDF data is printed in 256 colors on A4 size plain paper.

  When the print data is composed of a plurality of pages, the print program 65 generates preview images 135 and 136 for each of the plurality of pages as shown in FIG. 8B, and displays the list on the preview screen. To do. When page break information indicating the boundary position between the first page and the second page is included in the print data, the print program 65 may generate the preview images 135 and 136 according to the page break information. On the other hand, when the page break information is not included in the print data, the print program 65 may determine the page boundary position based on the corresponding paper size or the number of lines that can be included in one page.

  On the other hand, when the external acquisition process is executed, the print program 65 acquires at least the file name of the print data and the program ID of the external program as return values. Further, the print program 65 can further acquire the designated set value or set value ID as a return value. Then, the print program 65 acquires the print data specified by the acquired file name from the data storage area 62B. The printing program 65 according to the first embodiment acquires map image data generated by the map program 66.

  Next, the printing program 65 generates a preview image 143 of the map image data according to the designated setting value in response to the designated setting value being included in the return value (S18: Yes). In response to the setting value ID being included in the return value (S18: Yes), the printing program 65 reads the designated setting value corresponding to the setting value ID from the data storage area 62B, and reads the designated setting read out. A preview image 143 of the map image data is generated according to the value. The process of reading the designated set value is an example of a read process.

  On the other hand, the print program 65 does not include the designated set value or the set value ID in the return value, and the first set value of the map program 66 is stored in the data storage area 62B shown in FIG. In response to this (S18: No & S15: Yes), the first set value is read from the data storage area 62B, and a preview image 143 of the map image data is generated according to the read first set value. On the other hand, in response to the fact that the first set value of the map program 66 is not stored in the data storage area 62B (S15: No), the print program 65 stores the second set value corresponding to the format information “PNG” as data. A preview image 143 of the map image data is generated in accordance with the second setting value read out from the area 62B. The process of reading the first set value or the second set value is another example of the read process.

  FIG. 9B is a map image data preview screen showing the map image 142 shown in FIG. In the example of FIG. 9B, it is assumed that the first setting value associated with the program ID “001” is used. That is, the preview image 143 shown in FIG. 9B shows a state in which the map image 142 shown by the map image data is printed on A4 plain paper 144 in 256 colors.

  Next, in response to accepting a user operation for tapping the position of the [Print] icon via the operation unit 54 (S20: Yes), the print program 65 sends the recording instruction information to the multifunction device 10 through the communication unit 55. Transmit (S21). The recording instruction information is information for executing recording processing for print data in accordance with the set value used for generating the preview image. The recording instruction information includes, for example, the print data acquired in steps S13 and S14 and the setting value used for generating the preview image. The process of step S21 is an example of an output process.

  On the other hand, the control program 35 of the multifunction machine 10 causes the printer unit 11 to execute the recording process indicated by the recording instruction information in response to receiving the recording instruction information from the portable terminal 50 through the communication unit 25. That is, the printer unit 11 executes a recording process for the print data included in the recording instruction information according to the setting value included in the recording instruction information.

[Effects of Embodiment 1]
When acquiring print data from the photo data folder or the service providing apparatus 70, as described with reference to FIG. 7A or FIG. 8A, the user may select one of the icons displayed in a list. . On the other hand, when acquiring map image data indicating a desired map image as print data, various user operations on the map display area 141 may be accepted as described with reference to FIG. As described above, the interface suitable for selecting print data varies greatly depending on the type of data.

  Therefore, even if the number of types of print data to be supported is increased by enabling an external program to be called from the print program 65 as in the first embodiment, the print data 65 can be changed without greatly modifying the print program 65. An interface suitable for selection can be provided. In particular, if an activation argument passed to an external program, a return value acquired from the external program, and the like are disclosed, development of an external program having an interface suitable for selecting a new type of print data can be promoted.

  Further, only the external icon indicating the already installed external program is displayed on the menu screen of the first embodiment, and the external icon indicating the external program not yet installed is not displayed. Further, the external icon indicating the uninstalled external program is not displayed while the menu screen is displayed. As a result, it is easy for the user to find a desired acquisition source icon from the acquisition source icons displayed in a list on the menu screen.

  In addition, on the menu screen of the first embodiment, the user can recognize the presence of an external program that can be installed by the notification icon 115. As a result, an interface suitable for selecting print data can be provided. Furthermore, by arranging the notification icon 115 at a position outside the area where the acquisition source icons 111 to 114 are displayed in a list on the menu screen, the effect that the desired acquisition source icon is easily found by the user is not diminished.

  According to the first embodiment, the recording process for the print data selected by the user by the external program is executed according to the designated setting value designated by the user through the external program or the first setting value optimized for each external program. Can be made. Further, even when the designated set value is not designated and the first set value is not stored, the recording process can be executed according to the set value optimized for each data format of the print data. For example, the photographic data described with reference to FIG. 7 and the map image data described with reference to FIG. 9 are both in the “PNG” format, but appropriate setting values are applied.

  Note that the setting values stored in the data storage area 62B are not limited to the example of FIG. For example, the data storage area 62B may store a first setting value used for a recording process for recording an image on only one page and a second setting value used for a recording process for recording an image on a plurality of pages. . The print program 65 may cause the display unit 53 to display a preview image generated according to the first setting value in response to the print data including only the image to be recorded on one page. On the other hand, the print program 65 may cause the display unit 53 to display a preview image generated according to the second setting value in response to the print data including images to be recorded on a plurality of pages.

  Further, the external program according to the first embodiment can customize the interface for selecting print data according to the function of the multifunction machine 10 based on the set value list acquired from the print program 65. As a result, an interface more suitable for selecting print data can be provided.

  In the first embodiment, the example in which the print program 65 is activated using the map program 66 as a plug-in has been described. However, the method for calling the map program 66 from the print program 65 is not limited to the above example. For example, as shown in FIG. 10, the map program 66 may be called from the print program 65 by a sharing function realized by an API provided by the OS 64 of the portable terminal 50.

  First, the sharing source application 41 executes an API of the OS 64 (hereinafter referred to as “shared API”) for realizing the sharing function (S1). In executing the shared API, a URI (abbreviation of Uniform Resource Identifier), a type, and an action are obtained as input arguments. The URI is information indicating the location of the shared data. The type is information indicating the data format of the shared data. The action is information indicating the type of processing (for example, browsing, editing, transmission, printing, etc.) for shared data to be executed by the sharing destination application.

  On the other hand, the applications 42, 43, 44,... That are candidates for sharing destination applications declare in advance to the OS 64 the data format of the shared data that can be processed and the types of processing that can be executed. Therefore, the OS 64 identifies (S2) an application that can execute the process indicated by the action on the shared data in the data format indicated by the type from among the applications 42, 43, 44,. A list of applications is displayed on the display unit 53 (S3). Then, the OS 64 waits in a state in which a user operation for selecting one of the listed applications can be received via the operation unit 54 (S4).

  Next, the OS 64 accepts a user operation for selecting one of the listed applications via the operation unit 54 (S4), and uses the URI, type, and action as a startup argument for the application. Is activated (S5). In the example of FIG. 10, the application 41 corresponds to the print program 65, and the applications 42 to 44 correspond to external programs. Information delivered between the print program 65 and the map program 66 may be described in the URI.

[Embodiment 2]
The external program can be activated not only by being called from the printing program 65 but also independently in response to a user instruction to the OS 64. The image recording process according to the second embodiment will be described with reference to FIG. A detailed description of the common points with the first embodiment will be omitted, and the description will focus on the differences. The image recording process according to the second embodiment is different from the first embodiment in that the map program 66 executed independently calls the print program 65 as a plug-in.

  The map program 66 according to the second embodiment causes the display unit 53 to display the print area determination screen illustrated in FIG. 9A in response to being activated by the user. Then, the map program 66 activates the printing program 65 according to the second embodiment as a plug-in in response to receiving a user operation for tapping the position of the [Preview] icon via the operation unit 54. The map program 66 delivers the program ID “001” of the map program 66 and the file name of the print data stored in the data storage area 62B to the print program 65 as an activation argument. Furthermore, the designated argument or set value ID may be included in the startup argument.

  The print program 65 activated by the map program 66 executes the image recording process shown in FIG. The processing in steps S52 to S54 will be described later. First, the print program 65 acquires print data based on the activation argument acquired from the map program 66 (S51). Next, the print program 65 generates a preview image of the print data according to the designated set value, the first set value, or the second set value, and causes the display unit 53 to display a preview screen including the preview image (S55 to S60). ). Steps S55 to S60 are the same as steps S18, S19, and S15 to S17 in FIG.

  Further, the print program 65 according to the second embodiment uses the designated setting value used for generating the preview image in step S56 as the first setting value of the map program 66 in the data storage area 62B shown in FIG. Store (S57). That is, the printing program 65 overwrites the first setting value of the external program with the specified setting value in response to the acquisition of the specified setting value or setting value ID from the external program as a return value. However, as in the first embodiment, the process of step S57 can be omitted.

  Then, the print program 65 receives the user operation for tapping the position of the [print] icon included in the preview screen via the operation unit 54 (S61: Yes), and then sends it to the multifunction machine 10 through the communication unit 55. Recording instruction information is transmitted (S62). Steps S61 and S62 are common to steps S20 and S21 of FIG. Further, since the processing of the multifunction machine 10 that has received the recording instruction information is also common to the first embodiment, the description thereof will be omitted.

  Note that if the OS 64 of the portable terminal 50 has a multitasking function, the processing of steps S52 to S54 may be executed. For example, the user of the mobile terminal 50 can save the print program 65 displaying the preview screen on the display unit 53 in the background, start the map program 66, and tap the position of the [Preview] icon. At this time, the print program 65 called as a plug-in of the map program 66 executes the image recording process shown in FIG.

  The preview image included in the preview screen displayed before the print program 65 is saved in the background is an example of the first preview image. The print data used for generating the first preview image is an example of first print data. The print data called and acquired from the map program 66 during the display of the first preview image is an example of the second print data.

  In this case, the print program 65 displays the temporary storage inquiry screen on the display unit 53 (S53), assuming that the first print data is not stored (S52: Yes). FIG. 12A is an example of a temporary save inquiry screen. The temporary save inquiry screen shown in FIG. 12A includes a message “Do you want to temporarily save unsaved print data?”, A [Save] icon, and a [Cancel] icon. Then, the print program 65 stands by in a state where it can accept a user operation on the temporary storage inquiry screen via the operation unit 54.

  In response to receiving a user operation for tapping the position of the [Save] icon via the operation unit 54 (S53: Yes), the print program 65 stores the first print data in a predetermined area of the data storage area 62B. Is temporarily stored (S54). On the other hand, the print program 65 skips the process of step S54 in response to accepting a user operation for tapping the position of the [Cancel] icon via the operation unit 54 (S53: No). That is, the first print data is discarded. The process of step S53 is an example of an inquiry process, and the process of step S54 is an example of a storage control process.

  Next, the printing program 65 executes the processing after step S55 described above. That is, the print program 65 displays a preview screen including the second preview image generated based on the second print data on the display unit 53 (S55 to S60), and executes the recording process for the second print data. (S61 to S62). Although not shown, the print program 65 generates a first preview image based on the first print data temporarily stored after the image recording process for the second print data is completed, and the first preview image May be displayed on the display unit 53.

[Effects of Second Embodiment]
According to the second embodiment, in addition to the function and effect of the first embodiment in which the preview display process and the recording process can be executed according to appropriate setting values, even if the map program 66 is called during the execution of the preview display process, The stored first print data can be prevented from being accidentally discarded. In addition, it is possible to prevent unnecessary first print data from being temporarily stored by inquiring of the user whether or not to temporarily store the first print data.

  The print program 65 is, for example, the first print data acquired from the service providing device 70 through the communication unit 55, the first print data edited by an external program, or the first print data Depending on the conversion by the server device (not shown), the processing of steps S52 to S54 may be executed. On the other hand, the print program 65 may skip the processes of steps S52 to S54 in response to the first print data not satisfying the above-described conditions.

  According to the above configuration, the process of receiving the first print data from the service providing apparatus 70, the process of causing the external program to edit the first print data, or the process of converting the first print data to a server device (not shown) is performed again. No need to run. In step S54, what is temporarily stored is not limited to the first print data, and the setting value used for generating the first preview image may be further temporarily stored, or image data indicating the first preview image may be stored. May be temporarily stored instead of the first print data.

  Note that the processing of steps S52 to S54 can be applied to other than temporary storage of unsaved print data. For example, as described in detail below, the printing program 65 further has a function of acquiring scan data generated by the scanner unit 12 of the multifunction device 10 from the multifunction device 10 and storing the scan data in a location specified by the user. You may have. The printing program 65 may temporarily store unsaved scan data in steps S52 to S54.

  First, the print program 65 causes the display unit 53 to display a scan execution screen. FIG. 12B is an example of a scan execution screen. The scan execution screen shown in FIG. 12B includes a pull-down menu for accepting selection of the multifunction machine 10 to execute the scan process, a message “Please set the document in the selected MFC”, and a [Scan] icon. Including. Then, the printing program 65 stands by in a state where a user operation on the scan execution screen can be accepted via the operation unit 54.

  Next, the print program 65 instructs the multifunction peripheral 10 selected through the pull-down menu to execute a scan process in response to accepting a user operation for tapping the position of the [Scan] icon via the operation unit 54. Scan instruction information to be transmitted is transmitted through the communication unit 55. Then, the printing program 65 stands by in a state where the scan data generated by the multifunction machine 10 can be received through the communication unit 55. These processes are examples of the reception process.

  Further, the control program 35 of the multifunction machine 10 receives a document set on contact glass or ADF (abbreviation of Auto Document Feeder) in response to receiving scan instruction information from the portable terminal 50 through the communication unit 25. The scan data generated by the scanner unit 12 is transmitted to the portable terminal 50 through the communication unit 25. These processes are examples of the reading process.

  Next, the printing program 65 causes the display unit 53 to display a storage destination selection screen in response to receiving scan data from the multifunction device 10 through the communication unit 55. FIG. 13A is an example of a save destination selection screen. The storage destination selection screen shown in FIG. 13A includes one or more storage destination icons 151, 152, and 153. The save destination icons 151 to 153 correspond to scan data save destinations. For example, the save destination icon 151 corresponds to a data folder provided in the data storage area 62B. The storage destination icons 152 and 153 correspond to a storage server such as the service providing apparatus 70. Then, the print program 65 stands by in a state where it can accept a user operation on the save destination selection screen via the operation unit 54. These processes are examples of the reception process.

  Next, the print program 65 stores the scan data in the storage destination corresponding to the storage destination icon in response to receiving a user operation for tapping the position of the storage destination icon 151 to 153 via the operation unit 54. . On the other hand, in response to the print program 65 displaying the scan execution screen or the storage destination selection screen being saved in the background and called as a plug-in of the map program 66, the print program 65 is shown in FIG. The image recording process is executed.

  In this case, the print program 65 displays the temporary storage inquiry screen shown in FIG. 13B on the display unit 53 (S53), assuming that the scan data is not stored (S52: Yes). Then, the print program 65 temporarily stores the scan data in the data storage area 62B in response to accepting a user operation for tapping the position of the [Save] icon via the operation unit 54 (S53: Yes) (S54). ). On the other hand, the print program 65 skips the process of step S54 in response to accepting a user operation for tapping the position of the [Cancel] icon via the operation unit 54 (S53: No). This eliminates the need for the multifunction device 10 to execute the scan process again.

  In the multifunction machine 10 and the portable terminal 50 of each embodiment, the CPU 31 and 61 execute various programs stored in the program storage areas 32A and 62A of the storage units 32 and 62, so that the control unit of the present invention is executed. An example in which each process to be executed is realized has been described. However, the configuration of the control unit is not limited to this, and part or all of the configuration may be realized by hardware such as an integrated circuit (also referred to as an IC (Integrated Circuit)).

  Furthermore, the present invention may be realized not only as the multifunction device 10 or the portable terminal 50 but also as a program that causes the multifunction device 10 or the portable terminal 50 to execute processing. Then, the program may be provided by being recorded on a non-transitory recording medium. The non-transitory recording medium may include a storage unit mounted on a server device that can be connected to the multifunction device 10 or the portable terminal 50 via the communication network 102 in addition to a CD-ROM, a DVD-ROM, or the like. And the program memorize | stored in the memory | storage part of the server apparatus may be delivered via the communication networks 102, such as the internet, as the information or signal which shows the said program.

DESCRIPTION OF SYMBOLS 10 ... Multifunction machine 11 ... Printer part 12 ... Scanner part 25, 55 ... Communication part 31, 61 ... CPU
35 ... Control program 65 ... Print program 66 ... Map program 50 ... Portable terminal 53 ... Display unit 54 ... Operation unit 62 ... Storage unit

(1) A print program disclosed as an embodiment includes a display unit, an operation unit, a storage unit capable of storing an external program, and a communication unit, and displays an image indicated by print data according to a set value. It can be executed by an image recording apparatus capable of executing a recording process to be recorded on a computer and a computer that performs wireless communication with the communication unit. The print program executes the external program for determining the print data to be subjected to the recording process based on a user operation, and acquires the print data determined by the external program; Generating a preview image representing a state in which the print image indicated by the print data is recorded on the sheet, displaying the preview image on the display unit, and instructing execution of the recording process on the print data In response to receiving the first touch operation in the first reception process and the first reception process in which the one touch operation is received via the operation unit in a state where the preview image is displayed on the display unit, Recording instruction information for executing the recording process on the print data is transmitted to the image recording apparatus through the communication unit. To execute the output process, to the computer.

(14) An external program disclosed as an embodiment is executed by the computer in response to an instruction from the printing program according to any one of (1) to (13) . The external program causes the computer to execute a notification process for notifying the print program of data identification information indicating the print data in response to the operation unit receiving a touch operation designating the print data.

(15) An information processing device disclosed as an embodiment includes an information processing device including a display unit, an operation unit, a storage unit capable of storing an external program, a communication unit, and a control unit. The communication unit can wirelessly communicate with an image recording apparatus capable of executing a recording process for recording an image indicated by print data on a sheet according to a set value. The controller executes the external program for determining the print data to be subjected to the recording process based on a user operation, and acquires the print data determined by the external program; and Generating a preview image representing a state in which the print image indicated by the print data is recorded on the sheet, displaying the preview image on the display unit, and instructing execution of the recording process on the print data In response to receiving the first touch operation in the first reception process and the first reception process in which the one touch operation is received via the operation unit in a state where the preview image is displayed on the display unit, Output for transmitting recording instruction information for executing the recording process on the print data to the image recording apparatus through the communication unit To run and management.

(16) A recording system disclosed as an embodiment is indicated by an information processing device including a display unit, an operation unit, a storage unit capable of storing an external program, a first communication unit, and a first control unit, and print data. An image recording apparatus including a recording unit capable of executing a recording process for recording an image on a sheet according to a set value, a second communication unit, and a second control unit. An external acquisition process for executing the external program for determining the print data to be subjected to the recording process based on a user operation and acquiring the print data determined by the external program; Generating a preview image representing a state in which the print image indicated by the print data is recorded on a sheet and displaying the preview image on the display unit; and instructing execution of the recording process on the print data A first receiving operation for receiving the first touch operation through the operation unit in a state where the preview image is displayed on the display unit, and in response to receiving the first touch operation in the first receiving process. Then, recording instruction information for executing the recording process for the print data is transmitted to the image recording apparatus through the first communication unit. To run and that output processing. The second control unit causes the recording unit to execute the recording process indicated by the recording instruction information in response to receiving the recording instruction information from the information processing apparatus through the second communication unit.

FIG. 1 is a schematic diagram of a recording system 100 in the present embodiment. A recording system 100 shown in FIG. 1 includes a multifunction device 10, a portable terminal 50, and a service providing device 70. The multi-function device 10, the portable terminal 50, and the service providing apparatus 70 can communicate with each other via the communication network 102. Specific examples of the communication network 102 are not particularly limited, but may be, for example, the Internet, a mobile communication network, a wired LAN (abbreviation of Local Area Network), a wireless LAN, or a combination thereof. The recording system 100 is an example of a content processing system.

[Multifunction machine 10]
As shown in FIG. 1, the multifunction machine 10 includes a printer unit 11, a scanner unit 12, a display unit 23, an operation unit 24, a communication unit 25, a CPU 31, a storage unit 32, and a communication bus 33. Is mainly provided. Each component constituting the multi-function device 10 is connected to each other via a communication bus 33. The multifunction device 10 is an example of a content processing device or a reading device.

[Printer 11 and Scanner 12]
The printer unit 11 executes a recording process for recording an image indicated by the image data on a recording sheet that is an example of a sheet. The recording method of the printer unit 11 is not particularly limited. For example, a known method such as an ink jet method or an electrophotographic method can be employed. The scanner unit 12 executes a scan process for reading an image recorded on a recording sheet and generating image data. The multi-function device 10 may further include a FAX function for performing FAX transmission / reception, a copy function for reading an image recorded on a recording sheet and recording it on another recording sheet. The printer unit 11, the image data, and the recording process are examples of a content processing unit, content data, and content processing.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 102. That is, the multifunction device 10 outputs various information to the mobile terminal 50 or the service providing apparatus 70 through the communication unit 25 and receives various data or various information from the mobile terminal 50 or the service providing apparatus 70 through the communication unit 25. Although the specific communication procedure of the communication part 25 is not specifically limited, For example, Wi-Fi (registered trademark of Wi-Fi Alliance) is employable. The communication unit 25 is an example of a second communication unit.

[CPU 31]
A CPU (abbreviation of Central Processing Unit) 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires and executes various programs, which will be described later, from the storage unit 32 based on various information output from the operation unit 24 and various information acquired from an external device through the communication unit 25. The CPU 31 is an example of a second control unit.

[Portable terminal 50]
As shown in FIG. 1, the portable terminal 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 61, a storage unit 62, and a communication bus 63. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the portable terminal 50 are the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, Since it is common with the memory | storage part 32 and the communication bus | bath 33, description for the second time is abbreviate | omitted. The CPU 61 is an example of a control unit or a first control unit. The portable terminal 50 is an example of an information processing device. However, a specific example of the information processing apparatus is not limited to the mobile terminal 50 such as a smartphone, a mobile phone, and a tablet terminal, and may be a PC (abbreviation of Personal Computer) or the like.

The print program 65 is a program that causes the multi-function peripheral 10 to perform a recording process for the acquired print data. The map program 66 is a program that allows the user to designate an arbitrary area of the map image and delivers print data indicating the map image of the designated area to the print program 65. The map program 66 is an example of an external program that determines print data to be subjected to recording processing based on a user operation. The print program 65 is an example of an output instruction program. A specific example of the external program is not limited to the map program 66, and may be, for example, a paint program that edits an image in accordance with a user operation and delivers print data indicating the edited image to the print program 65.

The print program 65 waits in a state where a user operation for selecting the acquisition source icons 111 to 114 or the notification icon 115 can be accepted via the operation unit 54 while the menu screen is displayed on the display unit 53 (S43). Then, the print program 65 ends the menu screen display process in response to accepting a user operation for tapping the positions of the icons 111 to 113 and 115 via the operation unit 54 (S43: Yes). The process of step S43 is an example of a selection operation acceptance process. A user operation of tapping one of the icons 111 to 113 and 115 is an example of a selection operation.

On the other hand, the print program 65 executes an external acquisition process in response to receiving a user operation for tapping the position of the acquisition source icon 113 via the operation unit 54 (S12: external icon) (S14). The external acquisition process is a process for acquiring print data determined by an external program. That is, the print program 65 operates the map program 66 corresponding to the acquisition source icon 113 and acquires the print data determined by the map program 66. Note that the printing program 65 may be operated using the map program 66 as a plug-in, or may be operated via the OS 64. The external acquisition process is an example of an acquisition process.

The preview image included in the preview screen is an image representing a state where the print image indicated by the print data is recorded on the sheet. The user operation of tapping the position of the [Print] icon included in the preview screen is an example of a first touch operation that instructs execution of a recording process for print data. The process of steps S15 to S19 is an example of a preview display process, and the process of step S20 is an example of an instruction operation reception process.

Next, in response to accepting a user operation for tapping the position of the [Print] icon via the operation unit 54 (S20: Yes), the print program 65 sends the recording instruction information to the multifunction device 10 through the communication unit 55. Transmit (S21). The recording instruction information is information for executing recording processing for print data in accordance with the set value used for generating the preview image. The recording instruction information includes, for example, the print data acquired in steps S13 and S14 and the setting value used for generating the preview image. The process of step S21 is an example of an instruction process and a transmission process.

Claims (16)

An image recording apparatus comprising a display unit, an operation unit, a storage unit capable of storing an external program, and a communication unit, and capable of executing a recording process for recording an image indicated by print data on a sheet according to a set value A printing program executable by a computer that communicates wirelessly through the communication unit,
An external acquisition process for executing the external program for determining the print data to be subjected to the recording process based on a user operation, and acquiring the print data determined by the external program;
A preview display process for generating a preview image representing a state in which a print image indicated by the print data is recorded on a sheet, and displaying the preview image on the display unit;
A first accepting process for accepting a first touch operation for instructing execution of the recording process on the print data via the operation unit in a state where the preview image is displayed on the display unit;
An output process for transmitting recording instruction information for executing the recording process on the print data to the image recording apparatus through the communication unit in response to receiving the first touch operation in the first receiving process. A printing program to be executed by the computer. The printing program is
A list display process for causing the display unit to display a basic object indicating the acquisition source of the print data and an external object indicating the external program stored in the storage unit;
A second receiving process for receiving a second touch operation for selecting one of the objects displayed on the display unit in the list display process via the operation unit;
In response to accepting the second touch operation for selecting the basic object in the second accepting process, a designation operation for designating one of the data that can be acquired from the acquisition source indicated by the basic object is the operation unit. And a basic acquisition process for acquiring data specified by the specifying operation as the print data from the acquisition source,
And causing the computer to execute the external acquisition process using the external program indicated by the external object in response to receiving the second touch operation for selecting the external object in the second reception process. Item 8. The printing program according to item 1. The printing program is
A determination process for determining whether or not the external program is stored in the storage unit;
A list display process for causing the display unit to display only the external object indicating the external program determined by the determination process as being stored in the storage unit among the external objects. Item 3. The printing program according to Item 2. The program
Identification information acquisition processing for acquiring a plurality of program identification information for identifying each of the external programs executable in the external acquisition processing;
The printing program according to claim 3, wherein the computer executes the determination process of determining whether or not the external program identified by the program identification information is stored in the storage unit.   5. The printing program according to claim 3, wherein the printing program causes the display unit to display the first object acquired from the external program as the external object in the list display process.   In the list display process, the print program is stored in the storage unit to distinguish the external program from the second object stored in the storage unit to distinguish the external program from the other external program or the basic object. The printing program according to claim 3, wherein the displayed third object is displayed on the display unit as the external object. The printing program is
In response to the acquisition of the first object, in the list display process, the first object is displayed on the display unit as the external object,
The printing program according to claim 6, wherein the second object or the third object is displayed on the display unit as the external object in the list display process in response to the failure to acquire the first object.   In response to the notification from the OS of the computer that the external program has been deleted from the storage unit in the list display process, the print program removes the external object indicating the deleted external program. The printing program according to claim 3, wherein the printing program is displayed.   In response to determining that the external program is not stored in the storage unit in the determination process, the print program notifies that the external program that can be installed in the computer exists in the list display process. The printing program according to claim 3, wherein a notification object to be displayed is displayed on the display unit.   10. The print program according to claim 1, wherein, in the external acquisition process, a list of the setting values that can be used by the image recording apparatus for the recording process is notified when the external program is executed. 11. Printing program. The storage unit can store a first setting value that is the setting value associated with the program identification information;
The printing program is
The external acquisition process for further acquiring the program identification information of the executed external program from the external program;
A read process for reading out the first set value from the storage unit in response to the first set value associated with the acquired program identification information being stored in the storage unit;
The preview display process for causing the display unit to display the preview image generated according to the first set value read in the read process;
Causing the computer to execute the output process of transmitting the recording instruction information for executing the recording process for the print data to the image recording apparatus through the communication unit according to the setting value used for generating the preview image. The printing program according to claim 1.   In the preview display process that is executed in response to the acquisition of a designated setting value, which is the setting value to be used for the recording process for the print data, from the external program, the first setting value is the print program. The printing program according to claim 11, wherein the preview image generated according to the designated set value is displayed on the display unit regardless of whether or not the image is stored in the storage unit.   The printing program according to claim 12, wherein the printing program stores the designated setting value as the first setting value in the storage unit. An external program that is executed by the computer in response to an instruction from the printing program according to claim 1,
An external program for causing the computer to execute notification processing for notifying the print program of data identification information indicating the print data in response to the operation unit receiving a touch operation for designating the print data. A display unit;
An operation unit;
A storage unit capable of storing an external program;
A communication department;
An information processing apparatus comprising a control unit,
The communication unit is capable of wirelessly communicating with an image recording apparatus capable of executing a recording process for recording an image indicated by print data on a sheet according to a set value,
The controller is
An external acquisition process for executing the external program for determining the print data to be subjected to the recording process based on a user operation, and acquiring the print data determined by the external program;
A preview display process for generating a preview image representing a state in which a print image indicated by the print data is recorded on a sheet, and displaying the preview image on the display unit;
A first accepting process for accepting a first touch operation for instructing execution of the recording process on the print data via the operation unit in a state where the preview image is displayed on the display unit;
An output process for transmitting recording instruction information for executing the recording process on the print data to the image recording apparatus through the communication unit in response to receiving the first touch operation in the first receiving process. Information processing apparatus to be executed. An information processing device including a display unit, an operation unit, a storage unit capable of storing an external program, a first communication unit, and a first control unit, and a recording process for recording an image indicated by print data on a sheet according to a set value A recording system comprising a possible recording unit, a second communication unit, and an image recording device comprising a second control unit,
The first controller is
An external acquisition process for executing the external program for determining the print data to be subjected to the recording process based on a user operation, and acquiring the print data determined by the external program;
A preview display process for generating a preview image representing a state in which a print image indicated by the print data is recorded on a sheet, and displaying the preview image on the display unit;
A first accepting process for accepting a first touch operation for instructing execution of the recording process on the print data via the operation unit in a state where the preview image is displayed on the display unit;
An output process for transmitting recording instruction information for executing the recording process on the print data to the image recording apparatus through the first communication unit in response to receiving the first touch operation in the first receiving process; Run,
The recording system in which the second control unit causes the recording unit to perform the recording process indicated by the recording instruction information in response to receiving the recording instruction information from the information processing apparatus through the second communication unit.

Images