JP6330948B2 - Computer program and communication device - Google Patents

Description

  The present invention relates to control of a communication device connected to a network including a plurality of image processing devices, and more particularly to control for executing image processing using a plurality of image processing devices.

  A technique using a plurality of image processing apparatuses connected to a network in combination is known. For example, a system that realizes copy processing using a scanner and a printer separate from the scanner is known (for example, Patent Document 1). In this technology, a user moves a specific scanner icon onto a specific printer icon on a setting screen displayed on a display device of a personal computer connected to a network to which a plurality of scanners and a plurality of printers are connected. By performing a drag-and-drop operation, a copy process using a specific scanner and a specific printer can be specified.

  However, in the above technique, for example, when the number of types of image processing apparatuses included in the system is large, there is a possibility that the user cannot properly grasp the image processing that can be realized by the system.

JP 2000-315182 A

  An object of the present invention is to provide a technique for a user to appropriately grasp image processing that can be realized by a plurality of image processing apparatuses connected to a network.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following application examples.

Application Example 1 A computer program for a communication device connected to a network including a plurality of image processing devices,
A search step for searching the plurality of image processing devices in the network;
A plurality of image processings that can be realized using the searched plurality of image processing devices, the first image processing device executing the first image processing, and the first image processing. Image processing executed by each of the image processing devices with the plurality of image processing candidates including the composite processing executed using the second image processing device that executes the second image processing using the data A determination step of determining using processing information that is information related to the realization of the image processing device and is prepared for each image processing device;
A display control step for displaying support information for selecting the image processing to be determined on a display unit of the communication device;
A computer program that causes a computer mounted on the communication device to realize the above.

  According to the above configuration, support information for selecting image processing including composite processing realized by the first image processing device and the second image processing device according to a plurality of image processing devices in the network. Is displayed on the display. Therefore, the user can appropriately grasp image processing that can be realized by a plurality of image processing apparatuses in the network.

[Application Example 2] The computer program according to Application Example 1,
The processing information is
Information indicating a format of data output in the image processing executed by the first image processing apparatus;
Information indicating a format of data that can be input for image processing executed by the second image processing apparatus;
Including
In the determination step, when the data output from the first image processing device can be input to the second image processing device with reference to the processing information, the first image processing device A computer program in which the composite processing executed using the second image processing apparatus is determined as the realizable image processing.

  According to this configuration, realizable image processing is appropriately determined based on the format of data output from the first image processing device and the format of data that can be input to the second image processing device. be able to.

[Application Example 3] The computer program according to Application Example 1 or Application Example 2,
In the determination step,
Based on information in which the input format for the first image processing, the output format of the result of the second image processing, and the function type of the composite processing are associated, A computer program in which image processing is determined.

  According to this configuration, the realizable image processing can be appropriately determined based on the input format for the first image processing and the output format of the result of the second image processing.

[Application Example 4] The computer program according to Application Example 1 or Application Example 2,
In the determination step,
Determining the realizable image processing based on information associated with the type of the first image processing device, the type of the second image processing device, and the type of function of the combined processing; Computer program.

  According to this configuration, it is possible to appropriately determine the feasible image processing based on the type of the first image processing device and the type of the second image processing device.

[Application Example 5] The computer program according to any one of Application Examples 1 to 4,
The second image processing apparatus is different from the first image processing apparatus,
The computer program further includes:
A detection step of detecting whether an error has occurred in any of a set of image processing devices that execute the composite processing during the execution of the composite processing is implemented in a computer mounted on the communication device,
In the display control step, when the error is detected, the first error information including information on the content of the error is displayed on a display unit.

  According to this configuration, error information generated during the execution of the composite process can be displayed on the display unit, so that convenience for the user can be improved.

Application Example 6 The computer program according to any one of Application Example 1 to Application Example 4,
The second image processing apparatus is different from the first image processing apparatus,
The computer program further includes:
A detection step of detecting whether an error has occurred in any of a set of image processing apparatuses that execute the composite processing during the execution of the composite processing;
A storage step of storing, in a storage device, second error information indicating the set of image processing devices in which the error is detected when the error is detected;
Is realized by a computer mounted on the communication device.

  According to this configuration, the second error information indicating a set of image processing devices in which an error is detected can be stored in the storage device. Therefore, when determining a composite process that can be realized later, the error information Can be used.

[Application Example 7] The computer program according to Application Example 6,
The step of acquiring the second error information stored in the storage device is realized in a computer mounted on the communication device,
The display control step is executed using the set of image processing devices corresponding to the second error information among the plurality of image processings that can be realized using the plurality of image processing devices. A computer program in which the support information for selecting the image processing excluding the combined processing is displayed.

  According to this configuration, the user can be prevented from selecting a composite process that may cause an error.

[Application Example 8] The computer program according to Application Example 6, further comprising:
The step of acquiring the second error information stored in the storage device is realized in a computer mounted on the communication device,
In the display control step, the support information for selecting the composite processing executed using a combination of the first image processing device and the second image processing device corresponding to the second error information A computer program in which the support information including information about an error is displayed when is displayed.

  According to this configuration, the user can be prevented from selecting a composite process that may cause an error.

Application Example 9 The computer program according to any one of Application Example 6 to Application Example 8,
The computer program, wherein the second error information includes information related to mismatch between the capabilities of the first image processing device and the capabilities of the second image processing device.

  When there is a mismatch between the capabilities of the first image processing device and the second image processing device, the composite is executed using the first image processing device and the second image processing device. Problems such as image quality degradation may occur during processing. According to this configuration, the user can be prevented from selecting a composite process that may cause such a problem.

  The present invention can be realized in various forms. For example, the present invention can be realized in the form of a method for realizing the functions of the computer program, a communication apparatus, a recording medium on which the computer program is recorded, and the like.

The block diagram which shows the structure of the system 1000 of 1st Example. The figure which shows an example of input-output information. The figure which shows an example of the function information FI. The figure which shows an example of error occurrence information EI. The flowchart of the UI display process which 1st Example performs. The figure which shows an example of the combination information SI which shows only the combination pattern which can be connected. The figure which shows the example of a display of assistance information. The flowchart of a device control process. The figure which shows an example of the operation | movement flow information OF. The figure which shows an example of a progress image for displaying the progress of image processing. FIG. 11 is a sequence diagram when causing the scanner 300A and the printer 200B to execute copy processing by device control processing. The block diagram which shows the structure of the system 2000 of 2nd Example. The figure which shows the input / output information 832S of the server 800 itself. The figure which shows an example of the composite process search table FIC. The flowchart of UI display processing of 2nd Example. An example of the operation flow information OF2 of the second embodiment. The figure which shows an example of the input-output information of 3rd Example. The figure which shows an example of the function information FID of 3rd Example.

A. First Example A-1. Next, an embodiment of the present invention will be described based on examples. FIG. 1 is a block diagram illustrating a configuration of a system 1000 according to the first embodiment. The system 1000 includes three printers 200A to 200C, two scanners 300A and 300B, a multifunction machine 400, a sewing machine 500, a garment printer 600, an access point 50, and a portable terminal 100. Yes. Eight devices (also called image processing apparatuses) 200 </ b> A to 200 </ b> C, 300 </ b> A, 300 </ b> B, 400, 500, 600 and the access point 50 are connected to a local area network (LAN) 60.

  The LAN 60 is, for example, a wired network constructed in a building (such as a building) in conformity with the Ethernet (registered trademark) standard.

  The access point 50 is a wireless LAN access point using a communication method defined by a standard such as IEEE802.11a / b / g / n. The portable terminal 100 is connected to the LAN 60 via the access point 50. Accordingly, the mobile terminal 100 can communicate with the eight devices 200A to 200C, 300A, 300B, 400, 500, and 600 via the access point 50 and the LAN 60.

  The printer 200A includes a control unit CT, an interface unit IF including a user interface and a communication interface, and a print execution unit 240. The control unit CT includes a CPU 210, a volatile storage device 220 such as a RAM, and a nonvolatile storage device 230 such as a hard disk drive or a flash memory. The interface unit IF includes a display unit 250 including a display panel such as a liquid crystal, an operation unit 260 including a touch panel and buttons superimposed on the display panel, and an interface for performing data communication with an external device via the LAN 60. And a communication unit 270. The print execution unit 240 is a print engine that prints an image on paper using a predetermined method (for example, ink jet, laser).

  The volatile storage device 220 is provided with a buffer area 221 that temporarily stores various intermediate data generated when the CPU 210 performs processing. The non-volatile storage device 230 stores a control program 231 for controlling the printer 200A and input / output information 232A described later.

  The control program 231 is stored in the nonvolatile storage device 230 in advance at the time of shipment of the printer 200A, for example. Further, the control program 231A can be provided in a form recorded on a CD-ROM or downloaded from a server.

  Like the printer 200A, the printers 200B and 200C include a control unit, an interface unit, and a print execution unit (not shown). Since the printers 200A to 200C are different from each other, the specifications of the print execution unit and the control program are different from each other, and the formats of input data are different from each other as described later. For this purpose, different input / output information 232A, 232B, and 232C (described later with reference to FIG. 2) are stored in the printers 200A to 200C.

  Similar to the printer 200A, the scanners 300A and 300B include a control unit and an interface unit (not shown). The scanners 300A and 300B include a read execution unit (not shown) that optically reads a document using an optical sensor (for example, CIS (Contact Image Sensor)) instead of the print execution unit 240 of the printer 200A. ing. Since the scanner 300A and the scanner 300B are different from each other, the specifications of the reading execution unit and the control program are different from each other, and the output image data formats that can be output are different from each other as described later. For this purpose, different input / output information 332B and 332C (described later with reference to FIG. 2) are stored in the scanners 300A and 300B.

  Similar to the printer 200A, the multi-function device 400 includes a control unit, an interface unit, and a print execution unit, and also includes a read execution unit (not shown), similar to the scanners 300A and 300B. The multifunction device 400 stores input / output information 432 (described later with reference to FIG. 2) according to the specifications of the multifunction device 400. Further, the interface unit of the multifunction machine 400 includes an interface for connecting to a telephone line. Then, the control unit of the multi-function peripheral 400 performs a reading process using the reading execution unit, a printing process using the print execution unit, and a telephone that transmits and receives image data in a predetermined format (such as FAXG4 format) via a telephone line. Communication processing. In addition, the control unit of the multi-function peripheral 400 can execute a copy process for printing an image shown on a document on paper by combining a reading process and a printing process. In addition, by combining reading processing, printing processing, and telephone communication processing, image data representing an image shown on the original is transmitted via the telephone line, and image data received via the telephone line is transmitted to the paper. Fax processing to be printed on can be realized.

  The sewing machine 500 includes a control unit and an interface unit (not shown), like the printer 200A. The sewing machine 500 replaces the printing execution unit 240 of the printer 200A with a sewing needle in a direction perpendicular to the plane in which the cloth moves while moving the cloth to be sewn arranged on the sewing machine bed along a predetermined plane. A sewing execution unit capable of embroidering an image by reciprocating driving is provided. The control unit of the sewing machine 500 generates embroidery data for embroidering the image using the input image data, and drives the sewing execution unit according to the embroidery data, thereby embroidering the image represented by the image data. Can be executed. The sewing machine 500 stores input / output information 532 (described later with reference to FIG. 2) according to the specifications of the sewing machine 500.

The garment printer 600 includes a control unit and an interface unit (not shown), similar to the printer 200A. The garment printer 600 includes a printing execution unit for clothing that prints an image on clothing such as a T-shirt using, for example, an inkjet method instead of the printing execution unit 240 of the printer 200A. The garment printer 600 stores input / output information 632 (which will be described later with reference to FIG. 2) according to the specifications of the garment printer 600.

  Since the printers 200A to 200C, the sewing machine 500, and the garment printer 600 are devices that form images on paper or cloth, they can be called image forming devices. Since the scanner is a device that generates read image data by reading a document, it can be called an image data generation device. Further, since the multi-function device 400 has both a printer function and a scanner function, it can be said that it is an image forming apparatus and an image data generating apparatus.

FIG. 2 is a diagram illustrating an example of input / output information. The input / output information includes input information and output information. For example, FIGS. 2A to 2C show input information 232A to 232C of the printers 200A to 200C. The input information is information indicating the format of data that can be input when there is data to be input for image processing executed by the target device. The image processing executed by the printers 200A to 200C is “printing on paper”. Input for the printing process is performed in the form of image data. For this reason, as shown in FIGS. 2A to 2C, in the input / output information 232A to 232C of the printers 200A to 200C, the input information indicates the format of image data that can be input for printing processing. It is information to show. Specifically, the input image data format includes, for example, a bitmap data format, a compressed image data format, and a format for storing image data in units of pages. The format of the bitmap data is, for example, RGB image data that represents the color of each pixel with the gradation value of each component of RGB, CMYK image data that represents the color of each pixel with the gradation value of each component of CMYK, Each format includes a format such as dot data indicating whether or not to form a print dot. Formats of compressed image data include formats such as JPEG (Joint Photographic Experts Group) and GIF (Graphics Interchange Format). Formats for storing image data in units of pages include page description language formats such as PostScript and Portable Document Format (PDF).

  Specifically, the input information of the input / output information 232A of the printer 200A is dot data, RGB image data, image data compressed by the JPEG method, image data described in PostScript, and PDF. And information indicating image data (FIG. 2A). The input information of the input / output information 232B of the printer 200B includes information indicating RGB image data and image data compressed by the JPEG method (FIG. 2B). The input information of the input / output information 232C of the printer 200C includes information indicating dot data, image data described in PostScript, and image data stored in PDF (FIG. 2C). .

  As can be understood from the above description, the format of image data that can be input for print processing may differ depending on the printer model. In this embodiment, as shown in FIG. 2A, the printer 200A has dot data, RGB image data, image data compressed in JPEG format, image data described in PostScript, and PDF. It is possible to input stored image data. On the other hand, as shown in FIG. 2B, it is possible to input RGB image data and image data compressed by the JPEG method to the printer 200B, but input image data of other formats. I can't do it. As shown in FIG. 2C, the printer 200C can input dot data, image data described in PostScript, and image data saved in PDF. Image data in the format cannot be input.

  The output information is information indicating the output form when the output of the result of the image processing executed by the target device is performed in a form different from the data. The result of the printing process is output in the form of “paper”, not image data. For this reason, the output information of the input / output information 232A to 232C of the printers 200A to 200C is information indicating “paper” which is the output form of the printing process.

  The input information includes information indicating the input form when the input for image processing executed in the target device is performed in a form different from the data. The image processing executed by the scanners 300A and 300B is “paper (ie, document) reading processing”. The input for the reading process is performed in the form of “paper”, not image data. Therefore, as shown in FIGS. 2D to 2E, the input information of the input / output information 332A and 332B of the scanners 300A and 300B includes “paper” that is an input form for the reading process. Information.

  The output information includes information indicating the format of data that can be output when there is data to be output as a result of image processing executed by the target device. The output of the result of the reading process is performed in the form of image data. Therefore, the output information of the input / output information 332A and 332B of the scanners 300A and 300B is information indicating the format of image data that can be output in the reading process.

  Specifically, the output information of the input / output information 332A of the scanner 300A includes information indicating RGB image data, image data compressed by the JPEG method, and image data saved by PDF (FIG. 2 (D)). The output information of the input / output information 332B of the scanner 300A includes information indicating RGB image data (FIG. 2E).

  As can be understood from the above description, the format of image data that can be output as a result of the reading process may vary depending on the scanner model. In this embodiment, as shown in FIG. 2D, the scanner 300A can output RGB image data, image data compressed by the JPEG method, and image data saved by PDF. Yes, image data in other formats cannot be output. As shown in FIG. 2E, the scanner 300B can output only RGB image data, and cannot output image data of other formats.

  The image processing executed by the multi-function device 400 is “print processing on paper”, “read processing of paper original”, and “fax processing”. Therefore, in the multi-function device 400, input for printing processing and fax processing is performed in the form of image data, and input for reading processing is performed in the form of “paper”. In the multi-function device 400, the result of the printing process is output in the form of “paper”, and the result of the reading process and the fax process is output in the form of image data. For this purpose, as shown in FIG. 2F, the input / output information 432 of the multifunction machine 400 includes input information and output information for the printing process, the reading process, and the fax process.

For example, in this embodiment, the input / output information 432 of the MFP 400 includes RGB image data, image data compressed by the JPEG method, and image data stored in PDF as input information for the printing process. Contains information to indicate. Further, the input / output information 432 of the multifunction machine 400 includes information indicating “paper” as output information of the printing process. The input / output information 432 of the MFP 400 includes information indicating “paper” as input information of the reading process, and RGB image data and image data stored in PDF are output information of the reading process. Contains information for each. For example, the input / output information 432 of the MFP 400 includes the same information as the input information for the printing process as the input information for the fax process, and includes information indicating the FAXG4 format as the output information for the fax process.

  The image processing executed by the sewing machine 500 is “cloth embroidery processing”. The input for the embroidery process is performed in the form of image data, and the output of the result of the embroidery process is performed in the form of “cloth (embroidery)” instead of the image data. Therefore, as shown in FIG. 2G, the input information of the input / output information 532 of the sewing machine 500 includes information indicating RGB image data and image data compressed by the JPEG method. The output information of the input / output information 532 includes information indicating “cloth (embroidery)”.

  The image processing executed by the garment printer 600 is “printing on cloth”. The input for the printing process is performed in the form of image data, and the output of the result of the printing process is performed in the form of “cloth (print)” instead of the image data. Therefore, as shown in FIG. 2H, the input information of the input / output information 632 of the garment printer 600 includes information indicating RGB image data and image data compressed by the JPEG method. The output information of the input / output information 632 includes information indicating “cloth (print)”.

  Returning to FIG. 1, the description will be continued. The mobile terminal 100 is, for example, a multi-function mobile phone called a smartphone. The portable terminal 100 includes a CPU 110, a volatile storage device 120 such as a RAM, a non-volatile storage device 130 such as a hard disk drive or a flash memory, a wireless IF unit 140, a telephone IF unit 150, a speaker and a microphone. Mainly includes an audio processing unit 160 for realizing functions and the like, an operation unit 170 including a touch panel and operation keys, and a display unit 180 including a liquid crystal panel superimposed on the touch panel.

  The wireless IF unit 140 includes an antenna, and performs wireless communication with the access point 50 according to a standard such as IEEE 802.11a / b / g / n. As a result, as described above, the mobile terminal 100 can communicate with the plurality of devices 200A to 200C, 300A, 300B, 400, 500, 600 connected to the LAN 60 via the access point 50 and the LAN 60. Is possible.

  The telephone IF unit 150 includes an antenna and performs wireless communication with a base station (not shown) in accordance with a mobile phone communication system (for example, W-CDMA). The telephone IF unit 440 is used for connection to the Internet 70 via a telephone or a base station, for example.

  The volatile storage device 120 is provided with a buffer area 125 for temporarily storing various intermediate data generated when the CPU 110 performs processing.

  The nonvolatile storage device 130 stores a control program PG1, a device usage program PG2, error occurrence information EI, and function information FI. The control program PG1 is a program that realizes basic functions of the mobile terminal 100 such as an OS (operating system) function and a telephone function. The control program PG1 is provided by the manufacturer of the mobile terminal 100, for example, and is stored in advance at the time of shipment. The device utilization program PG2 is a program that realizes a function for remotely operating the plurality of devices 200A to 200C, 300A, 300B, 400, 500, 600 connected to the LAN 60. The device use program PG2 is a program for adding a new function to the mobile terminal 100 (referred to as an “app”). For example, a provider (for example, a device manufacturer) different from the manufacturer of the mobile terminal 100 is used. Is provided in the form of downloading from a predetermined server. The device usage program PG2 may be provided by the manufacturer of the mobile terminal 100, for example, and stored in advance at the time of shipment.

FIG. 3 is a diagram illustrating an example of the function information FI. The function information FI is information for associating a pair of an input device and an output device (hereinafter simply referred to as a device pair) and a function type of composite processing that can be realized by using the device pair. The composite processing according to the present exemplary embodiment includes processing including input-side image processing executed by the input device and output-side image processing executed by the output device using data obtained by the input-side image processing. It is. The input device is a device to which information for complex processing is input. Information for composite processing is input in the form of, for example, image data or a paper document. The output device is a device that outputs the result of the composite processing. In the present embodiment, five types of composite processing are assumed: copy processing, high-speed copy processing, card fax processing, embroidery copy processing, and clothing copy processing.

  The copy process is realized by a scanner as an input device that reads an original and a printer as an output device that prints an image on a sheet using read image data output from the scanner. The high-speed copy process is realized by a multifunction peripheral as an input device that reads a document, and a printer as an output device that prints an image on paper using read image data output from the multifunction peripheral. In the high-speed copy process, the print execution unit of the multifunction peripheral and the printer execute printing of the same image in parallel using the same image data. As a result, it is possible to perform a high-speed copy process as compared with the case where the multi-function peripheral executes the copy process alone. Card fax processing prints an image on paper using a flatbed scanner as an input device that reads thick documents such as credit cards and licenses, and read image data output from the flatbed scanner. This is realized by a printer as an output device. The embroidery copy process is realized by a scanner as an input device that reads a document and a sewing machine that embroiders an image on a cloth using read image data output from the scanner. The clothing copy process is realized by a scanner as an input device for reading an original and a garment printer that prints an image on cloth using read image data output from the scanner.

  The function information FI includes a model search table FIA (FIG. 3A) and a composite process search table FIB (FIG. 3B). The model search table FIA stores device types and device model identifiers (also referred to as model IDs) in association with each other. Specifically, the types of devices are roughly classified into six types: printers, scanners, flatbed scanners, multifunction machines, sewing machines, and garment printers. As the model ID, for example, the model number of the device (PR-xxxx in the example of FIG. 3A) is used. The scanner includes a flat bed type scanner and an automatic document feeder (ADF) type scanner. Accordingly, the model ID of the flatbed scanner is associated with two types of “flatbed scanner” and “scanner”. As a result, the device type can be specified by searching the model search table FIA using the device model ID as a search key.

  The composite processing search table FIB stores a pair of input device type and output device type and a composite processing function type realized by using the device pair in association with each other. For example, as shown in FIG. 3B, a pair of a scanner as an input device and a printer as an output device is associated with copy processing as a type of composite processing.

By referring to the two tables FIA and FIB, the function of the composite processing that can be realized by a pair of devices corresponding to the two model IDs using the model ID of the input device and the model ID of the output device as search keys. The type can be specified. The function information FI is composed of two tables FIA and FIB. Instead, the type of the composite process is directly associated with the pair of the model ID of the input device and the model ID of the output device. One table thus obtained may be used as the function information FI. The function information FI is provided, for example, in a form incorporated in advance in the device usage program PG2. Processing that uses the function information FI will be described later.

  FIG. 4 is a diagram illustrating an example of the error occurrence information EI. The error occurrence information EI is a table that stores a model ID pair indicating a pair of devices in which an error occurs and an error type in association with each other. The types of errors include, for example, communication errors, occurrence of moire, and poor color reproducibility.

  The communication error is, for example, an error that the output device cannot receive the image data output by the input device, or an error that the output device can receive the image data output by the input device, but the output device cannot process the image data. including. Specifically, the communication error includes a case where the output device does not support the reception of the format of the image data output from the input device. In addition, communication errors can be handled by the output device in receiving the format of the image data output by the input device. However, the output device may be affected by the detailed specifications of the format, which will be described later, or the memory capacity of the output device. This includes cases where image processing cannot be performed using image data. For example, the error information of a device pair in which such a communication error occurs or may occur may be registered in advance in the error occurrence information EI and incorporated in the device usage program PG2, which will be described later. As described above, when an error actually occurs, it may be added to the error occurrence information EI.

  Moire is a phenomenon in which unintended interference fringes appear in a printed image due to interference of a plurality of spatial frequency components included in the printed image. It is known that moiré is more likely to occur, for example, as the reading resolution of a scanner that generates image data used for printing is lower. In addition, generation of moire can be suppressed by performing image processing for moire removal (also referred to as moire removal processing) on image data used for printing. As the moiré removal process, for example, a process of reducing a plurality of spatial frequency components included in a print image by adding noise to image data is known. For this reason, for example, for a pair of a scanner whose reading resolution is lower than a reference resolution (for example, 300 dpi) and a printer that cannot perform moire removal processing, error information indicating that there is a high possibility of occurrence of moire. Is registered in the error occurrence information EI. In addition, for example, in a scanner / printer pair including at least one device of a scanner whose reading resolution is lower than the reference resolution and a printer that cannot perform moire removal processing, there is a possibility of occurrence of moire. Error information indicating that there is an error is registered in the error occurrence information EI.

  The poor color reproducibility is expressed, for example, by an image (for example, a printed image or an embroidered image) output by the output device, in which a color gamut that can be expressed by image data (for example, read image data) output by the input device is expressed. It can occur when the color gamut is too narrow compared to the possible color gamut. In this case, the color gamut expression ability of the output device cannot be fully exhibited. Further, it may occur when the color gamut that can be expressed by the image output by the output device is excessively narrow compared to the color gamut that can be expressed by the image data output by the input device. In this case, the image represented by the image data output from the input device cannot be sufficiently expressed by the image output from the output device. For this reason, for a device pair in which the difference between the wide color gamut that can be represented by the image data output from the input device and the wide color gamut that can be represented by the image output from the output device is greater than or equal to a reference value, Error information indicating that a reproducibility failure may occur is registered in the error occurrence information EI. For example, when the two color gamuts are expressed in the same color space (for example, La * b * color space), the volume difference between the two color gamuts is the volume of the larger color gamut of the two color gamuts. When the ratio is equal to or higher than a predetermined ratio (for example, 20%), it may be determined that there is a possibility that a color reproducibility failure may occur.

  It can be said that the communication error and the color reproducibility error are errors related to mismatch between the capabilities of the two devices (for example, the capability to cope with the format of the data and the ability to express the color).

A-2. System behavior:
A-2-1. UI display processing:
Of the operations of the system 1000, UI display processing executed by the mobile terminal 100 will be described. FIG. 5 is a flowchart of UI display processing executed by the CPU 110 of the mobile terminal 100. The UI display process is a process of displaying, on the display unit 250 of the mobile terminal 100, a UI image for executing image processing on one or more devices in the system 1000. The UI display process is started when the user activates the device use program PG2 in the portable terminal 100 in order to cause the plurality of devices in the system 1000 to perform image processing. The UI display process is a process realized by the CPU 110 executing the device usage program PG2.

  When the UI display processing is started, in the first step S11, the CPU 110 searches for a device in the LAN 60 as a device candidate for executing image processing. Specifically, the CPU 110 broadcasts a predetermined search packet on the LAN 60. As a result, the search packet is transmitted to all devices connected to the LAN 60, that is, eight devices 200A to 200C, 300A, 300B, 400, 500, and 600 in the example of FIG.

  Each device that has received the search packet transmits a response packet including the IP address and MAC address of the device to the mobile terminal 100 that is the transmission source of the search packet. By receiving the response packet, the CPU 110 of the portable terminal 100 can search for the presence of a device as a candidate for a device that executes image processing, and can acquire an IP address for accessing the device. In the example of FIG. 1, the CPU 110 searches for eight devices 200A to 200C, 300A, 300B, 400, 500, and 600.

  In step S12, the CPU 110 acquires the model ID of the searched device and input / output information (FIG. 2) from the searched device. Specifically, CPU 110 transmits a transmission request for these pieces of information to each searched device. Each device that has received the transmission request transmits a response including its model ID and input / output information to the mobile terminal 100. As a result, in the example of FIG. 1, the mobile terminal 100 includes the model IDs of the eight devices 200A to 200C, 300A, 300B, 400, 500, and 600 and the input / output information 232A to 232B, 332A, 332B, and 432, respectively. 532, 632 (FIG. 2). Note that communication between the portable terminal 100 and each device is executed using, for example, HTTP (Hypertext Transfer Protocol).

  In step S13, the CPU 110 generates combination information indicating a pair pattern of input devices and output devices (hereinafter, also referred to as a combination pattern) obtained by combining two of the eight devices. . In the combination information, all combination patterns are recorded, and the generated combination information is stored in the buffer area 125. For example, when there are 8 devices, the total number PN of the combination patterns is 56.

In step S14, the CPU 110 extracts connectable combination patterns from all the combination patterns. Specifically, when the format of image data output as a result of image processing executed by the input device can be input for image processing executed by the output device, the input device and the output device Are extracted as connectable combination patterns. The CPU 110 refers to the combination information generated in step S13 and the input / output information 232A to 232B, 332A, 332B, 432, 532, and 632 acquired in step S12, and the combinations that can be connected. Extract the pattern. Note that devices whose output is not image data, that is, the printers 200A to 200C, the sewing machine 500, and the garment printer 600 whose output form is “paper” or “cloth” cannot be input devices (see FIG. 2). . Devices whose input is not image data, that is, scanners 300A and 300B whose input form is “paper” cannot be output devices (see FIG. 2). The MFP 400 can be either an input device or an output device because the input may be image data and the output may be image data (see FIG. 2). CPU110 deletes patterns other than the combinable combination pattern extracted from the combination information produced | generated in step S13.

  FIG. 6 is a diagram illustrating an example of combination information SI indicating only connectable combination patterns obtained by combining the eight devices illustrated in FIG. In the example of FIG. 6, it can be understood that 14 of the 56 combination patterns are extracted as connectable combination patterns. In the combination information SI of FIG. 6, for ease of viewing the device, the device is specified by the name and code (printer 200A, etc.) of each device. Each device is identified using information unique to each device. In this embodiment, since there may be two or more devices of the same model in the system 1000, the model ID (model number) is not used to identify each device.

  In step S15, the CPU 110 extracts a combination pattern corresponding to the error information from the connectable combination patterns. Specifically, the CPU 110 searches the error occurrence information EI (FIG. 4) using the model ID of each device as a key, and extracts a combination pattern registered in the error occurrence information EI.

  In step S16, the CPU 110 associates error information with the extracted combination pattern. Specifically, the CPU 110 acquires error information corresponding to the combination pattern from the error occurrence information EI, and records it in the combination information SI (FIG. 6) in association with the combination pattern. In the example of FIG. 6, error information indicating that moire may occur is associated with the combination pattern of the scanner 300A and the printer 200A. Further, error information indicating that a color reproducibility failure may occur is associated with the combination pattern of the scanner 300B and the printer 200A. Further, error information indicating that a communication error may occur is associated with the combination pattern of the multifunction machine 400 and the printer 200C.

In step S <b> 17, the CPU 110 determines a composite process realized by each connectable combination pattern. Specifically, the CPU 110 searches the model search table FIA (FIG. 3A) for the types of input devices and output devices that constitute the combination pattern to be processed, using the model IDs of these devices as search keys. By specifying. Then, the CPU 110 specifies a composite process corresponding to the combination pattern to be processed by searching the composite process search table FIB using a pair of device types corresponding to the combination pattern to be processed as a search key. The identified composite process is determined as a composite process realized by the combination pattern to be processed. For example, a case will be described in which the model ID of the input device constituting the combination pattern to be processed is “SC-xxxx” and the model ID of the output device is “PR-aaaaaa”. The CPU 110 refers to the model search table FIA and specifies that the input device is “scanner” and the output device is “printer”. Next, the CPU 110 refers to the composite processing search table FIB and specifies that “copy processing” is realized in a pair of “scanner” as an input device and “printer” as an output device. Therefore, the composite process realized by the combination pattern to be processed is determined as “copy process”. Here, there may be a case where a plurality of composite processes realized by one combination pattern are determined. For example, the composite processing realized by the combination pattern of the scanner 300A and the multifunction device 400 in FIG. 6 is determined as two processes of “card fax processing” and “copy processing”.

  In step S18, the CPU 110 obtains support information for the user to select desired image processing from a feasible image processing group including composite processing based on the combination information SI in FIG. Display on the display unit 180 based on the SI.

  FIG. 7 is a diagram illustrating a display example of support information. Specifically, as shown in FIG. 7A, CPU 110 causes display unit 180 to display first selection image SD1 for the user to select image processing to be executed. The first selection image SD1 includes a plurality of selection buttons BT1 to BT4 corresponding to a plurality of realizable composite processes. Further, the first selection image SD1 may include a selection button (for example, a button BTa) corresponding to image processing that can be realized by a single device. If the type of a single device can be specified with reference to the search table FIA, it can be displayed, and the description thereof will be omitted. In each selection button, the name of the corresponding image processing function is displayed as support information. The selection button BT1 is a button corresponding to copy processing and high-speed copying (see FIG. 6), and the selection button BT2 is a button corresponding to clothing copy processing (see FIG. 6). The selection button BT3 is a button corresponding to an embroidery copy process (see FIG. 6), and the selection button BT4 is a button corresponding to a card fax (see FIG. 6) and a normal fax that can be realized by a single MFP. The user can select a button corresponding to the image processing to be executed from among these selection buttons BT1 to BT4.

  When the image processing corresponding to the selection buttons BT1 to BT4 can be further finely classified according to the function, a second selection image including support information for the user to select the finely classified image processing is displayed. Displayed on the unit 180. In FIG. 7B, when the selection button BT1 corresponding to the copy process is selected by the user in the first selection image SD1 (FIG. 7A), the first selection image SD1 is replaced. An example of the second selection image SD2 displayed on the display unit 180 is shown. The second selected image SD2 includes two selection buttons BT5 and BT6 corresponding to normal copy processing and high-speed copy, respectively. In each selection button, the names of image processing functions (normal copy processing and high-speed copy) classified more finely are displayed as support information. The user can select a button corresponding to the image processing to be executed from among these selection buttons BT5 to BT6.

  When the user selects one image process via the first selected image SD1 and the selected image process cannot be further classified, or the user selects via the second selected image SD2. When one image processing is selected, a third selection image for selecting a device for realizing the selected image processing is displayed on the display unit 180. FIG. 7C shows an example of the third selection image SD3 displayed when the selection button BT5 corresponding to the normal copy process is selected by the user in the second selection image SD2. Yes. The third selected image SD3 includes a single device that can realize a normal copy process, and a plurality of buttons BT7 to BT12 corresponding to the combination pattern of the devices. Support information for presenting a corresponding combination pattern to the user is displayed in the plurality of buttons BT7 to BT12. For example, the selection button BT8 is a button corresponding to a combination pattern of the printer 200A and the scanner 300A, and the selection button BT9 is a button corresponding to a combination pattern of the printer 200A and the multifunction device 400.

In addition, when displaying the selection button corresponding to the combination pattern (refer FIG. 6) with which specific error information is matched in 3rd selection image SD3, CPU110 displays the assistance information regarding an error. To do. In the example of FIG. 7C, support information ED1 that warns the user about these errors in combination patterns that may cause moire and combination patterns that may cause poor color reproducibility. , ED2 are displayed. Further, the CPU 110 does not display support information for selecting a combination pattern associated with other specific error information in the third selection image SD3. In the example of FIG. 7C, the combination buttons of the scanner 300A and the printer 200B that may cause a communication error and the selection buttons corresponding to the combination pattern of the multifunction device 400 and the printer 200C are displayed. Not (ie, excluded from candidates for selection). When using a combination pattern that may cause moiré or color reproducibility, although moire or color reproducibility may occur, copy processing can be executed. This is because there is a possibility that copy processing cannot be executed when a combination pattern that may cause a communication error is used.

  Instead, the CPU 110 may display a selection button corresponding to a combination pattern associated with error information related to a communication error, and may display support information that warns the user about the communication error. Further, the CPU 110 may not display a selection button corresponding to a combination pattern that may cause moire or color reproducibility.

  As can be understood from the above description, the support information of the present embodiment includes information that allows the user to recognize the image processing function (specifically, the name of the image processing function) and a device for realizing the image processing. Information that allows the user to recognize the combination pattern (specifically, the names of the devices that make up the combination pattern) and information that allows the user to recognize errors that may occur when image processing is executed (specifically, the error (FIG. 7). In this manner, the assistance information may include various information that is useful for the user to select appropriate image processing to be performed and to cause an appropriate device in the system 1000 to execute.

  In the third selection image SD3, when the user selects a single device or a combination pattern of devices to be subjected to image processing, the CPU 110 ends the UI display processing and performs device control described later. Execute the process.

  According to the UI display process of the first embodiment described above, the CPU 110 searches for a plurality of devices in the system 1000, that is, in the LAN 60 (step S11). Then, the CPU 110 determines image processing candidates that can be realized in the system 1000, including composite processing realized using a plurality of devices in the network (steps S12 to S17 in FIG. 5). Upon determination, the CPU 110 is input / output information 232A to 232B, 332A, 332B, 432, 532, and 632 (FIG. 2) that is information related to the realization of image processing executed by each device and is information prepared for each device. ) Is used. Then, the CPU 110 displays support information for the user to select the determined image processing on the display unit 180 (step S18 in FIG. 5, FIG. 7).

  As a result, support information for selecting image processing including composite processing realized by a pair of devices is appropriately displayed according to a plurality of devices in the system. Therefore, the user can grasp image processing that can be realized by a plurality of devices in the system. As a result, the convenience of the system including a plurality of devices can be improved. In particular, when the number of devices in the system is large, it may be difficult for the user to grasp the image processing that can be realized. However, according to the UI display processing of this embodiment, the user Image processing that can be realized by a plurality of devices can be easily grasped.

Further, even if the user does not specify a plurality of devices to be combined, device combination pattern candidates are displayed (FIG. 7C). Therefore, it is possible to easily use image processing (that is, composite processing) using the above device.

  Further, as will be understood from the description of step S14 and FIG. 6, the CPU 110 indicates the format (for example, JPEG or RGB) of the data output in the image processing executed by the first device (for example, the scanner 300A). Information (for example, input / output information 332A) and information (for example, input / output information 232A) indicating the format of data that can be input for image processing executed by the second device (for example, printer 200A). refer. When the data output from the first device can be input to the second device, the CPU 110 specifically, at least one of the formats of the data output from the first device. Are included in a format that can be input to the second device, the composite processing that is executed using the first device and the second device is determined as realizable image processing. Therefore, the realizable image processing can be appropriately determined based on the format of data output from the first device and the format of data that can be input to the second device.

  Furthermore, as can be seen from the description of step S17 and FIG. 3, the type of the first device (for example, the type according to the function of the scanner or the type distinguished by the model ID) and the type of the second device The realizable image processing is determined based on the function information FI in which the combination and the function type (for example, copy processing) of the composite processing are associated with each other. As a result, it is possible to appropriately determine the realizable image processing based on the first device type and the second device type.

  Further, for a combination pattern in which a specific error (for example, moire or poor color reproducibility) may occur, a warning about the error is displayed on the display unit 180 (FIG. 7C). A combination pattern of devices can be selected. For example, the user can be prevented from selecting a complex process that may cause an error.

  Furthermore, support information (specifically, a selection button for selecting the combination pattern) for selecting a combination pattern that may cause another specific error (for example, a communication error) is displayed on the display unit 180. (FIG. 7C), it is possible to suppress the user from selecting a composite process that may cause an error.

A-2-2. Device control processing:
Device control processing executed by the CPU 110 of the mobile terminal 100 will be described. The device control process is executed following the UI display process when an image process to be executed and a single device or a combination pattern of devices to be executed are selected in the UI display process described above. Is done. Hereinafter, a case where a combination pattern of the scanner 300A as an input device and the printer 200B as an output device is selected will be described as an example. The device control process is a process realized by the CPU 110 executing the device usage program PG2, similarly to the UI display process. The device control process is a process for executing the control of the operation of each device constituting the selected combination pattern and the confirmation of the progress of the operation of each device.

  FIG. 8 is a flowchart of device control processing. When the device control process is started, in step S20, the CPU 110 generates operation flow information OF for realizing the image processing selected by the user using the combination pattern of the devices selected by the user.

  FIG. 9 is a diagram illustrating an example of the operation flow information OF. FIG. 9 shows an example of operation flow information OF for realizing copy processing using the scanner 300A and the printer 200B. In this embodiment, the CPU 110 of the mobile terminal 100 repeats the process of transmitting a request to a device to be controlled (hereinafter also referred to as a target device) and receiving a response from the destination device. Control the device. For this reason, in this embodiment, the operation flow information OF is information describing a procedure for repeating a set of requests and responses in order to control the target device. The operation flow information OF includes partial flow information in which a request and response set for each target device is described. For example, the operation flow information OF in FIG. 9 includes partial flow information PF1 for the scanner 300A and partial flow information PF2 for the printer 200B (FIG. 9). The operation flow information OF is generated based on a template prepared in advance for each composite process to be executed, for example. The template of the operation flow information OF is stored in advance in the mobile terminal 100 in this embodiment. The operation flow information OF may be stored in each device for each partial flow information for each device. In this case, the mobile terminal 100 may acquire partial flow information corresponding to each device from each device used for realizing the composite processing, and generate the operation flow information OF by combining these partial flow information. .

  In step S22, the CPU 110 transmits a request to the target device according to the operation flow information OF. For example, in the example of FIG. 6, in the first step S22, the CPU 110 makes a request for confirming whether the scanner 300A is turned on and in an operable state as an initial request (ie, 9) is transmitted to the scanner 300A. Further, in the second step S22 when the process returns to step S22 through the processes of steps S24 to S29 described later, a request for requesting execution of the reading process (that is, the scan request in FIG. 9) is issued. Transmit to the scanner 300A. As described above, in step S22, the requests are sequentially transmitted to the target device according to the operation flow information OF.

  In step S24, the CPU 110 determines whether a response to the request has been received from the target device within a predetermined period corresponding to the content of the request from the transmission of the request. If no response is received (step S24: NO), the CPU 110 advances the process to step S30.

  When the response is received (step S24: YES), the CPU 110 determines whether or not the received response is a normal response (step S26). The content of the normal response is described in the operation flow information OF (FIG. 9). Although details will be described later, in the example of FIG. 9, when the transmitted request is “operation check”, the normal response is a response indicating “operation possible”.

  When the received response is not a normal response (step S26: NO), the CPU 110 advances the process to step S30. When the received response is a normal response (step S26: YES), the CPU 110 displays the progress of the image processing on the display unit 180 (step S28).

  FIG. 10 is a diagram illustrating an example of a progress image for displaying the progress of image processing. FIG. 10A shows a progress image EI1 displayed at the normal time when no error has occurred. It can be seen that the progress image EI1 includes, as progress information, a message MS1 indicating that the copy process is being executed and a symbol MK1 indicating that the reading process of the scanner 300A is currently being executed.

In subsequent step S29, CPU 110 determines whether or not the image processing to be executed has ended. Specifically, when the last request described in the operation flow information OF has been transmitted, that is, when there is no untransmitted request, the CPU 110 determines that the image processing to be executed has ended. If there is an untransmitted request, the CPU 110 determines that the image processing to be executed has not ended.

  If the image processing to be executed has not been completed (step S29: NO), the CPU 110 returns to step S22 and transmits an untransmitted request to the target device. And the process from step S22 to S29 mentioned above is repeated. When the image processing to be executed is completed (step S29: YES), the CPU 110 ends the device control process.

  FIG. 11 is a sequence diagram in a case where the scanner 300A and the printer 200B execute the copy process by the device control process. As can be seen from FIGS. 9 and 11, when the scanner 300A and the printer 200B execute copy processing, first, two requests (that is, the above-described operation check and scan request) are transmitted to the scanner 300A. (Step S22). As a result, the portable terminal 100 can acquire read image data (scan data) from the scanner 300A (step S24).

  As described above, the operation confirmation is a request for confirming whether or not the scanner 300A is turned on and is in an operable state, and the corresponding normal response is, for example, operable. It is a response indicating The corresponding abnormal response is a response indicating that the operation is impossible due to a failure or the like.

  As described above, the scan request is a request for requesting execution of the reading process, and the corresponding normal response is, for example, a response including the read image data. The corresponding abnormal response is a response indicating that the reading process cannot be executed due to a paper jam in the ADF or the absence of a document.

  When the read image data is acquired from the scanner 300A, the target device is changed from the scanner 300A to the printer 200B according to the operation flow information OF, and four requests (that is, an operation check and an operation state check) are made to the printer 200B. , A print request and confirmation of print completion) are transmitted (step S22). As a result, the mobile terminal 100 can cause the printer 200B to print an image represented by the read image data.

  The operation confirmation is a request for confirming whether the printer 200B is powered on and in an operable state, and the corresponding normal response is, for example, a response indicating that the printer 200B is operable. . The corresponding abnormal response is a response indicating that the operation is impossible due to a failure or the like.

  The reception status confirmation is a request for confirming whether or not the printer 200B can receive print data, and the corresponding normal response is, for example, a response indicating that reception is possible. The print data is image data in the various formats described above. Further, the corresponding abnormal response cannot be received immediately from the portable terminal 100 because the memory of the printer 200B is occupied by the print data received from another computer, for example. It is a response indicating that there is.

The print request is a request for requesting the printer 200B to execute printing, and is a request including print data. The normal response corresponding to the print request is, for example, a response indicating completion of print data reception. The corresponding abnormal response is a response indicating that the reception of the print data has failed due to, for example, a communication failure or the printer 200B not supporting the print data format.

  The confirmation of the completion of printing is a request for confirming whether or not the printing to be executed in response to the printing request is normally completed in the printer 200B, and the corresponding normal response is, for example, that the printing is normal It is a response indicating that it has been completed. Corresponding abnormal responses include, for example, that printing materials such as toner and ink have been consumed (so-called out of toner or out of ink), printing has been interrupted due to paper jams, etc. This is a response indicating that printing cannot be performed because the printer 200B does not support the format.

  Each time such a request is transmitted and a response is received, an error-related process including determination of whether or not an error has occurred is performed (FIG. 11). Steps S30 to S36 in FIG. 8 described below are error-related processes.

  If the response from the target device is not received in step S24 described above (step S24: NO), and if the response from the target device is not a normal response in step S26 described above (step S26: NO), it is considered that some kind of error occurred. That is, step S24 and step S26 can be said to be steps for detecting whether or not an error has occurred in any one of a pair of devices that execute composite processing. Specifically, after a request is transmitted to the target device in step S22, if a response from the target device is not received even after a predetermined time has elapsed (step S14: NO), an abnormal response is received from the target device. If it is received (step S26: NO), the CPU 110 determines that an error has occurred in the target device. When occurrence of an error is detected (step S24: NO or step S26: NO), the CPU 110 identifies a device in which an error has occurred (step S30). Specifically, the current target device is specified as a device in which an error has occurred.

  In subsequent step S32, CPU 110 identifies the content of the error. If the mobile terminal 100 receives an abnormal response from the target device in step S24, that is, a response including information indicating the content of the error, the content of the error is based on the information included in the response. Specified. If no response is received (step S24: NO), the content of the error is specified based on the content of the request corresponding to the response that has not been received.

  For example, when the response corresponding to the “operation check” request to the scanner 300A or the printer 200B is not received, the printer 200B is turned off, or the access point 50 or the LAN 60 is faulty. It is determined that the communication error is.

If the response corresponding to the “operation check” and “reception status check” requests to the printer 200B is normal, but the response corresponding to the “print request” request is not received, the access point 50 Alternatively, it is considered that no failure has occurred in the LAN 60, and the printer 200B is considered to be in a state where it can receive print data. Therefore, in this case, for example, it is considered that an error that the printer 200B cannot receive the print data because the size of the print data is too large, an error that the printer 200B cannot support the print data format, or the like has occurred. It is done. If the response corresponding to the “print request” request is normal but the response corresponding to the “print completion confirmation” request is not received, for example, the printer 200B receives the print data. However, the print data format cannot be interpreted, but the operation is stopped.

  In this way, not only the content of the error is specified based on the content of the response, but also the content of the error is specified based on the fact that the response cannot be received, for example, depending on the type of device in the system. This is because it does not always have a function of identifying the content of the error and transmitting a response including error information. For example, there may be a device that freezes and does not send any response because the format of the print data cannot be interpreted or because of memory overflow. Even in such a case, in the present embodiment, referring to the operation flow information OF, the content of the error is estimated based on which request can be received and which request cannot be received. Thus, the content of the error can be specified.

  When the content of the error is specified, in step S34, the CPU 110 displays error information including information regarding the content of the specified error on the display unit 180. FIG. 10B shows an example of the progress image EI2 on which error information is displayed. It can be seen that in the progress image EI2, a message MS2 indicating the occurrence of an error and a message MS3 and a symbol MK2 indicating the content (cause) of the error are displayed as error information.

  In step S36, the CPU 110 updates the error occurrence information EI (FIG. 4) based on the content of the error that has occurred. For example, when the error that has occurred is an error relating to cooperation between the input device and the output device, such as a communication error in which data (for example, read image data) output by the input device cannot be input to the output device, The CPU 110 associates the error information indicating the content of the error with the combination pattern of the device in which the error has occurred and adds it to the error occurrence information EI. On the other hand, if there is a temporary error such as a paper jam, power is not turned on, or an error that is not related to the linkage between the input device and the output device, the error information related to the error is the error occurrence information. Not added to EI. As a result, when an error related to the cooperation between the input device and the output device, such as a communication error, is detected, error information indicating a set of devices in which the error is detected is associated with the content of the error. And stored in the nonvolatile storage device 130.

  When the error occurrence information EI is updated, the CPU 110 ends the device control process. The process of step S38 indicated by the broken line is a process executed in the second embodiment, and will be described later.

  According to the device control process of the present embodiment described above, an error occurs in one of a pair of devices that execute the composite process during the execution of the composite process (for example, a copy process using the scanner 300A and the printer 200B). It is detected whether or not it has occurred (step S24, step S26). When an error is detected, error information including information related to the error content is displayed on the display unit 180 (step S34, FIG. 10B). As a result, since the user can properly grasp the content of the error that occurred during the execution of the composite processing, the convenience of the system 1000 for the user can be improved.

  Further, when an error is detected, error information indicating a set of devices (device combination pattern) from which the error is detected is added to the error occurrence information EI together with information indicating the content of the error. And stored in the nonvolatile storage device 130 (step S36). As a result, the error information can be used when determining information of a set of devices in which an error is detected in a composite process that can be realized in the UI display process executed next time (FIG. 5). Steps S15 and S16).

Therefore, in the UI display processing after the next time, the updated error occurrence information EI is used, so that more appropriate error information can be provided to the user. For example, in the input / output information (FIG. 2), even if the format of the image data output by the input device matches the format that can be input by the output device, the image data output by the input device is actually In some cases, the output device cannot be received. This may be caused by, for example, a difference in format version, a difference in detailed specifications on mounting, and compatibility between models. For this reason, by accumulating errors that have actually occurred as error occurrence information EI, it is possible to more accurately determine a combination pattern of devices that actually operate.

B. Second Example B-1. System Configuration FIG. 12 is a block diagram illustrating a configuration of a system 2000 according to the second embodiment. The system 2000 includes a server 800 in addition to the components included in the system 1000 of the first embodiment. The server 800 is connected to the Internet 70, and the LAN 60 is connected to the Internet 70. The mobile terminal 100 recognizes the IP address of the server 800 and can communicate with the server 800 via the access point 50, the LAN 60, and the Internet 70.

  The server 800 includes a CPU 810, a volatile storage device 820 such as a RAM, a nonvolatile storage device 830 such as a hard disk drive or a flash memory, and a communication unit 870 including an interface for performing data communication with an external device. ing.

  The volatile storage device 820 is provided with a buffer area 821 for temporarily storing various intermediate data generated when the CPU 810 performs processing. The nonvolatile storage device 230 stores a control program 831 for realizing a function as a server, input / output information 832 described later, function information FI (FIG. 3), and error occurrence information EI (FIG. 4). doing.

  The eight devices 200A to 200C, 300A, 300B, 400, 500, and 600 of the system 2000 basically have the same configuration as the device having the same name in the system 1000. However, each device of the system 2000 does not store its own input / output information 232A to 232C, 332A, 332B, 432, 532, 632 (FIG. 2).

  The input / output information 832 stored in the server 800 includes all the eight pieces of input / output information 232A to 232C, 332A, 332B, 432, 532, and 632 shown in FIG. In the input / output information 832, the eight pieces of input / output information 232A to 232C, 332A, 332B, 432, 532, and 632 in FIG. 2 are associated with identifiers (specifically, model IDs) indicating corresponding devices. (Not shown). Further, the input / output information 832 includes input / output information 832S of the server 800 itself. This is because in the second embodiment, the server 800 itself is also used as one of the devices for realizing the composite processing. Specifically, the server 800 executes the control program 831 to perform two types of images, a moire removal process and a background removal process, in addition to a function as a server for exchanging data with the mobile terminal 100. Processing can be executed. The moire removal process generates print data (for example, dot data) obtained by performing known image processing for suppressing the occurrence of moire on the input image data (for example, read image data generated by a scanner). It is processing. In the background removal processing, the input image data (for example, read image data generated by a scanner) is subjected to known image processing (processing for converting the background color to white) to remove the background color. This is processing for generating print data (for example, dot data).

FIG. 13 is a diagram showing input / output information 832S of the server 800 itself. Image processing executed by the server 800 is “moire removal processing” and “background removal processing”. The input for the image processing is image data, and the output of the image processing result is processed image data. For this reason, as shown in FIG. 13, the input / output information 832 of the server 800 includes input information indicating a format of image data that can be input for image processing, and a processed image output as a result of the image processing. Output information indicating the format of the data. In the example of FIG. 13, the format of image data that can be input is RGB image data, dot data, image data compressed with JPEG, image data described with PostScript, and image data saved with PDF. ,including. The format of processed image data output as a result of image processing is dot data.

  The non-volatile storage device 130 of the portable terminal 100 of the system 2000 does not store the function information FI and the error occurrence information EI. The information FI and EI are stored in the server 800 as described above, and the mobile terminal 100 acquires the information FI and EI from the server 800 as necessary.

  The function information FI stored in the server 800 includes a combination pattern of three devices including the server 800 as a relay device in addition to the model search table FIA and the composite processing search table FIB in FIG. It includes another composite processing search table FIC in which the types of composite processing functions that can be realized using the device combination pattern are associated.

  FIG. 14 is a diagram illustrating an example of the composite processing search table FIC. In this example, as a combination pattern of three devices, using a scanner as an input device, a server as a relay device, and a printer as an output device, copy processing including moire removal processing, and background removal Copy processing including processing can be realized.

  The other configuration of the system 2000 is the same as the configuration of the system 1000 in FIG.

B-2. System Operation FIG. 15 is a flowchart of UI display processing according to the second embodiment. In step S <b> 10 </ b> A, the CPU 110 of the mobile terminal 100 searches for a device in the LAN 60 by making an inquiry to the server 800. Specifically, in response to a request from the CPU 110, the server 800 sends a response including a list of devices in the LAN 60 and information for accessing each device (for example, an IP address or URL) to the CPU 110. Send. The CPU 110 can recognize devices in the LAN 60 based on information included in the response from the server 800. Alternatively, in step S10A, the CPU 110 may search for a device in the LAN 60 by broadcasting a predetermined search packet on the LAN 60, as in step S11 of the first embodiment.

  In step S <b> 11 </ b> A, CPU 110 further requests server 800 for information regarding the searched device. Specifically, CPU 110 transmits a request for information to server 800. In response to a request from the CPU 110, the server 800 includes a model ID of each device in the LAN 60, input / output information 832 (FIGS. 2 and 13), function information FI (FIGS. 3 and 14), and error occurrence information. A response including EI (FIG. 4) is transmitted to the CPU 110. In step S <b> 12 </ b> A, CPU 110 acquires these pieces of information as a response from server 800. Instead, in step S11A, the CPU 110 may acquire a part of information from each device by inquiring each searched device. Specifically, the CPU 110 may acquire the model ID of each device from each device and may acquire the remaining information (output information 832, function information FI, error occurrence information EI) from the server 800.

  In step S14A, CPU 110 generates combination information indicating a combination pattern of devices including a server as a relay device. Specifically, in addition to the 56 combination patterns of the input device and output device pairs in the first embodiment, the total includes 56 combination patterns in which a server as a relay device is sandwiched between each pair. Combination information indicating 112 combination patterns is generated. In this example, the combination information is generated on the premise that the server 800 cannot be an input device or an output device but can only be a relay device.

  The subsequent steps S14 to S17 are the same as the steps of the same reference numerals in the UI display process (FIG. 5) of the first embodiment, and thus the description thereof is omitted.

  Next, device control processing according to the second embodiment will be described. The device control process of the second embodiment is the same as the device control process of the first embodiment described with reference to FIG. However, in the device control process of the second embodiment, the process of step S38 indicated by a broken line in FIG. 8 is added.

  The process of step S38 is a process executed when the error occurrence information EI is updated in step S36. In step S <b> 38, CPU 110 transmits updated error occurrence information EI to server 800. As a result, the updated error occurrence information EI in which error information indicating a set of devices in which an error is detected is recorded in association with the error content is stored in the nonvolatile storage device 830 in the server 800 (FIG. 12). ). As a result, in step S12A (FIG. 15) of the next UI display process, the mobile terminal 100 can acquire the updated error occurrence information EI and can use it for the UI display process.

  FIG. 16 is an example of the operation flow information OF2 of the second embodiment. As described above, composite processing can be executed using a combination pattern of three devices, that is, an input device, a relay device, and an output device. In the example of FIG. 16, operation flow information OF2 for realizing copy processing using the scanner 300A as an input device, the server 800 as a relay device, and the printer 200A as an output device is shown. .

  The operation flow information OF2 includes partial flow information PF3 for the server 800 as a relay device in addition to the partial flow information PF1 for the scanner 300A and the partial flow information PF2 for the printer 200B. .

  As understood from the operation flow information OF2, even when the number of target devices increases, the CPU 110 of the mobile terminal 100 transmits a response to the target device according to the operation flow information OF2, and receives a response from the target device. By repeating the process of receiving, a composite process can be realized.

  According to the second embodiment described above, similarly to the first embodiment, the user can easily grasp image processing that can be realized by a plurality of devices in the system.

  Furthermore, according to the second embodiment, the portable terminal 100 does not need to always hold the function information FI and the error occurrence information EI, so that the nonvolatile storage device 130 can be saved. Further, each device 200A to 200C, 300A, 300B, 400, 500, 600 does not need to hold the input / output information 232A to 232C, 332A, 332B, 432, 532, 632 (FIG. 2). The device 230 can be saved.

Furthermore, according to the second embodiment, each of the devices 200A to 200C, 300A, 300B, 400, 500, and 600 is provided with a function of executing image processing such as “moire removal processing” and “background removal processing”. Even if not, composite processing such as copy processing including the image processing can be realized.

  As understood from the description of the second embodiment, the combination pattern of devices for realizing the composite processing is not limited to the combination pattern of two devices, but may be a combination pattern of three or more devices. good.

C. Third Embodiment In the first embodiment, a pair of an input device type (for example, a scanner) and an output device type (for example, a printer), a composite processing function type (for example, a copy process), and the like. Based on the function information FI (FIG. 3) that associates with each other, a composite process that can be realized by using a combination pattern of devices is determined (FIG. 5: step S16). Instead, in the third embodiment, the input form for executing the image processing at the input device, the output form of the image processing result at the output device, and the types of the functions of the composite processing are: Based on the associated function information FID, a composite process that can be realized using a combination pattern of devices is determined. That is, the mobile terminal 100 according to the third embodiment stores function information FID (FIG. 18), which will be described later, instead of the function information FI (model search table FIA and composite process search table FIB) shown in FIG.

  FIG. 17 is a diagram illustrating an example of input / output information according to the third embodiment. 16A to 16D, the printers 200A and 200B and the scanners 300A and 300B among the eight devices 200A to 200C, 300A, 300B, 400, 500, and 600 in FIG. Output information 232A, 232B, 332A, 332B is shown, respectively.

  The input information of the input / output information 232A and 232B of the printers 200A and 200B in FIG. 17 is the same as the information of the same name in FIG. 2, but the output information is different. That is, the output information of the input / output information 232A and 232B in FIG. 16 describes the paper type (output form) that can be output as a result of printing by the corresponding printer 200A or 200B. For example, as indicated by the input / output information 232A, the printer 200A can execute printing on A3 paper and A4 paper. Further, as indicated by the input / output information 232B, the printer 200B can execute printing on A4 paper.

  The output information of the input / output information 332A and 332B of the scanners 300A and 300B in FIG. 17 is the same as the information of the same name in FIG. 2, but the input information is different. That is, the input information of the input / output information 332A and 332B in FIG. 16 describes the paper type (input form) that can be read by the corresponding scanner 300A or 300B. For example, as shown in the input / output information 332A, the scanner 300A can read A3 paper, A4 paper, and a card. Further, as indicated by the input / output information 332B, the scanner 300B can read A4 sheets and cards.

  FIG. 18 is a diagram illustrating an example of the function information FID of the third embodiment. The function information FID in FIG. 18 stores a pair of an input form of the input device, an output form of the output device, and a function type of the composite processing realized by using the pair of the device in association with each other. doing. For example, as shown in FIG. 18, a pair of A3 paper as the input form of the input device and A3 paper as the output form of the output device has a copy process of A3 as a function type of the composite processing. It is associated. Also, a card fax process is associated with a pair of a card as an input form of the input device and image data in the FAXG4 format as an output form of the output device as a function type of the composite process.

In step S16 of the UI display process of the third embodiment, the CPU 110 refers to the input / output information (FIG. 17) for the input form of the input device and the output form of the output device for each device combination pattern. To identify. Then, the CPU 110 searches the function information FID using a pair of the input form of the input device and the output form of the output device as a search key, and determines the type of the function of the composite processing corresponding to the device combination pattern. To do.

  According to the third embodiment described above, image processing that can be realized based on the input mode for image processing at the input device and the output mode of the result of image processing at the output device. Can be determined appropriately.

D. Variations:
(1) In the first embodiment, the CPU 110 determines device combination patterns using the input / output information 232A to 232B, 332A, 332B, 432, 532, and 632 (FIG. 2) of each device. Instead of this, for example, the CPU 110 may determine the combination pattern using the function information FI (FIG. 3). In this case, for example, the CPU 110 specifies the type (scanner, printer, etc.) of each device by searching the model search table FIA included in the function information FI. Then, the combination pattern may be determined so as to configure a pair of the input device type and the output device type described in the composite processing search table FIB. Further, after determining the combination pattern using the function information FI, the CPU 110 determines whether or not the output device can input the format of the image data output from the input device that constitutes each combination pattern. You may confirm using 232A-232B, 332A, 332B, 432, 532, 632.

(2) In the above embodiment, the UI display process and the device control process are executed by the mobile terminal 100, but instead of the mobile terminal 100, another computer may execute these processes. For example, a personal computer connected to the LAN 60 may execute UI display processing and device control processing.

(3) The function of the server 800 of the second embodiment, specifically, the input / output information 832, the function information FI, and the error occurrence information EI of each device is stored, and the mobile terminal 100 is in response to a request from the mobile terminal 100. The function of transmitting to may be performed by another device. For example, these pieces of information 832, FI, and EI are stored in the nonvolatile storage device 230 of any one of the eight devices 200A to 200C, 300A, 300B, 400, 500, and 600 connected to the LAN 60. May be. In this case, the mobile terminal 100 may acquire these pieces of information from a device that stores these pieces of information 832, FI, and EI. Further, the information 832, FI, and EI may be stored in advance in the nonvolatile storage device 130 of the mobile terminal 100.

(4) In the first embodiment, image data (for example, read image data generated by a scanner) output as a result of image processing executed by the input device is transmitted to the mobile terminal 100. The image data is transmitted from the portable terminal 100 to the output device. Alternatively, the image data output as a result of image processing executed by the input device may be directly transmitted from the input device to the output device. In this case, for example, when the mobile terminal 100 transmits a request for instructing the input device to execute image processing, information specifying a device to which the output image data should be transmitted may be included in the request. .

(5) In the first embodiment, communication between the mobile terminal 100 and the eight devices 200A to 200C, 300A, 300B, 400, 500, 600 is performed by wireless communication via the access point 50 (in infrastructure mode). Wireless communication). Instead, some or all of these communications are performed using various other communication methods such as wireless LAN ad hoc mode, Wi-Fi direct, Bluetooth (registered trademark), infrared communication, and the like. Also good.

(6) The device (image processing apparatus) employed in the first embodiment is an example, and other types of devices may be employed. For example, a digital camera, a facsimile, a display, a projector, or the like may be employed.

(7) In the first embodiment, the mobile terminal 100 executes both the UI display process and the device control process. However, the mobile terminal 100 executes only the UI display process, and the user On the other hand, support information such as the types of image processing that can be realized using a plurality of devices may be provided. The actual image processing may be executed by, for example, the user operating the device, or another computer (for example, a personal computer) connected to the LAN 60 executes the device control processing based on the user's instruction. May be.

(8) In the third embodiment, the input form (specifically, the paper size) for execution of image processing at the input device and the output form (specifically, the result of image processing at the output device) Specifically, the function information FID in which the size of the sheet) is associated with the function type of the composite processing is used. The present invention is not limited to this. Based on the function information FID that associates various input formats for image processing at the input device with various output formats as a result of image processing at the output device, Complex processing that can be realized using the combination pattern can be determined. For example, the input / output format may be a relatively broad concept such as “paper”, “cloth”, “image data”, etc., and “postcard”, “T-shirt”, “JPEG image data”. It may be a relatively narrow concept such as “

(9) In each of the above embodiments, a part of the configuration realized by hardware may be replaced with software, and conversely, a part of the configuration realized by software may be replaced with hardware. May be.

(10) When some or all of the functions of the present invention are realized by software, the software (computer program) can be provided in a form stored in a computer-readable recording medium. “Computer-readable recording media” are not limited to portable recording media such as memory cards and CD-ROMs, but are connected to internal storage devices in computers such as various RAMs and ROMs, and computers such as hard disk drives. It also includes an external storage device.

  As mentioned above, although this invention was demonstrated based on the Example and the modification, Embodiment mentioned above is for making an understanding of this invention easy, and does not limit this invention. The present invention can be changed and improved without departing from the spirit and scope of the claims, and equivalents thereof are included in the present invention.

50 ... Access point, 60 ... LAN, 70 ... Internet, 100 ... Mobile terminal, 110 ... CPU, 120 ... Volatile storage device, 125 ... Buffer area, 130. ..Non-volatile storage device, 160 ... sound processing unit, 170 ... operation unit, 180 ... display unit, 200A
˜200C ... printer, 210 ... CPU, 220 ... volatile storage device, 221 ... buffer area, 230 ... nonvolatile storage device, 231A ... control program, 232A to 232C, 332A 332B, 432, 532, 632, 732, 832 ... I / O information, 24
DESCRIPTION OF SYMBOLS 0 ... Print execution part, 250 ... Display part, 260 ... Operation part, 270 ... Communication part, 400 ... Multifunction machine, 500 ... Sewing machine, 600 ... Garment printer, 800 ... Server, 810 ... C
PU, 820 ... volatile storage device, 821 ... buffer area, 830 ... non-volatile storage device, 831 ... control program, 870 ... communication unit, 1000 ... system, OF2 .. Operation flow information, PG1 ... Control program, PG2 ... Device usage program, FIA ... Model search table, FIB ... Composite processing search table, FIC ... Composite processing search table

Claims (12)

A computer program for a communication device connected to a network including a plurality pieces of image processing apparatus,
Each time said computer program is started, a search step of searching the plurality pieces of image processing apparatus in the network,
A plurality of image processing that can be realized by using the retrieved plural pieces of image processing apparatus, resulting in the first image processing apparatus for executing a first image processing by said first image processing A second image processing apparatus that executes second image processing using data, the second image processing apparatus having a model number different from that of the first image processing apparatus. The plurality of image processing candidates including composite processing are determined using processing information that is information relating to the realization of image processing executed by each image processing device and is prepared for each image processing device. A decision step to
A support information display step of displaying support information for selecting the image processing to be determined on the display unit of the communication device;
A first processing request for causing the first image processing apparatus to execute the first image processing in order to execute the composite processing selected by the user among the plurality of image processing. A first transmission step of transmitting
A first receiving step of receiving, from the first image processing device, first target data generated by the first image processing;
When the first target data is received from the first image processing device, the second target data based on the first target data is sent to the second image processing device; A second transmission step for transmitting a second processing request for executing the second image processing using target data;
A computer program that causes a computer mounted on the communication device to realize the above. The computer program according to claim 1 , further comprising:
After transmitting the first processing request for executing the first image processing, the composite processing of the display the communication device progress display step of displaying the part of the communication device information indicative of the current progress A computer program to be realized by a computer installed in the computer. The computer program according to claim 2 , further comprising:
Receiving a first response relating to the first image processing from the first image processing device and receiving a second response relating to the second image processing from the second image processing device; The receiving step is realized by a computer mounted on the communication device,
The progress display step, a case of receiving the first response indicating a normal operation, to the case of receiving the second response indicating normal operation, wherein the communication device information indicative of the current progress A computer program to be displayed on the display unit. A computer program for a communication device connected to a network including a plurality pieces of image processing apparatus,
A search step of searching the plurality pieces of image processing apparatus in the network,
A plurality of image processing that can be realized by using the retrieved plural pieces of image processing apparatus, resulting in the first image processing apparatus for executing a first image processing by said first image processing A second image processing apparatus that executes second image processing using data, the second image processing apparatus having a model number different from that of the first image processing apparatus. The plurality of image processing candidates including composite processing are determined using processing information that is information relating to the realization of image processing executed by each image processing device and is prepared for each image processing device. A decision step to
A support information display step of displaying support information for selecting the image processing to be determined on the display unit of the communication device;
A first processing request for causing the first image processing apparatus to execute the first image processing in order to execute the composite processing selected by the user among the plurality of image processing. A first transmission step of transmitting
A first receiving step of receiving, from the first image processing device, first target data generated by the first image processing;
When the first target data is received from the first image processing device, the second target data based on the first target data is sent to the second image processing device; A second transmission step for transmitting a second processing request for executing the second image processing using target data;
Receiving a first response relating to the first image processing from the first image processing device and receiving a second response relating to the second image processing from the second image processing device; Receiving step;
A progress display step of displaying information indicating the current progress of the combined processing on the display unit of the communication device after transmitting the first processing request for executing the first image processing;
Is realized on a computer mounted on the communication device ,
In the progress display step, information indicating the current progress is received when the first response indicating normal operation is received and when the second response indicating normal operation is received. said that displays on the display unit, the computer program. A computer program according to any one of claims 2 to 4 ,
The progress display step of the first image processing apparatus and the second image processing apparatus, information indicating a device that is performing the processing relating to the composite processing, the as information indicating the current progress A computer program displayed on the display unit of the communication device . A computer program according to any one of claims 1 to 5,
The first image processing is reading processing for reading a document,
The second image processing is a computer program that is printing processing for printing an image. A computer program according to any one of claims 1 to 6,
The processing information is
Information indicating a format of data output in the image processing executed by the first image processing apparatus;
Information indicating a format of data that can be input for image processing executed by the second image processing apparatus;
Including
In the determination step, when the data output from the first image processing device can be input to the second image processing device with reference to the processing information, the first image processing device A computer program in which the composite processing executed using the second image processing apparatus is determined as the realizable image processing. A computer program according to any one of claims 1 to 7,
In the determination step,
Based on information in which the input format for the first image processing, the output format of the result of the second image processing, and the function type of the composite processing are associated, A computer program in which image processing is determined. A computer program according to any one of claims 1 to 7,
In the determination step,
Determining the realizable image processing based on information associated with the type of the first image processing device, the type of the second image processing device, and the type of function of the combined processing; Computer program. The computer program according to any one of claims 1 to 9, further comprising:
Procedure information for the composite processing selected by the user, one or more of a request to be transmitted to the first image processing device and a response to be received from the first image processing device An information generating step for generating the procedure information indicating a set and one or more sets of a request to be transmitted to the second image processing apparatus and a response to be received from the second image processing apparatus; Realized in a computer mounted on the communication device;
The computer program, wherein the first transmission step, the first reception step, and the second transmission step are executed by repeating transmission of a request and reception of a response using the procedure information. A communication apparatus connected to a network including a plurality pieces of image processing apparatus,
Each time said computer program is started, a search unit for searching the plurality pieces of image processing apparatus in the network,
A plurality of image processing that can be realized by using the retrieved plural pieces of image processing apparatus, resulting in the first image processing apparatus for executing a first image processing by said first image processing a second image processing apparatus to perform a second image processing by using the data, wherein the first image processing apparatus model number different from said second image processing equipment, be carried out using The plurality of image processing candidates including the composite processing are information on the realization of the image processing executed in each image processing apparatus, and processing information that is information prepared for each image processing apparatus is used. A decision part to decide;
A support information display unit for displaying support information for selecting the image processing to be determined on the display unit of the communication device;
A first processing request for causing the first image processing apparatus to execute the first image processing in order to execute the composite processing selected by the user among the plurality of image processing. A first transmission unit for transmitting
A first receiving unit for receiving first target data generated in the first image processing from the first image processing device;
When the first target data is received from the first image processing device, the second target data based on the first target data is sent to the second image processing device; A second transmission unit that transmits a second processing request for executing the second image processing using target data;
A communication device comprising: A communication apparatus connected to a network including a plurality pieces of image processing apparatus,
A search unit for searching the plurality pieces of image processing apparatus in the network,
A plurality of image processing that can be realized by using the retrieved plural pieces of image processing apparatus, resulting in the first image processing apparatus for executing a first image processing by said first image processing a second image processing apparatus to perform a second image processing by using the data, wherein the first image processing apparatus model number different from said second image processing equipment, be carried out using The plurality of image processing candidates including the composite processing are information on the realization of the image processing executed in each image processing apparatus, and processing information that is information prepared for each image processing apparatus is used. A decision part to decide;
A support information display unit for displaying support information for selecting the image processing to be determined on the display unit of the communication device;
A first processing request for causing the first image processing apparatus to execute the first image processing in order to execute the composite processing selected by the user among the plurality of image processing. A first transmission unit for transmitting
A first receiving unit for receiving first target data generated in the first image processing from the first image processing device;
When the first target data is received from the first image processing device, the second target data based on the first target data is sent to the second image processing device; A second transmission unit that transmits a second processing request for executing the second image processing using target data;
Receiving a first response relating to the first image processing from the first image processing device and receiving a second response relating to the second image processing from the second image processing device; A receiver,
A progress display unit that displays information indicating the current progress of the combined processing on the display unit of the communication device after transmitting the first processing request for executing the first image processing;
Equipped with a,
The progress display unit displays information indicating the current progress when receiving the first response indicating normal operation and when receiving the second response indicating normal operation. wherein that displays on the display unit, the communication apparatus.

Images