JP6311813B2 - Relay device, relay device program, and communication method - Google Patents

Description

  In this specification, a relay device connected to the image processing device and the server device via a network is disclosed.

  The image processing apparatus described in Patent Document 1 has a built-in web browser and has a function of downloading and printing a web page. The image processing apparatus has a function of transmitting scan data generated by scanning a document to a web server after converting the scan data into a predetermined format such as JPEG.

JP 2008-229933 A

  There are cases where it is not desirable to upload the image data generated by the image processing apparatus as it is to the server, or it is not desirable for the image processing apparatus to download the image data stored in the server as it is.

The relay device described in Disclosure Example 1 is a relay device that can be connected to an image processing device and a server device via a network. The relay device is data processing executed on output data that is image data output from the image processing device or the server device, and is at least one type selected by the image processing device from among a plurality of types of data processing. The first acquisition means for acquiring the process identification information for identifying the selected data process, which is the data process of the image processing apparatus, and the plurality of types of modules for executing each of the plurality of types of data processes, A selection module that is a module that can be executed is selected, data processing means for causing the selection module to execute selection data processing on the output data, and when output data is output from the image processing apparatus, output by the selection module Processing data, which is data generated by executing selection data processing on data, is supported. To acquire the server device, when the output data from the server device is output, a second obtaining means for obtaining the processed data to the image processing apparatus, characterized in that it functions by.

According to the relay device, the program, the method, and the like described in the disclosure example 1 , the selection data processing selected in the image processing device is changed to the selection data processing for the data output from the image processing device or the server device. It can be executed in the corresponding selection module. Thereby, even if it is not desirable to upload the image data generated by the image processing apparatus to the server as it is, it can be dealt with by uploading the data processed in the selection data processing. Further, even when it is not desirable for the image processing apparatus to download the image data stored in the server as it is, it can be dealt with by downloading the processed data after being processed in the selection data processing.

According to the relay device described in the disclosure example 2 , it is possible to generate desired second processing data by data processing that cannot be executed by the image processing device. In addition, it is possible to perform data processing on the third data that cannot be decoded by the image processing apparatus and generate desired data.

According to the relay device or the like described in the disclosure example 3 , it is possible to generate processed image data desired for forming an image whose contents are processed with respect to an image formed based on output data. . In addition, it is possible to perform a format change process for changing the data format to a desired format.

According to the relay apparatus or the like described in the disclosure example 4 , it is not necessary to cope with both the format before conversion by the format conversion processing and the format after conversion by processing processing, and generates processing data of a desired format. It becomes possible to do.

According to the relay device or the like described in the disclosure example 5 , it is possible to generate processed data without having to deal with a large number of data formats by processing.

According to the relay device or the like described in the disclosure example 6 , it is possible to generate processed data in a desired format without having to deal with a large number of data formats by processing.

According to the relay device or the like described in the disclosure example 7 , when a plurality of processing processes are sequentially performed on one data, the processing data is performed in an advantageous processing order by executing in a predetermined order. Can be generated. For example, as a result of the data processing, the processing that reduces the amount of data is brought first, so that the subsequent processing only needs to perform processing on a small amount of data. That is, desired processing data can be generated by processing advantageous in terms of processing load.

Disclosure Example 8 According to the relay device or the like described in the present specification, output data output by the image processing device via the mediation server without the image processing device having to communicate processing data with the server device Can be processed into desired processing data, and the desired processing data can be output to the server device. Further, it is possible for the image processing apparatus to process the output data output from the server apparatus into desired processing data without causing the image processing apparatus to communicate processing data with the server apparatus, and to cause the image processing apparatus to acquire the desired data. Become.

According to the relay device or the like described in the disclosure example 9 , the output data output by the image processing device via the mediation server is desired without the image processing device having to communicate processing data with the server device. A plurality of processes for processing the processed data, and finally the processing data output by the conversion apparatus that has executed the selection data processing is sent to the server apparatus or the image processing apparatus via the mediation server. Can be acquired.

According to the relay device or the like described in the disclosure example 10 , the image processing device can acquire the desired processing data using the URL without the image processing device having to communicate the processing data with the server device. Can do.

According to the relay device or the like described in the disclosure example 11 , a waiting command is transmitted to the image processing device until the desired processing data is generated in the image processing device. When a situation in which an error occurs is prevented and desired processing data is generated, the server device or the image processing device can acquire the desired processing data.

According to the relay device described in the disclosure example 12 , the image processing device can upload desired processing data to the server device via the mediation server without having to communicate upload result information with the server device. It is possible to make the user confirm whether or not.

A method, a computer program, and a computer-readable recording medium storing the computer program for realizing the relay device are also novel and useful.
Examples of disclosure are listed below.
[Disclosure Example 1]
A relay device that can be connected to an image processing device and a server device via a network,
Data processing executed on output data which is image data output from the image processing device or the server device, and at least one type selected from the plurality of types of data processing in the image processing device First acquisition means for acquiring, from the image processing apparatus, process identification information for identifying selection data processing that is data processing;
A selection module that is a module capable of executing the selection data processing is selected from a plurality of types of modules that execute each of the plurality of types of data processing, and the selection data processing for the output data is selected. Data processing means to be executed by the module;
When the output data is output from the image processing device, the selection data is generated by executing the selection data processing on the output data by the selection module. Second output means for causing the image processing apparatus to acquire the processing data when the output data is output from a server device;
A relay device that functions as a relay.
[Disclosure Example 2]
The data processing means is the first data generated by data processing that can be executed by the image processing apparatus, and the output data output from the image processing apparatus is generated by the selection data processing. The selection data when the processing data is second data generated by data processing that cannot be executed by the image processing apparatus, or when the output data is third data that cannot be decoded by the image processing apparatus The relay apparatus according to Disclosure Example 1, which causes the selection module to execute a process.
[Disclosure Example 3]
For the multiple types of data processing,
Processing for generating processed image data, which is image data for forming an image whose contents are processed with respect to an image formed based on the output data, based on the output data;
A format change process for changing the format of the output data, and
The plurality of types of modules include
A processing module for executing the processing,
A format change processing module for executing the format change processing, and
The data processing means includes
In the case where the processing is included in the selection data processing, the selection module is selected so that the processing module is included in the selection module,
When the selection data processing includes the format change processing, the selection module is selected so that the selection module includes a format change processing module. Relay device.
[Disclosure Example 4]
The data processing means includes
When the selection data processing includes the processing processing and the format change processing,
Selecting the selection module such that the processing module and the format change processing module are included in the selection module;
Causing the processing module to execute the processing on the output data;
The relay apparatus according to Disclosure Example 3, which causes the format change processing module to execute the format change processing on the processed image data processed by the processing processing module.
[Disclosure Example 5]
The data processing means includes
When the format of the output data that causes the processing module to execute the processing is a format that cannot be processed by the processing module,
The relay device according to Disclosure Example 3, which causes the format change processing module to execute format conversion processing for converting the format of the output data into a format that can be processed by the processing processing module before the processing processing. .
[Disclosure Example 6]
The data processing means includes
In the case where the selection data processing includes the processing processing and the format change processing,
When the format of the output data is a format that cannot be processed by the processing module, the format change processing module executes a format conversion process for converting the format of the output data into a format that can be processed by the processing module. , Causing the processing module to execute the processing on the data processed by the format change processing module,
If the format of the output data is a format that can be processed by the processing module, the processing module is caused to execute the processing on the output data, and the processed image data processed by the processing module is processed. The relay apparatus according to disclosure 4 or 5, wherein the format change process module is caused to execute the format change process.
[Disclosure Example 7]
The relay device further functions as a storage control unit that stores a priority order among the plurality of types of processing in the storage unit,
The data processing means includes a plurality of processing modules that execute each of the plurality of selected processing processes in the selection module when there are a plurality of selected processing processes that are processing processes included in the selection data processing. The selection module is selected such that a plurality of selected processing processes are executed one by one in each of the plurality of processing processing modules in the order according to the priority order. The relay apparatus of any one of -6.
[Disclosure Example 8]
The relay device is
A mediation server capable of connecting to the image processing apparatus and the server apparatus via a network;
A plurality of conversion devices that are connectable to the image processing device and the mediation server via a network, and that include at least one of the plurality of modules;
Contains
When the output data is output from the image processing device, the conversion device acquires the output data from the image processing device, executes the selection data processing on the acquired output data, and The mediation server acquires the processing data from the conversion device, outputs the acquired processing data to the server device,
When the output data is output from the server device, the conversion device acquires the output data from the server device, executes the selection data processing on the acquired output data, and the mediation server The relay apparatus according to any one of disclosure examples 1 to 7, wherein the processing data is acquired from the conversion apparatus by the image processing apparatus.
[Disclosure Example 9]
In the case where the data processing means causes each of the plurality of conversion devices to sequentially execute the selection data processing,
When the output data is output from the image processing device,
The mediation server causes the first conversion device to acquire the output data from the image processing device, to execute the selection data processing on the acquired output data, and to transfer the processing data to the first conversion device. Obtained from the converter,
The intermediary server causes the Nth conversion device (N is a natural number of 2 or more) to output the processing data acquired from the (N−1) th conversion device and execute the selection data processing,
In response to causing the last conversion device to execute the selection data processing, the mediation server acquires the processing data from the conversion device, and outputs the acquired processing data to the server device.
When the output data is output from the server device,
The intermediary server causes the first conversion device to acquire the output data from the server device, to execute the selection data processing on the acquired output data, and to transfer the processing data to the first conversion device. Obtained from the converter,
The intermediary server causes the Nth conversion device (N is a natural number of 2 or more) to output the processing data acquired from the (N−1) th conversion device and execute the selection data processing,
9. The disclosure example 8, wherein the mediation server causes the image processing apparatus to acquire the processing data from the last conversion device in response to causing the last conversion device to execute the selection data processing. Relay device.
[Disclosure Example 10]
In response to causing the last conversion device to execute the selection data processing, the mediation server causes the image processing device to obtain data acquisition command information that causes the image processing device to acquire the processing data from the last conversion device. Output,
The relay apparatus according to Disclosure Example 9, wherein the data acquisition command information is described by a URL (Uniform Resource Locator) description method.
[Disclosure Example 11]
The data processing means outputs a standby command to wait for completion of the selection data processing to the image processing device during the execution period of the selection data processing,
The second acquisition unit causes the server apparatus or the image processing apparatus to acquire the processing data in response to completion of the selection data processing. The relay device described.
[Disclosure Example 12]
The relay device is
Upload result, which is information indicating whether or not the storage process of storing the processing data acquired by the second acquisition unit in the server apparatus in the server apparatus has been successful and is transmitted from the server apparatus Upload result information acquisition means for acquiring information,
Based on the obtained upload result information, it is determined whether or not the storage process is successful, and a determination result for outputting information for displaying the determination result on a display unit included in the image processing apparatus to the image processing apparatus Output means;
The relay device according to any one of disclosure examples 1 to 11, wherein the relay device further functions.
[Disclosure Example 13]
A program readable by a relay device that can be connected to an image processing device and a server device via a network,
The relay device;
Data processing executed on output data which is image data output from the image processing device or the server device, and at least one type selected from the plurality of types of data processing in the image processing device First acquisition means for acquiring, from the image processing apparatus, process identification information for identifying selection data processing that is data processing;
A selection module that is a module capable of executing the selection data processing is selected from a plurality of types of modules that execute each of the plurality of types of data processing, and the selection data processing for the output data is selected. Data processing means to be executed by the module;
When the output data is output from the image processing device, the selection data is generated by executing the selection data processing on the output data by the selection module. Second output means for causing the image processing apparatus to acquire the processing data when the output data is output from a server device;
A program characterized by making it function.
[Disclosure Example 14]
A control method for a relay device that can be connected to an image processing device and a server device via a network,
Data processing executed on output data which is image data output from the image processing device or the server device, and at least one type selected from the plurality of types of data processing in the image processing device A first acquisition step of acquiring, from the image processing apparatus, process identification information for identifying selection data processing that is data processing;
A selection module that is a module capable of executing the selection data processing is selected from a plurality of types of modules that execute each of the plurality of types of data processing, and the selection data processing for the output data is selected. Data processing steps to be executed by the module;
When the output data is output from the image processing device, the selection data is generated by executing the selection data processing on the output data by the selection module. A second obtaining step for causing the image processing device to obtain the processing data when the output data is output from a server device;
A method comprising the steps of:

1 shows a configuration of a communication system. The sequence diagram of each process performed by each device is shown. The sequence diagram of each process performed by each device is shown. The sequence diagram of each process performed by each device is shown. The sequence diagram of each process performed by each device is shown. The sequence diagram of each process performed by each device is shown. The sequence diagram of each process performed by each device is shown. The sequence diagram of each process performed by each device is shown. The sequence diagram of each process performed by each device is shown. The flowchart of a module designation | designated process is shown. An example of a priority table A display example of the main screen is shown. The example of a display of an application selection screen is shown. The example of a display of a server selection screen is shown. The display example of a basic function selection screen is shown. The example of a display of a process selection screen is shown.

(System configuration)
As shown in FIG. 1, the communication system 2 includes a multi-function device 10, a mediation server 60, content servers 100 and 110, a first data processing server 200, and a second data processing server 300. Yes. The multi-function device 10 is connected to the LAN 4. The mediation server 60, the content servers 100 and 110, the first data processing server 200 and the second data processing server 300 are connected to the Internet 6.

(Configuration of multi-function device 10)
The multi-function device 10 can execute processing for realizing each function such as a print function, a scan function, a copy function, and a FAX function. The multi-function device 10 includes an operation unit 12, a display unit 14, a network interface 16, a print execution unit 18, a scan execution unit 19, and a control unit 20. The operation unit 12 includes a plurality of keys. The user can input various instructions to the multi-function device 10 by operating the operation unit 12. The display unit 14 is a display for displaying various information. The network interface 16 is connected to the LAN 4. The multi-function device 10 can communicate with the mediation server 60, the first data processing server 200, and the like via the network interface 16. The print execution unit 18 includes a printing mechanism such as an inkjet method or a laser method. The scan execution unit 19 includes a scan mechanism such as a CCD or CIS. The control unit 20 includes a CPU 22 and a memory 24. The CPU 22 executes various processes according to the program 25 stored in the memory 24. The memory 24 may be a computer readable storage medium. The computer-readable storage medium is a non-transitory medium such as a ROM, RAM, flash memory, or hard disk. Electric signals that carry programs downloaded from servers on the Internet are not included in non-transitory media.

(Configuration of Mediation Server 60)
The mediation server 60 is a server configured separately from the first data processing server 200, the second data processing server 300, and the content servers 100 and 110. The mediation server 60 is a server for mediating communication of various data between each of the first data processing server 200, the second data processing server 300, the content servers 100 and 110, and the multi-function device 10. The mediation server 60 is a server provided by the vendor of the multi-function device 10. The mediation server 60 includes a network interface 62 and a control unit 70. The mediation server 60 can communicate with the multi-function device 10, the content servers 100 and 110, the first data processing server 200, the second data processing server 300, and the like via the network interface 62. The control unit 70 includes a CPU 72 and a memory 74. The memory 74 stores a program 75 and a priority order table TB1. The CPU 72 executes various processes according to the program 75. Similar to the memory 24, the memory 74 may be a computer-readable storage medium.

  The priority order table TB1 is a table showing the priority order among a plurality of types of processing. FIG. 11 shows an example of the priority table TB1. In the priority order table TB1, monochrome processing, Nin1 processing, and watermark processing are associated with the first to third priority orders. The priority order may be set so that the priority order of the processing process having a high data amount reduction rate before and after the processing process is high. Thereby, since the next processing process can be executed in a state where the data amount is reduced, the processing load in the next processing process can be reduced. For example, the amount of data for monochrome image data is smaller than that for color image data. Therefore, when performing the Nin1 processing after performing the monochrome processing, the data handled when performing the Nin1 processing can be compressed, so that the processing load of the Nin1 processing can be reduced. In addition, the number of times of the watermark processing is smaller when the Nin1 processing is performed and then the watermark processing is performed than when the Nin1 processing is performed after the watermark processing is performed on each of the N page image data. Therefore, the processing burden can be reduced. Note that, for reasons other than reducing the processing load of the processing process, a priority order among a plurality of types of processing processes may be determined.

(Configuration of the first data processing server 200)
The first data processing server 200 is a server configured separately from the mediation server 60, the content servers 100 and 110, and the second data processing server 300. The first data processing server 200 is a server for executing various processes to be described later on the data. The first data processing server 200 may be a server provided by the vendor of the multi-function device 10. The first data processing server 200 includes a network interface 262 and a control unit 270. The control unit 270 includes a CPU 272 and a memory 274. A program 275 is stored in the memory 274. The CPU 272 executes various processes according to the program 275. Similar to the memory 24, the memory 274 may be a computer-readable storage medium.

  The program 275 includes a monochrome processing module 281, a Nin1 processing module 282, and a watermark processing module 283 as programs for performing processing that changes data contents. The monochrome processing module 281 is a program for processing color image data into monochrome image data. The Nin1 processing module 282 is a program for performing processing that reduces each of the N pages of image data and assigns it to one page of image data. The watermark processing module 283 is a program that performs processing for copying a small design or character string into image data. The monochrome processing module 281, the Nin1 processing module 282, and the watermark processing module 283 all process image data whose format is JPEG format and output it as processed image data in JPEG format. Further, the monochrome processing module 281, the Nin1 processing module 282, and the watermark processing module 283 may be described as a basic processing module.

  The program 275 includes a JPEG_to_Office conversion module 291, an Office_to_JPEG conversion module 292, a JPEG_to_PDF conversion module 293, and a unified format conversion module 294 as programs for performing format conversion processing for converting the format of data. The JPEG_to_Office conversion module 291 is a program for converting the data format from the JPEG format to the Office format. Examples of Office format data include word processor software format data, spreadsheet software format data, presentation software format data, and the like. The Office_to_JPEG conversion module 292 is a program for converting the data format from the Office format to the JPEG format. The JPEG_to_PDF conversion module 293 is a program that converts the data format from JPEG format to PDF (abbreviation of Portable Document Format).

  The JPEG_to_Office conversion module 291 is also a program used when executing “Office conversion upload” among basic functions described later. The Office_to_JPEG conversion module 292 is also a program for executing “Office printing” among basic functions described later. The JPEG_to_PDF conversion module 293 is also a program for executing “PDF conversion upload” among basic functions described later. In addition to this, a PDF_to_JPEG conversion module that is a data program for executing “PDF printing” of basic functions to be described later and that converts the format from the PDF format to the JPEG format may be provided. . The unified format conversion module 294 is a module that converts data in a format that cannot be processed by the processing module into data in a format that can be processed by the processing module. For example, when all of the monochrome processing module 281, the Nin1 processing module 282, the watermark processing module 283, and the enclosing processing module 381 and the folded memo processing module 382, which will be described later, can process data in JPEG format, the unified format The conversion module 294 may be a module that converts data such as a bitmap format and a GIF format into a JPEG format. Of course, each processing module can process data other than the JPEG format, which is a unified format.

(Configuration of the second data processing server 300)
The second data processing server 300 is a server configured separately from the mediation server 60, the content servers 100 and 110, and the first data processing server 200. The second data processing server 300 is a server for executing various processes to be described later on the data. The second data processing server 300 includes a network interface 362 and a control unit 370. The control unit 370 includes a CPU 372 and a memory 374. A program 375 is stored in the memory 374. Similar to the memory 24, the memory 374 may be a computer-readable storage medium.

The program 375 includes a surrounding processing module 381 and a folded memo processing module 382 as a program for performing processing for changing the contents of data. The enclosing processing module 381 is an application for executing “enclosed scanning” and “enclosed copying”, which will be described later, among application functions, and images within a selection range designated by a marker or the like written on a document. This is a program for performing trimming processing to be extracted and selective erasure processing for erasing an image within a selection range. The folded memo processing module 382 is an application for executing “folded memo scanning” described later among the application functions. Enclosing processing module 38 1, any folded note processing module 382, processes the image data format is JPEG format, the JPEG format, and outputs it as image data of the processed. Moreover, enclosing processing module 38 1, the folding memo processing module 382 may be described as the application processing module.

  The precautions for description in this specification will be described. In the present specification, the description “the CPU 72 of the mediation server 60 receives various information” includes the technical content that “the CPU 72 of the mediation server 60 acquires various information via the network interface 62”. Suppose that Further, the description that “the CPU 72 of the mediation server 60 transmits various types of information” includes the technical content that “the CPU 72 of the mediation server 60 outputs various types of information via the network interface 62”. And Note that the same precautions exist for the CPU 272 and the network interface 262 of the first data processing server 200. Similar precautions exist for the CPU 22 and the network interface 16 of the multi-function device 10.

  Here, the definition of the words “data” and “information” will be described. In this specification, “data” and “information” use “information” as a superordinate concept of “data”. Therefore, “A data” may be rephrased as “A information”. In addition, “B data” copied or converted from “A data” is “A information” as long as it is used with the same meaning as “A data”.

  In this specification, when the mediation server 60 and the first data processing server 200 are connected via the Internet 6 (that is, the device functioning as the mediation server 60 and the device functioning as the first data processing server 200 are physically connected to each other). However, the present invention is not limited to this mode. At least two of the mediation server 60, the first data processing server 200, and the second data processing server 300 may be realized by one server device. For example, when the mediation server 60 and the first data processing server 200 are realized by one server device, a program that functions as the mediation server 60 and a program that functions as the first data processing server 200 are included in one server device. The communication between the two programs is performed via a bus line in the server device. In the case where the intermediary server 60 and the first data processing server 200 are configured by a single server device, this specification will be described as communication between the intermediary server 60 and the first data processing server 200. Communication may be replaced with data exchange between the program functioning as the mediation server 60 and the program functioning as the first data processing server 200. Further, a program that functions as the mediation server 60 and also functions as the first data processing server 200 may be realized in a form that operates on one server device. In this case, the communication described in this specification as the communication between the mediation server 60 and the first data processing server 200 functions as the mediation server 60 and also functions as the first data processing server 200. It may be replaced with data exchange in the program.

(Configuration of content servers 100 and 110)
The content servers 100 and 110 are servers used for online services provided by the vendor of the multi-function device 10. The content servers 100 and 110 are so-called storage servers. The content servers 100 and 110 may be servers used for online services that lend the data storage areas of the content servers 100 and 110 to users. Examples of online services include known services such as “Evernote (registered trademark)”, “Google (registered trademark) Docs”, “PICASA (registered trademark)”, “FACEBOOK (registered trademark)”, and the like. The user of the online service can upload or download various data via the Internet 6 to a storage area assigned to the user. The content server 100 includes a data storage area 101. The data storage area 101 is an area for storing various data. Various data stored in the data storage area 101 may be described as content data.

(Operation of communication system)
The operation of the communication system 2 will be described with reference to the sequence diagrams of FIGS. When the CPU 22 of the multi-function device 10 is turned on and receives a command to display the main screen, the CPU 22 displays the main screen on the display unit 14 in S510. The command for displaying the main screen may be input from the operation unit 12 by the user. Data representing the main screen may be stored in the memory 24 in advance. FIG. 12 shows an example of the main screen 201. The main screen 201 includes button images B1 and B2. The button images B1 and B2 are images for receiving input of execution commands for a plurality of functions. The function accepted by the button image B1 is an application function. The application function is a function for performing an applied process such as a surrounding process or a folded memo process. The function accepted by the button image B2 is a basic function. The basic function is a function for performing basic processing such as uploading scan data from the multi-function device 10 to the content server or printing data downloaded from the content server to the multi-function device 10.

  When an operation for selecting the button image B1 or B2 is performed in the multi-function device 10, the CPU 22 transmits function identification information indicating a function corresponding to the selected button image to the mediation server 60 in S512. An example of the function identification information is “application function” which is the name of the button image B1. That is, the function identification information may be information indicating the selected button. The function identification information may include device format information corresponding to the format of the scan data output from the multi-function device 10. As an example of the device format information, model information of the multi-function device 10 may be used. In this case, the CPU 72 of the mediation server 60 may recognize the format of the scan data output by the model based on the model information of the multi-function device 10. When there are a plurality of formats in which the multi-function device 10 can generate scan data, the device format information may be information indicating a default format which is a format mainly used among the plurality of formats. The default format may be JPEG. Note that the multi-function device 10 may generate scan data in a default format in execution of processing for realizing an application function described later.

  When receiving the button image identification information from the multi-function device 10, the CPU 72 of the mediation server 60 determines the function indicated by the function identification information in S514. When the basic function is indicated (S514: basic function), the process proceeds to S929. If an application function is indicated (S514: application function), the process proceeds to S518. In S518, the CPU 72 specifies the application selection screen 211 as screen data to be transmitted to the multi-function device 10 next. The application selection screen 211 is a screen for accepting selection of one of a plurality of application functions.

  In S518, the CPU 72 of the mediation server 60 generates application selection screen data for displaying the application selection screen 211. The memory 74 stores information (not shown) that indicates what information needs to be included in the application selection screen data. The CPU 72 of the mediation server 60 generates application selection screen data according to this information. The application selection screen data includes information indicating that the button images B11 to B13 are included in the application selection screen 211, information indicating that a screen for selecting any of the button images B11 to B13, and a button Information indicating that “enclosed scan”, “folded memo scan”, and “enclosed copy” correspond to each of the images B11 to B13, and a character string to be displayed on the button images B11 to B13. And information. In S <b> 519, the CPU 72 of the mediation server 60 transmits application selection screen data to the multi-function device 10.

  When receiving the application selection screen data from the mediation server 60, the CPU 22 of the multi-function device 10 displays the application selection screen 211 on the display unit 14 in S521. As shown in FIG. 13, the application selection screen 211 includes button images B11 to B13.

  The button image B11 is an image for receiving selection of an application function of “enclosed scan”. “Surround scanning” performs image processing on scan data generated by scanning a document with the multi-function device 10, recognizes a marker for designating a selection range written on the document, and creates an image within the selection range. It is an application for executing various types of processing and uploading processed data to the content server. In the “surrounding scan”, the image in the selection range may be trimmed, or the image in the selection range may be deleted.

  The button image B12 is an image for accepting selection of an application function of “folded memo scan”. “Folded memo scan” is an application for performing page recognition processing on scan data output from the multi-function device 10 and uploading processed data to a content server. Specifically, in the “folded memo scan”, a dedicated print sheet on which a page boundary is printed is used. By folding the printing paper at the page boundary, one sheet functions as a memo pad having a memo area of a plurality of pages. After writing in the memo pad, if the folds are returned to return to the state of one sheet of printing paper, scanning can be performed for each page by recognizing the boundary line of the page. For example, when one sheet of paper is folded in four, it has a memo area for 8 pages in total on the front and back sides. When the fold is returned after writing and “folded memo scan” is executed, image data for eight pages with page numbers can be generated. The dedicated printing paper may be downloaded from the server by the multi-function device 10 and printed.

  The button image B13 is an image for accepting the selection of the “enclose and copy” application function. “Surround Copy” performs image processing on scan data generated by scanning a document with the multi-function device 10, recognizes a marker for designating a selection range written on the document, and creates an image within the selection range. It is an application for executing various processes on the data, downloading the processed data to the multi-function device 10 again, and printing it. In “enclose copy”, an image in the selection range may be trimmed, or an image in the selection range may be deleted.

  The CPU 22 of the multi-function device 10 creates bitmap information and the like for displaying the images of the button images B11 to B13 based on the application selection screen data received from the mediation server 60, and displays the application selection screen 211. Display on the unit 14. Thus, since bitmap information is created on the multi-function device 10 side, it is not necessary to include bitmap information for displaying the button images B11 to B13 in the server selection screen data. Further, it is not necessary to include bitmap information for displaying the up and down arrow buttons shown in FIG. The user operates the operation unit 12 to select a button image representing a desired application from the application selection screen 211.

  When an operation for selecting a button image is performed in the multi-function device 10, the CPU 22 of the multi-function device 10 transmits application identification information to the mediation server 60 in S531. The application identification information is information for identifying the selected application function. An example of application identification information is the name of an application function. That is, the application identification information may be information indicating the selected button.

  When receiving the application identification information from the multi-function device 10, the CPU 72 of the mediation server 60 determines whether or not the application function indicated by the application identification information is an application function that requires selection of a service server in S532. If the determination is negative (S532: NO), the process proceeds to S538. If the determination is affirmative (S532: YES), the process proceeds to S533. In S532, the CPU 72 makes an affirmative determination when the application function indicated by the application identification information is “enclosed scan” or “folded memo scan”, and deny when the application function indicated by the application identification information is “enclosed copy”. to decide. In S533, the CPU 72 of the mediation server 60 generates service selection screen data for displaying the service selection screen 212. In S535, the CPU 72 transmits the service selection screen data to the multi-function device 10. When receiving the service selection screen data from the mediation server 60, the CPU 22 of the multi-function device 10 displays the service selection screen 212 on the display unit 14 in S536. And CPU22 receives selection of a service. As shown in FIG. 14, the service selection screen 212 includes button images B31 and B32.

  The user operates the operation unit 12 to select a button image representing a content server to which data is to be uploaded from the service selection screen 212. In the present embodiment, the description will be continued by taking as an example a case where the user selects the button image B31 (that is, the content server 100). In S537, the CPU 22 transmits service identification information corresponding to the button image selected by the user to the mediation server. In the example of this embodiment, service identification information including the server name “Server 100” is transmitted to the mediation server. That is, the service identification information may be information indicating the selected button.

  In S538, the CPU 72 of the mediation server 60 determines whether or not an application function that can select the processing process is selected. If a negative determination is made (S538: NO), the process proceeds to S559. If the determination is affirmative (S538: YES), the process proceeds to S539. In S538, the CPU 72 makes an affirmative determination when the application function indicated by the application identification information is “enclosed scan” or “enclosed copy”, and deny if the application function indicated by the application identification information is “folded memo scan”. to decide. In S <b> 539, the CPU 72 of the mediation server 60 generates processing process selection screen data for displaying the processing process selection screen 214. In S <b> 541, the CPU 72 of the mediation server 60 transmits the processing process selection screen data to the multi-function device 10. In S <b> 543, the CPU 22 of the multi-function device 10 displays the processing selection screen 214 on the display unit 14. As shown in FIG. 16, the processing selection screen 214 includes button images B51 to B55.

  The button image B51 is an image for accepting selection of “monochrome processing”. The button image B52 is an image for accepting selection of “Nin1 processing”. The button image B53 is an image for accepting selection of “watermark processing”. The button image B54 is an image for accepting selection that does not perform the processing. The user operates the operation unit 12 to select a button image representing the desired processing from the processing processing selection screen 214. A plurality of processing processes can be selected. For example, a plurality of processing processes may be selected by touching a plurality of processing processes to be executed and finally touching the button image B55 indicating “OK”.

  In S <b> 544, the CPU 22 transmits processing process identification information indicating the selected processing process to the mediation server 60. In S559, the CPU 72 of the mediation server 60 performs module designation processing. The module designation process is a process for designating an execution target module that is a module for executing the process. Module identification information for identifying the designated execution target module is stored in a FIFO (abbreviation of First In First Out) memory area (not shown). When a plurality of execution target modules are specified, identification information of the plurality of execution target modules is stored in the FIFO memory area in the specified order. The contents of the module designation process will be described using the flowchart of FIG. Note that the flowchart of FIG. 10 is a common flowchart regardless of whether the function identification information indicates “application function” or “basic function”.

  In S1112, the CPU 72 determines whether an application function is selected. This determination may be made based on the function identification information received in S531. As an example of the case where the application function is selected, there is a case where the function identification information received in S531 indicates “enclosed scan”. If the determination is negative (S1112: NO), the process proceeds to S1120. If the determination is affirmative (S1112: YES), the process proceeds to S1116. In S1116, the CPU 72 temporarily stores module identification information for identifying an application processing module for executing the processing related to the selected application function. For example, if “enclosed scan” is selected, the CPU 72 temporarily stores the identification information of the enclosing processing module 381. Then, the process proceeds to S1120.

  In S1120, the CPU 72 determines whether or not format conversion processing of image data is necessary in the basic function. This determination may be negative when any application function is selected. When the basic function identification information indicates “scan upload” and the setting format information is included in the scan setting information received in S958, the format indicated by the setting format information and the format indicated by the output format identification information received in S949 An affirmative determination may be made if they do not match, and a negative determination may be made if they match. If the basic function identification information indicates “scan upload” and the scan setting information received in S958 does not include the setting format information, or if the scan setting information is not received, in S512 or S941 An affirmative determination may be made when the received device format information does not match the output format identification information received at S949, and a negative determination may be made when they match. When the basic function identification information indicates “scan upload” and the output format identification information indicates the Office format, “Office conversion upload” is selected from the basic functions. When the basic function identification information indicates “scan upload” and the output format identification information indicates the PDF format, “PDF conversion upload” is selected from the basic functions. When the basic function identification information indicates “download print” and the format of the selection data received in S81 is the Office format, “Office print” is selected from the basic functions. When the basic function identification information indicates “download print” and the format of the selection data received in S81 is the PDF format, “PDF print” is selected from the basic functions.

  If a negative determination is made in S1120 (S1120: NO), the process proceeds to S1128. If an affirmative determination is made (S1120: YES), the process proceeds to S1124. In S1124, the CPU 72 temporarily stores identification information of the format change module corresponding to the selected function. Then, the process proceeds to S1128.

  In S1128, the CPU 72 determines whether or not an image processing function is selected. This determination may be made based on the processing identification information received in S544. As an example of the case where the image processing function is selected, there is a case where the processing processing identification information received in S544 indicates “monochrome processing” and “Nin1 processing”. If the determination is negative (S1128: NO), the process proceeds to S1144. If the determination is affirmative (S1128: YES), the process proceeds to S1132. In S1132, the CPU 72 temporarily stores the module identification information of the basic processing module that performs the processing indicated by the processing processing identification information. For example, when the processing identification information indicates “monochrome processing” and “Nin1 processing”, the CPU 72 temporarily stores the identification information of the monochrome processing module 281 and the identification information of the Nin1 processing module 282. Remember. Then, the process proceeds to S1136.

  In S1136, the CPU 72 determines whether or not the processing source data has a format that can be processed by the basic processing module. Specifically, the CPU 72 may make an affirmative determination when an application function is selected. This is because the application processing module outputs data in JPEG format, and the basic processing module processes data in JPEG format. The CPU 72 may make an affirmative determination when the basic function is selected and “Office download print” and “PDF download print” are selected from the basic functions. This is because the Office to JPEG conversion module and the PDF to JPEG conversion module output JPEG data, and the basic processing module processes JPEG data. In addition, when “Office conversion upload” and “PDF conversion upload” are selected among the basic functions, the CPU 72 displays the device format information included in the function identification information received in S517 or S941, or The determination may be made based on the setting format information included in the scan setting information received in S958. In this case, a negative determination is made when the device format information or the setting format information indicates the JPEG format, and an affirmative determination is made otherwise. If “download print” is selected among the basic functions, the determination may be made based on the extension of the selected data included in the detailed data information received in S55. In this case, a negative determination is made when the extension indicates the JPEG format, and an affirmative determination is made otherwise.

  If an affirmative determination is made in S1136 (S1136: YES), the process proceeds to S1144, and if a negative determination is made (S1136: NO), the process proceeds to S1140. Note that the selected application function and the selected basic function may be determined based on the temporarily stored module identification information, or based on the function identification information, application identification information, and output format identification information. You may judge.

  In S1140, the CPU 72 temporarily stores identification information of the unified format conversion module. Specifically, when a basic function is selected, and “Office Download Print” and “PDF Download Print” are selected among the basic functions, the module identification information of each format conversion module is unified format. Stored as module identification information of the conversion module, when “download print” is selected as the basic function, and the extension of the selected data included in the detailed data information received in S55 indicates other than JPEG format May temporarily store module identification information of the unified format conversion module 294 that converts data in the format indicated by the extension into data in JPEG format.

  In S1144, the CPU 72 executes a rearrangement process for rearranging the execution order of the modules stored temporarily. Specifically, first, the execution target module with the highest priority is determined. When the application function is selected, the corresponding application processing module is set as the execution target module with the highest priority. If “download print” is selected as the basic function and the module identification information of the format conversion module is temporarily stored in S1140, the format conversion module is set as the execution target module with the highest priority. If “scan upload” is selected as the basic function and the module identification information of the basic processing module is temporarily stored in S1132, the basic processing module is set as the highest priority execution target module. When the application processing module or the format conversion module is the highest priority execution target module and the module identification information of the basic processing module is not temporarily stored, the CPU 72 determines the module identification information of the application processing module or the format conversion module. Are stored in the FIFO memory area. When the application processing module or the format conversion module is the execution target module with the highest priority, and the module identification information of the basic processing module is temporarily stored in S1132, the basic processing module is ranked second or later. The execution target module has priority over When module identification information of a plurality of basic machining modules is stored in S1132, the execution order between the basic machining modules is determined so as to follow the priority order stored in the priority order table TB1. After determining the execution target module having priority over the second and subsequent ranks, if “scan upload” is selected from the basic functions and the module identification information of the format conversion module is temporarily stored in S1140, the format The conversion module becomes the last execution target module. After determining from the highest priority execution target module to the last execution target module, in S1144, the CPU 72 stores the module identification information of the plurality of execution target modules in the FIFO memory area in priority order. Then, the process proceeds to S1148.

  In S1148, the CPU 72 creates parameter information. The parameter information is information including the module identifier of the execution target module, and is information indicating the execution order of the execution target modules. As a result, the module designation process ends and the process proceeds to S561 (see FIG. 3).

  In S561, the CPU 72 of the mediation server 60 generates scan upload execution command information. The scan upload execution command information is information for instructing the multi-function device 10 to upload the upload data generated by the scan process. In S <b> 563, the CPU 72 transmits scan upload execution command information to the multi-function device 10. In step S565, the CPU 22 of the multi-function peripheral 10 executes image scanning. Specifically, when the user sets a sheet on which a predetermined image is recorded in the scan execution unit 19 and presses the reading start button of the operation unit 12, the CPU 22 records the sheet on the sheet in the scan execution unit 19. The scanned image is read, and upload data is created from the scanned image data. Note that if “Bordered Scan” or “Bordered Copy” is selected, the document with the marker is scanned, and if it is “Folded Memo Scan”, a memo is written on the dedicated folded memo paper. The document is scanned.

  In S <b> 571, the CPU 22 transmits data processing upload destination URL acquisition request information and template acquisition request information to the mediation server 60. “Data processing upload” is a process of uploading various data to the first data processing server 200 and the second data processing server 300 for data processing. The data processing upload destination URL acquisition request information is information for requesting the data processing upload destination URL, which is information necessary for uploading to the first data processing server 200. The template acquisition request information is information for requesting an upload message template to be described later.

  In the first data processing P1 (S572 to S651), the scan data generated by the multi-function device 10 or the data acquired by the mediation server 60 from the content server 100 is converted into the first data processing server 200 or the second data processing. This is a process for causing the server 300 to process data. In S <b> 572, the CPU 72 of the mediation server 60 determines whether the data to be processed by the data processing server is scan data generated by the multi-function device 10. Specifically, an affirmative determination may be made when an application function is selected based on the application identification information. Based on the basic function identification information, an affirmative determination may be made when “scan upload”, “Office conversion upload”, or “PDF conversion upload” is selected as the basic function. A negative determination may be made when “download printing”, “Office printing”, or “PDF printing” is selected as the basic function. If the determination is negative (S572: NO), the process proceeds to S53, and if the determination is affirmative (S572: YES), the process proceeds to S573.

  In S573, the CPU 72 of the mediation server 60 transmits data processing upload data ID acquisition request information to the data processing server that executes the first data processing P1. Specifically, the CPU 72 of the mediation server 60 transmits data processing upload data ID acquisition request information to the data processing server including the module indicated by the module identification information stored at the head of the FIFO memory. As will be described in detail later, the CPU 72 deletes the module identification information of the data-processed module from the top of the FIFO memory. Therefore, the highest priority module identification information among the modules that have not yet executed data processing is stored at the head of the FIFO memory. The data processing upload data ID acquisition request information is information for requesting the data processing server for a data processing upload data ID for identifying the upload data uploaded to the data processing server. In S575, the CPU 272 of the first data processing server 200 or the CPU 372 of the second data processing server 300 transmits the data ID for data processing upload to the mediation server 60.

  Note that the processing of S573 and S575 may be performed between any of the first data processing server 200 and the second data processing server 300. Hereinafter, when a process that can be executed for both the first data processing server 200 and the second data processing server 300 is described in the sequence diagram, one is described by a solid arrow, and the other is described by a dotted arrow. To do.

  In S577, the CPU 72 creates an upload message template. The upload message template is information serving as a message framework when uploading upload data to the data processing server.

  In S579, the CPU 72 transmits the data processing upload destination URL and the upload message template to the multi-function device 10. An example of the data processing upload destination URL is the URL of the data processing server.

  In S581, the CPU 22 creates an upload message based on the received template, the received data processing upload destination URL, and the upload data created in S565. Specifically, the multi-function device 10 combines the binary data of the upload data, the data processing upload destination URL, and various types of information such as the data size of the upload data at a predetermined position of the template received from the mediation server 60. . Thereby, an upload message corresponding to the data processing server can be created.

  In S583, the CPU 22 transmits an upload message to the data processing server. In S <b> 585, the CPU of the data processing server transmits data processing upload result information to the multi-function device 10. The data processing upload result information is information indicating whether or not the upload data has been successfully uploaded to the data processing server. Note that the processing of S583 and S585 may be performed between any of the first data processing server 200 and the second data processing server 300. In S 587, the CPU 22 of the multi-function device 10 transfers the received data processing upload result information to the mediation server 60.

  In S589, the CPU 72 of the mediation server 60 decrypts the data processing upload result information and creates a decryption result. Since the data processing upload result information is information transmitted from the data processing server to the multi-function device 10, the data processing upload result information has specifications specific to the data processing server. Therefore, the data processing upload result information can be decrypted by using a decryption program (not shown) included in the program 75 stored in the mediation server 60. The decryption result is a message in a format that can be decrypted by the multi-function device 10. The decryption result includes the data processing upload result included in the decrypted data processing upload result information.

  In S619 to S651, a data processing execution process is performed. In S619, the CPU 72 transmits the first data processing request information to the data processing server. The first data processing request information requests execution of data processing for the upload data identified by the data processing upload data ID received in S575 (that is, the upload data uploaded to the data processing server in S583). Information. The data processing is processing including the above-described processing processing and format change processing. When module identification information of modules included in the same data processing server is stored in the FIFO memory continuously from the module identification information stored at the head of the FIFO memory, the CPU 72 determines the first data processing request information. Includes information requesting execution of a plurality of processes in the order stored in the FIFO memory.

  In S621, the CPU 272 of the data processing server transmits the processing data acquisition information to the mediation server 60. The processing data acquisition information may include a data processing job ID that is information for identifying the data processing performed in response to the processing requesting execution of data processing (S619). The processing data acquisition information may be described by a URL description method. In S619, when the CPU 72 includes information requesting execution of a plurality of processes in the first data processing request information, one piece of processing data acquisition information identifies the plurality of data processes as a whole.

  The processing of S631 to S651 is processing for causing the multi-function device 10 to wait until data processing is completed when data processing is started for upload data. The data processing server executes data processing on the uploaded data in response to receiving the first data processing request information in S619. Data processing may be performed on upload data divided for each predetermined amount of data (eg, 100 KB). The predetermined data amount may be a data amount suitable for data processing. For example, when “JPEG_to_Office conversion process” and “JPEG_to_PDF conversion process” are included, the conversion process may be performed every 100 Kbytes. If “JPEG_to_Office conversion process” and “JPEG_to_PDF conversion process” are not included, only “enclosed process”, “folded memo process”, “monochrome process”, “Nin1 process”, and “watermark process” The entire upload data may be processed.

  In S631, the CPU 72 of the mediation server 60 transmits data processing completion confirmation request information to the data processing server. The data processing completion confirmation request information is information for confirming to the data processing server whether or not the data processing requested to the data processing server in S619 has been completed. In order to identify the data processing, the CPU 72 includes the processing data acquisition information transmitted by the data processing server in S621 in the data processing completion confirmation request information.

  In S632, the CPU of the data processing server determines whether the data processing is completed. Specifically, the data processing corresponding to the processing data acquisition information included in the data processing completion confirmation request information is specified as the data processing for determining whether or not the data processing can be completed. Then, in the specified data processing, it is determined whether or not conversion for a predetermined amount of data has been completed from the top portion of the upload data. Specifically, for data processing for processing every 100 Kbytes, it is determined whether processing for 100 Kbytes has been completed. For data processing for processing the entire upload data, the data processing for the entire upload data is completed. Judgment is made. If the data processing has not been completed (S632: NO), the process proceeds to S633.

  In S633, the CPU transmits data processing incomplete notification information indicating that the data processing is not completed to the mediation server 60. In S635, the CPU 72 of the mediation server 60 generates a standby command in response to receiving the data processing incomplete notification information. The standby command is a command for causing the multi-function device 10 to wait for completion of data processing.

  In S <b> 637, the CPU 72 transmits a standby command to the multi-function device 10. In S <b> 639, the CPU 22 of the multi-function device 10 executes standby processing for waiting for completion of data processing. The standby process may be, for example, a process of resetting and restarting a timer that has been started to detect a data processing timeout. In addition, for example, the time-out time stored in the memory 24 may be increased to extend the time for the data processing to time out.

  In S641, the CPU 22 transmits standby process completion information indicating that the execution of the standby process has been completed to the mediation server 60. Then, the process returns to S631.

  On the other hand, if it is determined in S632 that the data processing has been completed (S632: YES), the process proceeds to S651. In S651, the CPU of the data processing server transmits data processing completion notification information indicating that data processing for a predetermined amount of data at the head portion of the upload data has been completed to the mediation server 60. The data processing execution process (S619 to S651) may be performed with the second data processing server 300.

  In S654, the CPU 72 of the mediation server 60 that has received the data processing completion notification information deletes the module identification information corresponding to the data processing for which data processing for a predetermined amount of data has been completed from the top of the FIFO memory. In S619, when the CPU 72 includes information requesting execution of a plurality of processes in the first data processing request information, the module identification information corresponding to the plurality of processes is deleted from the head of the FIFO memory.

  In S659, the CPU 72 of the mediation server 60 determines whether module identification information is stored in the FIFO memory. In the case of a negative determination (S659: NO), the process proceeds to S752 in order to perform processing for outputting the processing data that has been processed in all modules stored in the FIFO memory, and in the case of a positive determination (S659: YES) In order to perform new data processing, the process proceeds to S663.

  In S <b> 663, the CPU 72 of the mediation server 60 transmits the first processing data acquisition command information to the data processing server that has been processing data until now. The first processing data acquisition command information is a command for causing the processing data identified by the processing data acquisition information to be transmitted from the data processing server that has been processing the data to the mediation server 60.

  The CPU of the data processing server that has been processing data up to now in S665 transmits the processing data specified by the first processing data acquisition command information to the mediation server 60. In the data processing server, when the data processing for the upload data is performed 100 KB at a time, the processing data is transmitted to the mediation server 60 at 100 KB in S665 with respect to the first processing data acquisition command information transmitted in S663. It may be. In this case, the CPU 72 of the mediation server 60 transmits the first processing data acquisition command information in S663 until the module indicated by the module identification information stored at the top of the FIFO memory receives the minimum amount of data that can be processed. And reception of the processing data in S665 may be repeated.

  The second data processing P2 (S673-S751) is different from the module that has processed the processing data processed in the first data processing P1 or the processing data processed in the second data processing P2. This is a process for further data processing in a data processing server including a module.

  In S673 to S685, processing for uploading the processing data acquired from the data processing server that has been processing data in S665 to the data processing server that performs new data processing is performed. The contents of each process of S673, S675, S683, and S685 are that the data to be processed is processed data that has been subjected to at least one of the data processes, an upload message is transmitted from the mediation server 60, If the processing data included in the upload message transmitted by the mediation server 60 is the minimum amount of data that can be processed by the data processing module, the remaining processing even after the data processing is started in the data processing module Except for the fact that an upload message including data is transmitted from the mediation server 60, the processing is the same as the contents of the above-described processes of S573, S575, S583, and S585, and thus description thereof is omitted here.

  In S719 to S751, processing for executing data processing is performed on the data uploaded to the data processing server that performs new data processing. Since the contents of each process are the same as the contents of each process of S619, S621, S631, S632, S633, S639, and S651 described above except that the specific data process is different, the description is omitted here. . The second data processing P2 may be performed between any of the first data processing server 200 and the second data processing server 300. After S751, the process returns to S654.

  On the other hand, when a negative determination is made in S659 (S659: NO), in S752, the CPU 72 of the mediation server 60 determines whether or not the output destination of the processed data is the multi-function device 10. For example, if “download print”, “Office download print”, or “PDF download print” is selected as the basic function, or “enclosed copy” is selected as the application function, the data It may be determined that the output destination is the multi-function device 10. In addition, when “scan upload”, “Office conversion upload”, or “PDF conversion upload” is selected as the basic function, or “enclosed scan” or “folded memo scan” is selected as the application function If it is, the data output destination may be determined to be the content server. The determination in S752 may be made based on module identification information included in the parameter information. The determination may be made based on the application identification information and basic function identification information stored separately from the parameter information. If the data output destination is the multi-function device 10 (S752: YES), the process proceeds to S753.

  The processing of S753 to S773 is processing for causing the multi-function device 10 to print the processing data processed by the first data processing server 200 or the second data processing server 300. In S753, the CPU 72 of the mediation server 60 generates second process data acquisition command information. The second processing data acquisition command information is information for notifying the multi-function device 10 that the data processing in the data processing module with the last data processing order has been completed for a predetermined amount of data in the top portion (S732: YES). is there.

  When the second processing data acquisition command information is received, the CPU 72 transmits the second processing data acquisition command information to the multi-function device 10 in S757. In S759, the CPU 22 of the multi-function device 10 transmits the first download source URL request information and the processing data acquisition information request information to the mediation server 60. The first download source URL request information is information for requesting the mediation server 60 for the first download source URL for accessing the processing data for which the data processing completion confirmation has been performed in S731. The processing data acquisition information request information is information for identifying the job that generated the processing data for which the data processing completion confirmation was performed in S731.

  In S <b> 761, the CPU 72 generates a first download source URL and processing data acquisition information for acquiring processing data from a data processing server including a data processing module that last processed the processing data. 10 to send.

  In S763, the CPU 22 of the multi-function device 10 uses the first data processing server 200 or the first data processing server 200 to download the download request information for downloading the processing data identified by the processing data acquisition information based on the first download source URL. 2 Transmit to the data processing server 300. In S765, the CPU of the data processing server causes the multi-function device 10 to transmit the processing data specified by the download request information. Note that the processing of S763 and S765 may be performed between any of the first data processing server 200 and the second data processing server 300.

  In the data processing server, when data processing is performed 100 KB at a time, the processing data may be transmitted to the multi-function device 10 at 100 KB in S765 with respect to the download request information transmitted at S763. In this case, the CPU 22 of the multi-function device 10 transmits the download request information in S763 and receives the processing data in S765 until it receives the minimum amount of data that can cause the print execution unit to execute the printing process. repeat. When the print execution unit 18 is an ink jet printer, the minimum amount of data that can cause the print execution unit to execute print processing may be an amount sufficient to cause the ink head to carriage once. When the execution unit 18 is a laser printer, the amount may be sufficient to print one sheet of printing paper.

  In S767, the CPU 22 of the multi-function peripheral 10 causes the print execution unit 18 to execute print processing. The printing process may be executed in the minimum printable unit of the print data. For example, when the print execution unit 18 is an inkjet printer, the print process may be executed in units of lines. When the printing execution unit 18 is a laser printer, the printing process may be executed for each sheet of printing paper.

  When the print processing of the processing data is completed, in S769, the CPU 22 transmits print completion notification information indicating that the print processing is completed to the mediation server 60. In S <b> 771, the CPU 72 of the mediation server 60 transmits processing completion notification information to the multi-function device 10. In S <b> 773, the CPU 22 of the multi-function device 10 displays a completion screen on the display unit 14. Then, the flow ends.

  On the other hand, when it is determined in S752 that the output destination of the processing data processed by the data processing server is not the multi-function device 10 (S752: NO), in order to output the processing data to the content server, S853 ( Go to FIG.

  In S853, the CPU 72 of the mediation server 60 generates the third processing data acquisition command information for acquiring the processing data from the data processing server including the data processing module that last processed the processing data. 3. Send processing data acquisition command information to the data processing server.

In S855, the CPU of the data processing server causes the mediation server 60 to transmit the processing data specified by the third processing data acquisition command information. In the data processing server, when the data processing is performed every 100 KB, the processing data may be transmitted to the mediation server 60 in 100 KB in S855 with respect to the third processing data acquisition command information transmitted in S853. . In this case, the CPU 72 of the mediation server 60 repeats the transmission of the third processing data acquisition command information in S853 and the reception of the processing data in S855 until the minimum amount of data that can be transmitted to the content server is received. The processing of S85 3 and S855, among the first data processing server 200 and the second data processing server 300 may be performed between the both.

  In S857, the CPU 72 of the mediation server 60 transmits the save upload destination URL acquisition request information to the content server 100. “Save upload” is a process of uploading various data to the content server for saving. The storage upload destination URL acquisition request information is information for requesting a storage upload destination URL, which is information necessary for uploading to the content server 100. In S859, the CPU 72 receives the save upload destination URL transmitted from the content server 100. In S <b> 861, the CPU 72 of the mediation server 60 transmits processing data to the content server 100. In S863, the CPU 72 receives the storage upload result information transmitted from the content server 100. The saved upload result information is information indicating whether or not the processing data is normally stored in the content server 100.

  In S865, the CPU 72 decrypts the stored upload result information and creates a decryption result. If the processing data is stored normally, a decoding result indicating that the processing data is stored normally is obtained. When the data is not stored normally, for example, when the data size of the uploaded processing data exceeds the data size that can be stored in the content server 100, the decryption result indicating that the data cannot be stored due to the capacity being exceeded. Is created.

  In S867, the CPU 72 of the mediation server 60 transmits processing completion notification information to the multi-function device 10. The processing completion notification information includes data for displaying the decoding result on the display unit 14 of the multi-function device 10. In S869, the CPU 22 of the multi-function device 10 causes the display unit 14 to display the decoding result based on the processing completion notification information. Then, the flow ends.

  On the other hand, if the function identification information indicates the basic function (S514: basic function) in S514 (see FIG. 2), the CPU 72 of the mediation server 60 proceeds to S929 (see FIG. 8). The content of each step of S929, S931, and S933 is the same as the content of each step of S533, S535, and S536 described above, and thus description thereof is omitted here.

  In S935, the CPU 22 of the multi-function peripheral 10 transmits service identification information corresponding to the button image selected by the user to the mediation server, as in S537.

  In S937, the CPU 72 of the mediation server 60 generates basic function selection screen data for displaying the basic function selection screen 213. In S938, the CPU 72 of the mediation server 60 transmits basic function selection screen data to the multi-function device 10.

  The CPU 22 of the multi-function device 10 causes the display unit 14 to display the basic function selection screen 213 in S939. As shown in FIG. 15, the basic function selection screen 213 includes button images B41 and B42.

  The button image B41 is an image for accepting selection of the basic function of “scan upload”. “Scan upload” is a function for uploading scan data generated by the multi-function device 10 to the service selected in S933. The button image B42 is an image for accepting selection of the basic function of “download print”. “Download print” is an application for executing print processing in the multi-function device 10 using image data downloaded from the service selected in S933.

When the operation of selecting the button image B41 or B42 is performed in the multi-function device 10, the CPU 22 transmits basic function identification information indicating the basic function corresponding to the selected button to the mediation server 60 in S941. An example of the basic function identification information is “scan upload” which is the name of the button image B41. That is, the basic function identification information may be information indicating the selected button. The basic function identification information may include device format information corresponding to the format of scan data output from the multi-function device 10. The device format information may be information indicating the default format described above.

  In S943, the CPU 72 of the mediation server 60 generates output format selection screen data. The output format selection screen is a screen for accepting selection of the format of output data. When the selected basic function is “scan upload”, the data uploaded to the service is output data. When the selected basic function is “download print”, the data downloaded by the multi-function device 10 is output data. It is. In S <b> 945, the CPU 72 transmits output format selection screen data to the multi-function device 10. In S947, the CPU 22 of the multi-function device 10 causes the display unit 14 to display an output format selection screen. The CPU 22 receives a format input by the user via the operation unit 12. Examples of formats include JPEG (Joint Photographic Experts Group), Office format, PDF, GIF (Graphics Interchange Format), and the like. In the output format selection screen, “no format conversion” may be selectable.

  When selection of the output format by the user is accepted, in S949, the CPU 22 transmits output format identification information for identifying the output format selected by the user to the mediation server. In S951, the CPU 72 of the mediation server 60 determines which basic function is selected based on the basic function identification information. In the case of “scan upload” (S951: scan upload), the process proceeds to S953. In S953, the CPU 72 of the mediation server 60 generates scan setting screen data for displaying the scan setting screen. The scan setting screen is a screen for accepting input of various scan settings (for example, the format, resolution, and color mode of scan data generated by the multi-function device 10).

In S <b> 955, the CPU 72 transmits scan setting screen data to the multi-function device 10. In S957, the CPU 22 of the multi-function peripheral 10 causes the display unit 14 to display a scan setting screen. The CPU 22 accepts input of various scan settings by the user via the operation unit 12.

  In S <b> 958, the CPU 22 transmits the scan setting information to the mediation server 60. The scan setting information is information indicating various settings by the user, and includes setting format information for identifying a setting format which is a format set by the user among scan data formats that can be generated by the multi-function device 10. You may go out. An example of the setting format information is an extension. Then, the process proceeds to S539 (see FIG. 3).

  On the other hand, if the CPU 72 of the mediation server 60 determines in S951 that “download print” is selected (S951: download print), the process proceeds to S31. In S <b> 31, the CPU 72 transmits data information request information to the content server 100. The data information request information is information for requesting data information. The data information is information for identifying each of a plurality of data stored in the selected content server. An example of the data information is a file name. When the content server 100 receives the data information request information from the mediation server 60, the content server 100 transmits the data information to the mediation server 60 in S33.

  In S34, the CPU 72 of the mediation server 60 generates data selection screen data for displaying the data selection screen 221 based on the data information received in S33. The data selection screen is a screen for allowing the user to select data to be downloaded. In S <b> 35, the CPU 72 transmits the data selection screen data to the multi-function device 10.

  When receiving the data selection screen data from the mediation server 60, the CPU 22 of the multi-function device 10 displays the data selection screen on the display unit 14 in S37. And CPU22 receives the process which selects selection data from the some data memorize | stored in the content server 100. FIG. The selection data is data selected as a download target from the content server 100. The CPU 22 may accept processing for selecting a plurality of selection data. The user operates the operation unit 12 to select a button image for accessing data to be downloaded from the data selection screen. The button image displayed including the image data file name is an example of a button image for accessing data to be downloaded. The button image may be displayed including a thumbnail of image data corresponding to the button.

  In S <b> 41, the CPU 22 of the multi-function device 10 transmits data selection instruction information corresponding to the button image selected by the user to the mediation server 60. The data selection instruction information is information for identifying selection data. In the example of the present embodiment, information indicating that data corresponding to the button image B21 has been selected is transmitted. The data selection instruction information may be described in a URL (Uniform Resource Locator) description method.

  In S <b> 53, the CPU 72 of the mediation server 60 transmits data detail information request information for requesting data detail information to the content server 100. Examples of the detailed data information include an extension indicating the format of the selected data, a data update date, a data size, and the like.

  In S <b> 55, the CPU 72 receives detailed data information from the content server 100. When there are a plurality of selection data selected in S37, all the detailed data information for each of the plurality of selection data is received.

  In S <b> 73, the CPU 72 of the mediation server 60 transmits download source URL request information to the content server 100. The download source URL request information is information for requesting a download source URL for accessing the selection data identified by the data selection instruction information received in S41. When the content server 100 receives the download source URL request information from the mediation server 60, the content server 100 first refers to the data storage area 101 and specifies the download source URL for accessing the selection data specified by the download source URL request information. To do. In S <b> 75, the content server 100 transmits the specified download source URL to the mediation server 60.

  In S <b> 79, the CPU 72 of the mediation server 60 transmits download request information to the content server 100. The download request information includes the download source URL acquired in S75. The download request information is information for requesting the content server 100 to transmit selection data specified by the download source URL. In S <b> 81, the content server 100 transmits the selection data specified by the download source URL to the mediation server 60.

  In S93 to S101, processing for accepting selection of a processing process is performed. Since the contents of each process of S93, S95, S97, and S101 are the same as the contents of each process of S539, S541, S543, and S544 described above, the description thereof is omitted here.

  In S102, the CPU 72 of the mediation server 60 executes module designation processing. The contents of the module designation process are the same as the contents described above in S559, and thus description thereof is omitted here.

In S111 to S117, upload execution processing is performed in which the selection data acquired from the content server in S81 is uploaded to a data processing server that performs data processing. The contents of each process of S111, S113, S115, and S117 are the above-described S573, S575, and S583 except that the target data is selection data and the selection data is transmitted from the mediation server 60. , S585 is the same as the contents of each process, and the description is omitted here. The upload execution process (S111 to S117) may be performed with the second data processing server 300. Then, in order to cause the data processing server to process the selected data, the process proceeds to S619 (see FIG. 4).

(First operation example)
A specific example of the first operation will be described. As an example, “enclose copy” is selected on the application selection screen displayed in S521 (see FIG. 2), and “monochrome processing” and “watermark processing” are selected on the processing selection screen displayed in S543 (see FIG. 3). The case where “” is selected will be described. A case will be described in which the data output from the multi-function device 10 is in JPEG format and each processing module is compatible with the JPEG format.

  The result of the module designation process performed in S559 (see FIG. 3) will be described. Since “enclose copy” is selected from the application functions (FIG. 10, S1112: YES), the module identification information of the enclosing process module 381 is temporarily stored (FIG. 10, S1116). Further, it is determined that the format conversion process of the image data is not necessary (FIG. 10, S1120: NO). The image processing function is selected (FIG. 10, S1128: YES), and the JPEG format that is the format of the upload data output from the multi-function device 10 is any of the monochrome processing module 281 and the watermark processing module 283. Therefore, the module identification information of the monochrome processing module 281 and the module identification information of the watermark processing module 283 are temporarily stored (S1132).

  A rearrangement process of the temporarily stored module identification information is performed (S1144), and the module identification information of the processing module 381 is stored at the head of the FIFO memory. Next, module identification information is stored in the FIFO memory in the order of the monochrome processing module 281 and the watermark processing module 283 in accordance with the priority order table TB1 (see FIG. 11). Then, parameter information is created (S1148).

The mediation server 60 determines that the scan data generated by the multi-function device 10 is to be processed by the data processing server based on the FIFO memory or the parameter information (S572: YES). Then, the multi-function device 10 is caused to transmit scan data to the second data processing server 300 including the processing module 381 (FIGS. 3 and 4, S573 to S589), and the first data processing request information is changed to the first data processing request information. 2 Transmit to the data processing server 300 (FIG. 4, S619 to S621). The first data processing request information includes information for identifying the marker portion data in the scan data and instructing to perform trimming processing or selective erasing processing based on the marker. Next, the mediation server 60 acquires the processing data processed by the surrounding processing module from the second data processing server 300 (FIG. 4, S631 to FIG. 5, 665), and the processing order is the second monochrome processing module. Using the 281 and the third watermark processing module 283, the first data processing server 200 is caused to transmit the second data conversion request information instructing the processing data to be monochrome processed and watermark processed (see FIG. 5, S673-721). When monochrome processing and watermark processing are sequentially executed and completed (FIG. 5, S721 to S751), the mediation server 60 acquires processing data from the first data processing server 200 (S665).

  Since the data output destination is the multi-function device 10 (FIG. 5, S752: YES), the mediation server 60 causes the multi-function device 10 to acquire the processing data from the first data processing server 200 (FIG. 6, S753-). S765). Then, the multi-function device 10 acquires the processing data subjected to the surrounding processing, monochrome processing, and watermark processing from the first data processing server 200 (FIG. 7, S853 to S855), and prints the acquired processing data ( FIG. 6, S767).

(Second operation example)
A specific example of the second operation will be described. As an example, it differs from the first operation example in that “enclosed scan” is selected on the application selection screen displayed in S521 (see FIG. 2). In the second specific operation example, processing is performed by being surrounded by the second data processing server 300, monochrome processing and watermark processing are sequentially executed by the first data processing server 200, and the first operation is completed until the processing is completed. It is the same as a specific example. In the second specific operation example, since the data output destination is the content server 100 (FIG. 5, S752: NO), the mediation server 60 receives the processing data subjected to the surrounding processing, monochrome processing, and watermark processing. 1 acquired from the data processing server 200 (FIG. 7, S853 to S855), and the acquired processing data is saved and uploaded to the content server 100 (FIG. 7, S857 to S869).

(Third example of operation)
A specific example of the third operation will be described. As an example, a case where “basic function” is selected on the main screen displayed in S510 (see FIG. 2) and “download print” is selected on the basic function selection screen displayed in S939 (see FIG. 8) will be described. To do. Further, a case will be described in which Office format content data is selected as download target selection data on the data selection screen displayed in S37 (see FIG. 9). Further, a case will be described in which “Nin1 processing” and “watermark processing” are selected on the processing selection screen displayed in S97 (see FIG. 9). A case will be described in which the multi-function device 10 cannot decode Office format data. A case will be described in which the Nin1 processing module 282 and the watermark processing module 283 cannot process Office format data but can process JPEG format data.

The result of the module designation process performed in S102 (see FIG. 9) will be described. The application function is not selected (FIG. 10, S1112: NO). Since “download print” of the basic function is selected and the format of the selected data is Office format, it is determined that the format conversion processing of the image data is necessary (FIG. 10, S1120: YES), and “Office print” is supported. Module identification information of the Office to JPEG conversion module 292 to be stored is temporarily stored. The image processing function is selected (FIG. 10, S1128: YES), and the JPEG format, which is the processing data format processed by the Office to JPEG conversion module, is one of the Nin1 processing module 282 and the watermark processing module 283. is determined to be in a format also it can process: since (S1136 YES), Nin1 processing module 28 second module identification information, and the module identification information of the watermark processing module 283 is temporarily stored (S1132).

  The reordering process of the temporarily stored module identification information is performed (S1144), and the module identification information of the Office to JPEG module 292 is stored at the head of the FIFO memory. Next, module identification information is stored in the FIFO memory in the order of the Nin1 processing module 282 and the watermark processing module 283 in accordance with the priority order table TB1 (see FIG. 11). Then, parameter information is created (S1148).

  When the parameter information is created by the module specifying process, the mediation server 60 uses the selection data acquired from the content server 100 (FIG. 9, S53 to S81) as the Office to JPEG module 292, the Nin1 processing module 282, and the watermark. The selected data is transmitted using the Office to JPEG module 292, the Nin1 processing module 282, and the watermark processing module 283, which is transmitted to the first data processing server 200 including the processing module 283 (FIG. 9, S111 to S117). First data processing request information for instructing JPEG conversion, Nin1 processing, and watermark processing is transmitted to the first data processing server 200 (FIG. 4, S619 to S621). JPEG conversion, Nin1 processing, and watermark processing are executed in order and completed (S651).

  Since the data output destination is the multi-function device 10 (FIG. 5, S752: YES), the mediation server 60 causes the multi-function device 10 to acquire the processing data from the first data processing server 200 (FIG. 6, S753-). S765). Then, the multi-function device 10 acquires processing data that has been subjected to JPEG conversion, Nin1 processing, and watermark processing from the first data processing server 200, and prints the acquired processing data (S767 in FIG. 6).

(Fourth operation example)
A specific example of the fourth operation will be described. As an example, a case where “basic function” is selected on the main screen displayed in S510 (see FIG. 2) and “scan upload” is selected on the basic function selection screen displayed in S939 (see FIG. 8) will be described. To do. Further, a case will be described in which “no format conversion” is selected on the output format selection screen displayed in S947 (see FIG. 8). A case will be described in which the GIF format is selected as the setting format on the scan setting screen displayed in S957 (see FIG. 8). A case will be described in which “monochrome processing” and “Nin1 processing” are selected on the processing selection screen displayed in S97 (see FIG. 9). Further, also, both monochrome processing module 281 and Nin1 processing module 2 82 can not process the data in GIF format, a case capable of processing the data in the JPEG format.

The result of the module designation process performed in S102 (see FIG. 9) will be described. The application function is not selected (FIG. 10, S1112: NO). Since the basic function “scan upload” is selected and the conversion of the output format is not selected, it is determined that the format conversion process of the image data is unnecessary (FIG. 10, S1120: NO). Processing function of the image have been selected (Fig. 10, S1128: YES), GIF format is set format, at least one of the monochrome processing module 281 and Nin1 processing module 2 82 is determined not to be a format that can be processed ( S1136: NO), the module identification information of the unified format conversion module 294 is temporarily stored (S1140), the module identification information of the monochrome processing module 281 and the module identification information of the Nin1 processing module 282 are temporarily stored. (S1132).

  The rearrangement process of the temporarily stored module identification information is performed (S1144), and the module identification information of the unified format conversion module 294 is stored at the head of the FIFO memory. Next, module identification information is stored in the FIFO memory in the order of the monochrome processing module 281 and the Nin1 processing module 282 in accordance with the priority order table TB1 (see FIG. 11). Then, parameter information is created (S1148).

  When the parameter information is created by the module specifying process, the mediation server 60 uses the selection data acquired from the content server 100 (FIG. 9, S53 to S81) as the Office to JPEG module 292, the Nin1 processing module 282, and the watermark. The selected data is transmitted using the Office to JPEG module 292, the Nin1 processing module 282, and the watermark processing module 283, which is transmitted to the first data processing server 200 including the processing module 283 (FIG. 9, S111 to S117). First data processing request information for instructing JPEG conversion, Nin1 processing, and watermark processing is transmitted to the first data processing server 200 (FIG. 4, S619 to S621). JPEG conversion, Nin1 processing, and watermark processing are executed in order and completed (S651). Thereafter, unified format conversion, monochrome processing, and Nin1 processing are executed in order in the first data processing server 200. Then, the mediation server 60 acquires processing data from the first data processing server 200 (FIG. 7, S853 to S855), and saves and uploads the acquired processing data to the content server 100 (FIG. 7, S857 to S869).

(Fifth operation example)
A specific example of the fifth operation will be described. As an example, the point that “Office format” is selected on the output format selection screen displayed in S947 (see FIG. 8) is different from the first specific operation example. In the fifth specific operation example, unified format conversion, monochrome processing, watermark processing, and JPEG to Office conversion are sequentially executed by the first data processing server 200. Then, the mediation server 60 acquires processing data from the first data processing server 200 (FIG. 7, S853 to S855), and saves and uploads the acquired processing data to the content server 100 (FIG. 7, S857 to S869).

(effect)
According to the mediation server 60 described in the present specification, various types of data processing for the data output from the multi-function device 10 or the content server are included in the first data processing server 200 and the second data processing server 300. This module can be executed. As a result, various types of processing that cannot be executed by the multi-function device 10 (eg, monochrome processing, surrounding processing, format change processing, etc.) and various format changes that cannot be executed by the multi-function device 10 are performed. Processing (for example, changing processing from the Office format to the JPEG format, etc.) can be executed. Therefore, processing of uploading data in a format that cannot be decoded and generated by the multi-function device 10 from the multi-function device 10 to the server device, or downloading data in a format that cannot be deciphered by the multi-function device 10 from the server device. It is possible to execute processing for printing.

  According to the mediation server 60 described in this specification, when both the processing process and the format change process are executed on data, the processing module is performed so that the processing process is performed before the format change process. The format change module is designated (S1132, S1124). This makes it possible to reduce the number of data formats that need to be handled by the processing module.

  According to the mediation server 60 described in this specification, when the format of data that causes the processing module to execute processing is a format that cannot be processed by the processing module (S1136: N), the data format Is converted into a unified format that can be processed by the processing module, and is executed by the unified format conversion module 294 (S1140). This makes it possible to reduce the number of data formats that need to be handled by the processing module.

  According to the mediation server 60 described in the present specification, when a plurality of processing processes are sequentially executed on one data, it can be executed in accordance with the priority order stored in the priority order table TB1 ( S1144). Thereby, for example, since it is possible to first perform processing with a high reduction rate of the data amount before and after the processing, it is possible to execute the next processing in a state where the data amount is reduced, The processing load of the processing process can be reduced.

  According to the mediation server 60 described in this specification, the first data processing server 200 outputs the data (S583) to execute the first processing, and the data after the first processing is subjected to the first data processing. It can be acquired from the server 200 (S665). Next, the data after the first processing is output to the second data processing server 300 (S683), the second processing is executed, and the data after the second processing is sent to the multi-function device 10 as the second data processing server. It can be acquired from 300 (S755). Thereby, it is possible to cause each of the first data processing server 200 and the second data processing server 300 to sequentially execute the processing.

  According to the mediation server 60 described in this specification, during the execution period of various processes, a standby command for waiting for the completion of the processes can be transmitted to the multi-function device 10 (S637). Therefore, it is possible to prevent a situation in which an error such as a timeout occurs in the multi-function device 10.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. For example, the following modifications are included.

(Modification)
There may be three or more data processing servers. For example, when each of N data processing servers (N is a natural number greater than or equal to 2) is executed in order, the processing data processed by the (N−1) th data processing server is changed to the Nth data processing server. What is necessary is just to pass to a data processing server. Then, in accordance with completion of data processing in the last data processing server, the processed data may be output to the multi-function device 10 or the content server.

  The process of designating the unified format conversion module 294 as an execution target module (S1140) can be omitted. In this case, S1136 and S1140 may be omitted, and the process may proceed from S1128 to S1132. Further, the rearrangement process (S1144) can be omitted. In this case, S1144 may be omitted and the process may proceed from S1124 to S1148. The process of transmitting a standby command to the multi-function device 10 (S637) can be omitted. In this case, S635 to S641 may be omitted, and the process may return from S633 to S631. From the above, generally speaking, the mediation server 60 only needs to include at least a “first acquisition unit”, a “data processing unit”, and a “second acquisition unit”. As a specific example, the multi-function device 10 may execute at least S102, S204, and S344.

  If any of the basic processing modules cannot process JPEG data, the CPU 72 may process as follows in S1136. First, the execution order between the basic processing modules is determined so as to follow the priority order stored in the priority order table TB1. For example, if one of the application functions is selected and the basic processing module with the first execution order can process only bitmap format data, a conversion module that converts JPEG format data to bitmap format data The identification information is stored as identification information of the unified format conversion module. In this case, in S1144, the CPU 72 changes the execution order of the execution target modules in the order of one of the application processing modules, a conversion module that converts JPEG format data into bitmap format data, and a basic processing module.

  The first data processing server 200 and the second data processing server 300 may include various conversion modules. For example, a conversion module that converts Office format data into PDL (abbreviation of Page Description Language) format may be provided as a module corresponding to “Office printing”. In addition, as a module corresponding to “PDF printing”, a conversion module for converting PDF data into PDL format may be provided.

  The application function of “enclosed scan” may include various functions. For example, a preview image based on the scan data may be displayed on the multi-function device 10, and designation of the selection range may be received by touch panel input to the displayed preview image. Then, the first data processing server 200 or the like may execute various types of processing on the image within the selection range.

  In the application selection screen 211 illustrated in FIG. 13, not only application selection but also various processing selections may be received. For example, the application selection screen 211 may display buttons corresponding to “Office conversion upload”, “PDF conversion upload”, “Office download print”, and “PDF download print”. If any one of “Office conversion upload”, “PDF conversion upload”, “Office download print”, and “PDF download print” is selected, the CPU 72 determines in S532 that the basic function has been selected again. May be. And you may make it progress to S929.

  The application function may include a processing download application function. The processing download application function is a function that causes the processing module to execute monochrome processing, Nin1 processing, and other processing on the content data stored in the service server and download the processed image data to the multi-function device 10. is there. Specifically, when the application function selected in S518 to S531 in FIG. 2 is the processing download application function, the same processing as S533 to S537 in FIG. 2 may be performed to allow the user to select a service. After the user selects a service, the same processing as S31 to S41 in FIG. 9 is performed, and the mediation server 60 may acquire the content data. The content data may be processed by the data processing module corresponding to the processing download application function in the same procedure as S619 to S651 of FIG. 4 or S719 to S751 of FIG. What is necessary is just to make the multi-function device 10 acquire the processed processing data in the same procedure as S753 to S765 of FIG.

  S539 to S544 may be omitted. In this case, in the module designation processing in S559, the processing for selecting the module corresponding to “monochrome processing”, “Nin1 processing”, and “watermark processing” is not executed.

  The data processing upload destination URL transmitted by the CPU 72 to the multi-function device 10 in S579 is not limited to the URL of the data processing server. For example, it may be a URL of a storage medium accessible by the data processing server.

  In S619, even if module identification information of modules included in the same data processing server is continuously stored in the FIFO memory, only the module having the module identification information stored at the head of the FIFO memory is requested to execute the process. May be.

  The processing of S943 to S949 may be executed only during “scan upload”. In this case, in “download printing”, the output data format may be the JPEG format.

  Although the case where the content servers 100 and 110 are connected to the Internet 6 has been described in the present embodiment, three or more content servers may be connected to the Internet 6.

  In the present embodiment, the case has been described in which the CPUs 22, 72, 272, and 372 of the multi-function device 10, the mediation server 60, the first data processing server 200, and the second data processing server 300 execute processing according to software. Not limited to. At least a part of the functions realized according to the software may be realized by hardware such as a logic circuit.

  The multi-function device 10 is an example of an image processing apparatus. The content servers 100 and 110 are examples of server devices. The mediation server 60, or the mediation server 60, the first data processing server 200, and the second data processing server 300 are examples of relay devices. The CPU that executes S544 and S51 is an example of a first acquisition unit and a first acquisition step. The CPU that executes S559, S619, and S52 is an example of data processing means and data processing steps. The CPU that executes S861 and S765 is an example of a second acquisition unit and a second acquisition step. The first data processing server 200 and the second data processing server 300 are an example of a plurality of conversion devices. The CPU that executes S863 is an example of upload result information acquisition means. The CPU that executes S867 is an example of a determination result output unit.

  10: Multi-function device, 22, 72, 272, 372: CPU, 60: Mediation server, 100 and 110: Content server, 200: First data processing server, 300: Second data processing server

Claims (11)

A relay device that can be connected to an image processing device and a server device via a network,
The relay device includes a mediating module that can be connected to the image processing device and the server device via the network, and a computer that functions as a plurality of types of processing modules that execute each of a plurality of types of data processing. Prepared,
A computer functioning as the mediation module is
Data processing executed on output data that is image data output from the image processing device or the server device, wherein at least one type selected from the plurality of types of data processing in the image processing device First acquisition means for acquiring, from the image processing apparatus, process identification information for identifying selection data processing that is data processing of
Selecting means for selecting a selection processing module that is a processing module capable of executing the selection data processing from the plurality of types of processing modules;
Output data acquisition means for causing the computer functioning as the selection processing module to acquire the output data to be subjected to the selection data processing;
Instruction means for instructing a computer functioning as the selection processing module to execute the selection data processing on the output data;
Function as
A computer functioning as the selection processing module functions as selection data processing means for executing the selection data processing instructed by the computer functioning as the mediation module;
When the computer functioning as the mediation module outputs the output data from the image processing device, data generated by executing the selection data processing on the output data by the computer functioning as the selection processing module And when the output data is output from the server device, the server device functions as a second acquisition unit that causes the image processing device to acquire the processing data .
The instruction means is the first data generated by the data processing that can be executed by the image processing device, the output data output from the image processing device, and the processing generated by the selection data processing When the data is second data generated by data processing that cannot be executed by the image processing device, or when the output data is third data that cannot be decoded by the image processing device, the selection data processing A relay apparatus that instructs a computer functioning as the selection processing module to execute For the multiple types of data processing,
Processing for generating processed image data, which is image data for forming an image whose contents are processed with respect to an image formed based on the output data, based on the output data;
A format change process for changing the format of the output data, and
The plurality of types of processing modules include
A processing module for executing the processing,
A format change processing module for executing the format change processing, and
In the case where the processing is included in the selection data processing, the instruction unit selects the selection processing module so that the processing module is included in the selection processing module, and the selection data processing includes the selection processing module. If the format changing process is included, the relay device according to claim 1, characterized by selecting said selection processing module to include the selected processing format change processing module to module. A determination process for determining whether or not the format of the output data is a format that cannot be processed by a computer functioning as the processing module when the selection data processing includes the processing;
When the determination process determines that the format of the output data is a format that cannot be processed by a computer functioning as the processing module, the processing module is executed after the format change processing module is executed. First information storage processing for storing first information in a memory of the relay device;
When the determination process determines that the format of the output data is a format that can be processed by a computer functioning as the processing module, second information indicating that the processing module is executed is sent to the relay device. A second information storage process to be stored in the memory;
And the computer functioning as the mediation module further functions,
In the instruction means,
When the first information is stored in the memory, it instructs a computer functioning as the format change processing module to acquire the output data, and further processes the processed image data processed by the format change processing module. Instructing a computer functioning as the processing module to process,
The relay apparatus according to claim 2 , wherein when the second information is stored in the memory, the computer is instructed to acquire the output data to a computer functioning as the processing module. If the format of the output data that causes the computer that functions as the processing module to execute the processing is a format that cannot be processed by the computer that functions as the processing module, the instruction means performs the processing before the processing. 3. The computer functioning as the format change processing module is instructed to execute a format conversion process for converting the format of the output data into a format that can be processed by a computer functioning as the processing module. The relay device described. In the case where the selection data processing includes the processing processing and the format change processing, the instruction means
When the format of the output data is a format that cannot be processed by a computer that functions as the processing module, a format conversion process that converts the format of the output data into a format that can be processed by a computer that functions as the processing module Instructing a computer functioning as the format change processing module to instruct execution, instructing a computer functioning as a processing processing module to execute the processing on data processed by the computer functioning as the format change processing module;
When the format of the output data is a format that can be processed by a computer that functions as the processing module, the computer that functions as the processing module is instructed to execute the processing on the output data, and the processing relay apparatus according to claim 3 or 4, wherein the instructing the execution of the format changing process to process image data processed by the computer functioning as a processing module to a computer to function as the format changing process module. The computer functioning as the mediation module further functions as storage control means for storing the priority order among the plurality of types of processing in the storage unit,
The instruction means has a plurality of processing modules for executing each of the plurality of selected processing processes in the selection processing module when there are a plurality of selected processing processes that are processing processes included in the selection data processing. The plurality of processing modules are selected so that each of the plurality of processing modules is executed one by one in the order according to the priority order. relay device according to any one of claims 2 to 5, characterized in that an instruction to each of the processing modules. The instruction means outputs a standby command for waiting for completion of the selection data processing to the image processing device during the execution period of the selection data processing,
The said 2nd acquisition means makes the said server data or the said image processing apparatus acquire the said process data according to the completion of the said selection data process, The any one of Claims 1-6 characterized by the above-mentioned. The relay device described. The computer functioning as the mediation module is
Upload result, which is information indicating whether or not the storage process of storing the processing data acquired by the second acquisition unit in the server apparatus in the server apparatus has been successful and is transmitted from the server apparatus Upload result information acquisition means for acquiring information,
Based on the obtained upload result information, it is determined whether or not the storage process is successful, and a determination result for outputting information for displaying the determination result on a display unit included in the image processing apparatus to the image processing apparatus Output means;
Relay device according to any one of claim 1 to 7, characterized in that further functions to. A program readable by a relay device that can be connected to an image processing device and a server device via a network,
The relay device includes a mediating module that can be connected to the image processing device and the server device via the network, and a computer that functions as a plurality of types of processing modules that execute each of a plurality of types of data processing. Prepared,
A computer functioning as the mediation module;
Data processing executed on output data that is image data output from the image processing device or the server device, wherein at least one type selected from the plurality of types of data processing in the image processing device First acquisition means for acquiring, from the image processing apparatus, process identification information for identifying selection data processing that is data processing of
Selecting means for selecting a selection processing module that is a processing module capable of executing the selection data processing from the plurality of types of processing modules;
Output data acquisition means for causing the computer functioning as the selection processing module to acquire the output data to be subjected to the selection data processing;
Instruction means for instructing a computer functioning as the selection processing module to execute the selection data processing on the output data;
To function,
Causing the computer functioning as the selection processing module to function as selection data processing means for executing the selection data processing instructed by the computer functioning as the mediation module;
When the output data is output from the image processing apparatus to the computer functioning as the mediation module, the data generated by executing the selection data processing on the output data by the computer functioning as the selection processing module When the output data is output from the server device, the server device is caused to function as second acquisition means for causing the image processing device to acquire the processing data .
The instruction means is the first data generated by the data processing that can be executed by the image processing device, the output data output from the image processing device, and the processing generated by the selection data processing When the data is second data generated by data processing that cannot be executed by the image processing device, or when the output data is third data that cannot be decoded by the image processing device, the selection data processing program characterized that you instruction execution computer that functions as the selection process module. A control method for a relay device that can be connected to an image processing device and a server device via a network,
The relay device includes a mediating module that can be connected to the image processing device and the server device via the network, and a computer that functions as a plurality of types of processing modules that execute each of a plurality of types of data processing. Prepared,
The computer functioning as the mediation module is
Data processing executed on output data that is image data output from the image processing device or the server device, wherein at least one type selected from the plurality of types of data processing in the image processing device A first acquisition step of acquiring, from the image processing apparatus, process identification information for identifying selection data processing that is data processing of
A selection step of selecting a selection processing module that is a processing module capable of executing the selection data processing from the plurality of types of processing modules;
An output data acquisition step for causing the computer functioning as the selection processing module to acquire the output data to be subjected to the selection data processing;
An instruction step for instructing a computer functioning as the selection processing module to execute the selection data processing on the output data;
Run
The computer functioning as the selection processing module executes a selection data processing step of executing the selection data processing instructed by the computer functioning as the mediation module,
When the output data is output from the image processing apparatus, the computer functioning as the mediation module generates data generated by executing the selection data processing on the output data by the computer functioning as the selection processing module. And when the output data is output from the server device, a second acquisition step is performed to cause the image processing device to acquire the processing data .
In the instruction step, the output data output from the image processing device is first data generated by data processing that can be executed by the image processing device, and the processing generated by the selection data processing When the data is second data generated by data processing that cannot be executed by the image processing device, or when the output data is third data that cannot be decoded by the image processing device, the selection data processing To instruct a computer functioning as the selection processing module to execute the operation . The image processing apparatus, a server apparatus, the image processing apparatus and the capable of connecting via a network to a server apparatus the relay apparatus, a communication system comprising,
The relay device includes a mediating module that can be connected to the image processing device and the server device via the network, and a computer that functions as a plurality of types of processing modules that execute each of a plurality of types of data processing. Prepared,
The image processing apparatus includes:
Data processing executed on output data which is image data output from the image processing device or the server device, and is at least one type of data processing selected from the plurality of types of data processing. Accepting means for accepting selection of selection data processing;
Process identification information transmitting means for transmitting, to the relay device, process identification information for identifying the selection data process whose selection has been received by the reception means;
With
A computer provided in the relay device and functioning as the mediation module,
The process identification information, and the processing identification information receiving means for receiving from said image processing apparatus,
Selecting means for selecting a selection processing module that is a processing module capable of executing the selection data processing from the plurality of types of processing modules ;
And instruction means for instructing the execution of the selected data processing for the previous SL output data to the computer that functions as the selection processing module,
Function as
A computer that functions as the selection processing module , which is a computer included in the relay device , functions as selection data processing means for executing the selection data processing instructed by the computer that functions as the mediation module;
The image processing apparatus transmits the output data to the relay apparatus when the selection data processing whose selection is received by the receiving unit is data processing executed on output data output from the image processing apparatus. First output data transmission means for transmitting to
A computer provided in the relay device and functioning as the mediation module,
First output data acquisition means for receiving the output data transmitted from the image processing apparatus by the first output data transmission means and causing a computer functioning as the selection processing module to acquire the output data;
First processing data transmission means for transmitting processing data, which is data generated by executing the selection data processing on the output data by a computer functioning as the selection processing module in accordance with an instruction from the instruction means, to the server device When,
Function as
The server device includes first processing data receiving means for receiving the processing data transmitted from the relay device by the first processing data transmitting means,
The server device transmits the output data to the relay device when the selection data processing whose selection is accepted by the accepting unit is data processing executed on output data output from the server device. Second output data transmitting means for
A computer provided in the relay device and functioning as the mediation module,
Second output data acquisition means for receiving the output data transmitted from the server device by the second output data transmission means and causing a computer functioning as the selection processing module to acquire the output data;
Second processing data transmission means for transmitting the processing data, which is data generated by executing the selection data processing on the output data in accordance with an instruction from the instruction means, to the image processing apparatus ;
Function as
The image processing apparatus includes second processing data receiving means for receiving the processing data transmitted from the relay apparatus by the second processing data transmitting means,
The instruction means is the first data generated by the data processing that can be executed by the image processing device, the output data output from the image processing device, and the processing generated by the selection data processing When the data is second data generated by data processing that cannot be executed by the image processing device, or when the output data is third data that cannot be decoded by the image processing device, the selection data processing A computer that functions as the selection processing module .