JP2010278666A - Communication apparatus communicably connected to a plurality of image processing servers - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To quickly provide processed image data to a user. <P>SOLUTION: The user selects filter processing of a specific sort from a plurality of sorts of filter processing by operating an operation unit 16. A center server 50 determines two image processing servers 70, 90 from a plurality of image processing servers 70, 90, 92. A multifunction machine 10 generates two unprocessed divided image data by dividing selected image data 28 into two image data. The multifunction machine 10 transmits one different unprocessed divided image data to each of the image processing servers 70, 90. Each of the image processing servers 70, 90 generates processed divided image data by executing the filter processing of the specific sort for the unprocessed divided image data and transmits the processed divided image data to the multifunction machine 10. The multifunction machine 10 generates processed image data by merging the two processed image data. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing technique.

  For example, Patent Document 1 discloses a system including one image processing server and a plurality of communication devices. Each communication apparatus transmits image data to the image processing server and instructs the image processing server to execute image processing on the image data. When receiving the above instruction, the image processing server generates image data after processing by executing image processing, and transmits the processed image data to the communication device that is the transmission source of the above instruction.

JP 2003-283740 A

  It is required to quickly provide post-processing image data to the user of the communication device. The present specification provides a technique capable of quickly providing post-processing image data to a user.

  One technique disclosed in this specification is a communication device that is communicably connected to a central server and a plurality of image processing servers. Note that the central server may or may not be able to execute image processing. In the former case, the central server functions as a central server and also functions as an image processing server. This communication apparatus includes pre-processing image data acquisition means, selection permission means, information transmission means, schedule information acquisition means, division means, pre-processing image data transmission means, post-processing image data acquisition means, and combining means.

  The pre-processing image data acquisition means acquires first image data (which can be paraphrased as image data to be processed). Note that the pre-processing image data acquisition unit may acquire the first image data by receiving image data transmitted from an external device, for example. In addition, the pre-processing image data acquisition unit allows the user to select one image data from a plurality of image data stored in a storage unit or an external memory included in the communication device, for example, and selects the image data by the user. The first image data may be obtained by reading the processed image data. The selection permission unit allows the user to select a specific type of image processing from among a plurality of types of image processing. The information transmitting means transmits a specific request not including the first image data to the central server.

  The schedule information acquisition means includes a schedule including M pieces of position information corresponding to M (M is an integer of 2 or more) image processing servers determined by the central server from a plurality of image processing servers according to the specific request. Obtain information from a central server. The position information (including specific position information described later) is a concept that includes all information related to the position of the image processing server. Examples of location information include a URL (Uniform Resource Locator), an IP address, and the like. The central server may select, for example, M image processing servers having a smaller load than other image processing servers. For example, when selecting an image processing server that should execute a specific type of image processing, the central server is relatively good at executing the specific type of image processing. An image processing server that can execute the above-described specific type of image processing with a smaller load than other image processing servers may be selected. For example, the central server may randomly select M image processing servers. In addition, the central server may select M image processing servers in a predetermined order, for example. Although various methods for selecting an image processing server have been illustrated, the central server may use a combination of two or more of the various methods described above.

  The dividing means generates M pre-processed divided image data by dividing the first image data into M pieces. The pre-processing image data transmission unit transmits one different pre-processing divided image data to each of the M image processing servers corresponding to the M pieces of position information included in the schedule information. The post-processing image data acquisition means is configured such that each of the M image processing servers generates the M pieces of image data generated by executing the specific type of image processing on one different pre-processing divided image data. Obtain post-processing divided image data. The combining unit generates the second image data by combining the M post-process divided image data.

  According to the configuration disclosed in the present specification, a specific type of image processing selected by the user can be distributed and executed on two or more M image processing servers determined by the central server. In other words, the M image processing servers can jointly execute the specific type of image processing on the first image data. For this reason, compared with a configuration in which only one image processing server exists, post-processing image data can be generated quickly. As a result, the processed image data can be quickly provided to the user of the communication device.

  For example, a method (hereinafter referred to as a specific method) of transmitting the specific request including the first image data from the communication device to the central server when the communication device requests the central server for scheduling is considered. It is done. In this case, the central server generates M pre-processed divided image data by dividing the first image data into M pieces, and transmits the M pre-processed divided image data to the M image processing servers. Can do. However, in the case of the above-described specific method, the first communication processing for transmitting the first image data from the communication device to the central server, and the M pre-processed image data to the M image processing servers are transmitted from the central server. The second communication process is performed. On the other hand, in the above-described configuration disclosed in the present specification, the specific request transmitted when the communication apparatus requests the central server for scheduling does not include the first image data. That is, there is no need to execute communication processing for transmitting the first image data from the communication device to the central server, and communication processing for transmitting M pre-processed divided image data to the M image processing servers from the communication device is performed. It's enough. It is necessary to transmit M pieces of position information corresponding to M pieces of image processing servers from the central server to the communication device. small. Therefore, when the above-described configuration disclosed in this specification is used, communication time can be shortened as compared with the above-described specific method. As a result, it is possible to quickly provide the second image data, which is the processed image data, to the user of the communication device.

  The information transmission unit may transmit the specific request including size information (for example, the number of pixels in the horizontal direction and the number of pixels in the vertical direction) related to the size of the first image data to the central server. The schedule information acquisition means acquires first coordinate information for specifying M areas included in the first image data, and includes schedule information including the first coordinate information determined by the central server according to the size information. May be. The dividing unit may generate M pre-processed divided image data by dividing the first image data into M pieces according to the first coordinate information. According to this configuration, the communication device can divide the first image data into M pieces at positions determined by the central server.

  When a predetermined type of image processing is executed, the size of the image data changes before and after the image processing. That is, when the predetermined type of image processing is executed on the pre-processed divided image data, post-processed divided image data having a size different from that of the pre-processed divided image data is generated. An index is required for the communication apparatus to combine the M post-process divided image data whose size has changed from before the process. Therefore, the following configuration may be adopted.

  That is, the information transmitting unit may transmit the specific request further including the type information specifying the specific type of image processing selected by the user to the central server. The schedule information acquisition means is second coordinate information for specifying M areas in which M post-process divided image data should be arranged, and is determined by the central server according to the size information and the type information. Schedule information further including coordinate information may be acquired. The combining unit may generate the second image data by combining the M post-process divided image data according to the second coordinate information. According to this configuration, the communication apparatus can combine the M post-processed divided image data even when the size of the pre-processed divided image data and the size of the post-processed divided image data are different.

  For example, in a system in which there is only one image processing server, a communication session between the communication device and the image processing server is usually performed after the communication device requests the image processing server for image processing and acquires post-processing image data. Is maintained. While the communication session is established, the load on the image processing server increases. In order to reduce the load on the image processing server, the following configuration may be employed.

  In other words, the pre-processing image data transmission means communicates between the communication device and the image processing server when the pre-processing divided image data has been transmitted to the image processing server for each of the M image processing servers. You may disconnect the session. The post-processing image data acquisition unit may acquire M post-processing divided image data from the M image processing servers by transmitting a request to each of the M image processing servers.

  According to the above configuration, when the pre-processed divided image data has been transmitted to each of the M image processing servers, the communication session between the communication device and the M image processing servers is disconnected. Compared to a configuration in which a communication session between the communication device and the M image processing servers is maintained until the communication device acquires post-processing image data, the load on the image processing server is reduced. Can do. In addition, the communication apparatus can acquire post-processed divided image data from each of the M image processing servers by transmitting a request to each of the M image processing servers.

  The selection permission unit may allow the user to sequentially select N types (N is an integer of 2 or more) of image processing from among a plurality of types of image processing. In this case, the specific type of image processing is the N types of image processing. The post-processing image data acquisition means is configured so that each of the M image processing servers performs M post-processing generated by sequentially executing N types of image processing on different one pre-processing divided image data. Divided image data may be acquired.

  The communication apparatus may further include a post-processing partial data acquisition unit and a first display control unit. The post-processing partial data acquisition means divides the reduced image data of the first image data into M pieces at a position corresponding to the division position for dividing the first image data into M pieces, so that M pre-processing pieces are obtained. When partial data is generated, N post-processing partial data generated by sequentially executing N types of image processing on the pre-processing partial data for each of the M pre-processing partial data. You may get it. In this case, the post-processing partial data acquisition means acquires M × N post-processing partial data in total. Note that the term “divide the reduced image data of the first image data into M pieces at a position corresponding to the division position for dividing the first image data into M pieces” is, for example, M processes. In other words, the reduced image data of the first image data is divided into M so that the pre-divided image data and the M pre-process partial data have a similar relationship. The subject that generates the “M pre-processing partial data” may be a communication device, a central server, an image processing server, It may be a device. The subject that generates the “M × N post-processing partial data” may be a communication device, a central server, an image processing server, Other devices may be used. The first display control means may display M × N post-processing partial data on the display means. According to this configuration, the user can view M × N post-processing partial data. As a result, the user can know how N types of image processing are sequentially performed on each of the M pre-process divided image data.

  The communication apparatus may further include, for each of the M image processing servers, a timing information acquisition unit that acquires timing information regarding each end timing of the N types of image processing executed by the image processing server. In this case, for each of the M image processing servers, the first display control means performs N processing by the image processing server so as to synchronize with the end timing of each of the N types of image processing executed by the image processing server. N pieces of post-processing partial data generated from pre-processing partial data corresponding to different one pre-processing divided image data that should be subjected to different types of image processing may be displayed in order on the display means. Note that the following description may be further added to the “pre-process partial data corresponding to one different pre-process divided image data”. That is, the position in the first image data of the different one pre-processed divided image data is the same as the position in the reduced image data of the first image data of the pre-process partial data.

The above-mentioned “first display control means... Display N processed partial data in order on the display means in order to synchronize” is rephrased as (1) or (2) below, for example: May be.
(1) For each of the M image processing servers, the first display control means sets the end timing of one type of image processing among the end timings of the N types of image processing executed by the image processing server. Each time it arrives, one piece of processed partial data generated by the one kind of image processing is displayed on the display means.
(2) For each of the M image processing servers, the first display control means sets the end timing of one type of image processing among the end timings of the N types of image processing executed by the image processing server. Each time it arrives, one piece of post-processing partial data generated by the image processing to be executed next to the one type of image processing is displayed on the display means.

  According to the configurations (1) and (2) above, the post-processing partial data corresponding to the image data actually generated by each image processing is displayed at the timing when each image processing server finishes each image processing. . The user can know how each image processing is executed in each image processing server.

  When the above-described M × N post-processing partial data is generated by the image processing server, the following configuration may be employed. That is, the schedule information acquisition unit may acquire schedule information further including specific position information corresponding to a specific image processing server for generating M × N post-processing partial data. The communication apparatus may further include reduced image data transmission means for transmitting the reduced image data of the first image data to the specific image processing server corresponding to the specific position information included in the schedule information. . The post-processing partial data acquisition unit may acquire M × N post-processing partial data from the specific image processing server.

  The communication apparatus may further include processing time information acquisition means, printing means, and second display control means. The processing time information acquisition unit acquires, for each of the M image processing servers, processing time information related to the processing time predicted to be necessary for the image processing server to execute the specific type of image processing. May be. The printing unit may print the second image data. The second display control means includes the largest processing time among the processing times of the M image processing servers, a printing time estimated to be necessary for the printing means to print the second image data, The display time that is the sum of the above may be displayed on the display means while counting down. According to this configuration, the user can know the remaining time until the result of printing the second image data is obtained.

  The second display control unit displays the display time when the display time when the post-processing image data acquisition unit acquires the last post-processing divided image data of the M post-processing divided image data does not match the printing time. Instead of this, the printing time may be displayed on the display means, and the printing time may be displayed on the display means while counting down. According to this configuration, the remaining time can be corrected when the actual remaining time (that is, the printing time) when the final post-process divided image data is acquired is different from the display time. The user can know a more accurate remaining time.

  Note that a control method and a computer program for realizing the communication apparatus are also novel and useful. A control method and a computer program for realizing the central server are also novel and useful. A control method and a computer program for realizing the image processing server are also new and useful. An image processing system including the communication device, the central server, and the plurality of image processing servers is also new and useful. The central server includes load information acquisition means for acquiring information related to the loads of the plurality of image processing servers, and N image processes whose loads at the time when the specific request is received are smaller than those of other image processing servers. Image processing server determining means for determining a server. According to this configuration, the central server can determine an image processing server with a relatively small load.

1 shows an example of the configuration of an image processing system. An example of a server table is shown. The sequence diagram of the process which each device performs is shown. FIG. 4 shows a sequence diagram continued from FIG. 3. FIG. 5 shows a sequence diagram continued from FIG. 4. An example of a processing table is shown. An example of a filter table is shown. A mode that a filter process is performed with respect to image data is shown. 3 shows a flowchart of main processing executed by the multi-function device. FIG. 10 is a flowchart continued from FIG. 9. FIG. 6 shows a flowchart of a display update thread executed by the multi-function device. An example of the screen displayed on a display part is shown.

(System configuration)
Embodiments will be described with reference to the drawings. FIG. 1 shows a schematic diagram of an image processing system 2 of the present embodiment. The image processing system 2 includes the Internet 4, a plurality of multi-function devices 10, 40, a central server 50, a plurality of image processing servers 70, 90, 92, and the like. A plurality of multi-function devices 10, 40, a central server 50, and a plurality of image processing servers 70, 90, 92 are connected to the Internet 4. The devices 10, 40, 50, 70, 90, and 92 can communicate with each other via the Internet 4.

(Configuration of multi-function device 10)
The configuration of the multi-function device 10 will be described in detail. The multi-function device 40 has the same configuration as the multi-function device 10. The multi-function device 10 includes a control unit 12, a display unit 14, an operation unit 16, a USB interface 18, a network interface 20, a printing unit 22, a storage unit 24, and the like. The control unit 12 executes processing according to the program 36 stored in the storage unit 24. The display unit 14 displays various information. The operation unit 16 includes a plurality of keys. The user can input various instructions to the multi-function device 10 by operating the operation unit 16. A USB memory (not shown) or the like is connected to the USB interface 18. The network interface 20 is connected to the Internet 4. The printing unit 22 prints image data.

  The storage unit 24 has a work area 26. The work area 26 stores data generated in the process in which the control unit 12 executes processing. The work area 26 stores, for example, selected image data 28, selected image thumbnail data 32, and the like. The selected image data 28 is image data that is an object of filter processing (image processing). In this embodiment, the selected image data 28 is selected by the user from a plurality of image data stored in the USB memory. The selected image thumbnail data 32 is image data representing an image corresponding to the selected image data 28 and is image data having a data size smaller than that of the selected image data 28. The selected image thumbnail data 32 may be generated from the selected image data 28 by the multi-function device 10 or may be stored in advance in a USB memory. The storage unit 24 stores a program 36 to be executed by the control unit 12. The storage unit 24 further includes a storage area 38 for storing information other than the information 28 to 36 described above.

(Configuration of central server 50)
Next, the configuration of the central server 50 will be described. The central server 50 includes a control unit 52, a network interface 54, a storage unit 56, and the like. The control unit 52 executes processing according to the program 62 stored in the storage unit 56. The network interface 54 is connected to the Internet 4.

  The storage unit 56 stores a function list 58. The function list 58 includes names and filter IDs of a plurality of types of filter processes that can be executed by the image processing servers 70, 90, and 92. Note that the image processing servers 70, 90, and 92 according to the present embodiment can execute a plurality of types of filter processing such as skin color correction, trimming, blurring, and red-eye correction. Therefore, the function list 58 includes the name of the filter process (skin color correction, etc.) and the filter ID (“1”, “2”, etc.) for each of a plurality of types of filter processes. The storage unit 56 has a work area 60. The work area 60 stores data generated in the process in which the control unit 52 executes processing. The storage unit 56 stores a program 62 to be executed by the control unit 52. The storage unit 56 stores a server table 64. The storage unit 56 further includes a storage area 66 for storing information other than the information 58, 62, and 64 described above.

  FIG. 2 shows an example of the server table 64. The server table 64 includes a plurality of combination information 100, 102, and 104. One combination information corresponds to one image processing server. In this embodiment, the combination information 100 corresponds to the image processing server 70, the combination information 102 corresponds to the image processing server 90, and the combination information 104 corresponds to the image processing server 92. Each combination information 100, 102, 104 is information in which the server URL 106, the reference processing time 108, and the load value 110 are associated with each other. The server URL 106 is the URL of the image processing server. The reference processing time 108 is a reference processing time for the image processing server to execute the filter processing corresponding to each filter ID. The reference processing time is a time required for the image processing server to execute image processing on image data of a predetermined size when the load value of the image processing server is a predetermined value. For example, in the combination information 100, t11 is set as the reference processing time for the image processing server 70 to execute the filter processing corresponding to the filter ID “1”, and the image processing server 70 corresponds to the filter ID “2”. T21 is set as a reference processing time for executing the filtering process. Even in the case of filter processing corresponding to the same filter ID, the reference processing time 108 of each image processing server 70, 90, 92 may be different. For example, t11, t12, and t13 shown in FIG. 2 are different values. That is, each of the image processing servers 70, 90, and 92 is capable of performing good filter processing (filter processing that can be performed faster than other image processing servers) and poor filter processing (other image processing servers can perform faster). It can be said that it has a filtering process. The load value 110 is a value related to the load of the image processing server. The load value 110 may be, for example, the current processing load (for example, benchmark speed) of the CPU, the remaining capacity of the work memory, or information on a combination thereof. The central server 50 periodically acquires load values from the image processing servers 70, 90, and 92 and updates the load value 110 of the server table 64. The server URL 106 and the reference processing time 108 in the server table 64 are information that is set in advance and are not information that should be updated.

(Configuration of Image Processing Server 70)
Next, the configuration of the image processing server 70 will be described with reference to FIG. Note that the image processing servers 90 and 92 have the same configuration as the image processing server 70. The image processing server 70 includes a control unit 72, a network interface 74, a storage unit 76, and the like. The control unit 72 executes processing according to the program 80 stored in the storage unit 76. The network interface 74 is connected to the Internet 4. The storage unit 76 has a work area 78. The work area 78 stores data generated in the process in which the control unit 72 executes processing. The storage unit 76 stores a program 80 to be executed by the control unit 72. The program 80 includes a program for executing a plurality of types of filter processing. The storage unit 76 further includes a storage area 82 for storing information other than the information 80 described above.

(Processes executed by each device 10, 50, 70, 90, 92)
Subsequently, processing executed by each device 10 and the like will be described. 3 to 5 show sequence diagrams of processing executed by each device 10 and the like. The central server 50 periodically transmits load requests 120, 126, and 132 to the image processing servers 70, 90, and 92. Each image processing server 70, 90, 92 transmits responses 122, 128, 134 including its own load values 124, 130, 136 when the load requests 120, 126, 132 are received. The central server 50 updates the load value 110 (see FIG. 2) of the server table 64 to the load values 124, 130, and 136 included in the responses 122, 128, and 134.

  The multi-function device 10 executes a preview screen display process (S4) when a predetermined operation is performed on the operation unit 16 (see FIG. 1) (S2). In the preview screen display process of the present embodiment, thumbnails of a plurality of image data stored in the USB memory are displayed on the display unit 14. The user can execute an image selection operation for selecting one thumbnail from a plurality of thumbnails by operating the operation unit 16 (S6). When the image selection operation is executed, the multi-function device 10 stores the selected thumbnail in the work area 26 as the selected image thumbnail data 32 (see FIG. 1). Further, the multi-function device 10 stores the original image data of the selected thumbnail in the work area 26 as the selected image data 28 (see FIG. 1).

  Next, the multi-function device 10 executes a function list inquiry process for transmitting the command 138 to the central server 50 (S8). As a result, the central server 50 transmits the function list 58 (see FIG. 1) to the multi-function device 10. The multi-function device 10 executes a function list display process (S10). In the function list display process, names of a plurality of types of filter processes included in the function list 58 are displayed on the display unit 14 (see FIG. 1).

  As shown in FIG. 4, the user performs a filter selection operation of selecting a desired type of filter processing from among a plurality of types of filters displayed on the display unit 14 by operating the operation unit 16. (S12). The user can select only one type of filter processing, or can sequentially select two or more types of filter processing. In the present embodiment, the following description will be continued by taking as an example a case where two or more types of filter processing are sequentially selected in the filter selection operation. Note that when executing the filter selection operation, the user can further select a parameter indicating the degree of filter processing. For example, when the user selects a filter process called skin color correction, the user can further select a parameter indicating the correction amount of the skin color correction. Note that the parameters corresponding to each type of filter processing are included in the function list 58 described above.

  The user can operate a decision button (not shown) included in the operation unit 16 after sequentially selecting two or more types of filter processing (and further parameters). In this case, the multi-function device 10 executes a request transmission process for transmitting the schedule request 140 to the central server 50 (S14). The schedule request 140 includes an image size 142 of the selected image data 28 (see FIG. 1), a filter ID 144, a parameter 146, and a selection order 148. The filter ID 144 and the parameter 146 are a filter ID and a parameter corresponding to the filter process selected by the filter selection operation (S12). In this embodiment, since two or more types of filter processing are sequentially selected in the filter selection operation (S12), the filter ID 144 includes two or more filter IDs, and the parameter 146 includes two or more parameters. The selection order 148 is information relating to the selection order of two or more types of filter processing selected in the filter selection operation (S12). When the central server 50 receives the schedule request 140, the central server 50 executes a scheduling process using the server table 64 (see FIG. 2) (S16). The contents of the scheduling process will be described in detail next.

  The central server 50 generates a processing table 152 and a filter table 154 by executing a scheduling process. FIG. 6 shows an example of the processing table 152. FIG. 7 shows an example of the filter table 154. First, a method for generating the filter table 154 will be described, and then a method for generating the processing table 152 will be described.

  As shown in FIG. 7, the filter table 154 includes a plurality of combination information 400, 402, and 404. Each combination information 400, 402, 404 is information in which a number 420, a filter ID 422, and a parameter 424 are associated with each other. The number 420 is a serial number starting from “1”. One number corresponds to one filter ID of the filter IDs 144 (see FIG. 4) included in the schedule request 140. In this embodiment, since the filter ID 144 includes three filter IDs, serial numbers from “1” to “3” are written in the number 420.

  Next, the central server 50 specifies the first filter ID selected first among the filter IDs 144 included in the schedule request 140 based on the selection order 148 included in the schedule request 140. The central server 50 further specifies the first parameter selected together with the first filter ID from the parameter 146 (see FIG. 4) included in the schedule request 140. The central server 50 writes the first filter and the first parameter in the column of the filter ID 422 and the parameter 424 corresponding to the number “1”. Similarly, the central server 50 specifies the second filter ID and the third filter ID (and the second parameter and the third parameter) selected next among the filter IDs 144 included in the schedule request 140. To do. The central server 50 writes the second filter and the second parameter in the column of the filter ID 422 and the parameter 424 corresponding to the number “2”. The central server 50 writes the third filter and the third parameter in the column of the filter ID 422 and the parameter 424 corresponding to the number “3”. Thereby, the filter table 154 is completed.

  Next, a method for generating the processing table 152 (see FIG. 6) will be described. The central server 50 identifies the load value 110 of each image processing server 70, 90, 92 when the schedule request 140 is received from the server table 64 (see FIG. 2). Next, the central server 50 identifies all image processing servers having a load value 110 that is smaller than a predetermined threshold value. In the present embodiment, the following description will be continued with an example in which the image processing server 70 and the image processing server 90 are specified. Hereinafter, the image processing servers 70 and 90 specified here are referred to as image processing servers for selected images.

  The central server 50 further determines an image processing server on which filter processing is to be performed on the selected image thumbnail data 32. Hereinafter, this image processing server is referred to as an image processing server for thumbnail images. In the present embodiment, the central server 50 determines the image processing server 92 that has not been determined as the image processing servers 70 and 90 for the selected image as the image processing server for the thumbnail image. When all the image processing servers 70, 90, and 92 are determined as the image processing servers for the selected image, the central server 50 selects the image processing server with the smallest load value as the image processing for thumbnail images. Determine as a server.

  As shown in FIG. 6, the processing table 152 includes a plurality of combination information 300, 302, and 304. Each combination information 300 or the like is information in which the server URL 310, the number 312, the processing time 314, the division information 316, and the merge information 318 are associated with each other. How these pieces of information 310 to 318 are written will be described in detail below.

  The central server 50 writes the URLs of the image processing servers 70 and 90 for the selected image and the URL of the image processing server 92 for the thumbnail image in the server URL 310 column. Next, the central server 50 writes a number in the column of the number 312 for each of the image processing servers 70 and 90 for the selected image. The number 312 is a serial number starting from “1”. One number corresponds to one filter ID included in the filter ID 144. Therefore, as in the case of the number 420 (see FIG. 7) of the filter table 154, in this embodiment, serial numbers “1” to “3” are written in the column of the number 312. The central server 50 writes “0” in the column of the number 312 (that is, the number 312 of the combination information 304) corresponding to the image processing server 92 for thumbnail images.

  As described above, the reference processing time 108 (see FIG. 2) of the server table 64 is a time required for executing image processing on image data of a predetermined size when the load value is a predetermined value. is there. The central server 50 calculates the first size ratio by dividing the image size 142 included in the schedule request 140 by the predetermined size. Next, the central server 50 calculates the second size ratio by dividing the first size ratio by the number of image processing servers for the selected image (“2” in the present embodiment). Further, the central server 50 divides the current load value of the image processing server (load value 110 of the server table 64) by the predetermined value for each of the image processing servers 70 and 90 for the selected image. Calculate the load ratio.

  Next, the central server 50 specifies the first filter ID selected first from the filter ID 144. For each of the image processing servers 70 and 90 for the selected image, the central server 50 sets the second size ratio and the image processing server at the reference processing time 108 of the first filter ID corresponding to the image processing server. The predicted processing time is calculated by multiplying the above load ratio. For example, when the first filter ID is filter ID “2”, the central server 50 sets t21, the second size ratio, and the load ratio of the image processing server 70 for the image processing server 70. , To calculate the prediction processing time of the first filter ID. In the case of this example, the central server 50 further multiplies the image processing server 90 by t22, the second size ratio, and the load ratio of the image processing server 90. The filter ID prediction processing time is calculated.

  Subsequently, the central server 50 specifies the second filter ID selected next to the first filter ID from the filter ID 144. The central server 50 uses the same method as that used to calculate the prediction processing time of the first filter ID, and sets the prediction processing time of the second filter ID for each of the image processing servers 70 and 90 for the selected image. calculate. The central server 50 executes the same processing until the predicted processing time is calculated for the last selected filter ID (third filter ID in the present embodiment).

  The central server 50 uses the image processing server as the processing time 314 corresponding to the numbers “1” to “3” of the image processing server 70 for the selected image (that is, the processing time 314 corresponding to the number “1” of the combination information 300). The predicted processing times of the first to third filter IDs calculated for 70 are written. Similarly, the central server 50 determines the processing time 314 corresponding to the numbers “1” to “3” of the image processing server 90 for the selected image (that is, the processing time 314 corresponding to the number “1” of the combination information 302). The prediction processing times of the first to third filter IDs calculated for the image processing server 90 are written.

  Next, the central server 50 writes the coordinate data in the division information 316 field corresponding to the image processing servers 70 and 90 for the selected image. When the number of image processing servers for the selected image is M (M is an integer equal to or greater than 2), the central server 50 of this embodiment determines to divide the selected image data 28 into M equal parts in the horizontal direction. In this embodiment, since the number of image processing servers for the selected image is “2”, the central server 50 determines to divide the selected image data 28 into two equal parts in the horizontal direction. The image size 142 (see FIG. 4) included in the schedule request 140 includes the number of pixels in the horizontal direction and the number of pixels in the vertical direction of the selected image data 28. The central server 50 identifies coordinate data for bisecting the selected image data 28 in the horizontal direction from the image size 142 and writes the coordinate data in the division information 316 field. This point will be explained in a little more detail.

  The uppermost diagram in FIG. 8 schematically shows the selected image data 28. The selected image data 28 has 1000 pixels in the horizontal direction and 500 pixels in the vertical direction. One pixel is considered as one coordinate. The left pre-processed divided image data 28a obtained by dividing the selected image data 28 into two equal parts has a horizontal coordinate range “1 to 500”, a vertical coordinate range “1 to 500”, Can be specified by. The central server 50 writes CH1 which is the horizontal coordinate range “1 to 500” in the column of the division information 316 (division information 316 of the combination information 300) corresponding to the image processing server 70, and the vertical coordinate range “ CV1 which is “1 to 500” is written. The right pre-processed divided image data 28b can be specified by a horizontal coordinate range “501 to 1000” and a vertical coordinate range “1 to 500”. The central server 50 writes CH2 that is the horizontal coordinate range “501 to 1000” in the column of the division information 316 (division information 316 of the combination information 302) corresponding to the image processing server 90, and the vertical coordinate range “ CV2 which is “1 to 500” is written.

  Next, the central server 50 writes the coordinate data in the field of merge information 318 corresponding to the image processing servers 70 and 90 for the selected image. When a predetermined type of filter processing among a plurality of types of filter processing that can be executed by the image processing servers 70 and 90 is executed, the size of the image data changes before and after the processing. In the present embodiment, when the filter processing corresponding to the filter ID “2” is executed on the image data before processing, the size of the image data after processing becomes smaller than the size of the image data before processing.

  As shown in FIG. 7, in this embodiment, filter ID “5”, filter ID “4”, and filter ID “2” are executed in order. As will be described later in detail, the image processing server 70 performs the above-described filter processing on the left pre-processed divided image data 28a shown in FIG. The image processing server 70 generates the first intermediate image data 210a from the pre-processed divided image data 28a by executing the filter processing corresponding to the filter ID “5”. Next, the image processing server 70 executes the filter process corresponding to the filter ID “4” to generate the second intermediate image data 212a from the first intermediate image data 210a. Next, the image processing server 70 generates post-processed divided image data 214a from the second intermediate image data 212a by executing a filter process corresponding to the filter ID “2”. The size of each image data 28a, 210a, 212a is the same. However, the size of the processed divided image data 214a obtained by the filter processing corresponding to the filter ID “2” is smaller than the size of the second intermediate image data 212a. In the present embodiment, the post-process divided image data 214a can be specified by the horizontal coordinate range “1 to 375” and the vertical coordinate range “1 to 375”.

  The central server 50 stores the reduction ratio of the image data when the filter process corresponding to the filter ID “2” is executed (for example, stored in the storage area 66 (see FIG. 1)). The central server 50 uses the CH1 and CV1 that are the division information 316 of the combination information 300 obtained from the image size 142 (see FIG. 4) and the above reduction ratio to perform the filter processing corresponding to the filter ID “2”. (I.e., the horizontal coordinate range “1 to 375” and the vertical coordinate range “1 to 375”) are calculated. The central server 50 writes CH3 which is the horizontal coordinate range “1 to 375” in the field of merge information 318 (merge information 318 of the combination information 300) corresponding to the image processing server 70, and the vertical coordinate range “ CV3 which is 1 to 375 "is written.

  Further, in this embodiment, as in the case of the image processing server 70, the image processing server 90 performs the above-described filter processing on the right pre-processed divided image data 28b shown in FIG. As a result, first intermediate image data 210b is generated from the pre-processed divided image data 28b, second intermediate image data 212b is generated from the first intermediate image data 210b, and post-processing is performed from the second intermediate image data 212b. Divided image data 214b is generated. The size of each image data 28b, 210b, 212b is the same. However, the size of the post-process divided image data 214b obtained by the filter processing corresponding to the filter ID “2” is smaller than the size of the second intermediate image data 212b. In the present embodiment, the post-processed divided image data 214b can be specified by the horizontal coordinate range “376 to 750” and the vertical coordinate range “1 to 375”.

  The central server 50 uses the CH2 and CV2 that are the division information 316 of the combination information 302 obtained from the image size 142 (see FIG. 4) and the above reduction ratio to perform the filter processing corresponding to the filter ID “2”. (I.e., the horizontal coordinate range “376 to 750” and the vertical coordinate range “1 to 375”) are calculated. The central server 50 writes CH4 which is the horizontal coordinate range “376 to 750” in the field of the merge information 318 (the merge information 318 of the combination information 302) corresponding to the image processing server 90, and the vertical coordinate range “ CV4 which is 1 to 375 "is written.

  In this embodiment, the size of the image data does not change before and after the processing even if the filter processing corresponding to the filter ID other than the filter ID “2” is executed. Accordingly, when the filter ID “2” is not included in the filter ID 144 (see FIG. 4), the coordinate data (for example, CH1) of the division information 316 and the coordinate data (for example, CH3) of the merge information 318 are the same. become.

  As shown in FIG. 4, when the scheduling process (S <b> 16) ends, the central server 50 transmits schedule information 150 to the multi-function device 10. The schedule information 150 includes a processing table 152 and a filter table 154. Next, the multi-function device 10 executes a thumbnail image dividing process for dividing the selected image thumbnail data 32 (S18). The contents of the thumbnail image division process will be described in detail below.

  The multi-function device 10 first reads the division information 316 (see FIG. 6) in the processing table 152. As described above, the division information 316 is coordinate data for dividing the selected image data 28 and is not coordinate data for dividing the selected image thumbnail data 32. The multi-function device 10 calculates coordinate data for dividing the selected image thumbnail data 32 from the division information 316 of the processing table 152. The multi-function device 10 specifies the horizontal division ratio by calculating the ratio between the number of CH1 pixels and the number of CH2 pixels included in the division information 316. In the present embodiment, the number of pixels of CH1 is “500” and the number of pixels of CH2 is “500”. Therefore, the horizontal division ratio is 1: 1. Further, the multi-function device 10 can know from the CV1 and CV2 included in the division information 316 that the multi-function device 10 is not divided in the vertical direction. The multi-function device 10 divides the selected image thumbnail data 32 using the horizontal division ratio (that is, divides the selected image thumbnail data into two equal parts in the horizontal direction). As a result, as shown in FIG. 8, left-side pre-processing partial data 32a and right-side pre-processing partial data 32b are obtained. The pre-process partial data 32a and 32b and the pre-process divided image data 28a and 28b obtained by the selection image division process (see S23 in FIG. 5) described later have a similar relationship.

  Next, the multi-function device 10 specifies the server URL 310 in which “0” is written as the number 312 (see FIG. 6) from the processing table 152. In this embodiment, the multi-function device 10 specifies the URL of the image processing server 92. The multi-function device 10 executes a request transmission process for transmitting the thumbnail image processing request 160 using the URL of the image processing server 92 as a transmission destination (S20). The thumbnail image processing request 160 includes pre-process partial data 32a and 32b (see FIG. 8) and a filter table 154 (see FIG. 7).

  Upon receiving the thumbnail image processing request 160, the image processing server 92 executes thumbnail image processing (S22). The image processing server 92 sequentially executes a plurality of filter processes on the left pre-process partial data 32a according to the order of the number 420 in the filter table 154. That is, first, the image processing server 92 executes the filter processing corresponding to the filter ID “5” on the pre-processing partial data 32a using the parameter “3”. Thereby, the first post-processing partial data 170a (see FIG. 8) is generated. Next, the image processing server 92 executes filter processing corresponding to the filter ID “4” on the first post-processing partial data 170a using the parameter “3”. Thereby, the second post-processing partial data 172a (see FIG. 8) is generated. Next, the image processing server 92 executes filter processing corresponding to the filter ID “2” on the second post-processing partial data 172a using the parameter “4”. Thereby, the third post-processing partial data 174a (see FIG. 8) is generated.

  Similarly, the image processing server 92 sequentially executes a plurality of filter processes on the right pre-process partial data 32b according to the order of the number 420 in the filter table 154. As a result, as shown in FIG. 8, the first post-processing partial data 170b, the second post-processing partial data 172b, and the third post-processing partial data 174b are generated in order. The image processing server 92 generates a total of six pieces of post-processing partial data 170a to 174a and 170b to 174b.

  When the multi-function device 10 transmits the thumbnail image processing request 160, the multi-function device 10 disconnects the communication session between the multi-function device 10 and the image processing server 92. Next, the multi-function device 10 transmits a thumbnail image transmission request 164 to the image processing server 92. The multi-function device 10 periodically transmits a thumbnail image transmission request 164 until a response to the thumbnail image transmission request 164 is received. When the post-processing partial data 170a to 174a and 170b to 174b are generated, the image processing server 92 transmits a response to the thumbnail image transmission request 164. This response includes the post-processing partial data 170a to 174a and 170b to 174b.

  Subsequently, the multi-function device 10 executes a selected image dividing process for dividing the selected image data 28 (see FIG. 1) (S23). The multi-function device 10 first reads the division information 316 (see FIG. 6) in the processing table 152. The multi-function device 10 generates two pre-processed divided image data 28a and 28b (see FIG. 8) by dividing the selected image data 28 according to the division information 316 (that is, dividing the selection image data into two equal parts in the horizontal direction).

  Next, the multi-function device 10 identifies the server URL 310 in which “1” is written as the number 312 (see FIG. 6) from the processing table 152. In the present embodiment, the multi-function device 10 identifies the URL of the image processing server 70. The multi-function device 10 executes a request transmission process for transmitting the selected image processing request 180 using the URL of the image processing server 70 as a transmission destination (S24). The selected image processing request 180 includes the left pre-processed divided image data 28a (see FIG. 8) and the filter table 154 (see FIG. 7).

  Furthermore, the multi-function device 10 specifies the server URL 310 in which “2” is written as the number 312 (see FIG. 6) from the processing table 152. In this embodiment, the multi-function device 10 specifies the URL of the image processing server 90. The multi-function device 10 executes a request transmission process for transmitting the selected image processing request 190 using the URL of the image processing server 90 as a transmission destination (S28). The selected image processing request 190 includes right pre-processed divided image data 28b (see FIG. 8) and a filter table 154 (see FIG. 7).

  Upon receiving the selected image processing request 180, the image processing server 70 executes selected image processing (S26). The image processing server 70 sequentially executes a plurality of filter processes according to the order of the number 420 in the filter table 154. That is, the image processing server 70 first executes the filter process corresponding to the filter ID “5” on the pre-processed divided image data 28 a using the parameter “3”. Thereby, the first intermediate image data 210a (see FIG. 8) is generated. Next, the image processing server 70 executes the filter process corresponding to the filter ID “4” on the first intermediate image data 210a using the parameter “3”. Thereby, the second intermediate image data 212a is generated. Finally, the image processing server 70 executes the filter process corresponding to the filter ID “2” on the second intermediate image data 212a using the parameter “4”. As a result, post-processed divided image data 214a is generated.

  Upon receiving the selected image processing request 190, the image processing server 90 executes selected image processing (S30). As in the case of the image processing server 70, the image processing server 90 sequentially executes a plurality of filter processes according to the order of the number 420 in the filter table 154. Thereby, as shown in FIG. 8, the first intermediate image data 210b, the second intermediate image data 212b, and the post-processed divided image data 214b are generated in order.

  When the multi-function device 10 transmits the selected image processing requests 180 and 190, the multi-function device 10 disconnects the communication session between the multi-function device 10 and the image processing servers 70 and 90. Next, the multi-function device 10 executes a request transmission process for transmitting the post-process image transmission request 200 using the URLs of the image processing servers 70 and 90 as transmission destinations (S32). The multi-function device 10 periodically transmits the processed image transmission request 200 until a response to the processed image transmission request 200 is received. The image processing server 70 transmits a response to the processed image transmission request 200 after generating the processed divided image data 214a (see FIG. 8). This response includes post-processed divided image data 214a. Moreover, the image processing server 90 will transmit the response with respect to the post-process image transmission request 200, if the post-process division | segmentation image data 214b (refer FIG. 8) is produced | generated. This response includes post-processed divided image data 214b.

  When the multi-function device 10 receives all the post-processing divided image data 214a and 214b, the multi-function device 10 executes a merge process (S34). As described above, the size of the post-processed divided image data 214a and 214b is different from the size of the pre-processed divided image data 28a and 28b. The multi-function device 10 executes the merge process according to the merge information 318 (see FIG. 6) included in the process table 152. More specifically, the multi-function device 10 uses the post-processing divided image data 214a transmitted from the image processing server 70 as CH3 and CH4 (see FIG. 6) included in the combination information 300 corresponding to the image processing server 70. Place it at the position specified by. Further, the multi-function device 10 identifies the post-processed divided image data 214b transmitted from the image processing server 90 by CH3 and CH4 (see FIG. 6) included in the combination information 302 corresponding to the image processing server 90. Place in position. As a result, the two post-processed divided image data 214a and 214b are merged (combined), and the post-process image data 220 is obtained as shown in FIG. Subsequently, the multi-function device 10 executes a printing process for printing the processed image data 220 (S36). Thereby, the post-processing image data 220 is provided to the user.

(Processes executed by the multi-function device 10)
Next, details of processing executed by the control unit 12 of the multi-function device 10 will be described in detail. 9 and 10 show flowcharts of main processing executed by the control unit 12. 9 and 10, descriptions regarding the processes of S4, S8, S10, etc. in FIG. 3 are omitted.

  The control unit 12 transmits a schedule request 140 (see FIG. 4) to the central server 50 (S50). As a result, the central server 50 transmits schedule information 150 (see FIG. 4) to the multi-function device 10. The control unit 12 receives the schedule information 150 (S52). Subsequently, the control unit 12 starts a thumbnail image division process (S54). The thumbnail image dividing process is described in detail in S18 of FIG.

  Next, the control unit 12 uses the server URL 310 (URL of the image processing server 92 in this embodiment) corresponding to the number “0” included in the processing table 152 (see FIG. 6) as a transmission destination, and the thumbnail image processing request 160 ( (See FIG. 4) is transmitted (S56). Next, the control unit 12 disconnects the communication session with the image processing server 92 that is the transmission destination of the thumbnail image processing request 160 (S58). Subsequently, the control unit 12 executes a selected image dividing process (S60). The selected image dividing process is described in detail in S23 of FIG.

  Subsequently, the control unit 12 uses the server URL 310 (the URL of the image processing servers 70 and 90 in this embodiment) corresponding to the numbers “1” and “2” included in the processing table 152 (see FIG. 6) as a transmission destination. The selected image processing requests 180 and 190 (see FIG. 5) are transmitted (S62). Next, the control unit 12 disconnects the communication session with the image processing servers 70 and 90 that are the transmission destinations of the selected image processing requests 180 and 190 (S64).

  Subsequently, the control unit 12 transmits a thumbnail image transmission request 164 (see FIG. 4) to the image processing server 92 to which the thumbnail image processing request 160 is transmitted (S66). As a result, the image processing server 92 transmits a plurality of post-processing partial data 170a to 174a, 170b to 174b (see FIG. 4) to the multi-function device 10. The control unit 12 receives the plurality of post-processing partial data 170a to 174a and 170b to 174b (S68).

  Next, as illustrated in FIG. 10, the control unit 12 calculates the total value of the processing time 314 for each of the combination information 300 and 302 excluding the number “0” included in the processing table 152 (see FIG. 6). (S90). In the example of FIG. 6, 5 + 10 + 3 = 18 is calculated as the total value of the processing time 314 of the combination information 300, and 4 + 7 + 6 = 17 is calculated as the total value of the processing time 314 of the combination information 302. Next, the control unit 12 calculates the sum of the maximum total value calculated in S90 (“18” in the example of FIG. 6) and the estimated print time (S92). The estimated print time is a time estimated to be necessary for the printing unit 22 (see FIG. 1) to print the processed image data 220 (see FIG. 8). The predicted print time may be a predetermined value or may be determined according to the image size of the post-processing image data 220 (this is obtained from the merge information 318 of the processing table 152). In the latter case, the estimated print time increases as the image size of the post-processing image data 220 increases.

  Next, the control unit 12 executes display processing for displaying a predetermined display screen on the display unit 14 (see FIG. 1) (S94). FIG. 12A shows an example of a display screen. The display unit 14 includes a time display area 500, two filter name display areas 502a and 502b, a pre-process image display area 504, and a post-process image display area 506. The pre-process image display area 504 includes two adjacent pre-process image display areas 504a and 504b. The processed image display area 506 includes two adjacent processed image display areas 506a and 506b. The control unit 12 causes the time display area 500 to display the value calculated in S92 (25 seconds in the example of FIG. 12A). Thereby, the user can know that printing will be completed in the remaining 25 seconds. The control unit 12 starts counting down the time displayed in the time display area 500.

  Next, the control unit 12 activates a plurality of display update threads (S96). The number of display update threads activated here is equal to the number of image processing servers 70 and 90 that execute the selected image processing (see S26 and S30 in FIG. 5). That is, in this embodiment, two display update threads are activated. When two display update threads are activated, the two display update threads are executed in parallel. One display update thread corresponds to the image processing server 70, and the other display update thread corresponds to the image processing server 90. That is, one display update thread corresponds to the combination information 300 (see FIG. 6) in the processing table 152, and the other display update thread corresponds to the combination information 302 (see FIG. 6) in the processing table 152.

  FIG. 11 shows a flowchart of one display update thread. The control unit 12 identifies “1” as the process number N (S120). Subsequently, the control unit 12 filters the name corresponding to the filter ID 422 of the number “N” (ie, “1”) included in the filter table 154 (see FIG. 7) (ie, the filter corresponding to the filter ID “5”). (Name of process) is displayed in a filter name display area (for example, 502a (see FIG. 12A)) corresponding to the thread (S122). In the display update thread corresponding to the image processing server 70, the name of the filter process corresponding to the filter ID “5” is displayed in the filter name display area 502a. In the display update thread corresponding to the image processing server 90, the name of the filter process corresponding to the filter ID “5” is displayed in the filter name display area 502b. Thereby, the user can know the name (type) of the filter process currently being executed in each of the image processing servers 70 and 90. The filter name display areas 502a and 502b actually display names such as “skin color correction”, but in FIG. 12, the filter name display areas 502a and 502b show filter IDs.

  The control unit 12 displays the pre-process partial data (for example, 32a (see FIG. 8)) in the pre-process image display area (for example, 504a (see FIG. 12 (a))) corresponding to the thread (S124). In the display update thread corresponding to the image processing server 70, the pre-processing partial data 32a is displayed in the pre-processing image display area 504a. In the display update thread corresponding to the image processing server 90, the pre-process partial data 32b is displayed in the pre-process image display area 504b. Thereby, the user can know the pre-processing partial data 32a and 32b before the execution of the currently executed filter process (filter ID “5”).

  In S124, the control unit 12 further uses the first processed partial data (for example, 170a (see FIG. 8)) as a processed image display area corresponding to the thread (for example, 506a (see FIG. 12 (a))). ). In the display update thread corresponding to the image processing server 70, the first post-processing partial data 170a is displayed in the post-processing image display area 506a. In the display update thread corresponding to the image processing server 90, the first post-processing partial data 170b is displayed in the post-processing image display area 506b. As a result, the user can execute the first post-processing partial data 170a and 170b (the above-mentioned first obtained by the currently executed filter process) after the currently executed filter process (filter ID “5”). The first post-processing partial data 170a and 170b) corresponding to the intermediate image data 210a and 210b (see FIG. 8) can be known.

  Subsequently, the control unit 12 starts a timer (S126). The control unit 12 specifies the processing time 314 of the processing number N (that is, N = 1) included in the combination information (for example, 300 (see FIG. 6)) corresponding to the thread from the processing table 152 (see FIG. 6). In the display update thread corresponding to the image processing server 70, 5 seconds corresponding to the number “1” is specified. In the display update thread corresponding to the image processing server 90, 4 seconds corresponding to the number “1” is specified. The control unit 12 monitors whether the timer value reaches the specified processing time (S128). In the case of YES here, the control unit 12 executes a display update process (S130).

  In the display update process of S130, the control unit 12 replaces the filter name currently displayed in the filter name display area (for example, 502a) corresponding to the thread with the filter name to be executed next (the number “N + 1 in the filter table 154). To the filter name corresponding to the filter ID). For example, in the display update thread corresponding to the image processing server 90, the filter ID “5” currently displayed in the filter name display area 502b is changed to the filter ID “4” to be executed next. As a result, as shown in FIG. 12B, the display content of the filter name display area 502b is updated.

  Next, the control unit 12 transfers the pre-process partial data (for example, 32a) currently displayed in the pre-process image display area (for example, 504a) corresponding to the thread to the post-process image display area (for example, 506a) corresponding to the thread. Change to the first post-processing partial data (for example, 170a) currently displayed. In the display update thread corresponding to the image processing server 90, the pre-processing partial data 32b currently displayed in the pre-processing image display area 504b is the first post-processing partial data currently displayed in the post-processing image display area 506b. Updated to 170b. Thereby, as shown in FIG. 12B, the display content of the pre-processing image display area 504b is updated. In the display update thread corresponding to the image processing server 70, the pre-process partial data 32a currently displayed in the pre-process image display area 504a is the first post-process currently displayed in the post-process image display area 506a. Updated to partial data 170a. Thereby, as shown in FIG.12 (c), the display content of the pre-processing image display area 504a is updated.

  Further, the control unit 12 applies the first post-processing partial data (for example, 170a) currently displayed in the post-processing image display area (for example, 506a) corresponding to the thread to the filter process (filter table) to be executed next. In 154, the data is changed to the second post-processing partial data (for example, 172a) generated by the filter processing corresponding to the filter ID of the number “N + 1”. In the display update thread corresponding to the image processing server 90, the first post-processing partial data 170b currently displayed in the post-processing image display area 506b is updated to the second post-processing partial data 172b. Thereby, as shown in FIG.12 (b), the display content of the post-process image display area 506b is updated. In the display update thread corresponding to the image processing server 70, the first post-processing partial data 170a currently displayed in the post-processing image display area 506a is updated to the second post-processing partial data 172a. Thereby, as shown in FIG.12 (c), the display content of the post-process image display area 506b is updated.

  When S130 ends, the control unit 12 generates a new process number N (that is, N = 2) by adding 1 to the process number N (S132). The control unit 12 determines whether or not the new process number N is equal to the last number “3” of the process table 152 (see FIG. 6) (S134). In the case of NO here, the control unit 12 resets and restarts the timer (S126). In S128 to be executed next, the control unit 12 determines from the processing table 152 (see FIG. 6) a new processing number N (that is, N =) included in the combination information (for example, 300 (see FIG. 6)) corresponding to the thread. The processing time 314 of 2) is specified. In the display update thread corresponding to the image processing server 70, 10 seconds corresponding to the number “2” is specified. In the display update thread corresponding to the image processing server 90, 7 seconds corresponding to the number “2” is specified. The control unit 12 monitors whether the timer value reaches the specified processing time (S128).

  In the case of YES in S128, the control unit 12 executes the display update process again (S130). As a result, although not shown in FIG. 12, in the display update thread corresponding to the image processing server 90, the display content is updated as follows. That is, the filter ID “4” currently displayed in the filter name display area 502b is changed to the filter ID “2” to be executed next. Further, the first post-processing partial data 170b currently displayed in the pre-processing image display area 504b is updated to the second post-processing partial data 172b currently displayed in the post-processing image display area 506b. Further, the second post-processing partial data 172b currently displayed in the post-processing image display area 506b is updated to the third post-processing partial data 174b.

  In the display update thread corresponding to the image processing server 70, the display content is updated as follows. That is, the filter ID “4” currently displayed in the filter name display area 502a is changed to the filter ID “2” to be executed next. Also, the first post-processing partial data 170a currently displayed in the pre-processing image display area 504a is updated to the second post-processing partial data 172a currently displayed in the post-processing image display area 506a. Furthermore, the second post-processing partial data 172a currently displayed in the post-processing image display area 506a is updated to the third post-processing partial data 174a.

  Next, the control unit 12 generates a new process number N (that is, N = 3) by executing S132. In this case, the control unit 12 determines YES in S134 and ends the display update thread. In this embodiment, the display update thread corresponding to the image processing server 90 (combination information 302 (see FIG. 6) ends first, and the display update thread corresponding to the image processing server 70 (combination information 300 (see FIG. 6)) The total processing time (17 seconds) of the combination information 302 is shorter than the total processing time (18 seconds) of the combination information 300.

  As shown in FIG. 10, when the control unit 12 activates a plurality of display update threads (when S96 is executed), the process proceeds to S98. In S98, the control unit 12 transmits the processed image transmission request 200 (see FIG. 5) using the URLs of the image processing servers 70 and 90 included in the processing table 152 (see FIG. 6) as transmission destinations. As a result, the image processing server 70 transmits the processed divided image data 214a to the multi-function device 10. Further, the image processing server 90 transmits the processed divided image data 214 b to the multi-function device 10. The control unit 12 receives the processed divided image data 214a and 214b (S100).

  Next, the control unit 12 determines whether or not the last post-processed divided image data among the post-processed divided image data 214a and 214b to be received is received (S102). That is, the control unit 12 determines whether or not all post-processed divided image data 214a and 214b have been received. In the case of NO here, the control unit 12 stands by until receiving the final post-process divided image data.

  In the case of YES in S102, the control unit 12 executes display update processing (S104). In the display update process executed in S104, the control unit 12 deletes the filter name display areas 502a and 502b, the pre-process image display area 504, and the post-process image display area 506, as shown in FIG. Instead, the characters “printing” are displayed. Further, the control unit 12 determines whether or not the time currently displayed in the time display area 500 matches the predicted print time. When the currently displayed time and the predicted print time do not match, the control unit 12 displays the predicted print time in the time display area 500 (that is, corrects the time), and the predicted print time. Start the countdown.

  Next, the control unit 12 executes a merge process for merging the post-processed divided image data 214a and 214b (S106). The contents of the merge process are described in detail in S34 of FIG. The control unit 12 causes the printing unit 22 (see FIG. 1) to print the processed image data 220 (see FIG. 8) obtained by the merge processing. Thereby, the process of the multi-function device 10 ends.

  The image processing system 2 of the present embodiment has been described in detail. According to the image processing system 2, the filter processing selected by the user can be distributed to the image processing servers 70 and 90 for two or more selected images determined by the central server 50 and executed. Compared with a configuration in which only one image processing server exists, post-processing image data 220 can be generated quickly. As a result, the processed image data 220 (see FIG. 8) can be quickly provided to the user of the multi-function device 10.

  In this embodiment, the schedule request 140 (see FIG. 4) does not include the selected image data 28 (see FIG. 1). That is, there is no need to execute communication processing for transmitting the selected image data 28 from the multi-function device 10 to the central server 50. Accordingly, the communication time executed between the multi-function device 10 and the central server 50 can be shortened. As a result, the processed image data 220 (see FIG. 8) can be quickly provided to the user of the multi-function device 10.

  Further, the central server 50 generates division information 316 and merge information 318, and transmits schedule information 150 including them to the multi-function device 10 (see FIG. 4). The multi-function device 10 can divide the selected image data 28 at a position corresponding to the division information 316 determined by the central server 50. Even if the size of the pre-processed divided image data 28a and 28b is different from the size of the post-processed divided image data 214a and 214b by executing the filter processing corresponding to the filter ID “2”, there are many cases. The functional device 10 can merge the post-processed divided image data 214a and 214b with reference to the merge information 318.

  Further, when the multi-function device 10 has transmitted the selected image processing requests 180 and 190 (see FIG. 5) including the pre-processed divided image data 28a and 28b to the image processing servers 70 and 90, the multi-function device 10 The communication session with 90 is disconnected. Compared to the configuration in which the state where the communication session between the multi-function device 10 and the image processing servers 70 and 90 is established is maintained until the multi-function device 10 acquires the post-processing divided image data 214a and 214b. The load on the processing servers 70 and 90 can be reduced.

  12A to 12C, the multi-function device 10 displays a plurality of post-processing partial data 170a to 174a and 170b to 174b in order. The user can know how the filter processes are sequentially executed according to the order selected by the user. In particular, in this embodiment, after the processing generated by the filter processing to be executed next to the filter processing at the timing (predicted timing) when the filter processing ends in the image processing servers 90 and 92 for the selected image. Partial data 172a, 174a, 172b, and 174b are displayed. For example, when the filter processing corresponding to the filter ID “5” displayed in FIG. 12A ends in the image processing server 90, as shown in FIG. 12B, next to the filter ID “5”. The second post-processing partial data 172b generated in the image processing server 92 by the filter processing corresponding to the filter ID “4” to be executed is displayed. For example, when the filter processing corresponding to the filter ID “5” is completed in the image processing server 70, as shown in FIG. 12C, the filter ID “4” to be executed next to the filter ID “5”. The second post-processing partial data 172a generated in the image processing server 92 by the filter processing corresponding to “is displayed. The user can know how each filter process is executed in each image processing server 70 and 90.

  As shown in FIGS. 12A to 12D, the multi-function device 10 displays the remaining time until the print result of the processed image data 220 is obtained. The user can know the remaining time. In addition, the multi-function device 10 displays the predicted print time when the remaining time displayed when the last post-processed divided image data is acquired does not match the predicted print time required for printing (FIG. 10). (See S104). That is, the multi-function device 10 can correct the remaining time. The user can know a more accurate remaining time.

  The correspondence between each component of the above embodiment and each component of the present invention will be described. The selected image data 28 (see FIG. 1) of this embodiment is an example of first image data, and the post-processing image data 220 (see FIG. 5) is an example of second image data. The operation unit 16 is an example of a selection permission unit. The schedule request 140 (see FIG. 4) is an example of a specific request, the image size 142 is an example of size information, and the filter ID 144 is an example of type information. Further, the server URL 310 of the combination information 300 and 302 in FIG. 6 is an example of M pieces of position information corresponding to M pieces of image processing servers. Moreover, the division information 316 in FIG. 6 is an example of first coordinate information, and the merge information 318 is an example of second coordinate information. Moreover, the processing time 314 of FIG. 6 is an example of timing information. Note that the processing time 314 in FIG. 6 is also an example of processing time information. Further, the server URL 310 of the combination information 304 in FIG. 6 is an example of specific position information corresponding to a specific image processing server.

The modifications of the above embodiment are listed below.
(1) In the above embodiment, when the number of image processing servers 70 and 90 for selected images is M, the central server 50 determines to divide the selected image data 28 into M equally in the horizontal direction. However, the central server 50 may determine to divide the selected image data 28 into M equal parts in the vertical direction. The central server 50 may determine to divide the selected image data 28 into X equal parts in the horizontal direction and Y equal parts in the vertical direction. Further, the central server 50 may determine the positions to be divided so that the size of the M pre-processed divided image data changes without dividing the selected image data 28 into M equal parts. For example, the central server 50 uses the load value 110 (see FIG. 2) of the image processing servers 70 and 90 for the selected image to determine the size of the pre-processed divided image data that each image processing server 70 and 90 should execute. May be. In this case, the central server 50 determines the position to be divided so that the size of the pre-processed divided image data to be executed by the image processing server decreases as the load value 110 of the image processing server for the selected image increases. You may decide.

(2) In the above embodiment, the central server 50 uses the image processing servers 70 and 90 whose load value 110 (see FIG. 2) is smaller than a predetermined threshold as the image processing servers 70 and 90 for the selected image. decide. However, the central server 50 may determine the image processing servers 70 and 90 for a plurality of selected images by randomly specifying a plurality of image processing servers. The central server 50 may determine a plurality of image processing servers 70 and 90 for selected images by specifying a plurality of image processing servers in a predetermined order.

(3) In the above embodiment, the central server 50 determines the image processing server 92 for thumbnail images by specifying an image processing server 92 other than the plurality of image processing servers 70 and 90 for selected images. However, the central server 50 may determine the image processing server 92 for thumbnail images by specifying the image processing server having the smallest load value 110. Further, the central server 50 may determine the image processing server 92 for thumbnail images by randomly specifying one image processing server. In addition, the central server 50 may determine the image processing server 92 for thumbnail images by specifying one image processing server in a predetermined order.

(4) In the above embodiment, after the processing generated in the image processing server 92 by the filter processing to be executed next to the filter processing at the end timing of the filter processing of the image processing servers 70 and 90 for the selected image Partial data 170a to 174a and 170b to 174b are displayed. However, the thumbnail data generated in the image processing server 92 by the filter processing may be displayed at the end timing of the filter processing of the image processing servers 70 and 90 for the selected image. For example, while the filter ID “5” is being executed in the image processing servers 70 and 90 on the display screen of FIG. 12A, the image processing server 92 generates the filter ID corresponding to the filter ID “5”. The first post-processing partial data 170a and 170b may not be displayed. In this case, the first post-processing partial data 170a and 170b may be displayed at the timing when the filter processing corresponding to the filter ID “5” is completed in the image processing servers 70 and 90. The second post-processing partial data 172a and 172b are displayed at the timing when the filter processing corresponding to the filter ID “4” is completed in the image processing servers 70 and 90, and the filter ID “2” is displayed in the image processing servers 70 and 90. The third post-processing partial data 174a and 174b may be displayed at the timing when the filter processing corresponding to is completed.

(5) In the above embodiment, the central server 50 predicts the end timing of each filter process (that is, the processing time 314 in FIG. 6), and transmits the end timing to the multi-function device 10. However, the image processing servers 70 and 90 for the selected image may transmit predetermined information to the multi-function device 10 every time the filtering process is completed. The multi-function device 10 can know that the filtering process has ended by receiving the predetermined information. When the multi-function device 10 receives the predetermined information, the multi-function device 10 may update the display of the post-processing partial data 170a to 174a and 170b to 174b.

(6) The above embodiment discloses a system for printing the processed image data 220. However, the technique of this embodiment can also be applied to a system that displays the processed image data 220, transmits it to another device, or processes it. Further, a system can be constructed using a printer, a scanner, a PC, a server, or the like instead of the multi-function device 10.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above.

  The technical elements described in this specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

  2: image processing system, 4: internet, 10, 40: multi-function device, 12: control unit, 14: display unit, 16: operation unit, 24: storage unit, 26: work area, 28: selected image data, 28a , 28b: pre-processed divided image data, 32: selected image thumbnail data, 32a, 32b: pre-process partial data, 36: program, 50: central server, 52: control unit, 56: storage unit, 58: function list, 60 : Work area 62: Program 64: Server table 70, 90, 92: Image processing server 72: Control unit 76: Storage unit 78: Work area 80: Program 140: Schedule request 142: Image Size: 144: Filter ID, 146: Parameter, 148: Selection order, 150: Schedule information, 152: Processing table, 15 : Filter table, 160: Thumbnail image processing request, 164: Thumbnail image transmission request, 170a to 174a, 170b to 174b: Partial data after processing, 180, 190: Selected image processing request, 200: Post image processing request, 214a, 214b: post-processing divided image data, 220: post-processing image data, 500: time display area, 502a, 502b: filter name display area, 504: pre-processing image display area, 506: post-processing image display area

Claims (13)

A communication device that is communicably connected to a central server and a plurality of image processing servers,
Pre-processing image data acquisition means for acquiring first image data;
A selection permission means for allowing a user to select a specific type of image processing from a plurality of types of image processing;
Information transmitting means for transmitting a specific request not including the first image data to the central server;
Schedule information including the M pieces of position information corresponding to M (M is an integer of 2 or more) image processing servers determined by the central server from the plurality of image processing servers according to the specific request, Schedule information acquisition means for acquiring from a central server;
Dividing means for generating the M pre-processed divided image data by dividing the first image data into the M pieces;
Pre-processing image data transmitting means for transmitting one different pre-processed divided image data to each of the M image processing servers corresponding to the M pieces of position information included in the schedule information;
Each of the M image processing servers generates the M post-processing divided image data generated by executing the specific type of image processing on the different one pre-processing divided image data. A post-processing image data acquisition means for acquiring
Combining means for generating second image data by combining the M post-processed divided image data;
A communication device comprising: The information transmission means transmits the specific request including size information regarding the size of the first image data to the central server,
The schedule information acquisition means includes first coordinate information for specifying the M areas included in the first image data, and includes the first coordinate information determined by the central server according to the size information. Obtaining the schedule information;
The division unit generates the M pre-processed divided image data by dividing the first image data into the M pieces according to the first coordinate information. Communication device. The information transmission means transmits the specific request further including type information specifying the specific type of image processing selected by the user to the central server,
The schedule information acquisition means is second coordinate information for specifying the M areas where the M post-process divided image data should be arranged, and the central server according to the size information and the type information Obtaining the schedule information further including the second coordinate information determined by
The communication device according to claim 2, wherein the combining unit generates the second image data by combining the M post-process divided image data according to the second coordinate information. The pre-processing image data transmission means, when the transmission of the pre-processing divided image data to the image processing server is completed for each of the M image processing servers, between the communication device and the image processing server. Disconnect the communication session
The post-processing image data acquisition means acquires the M post-processing divided image data from the M image processing servers by transmitting a request to each of the M image processing servers. The communication apparatus according to any one of claims 1 to 3. The selection permission means allows a user to sequentially select N types (N is an integer of 2 or more) of image processing among the plurality of types of image processing,
The specific type of image processing is the N types of image processing,
The post-processing image data acquisition means is generated by each of the M image processing servers executing the N types of image processing in order on the different one pre-processing divided image data. The communication apparatus according to any one of claims 1 to 4, wherein the M post-processed divided image data is acquired. By dividing the reduced image data of the first image data into the M pieces at a position corresponding to the division position for dividing the first image data into the M pieces, the M pre-processing partial data can be obtained. When generated, the N post-process partial data generated by sequentially executing the N types of image processing on the pre-process partial data for each of the M pre-process partial data. A post-processing partial data acquisition means for acquiring
First display control means for displaying the M × N pieces of the processed partial data on a display means;
The communication device according to claim 5, further comprising: For each of the M image processing servers, there is further provided timing information acquisition means for acquiring timing information regarding the end timing of each of the N types of image processing executed by the image processing server,
The first display control means includes
For each of the M image processing servers,
In synchronization with the end timing of each of the N types of image processing executed by the image processing server,
The N post-processing partial data generated from the pre-processing partial data corresponding to the different one pre-processing divided image data to be sequentially executed by the image processing server. The communication device according to claim 6, wherein the display unit sequentially displays the information. The first display control means includes
For each of the M image processing servers,
Each time the end timing of one type of image processing among the end timings of the N types of image processing executed by the image processing server is reached,
The communication apparatus according to claim 7, wherein one piece of the post-processing partial data generated by the image processing to be executed next to the one type of image processing is displayed on the display unit. The schedule information acquisition means acquires the schedule information further including specific position information corresponding to a specific image processing server to generate the M × N post-processing partial data.
Further comprising reduced image data transmission means for transmitting the reduced image data of the first image data to the specific image processing server corresponding to the specific position information included in the schedule information;
9. The communication according to claim 6, wherein the post-processing partial data acquisition unit acquires the M × N pieces of post-processing partial data from the specific image processing server. apparatus. For each of the M image processing servers, processing time information acquisition means for acquiring processing time information related to a processing time predicted to be necessary for the image processing server to execute the specific type of image processing; ,
Printing means for printing the second image data;
The sum of the processing time that is the largest of the processing times of each of the M image processing servers and the printing time that is predicted to be necessary for the printing means to print the second image data. Second display control means for displaying the display time on the display means while counting down,
The communication apparatus according to claim 1, further comprising: The second display control unit includes the display time when the post-processed image data acquisition unit acquires the last post-processed divided image data among the M post-processed divided image data. 11. The communication apparatus according to claim 10, wherein, if they do not match, the printing time is displayed on the display unit instead of the display time, and the printing unit displays the printing time while counting down. The communication device according to any one of claims 1 to 11,
The central server;
The plurality of image processing servers;
An image processing system comprising: The central server is
Load information acquisition means for acquiring information on each load of the plurality of image processing servers;
Image processing server determination means for determining the M image processing servers whose load at the time when the specific request is received is smaller than other image processing servers;
The image processing system according to claim 12, comprising:

Images