JP2015173403A - Image information control apparatus, program, and image information control system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a high-value-added service to image data outputted from an image processing system.SOLUTION: A controller in an image information control apparatus acquires target image information expressing a target image to be converted and conversion request information from the image processing system. In the case of acquiring the conversion request information, the controller converts the target image information on the basis of plural pieces of coloration pattern information indicated by the conversion request information and thereby generates plural converted images. The controller generates list image information for causing the image processing system to print out a list image including an image for list printing of the generated converted images and transmits the list image to the image processing system.

Description

  The present invention relates to an image information control apparatus capable of communicating with an image processing apparatus via a network, a program executed by the image information control apparatus, and an image information control system including the image information control apparatus and the image processing apparatus.

  The image processing apparatus described in Patent Document 1 has a built-in web browser and has a function of downloading and printing a web page. Further, the image processing apparatus has a function of converting scanned image data generated by scanning a document into a specific format such as JPEG or BMP, and transmitting the converted data to a web server.

JP 2008-229933 A

As described in Patent Document 1, various functions for transmitting image data from an image processing apparatus to a web server have been proposed.
On the other hand, it is desired to provide a service with high added value by performing more complex image processing than simple format conversion on the image data output from the image processing apparatus.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a service with high added value for image data output from an image processing apparatus.

  The present invention made in order to solve the above problems is an image information control apparatus including a control unit, a storage unit, and a communication interface. The storage unit stores a plurality of predetermined color arrangement pattern information, and the control unit can communicate with the image processing apparatus via a communication interface. The control unit executes a target image acquisition process, a conversion request acquisition process, a converted image generation process, a list image information generation process, and a first transmission process.

  The target image acquisition process is a process of acquiring target image information representing a target image to be converted from an image processing apparatus via a communication interface. The conversion request acquisition process is a process of acquiring conversion request information from the image processing apparatus via a communication interface. In the conversion image generation process, when conversion request information is acquired in the conversion request acquisition process, a converted image is generated by converting the objects constituting the target image individually according to the color pattern information for each color pattern. . The list image information generation process is a process of generating list image information for causing a list image including a list print image of a plurality of converted images generated by the converted image generation process to be printed out by the image processing apparatus. The first transmission process is a process of transmitting the list image information generated by the list image information generation process to the image processing apparatus via the communication interface.

  In the image information control apparatus of the present invention, the target image information transmitted from the image processing apparatus is converted based on a plurality of designated color arrangement pattern information, and the result of the conversion is displayed as list image information. Send to processing device. As a result, the image processing apparatus can print out the list image and check the conversion result for each color arrangement pattern information, and can determine a desired conversion result.

  Therefore, according to the image information control apparatus of the present invention, it is possible to provide a service with high added value for the image data output from the image processing apparatus.

It is a block diagram which shows schematic structure of the communication system of embodiment. It is explanatory drawing for demonstrating the outline | summary of a color change function. It is explanatory drawing which shows an example of the color scheme used for a color change function. It is explanatory drawing which shows the example of various screens displayed on the display part of a multi-function device. FIG. 10 is an explanatory diagram illustrating an example of a print result of a thumbnail list that can be printed out by a multi-function device. It is a sequence diagram which shows a part of sequence of each process performed with a communication system. FIG. 7 is a sequence diagram showing a part of a sequence of each process executed in the communication system (continuation of FIG. 6). FIG. 8 is a sequence diagram showing a part of a sequence of each process executed in the communication system (continuation of FIG. 7). FIG. 9 is a sequence diagram showing a part of the sequence of each process executed in the communication system (continuation of FIG. 8). FIG. 10 is a sequence diagram showing a sequence of each process executed as a download print process in S402 and S418 of FIG. 9. FIG. 9 is a flowchart showing image processing started in S306 of FIG. 8. FIG.

Preferred embodiments of the present invention will be described below with reference to the drawings.
(1) Configuration of Communication System 1 As shown in FIG. 1, the communication system 1 of this embodiment includes a multi-function device 10, an intermediary server 20, a conversion server 30, and a content server 50. The multi-function device 10 is connected to the Internet 4 via the LAN 2. The mediation server 20, the content server 50, and the conversion server 30 are connected to the Internet 4.

  The multi-function device 10, the mediation server 20, the conversion server 30, and the content server 50 can execute communication using, for example, HTTP (abbreviation of HyperText Transfer Protocol) or HTTPS (abbreviation of HyperText Transfer Protocol Secure).

  More specifically, the multi-function device 10 operates as an HTTP client. The conversion server 30 operates as an HTTP server. The mediation server 20 operates as an HTTP server in communication with the multi-function device 10 and operates as an HTTP client in communication with the conversion server 30 without being obstructed by a firewall or the like provided in the LAN 2 or the like. Communication with the multi-function device 10 and communication with the conversion server 30 can be performed.

(2) Configuration of Multi-Function Device 10 The multi-function device 10 can execute various processes for realizing various functions such as a print function, a scan function, a copy function, and a FAX function. The multi-function device 10 includes an operation unit 11, a display unit 12, a network interface 13, a print execution unit 14, a scan execution unit 15, and a control unit 16.

  The operation unit 11 includes a plurality of keys and a touch panel arranged in a superimposed manner on the display area of the display unit 12. The user can input various instructions to the multi-function device 10 by operating the operation unit 11. The display unit 12 is a display for displaying various information. The network interface 13 is connected to the LAN 2. The multi-function device 10 can communicate with the mediation server 20, the conversion server 30, and the like via the network interface 13. The print execution unit 14 includes a printing mechanism such as an inkjet method or a laser method. The scan execution unit 15 includes a scan mechanism such as a CCD or CIS.

  The control unit 16 includes a CPU 17 and a memory 18. The CPU 17 executes various processes according to the program 19 stored in the memory 18. Each process of the multi-function device 10 in FIGS. 6 to 10 to be described later is realized by the CPU 17 executing the program 19 in the memory 18. The memory 18 may be a computer readable storage medium. The computer-readable storage medium is a non-transitory medium such as a ROM, RAM, flash memory, or hard disk. Note that an electrical signal carrying a program downloaded from a server on the Internet is not included in a non-transitory medium.

(3) Configuration of Mediation Server 20 Mediation server 20 is a server configured separately from conversion server 30 and content server 50. The mediation server 20 is a server for mediating communication of various data between the conversion server 30 and the multi-function device 10. The mediation server 20 is a server provided by the vendor of the multi-function device 10.

  The mediation server 20 includes a network interface 21 and a control unit 22. The mediation server 20 can communicate with the multi-function device 10, the content server 50, the conversion server 30, and the like via the network interface 21. The control unit 22 includes a CPU 23 and a memory 24. A program 25 is stored in the memory 24. The CPU 23 executes various processes according to the program 25. Each process of the mediation server 20 in FIGS. 6 to 10 described later is realized by the CPU 23 executing the program 25 in the memory 24. Similar to the memory 18 of the multi-function device 10, the memory 24 may be a computer-readable storage medium.

(4) Configuration of Conversion Server 30 The conversion server 30 is a server configured separately from the mediation server 20 and the content server 50. The conversion server 30 is a server for executing various processes to be described later on input image data.

  The conversion server 30 may be a server provided by the vendor of the multi-function device 10. The conversion server 30 includes a network interface 31 and a control unit 32. The control unit 32 includes a CPU 33 and a memory 34. The memory 34 stores a program 35 and a template 41. The CPU 33 executes various processes according to the program 35. Each process of the conversion server 30 in FIGS. 6 to 11 described later is realized by the CPU 33 executing the program 35 in the memory 34. The template 41 includes third template image data 42 as image data used for image processing. Similar to the memory 18 of the multi-function device 10, the memory 34 may be a computer-readable storage medium.

  The program 35 includes an A application 36, a B application 37, and a C application 38 as programs for performing image processing. Among them, the C application 38 is an application for executing image processing for combining the output image output from the multi-function device 10 and the third template image for the C application 38.

  In other words, the C application 38 has a function of multi-coloring the output image output from the multi-function device 10 based on the third template image. The third template image is stored as third template image data 42 in the memory 34. The term “multicoloring” here means that at least one color other than monochrome is arranged on the output image output from the multi-function device 10, and is also referred to as colorization hereinafter.

  More specifically, the image processing performed by the C application 38 includes a specific region (a portion painted in black or a color close thereto in the present embodiment) in the output image output from the multi-function device 10. This is a process of colorizing with the color arrangement pattern shown in the three template images. In the present embodiment, various third template images used in the C application 38 are prepared. That is, the third template image data 42 for each of a plurality of types of third template images is stored in the memory 34. Among the plurality of types of third template images, one or more third template images selected by the multi-function device 10 are combined with the output image output from the multi-function device 10.

  The third template image used in the C application 38 is an information image indicating in what color scheme the output image output from the multi-function device 10 should be colored. Therefore, in the following description, the third template image used in the C application 38 is also referred to as a color arrangement pattern image. A function realized by the C application 382 is also referred to as a color change function hereinafter.

(5) Configuration of Content Server 50 The content server 50 is a server configured separately from the mediation server 20 and the conversion server 30. The content server 50 may be a server provided by the vendor of the multi-function device 10. The content server 50 includes a memory 51. A template 52 is stored in the memory 51.

  The template 52 includes first template image data 53 and second template image data 54. The first template image data 53 is image data used when the A application 36 is executed. The second template image data 54 is image data used when the B application 37 is executed.

  When the conversion server 30 executes the A application 36 and the B application 37, it is necessary to obtain image data of the template image selected by the multi-function device 10 from the content server 50. On the other hand, when the conversion server 30 executes the C application 38, the image data of the color arrangement pattern image selected by the multi-function device 10 may be read from the memory 34 in the conversion server 30. Need not be acquired from the content server 50.

  Here, notes on description in this specification will be described. In this specification, the description “the CPU 23 of the mediation server 20 receives various types of information” means “the CPU 23 of the mediation server 20 acquires various types of information via the network interface 21”. Is included. In addition, the description “the CPU 23 of the mediation server 20 transmits various types of information” includes the technical content that “the CPU 23 of the mediation server 20 outputs various types of information via the network interface 21”. It shall be. Note that similar precautions exist for the CPU 33 and the network interface 31 of the conversion server 30. Similar precautions exist for the CPU 17 and the network interface 13 of the multi-function device 10.

  Next, the definition of the words “data” and “information” will be described. In this specification, “data” and “information” use “information” as a superordinate concept of “data”. Therefore, “A data” may be rephrased as “A information”. Further, “information” is treated as the same information as long as it is recognized as the same meaning content even if the format as “data” (for example, text format, binary format, flag format, etc.) is different. For example, as long as the apparatus handles information indicating that the number of copies is two, text data “COPY = 2” and binary data “10” are the same information.

  In the present specification, a mode in which the mediation server 20, the conversion server 30, and the content server 50 are connected via the Internet 4 is illustrated. In other words, an example in which devices that function as each of the mediation server 20, the conversion server 30, and the content server 50 are arranged at physically separated positions is illustrated. However, the application of the present invention is not limited to such a form. For example, at least two of the mediation server 20, the conversion server 30, and the content server 50 may be realized by one server device. For example, when the mediation server 20 and the conversion server 30 are realized by one server device, the program that functions as the mediation server 20 and the program that functions as the conversion server 30 are operated in the one server device, The communication may be performed via a bus line in the server device. In the case where the mediation server 20 and the conversion server 30 are configured by a single server device, the communication described in this specification as the communication between the mediation server 20 and the conversion server 30 is the mediation server. Data exchange between the program functioning as 20 and the program functioning as the conversion server 30 may be replaced. Further, a program that functions as the mediation server 20 and also functions as the conversion server 30 may be realized in a form that operates on one server device. In this case, the communication described in this specification as the communication between the mediation server 20 and the conversion server 30 functions as the mediation server 20 and passes data within a program that also functions as the conversion server 30. It may be replaced with.

(6) Description of Color Change Function Implemented in Communication System 1 The communication system 1 according to the present embodiment can implement a plurality of types of image processing functions. That is, in the communication system 1, image data of an image scanned by the multi-function device 10 can be processed by the conversion server 30, and the result can be acquired by the multi-function device 10 and printed out.

  Although there are various types of image processing functions, at least three of them are image processing functions that are realized by executing the three applications 36 to 38 described above. Detailed description of the image processing function by the A application 36 and the B application 37 is omitted. The image processing function by the C application 38 is the above-described color change function. The color change function is a function that combines the scan image scanned by the user in the multi-function device 10 and the color arrangement pattern image selected by the user, and allows the multi-function device 10 to print out the synthesized image. .

  An outline of the color change function will be described. When the user of the multi-function device 10 wants to color a favorite manuscript (for example, a manuscript to be used for printing on the back side of a New Year's card) with a favorite color scheme, prepare the manuscript. There are various types of manuscripts, but a typical example is one in which a user himself freely draws a picture or character on a paper of a predetermined size with a black writing instrument.

  A specific example is shown in FIG. As shown in FIG. 2A, the user creates a document 62 to be colored by freely drawing a material picture 61 such as a favorite picture or character on a white paper 60 of, for example, A4 size. can do. The user executes the C application 38, causes the multi-function device 10 to scan the document 62 on which the material painting 61 is drawn, and further selects a favorite color arrangement pattern. Then, the image data of the scanned image is transmitted to the conversion server 30 via the Internet 4, and the image scanned by the conversion server 30 is illustrated in FIG. 2B according to the color arrangement pattern. Colored. In the following description, an image scanned by the multi-function device 10 is also referred to as an original scan image, and data of the original scan image is also referred to as original scan image data.

  The color converted image, which is an image generated by color-converting the original scan image as described above, is finally transmitted to the multi-function device 10 and can be printed out by the multi-function device 10. In the present embodiment, the user can not perform color conversion only with one specific color scheme, but as described later, a plurality of color scheme patterns (all color schemes prepared in the present embodiment). Color conversion results by (pattern) can be collectively obtained as a thumbnail list and printed. The user can determine a desired color arrangement pattern by looking at the printed thumbnail list. A color conversion image based on the color arrangement pattern can be acquired from the conversion server 30 and printed out.

  In the color converted image illustrated in FIG. 2B, a color corresponding to a color arrangement pattern selected by the user is arranged on each of a plurality of objects 66, 67, 68,. It has been The object here means an area drawn in a color other than white (for example, black or gray) and closed in the original scan image.

  The color converted image illustrated in FIG. 2B is composed of a plurality of objects 66, 67, 68. A plurality of objects 66, 67, 68... Are colored. Specifically, as shown in FIG. 2B, the largest object 66 at the center of the image is red, the left object 67 is blue, the object 68 above is green, and so on. The color is arranged.

  Color schemes that can be selected by the user are roughly classified into colorful, pastel, rainbow, and gradation. When these color arrangement patterns are further classified, each of colorful, pastel, rainbow, and gradation has a plurality of patterns.

  For example, as illustrated in FIG. 3A, colorful is a pattern in which one color is assigned to each object and is arranged. 3A is an example of the first colorful icon 122 displayed on the display unit 12 of the multi-function device 10 when the user selects a color arrangement pattern in the multi-function device 10. Specifically, FIG. It is an icon which shows colorful 1 which is a specific pattern among multiple types of colorful color schemes. The first colorful icon 122 indicating colorful 1 has an image of a plurality (six in this example) of parts 81 to 86, and different colors are arranged for each part. For example, the largest part 81 in the center is amber, the left part 82 is red, the upper part 83 is blue, and so on.

  Colorful 1, which is one of the color arrangement patterns, indicates that the original scan image is color-converted with the taste of the color represented by the first colorful icon 122 shown in FIG. The color taste means a color type, a color arrangement ratio, a color arrangement position, and the like. That is, when colorful 1 is selected as the color arrangement pattern, the color-converted image after color conversion has the same taste as the overall taste of the first colorful icon 122 shown in FIG.

  For example, as shown in FIG. 3B, a rainbow, which is one of the color schemes, divides the entire image into a plurality of continuous regions and assigns different colors to the regions. It is. 3B is an example of the first rainbow icon 123 displayed on the display unit 12 of the multi-function device 10 when the user selects a color arrangement pattern in the multi-function device 10, and specifically, It is an icon which shows the rainbow 1 which is a specific pattern among the multiple types of rainbow color schemes. The first rainbow icon 123 indicating the rainbow 1 includes images of a plurality of parts (five in this example). The first rainbow icon 123 is divided into a plurality of regions (six regions in this example) in the vertical direction as a whole, and different colors are assigned to the respective regions. Each of the parts 91 to 95 in the icon has a color corresponding to the area where the part is present. For example, the largest part 91 in the central portion exists over four areas. Therefore, in the part 91, the part existing in the lowermost area is colored in red corresponding to the area, and the part existing in the upper area is colored in blue corresponding to the area. The portion existing in the region above is colored with a dark blue corresponding to the region, and the portion existing in the region above is colored green corresponding to the region.

  Rainbow 1 which is one of the color arrangement patterns indicates that the original scan image is color-converted with the color taste represented by the first rainbow icon 123 shown in FIG. That is, when Rainbow 1 is selected as the color arrangement pattern, the color-converted image after color conversion has the same taste as the entire first rainbow icon 123 shown in FIG. In terms of image, the first rainbow icon 123 is enlarged to an image having the same size as the original scan image, and the enlarged first rainbow icon 123 is overlapped on the back side of the original scan image, so that other than white in the original scan image. It is an image that the first rainbow icon 123 on the back side is exposed from the area.

  There are also other pastels and gradations in the color arrangement pattern, and each has a plurality of types of patterns, but detailed description thereof will be omitted. When any color arrangement pattern is selected, the color converted image after color conversion has a taste similar to the taste of the color arrangement pattern as a whole.

  A specific procedure of image processing by the color change function will be described. First, as shown in FIG. 2A, the user prepares a document 62 on which a material picture 61 to be colored is drawn. Further, the user selects the C application 38 as an application to be used. When selecting an application in the multi-function device 10, an application selection screen as shown in FIG. 4A is displayed on the display unit 12 of the multi-function device 10. In the application selection screen, icons 111, 112, 113,... Showing a plurality of types of applications that can be used in the multi-function device 10 are displayed in a list. The user can cause the C application 38 to be executed in the conversion server 30 by selecting (for example, tapping) the icon 112 indicating the C application 38 from among them.

  When the C application 38 is selected on the application selection screen, a conversion selection screen for causing the user to select a color arrangement pattern as shown in FIG. 4B is displayed on the display unit 12 of the multi-function device 10. . On the conversion selection screen, icons 122, 123... Showing a plurality of selectable color schemes are displayed in a list, and an “all results trial print” icon (hereinafter abbreviated as “all trial icons”). ) 121 is also displayed. Each of the icons 122, 123... Is a reduced image of a color arrangement pattern image. In addition, the first colorful icon 122 and the first rainbow icon 123 illustrated in FIG. 3 are displayed on the conversion selection screen in FIG.

  In the present embodiment, not only can a color conversion image be obtained by performing color conversion using a specific one color pattern, but also color conversion is performed for all selectable color patterns, and thumbnails of thumbnails of each color conversion image are displayed in a list. The list image can be printed out by the multi-function device 10. Then, the user can determine the desired color arrangement pattern by looking at the print result of the thumbnail list image, obtain the image data of the color conversion image based on the determined color arrangement pattern from the conversion server 30, and print it out. . In the following description, the above-described function, that is, a function capable of printing out a thumbnail list image and determining a specific color arrangement pattern based on it is also referred to as a “list print / conversion selection function”.

  Of the icons on the conversion selection screen illustrated in FIG. 4B, all the trial icons 121 are icons indicating a list printing / conversion selection function. When the user selects all the trial icons 121, a list printing / conversion selection function is realized with the conversion server 30 as the center.

  In the conversion selection screen, when the user selects an icon indicating a specific color arrangement pattern instead of all the trial icons 121, a color conversion image based on the selected color arrangement pattern is transferred from the conversion server 30 to the multi-function device 10. The multi-function device 10 can print the color converted image on a desired sheet (for example, the back side of a postcard).

  When the user selects all the trial icons 121 on the conversion selection screen, the multi-function device 10 scans the document 62 on which the material painting 61 is drawn. The scanned original image data generated by the scan is transmitted from the multi-function device 10 to the conversion server 30. Then, the conversion server 30 performs color conversion for all the color arrangement patterns on the scanned document image, generates image data of thumbnail list images, and transmits the image data to the multi-function device 10.

  When the multi-function device 10 acquires the thumbnail list image data from the conversion server 30, the multi-function device 10 prints out the thumbnail list image. FIG. 5 shows an example of the print result of the thumbnail list image. As shown in FIG. 5, the thumbnail list image is a list of thumbnails of the color conversion results of the original scan image for each color arrangement pattern. Note that information (text in this embodiment) indicating a color arrangement pattern corresponding to each thumbnail image is also added to the thumbnail list image for each thumbnail image. By viewing the thumbnail list image print result, the user can efficiently check the color conversion results for all color arrangement patterns, although the display size is small, that is, a thumbnail.

  On the other hand, in addition to the thumbnail list image data, image data of each thumbnail is transmitted to the multi-function device 10. Then, the display unit 12 of the multi-function device 10 displays a conversion result selection screen in which the thumbnails 131, 132, 133,... Are arranged in the horizontal direction as illustrated in FIG. On the conversion result selection screen, for each thumbnail, information indicating a color arrangement pattern corresponding to the thumbnail (in this embodiment, text) is also displayed.

  When the user selects a thumbnail of a desired color arrangement pattern (for example, a tap operation) on the conversion result selection screen shown in FIG. 4C, the selection information is transmitted to the conversion server 30. Then, color conversion image data based on the selected color arrangement pattern is transmitted from the conversion server 30 to the multi-function device 10. As a result, the user can print out a color-converted image that has been color-converted with the selected desired color arrangement pattern.

(7) Operation of Communication System 1 Among the operations of the communication system 1, an operation example in particular when the color change function is realized will be described with reference to the sequence diagrams of FIGS. In the following description, a series of processes (S110 to S140) illustrated in FIG. 6 among the operation examples continuously illustrated in FIGS. 6 to 10 are collectively referred to as an initial selection process. A series of processes (S202 to S232) shown in FIG. 7 are collectively referred to as a scan upload process. A series of processes (S302 to S322) shown in FIG. 8 are collectively referred to as a conversion process. A series of processes (S402 to S418) shown in FIG. 9 are collectively referred to as thumbnail list printing / conversion selection process. A series of processes (S502 to S522) shown in FIG. 10 are collectively referred to as a download print process.

  The initial selection process in FIG. 6 will be described sequentially. When the CPU 17 of the multi-function device 10 is turned on and receives a command to display the main screen, the CPU 17 displays the main screen on the display unit 12 in S110. The main screen is, for example, a screen for selecting one of an application function and a menu function, and displays an image showing each selectable function and its function name. The application function is a function that performs applied processing such as processing for generating an image of the address and back of the New Year's card, and includes the color change function described above. The menu function is a function for performing processing for performing various settings of the multi-function device 10.

  When an operation for selecting any function is performed on the multi-function device 10 (for example, a tap operation on an image of a corresponding function), the CPU 17 sends function identification information indicating the selected function to the mediation server 20 in S112. Send.

  When receiving the function identification information from the multi-function device 10, the CPU 23 of the mediation server 20 determines the function indicated by the function identification information in S114. If a menu function is indicated (S114: menu function), a menu function execution process is performed. The details of the menu function execution process will be omitted. On the other hand, if an application function is indicated (S114: application function), the process proceeds to S116.

  In S116, the CPU 23 of the mediation server 20 generates application selection screen data for displaying the application selection screen (FIG. 4A). The CPU 23 of the mediation server 20 transmits the application selection screen data to the multi-function device 10 in S118.

  When receiving the application selection screen data from the mediation server 20, the CPU 17 of the multi-function device 10 displays the application selection screen on the display unit 12 in S120. The user of the multi-function device 10 can operate the operation unit 11 and select an icon representing a desired application from the application selection screen. When the user performs an operation of selecting an icon representing an application, the CPU 17 of the multi-function device 10 transmits application identification information to the mediation server 20 in S122. The application identification information is information for identifying a selected application that is an application selected by the user.

  In S124, the CPU 23 of the mediation server 20 identifies the selected application based on the application identification information, and generates conversion list information acquisition request information corresponding to the selected application. The conversion list information acquisition request information is information for requesting the content server 50 for conversion list information that is necessary for displaying a list of template images corresponding to the selected application.

  Here, assuming that the selected application is the C application 38, the description of S124 and subsequent steps will be made. As described above, the C application 38 is an application for realizing the color change function. The CPU 23 of the mediation server 20 transmits conversion list information acquisition request information to the content server 50 in S126. Since the selected application is the C application 38, S126 is a process of requesting the content server 50 for image data for causing the multi-function device 10 to display the conversion selection screen illustrated in FIG. That is, in S126, the CPU 23 of the mediation server 20 sends the icons 122, 123... And the text information corresponding to all selectable color arrangement pattern images to the content server 50, and all the trial icons 121 and the corresponding icons. Request text information.

  The CPU 23 of the mediation server 20 receives the conversion list information transmitted from the content server 50 in S128. The conversion list information includes the icons 121, 122, 123... And their text information.

  In S130, the CPU 23 of the mediation server 20 generates conversion selection screen data for displaying the conversion selection screen. The conversion selection screen data is generated based on the conversion list information received in S128. In S132, the conversion selection screen data is transmitted to the multi-function device 10.

  When receiving the conversion selection screen data from the mediation server 20, the CPU 17 of the multi-function device 10 displays the conversion selection screen on the display unit 12 in S134. The user operates the operation unit 11 to select all the trial icons 121 or icons corresponding to a specific color arrangement pattern to be used for color conversion from among a plurality of icons displayed on the conversion selection screen. In step S136, the CPU 17 of the multi-function peripheral 10 transmits conversion identification information for identifying the selected icon to the mediation server 20. The conversion identification information can also be said to be information indicating whether the user has selected to perform color conversion with a specific color arrangement pattern or to print out thumbnail list images of color conversion results with all color arrangement patterns. .

  Upon receiving the conversion identification information from the multi-function device 10, the CPU 23 of the mediation server 20 determines in S138 whether conversion by all color arrangement patterns has been selected, that is, whether all the trial icons 121 have been selected on the conversion selection screen. to decide. When conversion by all color arrangement patterns is not selected, that is, when a specific color arrangement pattern is selected (S138: NO), normal conversion processing is executed in S140. In the normal conversion process of S140, the user scans the document, the conversion server 30 performs color conversion on the document scan image with the selected color arrangement pattern, and the multi-function device 10 acquires and prints the color converted image. It is processing.

  When conversion using the entire color arrangement pattern is selected (S138: YES), the CPU 23 of the mediation server 20 creates a conversion parameter indicating conversion using the entire color arrangement pattern in S140. This conversion parameter is a parameter corresponding to a job that is currently being executed after the function identification information is transmitted from the multi-function device 10 in S112, and is a parameter created individually for each job. The conversion parameters include, for example, user information (for example, unique information of the multi-function device 10 and a user login ID) in addition to information indicating an image processing method (in this case, conversion by all color arrangement patterns) to be executed by the conversion server 30. Application identification information may be created in association with each other. Hereinafter, the description will be continued on the assumption that the conversion by the entire color arrangement pattern is selected by the user and the process proceeds from S138 to S140.

  After the process of S140, the process proceeds to the scan upload process of FIG. When the CPU 23 of the mediation server 20 proceeds to the scan upload process of FIG. 7, the image process upload data ID acquisition request information is transmitted to the conversion server 30 in S202. The image processing upload data ID acquisition request information includes an image processing upload data ID (hereinafter abbreviated as “UL-ID”) for identifying upload data to be uploaded from the multi-function device 10 to the conversion server 30. This is information for requesting for. The conversion parameter created in S140 may be included in the image processing upload data ID acquisition request information. In S <b> 204, the CPU 33 of the conversion server 30 transmits the UL-ID to the mediation server 20. Thereby, in the mediation server 20, the transmitted UL-ID is stored in association with the conversion parameter created in S140.

  In S206, the CPU 23 of the mediation server 20 generates scan upload execution command information. The scan upload execution command information is information for instructing the multi-function device 10 to scan a document to be color-converted and upload the document scan image data to the conversion server 30. In S <b> 208, the CPU 23 of the mediation server 20 transmits scan upload execution command information to the multi-function device 10. The scan upload execution command information may include a UL-ID.

  In step S <b> 209, the CPU 17 of the multi-function device 10 displays a document scan instruction screen on the display unit 12. On the document scan instruction screen, a message for instructing the user to set a document to be color-converted on the multi-function device 10 and scan it and an “OK” button are displayed. When the user operates the “OK” button (for example, a tap operation), the document is scanned in S210. In S210, the CPU 17 operates the scan execution unit 15 to read an image of a document, and creates document scan image data indicating the read document scan image.

  In S <b> 212, the CPU 17 of the multi-function device 10 transmits image processing upload destination URL (Uniform Resource Locator) acquisition request information and communication format acquisition request information to the mediation server 20. “Image processing upload” is a process of uploading various data to the conversion server 30 for image processing. The image processing upload destination URL acquisition request information is information for requesting the mediation server 20 for an image processing upload destination URL, which is information necessary for uploading to the conversion server 30. The communication format acquisition request information is information for requesting a communication format of an upload message described later.

  In S214, the CPU 23 of the mediation server 20 creates a communication format for the upload message. The communication format of the upload message is information serving as a message framework when uploading the scanned original image data to the conversion server 30. In S <b> 216, the CPU 23 of the mediation server 20 transmits the image processing upload destination URL and the communication format of the upload message to the multi-function device 10. An example of the image processing upload destination URL is the URL of the conversion server 30.

  In S218, the CPU 17 of the multi-function device 10 creates an upload message based on the received communication format, the received image processing upload destination URL, and the scanned original image data generated in S210. Specifically, the multi-function device 10 has various information such as document scan image data, image processing upload destination URL, and data size of the document scan image data at a predetermined position in the communication format received from the mediation server 20. Combine. A UL-ID may be included. Thereby, an upload message corresponding to the conversion server 30 is created.

  In S <b> 220, the CPU 17 of the multi-function device 10 transmits an upload message to the conversion server 30. The CPU 33 of the conversion server 30 acquires the upload message transmitted from the multi-function device 10 in S220 and temporarily stores it in the memory 34. In S <b> 222, the CPU 33 of the conversion server 30 transmits image processing upload result information to the multi-function device 10. The image processing upload result information is information indicating whether or not the original scan image data has been normally uploaded to the conversion server 30. In S <b> 224, the CPU 17 of the multi-function device 10 transmits the received image processing upload result information and continuation permission determination request information to the mediation server 20. The continuation permission determination request information is information for requesting the mediation server 20 to determine whether or not image processing can be continued.

  In S226, the CPU 23 of the mediation server 20 decrypts the image processing upload result information and creates a decryption result. Since the image processing upload result information is information transmitted from the conversion server 30 to the multi-function device 10, the image processing upload result information has specifications specific to the conversion server 30. Therefore, by using a decoding program (not shown) included in the program 25 stored in the mediation server 20, the image processing upload result information can be decoded. The decryption result is a message in a format that can be decrypted by the multi-function device 10. The decryption result includes the image processing upload result included in the decrypted image processing upload result information. Further, the CPU 23 of the mediation server 20 generates continuation continuity information, which is information about whether or not image processing can be continued, based on the decoding result. For example, if the decryption result indicates that the upload process has failed, continuation permission / prohibition information indicating that image processing cannot be continued is generated. In S <b> 228, the CPU 23 of the mediation server 20 transmits the decryption result and the continuation permission / inhibition information to the multi-function device 10.

  In S230, the CPU 17 of the multi-function device 10 determines whether the image processing can be continued based on the received continuation permission / inhibition information. If the image processing cannot be continued (S230: NO), the entire job currently being executed is terminated. If the image processing can be continued (S230: YES), the process proceeds to S232. In S <b> 232, the CPU 17 of the multi-function peripheral 10 transmits upload completion notification information indicating that the scan image data upload process to the conversion server 30 has been completed to the mediation server 20.

  After the process of S232, the process proceeds to the conversion process of FIG. When proceeding to the conversion process of FIG. 8, the CPU 23 of the mediation server 20 transmits the image processing request information, the selected application parameter, and the conversion parameter to the conversion server 30 in S <b> 302. The image processing request information is for requesting execution of image processing on the scanned document data identified by the UL-ID received in S204 (that is, scanned document data uploaded to the conversion server 30 in S220). Information. The selected application parameter is information for uniquely identifying the selected application selected by the user. Here, the selected application parameter is a parameter indicating the C application 38. An application for executing image processing can be designated by the selected application parameter. The conversion parameter is a conversion parameter created in S140, and includes at least information indicating an image processing method to be executed by the conversion server 30 (in this case, conversion by all color arrangement patterns) and a UL-ID associated therewith. Including.

  With the transmission of various types of information in S302, the conversion server 30 can acquire the original scan image data based on the UL-ID of the original scan image data, and the image processing to be executed based on the selected application parameter is the image of the C application 38. It can be recognized that this process is a process for generating thumbnail list image data as a conversion result of all color arrangement patterns.

  In S <b> 304, the CPU 33 of the conversion server 30 transmits processing data acquisition information to the mediation server 20. The processing data acquisition information includes a conversion ID, which is information for identifying image processing performed in response to processing (S302) that requests execution of image processing. In the conversion server 30, the conversion ID is associated with the image processing to be executed in response to the request in S302. The processing data acquisition information may be described by a URL description method.

  In S <b> 306, the CPU 33 of the conversion server 30 executes image processing by the C application 38. Specifically, here, the color conversion processing for all the color arrangement patterns for the scanned original image data is started. Details of the image processing started in S306 will be described later.

  The processing of S308 to S322 is processing for causing the multi-function device 10 to wait until image processing is completed when image processing is started for the scanned original image data. In S <b> 308, the CPU 23 of the mediation server 20 transmits image processing completion confirmation request information to the conversion server 30. The image processing completion confirmation request information is information for confirming to the conversion server 30 whether or not the image processing requested to the conversion server 30 in S302 is completed. The CPU 23 of the mediation server includes the processing data acquisition information acquired from the conversion server 30 in S304 in the image processing completion confirmation request information in order to identify the image processing.

  In S310, the CPU 33 of the conversion server 30 determines whether the image processing is completed. Specifically, the image processing corresponding to the processing data acquisition information included in the image processing completion confirmation request information is specified as image processing for determining whether image processing can be completed. Then, in the specified image processing, it is determined whether or not the synthesis of the original scan image data and the selected template image data is completed. If the image processing has not been completed (S310: NO), the process proceeds to S312.

  In S <b> 312, the CPU 33 of the conversion server 30 transmits image processing incomplete notification information indicating that the image processing has not been completed to the mediation server 20. In S314, the CPU 23 of the mediation server 20 generates a standby command based on the reception of the image processing incomplete notification information. The standby command is a command for causing the multi-function device 10 to wait for completion of image processing.

  In S <b> 316, the CPU 23 of the mediation server 20 transmits a standby command to the multi-function device 10. In S318, the CPU 17 of the multi-function peripheral 10 executes standby processing that waits for completion of image processing. In S320, the CPU 17 of the multi-function peripheral 10 transmits standby process completion information indicating that the execution of the standby process has been completed to the mediation server 20. The CPU 23 of the mediation server 20 waits for reception of standby processing completion information from the multi-function device 10 after transmitting a standby command in S316. When the standby process completion information is received from the multi-function device 10 in S320, the process returns to S308.

  On the other hand, if the conversion server 30 determines that the image processing has been completed in S310 (S310: YES), the process proceeds to S322. In S <b> 322, the CPU 33 of the conversion server 30 transmits image processing completion notification information indicating that the image processing is completed, that is, color conversion of the scanned original image is completed, to the mediation server 20. After the process of S322, the process proceeds to the thumbnail list print / conversion selection process of FIG.

  Details of the image processing started in S306 will be described with reference to FIG. When the image processing shown in FIG. 11 is started, the CPU 33 of the conversion server 30 extracts one color conversion pattern that has not been subjected to color conversion from among the color arrangement patterns specified by the conversion parameters in S602. Specifically, one color arrangement pattern image data that has not yet undergone color conversion among the color arrangement patterns designated by the multi-function device 10 is read from the memory 34. The color arrangement pattern designated from the multi-function device 10 is specifically the color arrangement pattern indicated by the conversion identification information transmitted from the multi-function device 10 to the mediation server 20 in S136.

  For example, when all the trial icons 121 are selected on the conversion selection screen shown in FIG. 4B, the specified color arrangement patterns are all color arrangement patterns that can be used for color conversion. In the conversion selection screen shown in FIG. 4B, when an icon indicating a specific color arrangement pattern other than the trial icon 121 is selected, the specified color arrangement pattern corresponds to the selected icon. One color arrangement pattern.

  In step S604, color conversion of the scanned document image data is performed based on the color arrangement pattern extracted in step S602. In S606, the result of the color conversion performed in S604, that is, the color converted image data generated by the color conversion is stored in the memory 34.

  In S608, it is determined whether or not there is an unprocessed color scheme, that is, whether or not color conversion has been performed for all designated color schemes. If there is an unprocessed color scheme (S608: YES), the process returns to S602. In S608, if there is no unprocessed color scheme, that is, if color conversion has been performed for all the designated color schemes (S608: NO), the process proceeds to S610.

  In S610, it is determined whether or not there are a plurality of color conversion results stored in the memory 34, that is, whether or not color conversion has been performed for each of a plurality of color arrangement patterns. If the stored color conversion result is one (S610: NO), the image processing is terminated. If there are a plurality of stored color conversion results (S610: YES), the process proceeds to S612. In S612, thumbnail list image data as a color conversion result is generated. That is, thumbnail list image data for generating thumbnails for all color-converted image data for each color arrangement pattern and causing the multi-function device 10 to print out thumbnail list images (see FIG. 5) in which each thumbnail is listed. Is generated.

  Returning to FIG. 9, the thumbnail list printing / conversion selection process will be described. When the process proceeds to the thumbnail list print / conversion selection process of FIG. 9, a download print process is performed in S402. The download print processing performed in S402 is processing for transmitting the thumbnail list image data generated in S612 to the multi-function device 10 and printing out the multi-function device 10 in the image processing described with reference to FIG. Note that the process of S402 is performed on the assumption that the user has selected color conversion for all color arrangement patterns. If a specific color scheme is selected by the user, the thumbnail list printing / conversion selection process of FIG. 9 does not perform the processes of S402 to S416, but performs the download print process of S418.

  Details of the download print processing in S402 are as shown in FIG. When proceeding to the download print process, the CPU 23 of the mediation server 20 generates process data acquisition command information in S502. The processing data acquisition command information may be described by a URL description method.

  When the processing data acquisition command information is generated, the CPU 23 of the mediation server 20 transmits the processing data acquisition command information to the multi-function device 10 in S504. In S <b> 506, the CPU 17 of the multi-function device 10 transmits the download source URL request information and the processing data acquisition information request information to the mediation server 20. The download source URL request information is information for requesting the mediation server 20 for a download source URL for accessing processing data generated by image processing. The download source URL requested here is more specifically a download source URL for accessing the thumbnail list image data generated in S612. The processing data acquisition information request information is information for identifying a job including image processing (see FIG. 11) executed by the conversion server 30.

  In S <b> 508, the CPU 23 of the mediation server 20 generates a download source URL and process data acquisition information for acquiring process data from the conversion server 30, and transmits the generated data to the multi-function device 10. The processing data acquisition information includes, for example, a conversion ID.

  In S510, the CPU 17 of the multi-function peripheral 10 sends download request information for downloading the processing data (here, thumbnail list image data) identified by the processing data acquisition information to the conversion server 30 based on the download source URL. Send. In S <b> 512, the CPU 33 of the conversion server 30 transmits data for one sheet of printing paper among the processing data specified by the download request information to the multi-function device 10. Through the transmission processing in S512, data for one page of the thumbnail list image is transmitted to the multi-function device 10.

  In S514, the CPU 17 of the multi-function device 10 causes the print execution unit 14 to execute print processing. That is, the thumbnail list image acquired in S512 is printed on one printing sheet. After executing the printing process in S514, the CPU 17 of the multi-function peripheral 10 determines in S516 whether there is processing data that has not been printed, that is, whether there is an image of the next page as a thumbnail list image. To do. If there are a large number of color arrangement patterns prepared for the color conversion function, it will be difficult to print thumbnails of color conversion results for all color arrangement patterns on one sheet of printing paper, and print them on multiple printing sheets. Cases can also occur. For example, when a maximum of nine thumbnails (see FIG. 5) can be printed on one sheet of printing paper, and there are ten or more color schemes, one thumbnail of the color conversion results of all the color schemes is displayed. It is not possible to print on one sheet of printing paper, and it is necessary to print it out in two or more sheets. When it is necessary to print and output thumbnail list images divided into a plurality of sheets as described above, an affirmative determination is made in S516 every time one thumbnail is printed until the printing of all thumbnails to be printed is completed, and S506. Will return.

  When all thumbnail list images to be printed are printed out (S516: NO), print completion notification information indicating that the thumbnail list image print processing has been completed is transmitted to the mediation server 20 in S518. In S <b> 520, the CPU 23 of the mediation server 20 transmits processing completion notification information to the multi-function device 10. In S <b> 522, the CPU 17 of the multi-function device 10 displays a completion screen on the display unit 12.

  In this manner, when the thumbnail list image download print processing in S402 of FIG. 9 is completed, in S404, the CPU 23 of the mediation server 20 generates conversion result selection screen data. The conversion result selection screen data is data for causing the multi-function device 10 to display a conversion result selection screen as illustrated in FIG. The conversion result selection screen data does not include image data of each of the thumbnails 131, 132, 133. However, the conversion result selection screen data includes the URL of the conversion server 30 to be accessed to acquire the image data of each thumbnail. A conversion ID may be included. In S <b> 406, the CPU 23 of the mediation server 20 transmits the generated conversion result selection screen data to the multi-function device 10.

  When receiving the conversion result selection screen data from the mediation server 20, the CPU 17 of the multi-function device 10 transmits thumbnail image acquisition request information to the conversion server 30 in S408. More specifically, the URL contained in the conversion result selection screen data is accessed and thumbnail image acquisition request information is transmitted. The thumbnail image acquisition request information is information for requesting the conversion server 30 for image data of each thumbnail displayed in the thumbnail list image printed out. The thumbnail image acquisition request information may include a conversion ID.

  When receiving the thumbnail image acquisition request information from the multi-function device 10, the CPU 33 of the conversion server 30 transmits the image data of each thumbnail to the multi-function device 10 in S410. Note that text data indicating a color arrangement pattern corresponding to the image data is added to each image data. When the CPU 17 of the multi-function device 10 receives the image data of each thumbnail from the conversion server 30, the conversion result selection screen (see FIG. 4C) in which the thumbnails are arranged in a line is displayed on the display unit 12 in S412. Display.

  When the conversion result selection screen is displayed on the display unit, the user of the multi-function device 10 corresponds to a desired color arrangement pattern from among the displayed thumbnails while checking against a thumbnail list image that is printed out separately. Selected thumbnails can be selected. The conversion result selection screen displays text information indicating the corresponding color arrangement pattern for each thumbnail, in addition to the thumbnails of the respective color conversion results for the respective color arrangement patterns. In addition, text information indicating a corresponding color arrangement pattern is also printed for each thumbnail in the thumbnail list image printed out (see FIG. 5). Therefore, the user can select a thumbnail corresponding to a desired color arrangement pattern by comparing the text information in the thumbnail list image printed out with the text information displayed on the conversion result selection screen. .

  In the multi-function device 10, when one conversion result is selected from the conversion result selection screen, the CPU 17 of the multi-function device 10 transmits the conversion result selection information to the mediation server 20 in S414. The conversion result selection information includes a conversion ID and an image index that is information indicating the selected conversion result. When the CPU 23 of the mediation server 20 receives and acquires the conversion result selection screen from the multi-function device 10, the CPU 23 determines the color conversion image selected by the multi-function device 10 based on the acquired conversion result selection information in S416. . After the process of S416, the process proceeds to the download print process of S418.

  The download print process performed in S418 is a color corresponding to the color converted image specified by the conversion result selection information in S414, among the color converted image data generated and stored in S604 to S606 in the image processing described with reference to FIG. In this process, the converted image data is transmitted to the multi-function device 10 and printed out on a desired sheet (for example, a postcard). If the conversion method specified by the user on the conversion selection screen (see FIG. 4B) is color conversion based on a specific color scheme, the download print processing in S418 is the first in image processing. The color conversion image data with one color arrangement pattern is transmitted to the multi-function device 10 and printed out on a desired sheet.

  The download print processing in S418 is as shown in FIG. That is, the download print process in S418 is basically performed in the same procedure as the download print process in S402. However, the following points are different from the download print processing in S402.

  That is, in the download print process of FIG. 10 executed in S418, in S508, the CPU 23 of the mediation server 20 sets a URL for accessing one color converted image selected by the multi-function device 10 as the download source URL. Send. Further, the processing data acquisition information transmitted to the multi-function device 10 by the CPU 23 of the mediation server 20 in S508 also includes an image index indicating one color converted image selected by the multi-function device 10.

  In S510, the CPU 17 of the multi-function peripheral 10 downloads download request information for downloading processing data (specific color conversion image data here) identified by the processing data acquisition information based on the download source URL. It transmits to the conversion server 30. The download request information transmitted here includes the conversion ID and image index acquired from the mediation server 20 in S508.

  In S <b> 512, the CPU 33 of the conversion server 30 transmits the color conversion image data specified by the download request information to the multi-function device 10. Through the transmission processing in S512, color conversion image data based on the color arrangement pattern selected by the user through the conversion result selection screen (FIG. 4C) is transmitted to the multi-function device 10. In step S514, the multi-function device 10 prints the color converted image on a desired sheet (for example, a postcard).

(8) Effects of Embodiment As described above, in the communication system 1 according to the present embodiment, color conversion is performed on a document scan image using a plurality of color arrangement patterns (all color arrangement patterns that can be selected in the present embodiment). Thus, the color conversion result can be printed out as a thumbnail list image. The user of the multi-function device 10 can check the color conversion result for each color arrangement pattern by looking at the thumbnail list image that has been printed out, and can determine a desired color arrangement pattern therefrom. In other words, when you want to check the color conversion results with multiple types of color patterns, you do not need to print and check the color conversion results for each color pattern you want to check, but print multiple color conversion results at once. It can be confirmed by outputting. In particular, in the present embodiment, since the color conversion results of all the color arrangement patterns prepared in advance for color conversion can be acquired at once, the user can select the optimum color arrangement pattern from all the selectable color arrangement patterns. Can be selected efficiently.

Therefore, according to the communication system 1 of the present embodiment, it is possible to provide a service with high added value for the scanned original image output from the multi-function device 10.
In the communication system 1 according to the present embodiment, after the thumbnail list image is printed out, when the user selects a desired color arrangement pattern in the multi-function device 10, color conversion image data based on the selected color arrangement pattern is converted from the conversion server 30 to the multi-function. To the machine 10. Thereby, the multi-function device 10 can acquire the color conversion image data of the selected desired color arrangement pattern, and can perform various processes (for example, printing on a postcard) based on the acquired color conversion image data. it can.

  That is, in the communication system 1 according to the present embodiment, the thumbnail list image is first printed by the multi-function device 10 so that the user can appropriately select a desired color arrangement pattern. Then, color conversion image data based on the color arrangement pattern selected based on the thumbnail list image can be provided to the user of the multi-function device 10. Therefore, the user of the multi-function device 10 can efficiently and easily acquire a color converted image that has been color-converted with a desired color arrangement pattern.

  In the communication system 1 of the present embodiment, after the thumbnail list image is printed out, the multi-function device 10 selects a conversion result selection screen (FIG. 4C) in order to select a desired color arrangement pattern from a plurality of types of color arrangement patterns. )) Is displayed. Thereby, the user of the multi-function device 10 can easily select a desired color arrangement pattern based on the display content of the conversion result selection screen.

  In particular, in the present embodiment, as the conversion result selection screen, as illustrated in FIG. 4C, thumbnails and text information of the color conversion results are displayed for each color arrangement pattern. Therefore, a desired color arrangement pattern can be easily specified and selected from the conversion result selection screen.

  Further, in addition to a plurality of thumbnails for each color arrangement pattern, text information indicating a corresponding color arrangement pattern is added to each thumbnail list image printed out by the multi-function device 10. That is, the thumbnail for each color arrangement pattern and its text information are displayed on both the thumbnail list image and the conversion result selection screen.

  Therefore, the user of the multi-function device 10 can easily grasp the correspondence between each thumbnail in the thumbnail list image printed out and each thumbnail in the conversion result selection screen displayed on the display unit 12. The thumbnail of the desired color arrangement pattern can be easily identified and selected from the conversion result selection screen.

  In the communication system 1 of this embodiment, when selecting a color arrangement pattern on the conversion selection screen (see FIG. 4B), the mediation server 20 transmits the conversion selection screen data to the multi-function device 10 (S132). A conversion selection screen is displayed on the display unit 12 of the functional device 10 (S134). Thereby, the user of the multi-function device 10 can efficiently designate one or all specific colors as a desired color arrangement pattern to be color-converted based on the display content of the conversion selection screen.

  In the present embodiment, the communication system 1 corresponds to an example of an image information control system of the present invention. The configuration including the mediation server 20 and the conversion server 30 corresponds to an example of the image information control apparatus of the present invention. The multi-function device 10 corresponds to an example of an image processing apparatus of the present invention. The network interface 21 of the mediation server 20 and the network interface 31 of the conversion server 30 correspond to an example of the communication interface of the present invention. The CPU 23 of the mediation server 20 and the CPU 33 of the conversion server 30 correspond to an example of a control unit of the present invention. The memory 34 of the conversion server 30 corresponds to an example of a storage unit of the present invention.

  The color arrangement pattern image corresponds to an example of the color arrangement pattern information of the present invention. The scanned document image corresponds to an example of the target image of the present invention. The scanned original image data corresponds to an example of target image information of the present invention. The color converted image corresponds to an example of the converted image of the present invention. The conversion identification information corresponds to an example of conversion request information according to the present invention. The thumbnail list image (FIG. 5) corresponds to an example of the list image of the present invention, and each thumbnail in the thumbnail list image corresponds to an example of the list printing image of the present invention, and each text information in the thumbnail list image. Corresponds to an example of the color arrangement pattern information image of the present invention, and the thumbnail list image data corresponds to an example of the list image information of the present invention. The conversion result selection information corresponds to an example of the designation information of the present invention, and one color converted image designated by the conversion result selection information corresponds to an example of the specific conversion image of the present invention, and the data of the color conversion image is This corresponds to an example of the specific converted image information of the present invention. The conversion result selection screen (FIG. 4C) corresponds to an example of the specific selection screen of the present invention, and each icon 131, 132, 133... In the conversion result selection screen is an example of the selection image of the present invention. The conversion result selection screen data corresponds to an example of the specific selection screen information of the present invention. The conversion selection screen (FIG. 4B) corresponds to an example of the initial selection screen of the present invention, and the conversion selection screen data corresponds to an example of the initial selection screen information of the present invention. The operation of selecting a thumbnail corresponding to a desired color arrangement pattern from the respective thumbnails on the conversion result selection screen corresponds to an example of the specifying operation of the present invention.

  The process in which the CPU 33 of the conversion server 30 acquires the upload message transmitted from the multi-function device 10 in S220 of FIG. 7 corresponds to an example of the target image acquisition process of the present invention. The process in which the CPU 23 of the mediation server 20 receives the conversion identification information transmitted from the multi-function device 10 in S136 of FIG. 6 corresponds to an example of the conversion request acquisition process of the present invention. In FIG. 11, the processing of S602 to S608 corresponds to an example of the converted image generation processing of the present invention, and the processing of S612 corresponds to an example of the list image information generation processing of the present invention. The process of S512 in the download print process (detailed in FIG. 10) executed in S402 of FIG. 9 corresponds to an example of the first transmission process of the present invention. The process in which the CPU 23 of the mediation server 20 acquires the conversion result selection information transmitted from the multi-function device 10 in S414 in FIG. 9 corresponds to an example of the designation information acquisition process of the present invention. The process of S512 in the download print process (detailed in FIG. 10) executed in S418 of FIG. 9 corresponds to an example of the second transmission process of the present invention. The process of S406 in FIG. 9 corresponds to an example of the specific selection screen information transmission process of the present invention. The process of S132 in FIG. 6 corresponds to an example of the initial selection screen information transmission process of the present invention.

[Other Embodiments]
(1) In the above embodiment, when it is desired to print out a plurality of types of color conversion results as a thumbnail list, the color conversion results of all selectable color arrangement patterns are printed out. Instead, the color conversion results based on a specific plurality of color arrangement patterns may be printed out as a thumbnail list.

  For example, the user may arbitrarily select a plurality of color arrangement patterns to be printed out as a thumbnail list. Further, for example, it may be possible to print and output as a thumbnail list collectively for each major classification of color arrangement patterns (for example, all color arrangement patterns corresponding to “colorful”, all color arrangement patterns corresponding to “rainbow”, etc.).

  (2) It is not always necessary to add text information to the conversion selection screen illustrated in FIG. 4B, the conversion result selection screen illustrated in FIG. 4C, and the thumbnail list image illustrated in FIG. . Conversely, for each of the screens in FIGS. 4B and 4C, the thumbnails may not be displayed, and other various types of information (for example, only text information) may be displayed.

  With respect to the conversion selection screen in FIG. 4B, as long as the user can appropriately select a desired option, the type and number of information to be displayed can be determined as appropriate. As for the thumbnail list image of FIG. 5, as long as the user can appropriately confirm the color conversion result by each color arrangement pattern, the size of the thumbnail to be printed, the presence / absence and type of information to be added to the thumbnail can be determined as appropriate. Regarding the conversion result selection screen in FIG. 4C, it is only necessary to clearly understand the correspondence between each option displayed on the screen and each color conversion result printed and output as a thumbnail list image (see FIG. 5). That is, it is only necessary to know which of the options on the conversion result selection screen corresponds to the desired color conversion result among the color conversion results displayed in the thumbnail list image.

  (3) The user does not necessarily have to draw a handwritten manuscript with a black or gray writing instrument. For example, when a picture is drawn with a color other than black and is scanned by the multi-function device 10, a monochrome scan image may be generated by executing a monochrome scan instead of a color scan. Then, as a result, a monochrome original scan image is transmitted to the conversion server 30.

  Note that. When the user scans a color handwritten document drawn in a color other than black as it is, a color document scanned image is transmitted to the conversion server 30. In this case, for example, the conversion server 30 extracts a region other than white from, for example, a color original scan image, and colors the extracted region according to the selected color arrangement pattern. You may make it make it. In other words, all the regions other than white may be regarded as coloration target regions for color arrangement.

  (4) The original scan image does not necessarily need to be an image obtained by scanning the original drawn by the user himself. For example, a material published in a book, magazine, or other medium may be scanned by the multi-function device 10 and the scanned image may be transmitted to the conversion server 30. In addition, for example, not scanned images but image data input to the multi-function device 10 (for example, image data acquired via the Internet or image data input from a memory not shown) is transmitted to the conversion server 30. May be. That is, the image data generated and acquired by various methods may be transmitted to the conversion server 30 as image data to be color-converted so that color conversion can be performed.

  (5) In addition, the present invention is not limited to the specific means and structure shown in the above embodiment, and can take various forms without departing from the gist of the present invention. For example, a part of the configuration of the above embodiment is replaced with a known configuration having the same function, added to or replaced with the configuration of another embodiment, or omitted as long as the problem can be solved. May be. Moreover, you may comprise combining several said embodiment suitably.

DESCRIPTION OF SYMBOLS 1 ... Communication system, 2 ... LAN, 4 ... Internet, 10 ... Multi-function machine, 11 ... Operation part, 12 ... Display part, 13, 21, 31 ... Network interface, 14 ... Print execution part, 15 ... Scan execution , 16, 22, 32 ... control unit, 17, 23, 33 ... CPU, 18, 24, 34, 51 ... memory, 19, 25, 35 ... program, 20 ... mediation server, 30 ... conversion server, 36 ... A Application 37 ... B application 38 ... C application 41, 52 ... Template 42 ... Third template image data 50 ... Content server 53 ... First template image data 54 ... Second template image data 60 ... Paper 61 ... Material painting, 62 ... Original, 66-68 ... Object, 81-86, 91-95 ... Parts, 111 113 ... icon 121 ... all trial icon 122 ... first colorful icons, 123 ... first rainbow icon, 131-133 ... thumbnail.

Claims (9)

A control unit;
A storage unit;
A communication interface;
A plurality of predetermined color arrangement pattern information is stored in the storage unit, and the control unit can communicate with the image processing apparatus via the communication interface,
The controller is
A target image acquisition process for acquiring target image information representing a target image to be converted from the image processing device via the communication interface;
Conversion request acquisition processing for acquiring conversion request information from the image processing device via the communication interface;
When the conversion request information is acquired in the conversion request acquisition process, a converted image generation process for generating a converted image by converting the objects constituting the target image according to the color pattern information individually for each color pattern ,
A list image information generation process for generating list image information for causing the image processing apparatus to print out a list image including a list print image of the plurality of converted images generated by the converted image generation process;
A first transmission process for transmitting the list image information generated in the list image information generation process to the image processing apparatus via the communication interface;
The image information control apparatus characterized by performing. The image information control device according to claim 1,
The plurality of color arrangement pattern information indicated by the conversion request information is all of the plurality of predetermined color arrangement pattern information. The image information control apparatus according to claim 1 or 2,
The controller is
After the list image information is transmitted in the first transmission process, specific color pattern information designation information among the color pattern information corresponding to the list printing images in the list image from the image processing apparatus Specified information acquisition processing to acquire,
A specification indicating the specific conversion image for causing the image processing apparatus to print out a specific conversion image that is the conversion image corresponding to the color arrangement pattern information specified by the specification information acquired in the specification information acquisition processing A second transmission process for transmitting the converted image information to the image processing apparatus via the communication interface;
The image information control apparatus characterized by performing. The image information control device according to claim 3,
The controller is
After transmitting the list image information in the first transmission process, a specific selection screen for selecting specific color pattern information among the color pattern information corresponding to the list printing images in the list image A specific selection screen information transmission process for transmitting specific selection screen information to be displayed on the image processing device to the image processing device;
In the specified information acquisition process, the specific selection screen information is transmitted to the image processing apparatus by the specific selection screen information transmission process, so that the specific selection screen is displayed in the image processing apparatus, and based on the display contents. The designation information transmitted from the image processing apparatus is acquired by performing a designation operation for the specific color arrangement pattern information. The image information control device according to claim 4,
The specific selection screen information includes at least information on a plurality of selection images obtained by converting the target image based on the plurality of color arrangement pattern information indicated by the conversion request information. Information control device. The image information control device according to claim 4 or 5, wherein
In the list image, a color arrangement pattern information image indicating the corresponding color arrangement pattern information is added to each list printing image,
The image information control apparatus, wherein the specific selection screen information includes at least information corresponding to the color arrangement pattern information image for each image for list printing. The image information control device according to any one of claims 1 to 6,
The controller is
Initial selection screen information transmission for transmitting, to the image processing device, initial selection screen information for causing the image processing device to display an initial selection screen for selecting a plurality of color scheme pattern information used in the converted image generation processing. Execute the process,
In the conversion request acquisition process, after the initial selection screen information is transmitted to the image processing apparatus by the initial selection screen information transmission process, the initial selection screen is transmitted from the image processing apparatus to the initial selection screen. Information indicating a plurality of color arrangement pattern information selected on the basis of the information is acquired as the conversion request information. An image information control including a control unit, a storage unit, and a communication interface, wherein the storage unit stores a plurality of predetermined color scheme pattern information, and the control unit can communicate with the image processing apparatus via the communication interface. In the apparatus, the control unit is a program executable,
In the control unit,
A target image acquisition process for acquiring target image information representing a target image to be converted from the image processing device via the communication interface;
Conversion request acquisition processing for acquiring conversion request information from the image processing device via the communication interface;
When the conversion request information is acquired in the conversion request acquisition process, a converted image generation process for generating a converted image by converting the objects constituting the target image according to the color pattern information individually for each color pattern ,
A list image information generation process for generating list image information for causing the image processing apparatus to print out a list image including a list print image of the plurality of converted images generated by the converted image generation process;
A first transmission process for transmitting the list image information generated in the list image information generation process to the image processing apparatus via the communication interface;
A program for running An image processing apparatus having a function of printing at least an image;
An image information control device capable of communicating with the image processing device;
With
The image information control device includes:
A storage unit storing a plurality of predetermined color arrangement pattern information;
A communication interface;
A control unit capable of communicating with the image processing apparatus via the communication interface;
With
The controller is
A target image acquisition process for acquiring target image information representing a target image to be converted from the image processing device via the communication interface;
Conversion request acquisition processing for acquiring conversion request information from the image processing device via the communication interface;
When the conversion request information is acquired in the conversion request acquisition process, a converted image generation process for generating a converted image by converting the objects constituting the target image according to the color pattern information individually for each color pattern ,
A list image information generation process for generating list image information for causing the image processing apparatus to print out a list image including a list print image of the plurality of converted images generated by the converted image generation process;
And a first transmission process for transmitting the list image information generated by the list image information generation process to the image processing apparatus via the communication interface.