JP6273919B2 - Image information control apparatus, program, and image information control system - Google Patents

Description

  The present invention relates to an image information control apparatus capable of communicating with an image processing apparatus via a network, a program executed by the image information control apparatus, and an image information control system including the image information control apparatus and the image processing apparatus.

  The image processing apparatus described in Patent Document 1 has a built-in web browser and has a function of downloading and printing a web page. Further, the image processing apparatus has a function of converting scanned image data generated by scanning a document into a specific format such as JPEG or BMP, and transmitting the converted data to a web server.

JP 2008-229933 A

As described in Patent Document 1, various functions for transmitting image data from an image processing apparatus to a web server have been proposed.
On the other hand, it is desired to provide a service with high added value by performing more complex image processing than simple format conversion on the image data output from the image processing apparatus.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a service with high added value for image data output from an image processing apparatus.

  The present invention made to solve the above-described problems is an image information control apparatus that includes a control unit and a communication interface, and the control unit can communicate with the image processing apparatus via the communication interface. The control unit executes a first acquisition process, a second acquisition process, a third acquisition process, a synthesis process, a result generation process, and a transmission process.

  The first acquisition process is a process of acquiring first image information indicating the first image from the image processing apparatus via the communication interface. The second acquisition process is a process of acquiring second image information identification information, which is information for designating a second image to be combined with the first image, from the image processing apparatus via the communication interface. The third acquisition process is a process of acquiring second image information indicating the second image based on the second image information identification information acquired in the second acquisition process. In the composition processing, an image of a specific first area is extracted as a material image from the first image indicated by the first image information acquired in the first acquisition processing, and the material image information indicating the extracted material image and the first image are displayed. Processing for generating composite image information indicating a composite image obtained by combining the second image and the material image by combining the second image information acquired in the three acquisition processing according to a predetermined specific image composition method. It is. The result generation process prints out a composite result image, which is an image including the composite image indicated by the composite image information generated by the composite process, and the used material information indicating the material image used in the composite image, on the image processing apparatus. This is a process of generating synthesis result image information indicating a synthesis result image. The transmission process is a process of transmitting the synthesis result image information generated by the result generation process to the image processing apparatus via the communication interface.

  In the image information control apparatus of the present invention, after the second image and the material image are synthesized by the synthesis process, information of the synthesis result image (synthesis result image information) indicating the synthesis result is transmitted to the image processing apparatus. In addition to the synthesized image, the synthesized result image includes used material information indicating a material image used in the synthesized image (that is, a material image actually synthesized with respect to the second image information). As a result, when a composite result image is printed out in the image processing apparatus, it is possible to confirm what composite image has been generated based on the print output result, and which region of the first image is included. It can be confirmed whether it is synthesized as a synthesized image.

  Therefore, by looking at the synthesis result image, it is possible to efficiently confirm whether or not the generated synthesized image has the intended content, and an appropriate response according to the confirmation result can be performed. Therefore, according to the image information control apparatus of the present invention, it is possible to provide a service with high added value for the image data output from the image processing apparatus.

It is a block diagram which shows schematic structure of the communication system of embodiment. It is explanatory drawing which shows the outline | summary of the procedure of an image synthesis process. It is explanatory drawing which shows an example of a trial printing result. It is explanatory drawing which shows the state which the user re-designated the area | region with the red pen with respect to the trial printing result. It is explanatory drawing which shows the example of various screens displayed on the display part of a multifunctional device. It is a sequence diagram which shows a part of sequence of each process performed with a communication system. FIG. 7 is a sequence diagram showing a part of a sequence of each process executed in the communication system (continuation of FIG. 6). FIG. 8 is a sequence diagram showing a part of a sequence of each process executed in the communication system (continuation of FIG. 7). FIG. 9 is a sequence diagram showing a part of the sequence of each process executed in the communication system (continuation of FIG. 8). FIG. 10 is a sequence diagram showing a part of the sequence of each process executed in the communication system (continuation of FIG. 9). It is a flowchart which shows the image process performed by S310 of FIG.

Preferred embodiments of the present invention will be described below with reference to the drawings.
(1) Configuration of Communication System 1 As shown in FIG. 1, the communication system 1 of this embodiment includes a multi-function device 10, an intermediary server 20, a conversion server 30, and a content server 50. The multi-function device 10 is connected to the Internet 4 via the LAN 2. The mediation server 20, the content server 50, and the conversion server 30 are connected to the Internet 4.

  The multi-function device 10, the mediation server 20, the conversion server 30, and the content server 50 can execute communication using, for example, HTTP (abbreviation of HyperText Transfer Protocol) or HTTPS (abbreviation of HyperText Transfer Protocol Secure).

  More specifically, the multi-function device 10 operates as an HTTP client. The conversion server 30 operates as an HTTP server. The mediation server 20 operates as an HTTP server in communication with the multi-function device 10 and operates as an HTTP client in communication with the conversion server 30 without being obstructed by a firewall or the like provided in the LAN 2 or the like. Communication with the multi-function device 10 and communication with the conversion server 30 can be performed.

(2) Configuration of Multi-Function Device 10 The multi-function device 10 can execute various processes for realizing various functions such as a print function, a scan function, a copy function, and a FAX function. The multi-function device 10 includes an operation unit 11, a display unit 12, a network interface 13, a print execution unit 14, a scan execution unit 15, and a control unit 16.

  The operation unit 11 includes a plurality of keys and a touch panel arranged in a superimposed manner on the display area of the display unit 12. The user can input various instructions to the multi-function device 10 by operating the operation unit 11. The display unit 12 is a display for displaying various information. The network interface 13 is connected to the LAN 2. The multi-function device 10 can communicate with the mediation server 20, the conversion server 30, and the like via the network interface 13. The print execution unit 14 includes a printing mechanism such as an inkjet method or a laser method. The scan execution unit 15 includes a scan mechanism such as a CCD or CIS.

  The control unit 16 includes a CPU 17 and a memory 18. The CPU 17 executes various processes according to the program 19 stored in the memory 18. Each process of the multi-function device 10 in FIGS. 6 to 10 to be described later is realized by the CPU 17 executing the program 19 in the memory 18. The memory 18 may be a computer readable storage medium. The computer-readable storage medium is a non-transitory medium such as a ROM, RAM, flash memory, or hard disk. Note that an electrical signal carrying a program downloaded from a server on the Internet is not included in a non-transitory medium.

(3) Configuration of Mediation Server 20 Mediation server 20 is a server configured separately from conversion server 30 and content server 50. The mediation server 20 is a server for mediating communication of various data between the conversion server 30 and the multi-function device 10. The mediation server 20 is a server provided by the vendor of the multi-function device 10.

  The mediation server 20 includes a network interface 21 and a control unit 22. The mediation server 20 can communicate with the multi-function device 10, the content server 50, the conversion server 30, and the like via the network interface 21. The control unit 22 includes a CPU 23 and a memory 24. A program 25 is stored in the memory 24. The CPU 23 executes various processes according to the program 25. Each process of the mediation server 20 in FIGS. 6 to 10 described later is realized by the CPU 23 executing the program 25 in the memory 24. Similar to the memory 18 of the multi-function device 10, the memory 24 may be a computer-readable storage medium.

(4) Configuration of Conversion Server 30 The conversion server 30 is a server configured separately from the mediation server 20 and the content server 50. The conversion server 30 is a server for executing various processes to be described later on input image data.

  The conversion server 30 may be a server provided by the vendor of the multi-function device 10. The conversion server 30 includes a network interface 31 and a control unit 32. The control unit 32 includes a CPU 33 and a memory 34. The memory 34 stores a program 35 and a template 41. The CPU 33 executes various processes according to the program 35. Each process of the conversion server 30 in FIGS. 6 to 10 to be described later is realized by the CPU 33 executing the program 35 in the memory 34. The template 41 includes third template image data 42 as image data used for image processing. Similar to the memory 18 of the multi-function device 10, the memory 34 may be a computer-readable storage medium.

  The program 35 includes an A application 36, a B application 37, and a C application 38 as programs for performing image processing. The third template image data 42 is used when the C application 38 is executed.

  The A application 36 is an application for executing processing for combining the output image output from the multi-function device 10 and the first template image for the A application. Specifically, the output image from the multi-function device 10 is combined with a specific area (eg, a transparent area) included in the first template image.

(5) Configuration of Content Server 50 The content server 50 is a server configured separately from the mediation server 20 and the conversion server 30. The content server 50 may be a server provided by the vendor of the multi-function device 10. The content server 50 includes a memory 51. A template 52 is stored in the memory 51.

  The template 52 includes first template image data 53 and second template image data 54. The first template image data 53 is image data for displaying the first template image described above. The second template image data 54 is image data used when the B application 37 is executed.

  When the conversion server 30 executes the A application 36 and the B application 37, it is necessary to obtain image data of the template image selected by the multi-function device 10 from the content server 50. On the other hand, when the conversion server 30 executes the C application 38, the image data of the template image selected by the multi-function device 10 may be read from the memory 34 in the conversion server 30. It is not necessary to acquire from the content server 50.

  Here, notes on description in this specification will be described. In this specification, the description “the CPU 23 of the mediation server 20 receives various types of information” means “the CPU 23 of the mediation server 20 acquires various types of information via the network interface 21”. Is included. In addition, the description “the CPU 23 of the mediation server 20 transmits various types of information” includes the technical content that “the CPU 23 of the mediation server 20 outputs various types of information via the network interface 21”. It shall be. Note that similar precautions exist for the CPU 33 and the network interface 31 of the conversion server 30. Similar precautions exist for the CPU 17 and the network interface 13 of the multi-function device 10.

  Next, the definition of the words “data” and “information” will be described. In this specification, “data” and “information” use “information” as a superordinate concept of “data”. Therefore, “A data” may be rephrased as “A information”. Further, “information” is treated as the same information as long as it is recognized as the same meaning content even if the format as “data” (for example, text format, binary format, flag format, etc.) is different. For example, as long as the apparatus handles information indicating that the number of copies is two, text data “COPY = 2” and binary data “10” are the same information.

  In the present specification, a mode in which the mediation server 20, the conversion server 30, and the content server 50 are connected via the Internet 4 (that is, a device that functions as each of the mediation server 20, the conversion server 30, and the content server 50 is physically However, the application of the present invention is not limited to such a form. For example, at least two of the mediation server 20, the conversion server 30, and the content server 50 may be realized by one server device. For example, when the mediation server 20 and the conversion server 30 are realized by one server device, the program that functions as the mediation server 20 and the program that functions as the conversion server 30 are operated in the one server device, The communication may be performed via a bus line in the server device. In the case where the mediation server 20 and the conversion server 30 are configured by a single server device, the communication described in this specification as the communication between the mediation server 20 and the conversion server 30 is the mediation server. Data exchange between the program functioning as 20 and the program functioning as the conversion server 30 may be replaced. Further, a program that functions as the mediation server 20 and also functions as the conversion server 30 may be realized in a form that operates on one server device. In this case, the communication described in this specification as the communication between the mediation server 20 and the conversion server 30 functions as the mediation server 20 and passes data within a program that also functions as the conversion server 30. It may be replaced with.

(6) Description of Favorite Material Composition Function Implemented in Communication System 1 The communication system 1 of the present embodiment can implement a plurality of types of image processing functions. That is, in the communication system 1, image data (scanned image data) of an image (scanned image) scanned by the multi-function device 10 is subjected to image processing by the conversion server 30, and the result is acquired by the multi-function device 10 and printed out. It is possible.

  Although there are various types of image processing functions, at least three of them are image processing functions that are realized by executing the three applications 36 to 38 described above. Detailed description of the image processing function by the B application 37 and the C application 38 is omitted. The image processing function by the A application 36 is a favorite material composition function. The favorite material composition function can synthesize a scan image scanned by the user in the multi-function device 10 and a specific template image selected by the user, and print the synthesized image (composite image) on the multi-function device 10. It is a function to make it.

  A specific procedure for image composition using the favorite material composition function will be described. When the user of the multi-function device 10 wants to use the favorite material composition function, first, the multi-function device 10 selects the A application 36.

  Next, the user selects a template image in the multi-function device 10. There are multiple template image options that can be selected. Information about what kind of template image exists is transmitted from the content server 50 to the multi-function device 10 via the mediation server 20 (S132 (FIG. 6) described later), and the display unit of the multi-function device 10 is used as a template selection screen. 12 (S134 (FIG. 6) described later). The template selection screen is a screen for displaying a list of reduced images (thumbnail images) of template images (images indicated by the first template image data) corresponding to the A application 36 and accepting an operation for selecting one template image from the list. It is. Hereinafter, a template image selected by the user from among the template images displayed as a list on the template selection screen is referred to as a selected template image.

  Next, the user scans a document of a desired material to be combined with the selected template image. Data (material scanned image data) of a scanned original document image (material scanned image) is transmitted (uploaded) from the multi-function device 10 to the conversion server 30.

  An example of the material scan image and the selected template image is shown in the upper part of FIG. In the example of FIG. 2, the material scan image is an image of a plant leaf. Actually, the color image is mainly green. The selected template image is an image including an animal pattern and characters, mainly intended for use on New Year's cards. In the selected template image, in practice, an image area that substantially functions as image information such as a character or a pattern is white, and the color of other areas (blank areas) is gray.

  In the multi-function device 10, when transmission of material scan image data and selection of a template image are performed, the conversion server 30 performs image processing (composition processing) for combining the material scan image data and the template image data.

  Specifically, the synthesis process is performed as follows. The conversion server 30 extracts an image (material image) of a specific area to be combined with the selected template image from the material scan image indicated by the material scan image data. An algorithm for extracting a material image from the entire material scan image is determined in advance. The conversion server 30 extracts a material image from the material scan image according to the algorithm.

  In the present embodiment, as illustrated in the middle part of FIG. 2, an image in a specific rectangular area is extracted as a material image from the entire material scan image. FIG. 2 illustrates three extraction patterns A to C.

  When the conversion server 30 extracts the material image from the material scan image, the conversion server 30 combines the material image and the selected template image by a predetermined image combining method. In the present embodiment, the material image is a part of the material scan image and is smaller in image size than the selected template image. For this reason, in the present embodiment, the material images are continuously arranged vertically and horizontally with respect to the entire area of the selected template image. Then, the white area in the selected template image is given priority over the white area, and the material image is not displayed. On the other hand, the gray area in the selected template image is given to the front with priority given to the material image. That is, the material image is exposed in the gray area.

  An example of the result of synthesis processing (synthesized image) by such an image synthesis method is shown in the lower part of FIG. Of the three composite images shown in FIG. 2, the composite image A is a composite result of the material image extracted by the extraction pattern A and the selected template image. The composite image B is a composite result of the material image extracted by the extraction pattern B and the selected template image. The composite image C is a composite result of the material image extracted with the extraction pattern C and the selected template image. In any case, a plurality of material images are continuously arranged vertically and horizontally with respect to the selected template image. For example, in the case of the composite image A, the material images are continuously arranged in 4 rows and 6 columns.

  The conversion server 30 generates composite image data of a composite image obtained by combining the material image and the selected template image by performing the composite processing of the material image data and the selected template image data as described above. When generating the composite image data, the conversion server 30 further generates image data of the trial print image (trial print image data).

  The trial print image is an image to be printed out by the multi-function device 10. As illustrated in FIG. 3, the test print image mainly includes a print image image 61, a material scan image 62, and a material extraction region image 63. , And a note image 64. The print image 61 is substantially the composite image itself generated by the above-described composite processing, and in order to present to the user that such a print result can be obtained when finally printed on a postcard. It is an image. The material scan image 62 is a material scan image scanned by the multi-function device 10 and transmitted to the conversion server 30. The material extraction region image 63 is an image indicating which region of the material scan image 62 is used as a material image. In the present embodiment, the material extraction area image 63 is a rectangular image surrounding an area corresponding to the material image in the material scan image 62. This indicates that the area surrounded by the rectangular image is used as the material image. The annotation image 64 is an image for presenting information related to precautions and the next operation to the user who has acquired the print result of the trial print image.

  The user sees the print image 61 in the printed test print image, and if there is no problem, the user can proceed to actual printing (for example, printing on a postcard) as it is. On the other hand, when the print image 61 has contents not intended by the user (for example, when an unintended area is used as a material image), the user can specify a desired area and redo the image composition. it can.

  Specifically, as shown in FIG. 4, a desired region to be used as a composition material is surrounded with a red pen (writing tool) with respect to the material scan image 62 in the printed test print image. That is, the user directly fills in a red pen surrounded by a red pen (rectangular closed loop, hereinafter referred to as “red pen box”) 65 on a print medium on which a trial print image is printed. In FIG. 4, the red pen box 65 is indicated by a broken line, but is actually a red line written by the user.

  On the other hand, when the trial print image data is downloaded from the conversion server 30, a correction execution selection screen as shown in FIG. 5A is displayed on the display unit 12 of the multi-function device 10. This correction execution selection screen is a screen for asking the user about the intention to correct (redo) image synthesis, and displays “Yes” and “No” options. If the user selects “No”, the process proceeds to normal regular print processing. When the user selects “Yes”, the corrected document scanning instruction screen shown in FIG. 5B is displayed on the display unit 12. In the corrected document scan instruction screen, a message for instructing the user to set the multi-function device 10 to scan the test print document in which the red pen box 65 is written and an “OK” button are displayed.

  When the user sets a trial print document in which the red pen box 65 is written on the multi-function device 10 and taps an “OK” button on the correction document scan instruction screen, the multi-function device 10 performs a scan, and the scan is performed. Data (corrected and completed scanned image data) of the image (modified and completed scanned image) is transmitted (uploaded) to the conversion server 30.

  As one of the cases where the printed print image 61 has contents not intended by the user, the scanned image itself is in an inappropriate state (for example, it is unclear or the color is not reproduced). It is possible that In that case, the user can redo the scanning of the material itself.

  When the conversion server 30 receives the corrected completed scan image data from the multi-function device 10, the conversion server 30 performs a recognition process for the red pen box 65. The conversion server 30 recognizes the red pen box 65 by detecting an image having a substantially rectangular loop shape in red or a color close to it from the corrected scan image. At that time, not only the red pen box 65 is recognized, but the area surrounded by the red pen box 65 in the entire material scan image 62 is relatively detected. That is, based on the relative positional relationship between the recognized red pen box 65 and the material scan image 62, re-recognition of which region of the entire material scan image 62 should be used as the material image is also performed.

  When the conversion server 30 cannot detect the red pen box 65, a box area detection error screen as shown in FIG. 5C is displayed on the display unit 12 of the multi-function device 10. Possible causes of the red pen box 65 being unrecognizable are, for example, that the red pen box 65 is surrounded by a color different from red, the box shape is not rectangular, or a plurality of points are surrounded.

  Various processing can be considered specifically when the red pen box 65 cannot be recognized, but in this embodiment, following the display of the surrounding area detection error screen (or in addition to the display contents). For example, options (not shown) of “execute trial printing again” and “scan again” are displayed to allow the user to select which one is appropriate. For example, when the user selects “execute trial printing again”, the trial print image data generated earlier is retransmitted to the multi-function device 10. When the same trial print image data is transmitted to the multi-function device 10 again, the multi-function device 10 prints out the test print image again. This allows the user to re-write the red pen box 65 and rescan. Conversely, when the user selects “scan again”, the process returns to the beginning of the procedure (scanning of the original document).

  In addition to the content of the surrounding area detection error screen shown in FIG. 5C (or by switching the display content after the screen is displayed), the cause of the failure or advice to the user may be displayed. . For example, if no entry with a red pen is detected, a message “Please check if it is enclosed with a pen of the correct color” may be displayed. Also, for example, if there was an entry with a red pen but there was no enclosure (closed loop), the message “Please check if it is enclosed in a square” should be displayed. May be. Further, for example, when two or more enclosures are detected, a message “only one can be enclosed” may be displayed.

  When the conversion server 30 recognizes the red pen box 65 and re-extracts the material image from the material scan image (already acquired in the previous image composition) based on the recognition result, the conversion material 30 and the newly extracted new material image and The selected template image is synthesized. Thereby, composite image data of a new composite image in which the material image is corrected is generated, and new test print image data including the new composite image data is further generated. The new test print image data generated in this way is transmitted to the multi-function device 10 and printed out. In the multi-function device 10, as in the previous print output, it is possible to check whether the composite image has the intended content by looking at the printed test print image.

(7) Operation of Communication System 1 The operation of the communication system 1 will be described with reference to the sequence diagrams of FIGS. In the following description, a series of processes (S110 to S136) illustrated in FIG. 6 among the operation examples continuously illustrated in FIGS. 6 to 10 are collectively referred to as an initial selection process. A series of processes (S202 to S232) shown in FIG. 7 are collectively referred to as a scan upload process. A series of processes (S300 to S326) shown in FIG. 8 are collectively referred to as a conversion process. A series of processes (S402 to S420) shown in FIG. 9 are collectively referred to as a download print process. A series of processes (S502 to S516) shown in FIG. 10 are collectively referred to as a correction acceptance process.

  The initial selection process in FIG. 6 will be described sequentially. When the CPU 17 of the multi-function device 10 is turned on and receives a command to display the main screen, the CPU 17 displays the main screen on the display unit 12 in S110. The main screen is, for example, a screen for selecting one of an application function and a menu function, and displays an image showing each selectable function and its function name. The application function is a function that performs applied processing such as processing for generating an image on the address side and the back side of the New Year's card. The menu function is a function for performing processing for performing various settings of the multi-function device 10.

  When an operation for selecting any function is performed on the multi-function device 10 (for example, a tap operation on an image of a corresponding function), the CPU 17 sends function identification information indicating the selected function to the mediation server 20 in S112. Send.

  When receiving the function identification information from the multi-function device 10, the CPU 23 of the mediation server 20 determines the function indicated by the function identification information in S114. If a menu function is indicated (S114: menu function), a menu function execution process is performed. The details of the menu function execution process will be omitted. On the other hand, if an application function is indicated (S114: application function), the process proceeds to S116.

  In S116, the CPU 23 of the mediation server 20 generates application selection screen data. The application selection screen is a screen to be displayed on the multi-function device 10 and is a screen for accepting selection of any one of a plurality of application functions. The application selection screen includes images showing the A application 36, the B application 37, and the C application 38. The CPU 23 of the mediation server 20 transmits the application selection screen data to the multi-function device 10 in S118.

  When receiving the application selection screen data from the mediation server 20, the CPU 17 of the multi-function device 10 displays the application selection screen on the display unit 12 in S120. The user of the multi-function device 10 can operate the operation unit 11 to select (for example, tap operation) an image representing a desired application from the application selection screen. When the user performs an operation of selecting an image representing an application, the CPU 17 of the multi-function device 10 transmits application identification information to the mediation server 20 in S122. The application identification information is information for identifying a selected application that is an application selected by the user.

  In S124, the CPU 23 of the mediation server 20 identifies the selected application based on the application identification information, and generates template list information acquisition request information corresponding to the selected application. The template list information acquisition request information is information for requesting the content server 50 for template list information that is necessary for displaying a list of template images corresponding to the selected application.

  Here, assuming that the selected application is the A application 36, the description of S124 and subsequent steps will be made. As described above, the A application 36 is an application for realizing a favorite material composition function. The CPU 23 of the mediation server 20 transmits the template list information acquisition request information to the content server 50 in S126. Since the selected application is the A application 36, S126 is a process for requesting the content server 50 for template list information for displaying a list of first template images.

  The CPU 23 of the mediation server 20 receives the template list information transmitted from the content server 50 in S128. In S130, template selection screen data for displaying a template selection screen is generated. The template selection screen data is generated based on the template list information received in S128. In S132, the template selection screen data is transmitted to the multi-function device 10.

  When receiving the template selection screen data from the mediation server 20, the CPU 17 of the multi-function device 10 causes the display unit 12 to display the template selection screen in S134. The template selection screen displayed here includes thumbnail images of a plurality of template images (images indicated by the first template image data) corresponding to the A application 36 as described above.

  The user operates the operation unit 11 to select a thumbnail image corresponding to a template image to be used from a plurality of thumbnail images. Thereby, one template image (selected template image) for which the user desires image composition is selected. In the present embodiment, the description will be continued on the assumption that the template image illustrated in the upper part of FIG. 2 is selected by the user.

In step S136, the CPU 17 of the multi-function peripheral 10 transmits template identification information for identifying the selected template image to the mediation server 20.
After the process of S136, the process proceeds to the scan upload process of FIG. When the CPU 23 of the mediation server 20 proceeds to the scan upload process of FIG. 7, the image process upload data ID acquisition request information is transmitted to the conversion server 30 in S202. The image processing upload data ID acquisition request information includes an image processing upload data ID (hereinafter abbreviated as “UL-ID”) for identifying upload data to be uploaded from the multi-function device 10 to the conversion server 30. This is information for requesting for. In S <b> 204, the CPU 33 of the conversion server 30 transmits the UL-ID to the mediation server 20.

  In S206, the CPU 23 of the mediation server 20 generates scan upload execution command information. The scan upload execution command information is information for instructing the multi-function device 10 to scan a document to be used as a material and upload the material scan image (upload data) to the conversion server 30. In S <b> 208, the CPU 23 of the mediation server 20 transmits scan upload execution command information to the multi-function device 10. The scan upload execution command information may include a UL-ID.

  In step S <b> 209, the CPU 17 of the multi-function device 10 displays a document scan instruction screen on the display unit 12. On the document scan instruction screen, a message for instructing the user to set and scan a document to be used as a material on the multi-function device 10 and an “OK” button are displayed. When the user operates the “OK” button (for example, a tap operation), the document is scanned in S210. In S <b> 210, the CPU 17 operates the scan execution unit 15 to read the image of the document, and creates data (material scan image data) of the read image (material scan image).

  In S <b> 212, the CPU 17 of the multi-function device 10 transmits image processing upload destination URL (Uniform Resource Locator) acquisition request information and communication format acquisition request information to the mediation server 20. “Image processing upload” is a process of uploading various data to the conversion server 30 for image processing. The image processing upload destination URL acquisition request information is information for requesting the mediation server 20 for an image processing upload destination URL, which is information necessary for uploading to the conversion server 30. The communication format acquisition request information is information for requesting a communication format of an upload message described later.

  In S214, the CPU 23 of the mediation server 20 creates a communication format for the upload message. The communication format of the upload message is information serving as a message framework when uploading the material scan image data to the conversion server 30. In S <b> 216, the CPU 23 of the mediation server 20 transmits the image processing upload destination URL and the communication format of the upload message to the multi-function device 10. An example of the image processing upload destination URL is the URL of the conversion server 30.

  In S218, the CPU 17 of the multi-function device 10 creates an upload message based on the received communication format, the received image processing upload destination URL, and the material scan image data created in S210. Specifically, the multi-function device 10 has a material scan image data (binary data), an image processing upload destination URL, a data size of the material scan image data, and the like at predetermined positions in the communication format received from the mediation server 20. Combine various information. A UL-ID may be included. Thereby, an upload message corresponding to the conversion server 30 is created.

  In S <b> 220, the CPU 17 of the multi-function device 10 transmits an upload message to the conversion server 30. In S <b> 222, the CPU 33 of the conversion server 30 transmits image processing upload result information to the multi-function device 10. The image processing upload result information is information indicating whether or not the material scan image data has been normally uploaded to the conversion server 30. In S <b> 224, the CPU 17 of the multi-function device 10 transmits the received image processing upload result information and continuation permission determination request information to the mediation server 20. The continuation permission determination request information is information for requesting the mediation server 20 to determine whether or not image processing can be continued.

  In S226, the CPU 23 of the mediation server 20 decrypts the image processing upload result information and creates a decryption result. Since the image processing upload result information is information transmitted from the conversion server 30 to the multi-function device 10, the image processing upload result information has specifications specific to the conversion server 30. Therefore, by using a decoding program (not shown) included in the program 25 stored in the mediation server 20, the image processing upload result information can be decoded. The decryption result is a message in a format that can be decrypted by the multi-function device 10. The decryption result includes the image processing upload result included in the decrypted image processing upload result information. Further, the CPU 23 of the mediation server 20 generates continuation continuity information, which is information about whether or not image processing can be continued, based on the decoding result. For example, if the decryption result indicates that the upload process has failed, continuation permission / prohibition information indicating that image processing cannot be continued is generated. In S <b> 228, the CPU 23 of the mediation server 20 transmits the decryption result and the continuation permission / inhibition information to the multi-function device 10.

  In S230, the CPU 17 of the multi-function peripheral 10 determines whether or not image processing (compositing processing) can be continued based on the received continuation permission / inhibition information. If the image processing cannot be continued (S230: NO), the processing of the selected application is terminated. If the image processing can be continued (S230: YES), the process proceeds to S232. In S <b> 232, the CPU 17 of the multi-function peripheral 10 transmits upload completion notification information indicating that the scan image data upload process to the conversion server 30 has been completed to the mediation server 20.

  After the process of S232, the process proceeds to the conversion process of FIG. When the CPU 23 of the mediation server 20 proceeds to the conversion process of FIG. 8, it generates image processing input information in S300. The input information for image processing is information necessary for causing the conversion server 30 to perform image processing (here, image composition). Specifically, the image processing input information includes a material scan image UL-ID, a selection template parameter, and a selection application parameter.

  The UL-ID of the material scan image is the UL-ID acquired from the conversion server 30 prior to the instruction to scan the material scan image to the multi-function device 10 (S208), that is, the UL-ID acquired in S204. It is. The selected application parameter is information for uniquely identifying the selected application selected by the user. With the selected application parameter, it is possible to designate an application (in this example, application A) for executing image processing. The selection template parameter is information for uniquely identifying the selection template image selected by the user. The selection template parameter may be described by a URL description method.

  In S <b> 302, the CPU 23 of the mediation server 20 transmits the trial print image processing request information and the image processing input information generated in S <b> 300 to the conversion server 30. The trial print image processing request information is obtained by executing image processing (compositing processing) on the material scan image data identified by the UL-ID received in S204 (that is, upload data uploaded to the conversion server 30 in S220). It is information for requesting. Further, by transmitting the image processing input information to the conversion server 30 in S302, the conversion server 30 can acquire the material scan image data based on the UL-ID of the material scan image, and select the selected template based on the selected template parameter. Image data can be acquired from the content server 50, and based on the selected application parameter, it can be recognized that the image processing (application) to be executed is the image processing of the A application 36 (ie, image composition processing).

  In S <b> 304, the CPU 33 of the conversion server 30 transmits processing data acquisition information to the mediation server 20. The processing data acquisition information may include an image processing job ID that is information for identifying image processing performed in response to the processing requesting execution of image processing (S302). The processing data acquisition information may be described by a URL description method.

  In S <b> 306, the CPU 33 of the conversion server 30 transmits template acquisition request information to the content server 50. The template acquisition request information is information for acquiring selected template image data identified by the selected template parameter from the content server 50. In S <b> 308, the CPU 33 of the conversion server 30 acquires the selected template image data from the content server 50. In step S310, image processing by the A application 36, that is, composition processing of material scan image data and selected template image data is started. Details of the image processing started in S310 will be described later.

  The processes of S312 to S326 are processes for causing the multi-function device 10 to wait until image processing is completed when starting image processing for material scanned image data. In S <b> 312, the CPU 23 of the mediation server 20 transmits image processing completion confirmation request information to the conversion server 30. The image processing completion confirmation request information is information for confirming to the conversion server 30 whether or not the image processing requested to the conversion server 30 in S302 is completed. The CPU 23 of the mediation server includes the processing data acquisition information transmitted by the conversion server 30 in S304 in the image processing completion confirmation request information in order to identify the image processing.

  In S314, the CPU 33 of the conversion server 30 determines whether the image processing is completed. Specifically, the image processing corresponding to the processing data acquisition information included in the image processing completion confirmation request information is specified as image processing for determining whether image processing can be completed. Then, in the identified image processing, it is determined whether or not the composition of the material scan image data and the selected template image data has been completed. If the image processing has not been completed (S314: NO), the process proceeds to S316.

  In S <b> 316, the CPU 33 of the conversion server 30 transmits image processing incomplete notification information indicating that the image processing has not been completed to the mediation server 20. In S318, the CPU 23 of the mediation server 20 generates a standby command based on the reception of the image processing incomplete notification information. The standby command is a command for causing the multi-function device 10 to wait for completion of image processing.

  In S <b> 320, the CPU 23 of the mediation server 20 transmits a standby command to the multi-function device 10. In step S322, the CPU 17 of the multi-function peripheral 10 executes standby processing that waits for completion of image processing. In S324, the CPU 17 of the multi-function peripheral 10 transmits standby process completion information indicating that the execution of the standby process has been completed to the mediation server 20. The CPU 23 of the mediation server 20 waits for reception of standby processing completion information from the multi-function device 10 after transmitting a standby command in S320. When the standby process completion information is received from the multi-function device 10 in S324, the process returns to S312.

  On the other hand, if the conversion server 30 determines that the image processing has been completed in S314 (S314: YES), the process proceeds to S326. In S326, the CPU 33 of the conversion server 30 transmits to the mediation server 20 image processing completion notification information indicating that the image processing has been completed, that is, that the composition of the material scan image and the selected template image has been completed. After the process of S326, the process proceeds to the download print process of FIG.

  Details of the image processing started in S310 will be described with reference to FIG. When the image processing shown in FIG. 11 is started, the CPU 33 of the conversion server 30 determines in step S602 whether the input includes a material scan image and a selected template image (specifically, their data). More specifically, it is determined whether or not the image processing input information acquired in S302 includes the UL-ID of the material scan image and the selected template parameter. When one of the material scan image (specifically, its UL-ID) and the selected template image (specifically, the selected template parameter) is missing as input (S602: NO), in S618, the input image Error processing is executed, and the entire processing of the favorite material composition function is terminated.

  If a material scan image and a selected template image are included as inputs (S602: YES), it is determined in S604 whether or not a corrected completed scan image (specifically, data thereof) is included in the input. More specifically, it is determined whether or not the image processing input information acquired in step S302 includes the UL-ID of the corrected and completed scanned image. As illustrated in FIG. 4, the corrected and completed scan image is an image obtained by scanning the multi-function device 10 with an image in which the user has entered the red pen box 65 on the test print original. If the input image does not include a corrected scan image (S604: NO), the process proceeds to S610. In step S610, a range to be handled as a material image (a range to be extracted) is calculated from the material scan image based on the algorithm described above. After calculating the range of the material image in S610, the process proceeds to S612.

  If it is determined in step S604 that a scan image with correction entry is included in the input (S604: YES), it is determined in step S606 whether a red pen box has been detected from the scan image with correction entry. If a red pen box cannot be detected (S606: NO), a box detection error process is executed in S620, and the entire process of the favorite material composition function is terminated. Specifically, the enclosure detection error processing in S620 is performed via the mediation server 20 with information for causing the display unit 12 of the multi-function device 10 to display the enclosure area detection error screen as illustrated in FIG. Including a process of transmitting to the multi-function device 10. An example of processing after the surrounding area detection error screen is displayed is as already described.

  If it is determined in S606 that a red pen box has been detected (S606: YES), the process proceeds to S608. In step S608, a range to be handled as a material image is calculated from the red pen box in the corrected and completed scan image. That is, the range of the material image to be newly extracted is calculated based on the relative positional relationship between the material scan image and the red pen box written in the material scan image.

  In S612, based on the range of the material image calculated in S608 or S610, a material image (specifically, image data thereof) is extracted from the scanned image. If the process has proceeded from S608 to S612, the image of the area surrounded by the red pen is re-extracted as a material image in S612.

  In S614, a synthesized image (synthesized image data) is generated by synthesizing the selected template image and the material image extracted in S612 by a predetermined image synthesis method. In the present embodiment, the image is synthesized by the image synthesis method illustrated with reference to FIG.

  In S616, image data (trial print image data) of the trial print image (see FIG. 3) including the composite image data generated in S614 is generated. When the process proceeds to S616 via S608, the material extraction area image 63 in the trial print image data is an image showing the area surrounded by the red pen box. When the trial print image data is generated in S616, the image processing ends.

  When the CPU 23 of the mediation server 20 proceeds to the download print process of FIG. 9, in S402, it generates process data acquisition command information. Note that steps S <b> 402 to S <b> 420 are processes for causing the multi-function device 10 to print out the trial print image data generated by the image processing in the conversion server 30. The processing data acquisition command information may be described by a URL description method.

  When generating the processing data acquisition command information, the CPU 23 of the mediation server 20 transmits the processing data acquisition command information to the multi-function device 10 in S404. In S <b> 406, the CPU 17 of the multi-function device 10 transmits the download source URL request information and the processing data acquisition information request information to the mediation server 20. The download source URL request information is information requesting the mediation server 20 for a download source URL for accessing the processing data (trial print image data in this example) for which image processing completion confirmation has been performed in S312. . The processing data acquisition information request information is information for identifying the job that generated the processing data for which image processing completion confirmation has been performed in S312.

  In S <b> 408, the CPU 23 of the mediation server 20 generates a download source URL and process data acquisition information for acquiring process data from the conversion server 30, and transmits the generated data to the multi-function device 10. In S410, the CPU 17 of the multi-function device 10 transmits download request information for downloading the processing data identified by the processing data acquisition information to the conversion server 30 based on the download source URL. In S <b> 412, the CPU 33 of the conversion server 30 transmits the processing data specified by the download request information to the multi-function device 10. The trial print image data is transmitted to the multi-function device 10 by the transmission process of S412.

  In step S414, the CPU 17 of the multi-function peripheral 10 causes the print execution unit 14 to execute print processing. That is, the trial print image generated by the image processing by the conversion server 30 is printed on the printing paper. When the print output of the trial print image is completed, the CPU 17 of the multi-function peripheral 10 transmits print completion notification information indicating that the printing process is completed to the mediation server 20 in S416. In S <b> 418, the CPU 23 of the mediation server 20 transmits processing completion notification information to the multi-function device 10. In S <b> 420, the CPU 17 of the multi-function device 10 displays a completion screen on the display unit 12.

  After the process of S420, the process proceeds to the correction acceptance process of FIG. When the CPU 23 of the mediation server 20 proceeds to the correction acceptance process of FIG. 10, in S502, the correction execution selection screen data is generated. The modification execution selection screen data is data for causing the multi-function device 10 to display a modification execution selection screen as illustrated in FIG. In step S <b> 504, the CPU 23 of the mediation server 20 transmits the generated correction execution selection screen data to the multi-function device 10.

  When the CPU 17 of the multi-function device 10 receives the correction execution selection screen data from the mediation server 20, the CPU 17 displays the correction execution selection screen indicated by the correction execution selection screen data on the display unit 12 in S506. In step S <b> 508, the CPU 17 of the multi-function device 10 determines which one of the “Yes” and “No” options displayed on the correction execution selection screen has been selected. When “No” is selected (S508: NO), the process proceeds to S509, and normal processing is executed after trial printing. That is, the image data of the composite image finally generated by the conversion server 30 is transmitted from the conversion server 30 to the multi-function device 10. As a result, the multi-function device 10 can print the composite image on a desired print medium (for example, a postcard).

  When “Yes” is selected while the correction execution selection screen is displayed (S508: YES), the CPU 17 of the multi-function peripheral 10 transmits the correction execution selection information to the mediation server 20 in S510. On the other hand, when “Yes” is selected on the correction execution selection screen, it means that the user of the multi-function device 10 requests to redo the image composition. Is entered (filling the red pen box) (S512). In step S514, a scan upload process is performed on the trial print original (corrected-filled trial print original) in which the red pen box is written. That is, the scan upload process shown in FIG.

  In the scan upload process for the trial-printed document with correction entry, in step S204, the UL-ID for the scan image of the trial document with correction entry is acquired. That is, the UL-ID is different from the UL-ID acquired when uploading the previous material scan image. Further, in S206, information for instructing to scan the corrected and written trial print original and upload the scanned image (corrected and completed scanned image) to the conversion server 30 is generated as scan upload execution instruction information. In S209, an image indicating a scan instruction for the corrected written trial print original is displayed. In S210, the user scans the corrected written trial print original. In S212, the URL of the upload destination of the corrected completed scan image is requested. In S220, an upload message including the corrected completed scanned image data is transmitted to the conversion server 30.

  As described above, when a correction request is received from the user after the test print original is printed out, a scan upload process for the correction completed trial original is executed in S514. That is, a scan image in which a region that the user really wants to adopt as a material image is surrounded by a red pen is transmitted to the conversion server 30.

  After the scan upload process for the corrected test print original document in S514 is executed, the process proceeds to S516. In S516, a conversion process (FIG. 8) is executed in which the input information includes the UL-ID of the material scan image, the UL-ID of the scan image that has already been corrected, the selection template parameter, and the selection application parameter that have already been transmitted last time. Is done.

  The conversion process executed in S516, that is, the conversion process executed after transmitting the corrected trial scan image is basically as shown in FIG. 8, but is the first executed for the material scan image. Compared with the conversion process, the following points are mainly different. In other words, the input information for image processing generated in S300 includes the UL-ID of the scan image with the correction entry in addition to the UL-ID of the material scan image, the selection template parameter, and the selection application parameter. As a result, the conversion server 30 can acquire not only the material scan image data and the selected template image data but also the scan image data with correction entry.

  Therefore, in the image processing of S310 (details are shown in FIG. 11), when an affirmative determination is made in S604 and a red pen box is detected (S606: YES), the area surrounded by the red pen is extracted as a material image and combined. Will be done again. Then, after image composition is performed on the material image corresponding to the region surrounded by the red pen, the trial print image data including the composite image data is transferred to the multi-function device 10 by the download print processing of FIG. Will be sent. In this case, the material extraction region image 63 (see FIG. 3) displayed in the trial print image is an image showing the region of the newly extracted material image, that is, the region designated by the user by the red pen box. .

(8) Effects of Embodiment As described above, in the communication system 1 according to the present embodiment, the conversion server 30 executes the combining process, whereby the selected template image and the material image are combined. Then, image data of a trial print image including the synthesized composite image is transmitted to the multi-function device 10. As illustrated in FIG. 3, the trial print image includes a material scan image 62, a material extraction area image 63, and a note image transmitted from the multi-function device 10, in addition to the print image image 61 that is a composite image. 64. The material extraction region image 63 is information indicating which region of the material scan image 62 is extracted as a material and used for synthesis. The image data of such a trial print image is generated by the conversion server 30 and transmitted to the multi-function device 10, so that the multi-function device 10 can print out the test print image.

  When the trial print image is printed out by the multi-function device 10, the user of the multi-function device 10 can check what kind of composite image has been generated based on the print output result, and scan it. The material scan result (material scan image) can be confirmed, and moreover, it is possible to visually and easily confirm which area of the material scan image is specifically extracted as a material image and used for composition. Can do.

  Therefore, by looking at the trial print image, it is possible to easily and efficiently confirm whether or not the generated composite image (print image image 61) has the intended contents, and an appropriate response according to the confirmation result can be made. it can. For example, when the composite image has the intended content, various application processes (for example, printing on a desired printing paper) using the composite image can be performed. Further, for example, when the synthesized image does not have the intended content, it is possible to request the conversion server 30 to redo the image synthesis directly or via the mediation server 20. Therefore, it is possible to provide a service with high added value for the image data (material scanned image) transmitted from the multi-function device 10.

  Further, in the present embodiment, after the image composition is performed by the conversion server 30 and the trial print image data is transmitted to the multi-function device 10, the multi-function device 10 may request the image composition to be redone (corrected). it can. Specifically, as illustrated in FIG. 4, the user himself encloses an area that the user really wants to use as a material in the material scan image 62 with a red pen (a red pen box 65). Then, the test printing document in which the red pen box 65 is written is rescanned, and the rescan result (corrected written scanned image data) is transmitted. As a result, the conversion server 30 recognizes the red pen box 65 from the material scan image based on the corrected and completed scan image data, and newly extracts a region surrounded by the red pen box 65 as a material image. The conversion server 30 can accurately extract a region (a region desired by the user) to be extracted as a material image by recognizing the red pen box 65 directly written on the material scan image. Then, the newly extracted material image and the already acquired material scan image are combined to generate a new combined image.

  The newly generated composite image is also transmitted to the multi-function device 10 as a trial print image, similar to the first generated composite image. At that time, an image of a trial print image including at least a newly generated composite image (print image image 61), a material scan image 62, and a material extraction region image 63 indicating a region of the newly extracted material image. Data is transmitted to the multi-function device 10.

  For this reason, the user of the multi-function device 10 uses the original composite result as the material image when the intended content is not the intended content (for example, when the intended region in the material scan image is not extracted as the material image). The desired area can be instructed directly and specifically, and a new composition result reflecting the instruction can be obtained.

  Also, if the red pen box 65 cannot be normally recognized from the corrected and completed scanned image data, the conversion server 30 performs error processing (S620). Specifically, a message as illustrated in FIG. 5C is displayed on the display unit 12 of the multi-function device 10. Further, in addition to the error message, the user of the multi-function device 10 can select either re-transmission of the trial print image data or re-scanning, and processing according to the selection result can be performed. Therefore, even when the red pen box 65 cannot be recognized, appropriate information can be presented to the multi-function device 10.

  In the present embodiment, the communication system 1 corresponds to an example of an image information control system of the present invention. The multi-function device 10 corresponds to an example of an image processing apparatus of the present invention. The CPU 23 of the mediation server 20 and the CPU 33 of the conversion server 30 correspond to an example of a control unit of the present invention. The material scan image corresponds to an example of the first image of the present invention. The selected template image corresponds to an example of the second image of the present invention. The template identification information (S136) corresponds to an example of the second image information identification information of the present invention. The trial print image corresponds to an example of the composite result image and the corrected composite result image of the present invention. The material scan image 62 (FIG. 3) in the trial print image corresponds to an example of the specific area image of the present invention. The material extraction region image 63 (FIG. 3) in the trial print image corresponds to an example of the material region explicit image of the present invention, and the region surrounded by the material extraction region image 63 is an example of the first region of the present invention. Equivalent to. The red pen box 65 corresponds to an example of the area designation information of the present invention, and the area surrounded by the red pen box 65 corresponds to an example of the second area of the present invention. The corrected and completed scanned image data corresponds to an example of the image information with the area designation information added according to the present invention.

[Other Embodiments]
(1) There can be various algorithms for extracting a material image from a material scan image in the conversion server 30. That is, it is possible to appropriately determine which region of the entire material scan image is extracted as the material image, and the example shown in the middle of FIG. 2 is merely an example.

  Various methods are conceivable for the image composition method of the material image and the selected template image. In the above-described embodiment, an image combining method in which a plurality of material images are arranged in a selected template image has been described. However, such a combining method is merely an example. How many material images are used and how to arrange them when a plurality of material images are used can be appropriately determined. A plurality of types of material images may be extracted (that is, a plurality of different material images may be extracted from the material scan image), and the plurality of material images may be appropriately arranged. It is only an example that the selected template image has a two-color configuration of white (picture or character) and gray (blank area), and that the material image is exposed in a gray area in the selected template image in image synthesis.

  (2) As a method for indicating to the user which region is extracted as the material image from the material scan image, the method of displaying the rectangular material extraction region image 63 surrounding the region shown in FIG. It is an example. You may make it show an extraction area | region to a user using another display method.

  (3) A method for re-designating a desired area to be used as a material image when the user instructs the trial print image to re-compose the image, the desired area as shown in FIG. The method of surrounding with the red pen box 65 is merely an example. Other designation methods may be used to designate a region desired to be used as a material image.

  (4) A plurality of material scan images may be uploaded from the multi-function device 10 and image synthesis may be performed based on each material scan image to obtain each image synthesis result (trial print image). In this case, the material region may be redesignated in a red pen box for any one or a plurality of print results of the plurality of test print images.

  (5) In addition, the present invention is not limited to the specific means and structure shown in the above embodiment, and can take various forms without departing from the gist of the present invention. For example, a part of the configuration of the above embodiment is replaced with a known configuration having the same function, added to or replaced with the configuration of another embodiment, or omitted as long as the problem can be solved. May be. Moreover, you may comprise combining several said embodiment suitably.

DESCRIPTION OF SYMBOLS 1 ... Communication system, 2 ... LAN, 4 ... Internet, 10 ... Multi-function machine, 11 ... Operation part, 12 ... Display part, 13, 21, 31 ... Network interface, 14 ... Print execution part, 15 ... Scan execution , 16, 22, 32 ... control unit, 18, 24, 34, 51 ... memory, 19, 25, 35 ... program, 20 ... mediation server, 30 ... conversion server, 36 ... A application, 37 ... B application, 38 ... C application, 41, 52 ... Template, 42 ... Third template image data, 50 ... Content server, 53 ... First template image data, 54 ... Second template image data, 61 ... Print image image, 62 ... Material scan image 63 ... Material extraction area image, 65 ... Red pen box.

Claims (9)

A control unit;
A communication interface;
An image information control apparatus capable of communicating with the image processing apparatus via the communication interface,
The controller is
A first acquisition process for acquiring first image information indicating a first image from the image processing apparatus via the communication interface;
A second acquisition process for acquiring second image information identification information, which is information for designating a second image to be combined with the first image, from the image processing apparatus via the communication interface;
A third acquisition process for acquiring second image information indicating the second image based on the second image information identification information acquired in the second acquisition process;
An image of a specific first region is extracted as a material image from the first image indicated by the first image information acquired in the first acquisition process, and the material image information indicating the extracted material image and the first image are extracted. 3 The synthesized image information indicating the synthesized image obtained by synthesizing the second image and the material image by synthesizing the second image information obtained in the obtaining process according to a predetermined specific image synthesizing method. The synthesis process to generate,
The image processing apparatus prints out a composite result image that is an image including the composite image indicated by the composite image information generated by the composite processing and the use material information indicating the material image used in the composite image. A result generation process for generating synthesis result image information indicating the synthesis result image;
A transmission process for transmitting the combined result image information generated in the result generation process to the image processing apparatus via the communication interface;
A fourth acquisition process for acquiring correction request information indicating a correction request for the synthesized image from the image processing apparatus after transmitting the synthesis result image information in the transmission process;
Based on the correction request information acquired in the fourth acquisition process, a specific second area different from the first area in the first image indicated by the first image information acquired in the first acquisition process. An image is extracted as a correction material image to be combined with the second image, and the correction material image information indicating the extracted correction material image and the second image information acquired in the third acquisition process are combined with the image. Correcting composition processing for generating corrected composite image information indicating a corrected composite image in which the correction material image is combined with the second image by combining according to a method;
A retransmission process for transmitting image information including at least the corrected composite image information generated by the correction composite process to the image processing apparatus via the communication interface;
The image information control apparatus characterized by performing. The image information control device according to claim 1,
The use material information includes a specific area image that is an image of a specific area including at least the material image in the first image. The image information control device according to claim 2,
The use material information includes a material region explicit image added to a region corresponding to the material image in the specific region image. The image information control apparatus according to any one of claims 1 to 3 ,
The correction request information includes region designation information indicating which region of the first image should be the second region,
In the correction composition process, an image of the second area indicated by the area designation information is extracted as the correction material image from the first image. The image information control device according to claim 4 ,
The image processing apparatus has an image reading function capable of reading an image,
The use material information included in the synthesis result image includes a specific region image that is an image of a specific region including at least the material image in the first image,
The correction request information is a region designation information addition image that is an image obtained by adding the region designation information to the specific region image in the synthesis result image printed out by the image processing device. Area designation information added image information generated by being read by the image reading function of
When acquiring the area designation information additional image information as the correction request information in the fourth acquisition process, the control unit recognizes the area designation information from the area designation information additional image information and based on the recognition result. Executing an area specifying process for specifying the second area of the first image,
In the correction composition process, an image of the second area specified by the area specifying process in the first image is extracted as the correction material image. The image information control device according to claim 5 ,
The said control part performs a specific non-recognition process, when the said area designation | designated information is not normally recognized from the said area designation | designated information addition image information in the said area | region identification process. The image information control apparatus characterized by the above-mentioned. An image information control apparatus according to any one of claims 1 to 6,
The control unit, after execution of the correction composition process, the correction composite image indicated by the correction composite image information generated by the correction composition process, and the correction use material indicating the correction material image used in the correction composite image Executing correction result generation processing for generating corrected composite result image information indicating the corrected composite result image for causing the image processing apparatus to print out a corrected composite result image that is an image including information,
In the retransmission process, the corrected composite result image information generated in the correction result generation process is transmitted. In an image information control apparatus comprising a control unit and a communication interface, wherein the control unit can communicate with the image processing apparatus via the communication interface, the program can be executed by the control unit,
In the control unit,
A first acquisition process for acquiring first image information indicating a first image from the image processing apparatus via the communication interface;
A second acquisition process for acquiring second image information identification information, which is information for designating a second image to be combined with the first image, from the image processing apparatus via the communication interface;
A third acquisition process for acquiring second image information indicating the second image based on the second image information identification information acquired in the second acquisition process;
An image of a specific first region is extracted as a material image from the first image indicated by the first image information acquired in the first acquisition process, and the material image information indicating the extracted material image and the first image are extracted. 3 The synthesized image information indicating the synthesized image obtained by synthesizing the second image and the material image by synthesizing the second image information obtained in the obtaining process according to a predetermined specific image synthesizing method. The synthesis process to generate,
The image processing apparatus prints out a composite result image that is an image including the composite image indicated by the composite image information generated by the composite processing and the use material information indicating the material image used in the composite image. A result generation process for generating synthesis result image information indicating the synthesis result image;
A transmission process for transmitting the combined result image information generated in the result generation process to the image processing apparatus via the communication interface;
A fourth acquisition process for acquiring correction request information indicating a correction request for the synthesized image from the image processing apparatus after transmitting the synthesis result image information in the transmission process;
Based on the correction request information acquired in the fourth acquisition process, a specific second area different from the first area in the first image indicated by the first image information acquired in the first acquisition process. An image is extracted as a correction material image to be combined with the second image, and the correction material image information indicating the extracted correction material image and the second image information acquired in the third acquisition process are combined with the image. Correcting composition processing for generating corrected composite image information indicating a corrected composite image in which the correction material image is combined with the second image by combining according to a method;
A retransmission process for transmitting image information including at least the corrected composite image information generated by the correction composite process to the image processing apparatus via the communication interface;
A program for running An image processing apparatus having a function of printing at least an image;
An image information control device capable of communicating with the image processing device;
With
The image information control device includes:
A communication interface;
A control unit capable of communicating with the image processing apparatus via the communication interface;
With
The controller is
A first acquisition process for acquiring first image information indicating a first image from the image processing apparatus via the communication interface;
A second acquisition process for acquiring second image information identification information, which is information for designating a second image to be combined with the first image, from the image processing apparatus via the communication interface;
A third acquisition process for acquiring second image information indicating the second image based on the second image information identification information acquired in the second acquisition process;
An image of a specific first region is extracted as a material image from the first image indicated by the first image information acquired in the first acquisition process, and the material image information indicating the extracted material image and the first image are extracted. 3 The synthesized image information indicating the synthesized image obtained by synthesizing the second image and the material image by synthesizing the second image information obtained in the obtaining process according to a predetermined specific image synthesizing method. The synthesis process to generate,
The image processing apparatus prints out a composite result image that is an image including the composite image indicated by the composite image information generated by the composite processing and the use material information indicating the material image used in the composite image. A result generation process for generating synthesis result image information indicating the synthesis result image;
A transmission process for transmitting the combined result image information generated in the result generation process to the image processing apparatus via the communication interface;
A fourth acquisition process for acquiring correction request information indicating a correction request for the synthesized image from the image processing apparatus after transmitting the synthesis result image information in the transmission process;
Based on the correction request information acquired in the fourth acquisition process, a specific second area different from the first area in the first image indicated by the first image information acquired in the first acquisition process. An image is extracted as a correction material image to be combined with the second image, and the correction material image information indicating the extracted correction material image and the second image information acquired in the third acquisition process are combined with the image. Correcting composition processing for generating corrected composite image information indicating a corrected composite image in which the correction material image is combined with the second image by combining according to a method;
A retransmission process for transmitting image information including at least the corrected composite image information generated by the correction composite process to the image processing apparatus via the communication interface;
An image information control system characterized by