JP2009071649A - Image processing device, image processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suppress the generation of color unevenness when a diagram image in which a diagram is drawn is superposed on a specified image and output. <P>SOLUTION: The diagram is extracted from the diagram image, an RGB histogram is created for every diagram (step S100-S140), based on the created histogram, whether the diagram is single color or not is judged (step S150), when the diagram is judged to be single color, the representative color of the diagram is set based on the created RGB histogram of the diagram (step S160), the diagram is painted out with the representative color (step S170), the diagram painted out with the representative color is superposed on a photographic image and output (step S190, S200). Since the diagram is output after being painted out with the representative color and superposed on the photographic image, the generation of color unevenness in the diagram is suppressed. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

Conventionally, as this type of image processing apparatus, an apparatus that outputs an image of a line drawing such as a character or a picture handwritten by a user on an image such as a photograph specified by the user has been proposed (particularly, Patent Documents). 1). In such an image processing apparatus, a background image obtained by lightly printing an image designated by a user and a sample pattern having the same color gamut as the background image are printed on a document in advance, and a line drawing drawn on the background image of the document by the user. Is extracted based on the color gamut of the sample pattern, and the extracted diagram is superimposed on the specified image and output.
JP 2006-287402 A

  In general, in the above-described image processing apparatus, a user manually draws a diagram on a document using a sign pen or the like, so that ink on the pen may blur and color irregularity may occur in the diagram. When such a line diagram with color unevenness is directly superimposed on an image designated by the user, color unevenness also occurs in the superimposed image, and the user may feel poor image quality. In particular, when performing glossy shading processing for applying gloss and shading to a diagram, if the diagram is uneven in color, the user will feel more strongly the poor image quality.

  The image processing apparatus, the image processing method, and the program according to the present invention suppress the occurrence of color unevenness in a diagram when a diagram image on which a diagram is drawn is superimposed on a specified image and output. The main purpose.

  The image processing apparatus, the image processing method, and the program according to the present invention employ the following means in order to achieve the main object described above.

The image processing apparatus of the present invention
An image processing apparatus that outputs an adjustment diagram image obtained by adjusting a diagram image on which a diagram is drawn, overlaid on a specified image,
A diagram extracting means for extracting a diagram drawn in the diagram image;
Single color determination means for determining whether or not the diagram is a single color based on the color distribution of the diagram with respect to the extracted diagram;
Representative color setting means for setting a representative color based on the color distribution of the diagram for the diagram determined to be a single color by the single color determination means;
An adjustment diagram image creating means for creating the adjustment diagram image by painting the diagram in which the representative color is set with the set representative color;
It is a summary to provide.

  In the image processing apparatus of the present invention, a diagram drawn in a diagram image is extracted, and it is determined whether or not the diagram is a single color based on the color distribution of the diagram with respect to the extracted diagram. A representative color is set based on the color distribution of the diagram for the diagram determined to be a single color, and the diagram for which the representative color is set is filled with the set representative color. Create an image. As a result, it is possible to suppress the occurrence of color unevenness in the diagram of the adjustment diagram image, and color unevenness in the output image when the adjustment diagram image is superimposed on the specified image and output. Can be suppressed. Here, the “line diagram” includes a figure drawn with lines such as characters and pictures.

  In such an image processing apparatus of the present invention, in the histogram showing the relationship between the luminance of the color element of the diagram and the number of pixels, the luminance that bisects the number of pixels in the predetermined luminance range including the luminance value corresponding to the mode value The representative color may be set by using any one of a value, an average luminance value in the predetermined luminance range, and the mode value. In this way, the representative color can be set more appropriately. In this case, the single color determining means has a predetermined luminance width in a region including a mode value and a pixel including a predetermined number of pixels or more in a histogram indicating the relationship between the luminance of the color element of the diagram and the number of pixels. The luminance corresponding to the interval of 2σ when it is less than the luminance width or when the standard deviation is approximated by an area including the mode value and the pixels including the predetermined number of pixels or more by the normal distribution in the histogram. It may be a means for determining that the color is a single color when the width is less than the predetermined luminance width. In this way, it is possible to more appropriately determine whether or not the diagram is a single color. In the image processing apparatus of the present invention in which it is determined whether or not the color is a single color using such a histogram, a predetermined thickness is given to a line included in the diagram filled with the set representative color. It may be a means for creating the adjustment diagram image by applying gloss and shading that are generated when light is irradiated from a predetermined angle. In this way, even when gloss and shadow are applied to the lines included in the diagram, it is possible to suppress color unevenness in the diagram and to output a higher quality image. In the image processing apparatus of the present invention in which gloss and shadow are applied to the lines included in such a diagram, the diagram image is displayed on a background image formed by reducing the color of the designated image within a predetermined color gamut. The line drawing extraction means is a means for extracting a line drawing on the condition that pixels of the line drawing image are out of the predetermined color gamut. The adjustment diagram image creating means may be a means for creating the adjustment diagram image by making the pixels within the predetermined color gamut of the diagram image transparent. In this way, even when the diagram is drawn on the background image formed by reducing the color of the image in which the diagram image is designated within the predetermined color gamut, the adjustment image can be appropriately created. .

The image processing method of the present invention includes:
An image processing method for superimposing and outputting an adjustment diagram image obtained by adjusting a diagram image on which a diagram is drawn on a specified image,
Extract the diagram drawn in the diagram image,
Determining whether the diagram is a single color based on the color distribution of the diagram for the extracted diagram;
A representative color is set based on the color distribution of the diagram for the diagram determined to be the single color,
The gist is to create the adjustment diagram image by painting the diagram set with the representative color with the set representative color.

  In the image processing method of the present invention, a diagram drawn in a diagram image is extracted, and it is determined whether or not the diagram is a single color based on the color distribution of the diagram for the extracted diagram. A representative color is set based on the color distribution of the diagram for the diagram determined to be a single color, and the diagram for which the representative color is set is filled with the set representative color. Create an image. As a result, it is possible to suppress the occurrence of color unevenness in the diagram of the adjustment diagram image, and when the adjustment diagram image is superimposed on the designated image and output, the color unevenness is present in the diagram. It can be suppressed from occurring.

  The program of the present invention outputs the above-described image processing method, that is, basically superimposing the adjustment diagram image formed by adjusting the diagram image on which the diagram is drawn on the designated image. An image processing method for extracting a diagram drawn in the diagram image, and whether the diagram is a single color based on a color distribution of the diagram with respect to the extracted diagram A representative color is set based on the color distribution of the diagram for the diagram determined to be the single color, and the diagram in which the representative color is set is set to the set representative color The gist of the present invention is that it is a program for causing one or more computers to execute each step of the image processing method for creating the adjustment diagram image by painting.

  In the program of the present invention, each step of the image processing method described above is executed by one or more computers. Therefore, an effect exhibited by the image processing method of the present invention, for example, an adjustment diagram image on the designated image. There are the same effects as the effect of suppressing the occurrence of color unevenness in the diagram when overlapping and outputting.

  Next, the best mode for carrying out the present invention will be described using examples.

  FIG. 1 is a configuration diagram showing an outline of the configuration of a multifunction printer 10 equipped with an image processing apparatus according to an embodiment of the present invention. As shown in the figure, the multifunction printer 10 includes a printer unit 20 that performs printing on a recording sheet S based on a print job, a scanner unit 30 that reads a document placed on a glass table 36, and a memory. A memory card controller 44 for inputting / outputting data to / from the memory card 42 inserted in the card slot 40, various information is displayed on the display unit 52, and a user instruction is input through the operation of the button group 54. Operating panel 50 and a main controller 60 that controls the entire apparatus. The multifunction printer 10 is configured such that the printer unit 20, the scanner unit 30, the memory card controller 44, and the main controller 60 can exchange various control signals and data with each other via the bus 12.

  The printer unit 20 includes a printer ASIC 22 and a printer engine 24. The printer ASIC 22 is an integrated circuit that controls the printer engine 24. When the printer ASIC 22 receives a print command from the main controller 60, the printer ASIC 22 controls the printer engine 24 to print on the recording paper S based on the image data targeted by the print command. . The printer engine 24 is configured as a well-known ink jet color printer mechanism that performs printing by ejecting ink from the print head onto the recording paper S.

  The scanner unit 30 includes a scanner ASIC 32 and a scanner engine 34. The scanner ASIC 32 is an integrated circuit that controls the scanner engine 34. Upon receiving a scan command from the main controller 60, the scanner ASIC 32 controls the scanner engine 34 to read a document placed on the glass table 36 as image data. The scanner engine 34 is configured as a well-known image scanner, and the reflected light after emitting light toward the document is separated into red (R), green (G), and blue (B) colors to obtain scan data. A known color image sensor is provided.

  The memory card controller 44 inputs and outputs data to and from the memory card 42 inserted in the memory card slot 40 provided on the side of the operation panel 50. When the memory card 42 is connected to the memory card slot 40, the memory card controller 44 reads a file stored in the memory card 42 and transmits it to the main controller 60 or inputs a command from the main controller 60. Data is written to the memory card 42 based on the command.

  The main controller 60 is configured as a microprocessor centered on the CPU 62, and includes an image processing program 70 for superimposing and outputting an image based on a diagram image in which a diagram is drawn on a designated image. ROM 64 storing various processing programs, various data, various tables, RAM 66 temporarily storing scan data, print data, etc., flash memory 68 capable of holding data even when the power is turned off, operation panel 50, And an internal communication interface 69 that enables the communication. The main controller 60 inputs various operation signals and various detection signals from the printer unit 20, the scanner unit 30, and the memory card controller 44, and inputs operation signals generated according to the operation of the button group 54 of the operation panel 50. To do. Also, a read command for reading a file from the memory card 42 and outputting it to the main controller 60 is output to the memory card controller 44, a print command is output to the printer unit 20 to execute printing of image data, and the operation panel 50 Based on the scan command of the button group 54, a read command is output to the scanner unit 30 so as to read a document placed on the glass table 36 as image data, or a control command for the display unit 52 is output to the operation panel 50. To do.

  The multi-function printer 10 thus configured reads a document placed on the glass table 36 as image data and prints it on the recording paper S, or an image stored in the memory card 42 connected to the memory card slot 40. Data is printed on the recording paper S.

Next, the operation of the multifunction printer 10 of the embodiment configured in this way, in particular,
An operation when performing superposition printing in which an image in which a diagram such as a character or a picture handwritten by a user is superimposed on a photographic image stored in the memory card 42 is printed on the recording paper S will be described. FIG. 2 is a flowchart showing an example of the overlay printing processing routine executed by the CPU 62 of the main controller 60. In this routine, the memory card 42 in which the photographic image 72 specified by the user illustrated in FIG. 3 is stored in the memory card slot 44 is inserted, and a diagram to be superimposed on the photographic image 72 is written on the glass base 36 of the scanner unit 30. This is executed when the user presses the overlay printing execution button on the operation panel 50 (not shown) in a state where the handwritten sheet 80 is placed. FIG. 4 is an explanatory diagram showing an example of a handwritten sheet 80 on which a diagram is written by the user. In the handwritten sheet 80, a free drawing area 82 in which a background image obtained by reducing the color gamut of the photographic image 72 illustrated in FIG. 2 to a specific color gamut is printed, and a background color gamut table 84 that displays colors used for the background image. And are arranged. In the free drawing area 82, the characters “Hello!” Are drawn as a diagram by the user with a sign pen. In the embodiment, a description will be given on the assumption that each character has bleeding due to the ink of the sign pen.

When the overlay printing processing routine is executed, the CPU 62 of the main controller 60
A reading command is transmitted to the scanner unit 30 so as to read the handwritten sheet 80 placed on the glass stand 36 of the scanner unit 30, and the scan data from the scan unit 30 is temporarily stored in the RAM 66 and also a photographic image from the memory card 42. A process of reading 72 data and temporarily storing it in the RAM 66 is executed (step S100). Subsequently, an image of the free drawing area 82 positioned and arranged in the handwritten sheet 80 is extracted from the scan data stored in the RAM 66 as a diagram image 86 (step S110). An example of the extracted diagram image 86 is shown in FIG.

  When the diagram image 86 is extracted, pixels that are the background of the characters “Hello!” In the diagram image based on the colors used in the background image displayed in the background color gamut table 84 are subsequently “transparent”. ”And background transparency processing for making pixels corresponding to the characters“ Hello! ”“ Opaque ”(step S120), and the α channel is“ opaque ”in the diagram image after the background transparency processing is performed. For the pixels set to “”, a diagram is extracted assuming that a group of continuously arranged pixels is one diagram (step S130). Specifically, in the background transparency process, the data of each pixel of the diagram image 86 is provided with an α channel capable of making the pixel transparent as auxiliary data, and R (red) of each pixel of the diagram image 86 The G (green) B (blue) data and the RGB data in the background color gamut table 84 are compared, and the colors of the pixels constituting the diagram image 86 are included in the colors displayed in the background color gamut table 84. If the color of the pixel is different from the color displayed in the background color gamut table 84, the alpha channel is set to "transparent". This is done by determining the corresponding pixel and setting the α channel to “opaque”. FIG. 6 is an explanatory diagram showing an example of the diagram image 86a after the background transparency processing and an example of the extracted diagram. In FIG. 6, pixels for which the α channel is set to “transparent” in the background transparency processing are represented by the same color as the background color in the figure, and pixels for which the α channel is set to “opaque” are represented by gray. . As shown in the figure, in the diagram image 86a, the characters “H”, “e”, “l”, and “o” are continuous in the same character but are separated from other characters. Although extracted as one diagram 88a to 88e, “!” Is extracted as two diagrams 88f and 88g because the lines are separated in the character.

  Subsequently, an RGB histogram of the attention diagram is created using one of the diagrams 88a to 88g as the attention diagram (step S140), and whether or not the attention diagram is a single color using the created histogram. Is determined (step S150). FIG. 7 is an explanatory diagram showing an example of a histogram generated for the diagram 88a corresponding to the letter “H”. In the diagram, solid lines, broken lines, and alternate long and short dash lines indicate RGB histograms, respectively. To determine whether the color is a single color, for each RGB data, generate a histogram with the horizontal axis representing luminance and the vertical axis representing the number of pixels for each luminance, and corresponding to the mode value of the histogram for each RGB data Deriving luminance widths WR, WB, WG including the most frequent luminance values Rmo, Gmo, Bmo and including a predetermined ratio or more (for example, 90% or more) of the total number of pixels, and deriving luminance widths WR, Each of WG and WB is determined to be a single color when it is within thresholds WRth, WGth, and WBth as luminance widths that can be determined that the character is a single color. Here, the threshold values WRth, WGth, and WBth are obtained by experimentation or the like for each RGB data when characters are drawn in a plurality of single colors using several types of pens on several types of paper. A histogram with the horizontal axis representing the luminance and the vertical axis representing the number of pixels for each luminance, and the average of the width of the luminance including the predetermined number or more of the total number of pixels centered on the mode value in the generated histogram The values are stored in the threshold values WRth, WGth, WBth and the ROM 64, and thus the values stored in the ROM 64 are also used.

  When the attention line is a single color (step S150), a color frequently included in the attention line is set as a representative color based on the generated histogram (step S160). Here, representative luminance values Ra, Ga, Ba of luminance are set for each RGB data using a histogram, and a color having the set representative luminance values Ra, Ga, Ba as RGB data is set as a representative color. It was supposed to be. FIG. 8 is an explanatory diagram showing an example of how the representative luminance value Ra is set for the R data. In the embodiment, the total number of pixels included in the range of the brightness width WR of the histogram is derived, and the intersection of the horizontal axis and the straight line f parallel to the vertical axis that bisects the total number of derived pixels on the left and right of the histogram. The representative luminance value Ra is set. Similarly to the R data, for each GB data, the vertical axis for deriving the total number of pixels included in the range of the luminance widths WB and WG of the histogram and dividing the total number of derived pixels into two at the left and right of the histogram The intersection of the straight line parallel to the horizontal axis and the horizontal axis is set as the representative luminance values Ga and Ba. By setting the representative luminance values Ra, Ga, and Ba in this way, even when the mode luminance values Rmo, Gmo, and Bmo are at positions far from the centers of the luminance widths WR, WG, and WB, the representative colors can be appropriately displayed. Can be set.

  When the representative color of the attention diagram is set in this way, a color conversion process is performed to convert RGB data of all pixels constituting the attention diagram into RGB data of the representative color (step S170). By such processing, it is possible to obtain a diagram without color unevenness filled with the representative color for which the attention diagram is set.

  On the other hand, when the attention line diagram is not a single color (step S150), it is determined that it is not appropriate to set the representative color and perform the painting process with one color because the attention line diagram is multicolored, and steps S160 and S170. The following processing is executed without performing the above processing. In this way, when the attention diagram is multicolored, it can be maintained as it is.

  When the processing for the attention diagram is completed in this way, the processing from step S140 to step S170 is repeated for all the diagrams extracted in step S130 (step S180), and the adjustment image 90 illustrated in FIG. 9 is created. . In FIG. 9, a pixel in which the α channel is set to “transparent” is represented by the same color as the background color in the drawing, and a pixel in which the α channel is set to “opaque” is represented in gray. When the adjustment image 90 is obtained in this manner, the adjustment image 90 is superimposed on the photographic image 72 stored in the RAM 66 to generate the print image 92 illustrated in FIG. 10 (step S190), and the generated print image A print execution instruction is output to the printer unit 20 to execute printing of the image 92 (step S200), and this routine is terminated. The printer unit 20 to which the print execution instruction is input executes the printing of the print image 92 on the recording paper S. Since the print image 92 is generated using the adjustment image 90 in which the diagrams 88a to 88g are filled with the representative colors, it is possible to print with a good quality image.

  Here, the correspondence between the components of the present embodiment and the components of the present invention will be clarified. The multifunction printer 10 of this embodiment corresponds to the image processing apparatus of the present invention, and the CPU 62 corresponds to a diagram extracting unit, a single color determining unit, a representative color setting unit, and an adjustment diagram image creating unit. Further, the image processing program 70 stored in the ROM 64 corresponds to the program of the present invention. In this embodiment, an example of the image processing method of the present invention is also clarified by describing the operation of the multifunction printer 10.

  According to the multifunction printer 10 of the embodiment described above, the adjustment diagram image 90 is obtained by filling the diagram 88a to 88g of the extracted diagram image 86 with a representative color for each diagram. When the diagram image 90 is superimposed on the photographic image 72 and output, it is possible to suppress color unevenness in the diagram. Further, in the histogram showing the relationship between the RGB data and the number of pixels in each diagram, the total number of pixels included in the luminance widths WR, WB, WG is derived, and the total number of derived pixels is equal to 2 on the left and right sides of the histogram. Since the colors having the representative luminance values Ra, Ga, and Ba as the intersections of the straight line parallel to the vertical axis to be divided and the RGB data are set as the representative colors of the attention line diagram, the representative colors are set more appropriately. be able to. Further, the luminance widths WR, WB, WG including the mode luminance values Rmo, Gmo, Bmo corresponding to the mode value of the histogram for each RGB data and including pixels of a predetermined ratio or more in the total number of pixels. Since it is used to determine whether each diagram is a single color, it is possible to more appropriately determine whether each diagram is a single color.

  In the multi-function printer 10 of the embodiment, the representative luminance values Ra, Ga, and the like as luminance values that divide the number of pixels included in the luminance widths WR, WB, and WG into two for each of the RGB data of the histogram in the process of step S160. The color having Ba as RGB data is set as the representative color of the diagram. However, the representative color may be set by any method as long as the representative color is set based on the color distribution of the diagram. For example, a color having an average luminance value in the luminance widths WR, WB, and WG as RGB data and a color having the mode luminance values Rmo, Gmo, and Bmo corresponding to the mode value in the histogram as RGB data are set as representative colors. May be.

  In the multi-function printer 10 according to the embodiment, in the process of step S150, each RGB data includes the mode luminance values Rmo, Gmo, and Bmo corresponding to the mode value of the histogram for each of the RGB data, and more than a predetermined ratio of the total number of pixels. Although it is determined that a single color is obtained when the luminance widths WR, WB, WG including the pixels are within the threshold values WRth, WGth, WBth, the diagram is a single color based on the color distribution of the diagram Can be determined by any method, for example, when the regions corresponding to the luminance widths WR, WB, WG in each histogram are approximated by a normal distribution and the standard deviation is σ. It may be determined that the color is a single color when the luminance width corresponding to the section of 2σ is within the threshold values WRth, WGth, and WBth.

  In the multi-function printer 10 of the embodiment, the glossy shading process may be performed on the attention line diagram between the process of step S170 and the process of step S180. The glossy shading process is performed by a user in a situation where the attention line is arranged on a predetermined plane, the attention line is given a predetermined thickness in a direction perpendicular to the predetermined plane, and the light source is arranged obliquely above the attention line. Assuming that the attention line diagram is viewed from infinity in the direction perpendicular to the plane, this is a process for providing a change in luminance to the lines included in the attention line figure so that the attention line diagram can be viewed in three dimensions. The glossy shading process is a well-known process and will not be described in detail. FIG. 11 is an explanatory diagram illustrating an example of a printing image 192 in which an adjustment image that has been subjected to glossy shading processing is superimposed on a photographic image 70. In this way, a glossy shading process is performed after the attention line diagram is painted with the representative color, whereby a higher quality image can be generated.

  In the multi-function printer 10 of the embodiment, a background image in which the color gamut of the photographic image 72 is reduced to a specific color gamut is printed in advance in the free drawing area 82 of the handwritten sheet 80. Such a background image may not be printed. In this case, in the process of step S120, it is desirable to perform the process of making the α channel “transparent” for the pixels of the same color as the ground color of the handwritten sheet 80. Also, if the diagram is a picture or speech bubble with a figure drawn inside the line, such as the character's face, the entire area surrounded by the line is considered as one diagram and the α channel is set to “opaque” It may be a thing. In this case, it is determined in step S150 that the color is not a single color, and the fill with the representative color is not performed.

  In the embodiment, the case where the image processing apparatus of the present invention is applied to a multi-function printer is exemplified. However, an adjustment diagram image obtained by adjusting a diagram image on which a diagram is drawn is superimposed on a specified image. It can be applied to any output as long as it is output.

  The best mode for carrying out the present invention has been described with reference to the embodiments. However, the present invention is not limited to these embodiments, and various modifications can be made without departing from the gist of the present invention. Of course, it can be implemented in the form.

  The present invention can be used in the manufacturing industry of image processing apparatuses.

1 is a configuration diagram showing an outline of the configuration of a multifunction printer 10. FIG. 7 is a flowchart illustrating an example of an overlay printing processing routine. FIG. 4 is an explanatory diagram showing an example of a photographic image 72 stored in the memory card 42. Explanatory drawing which shows an example of the handwritten sheet 80 in which the diagram was written by the user. Explanatory drawing which shows an example of the extracted diagram image 86. FIG. Explanatory drawing which shows an example of the diagram image 86a after performing background transparency processing. Explanatory drawing which shows an example of the histogram produced | generated about the diagram. Explanatory drawing which shows an example of a mode that representative luminance value Ra is set. Explanatory drawing which shows an example of the image 90 for adjustment. FIG. 6 is an explanatory diagram illustrating an example of a print image 92. 3 is an explanatory diagram illustrating an example of a print image 192. FIG.

Explanation of symbols

  10 Multifunction Printer, 12 Bus, 20 Printer Unit, 22 Printer ASIC, 24 Printer Engine, 30 Scanner Unit, 32 Scanner ASIC, 34 Scanner Engine, 40 Memory Card Slot, 42 Memory Card, 44 Memory Card Controller, 50 Operation Panel, 52 display unit, 54 button group, 60 main controller, 62 CPU, 64 ROM, 66 RAM, 68 flash memory, 69 internal communication I / F, 70 image processing program, 72 photographic image, 80 handwritten sheet, 82 free drawing area, 84 Background color gamut table, 86, 86a diagram image, 88a, 88b, 88c, 88d, 88e, 88f, 88g diagram, 90 adjustment image, 92, 192 print image, S recording paper.

Claims (7)

An image processing apparatus that outputs an adjustment diagram image obtained by adjusting a diagram image on which a diagram is drawn, overlaid on a specified image,
A diagram extracting means for extracting a diagram drawn in the diagram image;
Single color determination means for determining whether or not the diagram is a single color based on the color distribution of the diagram with respect to the extracted diagram;
Representative color setting means for setting a representative color based on the color distribution of the diagram for the diagram determined to be a single color by the single color determination means;
An adjustment diagram image creating means for creating the adjustment diagram image by painting the diagram in which the representative color is set with the set representative color;
An image processing apparatus comprising:   The representative color setting means includes a luminance value that bisects the number of pixels within a predetermined luminance range including a luminance value corresponding to a mode value in a histogram indicating a relationship between the luminance of the color element of the diagram and the number of pixels. The image processing apparatus according to claim 1, wherein the representative color is set using one of an average luminance value and a mode value in the predetermined luminance range.   The single color determination means includes a mode indicating a relationship between the luminance of the color element of the diagram and the number of pixels, and includes a mode value and a luminance width of an area including a predetermined number of pixels or more is less than the predetermined luminance width. When the area including the mode value and the pixel including the predetermined number of pixels or more in the histogram is approximated by a normal distribution and the standard deviation is σ, the luminance width corresponding to the section of 2σ is the predetermined width. The image processing apparatus according to claim 2, wherein the image processing apparatus is a unit that determines that the color is a single color when the luminance is less than the luminance width.   The adjustment diagram image creating means has a gloss and a shadow generated when light is irradiated from a predetermined angle with a predetermined thickness with respect to a line included in the diagram filled with the set representative color. The image processing apparatus according to claim 3, wherein the image processing apparatus is a means for generating the adjustment diagram image. The image processing apparatus according to claim 4,
The diagram image is an image in which a diagram is drawn on a background image formed by reducing the color of the designated image within a predetermined color gamut,
The diagram extracting means is means for extracting a diagram on the condition that pixels of the diagram image are out of the predetermined color gamut.
The adjustment diagram image creating means is an image processing apparatus that creates the adjustment diagram image by making the pixels within the predetermined color gamut of the diagram image transparent. An image processing method for superimposing and outputting an adjustment diagram image obtained by adjusting a diagram image on which a diagram is drawn on a specified image,
Extract the diagram drawn in the diagram image,
Determining whether the diagram is a single color based on the color distribution of the diagram for the extracted diagram;
A representative color is set based on the color distribution of the diagram for the diagram determined to be the single color,
An image processing method for creating the adjustment diagram image by painting the diagram set with the representative color with the set representative color.   A program for causing one or more computers to execute each step of the image processing method according to claim 6.