JP2008113446A - Image processing device, image processing program and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To maintain a gradation of a middle-tone area in an original image inputted from various image input apparatuses, and to also automatically adjust a contrast between a black character and a ground in an output image without a user performing an operation, such as setting a parameter. <P>SOLUTION: On the basis of a feature value calculated from an original image, which is a digital image, in a step S4, a character area is extracted from the original image in a step S5, and the original image is divided into blocks in a step S6. Pixels belonging to the extracted character area are classified into a first class and a second class according to colors, in each of the blocks in a step S7. On the basis of a black character color and a ground color on the original image estimated in each of the blocks in a step S8 according to the classification of the pixels belonging to the extracted character area, a tone correction is then performed on the black character color and the estimated ground color in a step S9 so as to adjust a contrast of the black character and the ground in an output image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

The present invention relates to an image processing apparatus, an image processing program, and a storage medium.

For example, when an image output device handles an image (document image) obtained by scanning a print document intended for content transmission with an image input device such as a scanner, the purpose of the document image is also content transmission. Therefore, improving the readability of the text in the output document image is the most important issue when outputting the document image.
However, for example, when printing a digital image obtained by inputting a document printed with a white background using a color image input device such as a color scanner from a color image output device such as a color printer, the image If the image is printed as it is without any image processing, the contrast between the characters and the background will be low, or the black characters that should be black or the background that should be white will be colored. May be less readable.

This is because the color and gradation are not consistent between the image input device and the image output device. When an image processing device such as an image input device or an image output device is stand-alone, an image processing algorithm and parameters are often designed according to the characteristics of the device.
Here, as related techniques, for example, a process that is implemented in a copier or the like and emphasizes a pixel corresponding to a black character (for example, see Patent Documents 1 to 5) or a process that specifies a halftone area (for example, Patent Document) In addition to 6-9, there is a technique in which gradation correction processing (for example, see Patent Documents 10 to 21) is performed based on a histogram of pixel signal values. In such a technique, image processing algorithms and parameters usually depend greatly on the color characteristics, resolution, and frequency characteristics of the input device.

  Also, if a digital image obtained by inputting a print document from a color image device such as a scanner is directly printed from a color printer or displayed on a display without performing any image processing on the digital image, Depending on the difference in scanner (difference in scanning conditions), the background and background colors may not be uniform, or so-called “show-through” may occur in which the content printed on the back side is shown through . In such a case, the phenomenon that the image looks dirty as a whole often occurs.

  When the background color or background color of the target digital image is white, as a countermeasure against the above-mentioned malfunction phenomenon, processing called so-called “background removal” or “background removal” that replaces the background or background part with white Is effective.

  As a process called “background removal” or “background removal”, for example, a background level is detected based on a histogram of pixel signal values and the background is skipped (see, for example, Patent Document 22 and Patent Document 23). It has been known. By such processing, when the background or background color is white, it is possible to prevent image deterioration due to differences in scanner (difference in reading conditions) or show-through.

  Also, there is a process of estimating the background color of the document and changing the pixel value of the target pixel using the difference between the background color and the target pixel value (see, for example, Patent Document 24). In this process, the background color is determined by searching for the brightest region from the histogram of the same color, and the background reference is determined from the color distribution according to the identification result in which one of the following four is identified as the background color. The color is determined, and the color of each pixel is adjusted based on the difference between the determined reference color and each pixel. In this technology, the four patterns identified as background colors are (1) near white, contone (such as white copy paper and newspaper printing paper), (2) near white, halftone (such as magazine printing paper), (3) Far white and contone (photograph, colored paper, etc.) and (4) Far white, halftone (magazine printing paper, etc.).

In addition, by analyzing the distribution state of the peak of the gradation distribution histogram, a threshold value for determining the area of the image / background / other area is determined, and the image area is output without being processed. There is a technique in which an area is converted to a background color and image degradation is prevented by processing in other areas according to a predetermined condition (see, for example, Patent Document 25).
Japanese Patent No. 2558915 JP 2000-196871 A JP 2000-316097 A JP 2001-0778036 A JP 2001-169133 A Japanese Patent No. 3158498 JP 2001-036748 A Japanese Patent Laid-Open No. 2001-144972 JP-A-11-220631 JP 2000-013616 A JP 2000-013625 A JP 2000-115538 A JP 2000-242777 A JP 2001-045303 A JP 2001-148785 A JP 2001-167260 A JP 2001-189862 A JP 2001-189863 A JP 2001-197312 A JP 2001-222711 A JP-A-10-281470 JP 2000-022971 A JP 2000-078408 JP 2000-050083 A JP 2001-045297 A

  By the way, with the spread of the network environment in recent years, an image input through an image device is transmitted to a remote place via a network, and a recipient edits, reuses, prints, and retransmits the image on a PC. Has appeared. In such a network environment, processing such as editing / reuse / printing / retransmission is performed on an image input through an unknown image device. New technical issues can be considered.

  In other words, in a network environment, the characteristics of input / output devices are diverse, and when a digital image is input / transmitted at a remote location, the input device may be unknown, but The image processing system that is optimal for the model may not be effective for models with different characteristics. Therefore, when an image input by an image input device is output by an image output device, the accuracy of image identification May vary, the quality of the output image may be reduced, and readability as a sentence may be reduced.

  As a countermeasure, adaptive binarization is effective only for the problem of contrast between characters and background and the problem of coloring of black characters and background. Research and development of binarization technology has been actively performed as a function as preprocessing of OCR in document image processing. However, when binarization is performed, there is a problem that the gradation and color of the halftone area are lost.

  As a solution to this problem, binarization is applied only to areas where black characters are written on a white background, using a technique that is used in document image recognition and dividing the image into areas such as text, photographs, and line drawings. It is possible to do. However, such a technique is easy to edit and correct even if the area identification is wrong in OCR which is a text file such as HTML, but the purpose is to re-output a document image with high image quality. If region identification is mistaken, image editing / correction may become very complicated.

  Therefore, global tone correction suitable for document images, such as converting white background to white and black characters to black, while maintaining the gradation of the halftone area, so-called "soft" global Threshold processing is desired. Here, global tone correction, so-called “soft” global threshold processing, means processing for performing the same conversion on all pixels.

  In addition, since the characteristics of the image input device are diverse, for example, processing for replacing the color of a pixel with a saturation level equal to or less than a predetermined threshold with white, or a pixel with a saturation level equal to or lower than a predetermined threshold is considered as monochrome. When processing, it is necessary to avoid hard-coding the parameters that will be the “specified threshold”, and the parameters that specify the above processing (background and black character color) can be calculated adaptively from the image. Is desired.

  In particular, the ability to express highlight colors varies widely among image output devices such as printers, and even if the same signal is clipped to white (nothing printed) or printed visually, etc. Therefore, in the above-described image processing, it is desirable that the user can easily adjust the processing according to the characteristics of the image output device.

  In a color document image, the background and background colors are arbitrary, the background structure is complicated, and there are many cases where the background is composed of a plurality of background colors.

  The histogram form obtained when the color and gradation distribution in a color document image with a complicated background structure is simply examined is a “mixed distribution” in which many peaks and valleys appear in the histogram. Therefore, it is difficult to estimate the true background color.

  In the technique described in Patent Document 22, Patent Document 23, or Patent Document 25 described above, a method of extracting a background or background color from a color document image having such a mixed distribution is described. Since the histogram includes many peaks and valleys due to noise, it is not always possible to accurately extract a desired background or background color, and the number of extraction errors increases.

  In the technique disclosed in Patent Document 24, the background and background are identified as a contone and a halftone (halftone dot), but the halftone dot identification strongly depends on the frequency characteristics (MTF) of the input device. It is difficult to apply when the input device is unknown, such as data sent from a remote place via a network.

  An object of the present invention is to automatically maintain black characters of an output image without performing a work such as setting a parameter while maintaining a gradation property of a halftone area of an original image input from various image input devices. And adjusting the contrast between the substrate and the background.

  The image processing apparatus according to the first aspect of the present invention includes a character area extracting unit that extracts a character area from an original image that is a digital image, and a first class and a second class of pixels belonging to the character area according to colors. Class classification means for classifying the black character color / background color estimation means for estimating a black character color and a background color on the original image based on a class classification of pixels belonging to the character area, and an estimated black character color Gradation correction means for performing gradation correction on the original image based on the background color.

  Therefore, for example, when an original image, which is a digital image input from an image input device, is output from the image output device, black characters on the original image based on a class classification in which pixels belonging to the character area are classified according to color. Based on the estimated black character color and background color, tone correction can be performed on the original image without using specified parameters.

  An image processing apparatus according to a second aspect of the present invention includes a character area extracting unit that extracts a character area from an original image that is a digital image, and a pixel belonging to the character area is classified into a first class and a second class according to color. Classifying means for classifying into the original image, background color estimating means for estimating the background color on the original image based on the class classification of the pixels belonging to the character area, and on the original image based on the estimated background color Background area specifying means for specifying a background area, and gradation correction means for performing gradation correction on the original image by replacing the color of the specified background area with the estimated background color.

  Therefore, for example, when an original image, which is a digital image input from an image input device, is output from the image output device, it is estimated from the original image based on a class classification in which pixels belonging to the character area are classified according to color. By replacing the color of the background area specified based on the background color with the estimated background color, it is possible to perform gradation correction on the original image without using a prescribed parameter.

  According to a third aspect of the present invention, there is provided an image processing apparatus for extracting a character region from an original image which is a digital image, and a first class and a second class of pixels belonging to the character region according to color. Classifying means for classifying into the original image, background color estimating means for estimating the background color on the original image based on the class classification of the pixels belonging to the character area, and on the original image based on the estimated background color Background area specifying means for specifying a background area, and gradation correction means for correcting gradation of the original image by replacing the color of the specified background area with white.

  Therefore, for example, when an original image, which is a digital image input from an image input device, is output from the image output device, it is estimated from the original image based on a class classification in which pixels belonging to the character area are classified according to color. By replacing the color of the background area specified based on the background color with white, it is possible to perform gradation correction on the original image without using a prescribed parameter.

  The image processing apparatus according to claim 4 is a feature amount calculating means for calculating a feature amount with respect to an original image that is a digital image, and a character that extracts a character region from the original image based on the feature amount. Area extracting means, block dividing means for dividing the original image into blocks, class classification means for classifying pixels belonging to the character area into first and second classes according to color, for each block; A black character color / background color estimating means for estimating a black character color and a background color on the original image based on a class classification of pixels belonging to the character area; and the original image based on the estimated black character color and the background color. Gradation correction means for performing gradation correction with respect to.

  Therefore, for example, when an original image, which is a digital image input from an image input device, is output from the image output device, pixels belonging to a character area extracted based on a value calculated from the feature amount of the original image are colored. On the basis of the classification classified according to the above, tone correction can be performed on the original image based on the black character color and the background color estimated from the original image without using the prescribed parameters.

  An image processing apparatus according to claim 5 is a feature amount calculating means for calculating a feature amount for an original image which is a digital image, and a character for extracting a character region from the original image based on the feature amount. Area extracting means, block dividing means for dividing the original image into blocks, class classification means for classifying pixels belonging to the character area into first and second classes according to color, for each block; Background color estimation means for estimating a background color on the original image based on a class classification of pixels belonging to the character area, and background area specifying means for specifying a background area on the original image based on the estimated background color And gradation correction means for performing gradation correction on the original image by replacing the color of the specified background area with the estimated background color.

  Therefore, for example, when an original image, which is a digital image input from an image input device, is output from the image output device, pixels belonging to a character area extracted based on a value calculated from the feature amount of the original image are colored. By replacing the background region color specified based on the background color estimated from the original image with the estimated background color based on the classification classified according to the original image, without using the specified parameters Tone correction can be performed.

  An image processing apparatus according to claim 6 is a feature amount calculating means for calculating a feature amount with respect to an original image that is a digital image, and a character that extracts a character region from the original image based on the feature amount. Area extracting means, block dividing means for dividing the original image into blocks, class classification means for classifying pixels belonging to the character area into first and second classes according to color, for each block; Background color estimation means for estimating a background color on the original image based on a class classification of pixels belonging to the character area, and background area specifying means for specifying a background area on the original image based on the estimated background color And gradation correction means for performing gradation correction on the original image by replacing the color of the specified background area with white.

  Therefore, for example, when an original image, which is a digital image input from an image input device, is output from the image output device, pixels belonging to a character area extracted based on a value calculated from the feature amount of the original image are colored. Tone correction for the original image without using specified parameters by replacing the color of the background area specified based on the background color estimated from the original image with white based on the classification classified according to Can be performed.

  According to a seventh aspect of the present invention, in the image processing apparatus according to the fourth, fifth, or sixth aspect, the feature amount calculating means calculates an average value and a standard deviation of color signals in a window set around each pixel. The character region extracting means is configured to detect the target pixel and the target pixel based on the color signal value of the target pixel in the window with respect to a threshold set by the average value and standard deviation of the color signals in the window. Are extracted as the character region.

  Therefore, a character area is extracted for each window based on the color signal value of the pixel of interest in the window with respect to the threshold value set by the average value and standard deviation of the color signal in the window set around each pixel. Therefore, for example, the image processing apparatus according to claim 4 can accurately estimate the black character color and the background color, and the image processing apparatus according to claim 5 or 6 can accurately estimate the background color. Can do.

  The invention according to claim 8 is the image processing apparatus according to claim 4, 5 or 6, wherein the feature amount calculation means calculates an edge amount of each pixel, and the character region extraction means determines the edge amount. Pixels above the threshold and surrounding pixels are extracted as the character region.

  Therefore, since the pixels whose edge amount is equal to or larger than the predetermined threshold and the pixels around the pixels are extracted as the character region, for example, in the image processing apparatus according to claim 4, the black character color and the background color are accurately estimated. In the image processing apparatus according to claim 5 or 6, the background color can be accurately estimated.

  According to a ninth aspect of the present invention, in the image processing device according to the fourth, fifth, or sixth aspect, the feature amount calculating means calculates the average of the edge amount of each pixel and the color signal in a window set around each pixel. The character area extracting means is set by a pixel whose edge amount is equal to or greater than the specified threshold and pixels around the pixel, and an average value and standard deviation of color signals in the window. Based on the color signal value of the target pixel in the window with respect to the threshold value, the target pixel and pixels around the target pixel are extracted as the character region.

  Therefore, pixels whose edge amount is equal to or greater than a predetermined threshold and pixels around this pixel are extracted as character areas, and are set by the average value and standard deviation of the color signals in the window set around each pixel. Since the character region is extracted for each window based on the color signal value of the target pixel in the window with respect to the threshold value, for example, in the image processing apparatus according to claim 4, the black character color and the background color are accurately estimated. In the image processing apparatus according to claim 5 or 6, the background color can be accurately estimated.

  According to a tenth aspect of the present invention, in the image processing apparatus according to any one of the first to ninth aspects, the class classification unit acquires a luminance threshold based on luminance calculated from a color signal of each pixel, A pixel group whose luminance is lower than the luminance threshold is classified as the first class, and a pixel group whose luminance is higher than the luminance threshold is classified as the second class.

  Therefore, classification can be performed by threshold processing of luminance calculated from the color signal of each pixel.

  According to an eleventh aspect of the present invention, in the image processing apparatus according to the fourth aspect, the black character color / background color estimation means has a maximum number of pixels belonging to the second class based on a class classification result for each block. The average color of the pixel group belonging to the second class in the block where the average color of the pixel group belonging to the first class in the block is black character color and the number of pixels belonging to the second class is the maximum Is estimated as the background color.

  Therefore, based on the class classification result for each block, the average color of the pixel group belonging to the first class in the block having the maximum number of pixels belonging to the second class is set to the black character color, and the second class in the same block is set to the second class. By estimating the average color of the pixel group to which it belongs as the background color, it is possible to accurately estimate the black character color and the background color.

  According to a twelfth aspect of the present invention, in the image processing apparatus according to the fifth or sixth aspect, the background color estimation means maximizes the number of pixels belonging to the second class based on a class classification result for each block. An average color of a pixel group belonging to the second class in the block is estimated as a background color.

  Therefore, based on the classification result for each block, the background color is accurately determined by estimating the average color of the pixel group belonging to the second class in the block having the maximum number of pixels belonging to the second class as the background color. Can be estimated.

  According to a thirteenth aspect of the present invention, in the image processing apparatus according to the fourth aspect, the black character color / background color estimation means calculates the average of the pixel groups belonging to the first class based on the class classification result for each block. The number of pixels belonging to the second class, where the average color of the pixel group belonging to the first class in the block in which the difference between the luminance and the average luminance of the pixel group belonging to the second class is maximized is a black character color The average color of the pixel group belonging to the second class in the block having the maximum is estimated as the background color.

  Therefore, the average color of the pixel group belonging to the first class in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class is the maximum is a black character color, By estimating the average color of the pixel group belonging to the second class in the same block as the background color, the black character color and the background color can be accurately estimated.

  According to a fourteenth aspect of the present invention, in the image processing apparatus according to the fifth or sixth aspect, the background color estimation means maximizes the number of pixels belonging to the second class based on a class classification result for each block. An average color of a pixel group belonging to the second class in the block is estimated as a background color.

  Therefore, the average color of the pixel group belonging to the second class in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average brightness of the pixel group belonging to the second class is maximized is estimated as the background color. By doing so, the background color can be accurately estimated.

  According to a fifteenth aspect of the present invention, in the image processing apparatus according to the tenth aspect, the gradation correction unit is configured to maximize the number of pixels belonging to the second class based on a class classification result for each block. Average luminance and standard deviation of the pixel group belonging to the first class in the block, and average luminance of the pixel group belonging to the second class in the block in which the number of pixels belonging to the second class is maximized The gradation correction is performed according to the gradation conversion curve set based on the value and the standard deviation.

  Therefore, based on the class classification result for each block, the average value and standard deviation of the luminance of the pixel group belonging to the first class in the block having the maximum number of pixels belonging to the second class, and the second value in the same block Depending on the gradation conversion curve set based on the average value and standard deviation of the brightness of the pixel group belonging to the class, the gradation correction of the black character and the background or the gradation correction of the background area over the entire original image is the same level. Since it is performed in accordance with the tone conversion curve, the contrast between the black character and the background can be stabilized (uniformized) over the entire image.

  According to a sixteenth aspect of the present invention, in the image processing apparatus according to the tenth aspect, the gradation correction unit is configured to determine an average luminance of the pixel group belonging to the first class based on a class classification result for each block, and the The average value and standard deviation of the luminance value of the pixel group belonging to the first class in the block having the largest difference from the average luminance value of the pixel group belonging to the second class, and the pixel group belonging to the first class. A gradation set based on an average value and a standard deviation of the luminance values of the pixel group belonging to the second class in the block in which the difference between the average luminance value and the average luminance value of the pixel group belonging to the second class is maximized. Gradation correction is performed according to the conversion curve.

  Therefore, based on the class classification result for each block, it belongs to the first class in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class is maximized. Depending on the gradation conversion curve set based on the average value and standard deviation of the luminance of the pixel group and the average value and standard deviation of the luminance of the pixel group belonging to the second class in the same block, the entire original image is covered. Tone correction between black text and background or background area is performed according to the same tone conversion curve, so that the contrast adjustment between black text and background is stabilized (uniformized) over the entire image. Can do.

  A seventeenth aspect of the present invention is the image processing apparatus according to any one of the first to sixteenth aspects, further comprising a low-resolution image generating unit that generates a low-resolution image having a resolution lower than that of the original image. The quantity calculation means calculates a feature quantity from the low resolution image, and the character area extraction means extracts the character area from the low resolution image.

  Therefore, the amount of calculation in each process can be reduced and the process can be simplified.

  An image processing program according to an eighteenth aspect of the present invention is interpreted by a computer, and in this computer, a character region extraction function for extracting a character region from an original image which is a digital image, and pixels belonging to the character region according to color Black character color / background color estimation for estimating a black character color and a background color on the original image based on a class classification function for classifying into a first class and a second class, and a class classification of pixels belonging to the character area And a gradation correction function for performing gradation correction on the original image based on the estimated black character color and background color.

  Therefore, by causing a computer to execute the image processing program of the present invention, for example, when outputting an original image, which is a digital image input from an image input device, from an image output device, pixels belonging to a character area are colored. The black character color and background color on the original image are estimated based on the classified classification, and tone correction is performed on the original image without using the specified parameters based on the estimated black character color and background color. Can be done.

  According to a nineteenth aspect of the present invention, there is provided an image processing program that is interpreted by a computer, and that the computer extracts a character region from an original image, which is a digital image, and a pixel belonging to the character region in accordance with a color. A class classification function for classifying into a first class and a second class, a background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area, and an estimated background A background area specifying function for specifying a background area on the original image based on a color, and a gradation correction for performing gradation correction on the original image by replacing the color of the specified background area with an estimated background color And execute the function.

  Therefore, by causing a computer to execute the image processing program of the present invention, for example, when outputting an original image, which is a digital image input from an image input device, from an image output device, pixels belonging to a character area are colored. The background color specified based on the background color estimated from the original image based on the classified classification is replaced with the estimated background color, and the gradation for the original image without using the specified parameters Correction can be performed.

  The image processing program according to the invention of claim 20 is interpreted by a computer, and in this computer, a character region extraction function for extracting a character region from an original image which is a digital image, and pixels belonging to the character region according to color A class classification function for classifying into a first class and a second class, a background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area, and an estimated background A background region specifying function for specifying a background region on the original image based on a color, and a tone correction function for performing tone correction on the original image by replacing the color of the specified background region with white. Let it run.

  Therefore, by causing a computer to execute the image processing program of the present invention, for example, when outputting an original image, which is a digital image input from an image input device, from an image output device, pixels belonging to a character area are colored. The color of the background area specified based on the background color estimated from the original image based on the classified classification is replaced with white, and gradation correction is performed on the original image without using a specified parameter. it can.

  The image processing program of the invention according to claim 21 is interpreted by a computer, and based on the feature amount, a feature amount calculation function for calculating a feature amount with respect to an original image that is a digital image, A character area extracting function for extracting a character area from an original image, a block dividing function for dividing the original image into blocks, and the pixels belonging to the character area in the first class and the second class according to color A class classification function for classifying each, a black character color / background color estimation function for estimating a black character color and a background color on the original image based on a class classification of pixels belonging to the character area, and an estimated black character color And a gradation correction function for performing gradation correction on the original image based on the background color.

  Therefore, by causing a computer to execute the image processing program of the present invention, for example, when outputting an original image, which is a digital image input from an image input device, from an image output device, it is calculated from the feature amount of the original image. The original image without using the specified parameters based on the black character color and background color estimated from the original image based on the class classification that classifies the pixels belonging to the character area extracted based on the obtained values according to the color Tone correction can be performed.

  The image processing program according to the invention of claim 22 is interpreted by a computer, and based on the feature amount, a feature amount calculation function for calculating a feature amount with respect to an original image that is a digital image, A character area extracting function for extracting a character area from an original image, a block dividing function for dividing the original image into blocks, and the pixels belonging to the character area in the first class and the second class according to color A class classification function for classifying each image, a background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area, and a function on the original image based on the estimated background color A background area specifying function for specifying a background area, and a gradation correction function for performing gradation correction on the original image by replacing the color of the specified background area with the estimated background color. To row.

  Therefore, by causing a computer to execute the image processing program of the present invention, for example, when outputting an original image, which is a digital image input from an image input device, from an image output device, it is calculated from the feature amount of the original image. Based on the class classification that classifies the pixels belonging to the character area extracted based on the obtained values according to the color, the color of the background area specified based on the background color estimated from the original image is changed to the estimated background color It is possible to perform gradation correction on the original image without using a predetermined parameter.

  An image processing program according to a twenty-third aspect of the invention is interpreted by a computer, and based on the feature amount, a feature amount calculation function for calculating a feature amount with respect to an original image that is a digital image, A character area extracting function for extracting a character area from an original image, a block dividing function for dividing the original image into blocks, and the pixels belonging to the character area in the first class and the second class according to color A class classification function for classifying each image, a background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area, and a function on the original image based on the estimated background color A background area specifying function for specifying a background area and a tone correction function for correcting the tone of the original image by replacing the color of the specified background area with white are executed.

  Therefore, by causing a computer to execute the image processing program of the present invention, for example, when outputting an original image, which is a digital image input from an image input device, from an image output device, it is calculated from the feature amount of the original image. By replacing the color of the background area specified based on the background color estimated from the original image with white based on the class classification that classifies the pixels belonging to the character area extracted based on the value Therefore, tone correction can be performed on the original image without using specified parameters.

  According to a twenty-fourth aspect of the present invention, in the image processing program according to the twenty-first, twenty-second, or twenty-third aspect, an average value and a standard deviation of color signals in a window set around each pixel are calculated by the feature amount calculation function. Then, by the character region extraction function, the target pixel and the target pixel based on the color signal value of the target pixel in the window with respect to a threshold set by the average value and the standard deviation of the color signal in the window Are extracted as the character region.

  Therefore, a character area is extracted for each window based on the color signal value of the pixel of interest in the window with respect to the threshold value set by the average value and standard deviation of the color signal in the window set around each pixel. Therefore, for example, in the image processing device according to claim 21, the black character color and the background color can be accurately estimated, and in the image processing device according to claim 22 or 23, the background color is accurately estimated. Can do.

  According to a twenty-fifth aspect of the invention, in the image processing program according to the twenty-first, twenty-second, or twenty-third aspect, an edge amount of each pixel is calculated by the feature amount calculation function, and the edge amount is defined by the character region extraction function Pixels above the threshold and surrounding pixels are extracted as the character region.

  Accordingly, since the pixels whose edge amount is equal to or greater than the predetermined threshold and the pixels around the pixels are extracted as the character region, for example, in the image processing device according to claim 21, the black character color and the background color are accurately estimated. In the image processing apparatus according to claim 22 or 23, the background color can be accurately estimated.

  According to a twenty-sixth aspect of the present invention, in the image processing program according to the twenty-first, twenty-second, or twenty-third aspect, the edge amount of each pixel and an average of color signals in a window set around each pixel are obtained by the feature amount calculation function. The value and standard deviation are calculated, and the character area extraction function is used to set a pixel whose edge amount is equal to or larger than the specified threshold, pixels around the pixel, and an average value and standard deviation of the color signal in the window. Based on the color signal value of the target pixel in the window with respect to the threshold value, the target pixel and pixels around the target pixel are extracted as the character region.

  Therefore, pixels whose edge amount is equal to or greater than a predetermined threshold and pixels around this pixel are extracted as character areas, and are set by the average value and standard deviation of the color signals in the window set around each pixel. Since the character region is extracted for each window based on the color signal value of the target pixel in the window with respect to the threshold value, for example, in the image processing apparatus according to claim 21, the black character color and the background color are accurately estimated. In the image processing apparatus according to claim 22 or 23, the background color can be accurately estimated.

  The invention according to claim 27 is the image processing program according to any one of claims 18 to 26, wherein the class classification function acquires a brightness threshold based on brightness calculated from a color signal of each pixel, A pixel group whose luminance is lower than the luminance threshold is classified as the first class, and a pixel group whose luminance is higher than the luminance threshold is classified as the second class.

  Therefore, classification can be performed by threshold processing of luminance calculated from the color signal of each pixel.

  According to a twenty-eighth aspect of the present invention, in the image processing program according to the twenty-first aspect, the number of pixels belonging to the second class is maximized based on the class classification result for each block by the black character color / background color estimation function. The average color of the pixel group belonging to the second class in the block where the average color of the pixel group belonging to the first class in the block is black character color and the number of pixels belonging to the second class is the maximum Is estimated as the background color.

  Therefore, based on the class classification result for each block, the average color of the pixel group belonging to the first class in the block having the maximum number of pixels belonging to the second class is set to the black character color, and the second class in the same block is set to the second class. By estimating the average color of the pixel group to which it belongs as the background color, the black character color and the background color can be accurately estimated.

  The invention according to claim 29 is the image processing program according to claim 22 or 23, wherein the background color estimation function maximizes the number of pixels belonging to the second class based on the class classification result for each block. An average color of a pixel group belonging to the second class in the block is estimated as a background color.

  Therefore, based on the classification result for each block, the background color is accurately determined by estimating the average color of the pixel group belonging to the second class in the block having the maximum number of pixels belonging to the second class as the background color. Can be estimated.

  According to a thirty-third aspect of the invention, in the image processing program according to the twenty-first aspect, an average of pixel groups belonging to the first class based on a class classification result for each block by the black character color / background color estimation function The number of pixels belonging to the second class, where the average color of the pixel group belonging to the first class in the block in which the difference between the luminance and the average luminance of the pixel group belonging to the second class is maximized is a black character color The average color of the pixel group belonging to the second class in the block having the maximum is estimated as the background color.

  Therefore, the average color of the pixel group belonging to the first class in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class is the maximum is a black character color, By estimating the average color of the pixel group belonging to the second class in the same block as the background color, the black character color and the background color can be accurately estimated.

  According to a thirty-first aspect of the invention, in the image processing program according to the twenty-second or twenty-third aspect, the average luminance of the pixel group belonging to the first class based on the class classification result for each block by the background color estimation function. And the average color of the pixel group belonging to the second class in the block in which the difference between the average luminance of the pixel group belonging to the second class is the maximum is estimated as the background color.

  Therefore, the average color of the pixel group belonging to the second class in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average brightness of the pixel group belonging to the second class is maximized is estimated as the background color. By doing so, the background color can be accurately estimated.

  According to a thirty-second aspect of the present invention, in the image processing program according to the twenty-seventh aspect, the number of pixels belonging to the second class is maximized by the gradation correction function based on a class classification result for each block. Average luminance and standard deviation of the pixel group belonging to the first class in the block, and average luminance of the pixel group belonging to the second class in the block in which the number of pixels belonging to the second class is maximized The gradation correction is performed according to the gradation conversion curve set based on the value and the standard deviation.

  Therefore, based on the class classification result for each block, the average value and standard deviation of the luminance of the pixel group belonging to the first class in the block having the maximum number of pixels belonging to the second class, and the second value in the same block Depending on the gradation conversion curve set based on the average value and standard deviation of the brightness of the pixel group belonging to the class, the gradation correction of the black character and the background or the gradation correction of the background area over the entire original image is the same level. Since it is performed according to the tone conversion curve, the adjustment of the contrast between the black character and the background or the adjustment of the contrast of the background region can be stabilized (uniformized) over the entire image.

  According to a thirty-third aspect of the present invention, in the image processing program according to the twenty-seventh aspect, the gradation correction function causes the average luminance of the pixel group belonging to the first class and the average brightness based on the classification result for each block. The average value and standard deviation of the luminance value of the pixel group belonging to the first class in the block having the largest difference from the average luminance value of the pixel group belonging to the second class, and the pixel group belonging to the first class. A gradation set based on an average value and a standard deviation of the luminance values of the pixel group belonging to the second class in the block in which the difference between the average luminance value and the average luminance value of the pixel group belonging to the second class is maximized. Gradation correction is performed according to the conversion curve.

  Therefore, based on the class classification result for each block, it belongs to the first class in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class is maximized. Depending on the gradation conversion curve set based on the average value and standard deviation of the luminance of the pixel group and the average value and standard deviation of the luminance of the pixel group belonging to the second class in the same block, the entire original image is covered. Tone correction for black text and background or background area is performed according to the same tone conversion curve, so the adjustment of contrast between black text and background or the contrast of background area is stable over the entire image. Can be made uniform.

  According to a thirty-fourth aspect of the present invention, in the image processing program according to any one of the eighteenth to thirty-third aspects, the computer executes a low-resolution image generation function for generating a low-resolution image having a lower resolution than the original image. The feature amount is calculated from the low-resolution image by the feature amount calculation function, and the character region is extracted from the low-resolution image by the character region extraction function.

  Therefore, the amount of calculation in each process can be reduced and the process can be simplified.

  A storage medium according to a thirty-fifth aspect stores the image processing program according to any one of the eighteenth to thirty-fourth aspects so as to be readable by a computer.

  Therefore, the operation of the invention according to any one of claims 18 to 34 can be achieved.

  According to the image processing apparatus of the first aspect of the invention and the image processing program of the invention of the eighteenth aspect, for example, when outputting an original image, which is a digital image input from the image input device, from the image output device The black character color and the background color on the original image are estimated based on the class classification in which the pixels belonging to the character area are classified according to the color, and the specified parameters are used based on the estimated black character color and the background color. Therefore, the user can set parameters while maintaining the gradation of the halftone area of the original image input from various image input devices. The contrast between the black characters of the output image and the background can be automatically adjusted without any problem.

  According to the image processing apparatus of the invention of claim 2 and the image processing program of the invention of claim 19, for example, when outputting an original image, which is a digital image input from the image input device, from the image output device By replacing the color of the background area specified based on the background color estimated from the original image based on the class classification that classifies the pixels belonging to the character area according to the color with the estimated background color, Automatic image degradation caused by background parts such as background color fluctuations and show-through in original images input from various image input devices without using parameters or setting parameters by the user Therefore, it is possible to obtain an output image in which characters and the like are easy to see by making corrections and optimizing the background portion.

  According to the image processing apparatus of the invention of claim 3 and the image processing program of the invention of claim 20, for example, when outputting an original image which is a digital image input from the image input device from the image output device The specified parameters can be used by replacing the color of the background area specified based on the background color estimated from the original image based on the class classification that classifies the pixels belonging to the character area according to the color with white. It is possible to automatically correct image deterioration such as background color fluctuation and show-through in the original image input from various image input devices without the user performing a task such as setting parameters.

  According to the image processing apparatus of the invention of claim 4 and the image processing program of the invention of claim 21, for example, when outputting an original image which is a digital image input from the image input device from the image output device Based on the classification of the pixels belonging to the character region extracted based on the value calculated from the feature value of the original image according to the color, based on the black character color and the background color estimated from the original image, It is possible to perform gradation correction on the original image without using the specified parameters. As a result, while maintaining the gradation of the halftone area of the original image input from various image input devices, the user can automatically set the black character and the background of the output image without performing operations such as setting parameters. The contrast can be adjusted.

  According to the image processing apparatus of the invention of claim 5 and the image processing program of the invention of claim 22, for example, when an original image that is a digital image input from the image input device is output from the image output device A background region identified based on a background color estimated from the original image based on a class classification in which pixels belonging to the character region extracted based on a value calculated from the feature value of the original image are classified according to color By substituting the background color with the estimated background color, the background of the original image input from various image input devices can be used without using the specified parameters or the user setting the parameters. It is possible to automatically correct image degradation caused by the background portion such as color variation and show-through, and to optimize the background portion, thereby obtaining an output image in which characters and the like are easy to see.

  According to the image processing apparatus of the invention of claim 6 and the image processing program of the invention of claim 23, for example, when outputting an original image which is a digital image input from the image input device from the image output device A background region identified based on a background color estimated from the original image based on a class classification in which pixels belonging to the character region extracted based on a value calculated from the feature value of the original image are classified according to color By replacing the color of the image with white, the background color fluctuations and backgrounds in the original images input from various image input devices can be used without using the specified parameters or the user setting the parameters. Image deterioration such as reflection can be automatically corrected.

  According to the invention described in claim 7 and the invention described in claim 24, in the image processing apparatus according to claim 4, 5 or 6, or the image processing program according to claim 21, 22 or 23, it is set around each pixel. The character region is extracted for each window based on the color signal value of the pixel of interest in the window with respect to the threshold value set by the average value and the standard deviation of the color signal in the specified window. The image processing apparatus according to claim 5 and the image processing program according to claim 21 can accurately estimate the black character color and the background color. The image processing apparatus according to claim 5 or 6 and the image according to claim 22 or 23 In the processing program, the background color can be accurately estimated.

  According to the invention described in claim 8 and the invention described in claim 25, in the image processing device according to claim 4, 5 or 6 or the image processing program according to claim 21, 22 or 23, the edge amount is not less than a specified threshold value. Therefore, for example, in the image processing apparatus according to claim 4 and the image processing program according to claim 21, the black character color and the background color are accurately estimated. In the image processing apparatus according to claim 5 or 6 and the image processing program according to claim 22 or 23, the background color can be accurately estimated.

  According to the invention described in claim 9 and the invention described in claim 26, in the image processing apparatus according to claim 4, 5 or 6, or the image processing program according to claim 21, 22 or 23, the edge amount is equal to or greater than a specified threshold value. And a pixel surrounding this pixel are extracted as a character area, and attention is paid to the threshold value set by the average value and the standard deviation of the color signal in the window set around each pixel. Since the character region is extracted for each window based on the color signal value of the pixel, for example, in the image processing apparatus according to claim 4 and the image processing program according to claim 21, the black character color and the background color are accurately estimated. In the image processing apparatus according to claim 5 or 6, and the image processing program according to claim 22 or 23, the background color can be set. It is possible to estimate the probability.

  According to the invention of claim 10 and the invention of claim 27, in the image processing apparatus according to any one of claims 1 to 9 or the image processing according to any one of claims 18 to 26, Since classification can be performed by threshold processing of luminance calculated from pixel color signals, the output image can be corrected without requiring any knowledge / characteristic information about the image input device. In addition, for example, when the user designates a parameter when correcting image deterioration due to a change in background color (background color) or show-through, the designated parameter can be simplified.

  According to the invention described in claim 11 and the invention described in claim 28, in the image processing device according to claim 4 or the image processing program according to claim 21, the second class based on the class classification result for each block. By making the average color of the pixel group belonging to the first class in the block having the maximum number of pixels belonging to the black character color and estimating the average color of the pixel group belonging to the second class in the same block as the background color, Since the color and the background color can be accurately estimated, the output image can be corrected more effectively.

  According to the invention of claim 12 and the invention of claim 29, in the image processing apparatus of claim 5 or 6, or the image processing program of claim 22 or 23, based on the class classification result for each block, Since the background color can be accurately estimated by estimating the average color of the pixel group belonging to the second class in the block having the maximum number of pixels belonging to the second class as the background color, more effectively The output image can be corrected.

  According to the invention of claim 13 and the invention of claim 30, in the image processing device according to claim 4 or the image processing program according to claim 21, the average luminance of the pixel group belonging to the first class and the The average color of the pixel group belonging to the first class in the block having the largest difference from the average luminance of the pixel group belonging to the second class is a black character color, and the average color of the pixel group belonging to the second class in the same block is By estimating as the background color, the black character color and the background color can be accurately estimated, so that the output image can be corrected more effectively.

  According to the invention described in claim 14 and the invention described in claim 31, in the image processing device according to claim 5 or 6, or the image processing program according to claim 22 or 23, the average of the pixel groups belonging to the first class Accurately estimating the background color by estimating the average color of the pixel group belonging to the second class in the block where the difference between the luminance and the average luminance of the pixel group belonging to the second class is the maximum as the background color Therefore, the output image can be corrected more effectively.

  According to the invention described in claim 15 and the invention described in claim 32, in the image processing apparatus according to claim 10 or the image processing program according to claim 27, the second class based on the class classification result for each block. Based on the average value and standard deviation of the luminance values of the pixel groups belonging to the first class in the block having the maximum number of pixels belonging to the pixel group, and the average value and standard deviation of the luminance values of the pixel groups belonging to the second class in the same block. Depending on the gradation conversion curve that is set, the gradation correction of the black character and the background over the entire original image or the gradation correction of the background area is performed according to the same gradation conversion curve, so the contrast between the black character and the background is the same. Can be stabilized (uniformized) over the entire image.

  According to the invention of claim 16 and the invention of claim 33, in the image processing apparatus of claim 10 or the image processing program of claim 27, the first class is based on the class classification result for each block. The average value and standard deviation of the luminance values of the pixel groups belonging to the first class in the block in which the difference between the average luminance value of the pixel groups belonging to the pixel group and the average luminance value of the pixel group belonging to the second class is the maximum, and the The contrast between the black character and the background is obtained by performing correction on the entire original image in accordance with the gradation conversion curve set based on the average value and the standard deviation of the luminance of the pixel group belonging to the second class. Adjustment and background area correction can be stabilized (uniformized) over the entire image.

  According to the invention of claim 17 and the invention of claim 34, in the image processing apparatus according to any one of claims 1 to 16, or the image processing program according to any one of claims 18 to 33, The amount of calculation in each process can be reduced, the process can be simplified, and the speed of the process can be increased.

  According to the storage medium of the invention of claim 35, the effect of the invention of any one of claims 18 to 34 can be obtained.

A first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a schematic diagram showing a system construction example of the present embodiment. As shown in FIG. 1, the system according to the present embodiment assumes a server client system 11 in which a plurality of personal computers 301 as image processing apparatuses are connected to a server computer 101 via a network 201 such as a LAN. .

  The server client system 11 includes an environment arranged so that an image input device 401 such as a scanner or a digital camera and an image output device 501 such as a printer can be shared on the network 201. A multifunction peripheral (hereinafter referred to as MFP) 601 is connected on the network 201. In the server client system 11, the MFP 601 may be constructed as an environment that functions as the image input device 401 or the image output device 501.

  The server client system 11 is constructed so as to be capable of data communication with another server client system 31 via, for example, the intranet 21 and is constructed so as to be capable of data communication with an external environment via the Internet communication network 41.

  Next, the module configuration of the personal computer 301 will be described with reference to FIG. FIG. 2 is a module configuration diagram of the personal computer 301 in the present embodiment. The personal computer 301 includes a CPU 302 for information processing, a ROM 303 for storing information, a primary storage device 305 such as a RAM 304, a secondary storage device 307 such as an HDD 306 (hard disk drive), and stores information and distributes information to the outside. A removable disk device 308 that reads information stored in a portable medium 308a for obtaining information from outside such as a network, a network interface 309 for communicating information with other external computers, and processing A display device 310 that displays progress and results to the operator, a keyboard 311 for the operator to input commands and information to the personal computer 301, a pointing device 312 such as a mouse, and the like.

  In this embodiment, a CD-ROM is used as the portable medium 308a, and the removable disk device 308 is realized by a CD-ROM drive capable of reading information stored in the CD-ROM. did.

  The CPU 302, the primary storage device 305, the secondary storage device 307, the removable disk device 308, the network interface 309, the display device 310, the keyboard 311, the pointing device 312, etc. Each unit included in the personal computer 301 that is arbitrated by 313 operates based on data that is arbitrated by the bus controller 313.

  In the personal computer 301, when the user turns on the power, the CPU 302 activates a program called a loader in the ROM 303, reads a program for managing computer hardware and software from the HDD 306 to the RAM 304, and activates the read program. In the present embodiment, a program that is read from the HDD 306 into the RAM 304 and manages computer hardware and software is called an operating system. The operating system starts application programs and the like, reads information, and stores information in response to user operations. As typical operating systems, for example, Windows (registered trademark), UNIX (registered trademark), and the like are known. In the present embodiment, an operation program executed on the operating system is an application program.

  The personal computer 301 of this embodiment stores an image processing program in the HDD 306 as an application program. For this reason, in the present embodiment, a storage medium for storing the image processing program is realized by the HDD 306.

  Various operation programs such as an image processing program installed in the secondary storage device 307 such as the HDD 306 are installed from, for example, an optical information recording medium such as a CD-ROM storing various operation programs or a magnetic medium such as an FD. Is possible. For this reason, it is possible to realize a storage medium for storing an image processing program also by a portable storage medium such as an optical information recording medium such as a CD-ROM or a magnetic medium such as an FD.

  In addition, various operation programs such as an image processing program installed in the secondary storage device 307 such as the HDD 306 may be installed in the secondary storage device 307 from the outside via the network interface 309, for example.

  In this embodiment, the storage medium is realized by the HDD 306. However, the present invention is not limited to this, and various operation programs such as an image processing program installed in the secondary storage device 307 such as the HDD 306 are, for example, CD- It can also be installed from an optical information recording medium such as a ROM or a magnetic medium such as an FD, and an image can also be obtained from various media having portability such as an optical information recording medium such as a CD-ROM or a magnetic medium such as an FD. A storage medium for storing the processing program can be realized.

  In this embodiment, image processing to be described later is executed according to an image processing program installed in the secondary storage device 307 such as the HDD 306. However, the present invention is not limited to this. The image processing described later may be executed in accordance with an image processing program downloaded to the secondary storage device 307 from outside.

  Next, means executed by the personal computer 301 will be schematically described with reference to FIGS. FIG. 3 is a functional block diagram schematically showing means executed by the personal computer 301 in accordance with the image processing program. FIG. 4 is a flowchart showing an execution procedure of various means included in this functional block diagram.

  The personal computer 301 activates an image processing program executed on the operating system, and executes various arithmetic processes by the CPU 302 according to the image processing program, thereby centrally controlling each unit included in the personal computer 301. . When executing the image processing program, the personal computer 301 executes various means shown in the flowchart of FIG. 4 by each function shown in the functional block diagram of FIG.

1. Overview of Processing First, an overview of processing will be described. Many characters are printed on the document image, but a general ordinary document has a portion in which black characters are directly printed on an unprinted portion of the paper. For this reason, it is assumed that there is a certain block in which black characters are directly printed on the paper surface by extracting an area where black characters are likely from the input image and dividing the input image into sufficiently small blocks. it can. Therefore, if the paper color as the background color is white, the flow of image processing can be defined as follows.

The image processing program according to the present embodiment is executed on the assumption that the personal computer 301 receives the original image I ₀ (input image) via the network interface 309, as shown in the flowchart of FIG. (Step S1). Here, the original image I ₀ is a digitized color image.

The low resolution image generating means 1001 generates a low resolution image (I) having a lower resolution than the original image (I ₀ ) from the original image (I ₀ ) (S2).

  The low resolution processing unit 2000 smoothes the low resolution image (I) generated by the low resolution image generating unit 1001 by the smoothing unit 2001 (S3), and the feature amount calculating unit 2002 converts each of the low resolution images (I). A feature size of the low-resolution image (I) is calculated by setting a fixed-size window around the pixel and calculating the average value μ and standard deviation σ of the signal in each of the R, G, and B channels (S4). .

  The character region extraction unit 3001 performs local adaptive threshold processing and dilation processing on the low-resolution image (I) to perform local adaptive binarization of the color components, so that the character region C (see FIG. 6). Is detected (S5).

The black character color / background color statistic estimation means 4001 divides the input original image (I ₀ ) into fixed-size non-overlapping blocks (S6), and in each divided block, pixels belonging to the character region C are divided. According to the two representative colors, the first class and the second class are classified into two classes (S7). Here, functions as block dividing means and class classification means are executed. Based on the luminance of the pixels belonging to the character area C, normally, the lighter color corresponds to the background color of the character area and the darker color corresponds to the character color.

  Further, the black character color / background color statistic estimation means 4001 displays a block B in which the number of pixels classified into one class is maximized from each block in which pixels belonging to the character region C are classified into two representative colors. W is selected, the two representative colors in this window W are set as the average color of the background and the average color of black characters in the input image, respectively, and the black character color and the background color are estimated based on the statistics of luminance. (S8). Here, the luminance is, for example, an average value of R, G, and B signals acquired by the calculation of the following equation (1), and the average value and standard deviation of the luminance acquired from the luminance are expressed as luminance values. Use statistics.

階調補正手段５００１は、輝度の統計量から計算された飽和基準値に基づいて、各ブロック内における各画素の階調補正を行なう（Ｓ９）。ここでは、下地色を白（輝度最大）とし、黒文字色を黒（輝度最小）とする。

The gradation correction unit 5001 performs gradation correction of each pixel in each block based on the saturation reference value calculated from the luminance statistics (S9). Here, the background color is white (luminance maximum), and the black character color is black (luminance minimum).

  The corrected image thus obtained is output / transmitted from a personal computer via a network interface or the like (S10).

2. Details of Processing Next, details of each means described above executed by the personal computer 301 will be described. Here, an original image (I ₀ ) as shown in FIG. 5 will be described as an example of an input image.

(1) Generation of low-resolution image [low-resolution image generation means 1001]
The low resolution image generation means 1001 converts the original image (I ₀ ) into a low resolution image (I) of about 100 dpi in order to reduce the amount of calculation. First, the input image is simply divided into non-overlapping blocks B (see FIG. 6), and the average value of the signals in each block B is set as the corresponding pixel signal in the low resolution image (I). At this time, if the size of the block B, that is, the reduction ratio is r, the average value of the signal in the block B can be obtained by the calculation of the equation (2).

ここで、縮小率ｒは、常に自然数になるようにし、原画像（Ｉ_０）の解像度が１００で割り切れない場合、ｒは自然数に丸めた値にする。例えば、３６０ｄｐｉの場合、ｒは３となる。

Here, the reduction ratio r is always a natural number, and when the resolution of the original image (I ₀ ) is not divisible by 100, r is a value rounded to a natural number. For example, r is 3 in the case of 360 dpi.

As described above, by using the low resolution image (I) having a resolution lower than that of the original image (I ₀ ), it is possible to reduce the subsequent calculation amount in the image processing and to simplify the processing.

(2) Smoothing [smoothing means 2001]
The smoothing unit 2001 smoothes the low resolution image (I) with a linear filter in order to remove noise.

(3) Feature quantity calculation [feature quantity calculation means 2002]
The feature amount calculation unit 2002 sets a fixed size window around each pixel for the low resolution image (I), and calculates the average value μ and the standard deviation σ of the signal in each of the R, G, and B channels. Calculate

(4) Extraction of character area [character area extraction means 3001]
The character region extraction unit 3001 extracts the character region C by performing local adaptive binarization of the color component on the low resolution image (I). When extracting the character region C, the threshold value μ (a + bσ) using a and b as parameters is compared with the signal value of each pixel, and based on whether the signal value is higher or lower than the threshold value μ (a + bσ). Region C is extracted. For example, in the case of an image in which black characters are directly printed on the background, the contrast tends to increase in all the R, G, and B channels. For this reason, in this embodiment, a pixel [i, j] whose signal value is lower than the threshold value μ (a + bσ) is set as an element of the character region C in all channels (see equation (3)).

また、文字領域抽出手段３００１は、原画像（Ｉ_０）と同じサイズで、文字領域（Ｃの要素）ではＯＮ値、それ以外ではＯＦＦ値を持つような２値画像を構成し（図６参照）、この２値画像において背景画素（ＯＦＦ値の画素）が横方向に沿う横方向のランを構築する。ここで、あるランの長さが予め規定された閾値τよりも短ければ、その画素を一時的にＯＮにする。このようにして、横方向に対して、背景画素のランのｓｍｅａｒｉｎｇを行ない、同様にして、縦方向にも背景画素のランのｓｍｅａｒｉｎｇを行なう。そして、横方向背景画素のランと縦方向の背景画素のランとのｓｍｅａｒｉｎｇのＡＮＤをとり、両方のｓｍｅａｒｉｎｇでＯＮ値になる画素だけを最終的なモノクロ前景画素（文字領域Ｃ）として設定する。これにより、例えば、図５に示すような原画像（Ｉ_０）から、図６に示すように、文字領域Ｃを抽出した画像Ｉ'を得ることができる。

Further, the character area extraction means 3001 constructs a binary image having the same size as the original image (I ₀ ) and having an ON value in the character area (element C) and an OFF value in the other areas (see FIG. 6). ) In this binary image, background pixels (off-value pixels) construct a horizontal run along the horizontal direction. Here, if the length of a certain run is shorter than a predetermined threshold τ, the pixel is temporarily turned on. In this way, background pixel runs are smeared in the horizontal direction, and similarly, background pixel runs are smeared in the vertical direction as well. Then, AND of the running of the background pixel in the horizontal direction and the running of the background pixel in the vertical direction is performed, and only the pixel that is turned ON by both the smearing is set as the final monochrome foreground pixel (character area C). Thereby, for example, an image I ′ obtained by extracting the character region C as shown in FIG. 6 can be obtained from the original image (I ₀ ) as shown in FIG.

(5) Block division and character area classification [block division means, class classification means]
The class classification means (not shown) divides the original image (I ₀ ) into sufficiently small blocks B that do not overlap each other (see FIG. 6). At this time, the size and shape of each block B may be, for example, a square corresponding to a side length r of 20 mm (160 pixels at 200 dpi and 320 pixels at 400 dpi). The class classification means classifies the pixels belonging to the character area C into two classes according to the luminance in each divided block B.

In classification, luminance is calculated from the color signal of each pixel, and threshold processing is performed. For the threshold processing, a known method such as a discriminant analysis method, a moment holding method, an entropy method, or the like can be used. Note that threshold processing using a discriminant analysis method, a moment holding method, an entropy method, or the like is a known technique, and thus description thereof is omitted. The class classification unit classifies the darker (low luminance) pixel group as the first class R _i1 and the brighter (high luminance) pixel group as the second class R _{i2 in} the block B _i . To do. Usually, since the lighter color corresponds to the background color of the character area and the darker color corresponds to the character color, here, the first class R _i1 corresponds to the character, and R _i2 corresponds to the background ( Corresponding to the ground). In this way, in all the blocks B, the pixels belonging to the character area C are classified into R _i1 and R _i2 .

(6) Black character color and background color estimation [black character color / background color statistic estimation means (black character color / background color estimation means) 4001]
The black character color / background color statistic estimation means 4001 selects a block B having the maximum number of pixels belonging to the second class R _i2 from all blocks in which the pixels belonging to the black character region C are classified into R _i1 and R _i2. The window W is selected, and the average color of the pixels (pixel group R _w1 ) belonging to the first class R _i1 in the selected window W is set as the black character color of the original image. FIG. 7 shows a region selected as the window W and the pixel groups R _w1 and R _w2 in the region selected for the input image of FIG. In FIG. 7, the average color of the pixel group R _{w1 is set as} the color of the black character of the original image, and the average color of the pixel group R _w2 is set as the background color of the original image.

(7) Gradation correction based on the statistic of the black character color and the background color [gradation correction unit 5001]
The tone correction unit 5001 calculates the statistics (average, standard deviation) of the luminance in each of R _w1 and R _w2, and calculates the statistics l ₁ , black and background colors of the input image calculated in the window W, Gradation correction is performed based on σ ₁ , l ₂ , and σ ₂ . Here, it is assumed that the calculated average value l ₁ of the luminance at R _w1 and the standard deviation is σ ₁ . In addition, the average value of luminance at R _w2 is l ₂ and the standard deviation is σ ₂ . However, it is assumed that l ₁ <l ₂ .

As the default of the gradation correction performed by the gradation correction means 5001, as shown in the following equation (4), R 1, G, and B are expressed by a function that maps l ₁ to 0 and l ₂ to 255. Each component may be converted.

ここで、０や２５５にクリップされる入力信号値の範囲は、画像出力機器の特性によって調整する必要がある。例えば、ハイライト色の表現能力が高いプリンタでは、白にクリップされる入力信号の輝度値が低めになるように設定する必要がある。一方で、例えば、ハイライト色の表現能力が低いプリンタでは、白にクリップされる入力信号の輝度値を低めにするような設定は必要ない。

Here, the range of the input signal value clipped to 0 or 255 needs to be adjusted according to the characteristics of the image output device. For example, in a printer with high highlight color expression capability, it is necessary to set the luminance value of an input signal clipped in white to be low. On the other hand, for example, a printer with low highlight color expression capability does not require a setting that lowers the luminance value of an input signal clipped to white.

Further, since the gradation correction between the black character color and the background color by the gradation correction means 5001 must take into account the variation of the background color of the input image, the calculated black character color dispersion σ ₁ and the background color are calculated. The degree of correction is adjusted based on the variance σ ₂ . Specifically, correction by the calculation of the following equation (5) may be performed (see FIG. 8). Note that the values of the adjustment parameters a and b are designated by the user and are appropriately set according to the characteristics of the printer used for printing, the user's preferences, and the like.

図８からも判るように、調整パラメータａ，ｂの値が大きいほど、黒文字の強調，下地の除去，コントラスト強調が強く作用する。図９に、図５に示した入力画像（原画像（Ｉ_０））に対して階調補正を行なった画像Ｉ''を示す。

As can be seen from FIG. 8, the larger the values of the adjustment parameters a and b, the stronger the black character enhancement, background removal, and contrast enhancement. FIG. 9 shows an image I ″ obtained by performing gradation correction on the input image (original image (I ₀ )) shown in FIG.

  By the way, since the gradation correction depends on the characteristics of the image output device, it is necessary to be able to easily adjust the degree of correction for the background and black characters. For example, in a printer having a high highlight color expression capability, it is necessary to set the luminance value of an input signal clipped in white to be low, and this is not necessary if the expression capability is low. Furthermore, the adjustment here must take into account variations in the background color of the input image. “Global tone correction suitable for document images, such as converting the background to white and black characters to black, while maintaining the gradation of the halftone area” and “Parameters for specifying processing (background and black characters In order to solve the problem that “the color can be adaptively calculated from the image”, it is necessary to accurately estimate the black character color and the background color.

  In the present embodiment, based on the calculated black character and background color dispersion (standard deviation), for example, by default, the background color average is white (maximum brightness) and the black character color average is black ( In the case of performing gradation correction as shown in (minimum luminance) and adjusting the correction level, the correction level is adjusted by shifting from the average by the standard deviation multiplied by the adjustment parameter. Thereby, according to the characteristic of an output apparatus, a user can adjust a process easily.

According to the present embodiment, when an original image (I ₀ ), which is a digital image input from an image input device, is output from an image output device 501 such as a printer, the feature amount of the original image (I ₀ ) is used. By performing tone correction on the original image (I ₀ ) without using specified parameters based on the black text color and background color estimated from the calculated value on the original image (I ₀ ), various While maintaining the gradation of the halftone area of the original image (I ₀ ) input from the correct image input device 401, the user does not perform operations such as setting parameters, and the black characters and the background of the output image The contrast can be adjusted automatically.

Further, according to the present embodiment, based on the classification result for each block B, it belongs to the first class R _i1 in the window W that is the block B having the maximum number of pixels belonging to the second class R _i2. By estimating the average color of the pixel group R _w1 as the black character color and estimating the average color of the pixel group R _w2 belonging to the second class R _i2 in the window W that is the same block B as the background color, Can be estimated accurately.

  Next, a second embodiment of the present invention will be described with reference to FIGS. Note that the same parts as those of the first embodiment are denoted by the same reference numerals, and description thereof is also omitted. The same shall apply hereinafter.

  FIG. 10 is a functional block diagram schematically showing means executed by the personal computer 301 in accordance with the image processing program in the second embodiment of the present invention. FIG. 11 shows various means included in this functional block diagram. It is a flowchart which shows the execution procedure of. When executing the image processing program, the personal computer 301 executes various means shown in the flowchart of FIG. 11 by each function shown in the functional block diagram of FIG.

  In the present embodiment, in addition to the smoothing unit 2001 and the feature amount calculating unit 2002, the local adaptive threshold processing and the expansion processing are performed on the low resolution image (I) to perform local adaptive binarization of the color components. Thus, the low resolution processing unit 2000 also includes character region extraction means 2003 (see character region extraction means 3001 in FIG. 3) that performs extraction detection of the character region C (see FIG. 6).

  In addition, in the present embodiment, background color estimation means 2004 and background area extraction means 2005 described below are included in low resolution processing means 2000.

  The processing from step S1 to step S7 in FIG. 11 performs the same processing as the processing from step S1 to step S7 in FIG. 4, and the number of pixels classified into the brighter class by the background color estimation means 2004; Select a window that maximizes the value of the evaluation function determined based on the brightness of the brighter color, set the brighter representative color in this window as the average background color in the input image, and then increase the brightness The background color is estimated by calculating the statistic (S20). Then, based on these statistics, a background area is extracted (S21), and the color of the extracted background area is replaced with the estimated average color of the background, and for the pixels other than the background, the gradation with the background area is replaced. Gradation correction is performed so as not to cause discontinuity (S22), and the process proceeds to step S10.

Next, details of the above-described means executed by the personal computer 301 will be described. In the present embodiment, an original image (I ₀ ′) as shown in FIG. 12 will be described as an example. In the original image (I ₀ ′), as compared to the original image (I ₀ ), a region serving as a background portion is composed of a plurality of background colors.

(8) Estimation of background color [background color estimation means 2004]
The background color estimation unit 2004 defines an evaluation function based on the number of pixels N _i belonging to the second class R _i2 and the average luminance L _{i of} R _i2 , and finds a block W having the maximum value. Here, as an evaluation function to be defined, for example, a function that takes a larger value as the number of pixels is larger and the average luminance is higher, such as N _i × L _i is defined (see FIG. 7). In the present embodiment, the average color of the pixel group _Rw2 is set as the background color of the original image. The background color estimation means further calculates a brightness statistic (average l _B , standard deviation σ) in R _w2 .

(9) Background area extraction [background area extraction means 2005]
The background area extraction unit 2005 extracts the background area based on the statistics of the background brightness. In the present embodiment, in the low-resolution image (I), a pixel whose luminance L is l _B −aσ <L <l _B (where a is a positive parameter) is set as the background region. Here, the parameter a is determined by the background fluctuation, the degree of show-through, and the like. For example, if the show-through is strong, the adjustment parameter a may be set larger. FIG. 13 shows an image I ₁ ′ in which pixels extracted as a background are shown in black.

Here, based on the average l _B and the standard deviation of the luminance σ in R _w2, it was determined background region, not limited to this, instead of median m _B and α% of the luminance distribution in R _w2 A pixel such that α _B <L <m _B may be extracted as a background region using the position point α _B (α is 25, for example).

(10) Gradation correction based on background color statistics [gradation correction means 5001]
In the original image (I ₀ ′), the gradation correction unit 5001 according to the present embodiment first replaces the pixel color in the background area with the average background color calculated in the block W. For pixels other than the background, each component of RGB is converted using the following equation (6) so that gradation discontinuity with the background does not occur (see FIG. 14).

ここで、図１５に、図１２に示した入力画像（原画像（Ｉ_０'））に対して階調補正を行った画像Ｉ_１''を示す。
なお、本実施の形態では、（６）式に基づいてＲＧＢの各成分を変換するようにしたが、これに限るものではなく、代わりに、以下に示す（７）式を用いてＲＧＢの各成分を変換してもよい。

FIG. 15 shows an image I ₁ ″ obtained by performing tone correction on the input image (original image (I ₀ ′)) shown in FIG.
In the present embodiment, the RGB components are converted based on the equation (6). However, the present invention is not limited to this. Instead, the RGB components are converted using the following equation (7). Components may be converted.

このように本実施の形態では、局所的に見て、カラー文書画像が前景と背景との２種類の領域から構成されていることに着目し、背景色の統計量推定問題を単純な２クラス問題に帰着させる。具体的には、デジタルカラー画像から真の背景色を含むような部分領域を探索し、その領域を前景と背景にクラス分けして、背景の色・階調分布から背景（地肌，下地）の代表色やばらつき度合を抽出する。これにより、従来行われていたような混合分布から構成されるヒストグラムの解析を避けることができる。

As described above, in the present embodiment, focusing on the fact that the color document image is composed of two types of areas, the foreground and the background, when viewed locally, the problem of estimating the background color statistic is simplified to two classes. Bring back to the problem. Specifically, a partial area including a true background color is searched from a digital color image, the area is classified into a foreground and a background, and the background (background, background) is determined from the background color and gradation distribution. Extract representative colors and degree of variation. As a result, it is possible to avoid the analysis of the histogram composed of the mixture distribution as conventionally performed.

  Based on these statistics, the background area is extracted from the entire image, the background area is replaced with the estimated representative color, and the gradation discontinuity with the background area does not occur in parts other than the background. Is subjected to gradation conversion.

  This makes it possible to automatically calculate the background / background color from the image features by statistical processing without the need for any knowledge / characteristic information or default parameters for the input device. Without depending on the characteristic information, and without using the specified parameters or setting the parameters by the user, the background color fluctuations and background in the original images input from various image input devices It is possible to automatically correct image deterioration caused by a background portion such as a reflection and to make the background portion more appropriate, thereby obtaining an output image in which characters and the like are easy to see. In addition, according to the present embodiment, backgrounds such as background color fluctuation and show-through can be applied to a digital image in which an input device is not known, such as an original image transmitted from a remote place via a network. By automatically correcting the image deterioration caused by the part and optimizing the background part, it is possible to obtain an output image in which characters and the like are easily seen.

  Next, a third embodiment of the present invention will be described. Although not particularly illustrated, the present embodiment is characterized in that the feature amount calculation in step S4 in FIG. 4 or FIG. 11 and the character region extraction in step S5 in FIG. 4 or FIG. Different from the embodiment.

  Here, in the case of black characters printed directly on the background, the contrast tends to be strong in all the R, G, and B channels.

  In the present embodiment, attention is paid to this, and the character region is extracted by setting the edge amount at the target pixel to the minimum edge amount calculated for each of the R, G, and B channels.

  When extracting the character region C, first, an edge amount in each pixel is calculated, and pixels whose edge amount calculated in each pixel is higher than a predetermined threshold value set in advance prior to image processing are used as elements of the character region C. Set. Thereafter, run smearing is performed as in the first embodiment.

  For example, the edge amount in the pixel [i, j] can be obtained by obtaining the maximum value of the edge amount separately calculated for the three channels (R, G, B). That is, the edge amount in the pixel [i, j] can be expressed by the following equation (8). Here, the function as the feature amount calculating means is realized.

ただし、Ｓ［Ｉ；ｉ，ｊ；ｋ］は、低解像度画像（Ｉ）のｋチャンネルでの画素［ｉ，ｊ］におけるエッジ強度である。

However, S [I; i, j; k] is the edge intensity at pixel [i, j] in the k channel of the low resolution image (I).

  By performing threshold processing (thr) on the edge amount calculated in this way, a pixel having an edge amount equal to or greater than the specified threshold value is specified. Therefore, a pixel having an edge amount equal to or greater than the specified threshold value and pixels surrounding this pixel Is extracted as a character region C. Here, the function as the character area extracting means is realized. Note that the prescribed threshold value may be set in advance, or may be changed from the outside prior to execution of the image processing program.

  According to the present embodiment, it is possible to accurately estimate the black character color and the background color (background color).

  Next, a fourth embodiment of the present invention will be described.

  Although not shown in particular, in the present embodiment, the calculation of the feature amount in step S4 of FIG. 4 or FIG. 11 and the extraction of the character area C in step S5 of FIG. In addition, the point of using the edge amount is different from the above-described embodiments.

  When calculating the feature amount, the statistical amount and edge amount of the window W are calculated as in the first and second embodiments. Here, the function as the feature amount calculating means is realized.

  In the subsequent extraction of the character region C, it is first determined whether the signal value is lower than the threshold value calculated from the statistics of the window W or the edge amount is higher than the specified threshold value in all channels. Then, in all the channels, the pixel whose signal value is determined to be lower than the threshold value calculated from the statistic of the window W or whose edge amount is higher than the specified threshold value and the surrounding pixels are designated as the character region C. Set to the element. Here, the function as the character area extracting means is realized.

  Thereafter, run smearing is performed as in the first embodiment.

  According to the present embodiment, it is possible to accurately estimate the black character color and the background color.

  Next, a fifth embodiment of the present invention will be described.

Although not particularly illustrated, in the present embodiment, the calculation of the feature amount and the extraction of the character region are performed without generating the low resolution image (I) having a lower resolution than the original image (I ₀ ) in step S2 of FIG. Is different from the first, second or third embodiment in that is executed on the original image (I ₀ ).

According to the present embodiment, the low-resolution image (I) is generated by performing the feature amount calculation and the character region extraction on the original image (I ₀ ) without generating the low-resolution image (I). ) Generation processing can be omitted.
Next, a sixth embodiment of the present invention will be described. This embodiment is different from the first, second, third, or fourth embodiment in the black character color estimation method in step S8 of FIG.

(6) 'Estimation of Black Character Color and Background Color First, the pixels belonging to the black character region C in all the blocks B are classified into R _i1 and R _i2 . Next, a block B in which the difference in average luminance between the two pixel groups R _i1 and R _i2 is maximized is selected, and the block B is set as a window W. Then, the average color of the pixel group R _w1 in the set window W is set as the black character color of the original image (I ₀ ), and the average color of the pixel group R _w2 in the window W is set as the background color of the original image (I ₀ ).

  In addition, in this embodiment, a statistic used for gradation correction is calculated in the window W.

  Next, a seventh embodiment of the present invention will be described. In this embodiment, in the tone correction in the second embodiment, instead of tone correction (see FIG. 14) by converting each component of RGB based on the function of equation (6), (9 ) Gradation correction (see FIG. 16) is performed by converting each component of RGB based on the function of the formula.

このように、（９）式の関数に基づいたＲＧＢの各成分を変換することによる階調補正を行うことにより、図１７に示すように、背景部分を白に階調変換を施した画像Ｉ_２''を得ることができる。

In this way, by performing gradation correction by converting each component of RGB based on the function of the expression (9), as shown in FIG. ₂ '' can be obtained.

  In the present embodiment, each component of RGB is converted based on the equation (9). However, the present invention is not limited to this. Instead, each component of RGB is converted using the following equation (10). Components may be converted.

なお、本実施の形態の階調補正は、第２の実施の形態に限るものではなく、ステップＳ２０〜Ｓ２２において第２の実施の形態と同様の処理を実行する第３，４，５，６の実施の形態に適用してもよい。

Note that the gradation correction of the present embodiment is not limited to the second embodiment, and the third, fourth, fifth, and sixth processes that execute the same processing as the second embodiment in steps S20 to S22. It may be applied to the embodiment.

It is a schematic diagram which shows the system construction example of the 1st Embodiment of this invention. It is a module block diagram of a personal computer. It is a functional block diagram which shows typically the means performed by a personal computer according to an image processing program. It is a flowchart which shows the execution procedure of the various means contained in this functional block diagram. It is a schematic diagram which illustrates an input image. It is a schematic diagram which shows the character area and block division which were extracted from the input image. It is a schematic diagram which shows the window selected from the image divided into blocks, and the pixel group classified within the window. It is a graph explaining the gradation correction based on the statistic of a black character color and a background color. It is a schematic diagram which shows the image after gradation correction | amendment. It is a functional block diagram which shows typically the means performed by the personal computer according to the image processing program in the 2nd Embodiment of this invention. It is a flowchart which shows the execution procedure of the various means contained in this functional block diagram. It is a schematic diagram which illustrates an input image. It is a schematic diagram which shows the pixel extracted as a background from an input image. It is a graph explaining the gradation correction based on the statistic with the background color. It is a schematic diagram which shows the image after gradation correction | amendment. It is a graph explaining the gradation correction based on the statistic with the background color of the 7th Embodiment of this invention. It is a schematic diagram which shows the image after gradation correction | amendment.

Explanation of symbols

301 Image processing device 306 Storage medium 1001 Low-resolution image generation unit 2002 Feature amount calculation unit 2003 Character region extraction unit 2004 Background color estimation unit 2005 Background region extraction unit 3001 Character region extraction unit 4001 Black character color / background color estimation unit 5001 Gradation correction means

Claims (35)

A character region extracting means for extracting a character region from an original image which is a digital image;
Class classification means for classifying pixels belonging to the character area into a first class and a second class according to color;
A black character color / background color estimation means for estimating a black character color and a background color on the original image based on a class classification of pixels belonging to the character region;
Gradation correction means for performing gradation correction on the original image based on the estimated black character color and background color;
An image processing apparatus comprising: A character region extracting means for extracting a character region from an original image which is a digital image;
Class classification means for classifying pixels belonging to the character area into a first class and a second class according to color;
Background color estimation means for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
Background area specifying means for specifying a background area on the original image based on the estimated background color;
Gradation correction means for performing gradation correction on the original image by replacing the color of the specified background region with the estimated background color;
An image processing apparatus comprising: A character region extracting means for extracting a character region from an original image which is a digital image;
Class classification means for classifying pixels belonging to the character area into a first class and a second class according to color;
Background color estimation means for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
Background area specifying means for specifying a background area on the original image based on the estimated background color;
Gradation correction means for performing gradation correction on the original image by replacing the color of the specified background region with white;
An image processing apparatus comprising: A feature amount calculating means for calculating a feature amount for an original image which is a digital image;
A character region extracting means for extracting a character region from the original image based on the feature amount;
Block dividing means for dividing the original image into blocks;
Class classification means for classifying the pixels belonging to the character area into a first class and a second class according to color for each block;
A black character color / background color estimation means for estimating a black character color and a background color on the original image based on a class classification of pixels belonging to the character region;
Gradation correction means for performing gradation correction on the original image based on the estimated black character color and background color;
An image processing apparatus comprising: A feature amount calculating means for calculating a feature amount for an original image which is a digital image;
A character region extracting means for extracting a character region from the original image based on the feature amount;
Block dividing means for dividing the original image into blocks;
Class classification means for classifying the pixels belonging to the character area into a first class and a second class according to color for each block;
Background color estimation means for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
Background area specifying means for specifying a background area on the original image based on the estimated background color;
Gradation correction means for performing gradation correction on the original image by replacing the color of the specified background region with the estimated background color;
An image processing apparatus comprising: A feature amount calculating means for calculating a feature amount for an original image which is a digital image;
A character region extracting means for extracting a character region from the original image based on the feature amount;
Block dividing means for dividing the original image into blocks;
Class classification means for classifying the pixels belonging to the character area into a first class and a second class according to color for each block;
Background color estimation means for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
Background area specifying means for specifying a background area on the original image based on the estimated background color;
Gradation correction means for performing gradation correction on the original image by replacing the color of the specified background region with white;
An image processing apparatus comprising: The feature amount calculating means includes:
Calculate the average value and standard deviation of the color signal in the window set around each pixel,
The character region extracting means is configured to detect the target pixel and the surroundings of the target pixel based on the color signal value of the target pixel in the window with respect to a threshold set by an average value and a standard deviation of the color signal in the window. The image processing apparatus according to claim 4, wherein the pixel is extracted as the character region. The feature amount calculating means includes:
Calculate the edge amount of each pixel,
The image processing apparatus according to claim 4, 5 or 6, wherein the character region extraction unit extracts pixels having the edge amount equal to or larger than a predetermined threshold and pixels around the pixel as the character region. The feature amount calculating means includes:
Calculate the average value and standard deviation of the color signal in the window set around each pixel edge amount and each pixel,
The character area extracting means includes:
The color signal value of the pixel of interest in the window with respect to a threshold set by a pixel set with the edge amount equal to or greater than the specified threshold and pixels around the pixel and the average value and standard deviation of the color signals in the window The image processing device according to claim 4, 5 or 6, wherein, based on the pixel of interest and pixels around the pixel of interest, the character region is extracted. The class classification means includes:
A luminance threshold is acquired based on the luminance calculated from the color signal of each pixel, a pixel group having a luminance lower than the luminance threshold is defined as the first class, and a pixel group having a luminance higher than the luminance threshold is defined as the first class. The image processing apparatus according to any one of claims 1 to 9, wherein the image processing apparatus is classified into two classes. The black character color / background color estimation means includes:
Based on the result of class classification for each block, the average color of the pixel group belonging to the first class in the block having the maximum number of pixels belonging to the second class is set to a black character color, and the second class The image processing apparatus according to claim 4, wherein an average color of a pixel group belonging to the second class in the block having the maximum number of pixels belonging is estimated as a background color. The background color estimation means includes
The average color of the pixel group belonging to the second class in the block having the maximum number of pixels belonging to the second class is estimated as a background color based on the class classification result for each block. The image processing apparatus described. The black character color / background color estimation means includes:
Based on the classification result for each block, the first block in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class is maximized. The average color of the pixel group belonging to the second class in the block in which the average color of the pixel group belonging to the class is a black character color and the number of pixels belonging to the second class is maximum is estimated as the base color. The image processing apparatus described. The background color estimation means includes
The average color of the pixel group belonging to the second class in the block having the maximum number of pixels belonging to the second class is estimated as a background color based on the class classification result for each block. The image processing apparatus described. The gradation correction means includes
Based on the classification result for each block, the average value and standard deviation of the luminance of the pixel group belonging to the first class in the block in which the number of pixels belonging to the second class is maximized, and the second 11. The gradation correction is performed according to a gradation conversion curve set based on an average value and a standard deviation of luminance of the pixel group belonging to the second class in the block in which the number of pixels belonging to the class is maximum. The image processing apparatus described. The gradation correction means includes
Based on the classification result for each block, the first block in the block in which the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class is maximized. In the block, the difference between the average value and the standard deviation of the brightness of the pixel group belonging to the class, and the average brightness of the pixel group belonging to the first class and the average brightness of the pixel group belonging to the second class is maximized. The image processing apparatus according to claim 10, wherein gradation correction is performed according to a gradation conversion curve set based on an average value and a standard deviation of luminance of the pixel group belonging to the second class. Comprising low-resolution image generation means for generating a low-resolution image having a lower resolution than the original image,
The feature amount calculating means includes:
Calculating features from the low resolution image;
The image processing apparatus according to claim 1, wherein the character region extraction unit extracts the character region from the low-resolution image. Interpreted by the computer,
A character region extraction function that extracts a character region from an original image that is a digital image;
A class classification function for classifying pixels belonging to the character area into a first class and a second class according to colors;
A black character color / background color estimation means for estimating a black character color and a background color on the original image based on a class classification of pixels belonging to the character region;
A gradation correction function for performing gradation correction on the original image based on the estimated black character color and background color;
An image processing program for executing Interpreted by the computer,
A character region extraction function that extracts a character region from an original image that is a digital image;
A class classification function for classifying pixels belonging to the character area into a first class and a second class according to colors;
A background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
A background area specifying function for specifying a background area on the original image based on the estimated background color;
A gradation correction function for performing gradation correction on the original image by replacing the color of the specified background region with the estimated background color;
An image processing program for executing Interpreted by the computer,
A character region extraction function that extracts a character region from an original image that is a digital image;
A class classification function for classifying pixels belonging to the character area into a first class and a second class according to colors;
A background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
A background area specifying function for specifying a background area on the original image based on the estimated background color;
A gradation correction function for performing gradation correction on the original image by replacing the color of the specified background area with white;
An image processing program for executing Interpreted by the computer,
A feature amount calculation function for calculating a feature amount for an original image which is a digital image;
A character region extraction function for extracting a character region from the original image based on the feature amount;
A block division function for dividing the original image into blocks;
A class classification function for classifying pixels belonging to the character area into a first class and a second class according to the color for each block;
A black character color / background color estimation function for estimating a black character color and a background color on the original image based on a class classification of pixels belonging to the character region;
A gradation correction function for performing gradation correction on the original image based on the estimated black character color and background color;
An image processing program for executing Interpreted by the computer,
A feature amount calculation function for calculating a feature amount for an original image which is a digital image;
A character region extraction function for extracting a character region from the original image based on the feature amount;
A block division function for dividing the original image into blocks;
A class classification function for classifying pixels belonging to the character area into a first class and a second class according to the color for each block;
A background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
A background area specifying function for specifying a background area on the original image based on the estimated background color;
A gradation correction function for performing gradation correction on the original image by replacing the color of the specified background region with the estimated background color;
An image processing program for executing Interpreted by the computer,
A feature amount calculation function for calculating a feature amount for an original image which is a digital image;
A character region extraction function for extracting a character region from the original image based on the feature amount;
A block division function for dividing the original image into blocks;
A class classification function for classifying pixels belonging to the character area into a first class and a second class according to the color for each block;
A background color estimation function for estimating a background color on the original image based on a class classification of pixels belonging to the character area;
A background area specifying function for specifying a background area on the original image based on the estimated background color;
A gradation correction function for performing gradation correction on the original image by replacing the color of the specified background area with white;
An image processing program for executing The feature value calculation function calculates the average value and standard deviation of the color signals in the window set around each pixel,
Based on the color signal value of the target pixel in the window with respect to a threshold set by the average value and standard deviation of the color signal in the window by the character region extraction function, the target pixel and the surroundings of the target pixel 24. The image processing program according to claim 21, 22 or 23, wherein said pixels are extracted as said character area. The feature amount calculation function calculates the edge amount of each pixel,
24. The image processing program according to claim 21, 22 or 23, wherein the character area extraction function extracts pixels having the edge amount equal to or larger than a predetermined threshold and pixels around the pixels as the character area. The feature amount calculation function calculates the edge amount of each pixel and the average value and standard deviation of the color signal in a window set around each pixel,
By the character region extraction function, the edge amount in the window with respect to the threshold value set by the average value and the standard deviation of the color signal in the window and the pixels around the pixel and the surrounding pixels of the pixel The image processing program according to claim 21, 22 or 23, wherein the pixel of interest and pixels around the pixel of interest are extracted as the character region based on a color signal value of the pixel of interest.   The class classification function obtains a luminance threshold based on the luminance calculated from the color signal of each pixel, sets a pixel group having a luminance lower than the luminance threshold as the first class, and the luminance is higher than the luminance threshold. 27. The image processing program according to claim 18, wherein a high pixel group is classified as the second class.   Based on the class classification result for each block, the black character color / background color estimation function calculates an average color of the pixel group belonging to the first class in the block having the maximum number of pixels belonging to the second class. The image processing program according to claim 21, wherein an average color of a pixel group belonging to the second class in the block in which the number of pixels belonging to the second class is the maximum is a black character color and is estimated as a background color.   Based on the result of class classification for each block, the background color estimation function uses the average color of the pixel group belonging to the second class in the block having the maximum number of pixels belonging to the second class as a background color. The image processing program according to claim 22 or 23 to be estimated.   Based on the result of class classification for each block, the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class is obtained by the black character color / background color estimation function. The average color of the pixel group belonging to the first class in the block having the maximum is a black character color, and the average of the pixel group belonging to the second class in the block having the maximum number of pixels belonging to the second class The image processing program according to claim 21, wherein the color is estimated as a background color.   The background color estimation function maximizes the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class based on the class classification result for each block. The image processing program according to claim 22 or 23, wherein an average color of a pixel group belonging to the second class in the block is estimated as a background color.   Based on the classification result for each block, the gradation correction function allows the average value and the standard value of the luminance of the pixel group belonging to the first class in the block in which the number of pixels belonging to the second class is maximized. In accordance with the gradation conversion curve set based on the deviation and the average value and standard deviation of the luminance of the pixel group belonging to the second class in the block in which the number of pixels belonging to the second class is maximum. 28. The image processing program according to claim 27, wherein tone correction is performed.   The gradation correction function maximizes the difference between the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class based on the classification result for each block. The difference between the average value and the standard deviation of the luminance of the pixel group belonging to the first class in the block, and the average luminance of the pixel group belonging to the first class and the average luminance of the pixel group belonging to the second class 28. The image processing program according to claim 27, wherein gradation correction is performed according to a gradation conversion curve set on the basis of an average value and a standard deviation of luminance of the pixel group belonging to the second class in the block having the largest value. . Causing the computer to execute a low-resolution image generation function for generating a low-resolution image having a lower resolution than the original image;
The feature amount calculation function calculates the feature amount from the low-resolution image,
The image processing program according to any one of claims 18 to 33, wherein the character region is extracted from the low-resolution image by the character region extraction function.   A storage medium for storing the image processing program according to any one of claims 18 to 34 so as to be readable by a computer.

Images