JP2007299317A - Backlit image correcting device, backlit image correcting method, backlit image correcting program, image reading device, image reading method, and printing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To give adequate backlight correcting treatment to a backlit image without determining the backlit image or not. <P>SOLUTION: The backlit image correcting device generates data for a color-based histogram showing the distribution of the number of pixels to concentration values for the colors of the pixels in accordance with data for the pixels constituting the image. It comprises a histogram generating part, an attribute information acquiring part for separating a region shown by the color-based histogram into two or more small regions by the concentration values in accordance with the generated data for the color-based histogram, selecting at least one small region out of the two or more small regions, and acquiring color-based attribute information regarding the small region, a correction information generating part for generating correction information to apply backlight correcting processing to the image in accordance with the acquired color-based attribute information, and a backlight correcting processing part for applying the backlight correcting processing to the image in accordance with the generated correction information. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a backlight image correction device, a backlight image correction method, a backlight image correction program, an image reading device, an image reading method, and a printing device.

  Various image reading apparatuses such as an image scanner are generally connected to a so-called computer apparatus such as a personal computer by wire or wireless, and transmit an image read from a document as image data to the computer apparatus. The computer device receives the image data transmitted from the image reading device and stores it in a data storage device such as various memories or a hard disk device. At this time, the computer apparatus performs various adjustment processes on the image data sent from the image reading apparatus.

Examples of the adjustment processing performed here include histogram adjustment for adjusting the brightness of an image, density correction for partially changing the expression of light and shade of an image, and the like. These adjustments are automatically executed by various programs such as a driver program and an application program of the image reading apparatus installed in the computer apparatus, or are executed by a user or the like. In addition, there is an adjustment for correcting a backlight image. Various methods have been proposed as the backlight correction method (see Patent Documents 1 to 3).
Japanese Patent Laid-Open No. 10-79885 JP 2004-56416 A JP 2000-134467 A

  However, in the correction method proposed here, when it is first determined whether or not the target image is a backlight image, and it is determined that the image is a backlight image, Backlight correction processing is performed. When it is not possible to appropriately determine whether or not the target image is a backlight image, there is a possibility that the backlight correction process may be performed on the image that is not the backlight image. In particular, among the conventionally proposed correction methods, there is a method in which it is not possible to appropriately determine whether or not a target image is a backlight image.

  The present invention has been made in view of such circumstances, and an object thereof is to perform an appropriate backlight correction process on a backlight image without determining whether the image is a backlight image.

The main invention for achieving the object is as follows:
(A) a histogram data generation unit that generates histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixels based on data of pixels constituting the image;
(B) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(C) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(D) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
A backlight image correction apparatus including (E).

  Other features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

  At least the following matters will become apparent from the description of the present specification and the accompanying drawings.

(A) a histogram data generation unit that generates histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixels based on data of pixels constituting the image;
(B) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(C) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(D) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
A backlight image correction device comprising (E).

  In such a backlight image correction apparatus, based on the data of the histogram for each color generated based on the data of the pixels constituting the image, the area represented by the histogram for each color is divided into 2 for each density value. Divide into two or more small areas, acquire attribute information for each color from at least one small area selected from these two or more small areas, and correct backlight based on the acquired attribute information for each color By generating correction information for performing processing and performing backlight correction processing on the image based on the correction information, appropriate backlight correction processing can be performed on the image.

  In such a backlight image correction device, histogram data for each color of red, green, and blue may be generated by the histogram data generation unit as the histogram data for each color. As described above, if histogram data for each color of red, green and blue is generated as histogram data for each color, it has density value data for each color of red, green and blue as data of pixels constituting the image. In this case, a more appropriate backlight correction process can be performed on the image.

  In the backlight image correction apparatus, the two or more small regions may include two or more small regions having the same area. In this way, if two or more small regions include two or more small regions having the same area, more appropriate backlight correction processing can be performed on the image.

  In this backlight image correction apparatus, the two or more small regions may include two or more small regions having the same number of pixels. In this way, if two or more small regions include two or more small regions having the same number of pixels, a more appropriate backlight correction process can be performed on the image.

  Further, in the backlight image correction device, the two or more small regions include two or more small regions in which at least one of the number and area of the pixels is equal to each other, The attribute information acquisition unit may acquire the attribute information from two or more small regions in which at least one of the number and area of the pixels is equal to each other. As described above, the two or more small regions include two or more small regions in which at least one of the number and area of the pixels is equal to each other, and the attribute information acquisition unit includes the number of pixels and the area. By acquiring the attribute information from two or more small regions in which at least one of them is equal to each other, a more appropriate backlight correction process can be performed on the image.

  In the backlight image correction apparatus, the attribute information acquisition unit may acquire an average value of the density values for each color as the attribute information for each of the at least one small region. As described above, the attribute information acquisition unit acquires, as the attribute information, the average value of the density values for each color for at least one small region, so that more appropriate backlight correction processing can be performed on the image.

  Further, in the backlight image correction device, the correction information generation unit relates to the brightness for each of the at least one small region based on an average value of the density values for each color acquired by the attribute information acquisition unit. Information may be acquired and the correction information may be generated based on the information related to the luminance. As described above, the correction information generation unit acquires information on luminance for each of at least one small region based on the average value of the density values for each color, and generates correction information based on the information on the luminance, thereby generating an image. Thus, a more appropriate backlight correction process can be performed.

  In the backlight image correction apparatus, the correction information generation unit may acquire an average value of the luminance of each pixel for the at least one small region as the information on the luminance. As described above, the correction information generation unit obtains the average value of the luminance of each pixel for at least one small region as the luminance-related information, so that more appropriate backlight correction processing can be performed on the image.

  In the backlight image correction apparatus, the correction information generation unit may calculate at least one of the average luminance values acquired for each of the at least one small area and the total luminance of the image. The correction information may be generated based on a value obtained by adding the average value. As described above, the correction information generation unit is based on a value obtained by adding at least one of the average luminance values acquired for each of at least one small region and the average luminance value of the entire image. By generating the correction information, it is possible to perform a more appropriate backlight correction process on the image.

  In the backlight image correction apparatus, the backlight correction processing unit may convert the density value of each pixel constituting the image when performing the backlight correction processing based on the correction information. As described above, when the backlight correction processing unit performs the backlight correction processing based on the correction information, the backlight correction processing can be easily performed by converting the density value of each pixel constituting the image.

  Further, in the backlight image correction apparatus, the correction information generation unit, as the correction information, the density value before being converted by the backlight correction processing unit, and after being converted by the backlight correction processing unit Information regarding the correspondence relationship with the density value may be generated. If such information is generated as correction information, the backlight correction process can be easily performed.

(A) a histogram data generation unit that generates histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixels based on data of pixels constituting the image;
(B) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(C) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(D) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
(E)
(F) As the histogram data for each color, histogram data for each color of red, green, and blue is generated by the histogram data generation unit,
(G) The two or more small regions include two or more small regions in which at least one of the number and area of the pixels is equal to each other, and the attribute information acquisition unit Obtaining the attribute information from two or more small regions in which at least one of the number and the area is equal to each other,
(H) The attribute information acquisition unit acquires, as the attribute information, an average value of the density values for each of the colors for the at least one small region,
(I) The correction information generation unit acquires an average luminance value for each of the at least one small region based on an average value of the density values for each color acquired by the attribute information acquisition unit,
(J) The correction information generation unit is obtained by adding at least one of the average luminance values acquired for each of the at least one small region and the average luminance value of the entire image. Based on the obtained value, the correction information is generated,
(K) When performing the backlight correction processing based on the correction information, the backlight correction processing unit converts a density value of each pixel constituting the image,
(L) The correction information generation unit includes, as the correction information, information related to a correspondence relationship between the density value before being converted by the backlight correction processing unit and the density value after being converted by the backlight correction processing unit. A backlight image correction device, characterized by comprising:

(A) a histogram data generation unit that generates histogram data representing a distribution of the number of pixels with respect to a density value of the pixels, based on data of pixels constituting the image;
(B) Based on the histogram data generated by the histogram data generation unit, each of the regions represented by the histogram is divided into two or more small regions according to the size of the density value. An attribute information acquisition unit that selects at least one small area from among the small areas and acquires attribute information related to the small area;
(C) a correction information generation unit that generates correction information for performing a backlight correction process on the image based on the attribute information acquired by the attribute information acquisition unit;
(D) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
A backlight image correction device comprising (E).

(A) generating histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the image;
(B) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas according to the size of the density value. Steps,
(C) selecting at least one small area from the two or more small areas, and obtaining attribute information about the small area for each color;
(D) generating correction information for performing backlight correction processing on the image based on the acquired attribute information for each color;
(E) performing the backlight correction process on the image based on the generated correction information;
(F) The backlight image correction method characterized by having.

(A) A backlight image correction program executed in the backlight image correction apparatus,
(B) generating histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the image;
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas according to the size of the density value. Steps,
(D) selecting at least one small area from the two or more small areas, and obtaining attribute information about the small area for each color;
(E) generating correction information for performing backlight correction processing on the image based on the acquired attribute information for each color;
(F) performing the backlight correction process on the image based on the generated correction information;
A backlight image correction program characterized by executing (G).

(A) an image reading unit for reading an image from a document;
(B) A histogram data generation unit that generates histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the image read by the image reading unit. When,
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(D) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(E) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
An image reading apparatus comprising (F).

(A) a step of reading an image from a document;
(B) generating histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the read image;
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas according to the size of the density value. Steps,
(D) selecting at least one small area from the two or more small areas, and obtaining attribute information about the small area for each color;
(E) generating correction information for performing backlight correction processing on the image based on the acquired attribute information for each color;
(F) performing the backlight correction process on the image based on the generated correction information;
An image reading method comprising (G).

(A) a printing unit that prints an image on a medium;
(B) Before the image is printed by the printing unit, based on the data of the pixels constituting the image, histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel is obtained. A histogram data generation unit to generate,
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(D) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(E) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
A printing apparatus comprising (F).

=== Overview of Image Reading System etc. ===
Hereinafter, a case where the backlight image correction apparatus according to the present invention is applied to an image reading system will be described as an example. 1 to 4 illustrate an embodiment of an image reading system to which a backlight image correction apparatus is applied. FIG. 1 illustrates an embodiment of an image reading system. FIG. 2 is a diagram illustrating an example of the internal configuration of the image reading apparatus. FIG. 3 is a diagram illustrating an example of a system configuration of the image reading apparatus. FIG. 4 is a diagram illustrating the system configuration of the computer apparatus.

  As shown in FIG. 1, the image reading system 2 includes an image reading device 10 and a computer device 20 connected to the image reading device 10 so as to be communicable by wire or wireless. As shown in FIG. 1, the image reading device 10 is a device generally called an image scanner, and includes a document table 12 and a document table cover 14 that opens and closes the upper surface of the document table 12. A document 15 from which an image is read is set on the document table 12. The document table cover 14 is provided at the rear end portion of the document table 12 through a hinge portion 18 so as to be freely opened and closed.

  On the other hand, as shown in FIG. 1, for example, the computer device 20 includes a computer main body 22, a display device 24, and an input device 26. The computer main body 22 includes various computers such as a personal computer. Here, the computer main body 22 includes a reading device 32 such as an FD drive device 28 or a CD-ROM drive device 30 therein. In addition, the computer main body 22 may include, for example, an MO (Magnet Optical) disk drive device or a DVD drive device. The display device 24 includes various display devices such as a CRT display, a plasma display, and a liquid crystal display. The input device 26 includes a keyboard 34, a mouse 36, and the like.

<Image reading device>
As shown in FIG. 2, inside the document table 12 of the image reading apparatus 10, a carriage 40 and the carriage 40 are parallel to each other along the direction of arrow A in FIG. A driving mechanism 42 for moving the guide 40 and a guide 44 for guiding the movement while supporting the carriage 40 are provided.

  The carriage 40 has an exposure lamp 46 as a light source for irradiating light to the document 15 via the document table 12, a lens 48 on which reflected light reflected by the document 15 is incident, and the inside of the carriage 40 through the lens 48. And an image sensor 50 for receiving the reflected light taken in. The image sensor 50 includes a linear CCD sensor or the like in which photoelectric conversion elements such as photodiodes that convert optical signals into electric signals are arranged in a line. The image data read by the image sensor 50 is output to the control unit 52.

  The drive mechanism 42 includes a timing belt 54 connected to the carriage 40, a pair of pulleys 55, 56 around which the timing belt 54 is stretched, and a drive motor 58 that rotationally drives one pulley 55. Yes. The drive motor 58 is driven and controlled by a control signal from the control unit 52.

  As shown in FIG. 3, the control unit 52 includes a controller 60, a motor control unit 62, a lamp control unit 64, a sensor control unit 66, an AFE (Analog Front End) unit 68, a digital processing circuit 70, And an interface circuit 72. Further, the AFE (Analog Front End) unit 68 includes an analog signal processing circuit 74 and an A / D conversion circuit 76.

  The controller 60 controls the motor control unit 62, the lamp control unit 64, the sensor control unit 66, the AFE (Analog Front End) unit 68, the digital processing circuit 70, and the interface circuit 72 based on commands from the computer main body 22. The motor control unit 62 performs drive control of the drive motor 58 for moving the carriage 40 according to a command from the controller 60. The lamp control unit 64 controls the light emission of the exposure lamp 46. The sensor control unit 66 controls the image sensor 50.

  An analog signal processing circuit 74 of an AFE (Analog Front End) unit 68 performs signal processing on an analog signal of an image read by the image sensor 50. An A / D conversion circuit 76 of an AFE (Analog Front End) unit 68 performs A / D conversion on the image signal processed by the analog signal processing circuit 74 into a digital signal.

  The digital processing circuit 70 performs digital signal processing on the digital signal sent from the A / D conversion circuit 76 of the AFE (Analog Front End) unit 68. Here, specifically, various image processing and the like are performed, including correction processing such as shading correction. The digital signal subjected to the digital signal processing is output as image data (image data) read from the document 15 to the outside, that is, to the computer main body 22 to which the image reading apparatus 10 is connected in this case. The In addition to this, the interface circuit 72 receives commands (commands) and the like from the computer main body 22 to the image reading apparatus 10.

<Computer body>
As shown in FIG. 4, the computer main body 22 includes a CPU 80, a memory 82, an HDD (Hard Disk Drive Device) 84, an operation input unit 86, a display control unit 88, an external communication unit 90, and a bus 92. I have. In addition, the computer main body 22 includes the CD-ROM drive device 30 and the FD drive device 28 described above. The CPU 80, the memory 82, the HDD (Hard Disk Drive Device) 84, the CD-ROM drive device 30, the FD drive device 28, the operation input unit 86, the display control unit 88, and the external communication unit 90 are buses. 92 to be communicable with each other.

  The CPU 80 performs overall control of the computer main body 22. The memory 82 is for storing various data such as a program executed by the CPU 80 and work data used by the program. The HDD (Hard Disk Drive Device) 84 stores an operating system (OS) executed by the CPU 80, various programs such as various application programs and drivers, and various data such as image data. The operation input unit 86 is connected to the input device 26 such as the keyboard 34 and the mouse 36, and acquires information input by the user through the input device 26. Further, the display control unit 88 controls an image displayed on the screen of the display device 24 based on a command from the CPU 80. The external communication unit 90 communicates with various peripheral devices such as the image reading apparatus 10 connected to the outside of the computer main body 22.

  The CPU 80 reads out a program from an HDD (Hard Disk Drive Device) 84 and executes various programs under an operating system (OS). The programs executed here include various applications programs and various drivers for controlling the image reading device 10, the operation input unit 86, the display control unit 88, and the like.

  A driver for controlling the image reading apparatus 10 is generally called a scanner driver. The scanner driver is a program installed in the computer main body 22 through various communication lines such as the Internet and various storage media such as a CD-ROM and a floppy disk (FD). When the scanner driver is installed in the computer main body 22, the computer main body 22 functions as a control device that controls the image reading apparatus 10.

=== Scanner Driver ===
Next, an example of the user interface of the scanner driver will be described. FIG. 5 shows the main dialog box 100 of this user interface. This user interface is displayed on the display screen of the display device 24 by the CPU 80 of the computer main body 22 through the display control unit 88. The user can make various settings of the scanner driver through the input device 26 such as the keyboard 34 and the mouse 36 while looking at the dialog box 100 of the user interface displayed on the display screen of the display device 24.

  The main dialog box 100 is provided with a “mode selection field” 102, a “setting storage field” 104, an “original setting field” 106, an “output setting field” 108, and an “adjustment field” 110. ing. In the “mode selection field” 102, the user can select one mode from a plurality of modes. Here, “professional mode” is selected. In the “setting storage field” 104, the user can save or delete the current setting by clicking the “save button” or “delete button”.

  Further, in the “original setting field” 106, the user can set each of “original type” 112, “reading device” 114, and “automatic exposure” 116. In the “original type” 112, the type of original set can be selected. For example, “reflection original”, “film”, or the like can be selected. In the “reading device” 114, for example, “original table” can be selected. In the “automatic exposure” 116, an exposure setting suitable for the type of document to be read can be performed. For example, “photo orientation”, “document orientation”, and the like can be selected.

  In the “output setting field” 108, the user can make various settings related to image output. Specifically, in the “output setting field” 108, the “image type” 118 of the output image, “resolution” 120 at the time of reading, “original size” 122 at the time of reading, and “output size” 124 are set. Is possible. In “image type” 118, the number of colors of the read image can be selected from three types of color, gray scale, and monochrome. In “Resolution” 120, the resolution of the read image can be set. In “Original Size” 122, the size of the read image can be set.

  When the “scan button” 126 at the bottom of the dialog box 100 is clicked by the user, the scanner driver controls the external image reading device 10 based on information set by the user through the dialog box 100 to An image is read from a document set on the reading device 10. The image data thus read is sent to the computer main body. When the “preview button” 127 at the bottom of the dialog box 100 is clicked by the user, the scanner driver displays a preview window for displaying the image read by the image reading device 10 on the display screen of the display device 24.

  In addition, this scanner driver has a function of adjusting an image read by the image reading device 10. The read image is adjusted through the “adjustment column” 110 of the main dialog box 100. The “adjustment column” 110 is provided with five buttons and four check boxes for adjusting an image read by the image reading apparatus 10. The five buttons 128A, 128B, 128C, 128D, and 128E are an automatic exposure button 128A, a histogram adjustment button 128B, a density correction button 128C, an image adjustment button 128D, and a color palette adjustment button 128E, respectively. is there. The four check boxes 130A, 130B, 130C, and 130D include an unsharp mask filter check box 130A, a moire removal filter check box 130B, a fading restoration check box 130C, and a dust removal check box 130D, respectively. And a backlight correction check box 130E.

  The automatic exposure button 128A is clicked when it is desired to automatically adjust the exposure. The histogram adjustment button 128B is a button that is clicked when it is desired to adjust the contrast of an image. When the histogram adjustment button 128B is clicked, a histogram adjustment dialog box is called up. The density correction button 128C is a button that is clicked when it is desired to correct the density balance of the image. When the density correction button 128C is clicked, a dialog box for density correction is called. The image adjustment button 128D is a button that is clicked when it is desired to adjust the brightness, contrast, saturation, and color balance of the image. When this image adjustment button 128D is clicked, an image adjustment dialog box is called up. On the other hand, the unsharp mask filter check box 130A is a check box for instructing whether or not the unsharp mask filter can be used, and is checked when it is desired to sharpen the image. The moire removal filter check box 130B is a check box for instructing whether or not to use a filter that removes moire (mesh shading) generated in the scanning of a printed matter, and is checked when moire is conspicuous. The color fading restoration check box 130C is checked when restoring the color of the faded photograph. The dust removal check box 130D is checked to reduce dust on the film during film scanning. The backlight correction check box 130E is checked when it is desired to perform backlight correction on the read image. This backlight correction will be described in detail later.

=== Image adjustment ===
Next, histogram adjustment, density correction, and image adjustment for performing image adjustment will be described. 6 to 9 illustrate histogram adjustment, density correction, and image adjustment, respectively. FIG. 6 shows a histogram adjustment dialog box. FIG. 7 explains a specific adjustment outline of the histogram adjustment. FIG. 8 shows a density correction dialog box. FIG. 9 shows an image adjustment dialog box.

<Histogram adjustment>
In “histogram adjustment”, the brightness of the image is adjusted to improve the appearance of the read image. In the histogram adjustment dialog box 131, as shown in FIG. 6, a histogram display field 132 in which a histogram of an image to be edited is displayed, and a tone curve display in which a tone curve indicating the result of adjustment by the histogram is displayed. A column 134 and a gray balance adjustment column 136 for adjusting the gray balance for removing the color cast are provided. Here, the “histogram” represents the brightness and color distribution of the entire image, and is a graph representing the data distribution (number of pixels) from black to white of the image.

  The histogram display column 132 is provided with a channel column 138 for selecting the type (channel (color)) of the histogram to be displayed. In this channel column 138, it is possible to select from four types of RGB (red, green, blue) all colors, only R (red), only G (green), and only B (blue). If you want to adjust all RGB (red, green, blue) colors, select the top switch in this channel column 138, and a histogram of all RGB (red, green, blue) colors will be displayed on the right. If only the R (red) is to be adjusted, the second switch from the top of the channel field 138 is selected, and a histogram of only R (red) is displayed on the right side. When only G (green) is to be adjusted, when the third switch from the top of the channel field 138 is selected, a histogram of only G (green) is displayed on the right side. If it is desired to adjust only B (blue), selecting the fourth switch from the top of the channel field 138 displays a histogram of only B (blue) on the right side.

  When the displayed histogram is adjusted, the adjustment is performed using the three sliders 140A, 140B, and 140C provided below the displayed histogram. The three sliders 140A, 140B, and 140C are a slider 140A that adjusts shadows, a slider 140B that adjusts gamma, and a slider 140C that adjusts highlights. The slider 140A for adjusting the shadow is represented by a black triangle mark “▲”. The slider 140B for adjusting gamma is represented by a gray triangle mark. The slider 140C for adjusting the highlight is represented by a white triangle “Δ”. When adjustment is performed using these three sliders 140A, 140B, and 140C, the three sliders 140A, 140B, and 140C are individually moved in the left-right direction. Specifically, the slider 140A for adjusting the shadow is moved so as to be located slightly to the right of the left end of the histogram peak. Further, the slider 140C for adjusting the highlight is moved so as to be located slightly to the left of the right end of the histogram peak. The slider 140B for adjusting the gamma is adjusted so that the brightness of the intermediate portion is appropriate by moving it to the left and right between the slider 140A for adjusting the shadow and the slider 140C for adjusting the highlight. As a result, the overall light / dark balance of the image to be edited is improved, and the appearance of the image can be improved.

  In addition, the histogram display field 132 is provided with numerical value input fields 142A, 142B, and 142C for directly and directly specifying the positions of the three sliders 140A, 140B, and 140C. A shadow input value is input to the numerical value input field 142A. In addition, the gamma value is input to the numerical value input field 142B. In addition, a highlight input value is input to the numerical value input field 142C. Thereby, it is possible to easily specify the shadow input value, the highlight input value, and the gamma value by directly inputting the numerical value into each numerical value input field 142A, 142B, 142C.

  Further, dropper buttons 143A, 143B, and 143C are provided on the right of these three numerical value input fields 142A, 142B, and 142C, respectively. The dropper buttons 143A, 143B, and 143C are buttons for directly instructing points from the image to be edited displayed on the preview screen displayed separately from the dialog box for adjusting the histogram. In the three numerical value input fields 142A, 142B, and 142C, numerical values corresponding to points (pixels) designated from the image to be edited on the preview screen are directly input using the dropper buttons 143A, 143B, and 143C. .

  Further, two numerical value input fields 142D and 142E are provided below the two numerical value input fields 142A and 142C to which the shadow input value and the highlight input value are input, respectively. A shadow output value corresponding to the shadow input value is input to the left numeric input field 142D. Further, a highlight output value corresponding to the highlight input value is input to the numerical value input field 142E on the right side.

  For adjustment using these sliders 140A, 140B, and 140C and numerical value input fields 142A, 142B, 142C, 142D, and 142E, RGB (red, green, blue) all colors, R (red) only, G (green) ) And B (blue) only.

  FIG. 7 explains this histogram adjustment in detail. In this histogram adjustment, the shadow input value α01, the shadow output value α03, the highlight input value α02, the highlight output value α04, which are set through the sliders 140A, 140B, 140C or the numerical value input fields 142A, 142B, 142C, 142D, 142E, Based on the gamma value α05, a tone curve representing the correspondence between input data and output data as shown in the figure is defined. That is, the tone curve defined here includes a point T1 (also referred to as a shadow point) defined by the set shadow input value α01 and shadow output value α03, and a set highlight input value α02 and highlight output value α04. It is formed so as to pass through a point T2 (also referred to as a highlight point) defined by. Further, the tone curve is formed so as to swell toward one of the straight lines connecting the points T1 and T2 in accordance with the set gamma value α05. Based on the shadow input value α01, the shadow output value α03, the highlight input value α02, the highlight output value α04, and the gamma value α05 set in this way, a tone curve representing the correspondence between the input data and the output data is obtained. It is prescribed. The tone curve is defined for each color of R (red), G (green), and B (blue).

  The tone curve thus defined is displayed in the tone curve display field 134 as shown in FIG. In the tone curve display field 134, a tone curve corresponding to the adjustment result performed in the histogram display field 132 is displayed. Further, in the tone curve display field 134, the gradation outside the point T1 (shadow point) or the point T2 (highlight point) can be adjusted so that the tone curve can be finely adjusted. Specifically, the end curve shape change buttons 144A and 144B provided on the lower left portion and the upper right portion of the tone curve are clicked, and the desired end curve shape is selected from the displayed pull-down menu. It has become. Here, for example, the end curve shape can be selected from three types of “boost”, “normal”, and “soft”. Here, “boost” is selected when it is desired to remove unevenness by making the white background part white or making the black part black. “Normal” is selected when the highlight part and the shadow part are expressed as they are. “Soft” is selected when returning a pure white part to an original white background or returning a pure black part to an original black background.

  In the gray balance adjustment column 136, a slider 145 for adjusting the gray balance is provided. By moving the slider 145 left and right, the gray balance can be adjusted and the color cast can be removed.

<Density correction>
“Density correction” is an adjustment used when the expression of the shading of an image is partially changed. Specifically, in this “density correction”, the tone curve is adjusted to improve the appearance of the read image. In other words, by adjusting the density curve (tone curve) that changes to shadow (darkest part), midtone (halftone), and highlight (brightest part), the brightness and contrast of the entire image are balanced. Can be finished. For this purpose, in the density correction dialog box 150, as shown in FIG. 8, a tone curve display unit 152 and a type of tone curve (channel (color)) to be displayed on the tone curve display unit 152 are selected. Channel column 154 is provided.

  In this channel column 154, it is possible to select from all four colors of RGB (red, green, blue), only R (red), only G (green), and only B (blue). If you want to adjust all RGB (red, green, blue) colors, select the top switch in this channel field 154, and the tone curves for all RGB (red, green, blue) colors will be displayed on the right. . If only the R (red) is to be adjusted, the tone curve of only the R (red) is displayed on the right side when the second switch from the top of the channel field 154 is selected. If it is desired to adjust only G (green), selecting the third switch from the top of this channel field 154 displays a tone curve of only G (green) on the right side. If it is desired to adjust only B (blue), when the fourth switch from the top of the channel field 154 is selected, a tone curve of only B (blue) is displayed on the right side.

  The tone curve display unit 152 displays a tone curve having the horizontal axis as an input value and the vertical axis as an output value. When the output value is set so as not to change with respect to the input value, the tone curve becomes a straight line as indicated by a line L1 in the figure.

  When adjusting the tone curve, an arbitrary point is set on the tone curve displayed on the tone curve display unit 152, and the tone curve is adjusted while shifting this point in the vertical and horizontal directions. In the present embodiment, three points P1, P2, and P3 are arbitrarily set on the tone curve displayed on the tone curve display unit 152, and these three points P1, P2, and P3 are respectively set up, down, left, and right from the reference line L1. Move and move in each direction. As a result, a tone curve desired by the user is formed on the tone curve display portion 152. The coordinates of the three points P1, P2, and P3 can also be set through two numerical value input fields 156A and 156B provided on the left side of the tone curve display unit 152, respectively. Here, by inputting an input value in the upper numerical value input field 156A and inputting an output value in the lower numerical value input field 156B, the coordinates of each point P1, P2, and P3 can be set.

  Such adjustment of the tone curve is possible for each of four types of RGB (red, green, blue), R (red) only, G (green) only, and B (blue) only. The tone curve setting can be stored through a density correction setting storage field 158 provided at the top of the density correction dialog box 150.

<Image adjustment>
As shown in the image adjustment dialog box 160 in FIG. 9, the “image adjustment” includes (1) brightness adjustment, (2) contrast adjustment, (3) saturation adjustment, and (4). There are four types of adjustments: color balance adjustments. Further, “(4) Color balance adjustment” includes an adjustment between “cyan (C) -red (R)”, an adjustment between “magenta (M) -green (G)”, and “yellow”. There are three types of adjustments, with adjustments between (Y)-Blue (B) ".

(1) Brightness adjustment “(1) Brightness adjustment” is performed when an image is too bright or too dark. “(1) Brightness adjustment” can be performed by moving the slider 162A to the left or right, or by directly inputting a numerical value into the numerical value input field 164A provided on the right side of the slider 162A.

(2) Contrast adjustment “(2) Contrast adjustment” is performed when the contrast is made clear or, on the contrary, the difference between light and dark is reduced. "(2) Contrast adjustment" can be performed by moving the slider 162B to the left or right, or by directly inputting a numerical value into the numerical value input field 164B provided on the right side of the slider 162B.

(3) Saturation adjustment “(3) Saturation adjustment” is performed when it is desired to make the color vivid. “(3) Saturation adjustment” can be performed by moving the slider 162C to the left or right, or by directly inputting a numerical value into the numerical value input field 164C provided on the right side of the slider 162C.

(4) Color balance adjustment “(4) Color balance adjustment” is performed when the image is reddish or bluish. “(4) Color balance adjustment” is performed by moving the sliders 162D, 162E, and 162F to the left and right, and in numerical value input fields 164D, 164E, and 164F provided on the right side of the sliders 162D, 162E, and 162F, respectively. This can be done by directly entering a numerical value. As a result, the image can be adjusted to an appropriate hue. Specifically, the strength of cyan and red (R) can be adjusted by moving the adjustment slider 162D between “cyan (C) and red (R)” to the left and right. Further, the strength of magenta (M) and green (G) can be adjusted by moving the adjustment slider 162E between “magenta (M) and green (G)” to the left and right. Further, the strength of yellow (Y) and blue (B) can be adjusted by moving the adjustment slider 162F between “yellow (Y) and blue (B)” to the left and right.

  Here, “(1) Brightness adjustment” and “(4) Color balance adjustment” are all three colors of red (R), green (G), and blue (B) or shades of each color as a whole. This is a process of performing conversion to shift. In addition, “(2) Contrast adjustment” is a process for performing conversion to increase or decrease the change in shading for all three colors of red (R), green (G), and blue (B).

On the other hand, “(3) Saturation adjustment” uses the following conversion formulas (1) to (3), for example, for each color of red (R), green (G), and blue (B). This is a process of converting data. Here, input data of each color of red (R), green (G), and blue (B) is indicated by “R”, “G”, and “B”, respectively. Further, output data of each color of red (R), green (G), and blue (B) are indicated by “R ′”, “G ′”, and “B ′”, respectively.
R ′ = S11 × R + S12 × G + S13 × B (1)
G ′ = S21 × R + S22 × G + S23 × B (2)
B ′ = S31 × R + S32 × G + S33 × B (3)
Here, S11, S12, S13, S21, S22, S23, S31, S32, and S33 are coefficients set according to the set saturation value. When increasing the saturation, values larger than “1” are set in S11, S22, and S33, and negative values are set in S12, S13, S21, S23, S31, and S32. In this way, “(3) Saturation adjustment” is executed.

<Setting data>
FIG. 10A to FIG. 10C illustrate data set by the histogram adjustment, density correction, and image adjustment, respectively. FIG. 10A explains data set by histogram adjustment. FIG. 10B explains data set by density correction. FIG. 10C explains data set by image adjustment.

  In the case of histogram adjustment, as shown in FIG. 10A, the shadow input values α11, α21, and α31 and the shadow output values α13, α23, and α33 for each color of R (red), G (green), and B (blue) Highlight input values α12, α22, α32, highlight output values α14, α24, α34, and gamma values α15, α25, α35 are set as data. In addition to this, data α41 and α42 relating to the “lower end shape” and “upper end shape” as the end shape of the tone curve and the adjustment value α51 in gray balance adjustment are set as data. The scanner driver stores these data α11, α21, α31, α13, α12, α22, α32, α23, α33, α14, α24, α34, α15, α25, α35, α41, α42, α51 as setting data. These setting data α11, α21, α31, α13, α23, α33, α12, α22, α32, α14, α24, α34, α15, α25, α35, α41, α42, α51 will be described with reference to FIG. 6, for example. In addition to being set by the user through the histogram adjustment dialog box 131, the scanner driver may be automatically set by calculation or the like. The scanner driver uses the stored setting data α11, α21, α31, α13, α23, α33, α12, α22, α32, α14, α24, α34, α15, α25, α35, α41, α42, α51 based on the input image. To adjust the image.

  In the case of density correction, as shown in FIG. 10B, a plurality of points P1, P2, P3,... Set on the tone curve for each color of R (red), G (green), and B (blue). The input coordinates β11, β13, β21, β23, β31, β33,... And the output coordinates β12, β14, β22, β24, β32, β34,. The scanner driver inputs the input coordinates β11, β13, β21, β23, β31, β33... And the output coordinates β12, β14, β22, β24, β32, β34... Of these points P1, P2, P3. Is stored as setting data. These setting data β11, β13, β21, β23, β31, β33,..., Β12, β14, β22, β24, β32, β34,. In addition to being set by the user through the dialog box 150, it may be set automatically by calculation or the like by the scanner driver. The scanner driver executes density correction based on the stored setting data β11, β13, β21, β23, β31, β33..., Β12, β14, β22, β24, β32, β34.

  In the case of image adjustment, as shown in FIG. 10C, the setting value γ1 of “(1) Brightness adjustment”, the setting value γ2 of “(2) Contrast adjustment”, and “(3) Color” Setting value γ3 of “degree adjustment” and setting values γ4, γ5, and γ6 of “(4) Color balance adjustment” are set. “(4) Color balance adjustment” includes a setting value γ4 between “cyan (C) -red (R)” and a setting value γ5 between “magenta (M) -green (G)”. And a set value γ6 between “yellow (Y) -blue (B)”. The scanner driver stores these setting values γ1, γ2, γ3, γ4, γ5, and γ6 as setting data. These setting data γ1, γ2, γ3, γ4, γ5, and γ6 are set by the user through the image adjustment dialog box 160 described with reference to FIG. May be set automatically. The scanner driver performs image adjustment based on the stored setting data γ1, γ2, γ3, γ4, γ5, and γ6.

=== Adjustment procedure ===
An example of a procedure for adjusting an input image, that is, an image read by the image reading apparatus 10 based on data set by the histogram adjustment, density correction, and image adjustment will be described. FIG. 11 shows an example of this procedure.

  The scanner driver performs histogram adjustment on the input image, that is, the image read by the image reading device 10 here (S002). In this histogram adjustment, the scanner driver adjusts R (red), G (green), and B (blue) based on tone curves defined for R (red), G (green), and B (blue), respectively. Data Rin, Gin, Bin of each pixel of the input image is converted and output for each color. Here, the scanner driver is set by the user through the histogram adjustment dialog box 131 described with reference to FIG. 6 or automatically set for each color of R (red), G (green), and B (blue). Shadow input values α11, α21, α31, shadow output values α13, α23, α33, highlight input values α12, α22, α32, highlight output values α14, α24, α34, gamma values α15, α25, α35, and others The histogram adjustment is executed based on these data with reference to the data α41 and α42 of the end shape of the tone curve and the adjustment value α51 of the gray balance adjustment. Thus, the scanner driver converts the data Rin, Gin, Bin (input data) of each pixel of the input image into output data Rout1, Gout1, Bout1, and outputs the converted data.

  After performing the histogram adjustment in this way, the scanner driver proceeds to step S004, and performs image adjustment on the image data on which the histogram adjustment has been performed (S004). Here, the scanner driver performs (1) brightness adjustment, (2) contrast adjustment, and (3) color balance adjustment as image adjustment. That is, the scanner driver sets the setting value γ1 of “(1) Brightness adjustment”, the setting value γ2 of “(2) Contrast adjustment”, and the setting values γ4, γ5 of “(4) Color balance adjustment”. , And γ6 are adjusted respectively. As a result, the scanner driver converts the output data Rout1, Gout1, and Bout1 resulting from the histogram adjustment into output data Rout2, Gout2, and Bout2, and outputs them.

  Then, after performing image adjustment (excluding (3) saturation adjustment) in this way, the scanner driver proceeds to step S006, and density correction is performed on the image data subjected to image adjustment. (S006). In this density correction, the scanner driver adjusts R (red), G (green), and B (blue) based on tone curves adjusted for the respective colors R (red), G (green), and B (blue). Data of each pixel of the input image is converted and output for each color. That is, here, the scanner driver inputs the input coordinates β11 of a plurality of points P1, P2, P3,... Set on the tone curve for each color of R (red), G (green), and B (blue). Referring to the setting data of β13, β21, β23, β31, β33 ………… and output coordinates β12, β14, β22, β24, β32, β34 …………, the tone curve formed based on these setting data Based on the above, density correction is executed. As a result, the scanner driver converts the output data Rout2, Gout2, and Bout2 resulting from image adjustment (excluding (3) saturation adjustment) into output data Rout3, Gout3, and Bout3 and outputs them.

  After performing the density correction in this manner, the scanner driver proceeds to step S008, and performs “(3) Saturation adjustment” as image adjustment on the image data subjected to density correction ( S008). Here, the scanner driver performs adjustment based on the set value γ3 of “(3) Saturation adjustment”. As a result, the scanner driver converts the output data Rout3, Gout3, and Bout3 resulting from the density correction into output data Rout4, Gout4, and Bout4 and outputs them.

After performing “(3) saturation adjustment” as image adjustment in this way, the scanner driver then performs color conversion on the image data that has been subjected to “(3) saturation adjustment”. Processing is performed (S010). The color conversion process is a process for converting data into data suitable for handling by various output devices (here, display devices, various printers, etc.). Specifically, for example, the following conversion formulas (4) to (6) are used.
R ′ = A11 × R + A12 × G + A13 × B (4)
G ′ = A21 × R + A22 × G + A23 × B (5)
B ′ = A31 × R + A32 × G + A33 × B (6)
Here, input data of red (R), green (G), and blue (B) before conversion are indicated by “R”, “G”, and “B”, respectively. Further, output data of each color of red (R), green (G), and blue (B) after conversion is indicated by “R ′”, “G ′”, and “B ′”, respectively. A11, A12, A13, A21, A22, A23, A31, A32, and A33 are coefficients that are appropriately set according to the characteristics of various output devices (display device 24, printer, etc.).

  In this way, the scanner driver performs color conversion processing according to the characteristics of various output devices on the image data on which “(3) saturation adjustment” has been performed. As a result, the scanner driver converts the output data Rout4, Gout4, and Bout4 by image adjustment ((3) saturation adjustment) into output data Rout5, Gout5, and Bout5 and outputs them. Then, after performing the color conversion process in this manner, the scanner driver outputs the image subjected to the color conversion process as an output image.

  Although the case where the color conversion process is executed at the final stage has been described as an example here, the color conversion process is executed as necessary.

=== Pre-scan ===
FIG. 12 illustrates an example of an image reading procedure performed by the image reading apparatus 10. When an image is read by the image reading device 10, a pre-scan may be executed. For example, in the case of reading an image at a high resolution, this pre-scan does not execute an operation for reading an image at a high resolution from the beginning, but an operation for reading an image at a high resolution (main scan). For example, reading an image at a low resolution once.

  As shown in the figure, the pre-scan is first executed (S050). The scanner driver acquires a pre-scan image (pre-image) by this pre-scan operation (S052). Next, the scanner driver performs automatic adjustment or the like on the acquired pre-scan image (pre-image). Here, the scanner driver obtains an appropriate adjustment value in histogram adjustment, density correction, image adjustment, and the like for the acquired pre-scan image (pre-image) and automatically corrects it (S054). The automatically corrected image is displayed on the display device 24, for example.

  The user performs various adjustments (corrections) while viewing the pre-scan image (pre-image) displayed on the display device 24 or the like in this way (S056). Here, the user performs various adjustments (corrections) through the histogram adjustment dialog box 131 in FIG. 6, the density correction dialog box 150 in FIG. 8, the image adjustment dialog box 160 in FIG.

  After various adjustments (corrections) are made by the user in this way, the main scan is executed. In this main scan, the image is read from the document 15 with high resolution by the image reading device 10 (S058). The scanner driver performs various adjustments (corrections) such as histogram adjustment, density correction, and image adjustment based on the data set by the user or the like for the high-resolution image acquired by the main scan in this way. To do. Thereby, the main image subjected to various adjustments (corrections) is acquired (S060).

=== Conventional Problems and Solutions ===
<Conventional problems>
Even when various adjustments (corrections) are automatically performed on the image read by the image reading device by histogram adjustment, density correction, image adjustment, etc., the backlight image is sufficiently adjusted (corrected). It was very difficult. For this reason, it was not possible to sufficiently improve the backlight image. Further, it has been extremely difficult for the user to adjust (correct) the backlight image through histogram adjustment, density correction, image adjustment, and the like. For this reason, it is necessary to provide a backlight image correction function so that sufficient adjustment (correction) can be performed on the backlight image.

  However, when the backlight image correction function is executed, it is determined whether or not the image to be determined is a backlight image. Conventional methods for determining whether or not the image is a backlight image sometimes cannot appropriately determine whether or not the target image is a backlight image. For this reason, there is a possibility that the backlight correction process may be performed on an image that is not a backlight image.

<Solution>
Therefore, in the present embodiment, a method is proposed in which backlight correction processing is performed on an image to be processed without determining whether the image is a backlight image. Here, the backlight correction process is executed as follows. The backlight correction process performed here will be described in detail below.

=== Backlight Correction Processing Procedure ===
In the present embodiment, when the “backlight correction check box 130 </ b> E” is checked by the user in the main dialog box 100 of the user interface described with reference to FIG. 5, the scanner driver displays an image read by the image reading device 10. On the other hand, backlight correction processing is performed. Here, the image on which the scanner driver performs the backlight correction processing is an image that has been adjusted (corrected) automatically or by the user by the above-described histogram adjustment, density correction, image adjustment, or the like. In the present embodiment, the scanner driver performs backlight correction processing on the image read by the image reading device 10 regardless of whether the image read by the image reading device 10 is a backlight image or not. The computer device 20 in which the scanner driver that performs the backlight correction process on the image read by the image reading device 10 is executed corresponds to a “backlight image correction device”.

  FIG. 13 illustrates a backlight image correction method performed here. In this correction method, the scanner driver first generates histogram data based on image data read by the image reading device 10 (S102). From this, the scanner driver corresponds to a “histogram data generation unit”. The histogram generated here is a graph representing the distribution of the number of pixels with respect to the density value of each pixel constituting the image read by the image reading device 10. On the horizontal axis of the histogram, the density value of the pixel is set, and on the vertical axis of the histogram, the number of pixels is set. In this histogram, a rectangular bar graph representing the number of pixels for each density value on the horizontal axis of the graph is formed. The bar graphs and the like formed here are connected to each other in the horizontal direction to form a graph having an area having a certain shape as a whole.

  After generating the histogram data in this manner, the scanner driver then divides the area represented by the histogram into two or more small areas according to the density value of the pixel based on the generated histogram data. (S104). Here, the number of small areas to be divided may be three, or may be four or more. Further, the areas of the small regions divided here may be set to be substantially equal to each other, or may be set to be not equal to each other. Further, some of the two or more divided small regions may be set so that their areas are substantially equal to each other. In addition, the number of pixels in the small area divided here may be set to be substantially equal to each other, or may be set to be not equal to each other. Further, some of the two or more divided small regions may be set so that the number of pixels is substantially equal to each other.

  The scanner driver divides the area represented by the histogram into two or more small areas in this way, and then selects at least one small area from the divided two or more small areas (S106). ). Here, the small area selected by the scanner driver may be two, or may be three or more. Of course, the scanner driver may select all the small areas here. Here, the small area selected by the scanner driver is preferably a small area from which information necessary for the scanner driver to perform backlight correction processing on the image read by the image reading apparatus 10 can be extracted.

  After selecting at least one small area from the two or more small areas obtained by dividing the area represented by the histogram in this way, the scanner driver then selects attribute information from the selected small area. Is acquired (S108). Here, the scanner driver corresponds to an “attribute information acquisition unit”.

  Here, the attribute information acquired by the scanner driver is information on the properties and characteristics of the small area selected by the scanner driver. Here, as the attribute information acquired by the scanner driver, for example, the average value of the density values of the pixels occupying the small area selected by the scanner driver, or the upper limit value or the lower limit of the density value of the pixels occupying the small area selected by the scanner driver. In addition, various attribute information such as the density value corresponding to the boundary line between the small area adjacent to the small area selected by the scanner driver and the area size of the small area selected by the scanner driver. There is. The scanner driver acquires at least one type of attribute information from these various attribute information. That is, the scanner driver may acquire one type of attribute information from these various types of attribute information, or may acquire a plurality of types of attribute information.

  The scanner driver may individually acquire attribute information for each of the small areas selected from the two or more small areas obtained by dividing the area represented by the histogram. Attribute information regarding two or more small regions may be acquired. In this way, the scanner driver acquires information necessary for the scanner driver to perform backlight correction processing on the image read by the image reading device 10.

  After acquiring the attribute information for the small area selected from the two or more small areas obtained by dividing the area represented by the histogram in this way, the scanner driver next displays the acquired attribute information. Based on this, the correction information for performing the backlight correction process on the target image is generated (S110). Here, the scanner driver corresponds to a “correction information generation unit”. The correction information is information that is fundamental when the scanner driver performs a backlight correction process on an image read by the image reading device 10. Based on the correction information, the scanner driver performs backlight correction processing on the image read by the image reading device 10. That is, this correction information becomes setting data for backlight correction processing that the scanner driver performs on the image read by the image reading device 10.

  Here, the scanner driver generates correction information corresponding to the backlight correction process performed on the image read by the image reading device 10. Specifically, for example, when the backlight correction process executed by the scanner driver is the above-described “density correction”, a setting for setting an arbitrary point to adjust the tone curve in “density correction” Information is generated as correction information.

  There are various methods for generating correction information based on attribute information acquired by the scanner driver. Specifically, for example, when the correction information is generated by the scanner driver, there is a method of acquiring correction information from a selected small area and generating correction information based on the information regarding the luminance. If information on luminance is acquired from the selected small area in this way, more appropriate backlight correction processing can be performed. As a method for acquiring information on the luminance, it is possible to easily acquire from the density values of the colors of red (R), green (G), and blue (B).

  The scanner driver generates the correction information for performing the backlight correction process in this manner, and then executes the backlight correction process based on the generated correction information (S112). Here, the scanner driver corresponds to a “backlight correction processing unit”. Here, as the backlight correction process executed by the scanner driver, various correction processes such as the above-described “density correction” can be employed. The backlight correction processing performed here may be performed on an image that has already been subjected to various adjustments (correction) such as histogram adjustment, density correction, and image adjustment, and may be read by the image reading device 10. The image may be directly applied to the obtained image. Further, the backlight correction process may be performed by changing parameters of various adjustments (corrections) already performed on the image read by the image reading apparatus 10.

  In this manner, the scanner driver performs backlight correction processing on the image read by the image reading device 10. Then, the process is immediately terminated.

  From these facts, this scanner driver corresponds to a “backlight image correction program”.

=== Correction of actual backlight image ===
<Generation of histogram>
FIG. 14 illustrates an example of a histogram generated by the scanner driver. In the histogram, the density value of the pixel is set on the horizontal axis, and the number of pixels is set on the vertical axis. In this histogram, a rectangular bar graph representing the number of pixels is formed for each density value on the horizontal axis of the graph, and these bar graphs are connected to each other in the horizontal direction to have a region having a certain shape as a whole. A graph is formed. From this histogram, the distribution status of the pixels can be grasped for each density value.

  In the present embodiment, the data of each pixel constituting the image read by the image reading device 10 is constituted by data of density values of three colors of red (R), green (G), and blue (B). . Therefore, in this embodiment, a histogram is generated for each color of red (R), green (G), and blue (B). That is, an image is formed with a histogram generated based on the red (R) density value of each pixel constituting the image, and a histogram generated based on the green (G) density value of each pixel constituting the image. Three types of histograms are generated: a histogram generated based on the blue (B) density value of each pixel. The scanner driver performs backlight correction processing on the image read by the image reading device 10 based on the histogram data of the three colors red (R), green (G), and blue (B) generated in this way. Apply.

<Division into small areas>
After generating the histogram data of the three colors of red (R), green (G), and blue (B) in this way, the scanner driver next generates the histogram of each color based on the data of the histogram of these three colors. A process for dividing each area represented by the above into two or more small areas is executed. Here, the scanner driver classifies the region represented by the histogram of each color according to the density value. Accordingly, two or more small regions are divided by boundary lines provided corresponding to certain density values along the direction of the vertical axis of the histogram of each color, as shown in FIG. 14, for example. Are arranged side by side along the direction of the horizontal axis. Here, an example will be described in which a region represented by a three-color histogram is divided into four small regions Ry1, Ry2, Ry3, and Ry4.

  In this embodiment, the scanner driver divides the regions represented by the histograms of three colors of red (R), green (G), and blue (B) into four small regions Ry1 and Ry2 as shown in FIG. , Ry3 and Ry4. Here, the small area Ry1 is referred to as a “first small area”. The small area Ry2 is referred to as a “second small area”. The small area Ry3 is referred to as a “third small area”. The small area Ry4 is referred to as a “fourth small area”. Of the four subregions divided here, that is, the first to fourth subregions Ry1, Ry2, Ry3, and Ry4, the first to third subregions Ry1, Ry2, and Ry3 have substantially the same area. Is set to That is, the first to third small regions Ry1, Ry2, and Ry3 have substantially the same number of pixels.

  Here, the areas of the first to third small regions Ry1, Ry2, and Ry3 each occupy approximately 33% of the total number of pixels constituting the image. That is, since the first small region Ry1 is located on the side where the density value is the smallest, among the pixels constituting the image to be determined, the pixels corresponding to “0 to 33%” in order from the pixel having the smallest density value. It is formed of pixels. Further, since the second small region Ry2 is located on the side having the second smallest density value after the first small region Ry1, the second small region Ry2 is included in the first small region Ry1 among the pixels constituting the image to be determined. The pixels are formed from “34 to 66%” pixels in order from the next pixel to the next pixel. Further, since the third small region Ry3 is located on the side having the third smallest density value after the second small region Ry2, the third small region Ry3 is included in the second small region Ry2 among the pixels constituting the image to be determined. The pixels are formed by “67 to 99%” pixels in order from the next pixel to the next pixel.

  On the other hand, the fourth small region Ry4 is set to have a different area (number of pixels) from the first to third small regions Ry1, Ry2, and Ry3. Here, the fourth small region Ry4 is located on the side with the fourth smallest density value next to the third small region Ry3 and on the side with the largest density value.

<Selection of small areas>
In this way, the regions represented by the three color histograms of red (R), green (G), and blue (B) are each divided into four small regions, that is, the first to fourth small regions Ry1, Ry2, Ry3, Ry4. Then, the scanner driver selects at least one of the four subregions, that is, the first to fourth subregions Ry1, Ry2, Ry3, and Ry4, in order to obtain attribute information. To do. In the present embodiment, three small regions (first to third small regions) Ry1, Ry2, Ry3 are selected from the first to fourth small regions Ry1, Ry2, Ry3, Ry4. Here, the selection of the three small regions (first to third small regions) Ry1, Ry2, and Ry3 is performed for each color. That is, the first to third small regions Ry1, Ry2, and Ry3 are selected from the histograms of red (R), green (G), and blue (B) colors, respectively.

<Acquisition of attribute information>
In this way, three small areas, ie, the first to third small areas Ry1, Ry2, and Ry3 are selected from the first to fourth small areas Ry1, Ry2, Ry3, and Ry4 for each color in order to obtain attribute information. After that, the scanner driver next acquires attribute information for each of the selected first to third small regions Ry1, Ry2, and Ry3. Here, the scanner driver acquires attribute information for each of the selected first to third small areas Ry1, Ry2, and Ry3. The attribute information is information on the properties and characteristics of the selected first to third small regions Ry1, Ry2, and Ry3. Specifically, the average value of the density values of the pixels occupying the selected first to third small regions Ry1, Ry2, Ry3, and the pixels occupying the selected first to third small regions Ry1, Ry2, Ry3. In addition to the upper limit value or lower limit value of the density value, the density value corresponding to the boundary line between the selected first to third small areas Ry1, Ry2, and Ry3 and other small areas is selected. For example, the first to third small regions Ry1, Ry2, and Ry3 have an area size.

  In the present embodiment, as attribute information regarding the selected first to third small regions Ry1, Ry2, and Ry3, average values AV1, AV2, and the average values AV1, AV2, and the like of the pixel values that occupy these first to third small regions Ry1, Ry2, Ry3, Acquire AV3 for each color. The average value of the density values of the pixels occupying the first small area Ry1 is “AV1”. Further, the average value of the density values of the pixels occupying the second small area Ry2 is “AV2”. The average value of the density values of the pixels occupying the third small region Ry3 is “AV3”. These average values AV1, AV2, and AV3 can be obtained by dividing the total value of the density values of the pixels that occupy the small area by the number of pixels that occupy the small area.

  Here, the average values of the density values of the pixels occupying the first to third small regions Ry1, Ry2, and Ry3 of the red (R) histogram are “AVr1”, “AVr2”, and “AVr3”, respectively. Also, the average values of the density values of the pixels occupying the first to third small regions Ry1, Ry2, and Ry3 of the green (G) histogram are “AVg1”, “AVg2”, and “AVg3”, respectively. The average values of the density values of the pixels occupying the first to third small regions Ry1, Ry2, and Ry3 of the blue (B) histogram are “AVb1,” “AVb2,” and “AVb3,” respectively.

<Generation of correction information>
In this way, the regions represented by the three color histograms of red (R), green (G), and blue (B) are each divided into four small regions, that is, the first to fourth small regions Ry1, Ry2, Ry3, Ry4. The three subregions, that is, the first to third subregions Ry1, Ry2, and Ry3 are selected from them, and these first to third subregions Ry1, Ry2, and Ry3 are used as attribute information. After obtaining the average value AVr1, AVr2, AVr3, AVg1, AVg2, AVg3, AVb1, AVb2, AVb3 of the density values of the pixels occupying the first to third small regions Ry1, Ry2, Ry3, Based on the average values AVr1, AVr2, AVr3, AVg1, AVg2, AVg3, AVb1, AVb2, AVb3 of the respective colors of the first to third small regions Ry1, Ry2, Ry3 obtained here, the image reading device 1 Correction information for performing a backlight correction process on the image read by 0 is generated. Hereinafter, a correction information generation method according to the present embodiment will be described.

(1) Acquisition of information about luminance In this embodiment, the first to third small regions Ry1, Ry2, and Ry3 obtained from the histograms of three colors of red (R), green (G), and blue (B) are occupied. Based on the average value AVr1, AVr2, AVr3, AVg1, AVg2, AVg3, AVb1, AVb2, AVb3 of the density value for each color of the pixel, the scanner driver performs each of the first to third small regions Ry1, Ry2, Ry3. Average values Yav1, Yav2, and Yav3 of the luminance of the pixels occupying Ry1, Ry2, and Ry3 are acquired. Here, the scanner driver uses, for example, the following formulas (7) to (9), and the like, thereby calculating average luminance values Yav1, Yav2, and Yav3 of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3 To get.
Yav1 = 1/5 × AVr1 + 3/5 × AVg1 + 1/5 × AVb1 (7)
Yav2 = 1/5 × AVr 2 + 3/5 × AVg 2 + 1/5 × AVb 2 (8)
Yav3 = 1/5 × AVr3 + 3/5 × AVg3 + 1/5 × AVb3 (9)
Here, in the formulas (7) to (9), the ratio of each color of red (R), green (G) and blue (B) is “1: 3: 1” as an example. However, other ratios may be set.
The scanner driver obtains average values Yav1, Yav2, and Yav3 of the luminance of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3 using these equations (7) to (9).

Further, the scanner driver uses the average luminance values Yav1, Yav2, and Yav3 of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3 acquired in this way, and reads the image read by the image reading device 10. An average value Yav0 of the overall luminance is obtained. In the present embodiment, since the first to third small regions Ry1, Ry2, and Ry3 occupy 99% of the entire image, the average luminance corresponding to the first to third small regions Ry1, Ry2, and Ry3, respectively. An average value of the values Yav1, Yav2, and Yav3 is set as an average value Yav0 of the luminance of the entire image. Therefore, in the present embodiment, the average value Yav0 of the overall luminance of the image read by the image reading device 10 can be obtained by the following equation (10), for example.
Yav0 = (Yav1 + Yav2 + Yav3) / 3 (10)
In this way, the scanner driver obtains the average value Yav0 of the overall luminance of the image read by the image reading device 10.

(2) Acquisition of Target Value The scanner driver acquires the average luminance values Yav1, Yav2, and Yav3 of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3 as described above, and further reads them by the image reading device 10. After obtaining the average brightness Yav0 of the entire image, the target value is obtained. This target value is a value acquired for performing the backlight correction process on the image read by the image reading device 10, and is a target value for determining the outline of the backlight correction process. In the present embodiment, two target values Ym1 and Ym2 are acquired as the target values. One target value Ym1 is acquired corresponding to the first small region Ry1, and indicates the target value of the average value of the luminance of the pixels occupying the first small region Ry1. The other target value Ym2 is acquired corresponding to the second small region Ry2, and indicates the target value of the average value of the luminance of the pixels occupying the second small region Ry2. In addition, the target value Ym3 corresponding to the third small region Ry3 is acquired. The target value Ym3 corresponding to the third small region Ry3 will be described in detail later.

  Next, a method for obtaining these two target values Ym1 and Ym2 will be described. FIG. 15 illustrates an example of a method for obtaining two target values Ym1 and Ym2.

  In the present embodiment, the scanner driver acquires these two target values Ym1 and Ym2 based on the average luminance value Yav1 of the pixels occupying the first small region Ry1 and the average luminance value Yav0 of the entire image. Specifically, the scanner driver adds the average luminance value Yav1 of the pixels occupying the first small area Ry1 and the average luminance value Yav0 of the entire luminance of the image, and based on the addition value Sadd obtained thereby, 2 Two target values Ym1 and Ym2 are acquired. In obtaining the two target values Ym1 and Ym2 from the added value Sadd, two relational expressions (A) and (B) as shown in the figure are used.

  These two relational expressions (A) and (B) shown in the figure are expressed on a graph formed with the horizontal axis as an addition value and the vertical axis as a target value. The relational expression (A) is for obtaining the target value Ym1 corresponding to the first small region Ry1. The relational expression (B) is for obtaining the target value Ym2 corresponding to the second small region Ry2.

  Assume that the scanner driver adds the average luminance value Yav1 of the pixels occupying the first small region Ry1 and the average luminance value Yav0 of the entire luminance of the image to obtain the added value Sadd. Then, the scanner driver acquires the target value Ym1 corresponding to the addition value Sadd from the relational expression (A) based on the addition value Sadd. Also, the scanner driver obtains the target value Ym2 corresponding to the addition value Sadd from the relational expression (B) based on the addition value Sadd. In this way, the scanner driver calculates two target values from the addition value Sadd obtained by adding the average value Yav1 of the luminance of the pixels occupying the first small region Ry1 and the average value Yav0 of the overall luminance of the image. That is, it is possible to easily obtain the target value Ym1 of the average brightness of the pixels occupying the first small area Ry1 and the target value Ym2 of the average brightness of the pixels occupying the second small area Ry2.

  Here, based on the addition value Sadd obtained by the scanner driver adding the average value Yav1 of the luminance of the pixels occupying the first small area Ry1 and the average value Yav0 of the overall luminance of the image, The reason why the target value, that is, the target value Ym1 of the average value of the pixels occupying the first small region Ry1 and the target value Ym2 of the average value of the pixels occupying the second small region Ry2 will be described. That is, the first small region Ry1 from which the average value Yav1 is acquired is the small one having the smallest density value among the four small regions obtained by dividing the histogram generated for each color, that is, the first to fourth small regions. It is an area. For this reason, the magnitude of the average value Yav1 acquired from the first small region Ry1 varies greatly depending on the degree of backlight of the image. However, whether or not the image is a backlight image cannot be determined only by the average value Yav1 acquired from the first small region Ry1. This is because even if the entire image is a dark image, the average value Yav1 acquired from the first small region Ry1 is small. In this case, it is necessary to increase the brightness of the entire image. This is because a sufficient correction effect cannot be obtained only by increasing the luminance of some pixels as in a backlight image.

  Therefore, in order to take into consideration the average value Yav0 of the entire luminance of the image, the average value Yav0 of the entire luminance of the image is added to the average value Yav0 of the pixels occupying the first small region Ry1, and the added value Sadd is obtained. Get it. This added value Sadd is a very appropriate value in examining the degree of backlighting of the image. That is, when the added value Sadd is very small, not only the average luminance value Yav1 of the pixels occupying the first small area Ry1 but also the average luminance value Yav0 of the entire image is small, and the entire image is dark. It can be determined that it is an image. As a result, correction can be performed to increase the brightness of the entire image.

  On the other hand, when the addition value Sadd is not so small, the average value Yav0 of the overall luminance of the image is not so small and the average value Yav1 of the pixels occupying the first small region Ry1 is small. It can be judged that there is. Accordingly, it is possible to perform correction so as to increase the luminance of some pixels, not the luminance of the entire image.

  The two relational expressions (A) and (B) described above are set so that the two target values Ym1 and Ym2 are defined according to the magnitude of the added value Sadd. That is, the two relational expressions (A) and (B) increase the luminance of the entire image when the addition value Sadd is very small, that is, when the luminance of the entire image is low and it is determined that the image is a dark image. Thus, the target value Ym1 of the average value of the luminance of the pixels occupying the first small region Ry1 and the target value Ym2 of the average value of the luminance of the pixels occupying the second small region Ry2 are very large values. Is set to be When the addition value Sadd is not so small, that is, when it is determined that the image is a backlight image, the two relational expressions (A) and (B) represent the luminance of the pixel occupying the first small region Ry1. The target value Ym1 of the average value and the target value Ym2 of the average value of the luminance of the pixels occupying the second small area Ry2 are set so as not to be too large. Accordingly, in the present embodiment, appropriate correction can be executed even when the image read by the image reading device 10 is not a backlight image but is a dark image with low overall brightness.

  These two relational expressions (A) and (B) can be set as follows, for example. That is, assuming that the minimum value that the addition value Sadd can take is “Smin” and the maximum value that the addition value Sadd can take is “Smax”, the maximum target value corresponding to each of the minimum value “Smin” and the maximum value “Smax”. Set the minimum target value. Here, the maximum target value corresponding to the relational expression (A) is “Ymax1”, and the minimum target value is “Ymin1”. The maximum target value corresponding to the relational expression (B) is “Ymax2”, and the minimum target value is “Ymin2”. The minimum value “Smin” and the maximum value “Smax” of the added value Sadd, the maximum target value “Ymax1” and the minimum target value “Ymin1” of the relational expression (A), and the maximum target value “of the relational expression (B)” Ymax2 ”and the minimum target value“ Ymin2 ”are appropriately set based on empirical rules and the like.

  From this, the relational expression (A) is, for example, the point Pm1 defined by the minimum value “Smin” of the addition value Sadd and the maximum target value “Ymax1” of the relational expression (A) as shown in FIG. And a straight line connecting the maximum value “Smax” of the addition value Sadd and the point Pm3 defined by the minimum target value “Ymin1” of the relational expression (A). Further, the relational expression (B) is, for example, as shown in the figure, a point Pm2 defined by the minimum value “Smin” of the addition value Sadd and the maximum target value “Ymax2” of the relational expression (B), It can be easily set as a straight line connecting the maximum value “Smax” of the addition value Sadd and the point Pm4 defined by the minimum target value “Ymin2” of the relational expression (B).

  Here, the minimum target value “Ymin1” of the relational expression (A) corresponding to the maximum value “Smax” of the addition value Sadd and the minimum target value “Ymin2” of the relational expression (B) are respectively set to very small values. Yes. From this, when the addition value Sadd is too large, the target value Ym1 of the average value of the luminance of the pixels occupying the first small region Ry1 and the target value Ym2 of the average value of the luminance of the pixels occupying the second small region Ry2 Can be set to a value sufficiently smaller than the standard value. As a result, even when the brightness of the entire image is high, that is, when the entire image is bright, the image can be corrected. That is, in the present embodiment, an appropriate backlight correction process can be performed on an image without determining whether the image is a backlight image, that is, regardless of whether the image is a backlight image.

  In this way, the scanner driver calculates the first value from the relational expressions (A) and (B) based on the average luminance value Yav1 of the pixels occupying the first small region Ry1 and the average luminance value Yav0 of the entire image. The target value Ym1 of the average value of the luminance of the pixels occupying the small region Ry1 and the target value Ym2 of the average value of the luminance of the pixels occupying the second small region Ry2 can be easily obtained.

  In the present embodiment, two target values are obtained based on the addition value Sadd obtained by adding the average luminance value Yav1 of the pixels occupying the first small region Ry1 and the average luminance value Yav0 of the entire luminance of the image. In order to easily obtain Ym1 and Ym2, a straight line, that is, a linear function, was used in the relational expressions (A) and (B). However, the relational expressions (A) and (B) used here are different from each other. Thus, such a linear function is not necessarily used. That is, a nonlinear function may be used in relational expressions (A) and (B).

  In the present embodiment, the average luminance value Yav1 of the pixels occupying the first small region Ry1 and the average luminance value Yav0 of the entire luminance of the image are added, and based on the added value Sadd obtained thereby, the target value Sadd is obtained. Although the values Ym1 and Ym2 have been acquired, it is not always necessary to obtain such an added value Sadd when acquiring the target values Ym1 and Ym2. That is, the target value may be acquired based only on the average luminance value Yav1 of the pixels occupying the first small region Ry1, and the target value is calculated based on the average luminance value Yav2 of the pixels occupying the second small region Ry2. You may get

  In this embodiment, the two target values Ym1 and Ym2 are acquired based on the addition value Sadd. However, it is not always necessary to acquire the two target values Ym1 and Ym2, and the number of target values is as follows. There may be one, or three or more.

(3) Generation of correction information The scanner driver generates correction information based on the two target values Ym1 and Ym2 acquired in this way. This correction information is information for the scanner driver to perform backlight correction processing on the image read by the image reading device 10. In the present embodiment, the scanner driver executes the above-described “density correction” as the backlight correction process. Therefore, in this embodiment, the scanner driver generates setting information for “density correction” as correction information. A method for generating setting information in “density correction” will be described in detail below.

  FIG. 16 illustrates a method for generating setting information in “density correction” as correction information. Here, the scanner driver performs a backlight correction process on the image read by the image reading device 10 by adjusting the tone curve Tc of “density correction”.

  In this embodiment, the tone curve Tc corresponding to all RGB (red, green, blue) colors described with reference to FIG. 8 is adjusted as the tone curve Tc for “density correction”.

  Therefore, the scanner driver sets three points Ps1, Ps2, and Ps3 as arbitrary points on the tone curve Tc based on the two target values Ym1 and Ym2 as correction information, as shown in FIG. . Then, the scanner driver adjusts the tone curve Tc so as to pass through these three points Ps1, Ps2, and Ps3. In the present embodiment, the point Ps1 is set corresponding to the first small region Ry1. The point Ps2 is set corresponding to the second small area Ry2. The point Ps3 is set corresponding to the third small region Ry3. In this embodiment, the input value of the point Ps1 is “X1”, and the output value is “Y1”. The input value of the point Ps2 is “X2”, and the output value is “Y2”. The input value of the point Ps3 is “X3”, and the output value is “Y3”.

  Here, the input values “X1”, “X2”, and “X3” of the three points Ps1, Ps2, and Ps3 are values that the input value can take, that is, in the present embodiment, a range of “0” to “255”. Any suitable value may be set. However, in order to form a well-balanced tone curve Tc, it is preferable to set as follows. That is, since these three points Ps1, Ps2, and Ps3 are arranged equally in a balanced manner, the range of values that the input value can take, that is, “0” to “255” is divided into three, The input values “X1”, “X2”, and “X3” are arranged respectively. That is, the input value “X1” is set within the range of “0” to “84”. The input value “X2” is set within the range of “85” to “169”. Further, the input value “X3” is set within the range of “170” to “255”.

  Furthermore, for example, it is preferable to set the input values “X1”, “X2”, and “X3” so as to be positioned at the approximate center in each section. Specifically, in this embodiment, the input value “X1” of the point Ps1 is set to “42”. Further, the input value “X2” of the point Ps2 is set to “127”. Further, the input value “X3” of the point Ps3 is set to “212”.

  On the other hand, the output values “Y1”, “Y2”, and “Y3” of these three points Ps1, Ps2, and Ps3 are set as follows in this embodiment. That is, the output value “Y1” of the point Ps1 and the output value “Y2” of the point Ps2 are set based on the two target values Ym1 and Ym2. On the other hand, the output value “Y3” of the point Ps3 is set based on the point Ps2 and the point Ps0. Here, the point Ps0 is a point set with an input value “255” and an output value “255”. The point Ps3 is set so as to be positioned almost directly above the straight line set between the point Ps2 and the point Ps0. That is, when “X3” is obtained as the input value of the point Ps3, a point corresponding to the input value “X3” is searched for on the straight line connecting the point Ps2 and the point Ps0 and set as the point Ps3. it can. The output value “Y3” of the point Ps3 can be obtained from the straight line connecting the point Ps2 and the point Ps0 as the output value corresponding to the input value “X3”.

  Here, how to obtain the output values “Y1” and “Y2” of the points Ps1 and Ps2 will be described. First, how to obtain the output value “Y1” of the point Ps1 will be described. The point Ps1 is set corresponding to the first small region Ry1. The output value “Y1” of the point Ps1 is set so that the average value Yav1 of the luminance of the pixels occupying the first small region Ry1 of the corrected histogram becomes the target value Ym1. Specifically, this is performed as follows. That is, an output value obtained when “density correction” is not performed on the input value “X1” is “Yt1”. That is, the output value “Yt1” is the same value as the input value “X1”. In FIG. 16, the point when “density correction” is not performed on the input value “X1” is shown as “Pt1”. A difference ΔYp1 between the output value “Y1” of the point Ps1 and the output value “Yt1” is obtained. This difference ΔYp1 can be obtained as follows.

  FIG. 17A illustrates a method for obtaining the difference ΔYp1 according to the present embodiment. In the present embodiment, the difference ΔYp1 is obtained by the scanner driver. First, as shown in the figure, the scanner driver obtains an output value “Yt1” corresponding to the input value “X1” (S202). The output value “Yt1” is the same value as the input value “X1” here. Next, the scanner driver sets the difference ΔYp1 to an initial value, here “0” (S204). Then, the scanner driver sets a value obtained by adding “1” to the difference ΔYp1 as a new ΔYp1 (S206). That is, when ΔYp1 is “42”, new ΔYp1 is added by “1” to become “43”.

  Next, the scanner driver sets a value obtained by adding ΔYp1 to the previously acquired output value “Yt1” as the output value “Y1” of the point Ps1 (S208). Then, image data after correction when “density correction” is executed based on the tone curve Tc set by the point Ps1 is acquired (S210). Here, as described with reference to FIG. 11, the contents of various adjustments (corrections) such as “histogram adjustment” and “image adjustment” are also reflected in addition to “density correction”. And

  After performing the correction in this manner, the scanner driver generates a histogram based on the image data obtained by the correction (S212). Here, the scanner driver creates a histogram of three colors of red (R), green (G), and blue (B). Next, the scanner driver classifies the histogram created in this way into small regions (S214). In other words, as described above, the scanner driver divides the region represented by the histogram into four small regions, that is, the first to fourth small regions Ry1, Ry2, Ry3, and Ry4.

  Then, the scanner driver acquires attribute information related to the first small region Ry1 from the four regions Ry1, Ry2, Ry3, and Ry4 obtained in this way. Here, the scanner driver acquires the average values AVr1, AVg1, and AVb1 of the density values of each color of red (R), green (G), and blue (B) as the attribute information related to the first small region Ry1. Then, the scanner driver obtains the average value Yav1 of the luminance of the pixels occupying the first small area Ry1 based on the acquired average values AVr1, AVg1, and AVb1 of the density values of the respective colors (S216). Here, the scanner driver obtains the average value Yav1 by, for example, Expression (7).

  Thereafter, the scanner driver compares the obtained average value Yav1 with the previously acquired target value Ym1 (S218). Here, the scanner driver checks whether or not the obtained average value Yav1 is equal to or greater than the target value Ym1. If the calculated average value Yav1 is not equal to or greater than the target value Ym1, the scanner driver returns to step S206 and again adds “1” to the difference ΔYp1 to obtain a new ΔYp1. (S206). Then, the output value “Y1” of the point Ps1 is acquired again (S208), the image is corrected based on this (S210), a histogram is generated (S212), and divided into small regions (S214). ), The average value Yav1 of the luminance of the pixels occupying the first small region Ry1 is obtained (S216). Thereafter, the obtained average value Yav1 is compared with the target value Ym1, and it is checked again whether or not the obtained average value Yav1 has reached the target value Ym1 (S218). The scanner driver repeats such processing (S206 to S218) until the obtained average value Yav1 reaches the target value Ym1. That is, the difference ΔYp1 is incremented by “1” sequentially until the calculated average value Yav1 reaches the target value Ym1.

  When the obtained average value Yav1 reaches the target value Ym1, the scanner driver sets the output value “Y1” of the point Ps1 based on the difference ΔYp1 obtained here (S220). In other words, the scanner driver sets the value obtained by adding the difference ΔYp1 to the output value “Yt1” as the output value “Y1” of the point Ps1.

  In this way, the scanner driver sets the output value “Y1” of the point Ps1 such that the average value Yav1 of the luminance of the pixels occupying the first small region Ry1 of the corrected histogram becomes the target value Ym1. When the output value “Y1” of the point Ps1 is set to a value smaller than the output value “Yt1”, the scanner driver determines whether or not the average value Yav1 is lower than the target value Ym1 in step S218. It is good to check.

  On the other hand, the output value “Y2” of the point Ps2 is set similarly to the output value “Y1” of the point Ps1. That is, the point Ps2 is set corresponding to the second small region Ry2. Similarly to the case of the point Ps1, the output value “Y2” of the point Ps2 is set so that the average value Yav2 of the luminance of the pixels occupying the second small region Ry2 of the corrected histogram becomes the target value Ym2. In short, if the output value obtained when “density correction” is not applied to the input value “X2” is “Yt2”, the difference ΔYp2 of the output value “Y2” of the point Ps2 with respect to this output value “Yt2” is obtained. Ask. In FIG. 16, the point when “density correction” is not performed on the input value “X2” is indicated as “Pt2”.

  FIG. 17B illustrates a method for obtaining the difference ΔYp1 according to the present embodiment. The difference ΔYp2 is also obtained by the scanner driver as in the case of the point Ps1. The scanner driver first obtains the output value “Yt2” corresponding to the input value “X2” as shown in FIG. The output value “Yt2” is the same value as the input value “X2” here. Next, the scanner driver sets the difference ΔYp2 to an initial value, here “0” (S254). Then, the scanner driver sets a value obtained by adding “1” to the difference ΔYp2 as a new ΔYp2 (S256).

  Next, the scanner driver sets a value obtained by adding ΔYp2 to the previously obtained output value “Yt2” as the output value “Y2” of the point Ps2 (S258). Then, image data after correction when “density correction” is executed based on the tone curve Tc set by the point Ps2 is acquired (S260). Here, as described with reference to FIG. 11, the contents of various adjustments (corrections) such as “histogram adjustment” and “image adjustment” are also reflected in addition to “density correction”. And Here, the scanner driver may or may not reflect the setting content of the point Ps1.

  After performing the correction in this manner, the scanner driver generates a histogram based on the image data obtained by the correction (S262). Here, the scanner driver creates a histogram of three colors of red (R), green (G), and blue (B). Next, the scanner driver divides the histogram created in this way into four small regions Ry1, Ry2, Ry3, and Ry4 (S264).

  Then, the scanner driver acquires attribute information related to the second small region Ry2 from the four regions Ry1, Ry2, Ry3, and Ry4 obtained in this way. Here, the scanner driver obtains the average values AVr2, AVg2, and AVb2 of the density values of each color of red (R), green (G), and blue (B) as attribute information related to the second small region Ry2. Then, the scanner driver obtains the average value Yav2 of the luminance of the pixels occupying the second small area Ry2 based on the acquired average values AVr2, AVg2, and AVb2 of the density values of the respective colors (S266). Here, the scanner driver obtains the average value Yav2 by, for example, Equation (8).

  Thereafter, the scanner driver compares the obtained average value Yav2 with the previously acquired target value Ym2 (S268). Here, if the obtained average value Yav2 has not reached the target value Ym2, the scanner driver returns to step S256, and again adds “1” to obtain a new ΔYp1 (S256). The output value “Y2” of the point Ps2 is acquired (S258), and based on this, the image is corrected (S260). Then, the scanner driver generates a histogram of the corrected image (S262), divides it into four small regions (S264), and obtains the average value Yav2 again (S266). Thereafter, the acquired average value Yav2 is compared with the target value Ym2, and it is checked again whether or not the obtained average value Yav2 has reached the target value Ym2 (S268). The scanner driver repeats such processing (S256 to S268) until the obtained average value Yav2 reaches the target value Ym2. That is, the difference ΔYp2 is incremented by “1” sequentially until the obtained average value Yav2 reaches the target value Ym2.

  When the calculated average value Yav2 reaches the target value Ym2, the scanner driver sets the output value “Y2” of the point Ps2 based on the difference ΔYp2 obtained here (S270). In other words, the scanner driver sets the value obtained by adding the difference ΔYp2 to the output value “Yt2” as the output value “Y2” of the point Ps2.

  In this manner, the scanner driver sets the output value “Y2” of the point Ps2 such that the average value Yav2 of the pixels occupying the second small area Ry2 of the corrected histogram becomes the target value Ym2. When the output value “Y2” of the point Ps2 is set to a value smaller than the output value “Yt2”, the scanner driver determines in step S268 whether or not the average value Yav2 has become equal to or less than the target value Ym2. It is good to check.

  Note that the output value “Y3” of the point Ps3 can be obtained from the straight line connecting the point Ps2 and the point Ps0 as the output value corresponding to the input value “X3” as described above.

(4) Other setting methods of the input values X1, X2, and X3 Other setting methods of the input values “X1”, “X2”, and “X3” of the three points Ps1, Ps2, and Ps3 described above are as follows: There are methods. That is, for example, the average luminance values Yav1, Yav2, and Yav3 of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3 may be set. In other words, the input values “X1”, “X2”, “X3” of these three points Ps1, Ps2, Ps3 are average values Yav1, Yav2, Reflect in Yav3. Specifically, there are the following setting methods.

  FIGS. 18A to 18C reflect the average values Yav1, Yav2, and Yav3 of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3, and the three input values “X1”, “X2”, “ An example of setting “X3” will be described. FIG. 18A illustrates a method for setting the input value “X1” of the point Ps1. FIG. 18B illustrates a method for setting the input value “X2” of the point Ps2. FIG. 18C illustrates a method for setting the input value “X3” of the point Ps3.

  When the input value “X1” of the point Ps1 is set, as shown in FIG. 18A, the predetermined target range “a1” is within the range of “0” to “84” where the input value “X1” is set. ~ “B1” is set. The predetermined target ranges “a1” to “b1” are set to approximately the center between “0” to “84”. “A1” and “b1” are set to appropriate values between “0” and “84”, respectively. The predetermined target ranges “a1” to “b1” set in this way are divided into 256 equal parts, and values “0” to “255” are allocated, and the average value of the luminance of the pixels occupying the first small area Ry1 The point Pk1 to which Yav1 corresponds is specified. Then, a value between “0” and “84” corresponding to the point Pk1 is obtained. The obtained value is set as the input value “X1” of the point Ps1.

  When the input value “X2” of the point Ps2 is set, as shown in FIG. 18B, the predetermined target range “8” is set within the range of “85” to “169” where the input value “X2” is set. “a2” to “b2” are set. The predetermined target ranges “a2” to “b2” are set to approximately the center between “85” to “169”. “A2” and “b2” are set to appropriate values between “85” and “169”, respectively. The predetermined target ranges “a2” to “b2” set in this way are divided into 256 equal parts, and values of “0” to “255” are allocated, and the average value of the luminance of the pixels occupying the second small area Ry2 The point Pk2 to which Yav2 corresponds is specified. Then, a value between “85” and “169” corresponding to the point Pk2 is obtained. The obtained value is set as the input value “X2” of the point Ps2.

  When the input value “X3” of the point Ps3 is set, as shown in FIG. 18C, a predetermined target range “in the range of“ 170 ”to“ 255 ”where the input value“ X3 ”is set. “a3” to “b3” are set. The predetermined target ranges “a3” to “b3” are set to approximately the center between “170” to “255”. “A3” and “b3” are set to appropriate values between “170” and “255”, respectively. The predetermined target ranges “a3” to “b3” set in this way are divided into 256 equal parts, and values “0” to “255” are allocated, and the average value of the luminance of the pixels occupying the third small region Ry3 The point Pk3 to which Yav3 corresponds is specified. Then, a value between “170” and “255” corresponding to the point Pk3 is obtained. The obtained value is set as the input value “X3” of the point Ps3.

  As described above, the input values “X1”, “X1”, “X1” and “Ps3” of the three points Ps1, Ps2, and Ps3 reflect the average luminance values Yav1, Yav2, and Yav3 of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3. When setting “X2” and “X3”, the predetermined target ranges “a1” to “b1”, “a2” to “b2”, and “a3” to “b3” are set for the following reason. is there. That is, when the average values Yav1, Yav2, and Yav3 of the pixels that occupy the first to third small regions Ry1, Ry2, and Ry3 are set as input values “X1”, “X2”, and “X3” as they are, This is because the range of values that can be taken by the input values “X1”, “X2”, and “X3” is widened, and thus there is a possibility that the tone curve Tc to be adjusted will be greatly affected.

  In other words, for example, it is assumed that the average luminance value Yav1 of the pixels occupying the first small region Ry1 is very small. When the average value Yav1 is set as it is as the input value “X1” of the point Ps1, and the point Ps1 is set in the tone curve Tc in FIG. 16, the position of the point Ps1 moves to the left side in the figure and moves to the vertical axis. Because of the approach, the rise of the tone curve Tc becomes very steep. Further, when the average value Yav1 of the luminance of the pixels occupying the first small region Ry1 is very large, the position of the point Ps1 moves to the right side in the drawing and approaches the point Ps2, so that the shape of the tone curve Tc May be distorted. The same applies to points Ps2 and Ps3.

  Therefore, in order to prevent the positions of the points Ps1, Ps2, and Ps3 from being too close to each other, each value that defines a predetermined target range, that is, “a1”, “b1”, “a2”, “b2”, By setting “a3” and “b3” to appropriate values, the shape of the tone curve Tc can be prevented from being distorted.

  In this way, the scanner driver sets three points Ps1, Ps2, and Ps3 for adjusting the tone curve Tc in “density correction” as correction information based on the two target values Ym1 and Ym2 acquired. Generate information.

  In the present embodiment, the three points Ps1, Ps2, and Ps3 are set as the correction information. However, the three points Ps1, Ps2, and Ps3 are not necessarily set as the correction information. That is, the number of points set as correction information may be one or two, and may be four or more. The number of points to be set is appropriately set according to the number of small regions obtained by dividing the region represented by the three-color histogram of red (R), green (G), and blue (B). Alternatively, it may be set as appropriate according to the number of small areas selected to acquire the attribute information.

  In addition, for the three points Ps1, Ps2, and Ps3 set as correction information, ranges of values that can be taken by the input value, that is, “0” to “255” in this embodiment are divided into three. It does not have to be arranged in each section.

  In the present embodiment, setting information of three points Ps1, Ps2, and Ps3 for adjusting the tone curve Tc in “density correction” is generated as correction information because of the relationship in which “density correction” is executed as the backlight correction processing. However, it is not always necessary to generate such setting information as correction information. That is, appropriate information may be generated as correction information in accordance with processing executed as backlight correction processing.

<Backlight correction processing>
The scanner driver is read by the image reading device 10 based on the information regarding the three points Ps1, Ps2, and Ps3 for adjusting the tone curve Tc in the “density correction” generated as correction information in this way. Backlight correction processing is performed on the image. In the present embodiment, the scanner driver corresponds to a “backlight correction processing unit”. Specifically, in the “density correction” in the adjustment procedure described with reference to FIG. 11, the image reading device is based on the tone curve Tc adjusted based on the information about the three points Ps1, Ps2, and Ps3 generated as the correction information. The density value of each color of the data of each pixel constituting the image read by 10 is converted. As a result, the scanner driver performs backlight correction processing on the image read by the image reading device 10.

  Here, the image subjected to the backlight correction processing is an image that has already been subjected to histogram adjustment, image adjustment (excluding (3) saturation adjustment), and the like according to the adjustment procedure shown in FIG. The scanner driver performs backlight correction processing by “density correction” on an image that has already been subjected to histogram adjustment, image adjustment (excluding (3) saturation adjustment), and the like in this way.

=== Other application examples ===
In the determination method described above, regions represented by the histograms of three colors of red (R), green (G), and blue (B) are each divided into four small regions, that is, first to fourth small regions Ry1, Ry2, and Ry3. However, it is not always necessary to divide into four small regions Ry1, Ry2, Ry3, and Ry4. That is, the region represented by the histogram of three colors of red (R), green (G), and blue (B) may be divided into at least two or more small regions. It may also be divided into five or more small areas.

  In the determination method described above, four small regions Ry1, Ry2, Ry3, and Ry4 obtained by dividing the region represented by the histogram of three colors of red (R), green (G), and blue (B). In addition, three small regions Ry1, Ry2, and Ry3 having substantially the same area and the same number of pixels are included. However, the small regions having the substantially same area and the same number of pixels are provided as described above. There is no need to be done. In addition, the present invention is not necessarily limited to the case where three small regions having substantially the same area or number of pixels are provided as described above, and may be two or four or more.

  In the above-described determination method, the first to fourth small regions Ry1, Ry2, obtained by dividing the region represented by the histogram of three colors of red (R), green (G), and blue (B), The first to third small regions Ry1, Ry2, and Ry3 are selected from Ry3 and Ry4. However, the selection is not necessarily limited to this. That is, at least one small region is selected from two or more small regions obtained by dividing the region represented by the histogram of three colors of red (R), green (G), and blue (B). It suffices to select one, and only one of the first to third small regions Ry1, Ry2, Ry3 may be selected. In addition, when the small area is divided by a method other than the method described here, the small area may be selected by another method.

  In the above-described determination method, the first to third small regions Ry1, Ry2, and Ry3 are assigned to each color as attribute information from the selected small regions, that is, the first to third small regions Ry1, Ry2, and Ry3. The average values AVr1, AVr2, AVr3, AVg1, AVg2, AVg3, AVb1, AVb2, and AVb3 of the density values of the occupied pixels are acquired, but such attribute information is not necessarily acquired. That is, any attribute information may be used as attribute information acquired from the selected small area. For example, the upper limit value of the density value of the pixels occupying the selected first to third small areas Ry1, Ry2, and Ry3. Alternatively, it may be the lower limit value, the size of the area of the selected first to third small regions Ry1, Ry2, and Ry3. In addition, as attribute information acquired from the selected small area, information that is influential in executing the backlight correction processing is desirable.

  In the above-described determination method, the density values of the pixels occupying the first to third small regions Ry1, Ry2, and Ry3 for each color obtained as attribute information from the selected first to third small regions Ry1, Ry2, and Ry3, respectively. Based on the average value AVr1, AVr2, AVr3, AVg1, AVg2, AVg3, AVb1, AVb2, and AVb3, and obtains a target value based on the information on the luminance, and corrects based on the target value. Although the information is generated, the correction information for executing the backlight correction process does not necessarily have to be generated by such a method. That is, the correction information may be generated by another method based on the attribute information acquired from the selected first to third small regions Ry1, Ry2, and Ry3.

  In the above-described determination method, the backlight correction process is performed by adjusting the tone curve Tc in “density correction”. However, the backlight correction process is not necessarily performed by such a method. That is, any backlight correction process may be executed as long as it is a backlight correction process capable of performing a correction process on the backlight image.

=== Summary ===
As described above, in the present embodiment, a histogram of three colors of red (R), green (G), and blue (B) is generated based on the data of each pixel constituting the image read by the image reading device 10. The regions represented by these histograms are divided into four small regions, that is, first to fourth small regions Ry1, Ry2, Ry3, Ry4, and these four small regions Ry1, Ry2, Ry3, Ry4 are divided. Three sub-regions, that is, first to third sub-regions Ry1, Ry2, Ry3 are selected for each color, and attribute information is obtained from each of the first to third sub-regions Ry1, Ry2, Ry3, Based on these attribute information, correction information for performing the backlight correction process is generated, and the backlight correction process is performed on the image read by the image reading device 10 based on the correction information. It can be provided with suitable backlight enhancement process on read by looking up device 10 images.

  Further, among the first to fourth small regions Ry1, Ry2, Ry3, and Ry4 obtained by dividing the regions represented by the histograms of red (R), green (G), and blue (B), respectively. The first to third small regions Ry1, Ry2, and Ry3 having substantially the same area and the same number of pixels are provided, and attribute information is acquired from each of the first to third small regions Ry1, Ry2, and Ry3 to obtain an image. More appropriate backlight correction processing can be performed on the image read by the reading device 10.

  As attribute information, average values AVr1, AVr2, AVr3, AVg1, AVg2, AVg3, AVb1, AVb2, AVb3 of the density values of the colors of the pixels occupying the selected first to third small regions Ry1, Ry2, Ry3 are used. By acquiring, more appropriate correction information can be generated, and more appropriate backlight correction processing can be performed on the image read by the image reading device 10.

  Further, based on the average values AVr1, AVr2, AVr3, AVg1, AVg2, AVg3, AVb1, AVb2, AVb3 of the density values of the colors of the pixels occupying the selected first to third small regions Ry1, Ry2, Ry3, the first ~ By obtaining the average values Yav1, Yav2, and Yav3 of the luminance of the pixels that occupy the third small regions Ry1, Ry2, and Ry3, more appropriate correction information is generated, and the image read by the image reading device 10 is obtained. Thus, a more appropriate backlight correction process can be performed.

  Further, by adding the acquired average luminance value Yav1 of the pixels occupying the first small region Ry1 and the average luminance value Yav0 of the entire image, the addition value Sadd is acquired to generate more appropriate correction information. Thus, a more appropriate backlight correction process can be performed on the image read by the image reading device 10.

  Further, by executing “density correction” as the backlight correction process, the backlight correction process can be easily performed on the image read by the image reading device 10.

=== Application to printing apparatus ===
Such an image reading apparatus 10 may be mounted on a printing apparatus. FIG. 19 illustrates a configuration example of a printing apparatus 220 including such an image reading apparatus 10. The printing apparatus 220 includes a scanner function for reading an image from a document and generating image data, a printer function for printing on various media such as printing paper based on print data sent from the host computer 248, and a reading function from the document. And a local copy function for copying a printed image on a medium. The printing apparatus 220 includes a scanner unit 222 that reads an image from a document (including the scanner control unit 238 and corresponds to the “image reading apparatus 10” herein), and a printer unit 224 that performs printing on a medium S such as printing paper. And.

  Further, the control unit 226 of the printing apparatus 220 includes a CPU 228, a memory 230, an external communication interface 232, an operation input interface 234, a display control unit 236, a scanner control unit 238, as shown in FIG. An image processing unit 240, a printer control unit 242, a card interface 244, and a bus 246 for connecting them to each other are provided.

  The CPU 228 controls the entire printing apparatus 220. The memory 230 stores a program executed by the CPU 228, data used in the program, and the like. The external communication interface 232 communicates with the host computer 248 by wire or wireless. The operation input interface 234 receives an operation input from the user through the operation button 250 or the like. The display control unit 236 controls a display unit such as the liquid crystal display 252.

  On the other hand, the scanner control unit 238 controls the scanner unit 222 to execute a reading operation for reading an image from a document. The image processing unit 240 executes print processing on the image data output from the scanner unit 222 by using the printer unit 224 in order to print an image read from the document by the scanner unit 222 on a medium by the printer unit 224. To play a role in converting data. The printer control unit 242 controls the printer unit 224. The card interface 244 performs processing for reading image data stored in the memory card from various memory cards set in the card reader unit 254.

  In the scanner function, the printing apparatus 220 outputs image data read from the document by the scanner unit 222 to the host computer 248. In the printer function, the printing apparatus 220 performs printing on various media by the printer unit 224 based on the print data sent from the host computer 248. In the local copy function, the printing apparatus 220 prints an image read from a document by the scanner unit 222 on various media by the printer unit 224 and copies it.

=== Other Embodiments ===
The present invention has been described above by taking an embodiment of an image reading system as an example. However, the above embodiment is for facilitating the understanding of the present invention, and is intended to limit the present invention. Is not. The present invention can be changed or improved without departing from the gist thereof, and needless to say, the present invention includes equivalents thereof. In particular, the embodiments described below are also included in the present invention.

<About images>
In the above-described embodiment, the image read by the image reading device 10 is described as an example of the image subjected to the backlight correction process. However, the “image” referred to here is any image. Also good. For example, specifically, an image taken by a digital camera or the like may be used. The image format may be any type, for example, an image expressed in various formats such as a JPEG format, a bitmap format, and a YUV format.

<About concentration values>
In the above-described embodiment, the density value expressed in 256 gradations, that is, the density value that can take values of “0” to “255”, for example, has been described as an example. The “density value” is not limited to such a density value. In other words, the “density value” here may be any density value as long as it is data for expressing the density of each pixel constituting the image. The “density value” includes a brightness density value expressed in a YUV format or the like.

<About the histogram>
In the embodiment described above, histogram data of three colors of red (R), green (G), and blue (B) is generated as “histogram data”. In this case, it is not always the case that the histogram data of these three colors of red (R), green (G) and blue (B) is generated. That is, at least two or more types of different color histogram data may be generated as “histogram data”, and one type of color histogram data, for example, black (“black”) histogram data, It may be generated as “histogram data”.

<About the histogram data generator>
In the above-described embodiment, as the “histogram data generation unit”, the scanner driver calculates the histogram data based on the data of the pixels constituting the image to be determined, that is, the image read by the image reading device 10 here. However, the “histogram data generation unit” here does not necessarily need to be such a scanner driver. In other words, in the “histogram data generation unit” here, any type of “histogram data generation unit” can be used as long as histogram data is generated based on the data of the pixels constituting the image to be determined. It does not matter.

<About the attribute information acquisition unit>
In the above-described embodiment, as the “attribute information acquisition unit”, the scanner driver determines that the region represented by the histogram of each color of red (R), green (G), and blue (B) is divided into two values according to the density value. It was divided into two or more small areas, and at least one small area was selected from these two or more small areas, and attribute information was acquired from the selected small areas. The “information acquisition unit” does not necessarily need to be such a scanner driver. In other words, the “attribute information acquisition unit” here may be any type of “attribute information acquisition unit” as long as the attribute information is acquired by the method described above.

<About correction information>
In the above-described embodiment, as the backlight correction process, setting information related to an arbitrary point for adjusting the tone curve Tc in the “density correction” is generated as the correction information because of the relationship in which “density correction” is executed. However, the setting information is not necessarily generated as correction information. That is, any type of correction information may be generated as long as it is correction information for performing backlight correction processing on an image.

<About the correction information generation unit>
In the above-described embodiment, as the “correction information generation unit”, the scanner driver generates setting information regarding an arbitrary point for adjusting the tone curve Tc in “density correction” as correction information. In the “correction information generation unit”, it is not always necessary to use such a scanner driver. In other words, the “correction information generation unit” here is any type of “correction information generation unit” as long as the correction information for performing the backlight correction process on the image is acquired. It doesn't matter.

<Backlight correction processing unit>
In the above-described embodiment, the scanner driver performs the backlight correction processing on the image read by the image reading device as the “backlight correction processing unit”. Therefore, it is not always necessary to use such a scanner driver. In other words, the “backlight correction processing section” here may be any type of “backlight correction processing section” as long as the backlight correction processing is performed on the image.

<About image reader>
In the above-described embodiment, the “image reading device” is an image reading device in which the image sensor 50 that reads an image is provided on the carriage 40 that moves relative to the document 15 set on the document table 12. As described above, the “image reading apparatus” here is not necessarily limited to this type of “image reading apparatus”. In other words, any type of apparatus is included in the “image reading apparatus” as long as the apparatus reads an image from a document. That is, the “image reading device” here includes an image reading device in which the document 15 moves relative to the image sensor 50 that reads an image and reads an image from the document 15.

<About printing devices>
In the above-described embodiment, as the “printing device”, an image reading unit (scanner unit 222) that reads an image from the document 15 and generates image data, and a printing unit (printer unit 224) that performs printing on a medium. However, the “printing apparatus” described here is not necessarily limited to the image reading unit (scanner unit 222 (scanner control unit 238 or image processing unit 240). Etc.))) is not necessary. In other words, the “printing apparatus” here may include at least a printing unit that performs printing on a medium.

1 is an explanatory diagram of an embodiment of an image reading system. FIG. FIG. 3 is an explanatory diagram illustrating an example of an internal configuration of an image reading apparatus. 1 is an explanatory diagram illustrating an example of a system configuration of an image reading apparatus. FIG. Explanatory drawing of an example of the system configuration | structure of a computer main body. FIG. 3 is an explanatory diagram illustrating an example of a main dialog box of a scanner driver. FIG. 6 is an explanatory diagram illustrating an example of a dialog box for adjusting a histogram. Explanatory drawing about the definition method of a tone curve. FIG. 4 is an explanatory diagram of an example of a density correction dialog box. Explanatory drawing of an example of the dialog box of an image adjustment. Explanatory drawing of the data set by histogram adjustment. Explanatory drawing of the data set by density correction. Explanatory drawing of the data set by image adjustment. Explanatory drawing of an example of the adjustment procedure of an image. Explanatory drawing of an example of an image reading procedure. The flowchart explaining the correction method of a backlight image. An explanatory view of an example of a histogram. Explanatory drawing of an example of the acquisition method of target value. Explanatory drawing of an example of the production | generation method of correction information. Explanatory drawing of an example of the setting method of point Ps1. Explanatory drawing of an example of the setting method of point Ps2. Explanatory drawing of an example of the other setting method of input value "X1" of point Ps1. Explanatory drawing of an example of the other setting method of input value "X2" of point Ps2. Explanatory drawing of an example of the other setting method of input value "X3" of point Ps3. FIG. 3 is an explanatory diagram illustrating an embodiment of a printing apparatus.

Explanation of symbols

2 image reading system, 10 image reading device, 12 document table,
14 Document cover, 15 Document, 18 Hinge, 20 Computer device,
22 computer body, 24 display device, 26 input device,
28 FD drive device, 30 CD-ROM drive device, 32 reading device,
34 keyboard, 36 mouse, 40 carriage, 42 drive mechanism,
44 guide, 46 exposure lamp, 48 lens, 50 image sensor,
52 control unit, 54 timing belt, 55 pulley, 56 pulley,
58 drive motor, 60 controller, 62 motor controller, 64 lamp controller,
66 sensor control unit, 68 AFE (Analog Front End) unit,
70 digital processing circuit, 72 interface circuit,
74 analog signal processing circuit, 76 A / D conversion circuit,
80 CPU, 82 memory, 84 HDD (hard disk drive),
86 operation input unit, 88 display control unit, 90 external communication unit, 92 bus,
100 dialog box, 102 “mode selection field”, 104 “save setting”,
106 “Original setting field”, 108 “Output setting field”, 110 “Adjustment field”,
112 “Document Type”, 114 “Scanning Device”, 116 “Auto Exposure”,
118 “Image type”, 120 “Resolution”, 122 “Original size”,
124 “Output Size”, 126 “Scan Button”,
127 “Preview button”, 128A button, 128B button,
128C button, 128D button, 128E button,
130A check box, 130B check box,
130C check box, 130D check box,
130E check box, 131 dialog box,
132 Histogram display field, 134 Tone curve display field,
136 Gray balance adjustment field, 138 channel field,
140A slider, 140B slider, 140C slider,
142A Numerical input field, 142B Numerical input field, 142C Numerical input field,
142D numeric input field, 142E numeric input field, 143A syringe button,
143B syringe button, 143C syringe button,
144A End curve shape change button, 144B End curve shape change button,
145 slider, 150 dialog box, 152 tone curve display,
154 Channel field, 156A Numerical value input field, 156B Numerical value input field,
158 Density correction setting save field, 160 dialog box,
162A slider, 162B slider, 162C slider,
162D slider, 162E slider, 162F slider,
164A Numerical input field, 164B Numerical input field, 164C Numerical input field,
164D numeric input field, 164E numeric input field, 164F numeric input field,
220 printing device, 222 scanner unit,
224 printer unit, 226 control unit, 228 CPU, 230 memory,
232 External communication interface, 234 operation input interface,
236 Display control unit, 238 Scanner control unit, 240 Image processing unit,
242 Printer control unit, 244 card interface,
246 bus, 248 host computer, 250 operation buttons,
252 LCD display, 254 card reader

Claims (18)

(A) a histogram data generation unit that generates histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixels based on data of pixels constituting the image;
(B) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(C) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(D) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
A backlight image correction device comprising (E).   2. The backlight image correction apparatus according to claim 1, wherein the histogram data generation unit generates histogram data for each color of red, green, and blue as the histogram data for each color.   The backlight image correction apparatus according to claim 1, wherein the two or more small regions include two or more small regions having the same area.   The backlight image correction apparatus according to any one of claims 1 to 3, wherein the two or more small regions include two or more small regions having the same number of pixels. The two or more small regions include two or more small regions in which at least one of the number and area of the pixels is equal to each other,
The attribute information acquisition unit acquires the attribute information from two or more small regions in which at least one of the number and area of the pixels is equal to each other. The backlight image correction device according to claim 1.   The backlight according to claim 1, wherein the attribute information acquisition unit acquires, as the attribute information, an average value of the density values for each color for each of the at least one small region. Image correction device.   The correction information generation unit acquires information on luminance for each of the at least one small region based on the average value of the density values for each color acquired by the attribute information acquisition unit, and based on the information on the luminance The backlight image correction apparatus according to claim 6, wherein the correction information is generated.   The backlight image correction apparatus according to claim 7, wherein the correction information generation unit acquires an average value of luminance of pixels for each of the at least one small region as information on the luminance.   The correction information generation unit adds a value obtained by adding at least one of the average luminance values acquired for each of the at least one small region and the average luminance value of the entire image. 9. The backlight image correction apparatus according to claim 8, wherein the correction information is generated based on the correction information.   The said backlight correction process part converts the density value of each pixel which comprises the said image, when performing the said backlight correction process based on the said correction information, The any one of Claims 1-9 characterized by the above-mentioned. The backlight image correction apparatus described.   The correction information generation unit generates, as the correction information, information related to a correspondence relationship between a density value before being converted by the backlight correction processing unit and a density value after being converted by the backlight correction processing unit. The backlight image correction apparatus according to claim 10. (A) a histogram data generation unit that generates histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixels based on data of pixels constituting the image;
(B) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(C) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(D) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
(E)
(F) As the histogram data for each color, histogram data for each color of red, green, and blue is generated by the histogram data generation unit,
(G) The two or more small regions include two or more small regions in which at least one of the number and area of the pixels is equal to each other, and the attribute information acquisition unit Obtaining the attribute information from two or more small regions in which at least one of the number and the area is equal to each other,
(H) The attribute information acquisition unit acquires, as the attribute information, an average value of the density values for each of the colors for the at least one small region,
(I) The correction information generation unit acquires an average luminance value for each of the at least one small region based on an average value of the density values for each color acquired by the attribute information acquisition unit,
(J) The correction information generation unit is obtained by adding at least one of the average luminance values acquired for each of the at least one small region and the average luminance value of the entire image. Based on the obtained value, the correction information is generated,
(K) When performing the backlight correction processing based on the correction information, the backlight correction processing unit converts a density value of each pixel constituting the image,
(L) The correction information generation unit includes, as the correction information, information related to a correspondence relationship between the density value before being converted by the backlight correction processing unit and the density value after being converted by the backlight correction processing unit. A backlight image correction device, characterized by comprising: (A) a histogram data generation unit that generates histogram data representing a distribution of the number of pixels with respect to a density value of the pixels, based on data of pixels constituting the image;
(B) Based on the histogram data generated by the histogram data generation unit, each of the regions represented by the histogram is divided into two or more small regions according to the size of the density value. An attribute information acquisition unit that selects at least one small area from among the small areas and acquires attribute information related to the small area;
(C) a correction information generation unit that generates correction information for performing a backlight correction process on the image based on the attribute information acquired by the attribute information acquisition unit;
(D) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
A backlight image correction device comprising (E). (A) generating histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the image;
(B) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas according to the size of the density value. Steps,
(C) selecting at least one small area from the two or more small areas, and obtaining attribute information about the small area for each color;
(D) generating correction information for performing backlight correction processing on the image based on the acquired attribute information for each color;
(E) performing the backlight correction process on the image based on the generated correction information;
(F) The backlight image correction method characterized by having. (A) A backlight image correction program executed in the backlight image correction apparatus,
(B) generating histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the image;
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas according to the size of the density value. Steps,
(D) selecting at least one small area from the two or more small areas, and obtaining attribute information about the small area for each color;
(E) generating correction information for performing backlight correction processing on the image based on the acquired attribute information for each color;
(F) performing the backlight correction process on the image based on the generated correction information;
A backlight image correction program characterized by executing (G). (A) an image reading unit for reading an image from a document;
(B) A histogram data generation unit that generates histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the image read by the image reading unit. When,
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(D) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(E) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
An image reading apparatus comprising (F). (A) a step of reading an image from a document;
(B) generating histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel based on the data of the pixels constituting the read image;
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas according to the size of the density value. Steps,
(D) selecting at least one small area from the two or more small areas, and obtaining attribute information about the small area for each color;
(E) generating correction information for performing backlight correction processing on the image based on the acquired attribute information for each color;
(F) performing the backlight correction process on the image based on the generated correction information;
An image reading method comprising (G). (A) a printing unit that prints an image on a medium;
(B) Before the image is printed by the printing unit, based on the data of the pixels constituting the image, histogram data for each color representing the distribution of the number of pixels with respect to the density value of each color of the pixel is obtained. A histogram data generation unit to generate,
(C) Based on the histogram data for each color generated by the histogram data generation unit, the area represented by the histogram for each color is divided into two or more small areas for each density value. An attribute information acquisition unit that selects at least one small area from the two or more small areas and acquires attribute information about the small area for each color;
(D) a correction information generation unit that generates correction information for performing backlight correction processing on the image based on the attribute information for each color acquired by the attribute information acquisition unit;
(E) a backlight correction processing unit that performs the backlight correction processing on the image based on the correction information generated by the correction information generation unit;
A printing apparatus comprising (F).