JP4345759B2 - Image editing apparatus, image editing method, image editing program, image reading system, and image reading method - Google Patents

Description

  The present invention relates to an image editing apparatus, an image editing method, an image editing program, an image reading apparatus, and an image reading method for editing an image according to user preferences.

  Various image reading apparatuses such as an image scanner are generally connected to a so-called computer apparatus such as a personal computer by wire or wireless, and transmit an image read from a document as image data to the computer apparatus. The computer device receives the image data transmitted from the image reading device and stores it in a data storage device such as various memories or a hard disk device. At this time, the computer apparatus can perform various kinds of processing such as image processing on the image data sent from the image reading apparatus according to the user's preference.

Examples of the adjustment processing performed here include histogram adjustment for adjusting the contrast of an image, density correction for partially changing the expression of light and shade of an image, and the like. These adjustments are automatically executed by various programs such as a driver program and an application program of the image reading apparatus installed in the computer apparatus, or are executed by a user or the like. In addition, various methods have been proposed for various adjustments, adjustment methods, editing methods, and the like that are performed on an image read by the image reading apparatus (see Patent Documents 1 to 5).
Japanese Patent Laid-Open No. 2002-16798 JP-A-7-220043 JP 11-345321 A JP-A-7-99589 JP 2004-153684 A

  However, when the user wants to adjust the image to a desired color tone, even if various adjustments and adjustment methods such as histogram adjustment and density correction, and editing methods are prepared, an appropriate adjustment method is selected from these. In addition, in the adjustment method, an appropriate adjustment must be performed through trial and error in order to change to a color desired by the user. For this reason, it has often been very difficult to change to a color desired by the user. In particular, a large amount of labor is required for users who are not familiar with color adjustment and the like.

  In particular, when the user wants to select a desired color when adjusting the hue, it is difficult to easily find the desired color based on the existing color, and it is extremely difficult to smoothly adjust the hue.

  The present invention has been made in view of such circumstances, and an object of the present invention is to enable a user to easily adjust the color of an image to be edited.

The main invention for achieving the object is as follows:
(A) an image display unit on which an image to be edited is displayed;
(B) a first adjustment unit that performs a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment, and at least one of the other A second adjustment unit that performs a second adjustment that is an adjustment of
An image editing apparatus comprising (C),
Displaying the image subjected to the second adjustment after the first adjustment on the original image on the image display unit;
Obtains information about the specified pixel is specified Ri by the user on the image displayed on the image display unit,
Based on the information on the specified pixel, the a first patch of the same color as the color of the designated pixel, the plurality of types of color at least one is different in steps of hue and lightness with respect to the first patch of the color display the editing palette and a second patch of,
Obtaining information on the designated color designated by the user on the editing palette;
A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
The image editing characterized in that the first adjustment is changed so that the color of the pixel at the position of the designated pixel of the original image becomes the target color by performing the first adjustment. Device.

  Other features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

  At least the following matters will become apparent from the description of the present specification and the accompanying drawings.

(A) an image display unit on which an image to be edited is displayed;
(B) an information acquisition unit that acquires information about a pixel arbitrarily designated by the user on the image displayed on the image display unit;
(C) Based on the information about the pixel acquired by the information acquisition unit, the first patch having the same color as the color of the pixel specified by the user, and the hue and brightness of the color of the first patch A palette display control unit that displays an editing palette having second patches of a plurality of types of colors, at least one of which is different in stages,
An image editing apparatus comprising (D).

  In such an image editing apparatus, the first patch having the same color as the pixel color arbitrarily designated by the user, and at least one of hue and lightness with respect to the color of the first patch is present. Since the editing palette having the second patches of a plurality of types of colors different in stages is displayed, the user can easily find a desired color.

  In such an image editing apparatus, the second patches of the plurality of types of colors may be arranged on the editing palette adjacent to each other. As described above, the second patches of a plurality of types of colors are arranged on the editing palette adjacent to each other, so that the colors of the second patches can be easily compared with each other.

  In the image editing apparatus, the first patch may be arranged on the editing palette adjacent to at least one of the second patches of the plurality of colors. As described above, the first patch is arranged on the editing palette adjacent to at least one of the plurality of types of second patches, so that the colors of the first patch and the second patch Can be easily compared.

  In such an image editing apparatus, the editing palette is provided with a plurality of types of patches whose hues are different from each other in stages with respect to the color of the first patch as the second patch. The lightness of the patches may be set to be equal to each other. In this way, as the second patch, a plurality of types of patches having different hues with respect to the color of the first patch are provided, and the brightness of the plurality of types of patches is set to be equal to each other. The user can find out a desired color more easily.

  In this image editing apparatus, the amount of change in the hue of the second patch with respect to the color of the first patch may be different depending on the brightness of the first patch. In this way, the amount of change in the hue of the second patch with respect to the color of the first patch varies depending on the brightness of the first patch, so that the user can more easily find a desired color.

  In such an image editing apparatus, the amount of change in hue between the second patches of the plurality of types of colors whose hues are different in stages with respect to the color of the first patch may be different. As described above, the amount of change in hue between the second patches of the plurality of types of colors whose hues are different in stages relative to the color of the first patch is different, so that the user can more easily find a desired color. it can.

  Further, in such an image editing apparatus, the second patches of the plurality of types of colors whose hues are different in stages with respect to the color of the first patch are arranged around the first patch. May be. Since the second patch is arranged around the first patch in this way, the color of the first patch and the color of the second patch can be easily compared, and the user can more easily desire Can find out the color of.

   In the image editing apparatus, the editing palette is provided with a plurality of types of patches having different brightness in stages with respect to the color of the first patch as the second patch. The hues of the patches may be set to be equal to each other. In this way, as the second patch, a plurality of types of patches whose brightness differs in stages with respect to the color of the first patch is provided, and the hues of the plurality of types of patches are set to be equal to each other, The user can find out a desired color more easily.

   In such an image editing apparatus, the second patches of the plurality of types of colors whose brightness differs stepwise with respect to the color of the first patch are arranged linearly around the first patch. Also good. As described above, since the second patches of a plurality of types of colors whose brightness differs stepwise with respect to the color of the first patch are arranged in a straight line with the first patch as a center, Thus, the user can easily find the desired color.

   In this image editing apparatus, the editing palette includes the second patch in the direction of each color of cyan, magenta, yellow, red, green and blue with respect to the color of the first patch. Patches having different hues in stages may be provided. As described above, the second patch is provided with patches whose hues are different in stages in the directions of cyan, magenta, yellow, red, green, and blue with respect to the color of the first patch. Can easily find the desired color.

  In the image editing apparatus, the editing palette is selected from cyan, magenta, yellow, red, green and blue as the second patch for the color of the first patch. Patches having different hues in the direction of the two types of colors may be provided. In this way, the patch having a different hue in the direction of two kinds of colors selected from cyan, magenta, yellow, red, green and blue is provided as the second patch, so that the user can more easily obtain the desired color. You can find the color.

  In such an image editing apparatus, the editing palette is provided with a color storage area for recording the color of the patch designated by the user from the plurality of types of second patches. It may be done. In this way, the editing palette is provided with a color storage area for recording the color of the patch designated by the user from among the second patches of a plurality of types of colors. You can save the color you want.

  In this image editing apparatus, a plurality of types of colors of the patch designated by the user may be recorded in the color storage area. As described above, since a plurality of types of patch colors designated by the user can be recorded in the color storage area, the user can store a plurality of types of desired colors.

  In the image editing apparatus, when the user selects one of the plurality of types of second patches, the palette display control unit selects a patch of the color of the selected patch. The editing palette as the first patch may be displayed. As described above, when one of the second patches of a plurality of colors is selected by the user, the palette display control unit displays an editing palette using the selected patch color as the first patch. As a result, the user sets the desired color as the color of the first patch, and applies the second patch of a plurality of types of colors, at least one of the hue and the brightness of which is different in stages from the color of the first patch. Can be displayed. Thereby, a desired color can be easily found.

  In such an image editing apparatus, the palette display control unit may display the editing palette on the image display unit. Thus, the palette display control unit displays the editing palette on the image display unit, so that the editing palette can be displayed in contrast with the image to be edited.

(A) an image display unit on which an image to be edited is displayed;
(B) an information acquisition unit that acquires information about a pixel arbitrarily designated by the user on the image displayed on the image display unit;
(C) Based on the information about the pixel acquired by the information acquisition unit, the first patch having the same color as the color of the pixel specified by the user, and the hue and brightness of the color of the first patch A palette display control unit that displays an editing palette having second patches of a plurality of types of colors, at least one of which is different in stages,
(D)
(E) the second patches of the plurality of types of colors are arranged on the editing palette adjacent to each other;
(F) The first patch is disposed on the editing palette adjacent to at least one of the plurality of types of second patches.
(G) In the editing palette, a plurality of types of patches whose hues are different in stages with respect to the color of the first patch are provided as the second patch, and the lightnesses of the plurality of types of patches are equal to each other. Is set to
(H) The amount of change in the hue of the second patch with respect to the color of the first patch differs depending on the brightness of the first patch,
(I) The amount of change in hue between the second patches of the plurality of types of colors different in hue from the color of the first patch is different,
(J) the second patches of the plurality of types of colors whose hues are different in stages with respect to the color of the first patch are arranged around the first patch,
(K) The editing palette is provided with a plurality of types of patches whose brightness varies stepwise with respect to the color of the first patch as the second patch, and the hues of the plurality of types of patches are equal to each other. Is set to
(L) The second patches of the plurality of types of colors whose brightness differs stepwise with respect to the color of the first patch are arranged linearly with the first patch as a center,
(M) In the editing palette, as the second patch, patches whose hues are stepwise different from each other in the directions of cyan, magenta, yellow, red, green and blue with respect to the color of the first patch. Is provided,
(N) In the editing palette, as the second patch, in the direction of two kinds of colors selected from cyan, magenta, yellow, red, green and blue with respect to the color of the first patch Patches with different hues are provided,
(O) The editing palette is provided with a color storage area for recording the color of the patch designated by the user from among the plurality of types of second patches.
(P) In the color storage area, a plurality of types of colors of the patch designated by the user can be recorded,
(Q) The palette display control unit, when one of the second patches of the plurality of types of colors is selected by the user, the editing using the color patch of the selected patch as the first patch Display the palette for
(R) The image editing apparatus, wherein the palette display control unit displays the editing palette on the image display unit.

Obtaining information on pixels arbitrarily designated by the user on the image displayed on the image display unit;
Based on the acquired information about the pixel, at least one of hue and brightness differs in stages from the first patch having the same color as the color of the pixel specified by the user and the color of the first patch. Displaying an editing palette having a second patch of a plurality of types of colors;
An image editing method characterized by comprising:

Obtaining information on pixels arbitrarily designated by the user on the image displayed on the image display unit;
Based on the acquired information about the pixel, at least one of hue and brightness differs in stages from the first patch having the same color as the color of the pixel specified by the user and the color of the first patch. Displaying an editing palette having a second patch of a plurality of types of colors;
An image editing program characterized by executing

(A) an image reading unit for reading an image from a document;
(B) an image display unit on which the image read by the image reading unit is displayed;
(C) an information acquisition unit that acquires information regarding pixels arbitrarily designated by the user on the image displayed on the image display unit;
(D) Based on the information about the pixel acquired by the information acquisition unit, the first patch of the same color as the color of the pixel specified by the user, and the hue and brightness of the color of the first patch A palette display control unit that displays an editing palette having second patches of a plurality of types of colors, at least one of which is different in stages,
An image reading system comprising (E).

Reading the image from the document,
Displaying the read image on the image display unit;
Obtaining information on pixels arbitrarily designated by the user on the image displayed on the image display unit;
Based on the acquired information relating to the pixel, at least one of hue and brightness of the first patch having the same color as the color of the pixel specified by the user and the color of the first patch is stepwise. Displaying an editing palette having second patches of different types of colors;
An image reading method comprising:

=== Overview of Image Reading System etc. ===
Embodiments of an image reading system and the like according to the present invention will be described below. 1 to 4 describe an embodiment of an image reading system. FIG. 1 illustrates an embodiment of an image reading system. FIG. 2 is a diagram illustrating an example of the internal configuration of the image reading apparatus. FIG. 3 is a diagram illustrating an example of a system configuration of the image reading apparatus. FIG. 4 is a diagram for explaining the system configuration of the computer apparatus.

  As shown in FIG. 1, the image reading system 2 includes an image reading device 10 and a computer device 20 connected to the image reading device 10 so as to be communicable by wire or wireless. As shown in FIG. 1, the image reading device 10 is a device generally called an image scanner, and includes a document table 12 and a document table cover 14 that opens and closes the upper surface of the document table 12. A document 15 from which an image is read is set on the document table 12. The document table cover 14 is provided at the rear end portion of the document table 12 through a hinge portion 18 so as to be freely opened and closed.

  On the other hand, the computer device 20 includes, for example, a computer main body 22, a display device 24, and an input device 26 as shown in FIG. The computer main body 22 includes various computers such as a personal computer. Here, the computer main body 22 includes a reading device 32 such as an FD drive device 28 or a CD-ROM drive device 30 therein. In addition, the computer main body 22 may include, for example, an MO (Magnet Optical) disk drive device or a DVD drive device. The display device 24 includes various display devices such as a CRT display, a plasma display, and a liquid crystal display. The input device 26 includes a keyboard 34, a mouse 36, and the like. Here, the display device 24 corresponds to an “image display unit”.

<Image reading device>
As shown in FIG. 2, a carriage 40 and the carriage 40 are arranged in parallel with each other along the direction of arrow A in FIG. A drive mechanism 42 for moving the vehicle and a guide 44 for guiding the movement while supporting the carriage 40 are provided.

  The carriage 40 has an exposure lamp 46 as a light source for irradiating light on the document 15 via the document table 12, a lens 48 on which reflected light reflected by the document 15 is incident, and the inside of the carriage 40 through the lens 48. And an image sensor 50 for receiving the reflected light taken in. The image sensor 50 includes a linear CCD sensor or the like in which photoelectric conversion elements such as photodiodes that convert optical signals into electric signals are arranged in a line. The image data read by the image sensor 50 is output to the control unit 52.

  The drive mechanism 42 includes a timing belt 54 connected to the carriage 40, a pair of pulleys 55, 56 around which the timing belt 54 is stretched, and a drive motor 58 that rotationally drives one pulley 55. Yes. The drive motor 58 is driven and controlled by a control signal from the control unit 52.

  As shown in FIG. 3, the control unit 52 includes a controller 60, a motor control unit 62, a lamp control unit 64, a sensor control unit 66, an AFE (Analog Front End) unit 68, a digital processing circuit 70, And an interface circuit 72. Further, the AFE (Analog Front End) unit 68 includes an analog signal processing circuit 74 and an A / D conversion circuit 76.

  The controller 60 controls the motor control unit 62, the lamp control unit 64, the sensor control unit 66, the AFE (Analog Front End) unit 68, the digital processing circuit 70, and the interface circuit 72 based on commands from the computer main body 22. The motor control unit 62 performs drive control of the drive motor 58 for moving the carriage 40 according to a command from the controller 60. The lamp control unit 64 controls the light emission of the exposure lamp 46. The sensor control unit 66 controls the image sensor 50.

  An analog signal processing circuit 74 of an AFE (Analog Front End) unit 68 performs signal processing on an analog signal of an image read by the image sensor 50. An A / D conversion circuit 76 in an AFE (Analog Front End) unit 68 performs A / D conversion of the image signal processed by the analog signal processing circuit 74 into a digital signal.

  The digital processing circuit 70 performs digital signal processing on the digital signal sent from the A / D conversion circuit 76 of the AFE (Analog Front End) unit 68. Here, specifically, various image processing and the like are performed, including correction processing such as shading correction. The digital signal subjected to the digital signal processing is output as image data (image data) read from the document 15 to the outside, that is, to the computer main body 22 to which the image reading apparatus 10 is connected in this case. The In addition to this, the interface circuit 72 receives commands (commands) and the like from the computer main body 22 to the image reading apparatus 10.

<Computer body>
As shown in FIG. 4, the computer main body 22 includes a CPU 80, a memory 82, an HDD (Hard Disk Drive Device) 84, an operation input unit 86, a display control unit 88, an external communication unit 90, and a bus 92. I have. In addition, the computer main body 22 includes the CD-ROM drive device 30 and the FD drive device 28 described above. The CPU 80, the memory 82, the HDD (Hard Disk Drive Device) 84, the CD-ROM drive device 30, the FD drive device 28, the operation input unit 86, the display control unit 88, and the external communication unit 90 are buses. 92 are communicably connected to each other.

  The CPU 80 performs overall control of the computer main body 22. The memory 82 is for storing various data such as a program executed by the CPU 80 and work data used by the program. An HDD (Hard Disk Drive Device) 84 stores an operating system (OS) executed by the CPU 80, various programs such as various application programs and drivers, and various other data such as image data. Yes. The operation input unit 86 is connected to the input device 26 such as the keyboard 34 and the mouse 36, and acquires information input by the user through the input device 26. Here, the operation input unit 86 corresponds to an “information acquisition unit”. Further, the display control unit 88 controls an image displayed on the screen of the display device 24 based on a command from the CPU 80. The external communication unit 90 communicates with various peripheral devices such as the image reading apparatus 10 connected to the outside of the computer main body 22.

  The CPU 80 reads out a program from an HDD (Hard Disk Drive Device) 84 and executes various programs under an operating system (OS). The programs executed here include various applications programs and various drivers for controlling the image reading device 10, the operation input unit 86, the display control unit 88, and the like.

  A driver for controlling the image reading apparatus 10 is generally called a scanner driver. The scanner driver is a program installed in the computer main body 22 through various communication lines such as the Internet and various storage media such as a CD-ROM and a floppy disk (FD). When the scanner driver is installed in the computer main body 22, the computer main body 22 functions as a control device that controls the image reading apparatus 10.

=== Scanner Driver ===
Next, an example of the user interface of the scanner driver will be described. FIG. 5 shows the main dialog box 100 of this user interface. The CPU 80 of the computer main body 22 displays this user interface on the display screen of the display device 24 through the display control unit 88. The user can make various settings of the scanner driver through the input device 26 such as the keyboard 34 and the mouse 36 while looking at the dialog box 100 of the user interface displayed on the display screen of the display device 24.

  The main dialog box 100 includes a “mode selection field” 102, a “setting storage field” 104, an “original setting field” 106, an “output setting field” 108, and an “adjustment field” 110. ing. In the “mode selection field” 102, the user can select one mode from a plurality of modes. Here, “professional mode” is selected. In the “setting storage field” 104, the user can save or delete the current setting by clicking the “save button” or “delete button”.

  Further, in the “original setting field” 106, the user can set each of “original type” 112, “reading device” 114, and “automatic exposure” 116. In the “original type” 112, the type of original set can be selected. For example, “reflection original”, “film”, or the like can be selected. In the “reading device” 114, for example, “original table” can be selected. In the “automatic exposure” 116, an exposure setting suitable for the type of document to be read can be performed. For example, “photo orientation”, “document orientation”, and the like can be selected.

  In the “output setting field” 108, the user can make various settings related to image output. Specifically, in the “output setting field” 108, the “image type” 118 of the output image, “resolution” 120 at the time of reading, “original size” 122 at the time of reading, and “output size” 124 are set. Is possible. In “image type” 118, the number of colors of the read image can be selected from three types of color, gray scale, and monochrome. In “Resolution” 120, the resolution of the read image can be set. In “Original Size” 122, the size of the read image can be set.

  When the “scan button” 126 at the bottom of the dialog box 100 is clicked by the user, the scanner driver controls the external image reading device 10 based on information set by the user through the dialog box 100 to An image is read from a document set on the reading device 10. The image data thus read is sent to the computer main body. When the “preview button” 127 at the bottom of the dialog box 100 is clicked by the user, the scanner driver displays a preview window for displaying the image read by the image reading device 10 on the display screen of the display device 24.

  In addition, the scanner driver has a function of adjusting an image read by the image reading device 10. The read image is adjusted through the “adjustment column” 110 of the main dialog box 100. The “adjustment column” 110 is provided with five buttons and four check boxes for adjusting an image read by the image reading apparatus 10. The five buttons 128A, 128B, 128C, 128D, and 128E are an automatic exposure button 128A, a histogram adjustment button 128B, a density correction button 128C, an image adjustment button 128D, and a color palette adjustment button 128E, respectively. is there. The four check boxes 130A, 130B, 130C, and 130D include an unsharp mask filter check box 130A, a moire removal filter check box 130B, a fading restoration check box 130C, and a dust removal check box 130D, respectively. It is.

  The automatic exposure button 128A is clicked when it is desired to automatically adjust the exposure. The histogram adjustment button 128B is a button that is clicked when it is desired to adjust the brightness of an image. When this histogram adjustment button 128B is clicked, a histogram adjustment dialog box is called up. The density correction button 128C is a button that is clicked when it is desired to correct the density balance of the image. When this density correction button 128C is clicked, a dialog box for density correction is called. The image adjustment button 128D is a button that is clicked when it is desired to adjust the brightness, contrast, saturation, and color balance of the image. When this image adjustment button 128D is clicked, an image adjustment dialog box is called up. The color palette adjustment button 128E is a button that is clicked when it is desired to directly specify a color for an arbitrary position in the image. When the color palette adjustment button 128E is clicked, a color palette adjustment dialog box is called up.

  On the other hand, the unsharp mask filter check box 130A is a check box for instructing whether or not the unsharp mask filter can be used, and is checked when it is desired to sharpen the image. Also, the moire removal filter check box 130B is a check box for instructing whether or not to use a filter that removes moire (mesh shading) generated in the scan of the printed material, and is checked when moire is conspicuous. The color fading restoration check box 130C is checked when restoring the color of the faded photograph. The dust removal check box 130D is checked to reduce dust on the film during film scanning.

=== Image adjustment ===
Next, histogram adjustment, density correction, and image adjustment for performing image adjustment will be described. The color palette adjustment will be described in detail later. 6 to 9 describe the histogram adjustment, the density correction, and the image adjustment, respectively. FIG. 6 shows a histogram adjustment dialog box. FIG. 7 explains a specific adjustment outline of histogram adjustment. FIG. 8 shows a dialog box for density correction. FIG. 9 shows an image adjustment dialog box.

<Histogram adjustment>
In “histogram adjustment”, the brightness of the image is adjusted to improve the appearance of the read image. In the histogram adjustment dialog box 131, as shown in FIG. 6, a histogram display field 132 in which a histogram of an image to be edited is displayed, and a tone curve display in which a tone curve indicating the result of adjustment using the histogram is displayed. A column 134 and a gray balance adjustment column 136 for adjusting the gray balance for removing the color cast are provided. Here, the “histogram” represents the brightness and color distribution of the entire image, and is a graph representing the data distribution (number of pixels) from black to white of the image.

  The histogram display column 132 is provided with a channel column 138 for selecting the type (channel (color)) of the histogram to be displayed. In this channel column 138, it is possible to select from four types of RGB (red, green, blue) all colors, only R (red), only G (green), and only B (blue). If you want to adjust all RGB (red, green, blue) colors, select the top switch in this channel column 138, and a histogram of all RGB (red, green, blue) colors will be displayed on the right. If only the R (red) is to be adjusted, the second switch from the top of the channel field 138 is selected, and a histogram of only R (red) is displayed on the right side. When only G (green) is to be adjusted, when the third switch from the top of the channel field 138 is selected, a histogram of only G (green) is displayed on the right side. If only B (blue) is to be adjusted, selecting the bottom switch from the top of this channel field 138 displays a histogram of only B (blue) on the right side.

  When the displayed histogram is adjusted, the adjustment is performed using the three sliders 140A, 140B, and 140C provided below the displayed histogram. The three sliders 140A, 140B, and 140C are a slider 140A that adjusts shadows, a slider 140B that adjusts gamma, and a slider 140C that adjusts highlights. The slider 140A for adjusting the shadow is represented by a black triangle “▲”. The slider 140B for adjusting gamma is represented by a gray triangle mark. The slider 140C for adjusting the highlight is represented by a white triangle “Δ”. When adjustment is performed using these three sliders 140A, 140B, and 140C, the three sliders 140A, 140B, and 140C are individually moved in the left-right direction. Specifically, the slider 140A for adjusting the shadow is moved so as to be positioned slightly to the right of the left end of the peak of the histogram. Further, the slider 140C for adjusting the highlight is moved so as to be located slightly to the left of the right end of the histogram peak. The slider 140B for adjusting the gamma is adjusted so that the brightness of the intermediate portion is appropriate by moving it to the left and right between the slider 140A for adjusting the shadow and the slider 140C for adjusting the highlight. As a result, the overall light / dark balance of the image to be edited is improved, and the appearance of the image can be improved.

  In addition, the histogram display field 132 is provided with numerical value input fields 142A, 142B, and 142C for directly and directly specifying the positions of the three sliders 140A, 140B, and 140C. A shadow input value is input to the numerical value input field 142A. In addition, the gamma value is input to the numerical value input field 142B. In addition, a highlight input value is input to the numerical value input field 142C. Thereby, it is possible to easily specify the shadow input value, the highlight input value, and the gamma value by directly inputting the numerical value into each numerical value input field 142A, 142B, 142C.

  Further, dropper buttons 143A, 143B, and 143C are provided on the right side of these three numerical value input fields 142A, 142B, and 142C, respectively. These dropper buttons 143A, 143B, and 143C are buttons for directly instructing points from the image to be edited displayed on the preview screen displayed separately from the dialog box for adjusting the histogram. In the three numerical value input fields 142A, 142B, and 142C, numerical values corresponding to points (pixels) designated from the image to be edited on the preview screen are directly input using the dropper buttons 143A, 143B, and 143C. .

  Further, two numerical value input fields 142D and 142E are provided below the two numerical value input fields 142A and 142C to which the shadow input value and the highlight input value are input, respectively. A shadow output value corresponding to the shadow input value is input to the left numeric input field 142D. Further, a highlight output value corresponding to the highlight input value is input to the numerical value input field 142E on the right side.

  For adjustment using these sliders 140A, 140B, and 140C and numerical value input fields 142A, 142B, 142C, 142D, and 142E, RGB (red, green, blue) all colors, R (red) only, G (green) ) And B (blue) only.

  FIG. 7 explains this histogram adjustment in detail. In this histogram adjustment, the shadow input value α01, the shadow output value α03, the highlight input value α02, the highlight output value α04, which are set through the sliders 140A, 140B, 140C or the numerical value input fields 142A, 142B, 142C, 142D, 142E, Based on the gamma value α05, a tone curve representing the correspondence between input data and output data as shown in the figure is defined. That is, the tone curve defined here includes a point T1 (also referred to as a shadow point) defined by the set shadow input value α01 and shadow output value α03, and a set highlight input value α02 and highlight output value α04. It is formed so as to pass through a point T2 (also referred to as a highlight point) defined by. Further, the tone curve is formed so as to swell toward one of the straight lines connecting the points T1 and T2 in accordance with the set gamma value α05. Based on the shadow input value α01, the shadow output value α03, the highlight input value α02, the highlight output value α04, and the gamma value α05 set in this way, a tone curve representing the correspondence between the input data and the output data is obtained. It is prescribed. The tone curve is defined for each color of R (red), G (green), and B (blue).

  The tone curve thus defined is displayed in the tone curve display field 134 as shown in FIG. In the tone curve display field 134, a tone curve corresponding to the adjustment result performed in the histogram display field 132 is displayed. Further, in the tone curve display field 134, the gradation outside the point T1 (shadow point) or the point T2 (highlight point) can be adjusted so that the tone curve can be finely adjusted. Specifically, the end curve shape change buttons 144A and 144B provided at the lower left portion and the upper right portion of the tone curve are clicked, and the desired end curve shape is selected from the displayed pull-down menu. It has become. Here, for example, the end curve shape can be selected from three types of “boost”, “normal”, and “soft”. Here, “boost” is selected when it is desired to remove the unevenness by making the white background part white or making the black background part black. “Normal” is selected when a highlight portion and a shadow portion are expressed as they are. Also, “soft” is selected when returning a pure white part to the original white background or returning a pure black part to the original black background.

  In the gray balance adjustment column 136, a slider 145 for adjusting the gray balance is provided. By moving the slider 145 left and right, the gray balance can be adjusted and the color cast can be removed.

<Density correction>
“Density correction” is an adjustment used when partially changing the expression of light and shade of an image. Specifically, in this “density correction”, the tone curve is adjusted to improve the appearance of the read image. In other words, by adjusting the density curve (tone curve) that changes to shadow (darkest part), midtone (halftone), and highlight (lightest part), the brightness and contrast of the entire image are balanced. Can be finished. Therefore, in the density correction dialog box 150, as shown in FIG. 8, the tone curve display unit 152 and the type (channel (color)) of the tone curve displayed on the tone curve display unit 152 are selected. Channel column 154 is provided.

  In this channel column 154, it is possible to select from all four colors of RGB (red, green, blue), only R (red), only G (green), and only B (blue). If you want to adjust all RGB (red, green, blue) colors, select the top switch in this channel field 154, and the tone curves for all RGB (red, green, blue) colors will be displayed on the right. . In addition, when it is desired to adjust only R (red), when the second switch from the top of the channel field 154 is selected, a tone curve of only R (red) is displayed on the right side. If only G (green) is to be adjusted, selecting the third switch from the top of the channel field 154 displays a tone curve for only G (green) on the right side. If it is desired to adjust only B (blue), the tone curve of only B (blue) is displayed on the right side by selecting the lowest switch from the top of the channel field 154.

  The tone curve display unit 152 displays a tone curve having the horizontal axis as an input value and the vertical axis as an output value. When the output value is set so as not to change with respect to the input value, the tone curve becomes a straight line as shown as line L1 in the figure.

  When the tone curve is adjusted, an arbitrary point is set on the tone curve displayed on the tone curve display unit 152, and the tone curve is adjusted while shifting this point in the vertical and horizontal directions. In the present embodiment, three points P1, P2, and P3 are arbitrarily set on the tone curve displayed on the tone curve display unit 152, and these three points P1, P2, and P3 are set up, down, left, and right from the reference line L1, respectively. Move and move in each direction. As a result, a tone curve desired by the user is formed on the tone curve display portion 152. The coordinates of the three points P1, P2, and P3 can be set through two numerical value input fields 156A and 156B provided on the left side of the tone curve display unit 152, respectively. Here, by inputting an input value in the upper numerical value input field 156A and inputting an output value in the lower numerical value input field 156B, the coordinates of each point P1, P2, and P3 can be set.

  Such adjustment of the tone curve is possible for each of four types of RGB (red, green, blue), R (red) only, G (green) only, and B (blue) only. The tone curve setting can be stored through a density correction setting storage field 158 provided at the top of the density correction dialog box 150.

<Image adjustment>
“Image adjustment” includes (1) brightness adjustment, (2) contrast adjustment, (3) saturation adjustment, and (4) as shown in the image adjustment dialog box 160 of FIG. There are four types of adjustments: color balance adjustments. Further, “(4) Color balance adjustment” includes an adjustment between “cyan (C) -red (R)”, an adjustment between “magenta (M) -green (G)”, and “yellow”. There are three types of adjustments, with adjustments between (Y)-Blue (B) ".

(1) Brightness adjustment “(1) Brightness adjustment” is performed when an image is too bright or too dark. “(1) Brightness adjustment” can be performed by moving the slider 162A to the left or right, or by directly inputting a numerical value into the numerical value input field 164A provided on the right side of the slider 162A.

(2) Contrast adjustment “(2) Contrast adjustment” is performed when the contrast is made clear or, conversely, the difference between brightness and darkness is reduced. “(2) Contrast adjustment” can be performed by moving the slider 162B to the left or right, or by directly inputting a numerical value into the numerical value input field 164B provided on the right side of the slider 162B.

(3) Saturation adjustment “(3) Saturation adjustment” is performed when it is desired to make the color vivid. “(3) Saturation adjustment” can be performed by moving the slider 162C to the left or right, or by directly inputting a numerical value into the numerical value input field 164C provided on the right side of the slider 162C.

(4) Color balance adjustment “(4) Color balance adjustment” is performed when the image is reddish or bluish. “(4) Color balance adjustment” is performed by moving the sliders 162D, 162E, and 162F to the left and right, and in numerical value input fields 164D, 164E, and 164F provided on the right side of the sliders 162D, 162E, and 162F, respectively. This can be done by directly entering a numerical value. As a result, the image can be adjusted to an appropriate hue. Specifically, the strength of cyan and red (R) can be adjusted by moving the adjustment slider 162D between “cyan (C) and red (R)” to the left and right. Further, the strength of magenta (M) and green (G) can be adjusted by moving the adjustment slider 162E between “magenta (M) and green (G)” to the left and right. Further, the strength of yellow (Y) and blue (B) can be adjusted by moving the adjustment slider 162F between “yellow (Y) and blue (B)” to the left and right.

  Here, “(1) Brightness adjustment” and “(4) Color balance adjustment” are all three colors of red (R), green (G), and blue (B), or shades of each color as a whole. This is a process of performing conversion to shift. “(2) Contrast adjustment” is a process of performing conversion to increase or decrease the change in shading for all three colors of red (R), green (G), and blue (B).

On the other hand, “(3) Saturation adjustment” uses the following conversion formulas (1) to (3), for example, for each color of red (R), green (G), and blue (B). This is a process of converting data. Here, input data of each color of red (R), green (G), and blue (B) is indicated by “R”, “G”, and “B”, respectively. Further, output data of each color of red (R), green (G), and blue (B) are indicated by “R ′”, “G ′”, and “B ′”, respectively.
R ′ = S11 × R + S12 × G + S13 × B (1)
G ′ = S21 × R + S22 × G + S23 × B (2)
B ′ = S31 × R + S32 × G + S33 × B (3)
Here, S11, S12, S13, S21, S22, S23, S31, S32, and S33 are coefficients set according to the set saturation value. When increasing the saturation, values larger than “1” are set in S11, S22, and S33, and negative values are set in S12, S13, S21, S23, S31, and S32. In this way, “(3) Saturation adjustment” is executed.

<Setting data>
FIG. 10A to FIG. 10C describe the data set by the histogram adjustment, density correction, and image adjustment, respectively. FIG. 10A explains data set by histogram adjustment. FIG. 10B explains data set by density correction. FIG. 10C explains data set by image adjustment.

  In the case of histogram adjustment, as shown in FIG. 10A, the shadow input values α11, α21, and α31 and the shadow output values α13, α23, and α33 for each color of R (red), G (green), and B (blue) Highlight input values α12, α22, α32, highlight output values α14, α24, α34, and gamma values α15, α25, α35 are set as data. In addition to this, data α41 and α42 relating to the “lower end shape” and “upper end shape” as the end shape of the tone curve and the adjustment value α51 in gray balance adjustment are set as data. The scanner driver stores these data α11, α21, α31, α13, α12, α22, α32, α23, α33, α14, α24, α34, α15, α25, α35, α41, α42, α51 as setting data. These setting data α11, α21, α31, α13, α23, α33, α12, α22, α32, α14, α24, α34, α15, α25, α35, α41, α42, α51 will be described with reference to FIG. 6, for example. In addition to being set by the user through the histogram adjustment dialog box 131, the scanner driver may be automatically set by calculation or the like. The scanner driver uses the stored setting data α11, α21, α31, α13, α23, α33, α12, α22, α32, α14, α24, α34, α15, α25, α35, α41, α42, α51 based on the input image. To adjust the image.

  In the case of density correction, as shown in FIG. 10B, a plurality of points P1, P2, P3... Set on the tone curve for each color of R (red), G (green), and B (blue). The input coordinates β11, β13, β21, β23, β31, β33,... And the output coordinates β12, β14, β22, β24, β32, β34,. The scanner driver inputs the input coordinates β11, β13, β21, β23, β31, β33... And the output coordinates β12, β14, β22, β24, β32, β34. Is stored as setting data. These setting data β11, β13, β21, β23, β31, β33,..., Β12, β14, β22, β24, β32, β34,. Besides being set by the user through the dialog box 150, it may be set automatically by calculation or the like by the scanner driver. The scanner driver executes density correction based on the stored setting data β11, β13, β21, β23, β31, β33..., Β12, β14, β22, β24, β32, β34.

  In the case of image adjustment, as shown in FIG. 10C, the setting value γ1 of “(1) Brightness adjustment”, the setting value γ2 of “(2) Contrast adjustment”, and “(3) Color” Setting value γ3 of “degree adjustment” and setting values γ4, γ5, and γ6 of “(4) Color balance adjustment” are set. “(4) Color balance adjustment” includes a setting value γ4 between “cyan (C) -red (R)” and a setting value γ5 between “magenta (M) -green (G)”. And a set value γ6 between “yellow (Y) -blue (B)”. The scanner driver stores these setting values γ1, γ2, γ3, γ4, γ5, and γ6 as setting data. These setting data γ1, γ2, γ3, γ4, γ5, and γ6 are set by the user through the image adjustment dialog box 160 described with reference to FIG. May be set automatically. The scanner driver performs image adjustment based on the stored setting data γ1, γ2, γ3, γ4, γ5, and γ6.

=== Adjustment procedure ===
An example of a procedure for adjusting an input image, that is, an image read by the image reading device 10 based on data set by the histogram adjustment, density correction, and image adjustment will be described. FIG. 11A shows an example of this procedure.

  The scanner driver performs histogram adjustment on the input image, that is, the image read by the image reading device 10 here (S002). In this histogram adjustment, the scanner driver adjusts R (red), G (green), and B (blue) based on tone curves defined for R (red), G (green), and B (blue), respectively. Data Rin, Gin, Bin of each pixel of the input image is converted and output for each color. Here, the scanner driver is set by the user through the histogram adjustment dialog box 131 described with reference to FIG. 6 or automatically set for each color of R (red), G (green), and B (blue). Shadow input values α11, α21, α31, shadow output values α13, α23, α33, highlight input values α12, α22, α32, highlight output values α14, α24, α34, gamma values α15, α25, α35, and others The histogram adjustment is executed based on these data with reference to the data α41 and α42 of the end shape of the tone curve and the adjustment value α51 of the gray balance adjustment. Thus, the scanner driver converts the data Rin, Gin, Bin (input data) of each pixel of the input image into output data Rout1, Gout1, Bout1, and outputs the converted data.

  After performing the histogram adjustment in this way, the scanner driver proceeds to step S004, and performs image adjustment on the image data on which the histogram adjustment has been performed (S004). Here, the scanner driver performs (1) brightness adjustment, (2) contrast adjustment, and (3) color balance adjustment as image adjustment. That is, the scanner driver sets the setting value γ1 of “(1) Brightness adjustment”, the setting value γ2 of “(2) Contrast adjustment”, and the setting values γ4, γ5 of “(4) Color balance adjustment”. , And γ6 are adjusted respectively. As a result, the scanner driver converts the output data Rout1, Gout1, and Bout1 resulting from the histogram adjustment into output data Rout2, Gout2, and Bout2, and outputs them.

  Then, after performing image adjustment (excluding (3) saturation adjustment) in this way, the scanner driver proceeds to step S006, and performs density correction on the image data subjected to image adjustment. (S006). In this density correction, the scanner driver adjusts R (red), G (green), and B (blue) based on tone curves adjusted for R (red), G (green), and B (blue), respectively. Data of each pixel of the input image is converted and output for each color. That is, here, the scanner driver inputs the input coordinates β11 of a plurality of points P1, P2, P3,... Set on the tone curve for each color of R (red), G (green), and B (blue). Referring to the setting data of β13, β21, β23, β31, β33 ………… and output coordinates β12, β14, β22, β24, β32, β34 …………, the tone curve formed based on these setting data Based on the above, density correction is executed. As a result, the scanner driver converts the output data Rout2, Gout2, and Bout2 resulting from image adjustment (excluding (3) saturation adjustment) into output data Rout3, Gout3, and Bout3 and outputs them.

  After performing the density correction in this manner, the scanner driver proceeds to step S008, and performs “(3) Saturation adjustment” as image adjustment on the image data subjected to density correction ( S008). Here, the scanner driver performs adjustment based on the set value γ3 of “(3) Saturation adjustment”. As a result, the scanner driver converts the output data Rout3, Gout3, and Bout3 resulting from the density correction into output data Rout4, Gout4, and Bout4 and outputs them.

  After performing “(3) saturation adjustment” as image adjustment in this way, the scanner driver then performs color conversion on the image data that has been subjected to “(3) saturation adjustment”. Processing is performed (S010). The color conversion process is a process for converting data into data suitable for handling by various output devices (here, display devices, various printers, etc.). Specifically, for example, the following conversion formulas (4) to (6) are used.

R '= A11 * R + A12 * G + A13 * B (4)
G ′ = A21 × R + A22 × G + A23 × B (5)
B '= A31 * R + A32 * G + A33 * B (6)
Here, input data of red (R), green (G), and blue (B) before conversion are indicated by “R”, “G”, and “B”, respectively. Further, output data of each color of red (R), green (G), and blue (B) after conversion is indicated by “R ′”, “G ′”, and “B ′”, respectively. A11, A12, A13, A21, A22, A23, A31, A32, and A33 are coefficients that are appropriately set according to the characteristics of various output devices (display device 24, printer, etc.).

  In this way, the scanner driver performs color conversion processing according to the characteristics of various output devices on the image data on which “(3) saturation adjustment” has been performed. As a result, the scanner driver converts the output data Rout4, Gout4, and Bout4 resulting from image adjustment ((3) saturation adjustment) into output data Rout5, Gout5, and Bout5 and outputs them. Then, after executing the color conversion process in this way, the scanner driver outputs the image subjected to the color conversion process as an output image.

  Although the case where the color conversion process is executed at the final stage has been described as an example here, the color conversion process is executed as necessary.

=== Pre-scan ===
FIG. 11B describes an example of an image reading procedure by the image reading device 10. When an image is read by the image reading device 10, a pre-scan may be executed. For example, in the case of reading an image at a high resolution, this pre-scan does not execute an operation for reading an image at a high resolution from the beginning, but an operation for reading an image at a high resolution (main scan). For example, reading an image at a low resolution once.

  As shown in the figure, the pre-scan is first executed (S050). The scanner driver acquires a pre-scan image (pre-image) by this pre-scan operation (S052). Next, the scanner driver performs automatic adjustment or the like on the acquired pre-scan image (pre-image). Here, the scanner driver obtains an appropriate adjustment value in histogram adjustment, density correction, image adjustment, etc., and automatically corrects the acquired pre-scan image (pre-image) (S054). The automatically corrected image is displayed on the display device 24, for example.

  The user performs various adjustments (corrections) while viewing the pre-scan image (pre-image) displayed on the display device 24 or the like in this way (S056). Here, the user performs various adjustments (corrections) through the histogram adjustment dialog box 131 in FIG. 6, the density correction dialog box 150 in FIG. 8, the image adjustment dialog box 160 in FIG.

  After various adjustments (corrections) are made by the user in this way, the main scan is executed. In this main scan, the image is read from the document 15 with high resolution by the image reading device 10 (S058). The scanner driver performs various adjustments (corrections) such as histogram adjustment, density correction, and image adjustment based on the data set by the user or the like for the high-resolution image acquired by the main scan in this way. To do. Thereby, the main image subjected to various adjustments (corrections) is acquired (S060).

=== Conventional Problems and Solutions ===
<Conventional problems>
By individually setting the histogram adjustment, the density correction, the image adjustment, and the like, the user can perform various adjustments on the image read by the image reading apparatus. However, when the user wants to adjust the image to a desired color, an appropriate adjustment method is selected from various adjustments such as histogram adjustment, density correction, and image adjustment, and the user desires in the adjustment method. Appropriate adjustments must be made through trial and error in order to change to a hue, and it may be very difficult to change to a hue desired by the user. In particular, a large amount of labor is required for users who are not familiar with color adjustment and the like.

  Further, when the user wants to select a desired color when adjusting the hue, it is difficult to easily find the desired color based on the existing color, and it is extremely difficult to smoothly adjust the hue.

<Solution>
Therefore, in the present embodiment, at least one of the first patch having the same color as the pixel color arbitrarily designated by the user on the image to be edited and at least one of hue and brightness with respect to the color of the first patch. By displaying an editing palette that has second patches of different types of colors that differ in stages, the user can easily find the desired color and adjust the hue smoothly. .

  Further, here, the user can arbitrarily designate a pixel on the image to be edited, and the user can directly designate a desired color for the pixel. The scanner driver has a user interface capable of such designation. Through such a user interface, the user can adjust the color of the image to be edited. Thus, the user can easily change the image to be edited to a desired color without performing adjustments by various conventional adjustments such as histogram adjustment, density correction, and image adjustment.

=== Specific Adjustment Method ===
Here, first, the user arbitrarily designates a pixel for which a color is desired to be designated on the image to be adjusted. Next, the user designates a desired color for the designated pixel.

<Pixel specification>
Here, the pixel designation by the user is performed through a preview window in which an image to be edited is displayed. FIG. 12 shows an example of the preview window 170. As shown in the figure, the preview window 170 performs a preview area 172 in which an image to be edited is displayed and various operations such as setting a capture frame and zooming on the image displayed in the preview area 172. And an operation area 174 provided with various operation buttons. In the present embodiment, the preview area 172 includes various adjustments (corrections) performed by the scanner driver or the user on the image read by the image reading apparatus as an image to be edited, that is, histogram adjustment and the like. The image after density correction, image adjustment, etc. is displayed.

  In addition to the image to be edited, the preview area 172 displays a pointer 176 for the user to arbitrarily specify a pixel from the image. The pointer 176 can be arbitrarily moved by the user in the vertical and horizontal directions on the image displayed in the preview area 172. Thus, the user moves the pointer 176 in the vertical and horizontal directions on the image displayed in the preview area 172, stops the pointer 176 at the position of the pixel for which the color is desired, and designates it by an operation.

<Specify color>
Designation of a desired color for a pixel designated by the user is performed through a dialog box for color palette adjustment. FIG. 13 illustrates an example of the dialog box 180 for adjusting the color palette. The dialog box 180 is provided with two types of color palettes, a hue color palette 182 and a lightness color palette 184. These color palettes 182 and 184 correspond to “edit palettes”. The display control unit 88 that displays the color palettes 182 and 184 on the display device 24 as an “editing palette” corresponds to a “palette display control unit”.

  The hue color palette 182 includes a plurality of types of selected color patches 188 having different hues, and a desired color patch can be selected from the plurality of types of selected color patches 188 to specify a color. it can. On the other hand, the lightness color palette 184 has a selection color patch 192 of a plurality of types of colors each having a different lightness, and selects a desired color patch from the plurality of types of selection color patches 192 to designate a color. be able to. The selection color patch 188 of the hue color palette 182 and the selection color patch 192 of the lightness color palette 184 correspond to a “second patch”. The hue color palette 182 and the lightness color palette 184 will be described in detail below.

(1) Hue Color Palette The Hue Color Palette 182 has a designated color patch 186 for indicating the currently designated color, in addition to the selected color patches 188 of a plurality of types of colors having different hues. . The designated color patch 186 corresponds to a “first patch”. The designated color patch 186 is arranged at the center of the selection color patches 188 of a plurality of types of colors. The selected color patches 188 of a plurality of types of colors are arranged around the designated color patch 186 so as to surround the designated color patch 186. The designated color patch 186 and the selection color patch 188 are each formed in a regular hexagonal shape having the same size. The designated color patch 186 and the selection color patch 188 are arranged so that the sides are in close contact with each other. As a result, the designated color patch 186 and the selected color patch 188 have a regular hexagonal shape as a whole.

  The designated color patch 186 located in the center is set to the same color as the pixel arbitrarily designated by the user through the pointer 176 from the image displayed in the preview area 172 of the preview window 170. On the other hand, the selected color patch 188 around the designated color patch 186 is set so that the hue is stepwise different from the color of the designated color patch 186 located at the center. In other words, the color of the selected color patch 188 is set so that the hue is individually different from that of the designated color patch 186. Here, the colors set for each of the selected color patches 188 will be described.

  FIG. 14 describes in detail the colors set in the selected color patch 188 of the hue color palette 182. The color of the selected color patch 188 is set so that the hue gradually differs from the color of the designated color patch 186 outward from the designated color patch 186 with the designated color patch 186 as the center. More specifically, the selected color patch 188 is centered on the specified color patch 186 and is directed upward, downward, diagonally lower left, diagonally upper left, diagonally lower right, and diagonally upper right from the designated color patch 186. The color of each selected color patch 188 is set so that the hue changes to a different color.

  In the upward direction from the designated color patch 186, the colors of the selected color patches Y1, Y2, and Y3 are set so that the yellow (Y) color gradually increases with respect to the color of the designated color patch 186. . Here, the hue changes in three stages from the designated color patch 186 upward. The ratio of the hue change of each selected color patch Y1, Y2, Y3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that yellow (Y) is stronger in the selected color patch Y2 than in the selected color patch Y1. Furthermore, the hue is set so that yellow (Y) is stronger in the selected color patch Y3 than in the selected color patch Y2.

  Further, in the diagonally upper right direction from the designated color patch 186, the colors of the selected color patches R1, R2, and R3 are set so that the color of the red (R) gradually increases with respect to the color of the designated color patch 186. Has been. Here, the hue changes in three steps from the designated color patch 186 toward the diagonally upper right direction. The ratio of the hue change of each selected color patch R1, R2, R3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that red (R) is stronger in the selected color patch R2 than in the selected color patch R1. Furthermore, the hue is set so that the selected color patch R3 has a stronger red (R) than the selected color patch R2.

  Further, in the diagonally lower right direction from the designated color patch 186, the colors of the selected color patches M1, M2, and M3 are respectively set so that the magenta (M) color gradually increases with respect to the color of the designated color patch 186. Is set. Here, the hue changes in three stages from the designated color patch 186 toward the diagonally lower right. The ratio of the hue change of each selected color patch M1, M2, M3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that the selected color patch M2 has a stronger magenta (M) than the selected color patch M1. Furthermore, the hue is set so that the selected color patch M3 has a stronger magenta (M) than the selected color patch M2.

  Further, in the downward direction from the designated color patch 186, the colors of the selected color patches B1, B2, and B3 are set so that the color of blue (B) gradually increases with respect to the color of the designated color patch 186. ing. Here, the hue changes in three stages from the designated color patch 186 downward. The ratio of the hue change of each selected color patch B1, B2, B3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that blue (B) is stronger in the selected color patch B2 than in the selected color patch B1. Furthermore, the hue is set so that blue (B) is stronger in the selected color patch B3 than in the selected color patch B2.

  Further, in the diagonally lower left direction from the designated color patch 186, the colors of the selected color patches C1, C2, and C3 are set so that the cyan (C) color gradually increases with respect to the color of the designated color patch 186. Has been. Here, the hue changes in three steps from the designated color patch 186 toward the diagonally lower left direction. The ratio of the hue change of each selected color patch C1, C2, C3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that cyan (C) is stronger in the selected color patch C2 than in the selected color patch C1. Furthermore, the hue is set so that cyan (C) is stronger in the selected color patch C3 than in the selected color patch C2.

  Further, in the diagonally upper left direction from the designated color patch 186, the colors of the selected color patches G1, G2, and G3 are set so that the color of the green (G) gradually increases with respect to the color of the designated color patch 186. Has been. Here, the hue changes in three steps from the designated color patch 186 toward the diagonally upper left direction. The ratio of the hue change of each selected color patch G1, G2, G3 is set to a ratio of 1: 3: 6, for example. That is, the hue is set so that the selected color patch G2 has a stronger green (G) than the selected color patch G1. Furthermore, the hue is set so that the selected color patch G3 is stronger in green (G) than the selected color patch G2.

  In this way, yellow (Y), red (R), red (R), upward, downward, diagonally lower left, diagonally upper left, diagonally lower right, and diagonally upper right from the central designated color patch 186. Selected color patches Y1, Y2, Y3, R1, R2, R3, M1, M2, M3, B1, whose hue changes to each color of magenta (M), blue (B), cyan (C), and green (G) By providing B2, B3, C1, C2, C3, G1, G2, and G3, the direction of color change is easily understood.

  Furthermore, between the three selection color patches Y1, Y2, Y3 arranged in the upward direction from the designated color patch 186 and the three selection color patches R1, R2, R3 arranged in the diagonally upper right direction from the designated color patch 186, these Selection color patches YR1, YR2, and YR3 having intermediate colors are arranged. Here, the hues of the selection color patches YR2 and YR3 are set so that yellow (Y) or red (R) is stronger than the selection color patch YR1.

  In addition, between the three selection color patches R1, R2, and R3 arranged in the diagonally upper right direction from the designated color patch 186 and between the three selection color patches M1, M2, and M3 arranged in the obliquely lower right direction from the designated color patch 186, Selection color patches RM1, RM2, and RM3 having intermediate colors of these colors are arranged. Here, the hues of the selection color patches RM2 and RM3 are set so that red (R) or magenta (M) is stronger than the selection color patch RM1.

  In addition, between the three selection color patches M1, M2, and M3 arranged obliquely from the designated color patch 186 in the lower right direction and the three selection color patches B1, B2, and B3 arranged downward from the designated color patch 186, Selection color patches BM1, BM2, and BM3 having intermediate colors of these colors are arranged. Here, the hues of the selected color patches BM2 and BM3 are set so that magenta (M) or blue (B) is stronger than the selected color patch BM1.

  Further, between the three selection color patches B1, B2, B3 arranged in the downward direction from the designated color patch 186 and the three selection color patches C1, C2, C3 arranged in the obliquely lower left direction from the designated color patch 186, these Selection color patches CB1, CB2, and CB3 having intermediate colors are arranged. Here, the hues of the selection color patches CB2 and CB3 are set so that cyan (C) or blue (B) is stronger than the selection color patch CB1.

  In addition, between the three selection color patches C1, C2, and C3 arranged in the diagonally lower left direction from the designated color patch 186 and the three selection color patches G1, G2, and G3 arranged in the obliquely upper left direction from the designated color patch 186, Selection color patches GC1, GC2, and GC3 having intermediate colors of these colors are arranged. Here, the hues of the selection color patches GC2 and GC3 are set so that cyan (C) or green (G) is stronger than the selection color patch GC1.

  Also, between the three selection color patches G1, G2, G3 arranged obliquely from the designated color patch 186 in the upper left direction and the three selection color patches Y1, Y2, Y3 arranged upward from the designated color patch 186, these Selection color patches YG1, YG2, and YG3 having intermediate colors are arranged. Here, the hues of the selection color patches YG2 and YG3 are set so that yellow (Y) or green (G) is stronger than the selection color patch YG1.

(2) Lightness Color Palette On the other hand, the lightness color palette 184 indicates the currently designated color, as well as the hue color palette 182, in addition to the selected color patches 192 of a plurality of colors having different hues. The designated color patch 190 is provided. The designated color patch 190 corresponds to a “first patch”. The designated color patch 190 is arranged at the center of the selection color patch 192 of a plurality of types of colors. The selected color patches 192 of a plurality of types of colors are arranged in a straight line along the vertical direction (vertical direction) around the designated color patch 190. The designated color patch 190 and the selection color patch 192 are each formed in a regular hexagonal shape having the same size. The designated color patch 190 and the selection color patch 192 are arranged so that the sides are in close contact with each other.

  The designated color patch 190 located in the center is set to the same color as the pixel arbitrarily designated by the user through the pointer 176 from the image displayed in the preview area 172 of the preview window 170. On the other hand, the selected color patch 192 is set so that the brightness varies stepwise with respect to the color of the designated color patch 190 located at the center. That is, the color of the selected color patch 192 is set so that the brightness is individually different from the color of the designated color patch 190. Here, the color set for each selected color patch 192 will be described.

  FIG. 15 describes in detail the colors set in the selected color patch 192 of the lightness color palette 184. The selected color patch 192 is set such that the brightness varies stepwise with respect to the color of the designated color patch 186 from the designated color patch 186 upward and downward with the designated color patch 186 as the center. Yes.

  In the upward direction from the designated color patch 190, the colors of the selected color patches L1, L2, and L3 are set so that the designated color patch 190 becomes gradually brighter. Here, the brightness changes in three stages from the designated color patch 190 upward. The ratio of the change in brightness of each selected color patch L1, L2, L3 is set to a ratio of 1: 3: 6, for example. That is, the brightness is set so that the selected color patch L2 is brighter than the selected color patch L1. Furthermore, the brightness is set so that the selected color patch L3 is brighter than the selected color patch L2.

  On the other hand, in the downward direction from the designated color patch 190, the colors of the selected color patches D1, D2, and D3 are set so as to gradually darken with respect to the designated color patch 190. Here, the brightness changes in three stages from the designated color patch 190 downward. The ratio of the change in brightness of each selected color patch D1, D2, D3 is set to a ratio of 1: 3: 6, for example. That is, the brightness is set so that the selected color patch D2 is darker than the selected color patch D1. Furthermore, the brightness is set so that the selected color patch D3 is darker than the selected color patch D2.

(3) Color designation The user can select and designate an arbitrary selection color patch from among a plurality of types of color selection color patches 188 and 192 provided in these two color palettes 182 and 184. it can. When one selected color patch is selected by clicking from the plurality of types of selected color patches 188 and 192, the colors of the specified color patches 186 and 190 positioned at the centers of the color palettes 182 and 184 are displayed. The color of the selected color patch 188 or 192 designated by the user is replaced. That is, the color of the selected color patch designated by the user moves to the center where the designated color patches 186 and 190 are located.

  As a result, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are changed. That is, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are changed based on the colors of the designated color patches 186 and 190 newly set by the user. In other words, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are reset so that the hue or brightness changes stepwise with respect to the colors newly set in the designated color patches 186 and 190. It is.

  Further, when the user again clicks and selects an arbitrary selected color patch 188, 192 from among the plurality of selected color patches 188, 192 of the two color palettes 182, 184, the selected color patch 188 selected here is selected. , 192 are newly set as the colors of the designated color patches 186, 190. Then, the colors of the selected color patches 188 and 192 of the two color palettes 182 and 184 are again set and changed again.

  In this way, the user sequentially clicks and selects an arbitrary selected color patch from among the selected color patches 188 and 192 of the plurality of types of colors in the two color palettes 182 and 184, so that the desired color is obtained. You can go closer. As a result, the user can easily find the selected color patch 188, 192 of the desired color.

(4) Other In addition to this, in the color palette adjustment dialog box 180, as shown in FIG. 13, the colors of the designated color patches 186 and 190 respectively arranged at the centers of the two color palettes 182 and 184 are numerically expressed. Three numerical value input fields 194A, 194B, and 194C for specifying are provided. These three numerical value input fields 194A, 194B, and 194C are configured to input numerical values of red (R), green (G), and blue (B), respectively. The user can easily specify a color by inputting numerical values into these three numerical value input fields 194A, 194B, and 194C, respectively.

  Further, the color palette adjustment dialog box 180 is provided with a color storage field 196 for storing the color designated by the user below the two color palettes 182 and 184. In this color storage column 196, nine color storage boxes 198 are provided. The user can store different colors in these nine color storage boxes 198. In order to save colors in these nine color saving boxes 198, the user clicks a save button 197B provided on the upper side of the color saving column 196. If the user wants to specify the color stored in the color storage box 198 as the color of the specified color patch, the user clicks the apply button 197A provided on the upper side of the color storage field 196. As a result, the designated color patches 186 and 190 having the same color as the color stored in the color storage box 198 are displayed on the two color palettes 182 and 184.

  Further, the color palette adjustment dialog box 180 includes an extraction dropper button 195B for calling a pointer for designating an arbitrary pixel on the image to be edited displayed in the preview area of the preview window 170, and the two An application dropper button 195A for applying the color designated on the color palettes 182 and 184, that is, the color of the designated color patch, to any pixel on the image to be edited displayed in the preview area of the preview window 170; Is provided.

=== Adjusting the whole image ===
The scanner driver adjusts the overall color of the image to be edited so that the pixel specified by the user has the color specified by the user. Here, the scanner driver corresponds to a “color adjustment unit”. In this adjustment, the scanner driver does not perform adjustment in the form of post-processing on an image that has already been adjusted or corrected, such as histogram adjustment, density correction, and image adjustment. Alternatively, adjustment is performed by changing the correction. This is because the information of the original image (here, the image read by the image reading device 10) is fully utilized when adjustment is performed in the form of post-processing such as histogram adjustment, density correction, and image adjustment that has already been executed. This is because there is a case where an adverse effect may occur, such as when there is no smooth gradation or when a smooth gradation is lost. The scanner driver adjusts the overall color of the image to be edited while changing these adjustments and corrections that have already been performed, while eliminating these adverse effects. The adjustment method executed here will be described in detail below.

  FIG. 16 explains the outline of the color palette adjustment executed here. Before performing color palette adjustment, as described in FIG. 11A, histogram adjustment is first performed on an input image such as an image read by the image reading apparatus 10 (S102), and then image adjustment is performed ( S104). In this image adjustment, other adjustments except the saturation adjustment, that is, brightness adjustment, contrast adjustment, and color balance adjustment are performed. After performing the image adjustment in this way, the image subjected to the image adjustment is subjected to density correction (S106), and then the saturation is adjusted as the image adjustment (S108). As a result, an output image subjected to various adjustments is acquired from the input image (the image read by the image reading device 10). Here, the color conversion process is omitted.

  Here, it is assumed that an arbitrary pixel is designated on the image to be edited by the user by color palette adjustment, and a desired color is designated by the user for the pixel. The color of the pixel specified by the user is obtained by changing the input color A of the corresponding pixel on the input image to the existing color B through histogram adjustment, density correction, image adjustment, and the like. In order to change the existing color B changed in this way to the designated color C designated by the user, at least one of histogram adjustment, density correction and image adjustment is changed, and the corresponding on the input image is changed. It is necessary to adjust the input color A of the pixel to be changed from the existing color B to the designated color C.

  In this embodiment, in order to change the existing color B to the designated color C, the most upstream adjustment element, that is, here, the histogram adjustment is changed, and the input color A of the corresponding pixel on the input image is designated. Adjust to color C. In this way, in order to change the existing color B of the pixel designated by the user to the designated color C designated by the user, the adjustment element at the most upstream side, that is, the histogram adjustment here, is selected as follows. For reasons. That is, other adjustment elements excluding the most upstream adjustment element, that is, here, for example, an intermediate adjustment element such as image adjustment (excluding saturation), density correction, and saturation adjustment, and a downstream adjustment element are used. This is because if it is selected, overflow may occur. If such an overflow occurs, information of the original image (here, the image read by the image reading device 10) may not be fully utilized, or smooth gradation may be lost. In addition, the reason for selecting the histogram adjustment is that the histogram adjustment has a larger influence on the image than other adjustment elements.

  In order to change the existing color B to the designated color C by changing the histogram adjustment, it is necessary to obtain an appropriate change amount of the histogram adjustment. Here, an appropriate change amount of the histogram adjustment is obtained by the following method.

  FIG. 17 illustrates an example of a procedure for obtaining an appropriate change amount of the histogram adjustment in order to change the existing color B to the designated color C. In order to obtain an appropriate change amount of the histogram adjustment, first, the color specified by the user, that is, the specified color C is subjected to inverse conversion of the saturation adjustment, and the RGB value before the saturation adjustment is performed. Rin1, Gin1, and Bin1 are acquired (S202). Here, the scanner driver performs the inverse conversion of the saturation adjustment based on the setting data for the saturation adjustment, that is, the setting value γ3 here.

  Next, the RGB values Rin1, Gin1, and Bin1 before saturation adjustment obtained in this way are subjected to inverse transformation of density correction, and the RGB values Rin2, Gin2 before density correction are performed. , Bin2 is obtained (S204). Here, the scanner driver sets density correction setting data, that is, a plurality of points P1, P2, P3... Set on the tone curve for each color of R (red), G (green), and B (blue). Refer to the setting data of the input coordinates β11, β13, β21, β23, β31, β33 ………… and the output coordinates β12, β14, β22, β24, β32, β34 ………… Based on the tone curve formed based on the data, inverse conversion of density correction is executed.

  Further, image conversion (excluding saturation) is performed by performing inverse conversion of image adjustment (excluding saturation) on the RGB values Rin2, Gin2, and Bin2 before density correction obtained in this way. The RGB values Rin3, Gin3, and Bin3 before being processed are obtained (S206). Here, the scanner driver sets image adjustment (excluding saturation) setting data, that is, a setting value γ1 of “(1) Brightness adjustment” and a setting value γ2 of “(2) Contrast adjustment”. Based on the set values γ4, γ5, and γ6 of “(4) Color balance adjustment”, inverse conversion of image adjustment (excluding saturation) is executed. Thereby, the RGB values Rin3, Gin3, and Bin3 after the histogram adjustment corresponding to the designated color C are obtained. A color expressed by the RGB values Rin3, Gin3, and Bin3 is set as a target color E here. Then, an appropriate change amount of the histogram adjustment is obtained such that the color D after the histogram adjustment is performed on the input color A becomes the target color E (S208).

In the description of FIG. 17, the description of the reverse conversion of the color conversion process is omitted, but if necessary, the reverse conversion of the color conversion process may be performed. An example of a conversion formula for the inverse conversion of the color conversion process is shown below.
R = A11 ′ × R ′ + A12 ′ × G ′ + A13 ′ × B ′ …………… (4 ′)
G = A21 ′ × R ′ + A22 ′ × G ′ + A23 ′ × B ′ (5 ′)
B = A31 ′ × R ′ + A32 ′ × G ′ + A33 ′ × B ′ (6 ′)
In the conversion formulas (4 ′) to (6 ′), “R”, “G”, and “B” are red (R), green (G), and blue (B) data after reverse conversion. Indicates. In addition, “R ′”, “G ′”, and “B ′” indicate data of each color of red (R), green (G), and blue (B) before reverse conversion. A11 ′, A12 ′, A13 ′, A21 ′, A22 ′, A23 ′, A31 ′, A32 ′, and A33 ′ are appropriately set according to the characteristics of various output devices (display device 24, printer, etc.). It is a coefficient.
With such conversion equations (4 ′) to (6 ′), the inverse conversion of the color conversion process can be easily executed.

<How to determine the amount of change>
FIG. 18 illustrates a method for obtaining the amount of change in histogram adjustment from the RGB value of the target color E. As described with reference to FIG. 17, the output value after changing the histogram adjustment is obtained by performing saturation adjustment, density correction, and inverse image adjustment conversion from the color designated by the user, that is, the designated color C. It becomes the value of each RGB color of the obtained target color E. Therefore, the input / output characteristics of the histogram adjustment after the change are as shown in FIG. 18, the output value after the change of the histogram adjustment, that is, the RGB values of the target color E, and the RGB colors of the designated pixel. The value (input value) must pass through the corresponding point W1. Here, as the input / output characteristics passing through the point W1, various characteristics can be considered as shown in the modification examples (1) to (4) as shown in FIG.

  Here, when the conditions under which the histogram adjustment can be changed while considering the image quality before the change of the histogram adjustment as much as possible are considered, the input / output characteristics as shown in the modified example (3) are preferable. The input / output characteristics of this modified example (3) are the points Q1, at which the output values of the input / output characteristics before the change of the histogram adjustment are the minimum value (here “0”) and the maximum value (here “255”), It is set to pass Q2. In this way, the changed input / output characteristics are expressed in the output image by being set to pass through the minimum and maximum points Q1 and Q2 of the output values of the input / output characteristics before the histogram adjustment is changed. Therefore, it is possible to retain the gray level information as much as possible.

  FIG. 19 illustrates an example of a method for specifically obtaining the change amount of the histogram adjustment by calculation. Here, the output value after changing the histogram adjustment, that is, the RGB values of the target color E and the RGB values (input values) of the designated pixel correspond to the coordinates of the point W1 (80, 122). ). Further, the coordinates of the point W2 corresponding to the output value before the change of the histogram adjustment, that is, the value of each RGB color of the color D and the value (input value) of each RGB color of the designated pixel are (80, 75). . Further, the coordinates of the points Q1 and Q2 at which the output value of the input / output characteristic before the change of the histogram adjustment becomes the minimum value (here “0”) and the maximum value (here “255”) are respectively (30, 0). ), (200, 255).

The input / output characteristics by this histogram adjustment are specified by two input / output points, that is, the coordinates of points Q1 and Q2, and an adjustment parameter called gamma (“γ”) that determines the curve shape. Therefore, if the output value is y and the input value is x, the input / output characteristics by the histogram adjustment can be expressed by the equation y = b × (x−a) ^{1 / γ} . Here, “b” and “a” are coefficients determined by input / output points, that is, points Q 1 and Q 2 and “γ”.

For example, if “γ” before the histogram adjustment is changed to “1”, the following equations (7) and (8) can be derived.
0 = b × (30−a) ^1/1 (7)
255 = b × (200−a) ^1/1 (8)
By solving these two equations (7) and (8), two coefficients “a = 30” and “b = 1.5” can be obtained. From this, the input / output characteristics of the histogram adjustment before the change are expressed by the following relational expression (9).
y = 1.5 × (x−30) ^1/1 (9)

As the input / output characteristics of the histogram adjustment after the change, the gamma value “γ” may be changed when the characteristics pass through the points Q1 and Q2. When the changed gamma value is “γ ′”, the output value before the change is “y”, and the output value after the change is “y ′”, the following relational expression (10) can be derived. . Further, since the output value “y” before the change is “75” at the point W2, and the output value “y ′” after the change is “122” at the point W1, it is changed as follows. "Γ '" can be obtained.
γ ′ = γ × {log (y / 255) / log (y ′ / 255)}
= 1 × {log (75/255) / log (122/255)}
= 1.66 (10)
If “γ ′” after the change is obtained from this equation, “γ ′ = 1.66” is obtained. That is, the target change can be realized by setting the gamma value “γ” to “1.66”.

In this way, the changed gamma value “γ ′” is set to “1.66”, and the input / output characteristics of the changed histogram adjustment are obtained. Here, since the input / output characteristics of the histogram adjustment after the change pass through the points Q1 and Q2 similarly to the input / output characteristics of the histogram adjustment before the change, as in the case described above, the following relational expression (11 ), (12).
0 = b × (30−a) ^{1 / 1.66} (11)
255 = b × (200−a) ^{1 / 1.66} (12)
By solving these two equations (11) and (12), two coefficients “a = 30” and “b = 11.56” can be obtained. From this, the input / output characteristics of the histogram adjustment after the change are expressed by the following relational expression (13).
y = 11.56 × (x−30) ^{1 / 1.66} (13)
In this case, since the coordinates of the points Q1 and Q2 are not changed as the parameters for histogram adjustment, only the gamma value “γ” may be changed from “1.0” to “1.66”.

=== Summary ===
As described above, in the present embodiment, the user can arbitrarily designate a pixel on the image to be edited displayed in the preview window 170, and the user can designate a desired color for the pixel. By doing so, the user can easily change the image to be edited to a desired hue without performing adjustments by various conventional adjustments such as histogram adjustment, density correction, and image adjustment.

  In particular, when the user selects a desired color, color palettes 182 and 184 are displayed on the screen, and the user can select a plurality of different color selection color patches 188 and 192 provided in the color palettes 182 and 184. Since a desired color can be selected from among them, the user can easily find the desired color and specify it easily.

  Further, the color palettes 182 and 184 include a plurality of different color selection color patches 188 and 192 as a plurality of different color selection color patches 188 and 192 that have different hues or lightnesses with respect to the color designated by the user. Since 192 can be displayed, the user can search for a relatively different color around the specified color. As a result, the user can more easily find a desired color.

  Further, by displaying two types of color palettes, a hue color palette 182 and a lightness color palette 184, the user can further expand the selection range and more efficiently find a desired color.

  Further, when adjusting the entire color of the image to be edited based on the color specified by the user, the scanner driver has already been adjusted and corrected, such as histogram adjustment, density correction, and image adjustment. The original image (the image read by the image reading device 10) is not performed by performing adjustment on the image in the form of post-processing, but by performing adjustment by changing the adjustment or correction that has already been performed. It is possible to reduce adverse effects such as failure to make full use of this information or loss of smooth gradation.

  In particular, here, the most upstream adjustment element among a plurality of adjustment elements such as histogram adjustment, density correction, and image adjustment, that is, here, the histogram adjustment is changed to change the overall color of the image to be edited. Since the adjustment is performed, the entire image can be adjusted while avoiding problems such as overflow as much as possible.

=== How to display the hue color palette ===
Here, the display method of the hue color palette 182 will be described in detail. As described with reference to FIG. 14, each selected color patch 188 of the hue color palette 182 has yellow (Y), red (R), magenta (M), blue (B ), Cyan (C), and green (G), the hue is set so as to change.

(1) Uniformity of lightness Here, when setting the color of each selected color patch 188, the RGB value of each selected color patch 188 is simply set to the blue (B) value for the blue (B) direction. Increase the red (R) value for the red (R) direction, decrease the blue (B) value for the yellow (Y) direction, and green (magenta (M) direction for the green ( When the value of G) is decreased and the value of red (R) is decreased in the cyan (C) direction, the brightness changes simultaneously with the hue. If the lightness changes at the same time as the hue, it becomes difficult to select an appropriate hue, and it is necessary to adjust the lightness after adjusting the hue. For this reason, the adjustment by the user becomes complicated. For this reason, it is desirable that the lightness of each selected color patch 188 of the hue color palette 182 does not change so much. In addition, by changing the center color of the hue color palette 182 (the color of the designated color patch 186) each time, various adjustments including large color adjustments are possible by repeating the operation. After adjusting once in the direction of blue (B) and then adjusting once in the direction of yellow (Y), which is the opposite color, it is desirable to return to the same color as before the operation. By doing so, the adjustment can be easily performed again, and the adjustment to the desired color tone becomes easy.

  Therefore, in this embodiment, when setting the color of each selected color patch 188, the value of any one of red (R), green (G), and blue (B) is increased in the direction of each color. Alternatively, when the value is reduced, the remaining two color values are also increased or decreased. Thus, the color brightness of each selected color patch 188 is set to be substantially uniform. FIG. 20 shows red when setting the hue to change in the direction of each color of yellow (Y), red (R), magenta (M), blue (B), cyan (C), and green (G). This is a description of a method for adjusting the values of each color of (R), green (G), and blue (B). As shown in the figure, for the direction of blue (B) (downward in the figure), the value of blue (B) is increased and the values of green (G) and red (R) are decreased. Further, in the direction of red (R) (upward and rightward in the figure), the value of red (R) is increased and the values of green (G) and blue (B) are decreased. Further, for the direction of green (G) (in the upper left direction in the figure), the value of green (G) is increased and the values of red (R) and blue (B) are decreased.

  On the other hand, in the yellow (Y) direction (upward in the figure), the blue (B) value is decreased and the green (G) and red (R) values are increased. In the magenta (M) direction (in the diagonally lower right direction in the figure), the value of green (G) is decreased and the values of red (R) and blue (B) are increased. Further, in the direction of cyan (C) (in the diagonally lower left direction in the figure), the value of red (R) is decreased, and the values of green (G) and blue (B) are respectively increased. In this way, the lightness of each selected color patch 188 having a different hue in the direction of each color of yellow (Y), red (R), magenta (M), blue (B), cyan (C), and green (G) is almost the same. Can be held constant.

<Calculation of RGB color values>
In order to keep the lightness constant while changing the hue, it is necessary to keep the lightness (“L”) calculated from each value of RGB constant. Here, the lightness (“L”) can be obtained by the following calculation formula (14).
L = Kr × R + Kg × G + Kb × B (14)
Here, “R”, “G”, and “B” indicate the values of red (R), green (G), and blue (B), respectively. “Kr”, “Kg”, and “Kb” are coefficients corresponding to red (R), green (G), and blue (B), respectively. The relations “Kg ≧ Kr” and “Kg ≧ Kb” are established. This is because the contribution ratio to the brightness of green (G) is generally high. The values of the coefficients “Kr”, “Kg”, and “Kb” are set to Kr = 0.2, Kg = 0.6, Kb = 0.2, for example.

Here, the RGB values of the designated color patch 186 located at the center are “R0”, “G0”, and “B0”, respectively, and the lightness of the designated color patch 186 is “L0”. Then, the lightness L0 of the color of the designated color patch 186 can be obtained by the following calculation formula (15).
L0 = Kr × R0 + Kg × G0 + Kb × B0 (15)
The color of each selected color patch 188 is set so as to hold this lightness “L0”.

When the hue is changed in the direction of red (R), the value of red (R) is increased, and the values of green (G) and blue (B) are decreased to keep the lightness substantially constant. In order to make red (R) relatively large, green (G) and blue (B) are made smaller by the same amount. When the increase amount of red (R) is “β1” ₁ and the decrease amount of green (G) and blue (B) is “α1”, the following equation (16) is established.
L0 = Kr × R0 + Kg × G0 + Kb × B0
= Kr × (R0 + β1) + Kg × (G0−α1) + Kb × (B0−α1) (16)
From this equation (16), it can be seen that the following relational equation (17) needs to be satisfied.
Kr × β1 + Kg × (−α1) + Kb × (−α1) = 0 (17)
From this relational expression (17), it can be seen that “β1” should be (Kg + Kb) / Kr times “α1”. Here, when Kr = 0.2, Kg = 0.6, and Kb = 0.2, “β1” is four times “α1”. Here, the sum of the increasing and decreasing RGB values is “β1 + α1 = (1+ (Kg + Kb) / Kr) × α1 = 5 × α1”.

On the other hand, when the hue is changed in the direction of green (G), the increase in green (G) is “β2”, the decrease in red (R) and blue (B) is “α2”, and red ( As in the case of R), in order to make the brightness constant, the following relational expression (18) needs to be satisfied.
Kr × (−α 2) + Kg × β 2 + Kb × (−α 2) = 0 (18)
From this relational expression (18), it can be seen that “β2” should be (Kr + Kb) / Kg times “α2”. Here, when Kr = 0.2, Kg = 0.6, and Kb = 0.2, “β2” is 3/2 times “α2”. Here, the total of the RGB values to be increased or decreased is “β 2 + α 2 = (1 + Kg / (Kr + Kb)) × α 2 = 5/2 × α 2”.

On the other hand, when changing the hue in the direction of blue (B), the increase in blue (B) is “β3” and the decrease in red (R) and green (G) is “α3”. In order to make the brightness constant, the following relational expression (19) needs to be satisfied.
Kr × (−α3) + Kg × (−α3) + Kb × β3 = 0 (19)
From this relational expression (19), it is understood that “β3” should be (Kr + Kg) / Kb times “α3”. Here, when Kr = 0.2, Kg = 0.6, and Kb = 0.2, “β3” is four times “α3”. Here, the sum of the increasing and decreasing RGB values is “β3 + α3 = 1 + (Kr + Kg) / Kb × α3 = 5 × α3”.

In order to make the change of the value in each of the red (R), green (G) and blue (B) directions, that is, the total of the increasing and decreasing RGB values uniform, “β1 + α1”, “β2 + α2”, and “β3 + α3” These values may be matched. That is, if the relationship of α1, α2, and α3 that satisfies the following relational expression (20) is satisfied, the hue can be changed in the direction of each color with the same amount of change.
(1+ (Kg + Kb) / Kr) × α1
= (1 + Kg / (Kr + Kb)) × α 2
= (1+ (Kr + Kg) / Kb) × α3 (20)
Here, the relationship between α1, α2, and α3 is obtained by coefficients Kr, Kg, and Kb. When Kr = 0.2, Kg = 0.6, and Kb = 0.2, from “5 × α1 = 5/2 × α2 = 5 × α3”, “α1 = α3, α2 = 2. It can be seen that “× α1” is sufficient.

  In the following description, the case where Kr = 0.2, Kg = 0.6, and Kb = 0.2 will be described as an example, but Kr, Kg, and Kb have different values. However, it can be obtained by a similar calculation method.

  When Kr = 0.2, Kg = 0.6, and Kb = 0.2, the RGB value when the hue changes in the red (R) direction is “R = R0 + 4 × α1, G = G0. −α1, B = B0−α1 ”. The RGB values when the hue changes in the green (G) direction are “R = R0−3 × α1, G = G0 + 2 × α1, B = B0−3 × α1”. The RGB value when the hue changes in the blue (B) direction is “R = R0−α1, G = G0−α1, B = B0 + 4 × α1”.

  On the other hand, the RGB value when the hue changes in the direction of cyan (C) is “R = R0−4 × α1, G = G0 + α1, B = B0 + α1” by reversing the increase / decrease. The RGB values when the hue changes in the magenta (M) direction are “R = R0 + 3 × α1, G = G0-2 × α1, B = B0 + 3 × α1”. The RGB values when the hue changes toward yellow (Y) are “R = R0 + α1, G = G0 + α1, B = B0−4 × α1”.

In this way, each of the selected color patches 188 having different hues in the direction of each color of yellow (Y), red (R), magenta (M), blue (B), cyan (C), and green (G). Set the color. As a result, the following items i) and ii) can be realized.
i) The hue changes in each direction with the brightness kept substantially constant.
ii) When the adjustment on the opposite side to the center color (the color of the designated color patch 186) is performed, the center color is almost the same as that before the adjustment.

(2) Coping method when RGB value is small or large The change in hue is a change in the ratio of each color of red (R): green (G): blue (B). As a simple method of changing this ratio, there is a method of multiplying each RGB value by a constant multiple. That is, for example, when blue (B) is reduced, the value of B can be increased by 0.95. However, when each RGB value is represented by 8 bits (an integer from 0 to 255) as in the present embodiment, for example, the blue (B) value of the color of the designated color patch 186 as the center. Is less than 10, when this is multiplied by 0.95 and rounded to obtain an integer, no change will occur. In other words, if the value of blue (B) is “9”, for example, 9 × 0.95 = 8.55, and if the value after rounding off the decimal point is an integer, it is “9” and does not change. If there is a condition in which no change occurs as described above, a problem that the adjustment is not performed no matter how many times the user repeats the adjustment operation occurs.

  In addition, if the hue change is appropriate for a low-lightness color, the hue change is small for a high-lightness color with a large RGB value, and good adjustment cannot be performed. That is, for example, in the hue color palette 182, it is assumed that the value of blue (B) of the selected color patch 188 changed in the blue (B) direction is increased by one. If the blue (B) value of the central color (the color of the designated color patch 186) is “10”, the blue (B) value of the selected color patch 188 is “10 + 1” and becomes “11”, and 11/10 = 1.1 times, a 10% change. However, when the value of blue (B) of the central color (the color of the designated color patch 186) is “200”, “200 + 1 = 201”, 201/200 = 1.005 times, 0.5% It ’s just a change. Thus, with a change of 0.5%, the change in hue is not sufficiently recognized, and comfortable adjustment cannot be realized.

  Therefore, in this embodiment, such a problem is prevented from occurring by the following method. The method will be described in detail below.

As described above, the selection color patches 188 having different hues in the directions of the colors of yellow (Y), red (R), magenta (M), blue (B), cyan (C), and green (G). The color, that is, the RGB value, can be expressed as an increase or decrease of the central color (the color of the designated color patch 186) to each RGB value. Here, if the coefficient for representing the increase / decrease value of the RGB value of each selected color patch 188 is “K 1”, the RGB value of each selected color patch 188 can be represented by the following equation (21).
(RGB value of each selected color patch) = (RGB value of specified color patch) + K1 × α1
…………… (21)
Here, when Kr = 0.2, Kg = 0.6, and Kb = 0.2, “K1” is a value as shown in FIG.

In this embodiment, in order to prevent the occurrence of the above-described problem, when the RGB value is large, the amount of change having an appropriate size with respect to the RGB value of the center color (the color of the designated color patch 186) is I try to get it. Here, by using the lightness (L0) of the center color (color of the designated color patch 186), when the RGB value is large, the amount of change with respect to the RGB value of the center color (color of the designated color patch 186). The value of “α1” is set so that becomes larger. By performing such a setting, it is possible to prevent the above-described problems. Equation (22) for obtaining the value of “α1” is shown below.
α1 = K2 × L0 …………… (22)
Here, “K2” is a coefficient. As a result, the change amount of the center color (the color of the designated color patch 186) with respect to the RGB value is “K1 × K2 × L0”. For example, the value of R for “K1” in the red (R) direction is K1 = 4. From this, when the lightness (L0) = 100, the amount of change is 400 × K2. Assuming that a value that changes appropriately including fine adjustment under this condition is about 4, K2 = 4/400 = 0.01.

On the other hand, even when the brightness is low, that is, when each value of RGB is small, the absolute value of K1 × α1 is the minimum unit to be displayed in order to obtain a certain change in the numerical value represented. It is necessary to keep the above. For this, the following relational expressions (23) and (24) may be satisfied.
<When truncating the decimal point of the calculation result>
α1 ≧ (1 / K1) …………… (23)
<When rounding off the decimal point of the calculation result>
α1 ≧ (0.5 / K1) …………… (24)
As shown in FIG. 21, when Kr = 0.2, Kg = 0.6, and Kb = 0.2, the minimum value of the absolute value of K1 is “1”. Therefore, when rounding down the decimal point of the calculation result, “α1” should be “1” or more, and if rounding is performed in calculation, it should be “0.5” or more. become. In this embodiment, since the calculation result is rounded off after the decimal point, after obtaining “α1 = K2 × L0” as described above, if “α1” is less than 0.5, “α1 = 0. 5 ”.

From the above, the following item iii) can be realized.
iii) Even if each RGB value is small, it changes reliably, and even when each RGB value is large, an appropriate change can be obtained.

  (3) The amount of change in hue is made different between the inside and outside of the color palette.

  The above calculation is performed on the innermost selected color patch 188 (selected color patches Y1, R1, M1, B1, C1, and G1 in FIG. 14) adjacent to the designated color patch 186 of the hue color palette 182. Applied. Here, the hue color palette 182 can be composed of only the six selected color patches 188 adjacent to the designated color patch 186. However, as described with reference to FIG. Color patches 188 (selected color patches Y2, Y3, R2, R3, M2, M3, B2, B3, C2, C3, G2, G3 in FIG. 14) facilitate color adjustment, A large hue change in the selected color patch 188 is desirable for easy adjustment and easy understanding of the color change.

  Therefore, in the present embodiment, a selection color patch 188 having three hues is provided outside the designated color patch. The colors of the selected color patches 188 having the three stages of hues are set so that the hue changes more as they are located on the outer side.

In order to increase the change in hue as it is located on the outer side, when the calculation is performed by increasing / decreasing each value of RGB as in the present embodiment, the change amount to be increased / decreased is multiplied by a magnification. realizable. The following formulas (25) to (27) describe an example of a method for calculating each RGB value of each selected color patch 188.
<Selected color patch adjacent to the specified color patch>
(Selected color patch value) = (Center color value) + K1 × α1 (25)
<The second selected color patch outside the specified color patch>
(Value of selected color patch) = (Value of center color) + K1 × α1 × m (26)
<The third selected color patch outside the specified color patch>
(Value of selected color patch) = (Value of center color) + K1 × α1 × n (27)
Here, if m> 2 and n> 3, the greater the change in hue is obtained with the patch located on the outer side.

  In the present embodiment, the amount of change is increased toward the outer side by setting m = 3 and n = 6. This makes it possible to adjust a relatively large hue while making the change in hue of the selected color patch 188 adjacent to the designated color patch 186 small enough for fine adjustment. In addition, the overall color change can be easily understood. In this embodiment, the three selected color patches 188 are arranged side by side from the designated color patch 186, but more selected color patches 188 may be arranged side by side. In this case, the same calculation method is possible. The number of selected color patches 188 arranged outside the designated color patch 186 is preferably about 2 to 6 for easy understanding of the hue and operability.

Therefore, the following item iv) can be realized.
iv) A plurality of patches are arranged on the outside, and the amount of hue change increases as the number of patches increases.

(4) Method for setting the color of the intermediate selected color patch In the color palette 184 of the hue of the present embodiment, yellow (Y), red (R), A selection color patch 188 (selected color patches YR1, YR2, YR3, RM1, RM2, in FIG. 14) is also provided in the middle of the direction of each color of magenta (M), blue (B), cyan (C), and green (G). RM3, BM1, BM2, BM3, CB1, CB2, CB3, GC1, GC2, GC3, YG1, YG2, YG3). It is possible to display nothing in this part, but it is easier to understand the change in hue if the selected color patch 188 is also arranged in this part. Regarding the RGB values of the selection color patch 188 located in the middle of these, the six-direction selection color patches existing on both sides of the selection color patch, that is, yellow (Y), red (R), magenta (M) , Blue (B), cyan (C), and green (G) are set to intermediate values of the selected color patches 188 having different hues, thereby obtaining a state in which the hue smoothly changes in the circumferential direction. . The RGB values of the selection color patch 188 (the selection color patches YR 1, RM 1, BM 1, CB 1, GC 1, YG 1 in FIG. 14) located in the second middle outside the designated color patch 186 are expressed by the following equations (28) to (30). Here, “Ri”, “Gi”, “Bi” and “Rj”, “Gj”, “Bj” are selected color patches 188 located on both sides (selected color patches Y2, R2, RGB values of M2, B2, C2, and G2).
R = (Ri + Rj) / 2 (28)
G = (Gi + Gj) / 2 (29)
B = (Bi + Bj) / 2 (30)

Further, a selection color patch 188 located in the third middle outside the designated color patch 186 (in FIG. 14, selection color patches YR2, YR3, RM2, RM3, BM2, BM3, CB2, CB3, GC2, GC3, YG2, The RGB value of YG3) can be obtained by the following equations (31) to (33). Here, “Rh”, “Gh”, “Bh”, “Rk”, “Gk”, and “Bk” are both sides of the selected color patch 188 located in the third middle outside the designated color patch 186. Are the RGB values of the selected color patch 188 (selected color patches Y3, R3, M3, B3, C3, and G3 in FIG. 14). Among these, “Rh”, “Gh”, and “Bh” are RGB values of the adjacent selection color patch 188 on the near side. “Rk”, “Gk”, and “Bk” are the RGB values of the selected color patch 188 on the far side.
R = Rh × 2/3 + Rk / 3 (31)
G = Gh × 2/3 + Gk / 3 (32)
B = Bh × 2/3 + Bk / 3 (3)

  By these formulas (28) to (33), the following matter v) can be realized.

  v) A selection color patch 188 having an appropriate hue is also arranged in the middle of the selection color patch 188 located outside the six directions of each color.

(5) Supplementary items Since the obtained numerical value is finally set as an integer, in this embodiment, the numbers after the decimal point are rounded off. If the RGB value is less than 0, “0” is set, and if the RGB value exceeds 255, “255” is set. This is because numerical values less than 0 or greater than 255 cannot be handled on the premise that each color of RGB in this embodiment is represented by 8 bits (an integer from 0 to 255).

  In addition, here, the case where each color of RGB is represented by 8 bits (for example, an integer from 0 to 255) has been described as an example, but other numbers of bits, for example, 16 bits (an integer from 0 to 65535), etc. Thus, each color of RGB may be represented.

=== How to display the lightness color palette ===
Here, a display method of the lightness color palette 184 will be described in detail. In this embodiment, the selected color patches 192 of the lightness color palette 184 change so that the lightness changes in the direction of lightening and darkening with respect to the color of the designated color patch 190 as described in FIG. Is set.

(1) Uniform Hue In the lightness color palette 184, the RGB value of each selected color patch 192 is set so that the hue is constant, contrary to the hue color palette 182. This facilitates the intended adjustment. In addition, it is desirable that after adjusting once in the direction of increasing the brightness, once returning in the direction of decreasing the brightness, it returns to substantially the same color as before the operation. By doing in this way, it is possible to easily redo the adjustment, and it is possible to easily adjust to the desired color.

  In order to maintain the hue, the ratio of red (R): green (G): blue (B) is kept constant, and the ratio of red (R): green (G): blue (B) is constant. In order to change the values while maintaining the values, each may be multiplied by a constant.

  Here, in the direction of increasing the brightness, the basic principle is to multiply each value of RGB by a constant “K3” for all three colors. In the direction of decreasing the brightness, on the contrary, it is divided by the constant “K3”. That is, 1 / K3 times.

From this, the following items i) and ii) can be realized.
i) Lightness changes with the hue kept substantially constant.
ii) When each adjustment on the opposite side to the center color is performed, the center color is almost the same as before the adjustment.

(2) Coping method when RGB value is small or large However, as in the case of the color palette 182 of the hue described above, in the method of multiplying by a constant, if the RGB value before the change is small, the change does not occur at all. There may be no cases. If there is a condition in which no change occurs, there is a problem that an appropriate adjustment result is not obtained no matter how many times the user repeats the adjustment operation.

Therefore, a process of adding a constant “δ” before multiplying by a constant and subtracting “δ” after multiplying by a constant is performed. That is, if the RGB values before the change are “R”, “G”, “B”, and the RGB values after the change are “R ″”, “G ″”, “B ″”, the brightness is In the one-step change to the higher side, it can be obtained by the following equations (34) to (36).
R ″ = (R + δ) × K3−δ (34)
G ″ = (G + δ) × K3−δ (35)
B ″ = (B + δ) × K3−δ (36)
On the other hand, in the one-step change to the side of decreasing the brightness, it can be obtained by the following equations (37) to (39).
R ″ = (R + δ) / K3−δ (37)
G ″ = (G + δ) / K3−δ (38)
B ″ = (B + δ) / K3−δ (39)
Here, “δ” is a constant given in association with the value of the constant “K3” in order to ensure the change of the value by the above conversion even if the RGB value is low. Even if there is an RGB value of “0”, the condition for changing the value by rounding off is “δ × K3−δ ≧ 0.5”, so that “δ ≧ 0.5 / (K3− 1) ”.

  Here, the value of “K3” is preferably 1.01 to 1.05 because the change in lightness can be finely adjusted at a few percent level. In the embodiment, “K3 = 1.02”. In this case, the condition of “δ” is “δ ≧ 25”, so “δ = 25”.

The correspondence to the fact that a plurality of the selected color patches 192 of the lightness color palette 184 are arranged may be performed by repeating the conversion according to the above equation for each stage.
Further, in the hue color palette 182 described above, the hue change amount is set to be larger for the outer selected color patch 188. However, since the change in lightness is easier to understand than the change in hue, the outer color palette 182 is particularly outside. It is not necessary to make the change as great as that. Of course, it is possible to increase the change toward the outside in the selected color patch 192 of the lightness color palette 184 as well.

As a result, the following item iii) can be realized.
iii) It should change reliably even if the RGB values are small.

  Here, the case where each color of RGB is represented by 8 bits (for example, an integer of 0 to 255) has been described as an example, but other colors such as 16 bits (an integer of 0 to 65535) or the like have been described. Thus, each color of RGB may be represented.

=== Other Embodiments <Part 1> ===
In the above-described embodiment, the color palettes 182 and 184 are displayed as “editing palettes” for the user to designate a desired color for the pixel designated by the user. The “pallet for use” is not necessarily limited to the case where the user designates a desired color for the pixel designated by the user. That is, the color palettes 182 and 184 may be displayed as the “editing palette” for purposes other than the purpose of the user specifying a desired color for the pixel specified by the user.

  In the above-described embodiment, two types of color palettes, namely the hue color palette 182 and the lightness color palette 184, are displayed as the “edit palette”. The two kinds of color palettes 182 and 184 are not necessarily displayed as described above. That is, as the “editing palette”, only one of the hue color palette 182 and the brightness color palette 184 may be displayed.

  Further, as described above, the hue color palette 182 includes hues of yellow (Y), red (R), magenta (M), blue (B), cyan (C), and green (G). The selection color patch 188 (second patch) does not need to be provided so as to change, and if the selection color patch 188 (second patch) is provided so that the hue changes, in any form It does not matter. In the above-described embodiment, the selected color patch 188 (second patch) is arranged so as to surround the designated color patch 186 (first patch) as a center. There is no need to be done.

  Further, as described above, the lightness color palette 184 is not necessarily provided with a plurality of types of selection color patches 192 (second patches) whose lightness changes in the bright direction and the dark direction, respectively. Alternatively, a plurality of types of selection color patches 192 (second patches) whose brightness changes in one of the dark directions may be provided. Of course, as long as the selection color patch 192 (second patch) is provided so that the lightness changes, any form may be used. In the above-described embodiment, the selected color patch 192 (second patch) is arranged linearly in the vertical direction around the designated color patch 190 (first patch). There is no need to be placed.

  In the above-described embodiment, the hue color palette 182 and the lightness color palette 184 are displayed on the screen of the same display device 24 as the preview window 170 on which an image to be edited is displayed as the “edit palette”. However, the “edit palette” here does not necessarily have to be displayed on the screen on which the image to be edited is displayed. That is, the “editing palette” here is displayed on a screen different from the screen on which the image to be edited is displayed, for example, on a display device different from the display device on which the image to be edited is displayed. Also good.

  In the above-described embodiment, the entire color of the image to be edited is changed by changing the histogram adjustment so that the pixel specified by the user becomes the color specified by the user through the color palettes 182 and 184. Although the adjustment has been made, it is not always necessary to adjust the color of the entire image. Furthermore, even when the color of the entire image is adjusted, it is not always necessary to adjust the color by changing the histogram adjustment. That is, the color of the entire image may be adjusted by changing other adjustment elements, density correction, image adjustment, or the like.

  In the above-described embodiment, the order of performing various adjustments (corrections) on an input image such as an image read by the image reading device 10 is <histogram adjustment> → <image adjustment (color). )> → <Density correction> → <Image adjustment (saturation)>, but the order of various adjustments (correction) to be performed on the input image is not limited to this order. It may be in order. That is, for example, <image adjustment (excluding saturation)> → <image adjustment (saturation)> may be performed in this order, and <density correction> → <histogram adjustment> → <image adjustment (excluding saturation). > → <Image adjustment (saturation)>.

=== Other Embodiments <Part 2> ===
As described above, the case where the present invention is applied to an image reading system including an image reading device has been described as an example based on one embodiment, but the above embodiment is for facilitating the understanding of the present invention. It is not intended to limit the invention. The present invention can be changed or improved without departing from the gist thereof, and needless to say, the present invention includes equivalents thereof. In particular, the embodiments described below are also included in the present invention.

<About images>
In the above-described embodiment, an image read from the document 15 by the image reading device 10 is described as an example of the “image”. However, the “image” referred to here is the document read by the image reading device 10. The image read from 15 is not limited. In other words, any image that is edited by the user corresponds to the “image” here.

<About the image display>
In the above-described embodiment, the case of the display device 24 has been described as an example of the “image display unit”. However, in the “image display unit” here, in addition to the display device 24, editing is possible. Any “image display unit” may be used as long as it is an “image display unit” that displays a target image.

<About pixels>
In the above-described embodiment, one pixel arbitrarily designated from the image to be edited has been described as an example of the “pixel”. However, the “pixel” described here is arbitrarily selected as described above. For example, a region may be specified on the image to be edited and a plurality of pixels may be specified, or a user may arbitrarily specify pixels from two or more locations.

<About the information acquisition unit>
In the above-described embodiment, the operation input unit 86 inside the computer apparatus 20 has been described as an example of the “information acquisition unit”. However, the “information acquisition unit” here does not necessarily operate in this manner. It is not necessary to be limited to the input unit 86, and any type of “information acquisition unit” may be used as long as it is an “information acquisition unit” that acquires information regarding pixels arbitrarily designated by the user.

<About the first patch>
In the above-described embodiment, as the “first patch”, the designated color patches 186 and 190 arranged in the center among the selection color patches 188 and 192 of a plurality of types of colors have been described as an example. The “first patch” is not necessarily provided on the editing palette (the hue color palette 182 and the lightness color palette 184) in this manner.

  In the embodiment described above, the designated color patches 186 and 190 having a regular hexagonal shape are provided as the “first patch”. However, the “first patch” here is not necessarily in such a form. It is not necessary to be provided on the editing palette (hue color palette 182 and lightness color palette 184).

<About the second patch>
In the above-described embodiment, as the “second patch”, the selection color patch 188 of a plurality of types of colors arranged so as to surround the specified color patch 186 in the center and the specified color patch 186 in a straight line in the center. However, the “second patch” here is not necessarily limited to the editing palette (the hue color palette 182, It need not be provided on the lightness color palette 184).
In the above-described embodiment, the selection color patches 188 and 196 having a regular hexagonal shape are provided as the “second patch”. However, the “second patch” here is not necessarily in such a form. It is not necessary to be provided on the editing palette (hue color palette 182 and lightness color palette 184).

<About editing palette>
In the above-described embodiment, two color palettes 182 and 184 are displayed in the color palette adjustment dialog box 180 as the “edit palette”, but this is the case with the “edit palette” here. However, the display is not limited to the case of being displayed in the color palette adjustment dialog box 180. That is, the first patch having the same color as the pixel color designated by the user, and the second patch having a plurality of types of colors in which at least one of hue and brightness differs stepwise with respect to the color of the first patch As long as it is an “editing palette” having “”, it may be displayed in any form.

<About the palette display control unit>
In the embodiment described above, the display control unit 88 of the computer main body 22 has been described as an example of the “pallet display control unit”. However, the “pallet display control unit” described here is not necessarily limited to such a computer main body 22. The display control unit 88 is not limited to this. In the above-described embodiment, the two color palettes 182 and 184 as the “editing palette” are displayed on the display device 24 on which the image to be edited is displayed by the display control unit 88 of the computer main body 22. However, if the “editing palette” is displayed on a display unit different from the display device 24 on which the image to be edited is displayed, a “pallet” different from the display control unit 88 of the computer main body 22 is displayed. A display control unit ”may be provided.

1 is an explanatory diagram of an embodiment of an image reading system. FIG. FIG. 3 is an explanatory diagram illustrating an example of an internal configuration of an image reading apparatus. 1 is an explanatory diagram illustrating an example of a system configuration of an image reading apparatus. FIG. Explanatory drawing of an example of the system configuration | structure of a computer main body. FIG. 3 is an explanatory diagram illustrating an example of a main dialog box of a scanner driver. FIG. 5 is an explanatory diagram of an example of a dialog box for adjusting a histogram. Explanatory drawing about the definition method of a tone curve. FIG. 4 is an explanatory diagram of an example of a density correction dialog box. FIG. 4 is an explanatory diagram of an example of an image adjustment dialog box. Explanatory drawing of the data set by histogram adjustment. Explanatory drawing of the data set by density correction. Explanatory drawing of the data set by image adjustment. Explanatory drawing of an example of the adjustment procedure of an image. Explanatory drawing of an example of an image reading procedure. Explanatory drawing of an example of the preview window which displays the image of edit object. FIG. 3 is an explanatory diagram illustrating an example of a color palette adjustment dialog box. Explanatory drawing of an example of the color palette of a hue. Explanatory drawing of an example of the lightness color palette. Explanatory drawing about the outline | summary of color palette adjustment. Explanatory drawing of an example of the procedure which calculates | requires the suitable change amount of histogram adjustment. Explanatory drawing of an example of the method of calculating | requiring the suitable change amount of histogram adjustment. Explanatory drawing of an example of the method of calculating | requiring the change amount of histogram adjustment concretely by an operation. Explanatory drawing of the adjustment method of the value of each RGB color in the color palette of a hue. Explanatory drawing of the value of "K1" in case Kr, Kg, and Kb are predetermined values.

Explanation of symbols

2 image reading system, 10 image reading device, 12 document table,
14 Document cover, 15 Document, 18 Hinge, 20 Computer device,
22 computer body, 24 display device, 26 input device,
28 FD drive device, 30 CD-ROM drive device,
32 readers, 34 keyboards, 36 mice,
40 Carriage, 42 Drive mechanism, 44 Guide, 46 Exposure lamp,
48 lens, 50 image sensor, 52 control unit, 54 timing belt,
55 pulley, 56 pulley, 58 drive motor, 60 controller,
62 motor control unit, 64 lamp control unit, 66 sensor control unit,
68 AFE (Analog Front End) part, 70 Digital processing circuit,
72 interface circuit, 74 analog signal processing circuit, 76 A / D conversion circuit,
80 CPU, 82 memory, 84 HDD (hard disk drive),
86 operation input unit, 88 display control unit, 90 external communication unit, 92 bus,
100 dialog box, 102 “mode selection field”, 104 “save setting”,
106 “Original setting field”, 108 “Output setting field”, 110 “Adjustment field”,
112 “Document Type”, 114 “Scanning Device”, 116 “Auto Exposure”,
118 “Image type”, 120 “Resolution”, 122 “Original size”,
124 “Output Size”, 126 “Scan Button”,
127 “Preview button”,
128A button, 128B button, 128C button, 128D button,
128E button, 130A check box, 130B check box,
130C check box, 130D check box,
130E check box, 131 dialog box,
132 Histogram display field, 134 Tone curve display field,
136 Gray balance adjustment field, 138 channel field,
140A slider, 140B slider, 140C slider,
142A Numerical input field, 142B Numerical input field, 142C Numerical input field,
143A syringe button, 143B syringe button, 143C syringe button,
144A End curve shape change button, 144B End curve shape change button,
145 slider, 150 dialog box, 152 tone curve display area,
154 Channel field, 156A Numerical value input field, 156B Numerical value input field,
158 Density correction setting save field, 160 dialog box,
162A slider, 162B slider, 162C slider,
162D slider, 162E slider, 162F slider,
164A Numerical input field, 164B Numerical input field, 164C Numerical input field,
164D numeric input field, 164E numeric input field, 164F numeric input field,
170 preview window, 172 preview area, 174 operation area,
176 pointer, 180 dialog box, 182 color palette,
184 color palette, 186 specified color patch, 188 selected color patch,
190 Specified color patch, 192 Selected color patch, 194A Numerical value input field,
194B numeric input field, 194C numeric input field, 195A dropper button,
195B dropper button, 196 color storage field, 197A apply button,
197B Save button, 198 color save box

Claims (19)

(A) an image display unit on which an image to be edited is displayed;
(B) a first adjustment unit that performs a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment, and at least one of the other A second adjustment unit that performs a second adjustment that is an adjustment of
An image editing apparatus comprising (C),
Displaying the image subjected to the second adjustment after the first adjustment on the original image on the image display unit;
Obtains information about the specified pixel is specified Ri by the user on the image displayed on the image display unit,
Based on the information on the specified pixel, the a first patch of the same colors as the color of the designated pixel, the plurality of types of color at least one is different from the stages of the hue and lightness with respect to the first patch of the color display the editing palette and a second patch of,
Obtaining information on the designated color designated by the user on the editing palette;
A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
The image editing characterized in that the first adjustment is changed so that the color of the pixel at the position of the designated pixel of the original image becomes the target color by performing the first adjustment. apparatus.   The image editing apparatus according to claim 1, wherein the second patches of the plurality of types of colors are arranged on the editing palette adjacent to each other.   3. The image editing according to claim 1, wherein the first patch is arranged on the editing palette adjacent to at least one of the second patches of the plurality of types of colors. apparatus.   The editing palette is provided with a plurality of types of patches whose hues are different in stages with respect to the color of the first patch as the second patch, and the brightness of the plurality of types of patches is set to be equal to each other. The image editing apparatus according to any one of claims 1 to 3, wherein the image editing apparatus is provided.   The image editing apparatus according to claim 4, wherein an amount of change in hue of the second patch with respect to a color of the first patch differs according to lightness of the first patch.   6. The image editing apparatus according to claim 4, wherein the amount of change in hue between the second patches of the plurality of types of colors whose hues are different in stages with respect to the color of the first patch is different.   7. The second patch of the plurality of types of colors whose hues are different in stages with respect to the color of the first patch are arranged around the first patch as a center. The image editing apparatus according to any one of the above.   The editing palette is provided with a plurality of types of patches whose brightness varies stepwise with respect to the color of the first patch as the second patch, and the hues of the plurality of types of patches are set to be equal to each other. The image editing apparatus according to claim 1, wherein the image editing apparatus is configured.   9. The second patch of the plurality of types of colors whose brightness varies stepwise with respect to the color of the first patch is arranged in a straight line with the first patch as a center. Image editing device.   The editing palette is provided with a patch whose hue is stepwise different from each other in the directions of cyan, magenta, yellow, red, green, and blue with respect to the color of the first patch as the second patch. The image editing apparatus according to claim 1, wherein the image editing apparatus is an image editing apparatus.   In the editing palette, as the second patch, the hue differs in the direction of two kinds of colors selected from cyan, magenta, yellow, red, green and blue with respect to the color of the first patch. The image editing apparatus according to claim 10, wherein a patch is provided.   2. A color storage area for recording a color of a patch designated by a user from among the plurality of types of second patches in the editing palette. The image editing apparatus of any one of -11.   13. The image editing apparatus according to claim 12, wherein a plurality of types of colors of the patch designated by a user can be recorded in the color storage area. When one of the previous SL plurality of second patch color is selected by the user, the display means displays the editing palette color patches of the selected patches were the first patch The image editing apparatus according to any one of claims 1 to 13. Image editing apparatus according to any one of claims 1 to 14, characterized in that to display the previous SL editing pallet on the image display unit. Displaying an image to be edited on the image display unit;
Applying a first adjustment which is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment and color balance adjustment; and at least one of the other adjustments. Two adjustment steps;
An image editing method comprising:
Displaying the image on which the second adjustment has been performed after performing the first adjustment on the original image on the image display unit;
Acquiring information about the specified pixel is specified Ri by the user on the displayed the image in the image display unit,
Based on the information on the specified pixel, the a first patch of the same color as the color of the designated pixel, the plurality of types of color at least one is different in steps of hue and lightness with respect to the first patch of the color Displaying an editing palette having a second patch of
Obtaining information on a designated color designated by the user on the editing palette;
Obtaining a target color by performing inverse transformation of the second adjustment on the designated color;
Changing the first adjustment so that the color of the pixel at the position of the designated pixel in the original image becomes the target color by performing the first adjustment;
An image editing method characterized by comprising: Displaying an image to be edited on the image display unit;
Applying a first adjustment which is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment and color balance adjustment; and at least one of the other adjustments. Two adjustment steps;
An image editing program for executing
Displaying the image on which the second adjustment has been performed after performing the first adjustment on the original image on the image display unit;
Acquiring information about the specified pixel is specified Ri by the user on the displayed the image in the image display unit,
Based on the information on the specified pixel, the a first patch of the same color as the color of the designated pixel, the plurality of types of color at least one is different in steps of hue and lightness with respect to the first patch of the color Displaying an editing palette having a second patch of
Obtaining information on a designated color designated by the user on the editing palette;
Obtaining a target color by performing inverse transformation of the second adjustment on the designated color;
Changing the first adjustment so that the color of the pixel at the position of the designated pixel in the original image becomes the target color by performing the first adjustment;
An image editing program characterized by executing (A) an image reading unit that reads an original image from a document;
An image display unit (B) images are displayed,
(C) a first adjustment unit that performs a first adjustment that is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment, and color balance adjustment, and at least one of the other. A second adjustment unit that performs a second adjustment that is an adjustment of
An image reading system comprising (D),
Displaying the image subjected to the second adjustment after the first adjustment on the original image read by the image reading unit on the image display unit;
Obtains information about the specified pixel is specified Ri by the user on the image displayed on the image display unit,
Based on the information on the specified pixel, the a first patch of the same color as the color of the designated pixel, the plurality of types of color at least one is different in steps of hue and lightness with respect to the first patch of the color display the editing palette and a second patch of,
Obtaining information on the designated color designated by the user on the editing palette;
A target color is obtained by performing an inverse transformation of the second adjustment on the designated color,
The image reading characterized in that the first adjustment is changed so that the color of the pixel at the position of the designated pixel of the original image becomes the target color by performing the first adjustment. system. Reading the original image from the document;
Displaying an image on the image display unit;
Applying a first adjustment which is at least one of histogram adjustment, tone curve adjustment, brightness adjustment, contrast adjustment, saturation adjustment and color balance adjustment; and at least one of the other adjustments. Two adjustment steps;
An image reading method comprising:
Displaying the image subjected to the second adjustment after the first adjustment on the read original image on the image display unit;
Acquiring information about the specified pixel is specified Ri by the user on the displayed the image in the image display unit,
Based on the information on the specified pixel, the a first patch of the same color as the color of the designated pixel, the plurality of types of color at least one is different in steps of hue and lightness with respect to the first patch of the color Displaying an editing palette having a second patch of
Obtaining information on a designated color designated by the user on the editing palette;
Obtaining a target color by performing inverse transformation of the second adjustment on the designated color;
Changing the first adjustment so that the color of the pixel at the position of the designated pixel in the original image becomes the target color by performing the first adjustment;
An image reading method comprising: